developer_uid: chai_backend_admin
submission_id: function_sogar_2024-11-29
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-29T00:01:33+00:00
num_battles: 10368
num_wins: 5247
celo_rating: 1267.51
family_friendly_score: 0.5886
family_friendly_standard_error: 0.006959167191553886
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-28
win_ratio: 0.5060763888888888
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0590426921844482s
Received healthy response to inference request in 2.8812015056610107s
Received healthy response to inference request in 3.1412694454193115s
Received healthy response to inference request in 2.5848655700683594s
Received healthy response to inference request in 3.3904967308044434s
5 requests
0 failed requests
5th percentile: 2.6441327571868896
10th percentile: 2.7033999443054197
20th percentile: 2.8219343185424806
30th percentile: 2.9167697429656982
40th percentile: 2.9879062175750732
50th percentile: 3.0590426921844482
60th percentile: 3.0919333934783935
70th percentile: 3.1248240947723387
80th percentile: 3.191114902496338
90th percentile: 3.2908058166503906
95th percentile: 3.340651273727417
99th percentile: 3.380527639389038
mean time: 3.0113751888275146
Pipeline stage StressChecker completed in 16.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.14s
Shutdown handler de-registered
function_sogar_2024-11-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4009.33s
Shutdown handler de-registered
function_sogar_2024-11-29 status is now inactive due to auto deactivation removed underperforming models