developer_uid: chai_backend_admin
submission_id: function_sakek_2024-11-23
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-23T00:34:51+00:00
num_battles: 20052
num_wins: 10462
celo_rating: 1282.5
family_friendly_score: 0.5820000000000001
family_friendly_standard_error: 0.006975327949279518
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-22
win_ratio: 0.5217434669858368
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.142598628997803s
Received healthy response to inference request in 5.999542951583862s
Received healthy response to inference request in 4.663345098495483s
Received healthy response to inference request in 5.220837116241455s
Received healthy response to inference request in 6.907960653305054s
5 requests
0 failed requests
5th percentile: 4.759195804595947
10th percentile: 4.855046510696411
20th percentile: 5.046747922897339
30th percentile: 5.158246326446533
40th percentile: 5.1895417213439945
50th percentile: 5.220837116241455
60th percentile: 5.532319450378418
70th percentile: 5.843801784515381
80th percentile: 6.181226491928101
90th percentile: 6.544593572616577
95th percentile: 6.726277112960815
99th percentile: 6.871623945236206
mean time: 5.586856889724731
%s, retrying in %s seconds...
Received healthy response to inference request in 5.546253442764282s
Received healthy response to inference request in 5.990758657455444s
Received healthy response to inference request in 4.5898847579956055s
Received healthy response to inference request in 7.242397785186768s
Received healthy response to inference request in 3.2662339210510254s
5 requests
0 failed requests
5th percentile: 3.5309640884399416
10th percentile: 3.7956942558288573
20th percentile: 4.325154590606689
30th percentile: 4.781158494949341
40th percentile: 5.163705968856812
50th percentile: 5.546253442764282
60th percentile: 5.724055528640747
70th percentile: 5.901857614517212
80th percentile: 6.241086483001709
90th percentile: 6.741742134094238
95th percentile: 6.992069959640503
99th percentile: 7.192332220077515
mean time: 5.327105712890625
%s, retrying in %s seconds...
Received healthy response to inference request in 4.237219333648682s
Received healthy response to inference request in 3.4197630882263184s
Received healthy response to inference request in 3.6928725242614746s
Received healthy response to inference request in 2.2593936920166016s
Received healthy response to inference request in 2.990339756011963s
5 requests
0 failed requests
5th percentile: 2.405582904815674
10th percentile: 2.551772117614746
20th percentile: 2.8441505432128906
30th percentile: 3.076224422454834
40th percentile: 3.247993755340576
50th percentile: 3.4197630882263184
60th percentile: 3.5290068626403808
70th percentile: 3.638250637054443
80th percentile: 3.8017418861389163
90th percentile: 4.019480609893799
95th percentile: 4.12834997177124
99th percentile: 4.215445461273194
mean time: 3.319917678833008
Pipeline stage StressChecker completed in 75.44s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.10s
Shutdown handler de-registered
function_sakek_2024-11-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2972.11s
Shutdown handler de-registered
function_sakek_2024-11-23 status is now inactive due to auto deactivation removed underperforming models