developer_uid: chai_backend_admin
submission_id: function_kalof_2024-11-24
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-24T08:25:04+00:00
num_battles: 16956
num_wins: 9288
celo_rating: 1285.51
family_friendly_score: 0.5744
family_friendly_standard_error: 0.006992347817435857
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-24
win_ratio: 0.5477707006369427
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5104992389678955s
Received healthy response to inference request in 4.232658386230469s
Received healthy response to inference request in 3.914490222930908s
Received healthy response to inference request in 3.744039535522461s
Received healthy response to inference request in 4.205631256103516s
5 requests
0 failed requests
5th percentile: 3.5572072982788088
10th percentile: 3.6039153575897216
20th percentile: 3.6973314762115477
30th percentile: 3.7781296730041505
40th percentile: 3.846309947967529
50th percentile: 3.914490222930908
60th percentile: 4.0309466361999515
70th percentile: 4.147403049468994
80th percentile: 4.211036682128906
90th percentile: 4.2218475341796875
95th percentile: 4.227252960205078
99th percentile: 4.231577301025391
mean time: 3.92146372795105
%s, retrying in %s seconds...
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.4446053504943848s
Received healthy response to inference request in 3.589602470397949s
Received healthy response to inference request in 3.5732579231262207s
Received healthy response to inference request in 3.705735683441162s
Received healthy response to inference request in 3.5425329208374023s
5 requests
0 failed requests
5th percentile: 3.464190864562988
10th percentile: 3.4837763786315916
20th percentile: 3.522947406768799
30th percentile: 3.548677921295166
40th percentile: 3.5609679222106934
50th percentile: 3.5732579231262207
60th percentile: 3.579795742034912
70th percentile: 3.5863335609436033
80th percentile: 3.6128291130065917
90th percentile: 3.659282398223877
95th percentile: 3.6825090408325196
99th percentile: 3.7010903549194336
mean time: 3.5711468696594237
Pipeline stage StressChecker completed in 39.70s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.39s
Shutdown handler de-registered
function_kalof_2024-11-24 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3418.16s
Shutdown handler de-registered
function_kalof_2024-11-24 status is now inactive due to auto deactivation removed underperforming models