developer_uid: chai_backend_admin
submission_id: function_sojaf_2026-03-06
model_name: function_sojaf_2026-03-06
model_group:
status: torndown
timestamp: 2026-03-10T06:21:55+00:00
num_battles: 11871
num_wins: 6781
celo_rating: 1342.07
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_sojaf_2026-03-06
is_internal_developer: True
ranking_group: single
us_pacific_date: 2026-03-06
win_ratio: 0.5712239912391542
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.844480276107788s
Received healthy response to inference request in 4.540652513504028s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 5.6327831745147705s
Received healthy response to inference request in 5.112927198410034s
Received healthy response to inference request in 4.94977068901062s
Received healthy response to inference request in 4.4533302783966064s
Received healthy response to inference request in 4.4566309452056885s
Received healthy response to inference request in 4.953746795654297s
Received healthy response to inference request in 4.8312718868255615s
Received healthy response to inference request in 4.822687864303589s
Received healthy response to inference request in 4.641998767852783s
Received healthy response to inference request in 4.613164186477661s
Received healthy response to inference request in 4.416633367538452s
Received healthy response to inference request in 5.133866548538208s
Received healthy response to inference request in 4.7829673290252686s
Received healthy response to inference request in 4.61385178565979s
Received healthy response to inference request in 4.571338653564453s
Received healthy response to inference request in 4.816679954528809s
10 requests
0 failed requests
5th percentile: 4.494440650939941
10th percentile: 4.5322503566741945
20th percentile: 4.5652014255523685
30th percentile: 4.601097846031189
40th percentile: 4.630739974975586
50th percentile: 4.736635327339172
60th percentile: 4.836555242538452
Received healthy response to inference request in 4.476030588150024s
70th percentile: 4.876067399978638
10 requests
80th percentile: 4.986589860916138
1 failed requests
90th percentile: 5.183758211135864
5th percentile: 4.433146977424622
95th percentile: 5.408270692825317
10th percentile: 4.449660587310791
99th percentile: 5.58788067817688
20th percentile: 4.471490526199341
mean time: 4.821664524078369
30th percentile: 4.57202410697937
Pipeline stage StressChecker completed in 64.56s
40th percentile: 4.715046072006226
run pipeline stage %s
50th percentile: 4.799823641777039
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
60th percentile: 4.819083118438721
run_pipeline:run_in_cloud %s
70th percentile: 4.8620055437088014
starting trigger_guanaco_pipeline args=%s
80th percentile: 4.985582876205444
90th percentile: 6.734700393676752
triggered trigger_guanaco_pipeline args=%s
95th percentile: 14.032679772376998
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.70s
99th percentile: 19.87106327533722
Shutdown handler de-registered
mean time: 6.377882671356201
function_pobil_2026-03-06 status is now deployed due to DeploymentManager action
%s, retrying in %s seconds...
Received healthy response to inference request in 5.768824577331543s
Received healthy response to inference request in 5.352587461471558s
Received healthy response to inference request in 4.9863972663879395s
Received healthy response to inference request in 5.427667856216431s
Received healthy response to inference request in 4.6996684074401855s
Received healthy response to inference request in 5.46115517616272s
Received healthy response to inference request in 5.845429420471191s
Received healthy response to inference request in 5.806159019470215s
Received healthy response to inference request in 5.818678855895996s
Received healthy response to inference request in 5.80427360534668s
10 requests
0 failed requests
5th percentile: 4.828696393966675
10th percentile: 4.957724380493164
20th percentile: 5.279349422454834
30th percentile: 5.405143737792969
40th percentile: 5.4477602481842045
50th percentile: 5.614989876747131
60th percentile: 5.783004188537598
70th percentile: 5.80483922958374
80th percentile: 5.808662986755371
90th percentile: 5.821353912353516
95th percentile: 5.8333916664123535
99th percentile: 5.843021869659424
mean time: 5.497084164619446
Pipeline stage StressChecker completed in 152.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.94s
Shutdown handler de-registered
function_sojaf_2026-03-06 status is now deployed due to DeploymentManager action
function_sojaf_2026-03-06 status is now inactive due to auto deactivation removed underperforming models
function_sojaf_2026-03-06 status is now torndown due to DeploymentManager action