developer_uid: chai_backend_admin
submission_id: function_sasof_2025-12-17
model_name: function_sasof_2025-12-17
model_group:
status: torndown
timestamp: 2025-12-20T16:21:20+00:00
num_battles: 8132
num_wins: 4137
celo_rating: 1299.29
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_sasof_2025-12-17
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.5087309394982784
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.046165704727173s
Received healthy response to inference request in 5.613494396209717s
Received healthy response to inference request in 11.759938478469849s
Received healthy response to inference request in 3.4502100944519043s
Received healthy response to inference request in 11.497738599777222s
Received healthy response to inference request in 10.043899774551392s
Received healthy response to inference request in 2.472871780395508s
Received healthy response to inference request in 4.839167833328247s
Received healthy response to inference request in 4.3500683307647705s
Received healthy response to inference request in 2.5092759132385254s
10 requests
0 failed requests
5th percentile: 2.4892536401748657
10th percentile: 2.5056354999542236
20th percentile: 3.2620232582092283
30th percentile: 4.08011085987091
40th percentile: 4.643528032302856
50th percentile: 5.226331114768982
60th percentile: 6.986562919616698
70th percentile: 9.345485925674438
80th percentile: 10.334667539596557
90th percentile: 11.523958587646485
95th percentile: 11.641948533058166
99th percentile: 11.736340489387512
mean time: 6.558283090591431
%s, retrying in %s seconds...
Received healthy response to inference request in 18.09374499320984s
Received healthy response to inference request in 4.2260355949401855s
Received healthy response to inference request in 2.7055628299713135s
Received healthy response to inference request in 19.311736583709717s
Received healthy response to inference request in 4.570400238037109s
Received healthy response to inference request in 2.6705076694488525s
Received healthy response to inference request in 6.087053060531616s
Received healthy response to inference request in 12.871068477630615s
Received healthy response to inference request in 1.5224792957305908s
Received healthy response to inference request in 4.850284099578857s
10 requests
0 failed requests
5th percentile: 2.0390920639038086
10th percentile: 2.5557048320770264
20th percentile: 2.698551797866821
30th percentile: 3.7698937654495235
40th percentile: 4.43265438079834
50th percentile: 4.710342168807983
60th percentile: 5.34499168395996
70th percentile: 8.122257685661314
80th percentile: 13.91560378074646
90th percentile: 18.215544152259827
95th percentile: 18.76364036798477
99th percentile: 19.20211734056473
mean time: 7.69088728427887
%s, retrying in %s seconds...
Received healthy response to inference request in 8.520915269851685s
Received healthy response to inference request in 4.471724510192871s
Received healthy response to inference request in 1.6929142475128174s
Received healthy response to inference request in 5.752751111984253s
Received healthy response to inference request in 2.424316883087158s
Received healthy response to inference request in 6.200556039810181s
Received healthy response to inference request in 6.11378026008606s
Received healthy response to inference request in 4.47133469581604s
Received healthy response to inference request in 2.417694568634033s
Received healthy response to inference request in 5.843158006668091s
10 requests
0 failed requests
5th percentile: 2.0190653920173647
10th percentile: 2.3452165365219115
20th percentile: 2.4229924201965334
30th percentile: 3.857229351997375
40th percentile: 4.471568584442139
50th percentile: 5.112237811088562
60th percentile: 5.788913869857788
70th percentile: 5.924344682693482
80th percentile: 6.131135416030884
90th percentile: 6.43259196281433
95th percentile: 7.4767536163330055
99th percentile: 8.312082939147949
mean time: 4.790914559364319
Pipeline stage StressChecker completed in 194.85s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
Shutdown handler de-registered
function_sasof_2025-12-17 status is now deployed due to DeploymentManager action
function_sasof_2025-12-17 status is now inactive due to auto deactivation removed underperforming models
function_sasof_2025-12-17 status is now torndown due to DeploymentManager action