developer_uid: chai_backend_admin
submission_id: function_tadif_2025-12-21
model_name: function_tadif_2025-12-21
model_group:
status: torndown
timestamp: 2025-12-24T23:51:30+00:00
num_battles: 10315
num_wins: 5419
celo_rating: 1310.88
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_tadif_2025-12-21
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-24
win_ratio: 0.5253514299563742
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 4.710402727127075s
Received healthy response to inference request in 5.153509855270386s
Received healthy response to inference request in 11.353303670883179s
Received healthy response to inference request in 13.380281925201416s
Received healthy response to inference request in 15.369930505752563s
Received healthy response to inference request in 7.494310140609741s
Received healthy response to inference request in 3.2894458770751953s
Received healthy response to inference request in 4.669461965560913s
10 requests
2 failed requests
5th percentile: 3.9104531168937684
10th percentile: 4.5314603567123415
20th percentile: 4.702214574813842
30th percentile: 5.020577716827392
40th percentile: 6.557990026473999
50th percentile: 9.42380690574646
60th percentile: 12.164094972610473
70th percentile: 13.97717649936676
80th percentile: 16.331024789810183
90th percentile: 20.22355761528015
95th percentile: 20.44025821685791
99th percentile: 20.613618698120117
mean time: 10.625300741195678
%s, retrying in %s seconds...
Received healthy response to inference request in 8.118950366973877s
Received healthy response to inference request in 7.268665790557861s
Received healthy response to inference request in 8.631340026855469s
Received healthy response to inference request in 4.067746877670288s
Received healthy response to inference request in 6.7038373947143555s
Received healthy response to inference request in 4.604035139083862s
Received healthy response to inference request in 7.138893365859985s
Received healthy response to inference request in 3.493882656097412s
Received healthy response to inference request in 7.286885738372803s
Received healthy response to inference request in 4.302098512649536s
10 requests
0 failed requests
5th percentile: 3.752121555805206
10th percentile: 4.010360455513
20th percentile: 4.255228185653687
30th percentile: 4.513454151153565
40th percentile: 5.863916492462159
50th percentile: 6.92136538028717
60th percentile: 7.190802335739136
70th percentile: 7.274131774902344
80th percentile: 7.453298664093018
90th percentile: 8.170189332962035
95th percentile: 8.400764679908752
99th percentile: 8.585224957466126
mean time: 6.161633586883545
Pipeline stage StressChecker completed in 171.37s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_tadif_2025-12-21 status is now deployed due to DeploymentManager action
function_tadif_2025-12-21 status is now inactive due to auto deactivation removed underperforming models
function_tadif_2025-12-21 status is now torndown due to DeploymentManager action