developer_uid: chai_backend_admin
submission_id: function_jihar_2025-12-17
model_name: function_jihar_2025-12-17
model_group:
status: torndown
timestamp: 2025-12-20T23:31:08+00:00
num_battles: 5585
num_wins: 2980
celo_rating: 1316.35
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_jihar_2025-12-17
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.5335720680393913
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.249750852584839s
Received healthy response to inference request in 1.7733547687530518s
Received healthy response to inference request in 2.0676770210266113s
Received healthy response to inference request in 3.1292519569396973s
Received healthy response to inference request in 2.301917314529419s
Received healthy response to inference request in 3.337376117706299s
Received healthy response to inference request in 2.474548816680908s
Received healthy response to inference request in 2.7089030742645264s
Received healthy response to inference request in 1.8922951221466064s
10 requests
1 failed requests
5th percentile: 1.8268779277801515
10th percentile: 1.880401086807251
20th percentile: 2.0326006412506104
30th percentile: 2.1951287031173705
40th percentile: 2.2810507297515867
50th percentile: 2.3882330656051636
60th percentile: 2.5682905197143553
70th percentile: 2.8350077390670774
80th percentile: 3.1708767890930174
90th percentile: 5.014835166931146
95th percentile: 12.563400888442974
99th percentile: 18.602253465652467
mean time: 4.204704165458679
%s, retrying in %s seconds...
Received healthy response to inference request in 1.1006853580474854s
Received healthy response to inference request in 1.9033985137939453s
Received healthy response to inference request in 1.9701619148254395s
Received healthy response to inference request in 1.8864803314208984s
Received healthy response to inference request in 3.70139479637146s
Received healthy response to inference request in 1.5274920463562012s
Received healthy response to inference request in 1.2414798736572266s
Received healthy response to inference request in 1.8162744045257568s
Received healthy response to inference request in 2.479909896850586s
Received healthy response to inference request in 1.7482383251190186s
10 requests
0 failed requests
5th percentile: 1.164042890071869
10th percentile: 1.2274004220962524
20th percentile: 1.4702896118164062
30th percentile: 1.6820144414901732
40th percentile: 1.7890599727630616
50th percentile: 1.8513773679733276
60th percentile: 1.8932476043701172
70th percentile: 1.9234275341033935
80th percentile: 2.0721115112304687
90th percentile: 2.602058386802673
95th percentile: 3.1517265915870656
99th percentile: 3.5914611554145814
mean time: 1.9375515460968018
Pipeline stage StressChecker completed in 64.21s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.31s
Shutdown handler de-registered
function_jihar_2025-12-17 status is now deployed due to DeploymentManager action
function_jihar_2025-12-17 status is now inactive due to auto deactivation removed underperforming models
function_jihar_2025-12-17 status is now torndown due to DeploymentManager action