developer_uid: chai_backend_admin
submission_id: function_kobes_2025-12-22
model_name: function_kobes_2025-12-22
model_group:
status: torndown
timestamp: 2025-12-25T13:01:38+00:00
num_battles: 7554
num_wins: 4058
celo_rating: 1319.1
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_kobes_2025-12-22
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-25
win_ratio: 0.5371988350542759
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.695589303970337s
Received healthy response to inference request in 1.9630036354064941s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.7456610202789307s
Received healthy response to inference request in 2.4432449340820312s
Received healthy response to inference request in 2.1445021629333496s
Received healthy response to inference request in 4.50042200088501s
Received healthy response to inference request in 3.8398869037628174s
Received healthy response to inference request in 8.34248661994934s
Received healthy response to inference request in 8.38418960571289s
10 requests
1 failed requests
5th percentile: 2.044677972793579
10th percentile: 2.126352310180664
20th percentile: 2.383496379852295
30th percentile: 2.619885993003845
40th percentile: 2.725632333755493
50th percentile: 3.292773962020874
60th percentile: 4.104100942611694
70th percentile: 5.6530413866043085
80th percentile: 8.35082721710205
90th percentile: 9.556338000297542
95th percentile: 14.831005775928485
99th percentile: 19.05073999643326
mean time: 5.716465973854065
%s, retrying in %s seconds...
Received healthy response to inference request in 7.426215410232544s
Received healthy response to inference request in 5.775066614151001s
Received healthy response to inference request in 9.011595726013184s
Received healthy response to inference request in 8.381230115890503s
Received healthy response to inference request in 4.7285988330841064s
Received healthy response to inference request in 6.438126087188721s
Received healthy response to inference request in 9.02367353439331s
Received healthy response to inference request in 9.05611801147461s
Received healthy response to inference request in 8.278787612915039s
Received healthy response to inference request in 14.174993991851807s
10 requests
0 failed requests
5th percentile: 5.199509334564209
10th percentile: 5.670419836044312
20th percentile: 6.305514192581176
30th percentile: 7.129788613319397
40th percentile: 7.937758731842041
50th percentile: 8.330008864402771
60th percentile: 8.633376359939575
70th percentile: 9.015219068527221
80th percentile: 9.03016242980957
90th percentile: 9.568005609512328
95th percentile: 11.871499800682063
99th percentile: 13.71429515361786
mean time: 8.229440593719483
Pipeline stage StressChecker completed in 144.15s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_kobes_2025-12-22 status is now deployed due to DeploymentManager action
function_kobes_2025-12-22 status is now inactive due to auto deactivation removed underperforming models
function_kobes_2025-12-22 status is now torndown due to DeploymentManager action