developer_uid: chai_backend_admin
submission_id: function_kotot_2025-12-22
model_name: function_kotot_2025-12-22
model_group:
status: torndown
timestamp: 2025-12-25T13:01:39+00:00
num_battles: 6869
num_wins: 3506
celo_rating: 1300.49
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_kotot_2025-12-22
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-25
win_ratio: 0.5104090842917455
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.590061902999878s
Received healthy response to inference request in 4.627769708633423s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.561621904373169s
Received healthy response to inference request in 7.244121789932251s
Received healthy response to inference request in 7.527310848236084s
Received healthy response to inference request in 16.564171075820923s
Received healthy response to inference request in 5.614551544189453s
Received healthy response to inference request in 7.88095760345459s
Received healthy response to inference request in 8.54662823677063s
10 requests
1 failed requests
5th percentile: 4.024419903755188
10th percentile: 4.487217903137207
20th percentile: 4.6202281475067135
30th percentile: 5.3185169935226435
40th percentile: 6.592293691635132
50th percentile: 7.3857163190841675
60th percentile: 7.6687695503234865
70th percentile: 8.080658793449402
80th percentile: 10.15013680458069
90th percentile: 16.92573251724243
95th percentile: 18.552759003639217
99th percentile: 19.854380192756654
mean time: 8.633698010444641
%s, retrying in %s seconds...
Received healthy response to inference request in 12.718851089477539s
Received healthy response to inference request in 5.092612981796265s
Received healthy response to inference request in 11.681043148040771s
Received healthy response to inference request in 9.55311894416809s
Received healthy response to inference request in 8.251907348632812s
Received healthy response to inference request in 5.716358184814453s
Received healthy response to inference request in 14.098022699356079s
Received healthy response to inference request in 6.403386354446411s
Received healthy response to inference request in 9.06438946723938s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
10 requests
1 failed requests
5th percentile: 5.373298323154449
10th percentile: 5.6539836645126345
20th percentile: 6.2659807205200195
30th percentile: 7.697351050376891
40th percentile: 8.739396619796754
50th percentile: 9.308754205703735
60th percentile: 10.404288625717163
70th percentile: 11.992385530471802
80th percentile: 12.994685411453247
90th percentile: 14.699310421943663
95th percentile: 17.405105173587792
99th percentile: 19.56974097490311
mean time: 10.269059014320373
%s, retrying in %s seconds...
Received healthy response to inference request in 8.591224193572998s
Received healthy response to inference request in 3.9772403240203857s
Received healthy response to inference request in 7.979271173477173s
Received healthy response to inference request in 5.842980623245239s
Received healthy response to inference request in 4.487396955490112s
Received healthy response to inference request in 7.886335849761963s
Received healthy response to inference request in 8.246944904327393s
Received healthy response to inference request in 6.303266763687134s
Received healthy response to inference request in 18.67743754386902s
Received healthy response to inference request in 7.921914100646973s
10 requests
0 failed requests
5th percentile: 4.206810808181762
10th percentile: 4.43638129234314
20th percentile: 5.571863889694214
30th percentile: 6.165180921554565
40th percentile: 7.253108215332031
50th percentile: 7.904124975204468
60th percentile: 7.944856929779053
70th percentile: 8.059573292732239
80th percentile: 8.315800762176513
90th percentile: 9.599845528602597
95th percentile: 14.138641536235799
99th percentile: 17.769678342342377
mean time: 7.991401243209839
Pipeline stage StressChecker completed in 272.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.58s
Shutdown handler de-registered
function_kotot_2025-12-22 status is now deployed due to DeploymentManager action
function_kotot_2025-12-22 status is now inactive due to auto deactivation removed underperforming models
function_kotot_2025-12-22 status is now torndown due to DeploymentManager action