developer_uid: chai_backend_admin
submission_id: function_dimen_2026-02-16
model_name: g96w8
model_group:
status: torndown
timestamp: 2026-02-20T05:31:31+00:00
num_battles: 10046
num_wins: 5883
celo_rating: 1358.3
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: g96w8
is_internal_developer: True
ranking_group: single
us_pacific_date: 2026-02-16
win_ratio: 0.5856062114274339
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 7.7134692668914795s
Received healthy response to inference request in 4.550084590911865s
Received healthy response to inference request in 4.04619574546814s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.7716128826141357s
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 11.557965517044067s
Received healthy response to inference request in 5.707392930984497s
Received healthy response to inference request in 6.221349716186523s
Received healthy response to inference request in 7.01640248298645s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
10 requests
2 failed requests
5th percentile: 3.3451751708984374
10th percentile: 3.918737459182739
20th percentile: 4.44930682182312
30th percentile: 5.360200428962707
40th percentile: 6.015767002105713
50th percentile: 6.618876099586487
60th percentile: 7.295229196548462
70th percentile: 8.866818141937255
80th percentile: 13.267709159851076
90th percentile: 20.10795385837555
95th percentile: 20.113669431209566
99th percentile: 20.118241889476778
mean time: 8.981054186820984
%s, retrying in %s seconds...
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 4.782448768615723s
Failed to get response for submission chaiml-csfs-v3-3-dpo-lr5e_937_v5: ('http://guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com/models/chaiml-csfs-v3-3-dpo-lr5e_937_v5/predict', '{"detail":"1 validation error for RuntimeResponse\\npredictions\\n Field required [type=missing, input_value={\'detail\': \\"503, message=...o-lr5e_937_v5/predict\'\\"}, input_type=dict]\\n For further information visit https://errors.pydantic.dev/2.12/v/missing"}')
Received healthy response to inference request in 5.801536321640015s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 5.21668553352356s
Received healthy response to inference request in 3.689134359359741s
Received healthy response to inference request in 1.9734208583831787s
Received healthy response to inference request in 5.67471170425415s
Received healthy response to inference request in 3.731398105621338s
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 6.842058420181274s
Received healthy response to inference request in 6.737013101577759s
10 requests
1 failed requests
5th percentile: 2.745491933822632
10th percentile: 3.517563009262085
20th percentile: 3.7229453563690185
30th percentile: 4.467133569717407
40th percentile: 5.042990827560425
50th percentile: 5.445698618888855
60th percentile: 5.725441551208496
70th percentile: 6.082179355621338
80th percentile: 6.758022165298462
90th percentile: 8.170914387702936
95th percentile: 14.150766241550432
99th percentile: 18.93464772462845
mean time: 6.457902526855468
%s, retrying in %s seconds...
Failed to get response for submission chaiml-kimid-v8b-kimid_63800_v21: HTTPConnectionPool(host='guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 4.882551670074463s
Received healthy response to inference request in 3.7043936252593994s
Retrying (%r) after connection broken by '%r': %s
Received healthy response to inference request in 5.510000944137573s
Received healthy response to inference request in 4.7699501514434814s
Received healthy response to inference request in 3.112046718597412s
Received healthy response to inference request in 4.829384803771973s
Received healthy response to inference request in 5.603845834732056s
Received healthy response to inference request in 5.516430377960205s
Received healthy response to inference request in 6.186275243759155s
Received healthy response to inference request in 5.15090799331665s
10 requests
0 failed requests
5th percentile: 3.3786028265953063
10th percentile: 3.6451589345932005
20th percentile: 4.556838846206665
30th percentile: 4.811554408073425
40th percentile: 4.861284923553467
50th percentile: 5.016729831695557
60th percentile: 5.2945451736450195
70th percentile: 5.511929774284363
80th percentile: 5.533913469314575
90th percentile: 5.662088775634765
95th percentile: 5.92418200969696
99th percentile: 6.133856596946717
mean time: 4.9265787363052365
Pipeline stage StressChecker completed in 210.47s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.29s
Shutdown handler de-registered
function_dimen_2026-02-16 status is now deployed due to DeploymentManager action
function_dimen_2026-02-16 status is now inactive due to auto deactivation removed underperforming models
function_dimen_2026-02-16 status is now torndown due to DeploymentManager action