developer_uid: chai_backend_admin
submission_id: function_fisut_2026-02-15
model_name: abtest_blend
model_group:
status: inactive
timestamp: 2026-02-15T18:47:28+00:00
num_battles: 10404
num_wins: 5054
celo_rating: 1288.56
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest_blend
is_internal_developer: True
ranking_group: single
us_pacific_date: 2026-02-15
win_ratio: 0.4857747020376778
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 3.557827949523926s
Received healthy response to inference request in 3.0084879398345947s
Received healthy response to inference request in 4.079058647155762s
Received healthy response to inference request in 3.2869858741760254s
Received healthy response to inference request in 2.913853168487549s
Received healthy response to inference request in 2.880204200744629s
Received healthy response to inference request in 4.55110239982605s
Received healthy response to inference request in 2.748318910598755s
Received healthy response to inference request in 2.245220422744751s
Received healthy response to inference request in 4.988700866699219s
10 requests
0 failed requests
5th percentile: 2.4716147422790526
10th percentile: 2.6980090618133543
20th percentile: 2.853827142715454
30th percentile: 2.903758478164673
40th percentile: 2.970634031295776
50th percentile: 3.14773690700531
60th percentile: 3.3953227043151855
70th percentile: 3.7141971588134766
80th percentile: 4.173467397689819
90th percentile: 4.594862246513366
95th percentile: 4.791781556606292
99th percentile: 4.949317004680633
mean time: 3.425976037979126
Pipeline stage StressChecker completed in 35.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_fisut_2026-02-15 status is now deployed due to DeploymentManager action
function_fisut_2026-02-15 status is now inactive due to auto deactivation removed underperforming models