developer_uid: chai_backend_admin
submission_id: function_hadeb_2025-12-17
model_name: abtest
model_group:
status: torndown
timestamp: 2025-12-21T00:01:13+00:00
num_battles: 6868
num_wins: 3912
celo_rating: 1341.93
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.5695981362842166
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0406439304351807s
Received healthy response to inference request in 1.9413418769836426s
Received healthy response to inference request in 1.9389400482177734s
Received healthy response to inference request in 2.0343899726867676s
Received healthy response to inference request in 2.0222811698913574s
Received healthy response to inference request in 2.0775818824768066s
Received healthy response to inference request in 1.925520896911621s
Received healthy response to inference request in 2.183723211288452s
Received healthy response to inference request in 1.8449344635009766s
Received healthy response to inference request in 2.1950221061706543s
10 requests
0 failed requests
5th percentile: 1.8811983585357666
10th percentile: 1.9174622535705566
20th percentile: 1.936256217956543
30th percentile: 1.9406213283538818
40th percentile: 1.9899054527282716
50th percentile: 2.0283355712890625
60th percentile: 2.036891555786133
70th percentile: 2.0517253160476683
80th percentile: 2.098810148239136
90th percentile: 2.1848531007766723
95th percentile: 2.1899376034736635
99th percentile: 2.1940052056312562
mean time: 2.0204379558563232
Pipeline stage StressChecker completed in 21.51s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_hadeb_2025-12-17 status is now deployed due to DeploymentManager action
function_hadeb_2025-12-17 status is now inactive due to auto deactivation removed underperforming models
function_hadeb_2025-12-17 status is now torndown due to DeploymentManager action