developer_uid: chai_backend_admin
submission_id: function_jidof_2025-12-23
model_name: abtest_blend
model_group:
status: torndown
timestamp: 2025-12-26T08:51:21+00:00
num_battles: 5983
num_wins: 3369
celo_rating: 1337.47
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest_blend
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-26
win_ratio: 0.5630954370717032
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2137997150421143s
Received healthy response to inference request in 3.1547253131866455s
Received healthy response to inference request in 3.3669075965881348s
Received healthy response to inference request in 3.6205785274505615s
Received healthy response to inference request in 1.7038886547088623s
Received healthy response to inference request in 2.5763511657714844s
Received healthy response to inference request in 2.6979949474334717s
Received healthy response to inference request in 3.7430644035339355s
Received healthy response to inference request in 4.642521619796753s
Received healthy response to inference request in 2.3406453132629395s
10 requests
0 failed requests
5th percentile: 1.9333486318588258
10th percentile: 2.1628086090087892
20th percentile: 2.3152761936187742
30th percentile: 2.505639410018921
40th percentile: 2.6493374347686767
50th percentile: 2.9263601303100586
60th percentile: 3.239598226547241
70th percentile: 3.443008875846863
80th percentile: 3.6450757026672362
90th percentile: 3.833010125160217
95th percentile: 4.237765872478484
99th percentile: 4.561570470333099
mean time: 3.0060477256774902
Pipeline stage StressChecker completed in 31.24s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.54s
Shutdown handler de-registered
function_jidof_2025-12-23 status is now deployed due to DeploymentManager action
function_jidof_2025-12-23 status is now inactive due to auto deactivation removed underperforming models
function_jidof_2025-12-23 status is now torndown due to DeploymentManager action