developer_uid: chai_backend_admin
submission_id: function_bopem_2025-12-19
model_name: abtest_blend
model_group:
status: torndown
timestamp: 2025-12-22T02:01:17+00:00
num_battles: 7700
num_wins: 4061
celo_rating: 1341.53
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest_blend
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.5274025974025974
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6515347957611084s
Received healthy response to inference request in 3.1242783069610596s
Received healthy response to inference request in 3.929607629776001s
Received healthy response to inference request in 6.139521360397339s
Received healthy response to inference request in 4.159054756164551s
Received healthy response to inference request in 4.493962526321411s
Received healthy response to inference request in 4.154578447341919s
Received healthy response to inference request in 4.029350996017456s
Received healthy response to inference request in 4.470717906951904s
Received healthy response to inference request in 3.4841902256011963s
10 requests
0 failed requests
5th percentile: 2.8642693758010864
10th percentile: 3.0770039558410645
20th percentile: 3.412207841873169
30th percentile: 3.7959824085235594
40th percentile: 3.989453649520874
50th percentile: 4.0919647216796875
60th percentile: 4.156368970870972
70th percentile: 4.252553701400757
80th percentile: 4.475366830825806
90th percentile: 4.6585184097290036
95th percentile: 5.399019885063169
99th percentile: 5.991421065330505
mean time: 4.0636796951293945
Pipeline stage StressChecker completed in 42.33s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.53s
Shutdown handler de-registered
function_bopem_2025-12-19 status is now deployed due to DeploymentManager action
function_bopem_2025-12-19 status is now inactive due to auto deactivation removed underperforming models
function_bopem_2025-12-19 status is now torndown due to DeploymentManager action