developer_uid: chai_backend_admin
submission_id: function_hopes_2025-12-23
model_name: abtest_blend
model_group:
status: torndown
timestamp: 2025-12-26T07:31:46+00:00
num_battles: 6577
num_wins: 3858
celo_rating: 1353.92
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest_blend
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-25
win_ratio: 0.5865896305306371
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.7012603282928467s
Received healthy response to inference request in 1.670123815536499s
Received healthy response to inference request in 1.6483731269836426s
Received healthy response to inference request in 1.767930030822754s
Received healthy response to inference request in 1.607259750366211s
Received healthy response to inference request in 1.5190341472625732s
Received healthy response to inference request in 1.5602912902832031s
Received healthy response to inference request in 2.4832324981689453s
Received healthy response to inference request in 2.0556349754333496s
Received healthy response to inference request in 1.6316430568695068s
10 requests
0 failed requests
5th percentile: 1.5375998616218567
10th percentile: 1.5561655759811401
20th percentile: 1.5978660583496094
30th percentile: 1.624328064918518
40th percentile: 1.6416810989379882
50th percentile: 1.6592484712600708
60th percentile: 1.6825784206390382
70th percentile: 1.721261239051819
80th percentile: 1.8254710197448731
90th percentile: 2.098394727706909
95th percentile: 2.2908136129379266
99th percentile: 2.4447487211227417
mean time: 1.7644783020019532
Pipeline stage StressChecker completed in 19.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.55s
Shutdown handler de-registered
function_hopes_2025-12-23 status is now deployed due to DeploymentManager action
function_hopes_2025-12-23 status is now inactive due to auto deactivation removed underperforming models
function_hopes_2025-12-23 status is now torndown due to DeploymentManager action