developer_uid: chai_backend_admin
submission_id: function_samin_2025-12-23
model_name: abtest_blend
model_group:
status: torndown
timestamp: 2025-12-27T01:31:38+00:00
num_battles: 5972
num_wins: 3340
celo_rating: 1334.56
family_friendly_score: 0.5544
family_friendly_standard_error: 0.0070290915486995904
submission_type: function
display_name: abtest_blend
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-26
win_ratio: 0.5592766242464836
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2171871662139893s
Received healthy response to inference request in 1.5572757720947266s
Received healthy response to inference request in 1.4980738162994385s
Received healthy response to inference request in 2.05911922454834s
Received healthy response to inference request in 1.5870351791381836s
Received healthy response to inference request in 1.4739034175872803s
Received healthy response to inference request in 1.7295293807983398s
Received healthy response to inference request in 2.081233024597168s
Received healthy response to inference request in 1.9621567726135254s
Received healthy response to inference request in 1.6741180419921875s
10 requests
0 failed requests
5th percentile: 1.4847800970077514
10th percentile: 1.4956567764282227
20th percentile: 1.545435380935669
30th percentile: 1.5781073570251465
40th percentile: 1.639284896850586
50th percentile: 1.7018237113952637
60th percentile: 1.8225803375244138
70th percentile: 1.9912455081939697
80th percentile: 2.0635419845581056
90th percentile: 2.09482843875885
95th percentile: 2.1560078024864193
99th percentile: 2.204951293468475
mean time: 1.783963179588318
Pipeline stage StressChecker completed in 19.98s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
function_samin_2025-12-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2358.82s
Shutdown handler de-registered
function_samin_2025-12-23 status is now inactive due to auto deactivation removed underperforming models
function_samin_2025-12-23 status is now torndown due to DeploymentManager action