developer_uid: chai_backend_admin
submission_id: function_risub_2026-01-24
model_name: abtest_tai
model_group:
status: inactive
timestamp: 2026-01-24T05:17:47+00:00
num_battles: 11130
num_wins: 5736
celo_rating: 1315.82
family_friendly_score: 0.567
family_friendly_standard_error: 0.007007296197535822
submission_type: function
display_name: abtest_tai
is_internal_developer: True
ranking_group: single
us_pacific_date: 2026-01-23
win_ratio: 0.5153638814016173
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.5777177810668945s
Received healthy response to inference request in 1.3987901210784912s
Received healthy response to inference request in 1.426619052886963s
Received healthy response to inference request in 1.3473443984985352s
Received healthy response to inference request in 1.4208576679229736s
Received healthy response to inference request in 1.264099359512329s
Received healthy response to inference request in 1.4990696907043457s
Received healthy response to inference request in 1.765010118484497s
Received healthy response to inference request in 1.2265477180480957s
Received healthy response to inference request in 1.4312121868133545s
10 requests
0 failed requests
5th percentile: 1.2434459567070006
10th percentile: 1.2603441953659058
20th percentile: 1.330695390701294
30th percentile: 1.3833564043045044
40th percentile: 1.4120306491851806
50th percentile: 1.4237383604049683
60th percentile: 1.4284563064575195
70th percentile: 1.4515694379806519
80th percentile: 1.5147993087768554
90th percentile: 1.5964470148086547
95th percentile: 1.6807285666465757
99th percentile: 1.7481538081169128
mean time: 1.435726809501648
Pipeline stage StressChecker completed in 15.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_risub_2026-01-24 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2259.76s
Shutdown handler de-registered
function_risub_2026-01-24 status is now inactive due to auto deactivation removed underperforming models