developer_uid: chai_backend_admin
submission_id: function_dokus_2025-12-17
model_name: abtest
model_group:
status: torndown
timestamp: 2025-12-20T23:41:33+00:00
num_battles: 6380
num_wins: 3562
celo_rating: 1334.15
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.558307210031348
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8795955181121826s
Received healthy response to inference request in 1.927152156829834s
Received healthy response to inference request in 2.1710476875305176s
Received healthy response to inference request in 2.518298387527466s
Received healthy response to inference request in 1.7341773509979248s
Received healthy response to inference request in 1.9278929233551025s
Received healthy response to inference request in 1.9422380924224854s
Received healthy response to inference request in 2.629929542541504s
Received healthy response to inference request in 2.138693332672119s
Received healthy response to inference request in 2.6816675662994385s
10 requests
0 failed requests
5th percentile: 1.821016013622284
10th percentile: 1.907854676246643
20th percentile: 1.9277447700500487
30th percentile: 1.9379345417022704
40th percentile: 2.060111236572266
50th percentile: 2.1548705101013184
60th percentile: 2.309947967529297
70th percentile: 2.5517877340316772
80th percentile: 2.640277147293091
90th percentile: 2.701460361480713
95th percentile: 2.7905279397964478
99th percentile: 2.8617820024490355
mean time: 2.2550692558288574
Pipeline stage StressChecker completed in 23.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_dokus_2025-12-17 status is now deployed due to DeploymentManager action
function_dokus_2025-12-17 status is now inactive due to auto deactivation removed underperforming models
function_dokus_2025-12-17 status is now torndown due to DeploymentManager action