developer_uid: chai_backend_admin
submission_id: function_fehak_2025-12-23
model_name: abtest_blend
model_group:
status: torndown
timestamp: 2025-12-26T09:21:34+00:00
num_battles: 6924
num_wins: 4026
celo_rating: 1350.48
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest_blend
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-26
win_ratio: 0.5814558058925476
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6760449409484863s
Received healthy response to inference request in 2.4913837909698486s
Received healthy response to inference request in 2.3258721828460693s
Received healthy response to inference request in 2.2095303535461426s
Received healthy response to inference request in 2.159712791442871s
Received healthy response to inference request in 2.827308177947998s
Received healthy response to inference request in 2.5045547485351562s
Received healthy response to inference request in 2.3839187622070312s
Received healthy response to inference request in 2.0941524505615234s
Received healthy response to inference request in 2.079592227935791s
10 requests
0 failed requests
5th percentile: 2.0861443281173706
10th percentile: 2.09269642829895
20th percentile: 2.1466007232666016
30th percentile: 2.194585084915161
40th percentile: 2.279335451126099
50th percentile: 2.3548954725265503
60th percentile: 2.4269047737121583
70th percentile: 2.495335078239441
80th percentile: 2.5388527870178224
90th percentile: 2.6911712646484376
95th percentile: 2.7592397212982176
99th percentile: 2.8136944866180422
mean time: 2.375207042694092
Pipeline stage StressChecker completed in 31.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.58s
Shutdown handler de-registered
function_fehak_2025-12-23 status is now deployed due to DeploymentManager action
function_fehak_2025-12-23 status is now inactive due to auto deactivation removed underperforming models
function_fehak_2025-12-23 status is now torndown due to DeploymentManager action