function_nuset_2026-01-09

developer_uid: chai_backend_admin

submission_id: function_nuset_2026-01-09

model_name: abtest_blend

model_group:

status: torndown

timestamp: 2026-01-14T16:59:58+00:00

num_battles: 1682

num_wins: 919

celo_rating: 9999.0

family_friendly_score: 0.5698

family_friendly_standard_error: 0.007001827761377739

submission_type: function

display_name: abtest_blend

is_internal_developer: True

ranking_group: single

us_pacific_date: 2026-01-09

win_ratio: 0.5463733650416172

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.574786901473999s
Received healthy response to inference request in 1.6720120906829834s
Received healthy response to inference request in 1.5294559001922607s
Received healthy response to inference request in 1.62131667137146s
Received healthy response to inference request in 1.4377520084381104s
Received healthy response to inference request in 1.4958980083465576s
Received healthy response to inference request in 1.4738545417785645s
Received healthy response to inference request in 1.4320387840270996s
Received healthy response to inference request in 1.4623284339904785s
Received healthy response to inference request in 1.4851438999176025s
10 requests
0 failed requests
5th percentile: 1.4346097350120544
10th percentile: 1.4371806859970093
20th percentile: 1.4574131488800048
30th percentile: 1.4703967094421386
40th percentile: 1.4806281566619872
50th percentile: 1.49052095413208
60th percentile: 1.5093211650848388
70th percentile: 1.5430552005767821
80th percentile: 1.5840928554534912
90th percentile: 1.6263862133026123
95th percentile: 1.6491991519927978
99th percentile: 1.6674495029449463
mean time: 1.5184587240219116
Pipeline stage StressChecker completed in 16.85s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.98s
Shutdown handler de-registered
function_nuset_2026-01-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 1786.40s
Shutdown handler de-registered
function_nuset_2026-01-09 status is now torndown due to DeploymentManager action