developer_uid: chai_backend_admin
submission_id: function_nasab_2025-12-21
model_name: function_nasab_2025-12-21
model_group:
status: torndown
timestamp: 2025-12-24T18:26:38+00:00
num_battles: 8582
num_wins: 4369
celo_rating: 1299.65
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_nasab_2025-12-21
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-24
win_ratio: 0.5090887904917268
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.220996856689453s
Received healthy response to inference request in 3.4957146644592285s
Received healthy response to inference request in 2.740281343460083s
Received healthy response to inference request in 1.999004602432251s
Received healthy response to inference request in 2.5485928058624268s
Received healthy response to inference request in 3.527669668197632s
Received healthy response to inference request in 3.29504656791687s
Received healthy response to inference request in 1.7790586948394775s
Received healthy response to inference request in 1.5902974605560303s
Received healthy response to inference request in 1.5533447265625s
10 requests
0 failed requests
5th percentile: 1.5699734568595887
10th percentile: 1.5866021871566773
20th percentile: 1.741306447982788
30th percentile: 1.933020830154419
40th percentile: 2.1321999549865724
50th percentile: 2.38479483127594
60th percentile: 2.6252682209014893
70th percentile: 2.906710910797119
80th percentile: 3.3351801872253417
90th percentile: 3.498910164833069
95th percentile: 3.51328991651535
99th percentile: 3.5247937178611757
mean time: 2.475000739097595
Pipeline stage StressChecker completed in 26.20s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.56s
Shutdown handler de-registered
function_nasab_2025-12-21 status is now deployed due to DeploymentManager action
function_nasab_2025-12-21 status is now inactive due to auto deactivation removed underperforming models
function_nasab_2025-12-21 status is now torndown due to DeploymentManager action