developer_uid: chai_backend_admin
submission_id: function_notel_2025-12-09
model_name: function_notel_2025-12-09
model_group:
status: torndown
timestamp: 2025-12-12T18:29:49+00:00
num_battles: 5940
num_wins: 3021
celo_rating: 1303.25
family_friendly_score: 0.596
family_friendly_standard_error: 0.006939510069161943
submission_type: function
display_name: function_notel_2025-12-09
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-09
win_ratio: 0.5085858585858586
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.239400386810303s
Received healthy response to inference request in 2.000122547149658s
Received healthy response to inference request in 5.8670361042022705s
Received healthy response to inference request in 2.7135121822357178s
Received healthy response to inference request in 2.151710033416748s
Received healthy response to inference request in 5.897923469543457s
Received healthy response to inference request in 1.691380500793457s
Received healthy response to inference request in 1.7427468299865723s
Received healthy response to inference request in 1.9752366542816162s
Received healthy response to inference request in 1.5926554203033447s
10 requests
0 failed requests
5th percentile: 1.6370817065238952
10th percentile: 1.6815079927444458
20th percentile: 1.7324735641479492
30th percentile: 1.905489706993103
40th percentile: 1.9901681900024415
50th percentile: 2.075916290283203
60th percentile: 2.3764308929443354
70th percentile: 3.171278643608093
80th percentile: 4.5649275302886965
90th percentile: 5.8701248407363895
95th percentile: 5.884024155139923
99th percentile: 5.89514360666275
mean time: 2.9871724128723143
Pipeline stage StressChecker completed in 31.59s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_notel_2025-12-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2210.69s
Shutdown handler de-registered
function_notel_2025-12-09 status is now torndown due to DeploymentManager action