developer_uid: chai_backend_admin
submission_id: function_nilir_2025-12-05
model_name: function_nilir_2025-12-05
model_group:
status: torndown
timestamp: 2025-12-12T18:29:47+00:00
num_battles: 5726
num_wins: 3346
celo_rating: 1351.59
family_friendly_score: 0.5628
family_friendly_standard_error: 0.007015071774401171
submission_type: function
display_name: function_nilir_2025-12-05
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-05
win_ratio: 0.5843520782396088
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.94355845451355s
Received healthy response to inference request in 3.787454843521118s
Received healthy response to inference request in 2.8811309337615967s
Received healthy response to inference request in 2.5410027503967285s
Received healthy response to inference request in 3.1092429161071777s
Received healthy response to inference request in 0.6666946411132812s
Received healthy response to inference request in 0.7581183910369873s
Received healthy response to inference request in 0.3750467300415039s
Received healthy response to inference request in 0.4373056888580322s
Received healthy response to inference request in 0.42856717109680176s
10 requests
0 failed requests
5th percentile: 0.39913092851638793
10th percentile: 0.42321512699127195
20th percentile: 0.43555798530578616
30th percentile: 0.5978779554367065
40th percentile: 0.7215488910675049
50th percentile: 1.649560570716858
60th percentile: 2.6770540237426754
70th percentile: 2.949564528465271
80th percentile: 3.244885301589966
90th percentile: 3.903065204620361
95th percentile: 4.423311829566955
99th percentile: 4.839509129524231
mean time: 1.9928122520446778
Pipeline stage StressChecker completed in 21.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.05s
Shutdown handler de-registered
function_nilir_2025-12-05 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 4131.50s
Shutdown handler de-registered
function_nilir_2025-12-05 status is now inactive due to auto deactivation removed underperforming models
function_nilir_2025-12-05 status is now torndown due to DeploymentManager action