function_nilom_2025-12-08

developer_uid: chai_backend_admin

submission_id: function_nilom_2025-12-08

model_name: function_nilom_2025-12-08

model_group:

status: torndown

timestamp: 2025-12-12T18:29:48+00:00

num_battles: 5323

num_wins: 2748

celo_rating: 1303.56

family_friendly_score: 0.513

family_friendly_standard_error: 0.007068677386894949

submission_type: function

display_name: function_nilom_2025-12-08

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-08

win_ratio: 0.5162502348299831

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4816243648529053s
Received healthy response to inference request in 1.8852434158325195s
Received healthy response to inference request in 2.3109488487243652s
Received healthy response to inference request in 1.840047836303711s
Received healthy response to inference request in 1.993725061416626s
Received healthy response to inference request in 1.5630688667297363s
Received healthy response to inference request in 1.6192235946655273s
Received healthy response to inference request in 2.337888240814209s
Received healthy response to inference request in 1.9333548545837402s
Received healthy response to inference request in 2.466555595397949s
10 requests
0 failed requests
5th percentile: 1.5883384943008423
10th percentile: 1.6136081218719482
20th percentile: 1.7958829879760743
30th percentile: 1.871684741973877
40th percentile: 1.914110279083252
50th percentile: 1.963539958000183
60th percentile: 2.1206145763397215
70th percentile: 2.3190306663513183
80th percentile: 2.363621711730957
90th percentile: 2.468062472343445
95th percentile: 2.474843418598175
99th percentile: 2.4802681756019593
mean time: 2.043168067932129
Pipeline stage StressChecker completed in 22.63s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_nilom_2025-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2301.08s
Shutdown handler de-registered
function_nilom_2025-12-08 status is now inactive due to auto deactivation removed underperforming models
function_nilom_2025-12-08 status is now torndown due to DeploymentManager action