developer_uid: chai_backend_admin
submission_id: function_sunuk_2025-05-09
model_name: function_sunuk_2025-05-09
model_group:
status: torndown
timestamp: 2025-05-09T02:25:12+00:00
num_battles: 6782
num_wins: 3413
celo_rating: 1291.15
family_friendly_score: 0.552
family_friendly_standard_error: 0.007032723512267492
submission_type: function
display_name: function_sunuk_2025-05-09
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-08
win_ratio: 0.5032438808611029
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0248377323150635s
Received healthy response to inference request in 3.1257853507995605s
Received healthy response to inference request in 3.7871828079223633s
Received healthy response to inference request in 2.380263566970825s
Received healthy response to inference request in 2.686126470565796s
5 requests
0 failed requests
5th percentile: 2.4414361476898194
10th percentile: 2.5026087284088137
20th percentile: 2.6249538898468017
30th percentile: 2.7538687229156493
40th percentile: 2.8893532276153566
50th percentile: 3.0248377323150635
60th percentile: 3.0652167797088623
70th percentile: 3.105595827102661
80th percentile: 3.258064842224121
90th percentile: 3.522623825073242
95th percentile: 3.6549033164978026
99th percentile: 3.760726909637451
mean time: 3.000839185714722
Pipeline stage StressChecker completed in 16.11s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_sunuk_2025-05-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2813.52s
Shutdown handler de-registered
function_sunuk_2025-05-09 status is now inactive due to auto deactivation removed underperforming models
function_sunuk_2025-05-09 status is now torndown due to DeploymentManager action