developer_uid: chai_backend_admin
submission_id: function_panus_2025-05-11
model_name: function_panus_2025-05-11
model_group:
status: torndown
timestamp: 2025-05-11T02:36:50+00:00
num_battles: 8273
num_wins: 4120
celo_rating: 1281.8
family_friendly_score: 0.5278
family_friendly_standard_error: 0.007060129743850322
submission_type: function
display_name: function_panus_2025-05-11
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-10
win_ratio: 0.4980055602562553
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3401832580566406s
Received healthy response to inference request in 4.190129995346069s
Received healthy response to inference request in 2.0712578296661377s
Received healthy response to inference request in 2.7743518352508545s
Received healthy response to inference request in 2.191509485244751s
5 requests
0 failed requests
5th percentile: 2.0953081607818604
10th percentile: 2.119358491897583
20th percentile: 2.1674591541290282
30th percentile: 2.3080779552459716
40th percentile: 2.5412148952484133
50th percentile: 2.7743518352508545
60th percentile: 3.000684404373169
70th percentile: 3.227016973495483
80th percentile: 3.5101726055145264
90th percentile: 3.850151300430298
95th percentile: 4.020140647888184
99th percentile: 4.1561321258544925
mean time: 2.9134864807128906
Pipeline stage StressChecker completed in 15.68s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_panus_2025-05-11 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3309.69s
Shutdown handler de-registered
function_panus_2025-05-11 status is now inactive due to auto deactivation removed underperforming models
function_panus_2025-05-11 status is now torndown due to DeploymentManager action