developer_uid: chai_backend_admin
submission_id: function_jaruf_2025-05-11
model_name: function_jaruf_2025-05-11
model_group:
status: torndown
timestamp: 2025-05-11T02:39:19+00:00
num_battles: 7111
num_wins: 3597
celo_rating: 1289.18
family_friendly_score: 0.5574
family_friendly_standard_error: 0.0070243183299164335
submission_type: function
display_name: function_jaruf_2025-05-11
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-10
win_ratio: 0.5058360286879483
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.9668612480163574s
Received healthy response to inference request in 2.696934938430786s
Received healthy response to inference request in 3.901942491531372s
Received healthy response to inference request in 2.9410383701324463s
Received healthy response to inference request in 3.4658470153808594s
5 requests
0 failed requests
5th percentile: 2.7457556247711183
10th percentile: 2.79457631111145
20th percentile: 2.892217683792114
30th percentile: 2.9462029457092287
40th percentile: 2.956532096862793
50th percentile: 2.9668612480163574
60th percentile: 3.166455554962158
70th percentile: 3.366049861907959
80th percentile: 3.553066110610962
90th percentile: 3.727504301071167
95th percentile: 3.8147233963012694
99th percentile: 3.8844986724853516
mean time: 3.194524812698364
Pipeline stage StressChecker completed in 17.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_jaruf_2025-05-11 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3225.38s
Shutdown handler de-registered
function_jaruf_2025-05-11 status is now inactive due to auto deactivation removed underperforming models
function_jaruf_2025-05-11 status is now torndown due to DeploymentManager action