developer_uid: chai_backend_admin
submission_id: function_getut_2025-07-09
model_name: function_getut_2025-07-09
model_group:
status: torndown
timestamp: 2025-07-09T23:34:59+00:00
num_battles: 7425
num_wins: 3741
celo_rating: 1289.1
family_friendly_score: 0.5358
family_friendly_standard_error: 0.007052919395541112
submission_type: function
display_name: function_getut_2025-07-09
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-07-09
win_ratio: 0.5038383838383839
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.120298147201538s
Received healthy response to inference request in 2.539250135421753s
Received healthy response to inference request in 4.314342975616455s
Received healthy response to inference request in 2.5460903644561768s
Received healthy response to inference request in 2.4709346294403076s
5 requests
0 failed requests
5th percentile: 2.4845977306365965
10th percentile: 2.498260831832886
20th percentile: 2.525587034225464
30th percentile: 2.5406181812286377
40th percentile: 2.5433542728424072
50th percentile: 2.5460903644561768
60th percentile: 2.7757734775543215
70th percentile: 3.0054565906524657
80th percentile: 3.3591071128845216
90th percentile: 3.8367250442504885
95th percentile: 4.075534009933471
99th percentile: 4.266581182479858
mean time: 2.998183250427246
Pipeline stage StressChecker completed in 16.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.81s
Shutdown handler de-registered
function_getut_2025-07-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3545.11s
Shutdown handler de-registered
function_getut_2025-07-09 status is now inactive due to auto deactivation removed underperforming models
function_getut_2025-07-09 status is now torndown due to DeploymentManager action