developer_uid: chai_backend_admin
submission_id: function_leler_2025-07-08
model_name: function_leler_2025-07-08
model_group:
status: torndown
timestamp: 2025-07-08T00:18:32+00:00
num_battles: 5945
num_wins: 3055
celo_rating: 1296.17
family_friendly_score: 0.536
family_friendly_standard_error: 0.007052715788970942
submission_type: function
display_name: function_leler_2025-07-08
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-07-07
win_ratio: 0.5138772077375946
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8219845294952393s
Received healthy response to inference request in 5.303123950958252s
Received healthy response to inference request in 1.6464016437530518s
Received healthy response to inference request in 5.247752904891968s
Received healthy response to inference request in 3.218224048614502s
5 requests
0 failed requests
5th percentile: 1.9607661247253418
10th percentile: 2.275130605697632
20th percentile: 2.903859567642212
30th percentile: 3.3389761447906494
40th percentile: 3.5804803371429443
50th percentile: 3.8219845294952393
60th percentile: 4.39229187965393
70th percentile: 4.962599229812621
80th percentile: 5.258827114105225
90th percentile: 5.2809755325317385
95th percentile: 5.292049741744995
99th percentile: 5.300909109115601
mean time: 3.8474974155426027
%s, retrying in %s seconds...
Received healthy response to inference request in 2.8659262657165527s
Received healthy response to inference request in 2.175227403640747s
Received healthy response to inference request in 2.5980820655822754s
Received healthy response to inference request in 3.763673782348633s
Received healthy response to inference request in 2.9402711391448975s
5 requests
0 failed requests
5th percentile: 2.2597983360290526
10th percentile: 2.3443692684173585
20th percentile: 2.51351113319397
30th percentile: 2.651650905609131
40th percentile: 2.758788585662842
50th percentile: 2.8659262657165527
60th percentile: 2.8956642150878906
70th percentile: 2.9254021644592285
80th percentile: 3.104951667785645
90th percentile: 3.4343127250671386
95th percentile: 3.5989932537078855
99th percentile: 3.730737676620483
mean time: 2.868636131286621
Pipeline stage StressChecker completed in 35.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.80s
Shutdown handler de-registered
function_leler_2025-07-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3783.52s
Shutdown handler de-registered
function_leler_2025-07-08 status is now inactive due to auto deactivation removed underperforming models
function_leler_2025-07-08 status is now torndown due to DeploymentManager action