developer_uid: chai_backend_admin
submission_id: function_pimis_2025-05-23
model_name: function_pimis_2025-05-23
model_group:
status: torndown
timestamp: 2025-05-23T22:13:14+00:00
num_battles: 6222
num_wins: 3253
celo_rating: 1303.58
family_friendly_score: 0.5258
family_friendly_standard_error: 0.007061647966303617
submission_type: function
display_name: function_pimis_2025-05-23
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-23
win_ratio: 0.5228222436515589
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.915498971939087s
Received healthy response to inference request in 3.3521811962127686s
Received healthy response to inference request in 3.379021406173706s
Received healthy response to inference request in 3.4850387573242188s
Received healthy response to inference request in 3.458512544631958s
5 requests
0 failed requests
5th percentile: 3.002835416793823
10th percentile: 3.0901718616485594
20th percentile: 3.2648447513580323
30th percentile: 3.357549238204956
40th percentile: 3.368285322189331
50th percentile: 3.379021406173706
60th percentile: 3.410817861557007
70th percentile: 3.4426143169403076
80th percentile: 3.4638177871704103
90th percentile: 3.4744282722473145
95th percentile: 3.4797335147857664
99th percentile: 3.4839777088165285
mean time: 3.318050575256348
Pipeline stage StressChecker completed in 17.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_pimis_2025-05-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3171.89s
Shutdown handler de-registered
function_pimis_2025-05-23 status is now inactive due to auto deactivation removed underperforming models
function_pimis_2025-05-23 status is now torndown due to DeploymentManager action