developer_uid: chai_backend_admin
submission_id: function_hokaf_2025-05-30
model_name: function_hokaf_2025-05-30
model_group:
status: torndown
timestamp: 2025-05-30T17:35:27+00:00
num_battles: 6664
num_wins: 3430
celo_rating: 1294.06
family_friendly_score: 0.402
family_friendly_standard_error: 0.0069339166421294686
submission_type: function
display_name: function_hokaf_2025-05-30
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-30
win_ratio: 0.5147058823529411
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4958555698394775s
Received healthy response to inference request in 2.7208616733551025s
Received healthy response to inference request in 2.506115436553955s
Received healthy response to inference request in 2.554230213165283s
Received healthy response to inference request in 2.4634077548980713s
5 requests
0 failed requests
5th percentile: 2.4698973178863524
10th percentile: 2.476386880874634
20th percentile: 2.4893660068511965
30th percentile: 2.497907543182373
40th percentile: 2.5020114898681642
50th percentile: 2.506115436553955
60th percentile: 2.525361347198486
70th percentile: 2.5446072578430177
80th percentile: 2.587556505203247
90th percentile: 2.654209089279175
95th percentile: 2.6875353813171388
99th percentile: 2.71419641494751
mean time: 2.548094129562378
Pipeline stage StressChecker completed in 13.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_hokaf_2025-05-30 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2512.27s
Shutdown handler de-registered
function_hokaf_2025-05-30 status is now inactive due to auto deactivation removed underperforming models
function_hokaf_2025-05-30 status is now torndown due to DeploymentManager action