developer_uid: chai_backend_admin
submission_id: function_kotin_2025-05-30
model_name: function_kotin_2025-05-30
model_group:
status: torndown
timestamp: 2025-05-30T16:03:40+00:00
num_battles: 6746
num_wins: 3522
celo_rating: 1300.4
family_friendly_score: 0.5406
family_friendly_standard_error: 0.007047717928521259
submission_type: function
display_name: function_kotin_2025-05-30
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-30
win_ratio: 0.5220871627631188
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.5111658573150635s
Received healthy response to inference request in 1.5117683410644531s
Received healthy response to inference request in 1.4837651252746582s
Received healthy response to inference request in 1.5193636417388916s
Received healthy response to inference request in 1.5299146175384521s
5 requests
0 failed requests
5th percentile: 1.4892452716827393
10th percentile: 1.4947254180908203
20th percentile: 1.5056857109069823
30th percentile: 1.5112863540649415
40th percentile: 1.5115273475646973
50th percentile: 1.5117683410644531
60th percentile: 1.5148064613342285
70th percentile: 1.5178445816040038
80th percentile: 1.5214738368988037
90th percentile: 1.525694227218628
95th percentile: 1.52780442237854
99th percentile: 1.5294925785064697
mean time: 1.5111955165863038
Pipeline stage StressChecker completed in 8.59s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_kotin_2025-05-30 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 1936.92s
Shutdown handler de-registered
function_kotin_2025-05-30 status is now inactive due to auto deactivation removed underperforming models
function_kotin_2025-05-30 status is now torndown due to DeploymentManager action