developer_uid: jxlu90
submission_id: function_kakut_2024-12-19
model_name: run_3_v65_moonshine_ranked
model_group:
status: inactive
timestamp: 2024-12-19T16:53:05+00:00
num_battles: 18805
num_wins: 9628
celo_rating: 1271.38
family_friendly_score: 0.5924
family_friendly_standard_error: 0.006949276796904841
submission_type: function
display_name: run_3_v65_moonshine_ranked
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-19
win_ratio: 0.5119914916245679
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.9523754119873047s
Received healthy response to inference request in 3.2212367057800293s
Received healthy response to inference request in 2.516099214553833s
Received healthy response to inference request in 2.325350046157837s
Received healthy response to inference request in 3.16288685798645s
5 requests
0 failed requests
5th percentile: 2.363499879837036
10th percentile: 2.4016497135162354
20th percentile: 2.477949380874634
30th percentile: 2.6033544540405273
40th percentile: 2.777864933013916
50th percentile: 2.9523754119873047
60th percentile: 3.036579990386963
70th percentile: 3.120784568786621
80th percentile: 3.174556827545166
90th percentile: 3.1978967666625975
95th percentile: 3.2095667362213134
99th percentile: 3.218902711868286
mean time: 2.835589647293091
Pipeline stage StressChecker completed in 15.36s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.12s
Shutdown handler de-registered
function_kakut_2024-12-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3602.71s
Shutdown handler de-registered
function_kakut_2024-12-19 status is now inactive due to auto deactivation removed underperforming models