function_joduf_2024-12-18

developer_uid: jxlu90

submission_id: function_joduf_2024-12-18

model_name: run3_v65_moonshine_avg1k

model_group:

status: inactive

timestamp: 2024-12-18T19:20:46+00:00

num_battles: 7538

num_wins: 3967

celo_rating: 1274.06

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: run3_v65_moonshine_avg1k

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-18

win_ratio: 0.5262669143008756

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5961408615112305s
Received healthy response to inference request in 3.4572229385375977s
Received healthy response to inference request in 2.2382702827453613s
Received healthy response to inference request in 3.7599053382873535s
Received healthy response to inference request in 3.7831101417541504s
5 requests
0 failed requests
5th percentile: 2.4820608139038085
10th percentile: 2.7258513450622557
20th percentile: 3.2134324073791505
30th percentile: 3.4850065231323244
40th percentile: 3.5405736923217774
50th percentile: 3.5961408615112305
60th percentile: 3.6616466522216795
70th percentile: 3.727152442932129
80th percentile: 3.764546298980713
90th percentile: 3.773828220367432
95th percentile: 3.778469181060791
99th percentile: 3.7821819496154787
mean time: 3.3669299125671386
%s, retrying in %s seconds...
Received healthy response to inference request in 2.9621870517730713s
Received healthy response to inference request in 3.9159629344940186s
Received healthy response to inference request in 3.8045389652252197s
Received healthy response to inference request in 3.140739917755127s
Received healthy response to inference request in 3.211967706680298s
5 requests
0 failed requests
5th percentile: 2.9978976249694824
10th percentile: 3.0336081981658936
20th percentile: 3.105029344558716
30th percentile: 3.154985475540161
40th percentile: 3.1834765911102294
50th percentile: 3.211967706680298
60th percentile: 3.4489962100982665
70th percentile: 3.686024713516235
80th percentile: 3.8268237590789793
90th percentile: 3.871393346786499
95th percentile: 3.893678140640259
99th percentile: 3.9115059757232666
mean time: 3.407079315185547
Pipeline stage StressChecker completed in 36.85s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.78s
Shutdown handler de-registered
function_joduf_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_joduf_2024-12-18 status is now inactive due to auto deactivation removed underperforming models