developer_uid: jxlu90
submission_id: function_mijis_2024-12-09
model_name: moonshine_nemo70B_600_sa
model_group:
status: inactive
timestamp: 2024-12-09T20:53:57+00:00
num_battles: 8014
num_wins: 3566
celo_rating: 1222.59
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: moonshine_nemo70B_600_sa
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-09
win_ratio: 0.44497130022460696
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.290629148483276s
Received healthy response to inference request in 2.458069324493408s
Received healthy response to inference request in 3.1828112602233887s
Received healthy response to inference request in 4.2939348220825195s
Received healthy response to inference request in 4.102270126342773s
5 requests
0 failed requests
5th percentile: 2.603017711639404
10th percentile: 2.7479660987854
20th percentile: 3.0378628730773927
30th percentile: 3.3667030334472656
40th percentile: 3.7344865798950195
50th percentile: 4.102270126342773
60th percentile: 4.178936004638672
70th percentile: 4.25560188293457
80th percentile: 4.493273687362671
90th percentile: 4.891951417922973
95th percentile: 5.091290283203125
99th percentile: 5.250761375427246
mean time: 3.865542936325073
%s, retrying in %s seconds...
Received healthy response to inference request in 4.784035682678223s
Received healthy response to inference request in 4.893414735794067s
Received healthy response to inference request in 2.893199920654297s
Received healthy response to inference request in 5.296536684036255s
Received healthy response to inference request in 4.566397666931152s
5 requests
0 failed requests
5th percentile: 3.227839469909668
10th percentile: 3.562479019165039
20th percentile: 4.231758117675781
30th percentile: 4.609925270080566
40th percentile: 4.6969804763793945
50th percentile: 4.784035682678223
60th percentile: 4.827787303924561
70th percentile: 4.871538925170898
80th percentile: 4.974039125442505
90th percentile: 5.13528790473938
95th percentile: 5.215912294387818
99th percentile: 5.280411806106567
mean time: 4.486716938018799
%s, retrying in %s seconds...
Received healthy response to inference request in 2.705167531967163s
Received healthy response to inference request in 5.0816426277160645s
Received healthy response to inference request in 3.7415924072265625s
Received healthy response to inference request in 3.225351572036743s
Received healthy response to inference request in 3.424851417541504s
5 requests
0 failed requests
5th percentile: 2.809204339981079
10th percentile: 2.913241147994995
20th percentile: 3.121314764022827
30th percentile: 3.2652515411376952
40th percentile: 3.3450514793396
50th percentile: 3.424851417541504
60th percentile: 3.551547813415527
70th percentile: 3.678244209289551
80th percentile: 4.009602451324463
90th percentile: 4.545622539520264
95th percentile: 4.813632583618164
99th percentile: 5.028040618896484
mean time: 3.6357211112976073
Pipeline stage StressChecker completed in 63.34s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.11s
Shutdown handler de-registered
function_mijis_2024-12-09 status is now deployed due to DeploymentManager action
function_mijis_2024-12-09 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_mijis_2024-12-09 status is now inactive due to admin request