developer_uid: jxlu90
submission_id: function_gamaf_2024-12-10
model_name: moonshine_nemo70B_600_sa
model_group:
status: inactive
timestamp: 2024-12-10T03:35:05+00:00
num_battles: 5719
num_wins: 2569
celo_rating: 1226.08
family_friendly_score: 0.6242
family_friendly_standard_error: 0.006849443189048289
submission_type: function
display_name: moonshine_nemo70B_600_sa
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-09
win_ratio: 0.44920440636474906
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.256448268890381s
Received healthy response to inference request in 11.160441637039185s
Received healthy response to inference request in 1.7493183612823486s
Received healthy response to inference request in 2.244335174560547s
Received healthy response to inference request in 4.426141262054443s
5 requests
0 failed requests
5th percentile: 1.8483217239379883
10th percentile: 1.947325086593628
20th percentile: 2.1453318119049074
30th percentile: 2.4467577934265137
40th percentile: 2.8516030311584473
50th percentile: 3.256448268890381
60th percentile: 3.7243254661560057
70th percentile: 4.1922026634216305
80th percentile: 5.773001337051393
90th percentile: 8.46672148704529
95th percentile: 9.813581562042234
99th percentile: 10.891069622039794
mean time: 4.567336940765381
%s, retrying in %s seconds...
Received healthy response to inference request in 15.726258754730225s
Received healthy response to inference request in 8.578354835510254s
Received healthy response to inference request in 4.261839866638184s
Received healthy response to inference request in 2.994917869567871s
Received healthy response to inference request in 1.87318754196167s
5 requests
0 failed requests
5th percentile: 2.09753360748291
10th percentile: 2.32187967300415
20th percentile: 2.770571804046631
30th percentile: 3.2483022689819334
40th percentile: 3.755071067810059
50th percentile: 4.261839866638184
60th percentile: 5.988445854187011
70th percentile: 7.715051841735839
80th percentile: 10.00793561935425
90th percentile: 12.867097187042237
95th percentile: 14.296677970886229
99th percentile: 15.440342597961425
mean time: 6.686911773681641
%s, retrying in %s seconds...
Received healthy response to inference request in 3.021306276321411s
Received healthy response to inference request in 8.329426765441895s
Received healthy response to inference request in 2.356783151626587s
Received healthy response to inference request in 2.0459682941436768s
Received healthy response to inference request in 3.005336284637451s
5 requests
0 failed requests
5th percentile: 2.108131265640259
10th percentile: 2.170294237136841
20th percentile: 2.294620180130005
30th percentile: 2.48649377822876
40th percentile: 2.7459150314331056
50th percentile: 3.005336284637451
60th percentile: 3.011724281311035
70th percentile: 3.0181122779846192
80th percentile: 4.0829303741455085
90th percentile: 6.2061785697937015
95th percentile: 7.267802667617797
99th percentile: 8.117101945877074
mean time: 3.751764154434204
Pipeline stage StressChecker completed in 78.50s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.26s
Shutdown handler de-registered
function_gamaf_2024-12-10 status is now deployed due to DeploymentManager action
function_gamaf_2024-12-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2543.58s
Shutdown handler de-registered
function_gamaf_2024-12-10 status is now inactive due to auto deactivation removed underperforming models