developer_uid: jxlu90
submission_id: function_loter_2024-12-18
model_name: nemo_moonshing_1kavg
model_group:
status: inactive
timestamp: 2024-12-18T18:51:15+00:00
num_battles: 7193
num_wins: 3239
celo_rating: 1226.26
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: nemo_moonshing_1kavg
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-18
win_ratio: 0.4502989017099958
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.019027233123779s
Received healthy response to inference request in 3.497253179550171s
Received healthy response to inference request in 4.5642006397247314s
Received healthy response to inference request in 4.914826393127441s
Received healthy response to inference request in 4.363569498062134s
5 requests
0 failed requests
5th percentile: 3.6705164432525637
10th percentile: 3.843779706954956
20th percentile: 4.190306234359741
30th percentile: 4.403695726394654
40th percentile: 4.483948183059693
50th percentile: 4.5642006397247314
60th percentile: 4.704450941085815
70th percentile: 4.8447012424469
80th percentile: 4.935666561126709
90th percentile: 4.977346897125244
95th percentile: 4.998187065124512
99th percentile: 5.014859199523926
mean time: 4.471775388717651
%s, retrying in %s seconds...
Received healthy response to inference request in 3.3249757289886475s
Received healthy response to inference request in 5.592351198196411s
Received healthy response to inference request in 4.020100116729736s
Received healthy response to inference request in 1.8113837242126465s
Received healthy response to inference request in 3.2155234813690186s
5 requests
0 failed requests
5th percentile: 2.092211675643921
10th percentile: 2.3730396270751952
20th percentile: 2.934695529937744
30th percentile: 3.237413930892944
40th percentile: 3.281194829940796
50th percentile: 3.3249757289886475
60th percentile: 3.603025484085083
70th percentile: 3.881075239181518
80th percentile: 4.3345503330230715
90th percentile: 4.963450765609741
95th percentile: 5.277900981903076
99th percentile: 5.529461154937744
mean time: 3.592866849899292
%s, retrying in %s seconds...
Received healthy response to inference request in 2.5482852458953857s
Received healthy response to inference request in 4.841366291046143s
Received healthy response to inference request in 2.0259182453155518s
Received healthy response to inference request in 3.221501350402832s
Received healthy response to inference request in 3.7189321517944336s
5 requests
0 failed requests
5th percentile: 2.1303916454315184
10th percentile: 2.2348650455474854
20th percentile: 2.443811845779419
30th percentile: 2.682928466796875
40th percentile: 2.9522149085998537
50th percentile: 3.221501350402832
60th percentile: 3.4204736709594727
70th percentile: 3.619445991516113
80th percentile: 3.9434189796447754
90th percentile: 4.392392635345459
95th percentile: 4.616879463195801
99th percentile: 4.796468925476074
mean time: 3.271200656890869
Pipeline stage StressChecker completed in 60.51s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.26s
Shutdown handler de-registered
function_loter_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_loter_2024-12-18 status is now inactive due to admin request