developer_uid: jxlu90
submission_id: function_nusab_2024-12-13
model_name: moonshine400_nemo_avg1k_max1750
model_group:
status: torndown
timestamp: 2024-12-13T19:03:29+00:00
num_battles: 7776
num_wins: 3490
celo_rating: 1228.07
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: moonshine400_nemo_avg1k_max1750
is_internal_developer: False
ranking_group: single
us_pacific_date: 2024-12-13
win_ratio: 0.4488168724279835
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', 'You:', '\n'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.644409656524658s
Received healthy response to inference request in 5.732577562332153s
Received healthy response to inference request in 2.6628947257995605s
Received healthy response to inference request in 3.246549606323242s
Received healthy response to inference request in 3.5477912425994873s
5 requests
0 failed requests
5th percentile: 2.7796257019042967
10th percentile: 2.8963566780090333
20th percentile: 3.129818630218506
30th percentile: 3.3067979335784914
40th percentile: 3.4272945880889893
50th percentile: 3.5477912425994873
60th percentile: 3.9864386081695558
70th percentile: 4.425085973739624
80th percentile: 4.862043237686158
90th percentile: 5.297310400009155
95th percentile: 5.514943981170654
99th percentile: 5.689050846099853
mean time: 3.9668445587158203
%s, retrying in %s seconds...
Received healthy response to inference request in 3.797236680984497s
Received healthy response to inference request in 5.380283832550049s
Received healthy response to inference request in 3.0155842304229736s
Received healthy response to inference request in 3.319108724594116s
Received healthy response to inference request in 2.495541572570801s
5 requests
0 failed requests
5th percentile: 2.5995501041412354
10th percentile: 2.70355863571167
20th percentile: 2.911575698852539
30th percentile: 3.0762891292572023
40th percentile: 3.1976989269256593
50th percentile: 3.319108724594116
60th percentile: 3.5103599071502685
70th percentile: 3.7016110897064207
80th percentile: 4.113846111297608
90th percentile: 4.7470649719238285
95th percentile: 5.063674402236938
99th percentile: 5.316961946487426
mean time: 3.6015510082244875
%s, retrying in %s seconds...
Received healthy response to inference request in 3.113798141479492s
Received healthy response to inference request in 2.636272668838501s
Received healthy response to inference request in 3.1596434116363525s
Received healthy response to inference request in 2.7565526962280273s
Received healthy response to inference request in 2.518840789794922s
5 requests
0 failed requests
5th percentile: 2.5423271656036377
10th percentile: 2.5658135414123535
20th percentile: 2.612786293029785
30th percentile: 2.660328674316406
40th percentile: 2.7084406852722167
50th percentile: 2.7565526962280273
60th percentile: 2.8994508743286134
70th percentile: 3.042349052429199
80th percentile: 3.1229671955108644
90th percentile: 3.1413053035736085
95th percentile: 3.1504743576049803
99th percentile: 3.157809600830078
mean time: 2.837021541595459
Pipeline stage StressChecker completed in 55.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.21s
Shutdown handler de-registered
function_nusab_2024-12-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_nusab_2024-12-13 status is now torndown due to DeploymentManager action
function_nusab_2024-12-13 status is now torndown due to DeploymentManager action
function_nusab_2024-12-13 status is now torndown due to DeploymentManager action