developer_uid: jxlu90
submission_id: function_jarok_2024-12-18
model_name: nemo_moonshine_1kavg
model_group:
status: inactive
timestamp: 2024-12-18T18:01:03+00:00
num_battles: 6556
num_wins: 2966
celo_rating: 1230.1
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: nemo_moonshine_1kavg
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-18
win_ratio: 0.4524100061012813
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.787484407424927s
Received healthy response to inference request in 3.5254952907562256s
Received healthy response to inference request in 2.3997533321380615s
Received healthy response to inference request in 3.2755866050720215s
Received healthy response to inference request in 5.607099533081055s
5 requests
0 failed requests
5th percentile: 2.5749199867248533
10th percentile: 2.7500866413116456
20th percentile: 3.1004199504852297
30th percentile: 3.325568342208862
40th percentile: 3.425531816482544
50th percentile: 3.5254952907562256
60th percentile: 4.030290937423706
70th percentile: 4.535086584091187
80th percentile: 4.951407432556152
90th percentile: 5.2792534828186035
95th percentile: 5.443176507949829
99th percentile: 5.574314928054809
mean time: 3.919083833694458
%s, retrying in %s seconds...
Received healthy response to inference request in 4.626424551010132s
Received healthy response to inference request in 3.486551523208618s
Received healthy response to inference request in 2.949354887008667s
Received healthy response to inference request in 6.319643497467041s
Received healthy response to inference request in 4.062659025192261s
5 requests
0 failed requests
5th percentile: 3.056794214248657
10th percentile: 3.1642335414886475
20th percentile: 3.379112195968628
30th percentile: 3.6017730236053467
40th percentile: 3.8322160243988037
50th percentile: 4.062659025192261
60th percentile: 4.2881652355194095
70th percentile: 4.513671445846557
80th percentile: 4.965068340301514
90th percentile: 5.642355918884277
95th percentile: 5.980999708175659
99th percentile: 6.251914739608765
mean time: 4.288926696777343
%s, retrying in %s seconds...
Received healthy response to inference request in 2.6316192150115967s
Received healthy response to inference request in 2.6276752948760986s
Received healthy response to inference request in 2.759786605834961s
Received healthy response to inference request in 3.5296995639801025s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 4.943443059921265s
5 requests
0 failed requests
5th percentile: 2.6284640789031983
10th percentile: 2.629252862930298
20th percentile: 2.630830430984497
30th percentile: 2.6572526931762694
40th percentile: 2.7085196495056154
50th percentile: 2.759786605834961
60th percentile: 3.0677517890930175
70th percentile: 3.375716972351074
80th percentile: 3.8124482631683354
90th percentile: 4.3779456615448
95th percentile: 4.660694360733032
99th percentile: 4.886893320083618
mean time: 3.2984447479248047
Pipeline stage StressChecker completed in 61.35s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.44s
Shutdown handler de-registered
function_jarok_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_jarok_2024-12-18 status is now inactive due to admin request