developer_uid: jxlu90
submission_id: function_sipef_2024-12-18
model_name: nemo_moonshine
model_group:
status: inactive
timestamp: 2024-12-18T22:50:53+00:00
num_battles: 6851
num_wins: 3019
celo_rating: 1218.74
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: nemo_moonshine
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-18
win_ratio: 0.44066559626331925
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5583083629608154s
Received healthy response to inference request in 2.0121307373046875s
Received healthy response to inference request in 2.2534401416778564s
Received healthy response to inference request in 2.5371570587158203s
Received healthy response to inference request in 2.4576237201690674s
5 requests
0 failed requests
5th percentile: 2.0603926181793213
10th percentile: 2.108654499053955
20th percentile: 2.2051782608032227
30th percentile: 2.2942768573760985
40th percentile: 2.375950288772583
50th percentile: 2.4576237201690674
60th percentile: 2.4894370555877687
70th percentile: 2.5212503910064696
80th percentile: 2.5413873195648193
90th percentile: 2.5498478412628174
95th percentile: 2.5540781021118164
99th percentile: 2.5574623107910157
mean time: 2.3637320041656493
Pipeline stage StressChecker completed in 13.06s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.12s
Shutdown handler de-registered
function_sipef_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered