developer_uid: jxlu90
submission_id: function_jepit_2024-12-05
model_name: moonshine_nemo70B
model_group:
status: inactive
timestamp: 2024-12-05T19:48:38+00:00
num_battles: 4215
num_wins: 1783
celo_rating: 1209.31
family_friendly_score: 0.6078
family_friendly_standard_error: 0.006904768786860281
submission_type: function
display_name: moonshine_nemo70B
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-05
win_ratio: 0.42301304863582445
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.666330337524414s
Received healthy response to inference request in 3.491851806640625s
Received healthy response to inference request in 3.74638295173645s
Received healthy response to inference request in 4.2619194984436035s
Received healthy response to inference request in 1.8025224208831787s
5 requests
0 failed requests
5th percentile: 1.9752840042114257
10th percentile: 2.1480455875396727
20th percentile: 2.493568754196167
30th percentile: 2.831434631347656
40th percentile: 3.161643218994141
50th percentile: 3.491851806640625
60th percentile: 3.593664264678955
70th percentile: 3.6954767227172853
80th percentile: 3.849490261077881
90th percentile: 4.055704879760742
95th percentile: 4.158812189102173
99th percentile: 4.2412980365753175
mean time: 3.1938014030456543
Pipeline stage StressChecker completed in 17.19s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.58s
Shutdown handler de-registered
function_jepit_2024-12-05 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3277.45s
Shutdown handler de-registered
function_jepit_2024-12-05 status is now inactive due to admin request