developer_uid: jxlu90
submission_id: function_dosis_2024-12-06
model_name: moonshine_nemo70B_8rn_300hist
model_group:
status: inactive
timestamp: 2024-12-06T03:53:06+00:00
num_battles: 10024
num_wins: 4473
celo_rating: 1226.15
family_friendly_score: 0.6208
family_friendly_standard_error: 0.006861593983907821
submission_type: function
display_name: moonshine_nemo70B_8rn_300hist
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-05
win_ratio: 0.44622905027932963
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.327927350997925s
Received healthy response to inference request in 2.4291181564331055s
Received healthy response to inference request in 6.27035117149353s
Received healthy response to inference request in 4.057185411453247s
Received healthy response to inference request in 4.093271255493164s
5 requests
0 failed requests
5th percentile: 2.6088799953460695
10th percentile: 2.788641834259033
20th percentile: 3.1481655120849608
30th percentile: 3.4737789630889893
40th percentile: 3.765482187271118
50th percentile: 4.057185411453247
60th percentile: 4.071619749069214
70th percentile: 4.086054086685181
80th percentile: 4.528687238693237
90th percentile: 5.399519205093384
95th percentile: 5.834935188293457
99th percentile: 6.183267974853516
mean time: 4.035570669174194
%s, retrying in %s seconds...
Received healthy response to inference request in 3.6170494556427s
Received healthy response to inference request in 4.705874443054199s
Received healthy response to inference request in 2.9574942588806152s
Received healthy response to inference request in 2.8944895267486572s
Received healthy response to inference request in 2.436830520629883s
5 requests
0 failed requests
5th percentile: 2.5283623218536375
10th percentile: 2.6198941230773927
20th percentile: 2.8029577255249025
30th percentile: 2.9070904731750487
40th percentile: 2.932292366027832
50th percentile: 2.9574942588806152
60th percentile: 3.221316337585449
70th percentile: 3.485138416290283
80th percentile: 3.8348144531250004
90th percentile: 4.2703444480896
95th percentile: 4.488109445571899
99th percentile: 4.662321443557739
mean time: 3.322347640991211
Pipeline stage StressChecker completed in 38.99s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.49s
Shutdown handler de-registered
function_dosis_2024-12-06 status is now deployed due to DeploymentManager action
function_dosis_2024-12-06 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2561.93s
Shutdown handler de-registered