developer_uid: jxlu90
submission_id: function_tatab_2024-12-06
model_name: moonshine_nemo70B_wout_7rn
model_group:
status: inactive
timestamp: 2024-12-06T16:36:28+00:00
num_battles: 6674
num_wins: 2848
celo_rating: 1210.71
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: moonshine_nemo70B_wout_7rn
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-06
win_ratio: 0.42673059634402155
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5761101245880127s
Received healthy response to inference request in 2.683645248413086s
Received healthy response to inference request in 5.656407356262207s
Received healthy response to inference request in 3.6015889644622803s
Received healthy response to inference request in 3.2911272048950195s
5 requests
0 failed requests
5th percentile: 2.5976171493530273
10th percentile: 2.619124174118042
20th percentile: 2.6621382236480713
30th percentile: 2.805141639709473
40th percentile: 3.048134422302246
50th percentile: 3.2911272048950195
60th percentile: 3.415311908721924
70th percentile: 3.539496612548828
80th percentile: 4.012552642822266
90th percentile: 4.8344799995422365
95th percentile: 5.245443677902221
99th percentile: 5.57421462059021
mean time: 3.561775779724121
Pipeline stage StressChecker completed in 18.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.53s
Shutdown handler de-registered
function_tatab_2024-12-06 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_tatab_2024-12-06 status is now inactive due to auto deactivation removed underperforming models