developer_uid: jxlu90
submission_id: function_liten_2024-12-07
model_name: moonshine_nemo70B_150
model_group:
status: inactive
timestamp: 2024-12-07T21:53:07+00:00
num_battles: 5364
num_wins: 2221
celo_rating: 1200.43
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: moonshine_nemo70B_150
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-07
win_ratio: 0.4140566741237882
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0830576419830322s
Received healthy response to inference request in 2.6824660301208496s
Received healthy response to inference request in 2.924429416656494s
Received healthy response to inference request in 5.468733787536621s
Received healthy response to inference request in 5.561327934265137s
5 requests
0 failed requests
5th percentile: 2.7308587074279784
10th percentile: 2.7792513847351072
20th percentile: 2.8760367393493653
30th percentile: 2.9561550617218018
40th percentile: 3.019606351852417
50th percentile: 3.0830576419830322
60th percentile: 4.037328100204467
70th percentile: 4.991598558425903
80th percentile: 5.487252616882325
90th percentile: 5.524290275573731
95th percentile: 5.542809104919433
99th percentile: 5.557624168395996
mean time: 3.944002962112427
%s, retrying in %s seconds...
Received healthy response to inference request in 2.1814160346984863s
Received healthy response to inference request in 4.316020250320435s
Received healthy response to inference request in 3.3235018253326416s
Received healthy response to inference request in 3.834076166152954s
Received healthy response to inference request in 3.766977310180664s
5 requests
0 failed requests
5th percentile: 2.4098331928253174
10th percentile: 2.6382503509521484
20th percentile: 3.0950846672058105
30th percentile: 3.412196922302246
40th percentile: 3.589587116241455
50th percentile: 3.766977310180664
60th percentile: 3.79381685256958
70th percentile: 3.820656394958496
80th percentile: 3.93046498298645
90th percentile: 4.123242616653442
95th percentile: 4.2196314334869385
99th percentile: 4.296742486953735
mean time: 3.4843983173370363
%s, retrying in %s seconds...
Received healthy response to inference request in 2.9004321098327637s
Received healthy response to inference request in 2.79013991355896s
Received healthy response to inference request in 3.250370740890503s
Received healthy response to inference request in 3.1171865463256836s
Received healthy response to inference request in 3.1760852336883545s
5 requests
0 failed requests
5th percentile: 2.812198352813721
10th percentile: 2.8342567920684814
20th percentile: 2.8783736705780028
30th percentile: 2.943782997131348
40th percentile: 3.0304847717285157
50th percentile: 3.1171865463256836
60th percentile: 3.140746021270752
70th percentile: 3.16430549621582
80th percentile: 3.190942335128784
90th percentile: 3.2206565380096435
95th percentile: 3.2355136394500734
99th percentile: 3.247399320602417
mean time: 3.046842908859253
Pipeline stage StressChecker completed in 55.61s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.15s
Shutdown handler de-registered
function_liten_2024-12-07 status is now deployed due to DeploymentManager action
function_liten_2024-12-07 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_liten_2024-12-07 status is now inactive due to admin request