developer_uid: jxlu90
submission_id: function_mapon_2024-12-11
model_name: moonshine_nemo70B_600_sa
model_group:
status: inactive
timestamp: 2024-12-11T01:38:23+00:00
num_battles: 5555
num_wins: 2491
celo_rating: 1226.54
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: moonshine_nemo70B_600_sa
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-10
win_ratio: 0.4484248424842484
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.120624303817749s
Received healthy response to inference request in 2.7476794719696045s
Received healthy response to inference request in 2.7522265911102295s
Received healthy response to inference request in 3.8445162773132324s
Received healthy response to inference request in 2.2344868183135986s
5 requests
0 failed requests
5th percentile: 2.3371253490447996
10th percentile: 2.439763879776001
20th percentile: 2.6450409412384035
30th percentile: 2.7485888957977296
40th percentile: 2.7504077434539793
50th percentile: 2.7522265911102295
60th percentile: 3.1891424655914307
70th percentile: 3.626058340072632
80th percentile: 3.899737882614136
90th percentile: 4.010181093215943
95th percentile: 4.065402698516846
99th percentile: 4.109579982757569
mean time: 3.1399066925048826
Pipeline stage StressChecker completed in 16.76s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.35s
Shutdown handler de-registered
function_mapon_2024-12-11 status is now deployed due to DeploymentManager action
function_mapon_2024-12-11 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
function_mapon_2024-12-11 status is now inactive due to auto deactivation removed underperforming models