developer_uid: jxlu90
submission_id: function_kagel_2024-12-05
model_name: moonshine_nemo70B
model_group:
status: inactive
timestamp: 2024-12-05T01:21:36+00:00
num_battles: 5316
num_wins: 2322
celo_rating: 1214.95
family_friendly_score: 0.6073999999999999
family_friendly_standard_error: 0.006906015348954851
submission_type: function
display_name: moonshine_nemo70B
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-04
win_ratio: 0.4367945823927765
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.135108709335327s
Received healthy response to inference request in 2.962592124938965s
Received healthy response to inference request in 2.357671022415161s
Received healthy response to inference request in 3.3288779258728027s
Received healthy response to inference request in 2.7209181785583496s
5 requests
0 failed requests
5th percentile: 2.430320453643799
10th percentile: 2.5029698848724364
20th percentile: 2.6482687473297117
30th percentile: 2.769252967834473
40th percentile: 2.865922546386719
50th percentile: 2.962592124938965
60th percentile: 3.1091064453125
70th percentile: 3.255620765686035
80th percentile: 3.690124082565308
90th percentile: 4.412616395950318
95th percentile: 4.7738625526428216
99th percentile: 5.062859477996826
mean time: 3.301033592224121
Pipeline stage StressChecker completed in 17.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.51s
Shutdown handler de-registered
function_kagel_2024-12-05 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3219.38s
Shutdown handler de-registered
function_kagel_2024-12-05 status is now inactive due to auto deactivation removed underperforming models