developer_uid: jxlu90
submission_id: function_sadas_2024-12-06
model_name: moonshine_nemo70B_750_without
model_group:
status: inactive
timestamp: 2024-12-06T18:51:10+00:00
num_battles: 4579
num_wins: 2057
celo_rating: 1227.64
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: moonshine_nemo70B_750_without
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-06
win_ratio: 0.44922472155492466
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.522669792175293s
Received healthy response to inference request in 2.305685520172119s
Received healthy response to inference request in 3.786824941635132s
Received healthy response to inference request in 2.8687407970428467s
Received healthy response to inference request in 1.9119043350219727s
5 requests
0 failed requests
5th percentile: 1.9906605720520019
10th percentile: 2.069416809082031
20th percentile: 2.22692928314209
30th percentile: 2.4182965755462646
40th percentile: 2.6435186862945557
50th percentile: 2.8687407970428467
60th percentile: 3.2359744548797607
70th percentile: 3.6032081127166746
80th percentile: 3.933993911743164
90th percentile: 4.228331851959228
95th percentile: 4.37550082206726
99th percentile: 4.493235998153686
mean time: 3.0791650772094727
Pipeline stage StressChecker completed in 16.65s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.44s
Shutdown handler de-registered
function_sadas_2024-12-06 status is now deployed due to DeploymentManager action
function_sadas_2024-12-06 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_sadas_2024-12-06 status is now inactive due to admin request