developer_uid: jxlu90
submission_id: function_pakut_2024-12-12
model_name: nemo70B_moonshine600_1line
model_group:
status: torndown
timestamp: 2024-12-12T04:30:36+00:00
num_battles: 17312
num_wins: 8544
celo_rating: 1218.18
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: nemo70B_moonshine600_1line
is_internal_developer: False
ranking_group: single
us_pacific_date: 2024-12-11
win_ratio: 0.49353049907578556
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', 'You:', '\n'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.278801202774048s
Received healthy response to inference request in 3.5710630416870117s
Received healthy response to inference request in 3.5350098609924316s
Received healthy response to inference request in 4.787475824356079s
Received healthy response to inference request in 2.2867512702941895s
5 requests
0 failed requests
5th percentile: 2.280391216278076
10th percentile: 2.2819812297821045
20th percentile: 2.285161256790161
30th percentile: 2.5364029884338377
40th percentile: 3.035706424713135
50th percentile: 3.5350098609924316
60th percentile: 3.5494311332702635
70th percentile: 3.563852405548096
80th percentile: 3.814345598220825
90th percentile: 4.300910711288452
95th percentile: 4.544193267822266
99th percentile: 4.738819313049317
mean time: 3.291820240020752
Pipeline stage StressChecker completed in 17.53s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.37s
Shutdown handler de-registered
function_pakut_2024-12-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
function_pakut_2024-12-12 status is now inactive due to admin request
function_pakut_2024-12-12 status is now torndown due to DeploymentManager action
function_pakut_2024-12-12 status is now torndown due to DeploymentManager action
function_pakut_2024-12-12 status is now torndown due to DeploymentManager action