developer_uid: jxlu90
submission_id: function_rakir_2024-12-13
model_name: nemo70B_moonshine600_1line
model_group:
status: inactive
timestamp: 2024-12-13T00:39:26+00:00
num_battles: 8183
num_wins: 3630
celo_rating: 1219.42
family_friendly_score: 0.6206
family_friendly_standard_error: 0.00686229757442797
submission_type: function
display_name: nemo70B_moonshine600_1line
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-12
win_ratio: 0.44360259073689357
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7888407707214355s
Received healthy response to inference request in 3.1479341983795166s
Received healthy response to inference request in 4.989379405975342s
Received healthy response to inference request in 2.409243583679199s
Received healthy response to inference request in 2.891800880432129s
5 requests
0 failed requests
5th percentile: 2.4851630210876463
10th percentile: 2.561082458496094
20th percentile: 2.7129213333129885
30th percentile: 2.809432792663574
40th percentile: 2.8506168365478515
50th percentile: 2.891800880432129
60th percentile: 2.994254207611084
70th percentile: 3.0967075347900392
80th percentile: 3.516223239898682
90th percentile: 4.252801322937012
95th percentile: 4.621090364456176
99th percentile: 4.915721597671508
mean time: 3.2454397678375244
Pipeline stage StressChecker completed in 17.39s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.82s
Shutdown handler de-registered
function_rakir_2024-12-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2699.58s
Shutdown handler de-registered
function_rakir_2024-12-13 status is now inactive due to auto deactivation removed underperforming models