developer_uid: jxlu90
submission_id: function_fukif_2024-12-05
model_name: moonshine_nemo70B_8rn_300hist
model_group:
status: inactive
timestamp: 2024-12-05T23:10:24+00:00
num_battles: 3201
num_wins: 1421
celo_rating: 1223.87
family_friendly_score: 0.6202
family_friendly_standard_error: 0.006863701042440587
submission_type: function
display_name: moonshine_nemo70B_8rn_300hist
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-05
win_ratio: 0.44392377382068104
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.9114019870758057s
Received healthy response to inference request in 3.9111528396606445s
Received healthy response to inference request in 5.005864143371582s
Received healthy response to inference request in 4.186333417892456s
Received healthy response to inference request in 6.455992221832275s
5 requests
0 failed requests
5th percentile: 3.1113521575927736
10th percentile: 3.311302328109741
20th percentile: 3.7112026691436766
30th percentile: 3.9661889553070067
40th percentile: 4.076261186599732
50th percentile: 4.186333417892456
60th percentile: 4.514145708084106
70th percentile: 4.841957998275757
80th percentile: 5.295889759063721
90th percentile: 5.875940990447998
95th percentile: 6.165966606140136
99th percentile: 6.397987098693847
mean time: 4.494148921966553
%s, retrying in %s seconds...
Received healthy response to inference request in 2.911404848098755s
Received healthy response to inference request in 3.877091646194458s
Received healthy response to inference request in 3.009627103805542s
Received healthy response to inference request in 2.0152430534362793s
Received healthy response to inference request in 3.010092258453369s
5 requests
0 failed requests
5th percentile: 2.1944754123687744
10th percentile: 2.3737077713012695
20th percentile: 2.7321724891662598
30th percentile: 2.9310492992401125
40th percentile: 2.9703382015228272
50th percentile: 3.009627103805542
60th percentile: 3.009813165664673
70th percentile: 3.009999227523804
80th percentile: 3.183492136001587
90th percentile: 3.5302918910980225
95th percentile: 3.70369176864624
99th percentile: 3.8424116706848146
mean time: 2.9646917819976806
Pipeline stage StressChecker completed in 39.43s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.23s
Shutdown handler de-registered
function_fukif_2024-12-05 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2637.88s
Shutdown handler de-registered
function_fukif_2024-12-05 status is now inactive due to admin request