developer_uid: jxlu90
submission_id: function_dejes_2024-12-13
model_name: moonshine600_nemo_1kavg_1750max
model_group:
status: inactive
timestamp: 2024-12-13T17:47:18+00:00
num_battles: 5292
num_wins: 2470
celo_rating: 1236.08
family_friendly_score: 0.6255999999999999
family_friendly_standard_error: 0.006844335468107915
submission_type: function
display_name: moonshine600_nemo_1kavg_1750max
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-13
win_ratio: 0.46674225245653816
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.2298190593719482s
Received healthy response to inference request in 3.665724039077759s
Received healthy response to inference request in 2.4914724826812744s
Received healthy response to inference request in 3.3912742137908936s
Received healthy response to inference request in 2.163703441619873s
5 requests
0 failed requests
5th percentile: 2.2292572498321532
10th percentile: 2.2948110580444334
20th percentile: 2.4259186744689942
30th percentile: 2.639141798019409
40th percentile: 2.9344804286956787
50th percentile: 3.2298190593719482
60th percentile: 3.2944011211395265
70th percentile: 3.3589831829071044
80th percentile: 3.446164178848267
90th percentile: 3.5559441089630126
95th percentile: 3.6108340740203855
99th percentile: 3.654746046066284
mean time: 2.9883986473083497
Pipeline stage StressChecker completed in 16.09s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.51s
Shutdown handler de-registered
function_dejes_2024-12-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2635.77s
Shutdown handler de-registered
function_dejes_2024-12-13 status is now inactive due to auto deactivation removed underperforming models