developer_uid: jxlu90
submission_id: function_higas_2024-12-04
model_name: moonshine_nemo70B
model_group:
status: inactive
timestamp: 2024-12-04T22:06:34+00:00
num_battles: 6612
num_wins: 3013
celo_rating: 1230.29
family_friendly_score: 0.616
family_friendly_standard_error: 0.006878139283265497
submission_type: function
display_name: moonshine_nemo70B
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-04
win_ratio: 0.455686630369026
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.863126754760742s
Received healthy response to inference request in 4.084142684936523s
Received healthy response to inference request in 3.6975603103637695s
Received healthy response to inference request in 3.3365159034729004s
Received healthy response to inference request in 4.431881427764893s
5 requests
0 failed requests
5th percentile: 3.408724784851074
10th percentile: 3.480933666229248
20th percentile: 3.6253514289855957
30th percentile: 3.730673599243164
40th percentile: 3.796900177001953
50th percentile: 3.863126754760742
60th percentile: 3.9515331268310545
70th percentile: 4.039939498901367
80th percentile: 4.153690433502197
90th percentile: 4.292785930633545
95th percentile: 4.362333679199219
99th percentile: 4.417971878051758
mean time: 3.8826454162597654
%s, retrying in %s seconds...
Received healthy response to inference request in 4.636744737625122s
Received healthy response to inference request in 4.14398717880249s
Received healthy response to inference request in 1.9686050415039062s
Received healthy response to inference request in 3.1384716033935547s
Received healthy response to inference request in 2.978752374649048s
5 requests
0 failed requests
5th percentile: 2.1706345081329346
10th percentile: 2.372663974761963
20th percentile: 2.7767229080200195
30th percentile: 3.010696220397949
40th percentile: 3.074583911895752
50th percentile: 3.1384716033935547
60th percentile: 3.5406778335571287
70th percentile: 3.9428840637207028
80th percentile: 4.242538690567017
90th percentile: 4.439641714096069
95th percentile: 4.538193225860596
99th percentile: 4.617034435272217
mean time: 3.3733121871948244
%s, retrying in %s seconds...
Received healthy response to inference request in 3.2906410694122314s
Received healthy response to inference request in 3.0565199851989746s
Received healthy response to inference request in 2.332223653793335s
Received healthy response to inference request in 2.7682127952575684s
Received healthy response to inference request in 2.9234793186187744s
5 requests
0 failed requests
5th percentile: 2.4194214820861815
10th percentile: 2.5066193103790284
20th percentile: 2.681014966964722
30th percentile: 2.7992660999298096
40th percentile: 2.861372709274292
50th percentile: 2.9234793186187744
60th percentile: 2.9766955852508543
70th percentile: 3.0299118518829347
80th percentile: 3.103344202041626
90th percentile: 3.1969926357269287
95th percentile: 3.24381685256958
99th percentile: 3.281276226043701
mean time: 2.8742153644561768
Pipeline stage StressChecker completed in 54.17s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.14s
Shutdown handler de-registered
function_higas_2024-12-04 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2406.90s
Shutdown handler de-registered
function_higas_2024-12-04 status is now inactive due to auto deactivation removed underperforming models