developer_uid: jxlu90
submission_id: function_binur_2024-12-10
model_name: moonshine_nemo70B_600_sa
model_group:
status: inactive
timestamp: 2024-12-10T00:33:10+00:00
num_battles: 5520
num_wins: 2429
celo_rating: 1220.44
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: moonshine_nemo70B_600_sa
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-09
win_ratio: 0.440036231884058
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8887827396392822s
Received healthy response to inference request in 3.9765751361846924s
Received healthy response to inference request in 4.52006196975708s
Received healthy response to inference request in 2.6136395931243896s
Received healthy response to inference request in 4.296989917755127s
5 requests
0 failed requests
5th percentile: 2.0337541103363037
10th percentile: 2.178725481033325
20th percentile: 2.468668222427368
30th percentile: 2.88622670173645
40th percentile: 3.4314009189605716
50th percentile: 3.9765751361846924
60th percentile: 4.104741048812866
70th percentile: 4.23290696144104
80th percentile: 4.341604328155517
90th percentile: 4.430833148956299
95th percentile: 4.47544755935669
99th percentile: 4.511139087677002
mean time: 3.4592098712921144
%s, retrying in %s seconds...
Received healthy response to inference request in 2.775059223175049s
Received healthy response to inference request in 4.343730449676514s
Received healthy response to inference request in 2.929985761642456s
Received healthy response to inference request in 2.277327299118042s
Received healthy response to inference request in 5.563523054122925s
5 requests
0 failed requests
5th percentile: 2.3768736839294435
10th percentile: 2.4764200687408446
20th percentile: 2.6755128383636473
30th percentile: 2.8060445308685305
40th percentile: 2.8680151462554933
50th percentile: 2.929985761642456
60th percentile: 3.495483636856079
70th percentile: 4.060981512069702
80th percentile: 4.587688970565796
90th percentile: 5.075606012344361
95th percentile: 5.319564533233643
99th percentile: 5.514731349945069
mean time: 3.5779251575469972
%s, retrying in %s seconds...
Received healthy response to inference request in 1.6003036499023438s
Received healthy response to inference request in 7.568691968917847s
Received healthy response to inference request in 2.59263277053833s
Received healthy response to inference request in 1.9407446384429932s
Received healthy response to inference request in 2.7065322399139404s
5 requests
0 failed requests
5th percentile: 1.6683918476104735
10th percentile: 1.7364800453186036
20th percentile: 1.8726564407348634
30th percentile: 2.0711222648620606
40th percentile: 2.331877517700195
50th percentile: 2.59263277053833
60th percentile: 2.638192558288574
70th percentile: 2.683752346038818
80th percentile: 3.6789641857147224
90th percentile: 5.6238280773162845
95th percentile: 6.596260023117065
99th percentile: 7.374205579757691
mean time: 3.281781053543091
Pipeline stage StressChecker completed in 55.49s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.72s
Shutdown handler de-registered
function_binur_2024-12-10 status is now deployed due to DeploymentManager action
function_binur_2024-12-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_binur_2024-12-10 status is now inactive due to auto deactivation removed underperforming models