function_kibak_2024-12-06

developer_uid: jxlu90

submission_id: function_kibak_2024-12-06

model_name: moonshine_nemo70B_8rn_300hist

model_group:

status: inactive

timestamp: 2024-12-06T00:53:46+00:00

num_battles: 4041

num_wins: 1780

celo_rating: 1220.5

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: moonshine_nemo70B_8rn_300hist

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-05

win_ratio: 0.4404850284583024

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.692476272583008s
Received healthy response to inference request in 2.048076629638672s
Received healthy response to inference request in 2.8678574562072754s
Received healthy response to inference request in 2.704974889755249s
Received healthy response to inference request in 4.321260213851929s
5 requests
0 failed requests
5th percentile: 2.179456281661987
10th percentile: 2.310835933685303
20th percentile: 2.5735952377319338
30th percentile: 2.7375514030456545
40th percentile: 2.802704429626465
50th percentile: 2.8678574562072754
60th percentile: 3.4492185592651365
70th percentile: 4.030579662322998
80th percentile: 4.395503425598145
90th percentile: 4.543989849090576
95th percentile: 4.618233060836792
99th percentile: 4.677627630233765
mean time: 3.3269290924072266
%s, retrying in %s seconds...
Received healthy response to inference request in 2.3279709815979004s
Received healthy response to inference request in 2.363755226135254s
Received healthy response to inference request in 3.552692174911499s
Received healthy response to inference request in 4.3970787525177s
Received healthy response to inference request in 2.402845859527588s
5 requests
0 failed requests
5th percentile: 2.335127830505371
10th percentile: 2.342284679412842
20th percentile: 2.356598377227783
30th percentile: 2.3715733528137206
40th percentile: 2.3872096061706545
50th percentile: 2.402845859527588
60th percentile: 2.8627843856811523
70th percentile: 3.322722911834717
80th percentile: 3.7215694904327394
90th percentile: 4.059324121475219
95th percentile: 4.22820143699646
99th percentile: 4.3633032894134525
mean time: 3.008868598937988
Pipeline stage StressChecker completed in 33.88s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.15s
Shutdown handler de-registered
function_kibak_2024-12-06 status is now deployed due to DeploymentManager action
function_kibak_2024-12-06 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Retrying (%r) after connection broken by '%r': %s
Shutdown handler de-registered
function_kibak_2024-12-06 status is now inactive due to admin request