function_kudif_2024-12-07

developer_uid: jxlu90

submission_id: function_kudif_2024-12-07

model_name: moonshine_nemo70B_600

model_group:

status: inactive

timestamp: 2024-12-07T18:20:04+00:00

num_battles: 7249

num_wins: 3261

celo_rating: 1226.46

family_friendly_score: 0.617

family_friendly_standard_error: 0.006874750904578289

submission_type: function

display_name: moonshine_nemo70B_600

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-07

win_ratio: 0.4498551524348186

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.132610559463501s
Received healthy response to inference request in 5.729281425476074s
Received healthy response to inference request in 2.9124646186828613s
Received healthy response to inference request in 2.4435675144195557s
Received healthy response to inference request in 5.352313995361328s
5 requests
0 failed requests
5th percentile: 2.537346935272217
10th percentile: 2.631126356124878
20th percentile: 2.8186851978302
30th percentile: 3.156493806838989
40th percentile: 3.6445521831512453
50th percentile: 4.132610559463501
60th percentile: 4.620491933822632
70th percentile: 5.108373308181762
80th percentile: 5.427707481384277
90th percentile: 5.578494453430176
95th percentile: 5.653887939453125
99th percentile: 5.714202728271484
mean time: 4.114047622680664
%s, retrying in %s seconds...
Received healthy response to inference request in 5.601257801055908s
Received healthy response to inference request in 3.559626817703247s
Received healthy response to inference request in 2.610914945602417s
Received healthy response to inference request in 3.66910719871521s
Received healthy response to inference request in 2.553349494934082s
5 requests
0 failed requests
5th percentile: 2.564862585067749
10th percentile: 2.576375675201416
20th percentile: 2.59940185546875
30th percentile: 2.800657320022583
40th percentile: 3.180142068862915
50th percentile: 3.559626817703247
60th percentile: 3.603418970108032
70th percentile: 3.647211122512817
80th percentile: 4.05553731918335
90th percentile: 4.828397560119629
95th percentile: 5.214827680587768
99th percentile: 5.52397177696228
mean time: 3.5988512516021727
Pipeline stage StressChecker completed in 41.24s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.46s
Shutdown handler de-registered
function_kudif_2024-12-07 status is now deployed due to DeploymentManager action
function_kudif_2024-12-07 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2532.60s
Shutdown handler de-registered
function_kudif_2024-12-07 status is now inactive due to admin request