function_daril_2024-12-12

developer_uid: jxlu90

submission_id: function_daril_2024-12-12

model_name: nemo70B_5Kctx

model_group:

status: inactive

timestamp: 2024-12-12T17:36:48+00:00

num_battles: 0

num_wins: 0

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: nemo70B_5Kctx

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-12

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.566883325576782s
Received healthy response to inference request in 4.080833196640015s
Received healthy response to inference request in 4.426344871520996s
Received healthy response to inference request in 6.149244546890259s
Received healthy response to inference request in 2.990036964416504s
5 requests
0 failed requests
5th percentile: 3.208196210861206
10th percentile: 3.4263554573059083
20th percentile: 3.8626739501953127
30th percentile: 4.149935531616211
40th percentile: 4.288140201568604
50th percentile: 4.426344871520996
60th percentile: 4.8825602531433105
70th percentile: 5.338775634765625
80th percentile: 5.6833555698394775
90th percentile: 5.916300058364868
95th percentile: 6.0327723026275635
99th percentile: 6.12595009803772
mean time: 4.642668581008911
%s, retrying in %s seconds...
Received healthy response to inference request in 3.2533812522888184s
Received healthy response to inference request in 2.8921656608581543s
Received healthy response to inference request in 3.312098264694214s
Received healthy response to inference request in 3.3336496353149414s
Received healthy response to inference request in 6.182342052459717s
5 requests
0 failed requests
5th percentile: 2.964408779144287
10th percentile: 3.0366518974304197
20th percentile: 3.1811381340026856
30th percentile: 3.2651246547698975
40th percentile: 3.2886114597320555
50th percentile: 3.312098264694214
60th percentile: 3.3207188129425047
70th percentile: 3.329339361190796
80th percentile: 3.903388118743897
90th percentile: 5.042865085601807
95th percentile: 5.612603569030761
99th percentile: 6.0683943557739255
mean time: 3.7947273731231688
Pipeline stage StressChecker completed in 44.56s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.41s
Shutdown handler de-registered
function_daril_2024-12-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered