function_kesuf_2024-12-11

developer_uid: jxlu90

submission_id: function_kesuf_2024-12-11

model_name: nemo70B

model_group:

status: inactive

timestamp: 2024-12-11T22:02:08+00:00

num_battles: 8

num_wins: 4

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: nemo70B

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-11

win_ratio: 0.5

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 7.231838941574097s
Received healthy response to inference request in 4.6765782833099365s
Received healthy response to inference request in 6.424478054046631s
Received healthy response to inference request in 2.8989739418029785s
Received healthy response to inference request in 3.5928664207458496s
5 requests
0 failed requests
5th percentile: 3.0377524375915526
10th percentile: 3.176530933380127
20th percentile: 3.4540879249572756
30th percentile: 3.809608793258667
40th percentile: 4.243093538284302
50th percentile: 4.6765782833099365
60th percentile: 5.375738191604614
70th percentile: 6.074898099899292
80th percentile: 6.585950231552125
90th percentile: 6.90889458656311
95th percentile: 7.070366764068603
99th percentile: 7.199544506072998
mean time: 4.964947128295899
%s, retrying in %s seconds...
Received healthy response to inference request in 2.9950568675994873s
Received healthy response to inference request in 3.5822131633758545s
Received healthy response to inference request in 3.076784133911133s
Received healthy response to inference request in 2.962256669998169s
Received healthy response to inference request in 3.833512306213379s
5 requests
0 failed requests
5th percentile: 2.968816709518433
10th percentile: 2.975376749038696
20th percentile: 2.9884968280792235
30th percentile: 3.0114023208618166
40th percentile: 3.0440932273864747
50th percentile: 3.076784133911133
60th percentile: 3.2789557456970213
70th percentile: 3.4811273574829102
80th percentile: 3.6324729919433594
90th percentile: 3.732992649078369
95th percentile: 3.783252477645874
99th percentile: 3.823460340499878
mean time: 3.2899646282196047
Pipeline stage StressChecker completed in 44.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.53s
Shutdown handler de-registered
function_kesuf_2024-12-11 status is now deployed due to DeploymentManager action
function_kesuf_2024-12-11 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered