function_sijib_2024-12-12

developer_uid: jxlu90

submission_id: function_sijib_2024-12-12

model_name: nemo70B

model_group:

status: inactive

timestamp: 2024-12-12T00:03:52+00:00

num_battles: 1957

num_wins: 925

celo_rating: 1240.96

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: nemo70B

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-11

win_ratio: 0.47266223811957075

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.920060634613037s
Received healthy response to inference request in 3.2776944637298584s
Received healthy response to inference request in 2.947211503982544s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 8.055251598358154s
Received healthy response to inference request in 7.3953142166137695s
5 requests
0 failed requests
5th percentile: 3.0133080959320067
10th percentile: 3.07940468788147
20th percentile: 3.2115978717803957
30th percentile: 3.4061676979064943
40th percentile: 3.6631141662597657
50th percentile: 3.920060634613037
60th percentile: 5.31016206741333
70th percentile: 6.700263500213622
80th percentile: 7.527301692962647
90th percentile: 7.791276645660401
95th percentile: 7.923264122009277
99th percentile: 8.02885410308838
mean time: 5.119106483459473
%s, retrying in %s seconds...
Received healthy response to inference request in 3.959045886993408s
Received healthy response to inference request in 5.235247373580933s
Received healthy response to inference request in 4.507143497467041s
Received healthy response to inference request in 3.732100009918213s
Received healthy response to inference request in 2.838209390640259s
5 requests
0 failed requests
5th percentile: 3.01698751449585
10th percentile: 3.1957656383514403
20th percentile: 3.553321886062622
30th percentile: 3.777489185333252
40th percentile: 3.86826753616333
50th percentile: 3.959045886993408
60th percentile: 4.178284931182861
70th percentile: 4.397523975372314
80th percentile: 4.6527642726898195
90th percentile: 4.944005823135376
95th percentile: 5.089626598358154
99th percentile: 5.206123218536377
mean time: 4.0543492317199705
%s, retrying in %s seconds...
Received healthy response to inference request in 2.0456840991973877s
Received healthy response to inference request in 3.149719476699829s
Received healthy response to inference request in 2.512470245361328s
Received healthy response to inference request in 3.798804521560669s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.771106004714966s
5 requests
0 failed requests
5th percentile: 2.1390413284301757
10th percentile: 2.2323985576629637
20th percentile: 2.41911301612854
30th percentile: 2.6399200916290284
40th percentile: 2.8948197841644285
50th percentile: 3.149719476699829
60th percentile: 3.3982740879058837
70th percentile: 3.6468286991119383
80th percentile: 3.7766457080841063
90th percentile: 3.7877251148223876
95th percentile: 3.7932648181915285
99th percentile: 3.797696580886841
mean time: 3.055556869506836
Pipeline stage StressChecker completed in 64.67s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.45s
Shutdown handler de-registered
function_sijib_2024-12-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_sijib_2024-12-12 status is now inactive due to admin request