function_sugar_2024-12-27

developer_uid: jxlu90

submission_id: function_sugar_2024-12-27

model_name: llama33_70B_bo4

model_group:

status: torndown

timestamp: 2024-12-27T18:07:15+00:00

num_battles: 12342

num_wins: 5915

celo_rating: 1248.75

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: llama33_70B_bo4

is_internal_developer: False

ranking_group: single

us_pacific_date: 2024-12-27

win_ratio: 0.47925781883001134

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.414198875427246s
Received healthy response to inference request in 3.892592191696167s
Received healthy response to inference request in 3.9731967449188232s
Received healthy response to inference request in 3.492523193359375s
Received healthy response to inference request in 3.6864264011383057s
5 requests
0 failed requests
5th percentile: 3.5313038349151613
10th percentile: 3.570084476470947
20th percentile: 3.6476457595825194
30th percentile: 3.727659559249878
40th percentile: 3.8101258754730223
50th percentile: 3.892592191696167
60th percentile: 3.9248340129852295
70th percentile: 3.957075834274292
80th percentile: 4.0613971710205075
90th percentile: 4.237798023223877
95th percentile: 4.325998449325562
99th percentile: 4.396558790206909
mean time: 3.8917874813079836
%s, retrying in %s seconds...
Received healthy response to inference request in 2.2851946353912354s
Received healthy response to inference request in 3.953667640686035s
Received healthy response to inference request in 3.9162728786468506s
Received healthy response to inference request in 3.0565683841705322s
Received healthy response to inference request in 3.0642030239105225s
5 requests
0 failed requests
5th percentile: 2.4394693851470945
10th percentile: 2.593744134902954
20th percentile: 2.902293634414673
30th percentile: 3.0580953121185304
40th percentile: 3.061149168014526
50th percentile: 3.0642030239105225
60th percentile: 3.4050309658050537
70th percentile: 3.745858907699585
80th percentile: 3.9237518310546875
90th percentile: 3.9387097358703613
95th percentile: 3.9461886882781982
99th percentile: 3.9521718502044676
mean time: 3.255181312561035
%s, retrying in %s seconds...
Received healthy response to inference request in 3.531094551086426s
Received healthy response to inference request in 5.697071552276611s
Received healthy response to inference request in 3.423137664794922s
Received healthy response to inference request in 3.216586112976074s
Received healthy response to inference request in 2.844954252243042s
5 requests
0 failed requests
5th percentile: 2.9192806243896485
10th percentile: 2.993606996536255
20th percentile: 3.1422597408294677
30th percentile: 3.2578964233398438
40th percentile: 3.340517044067383
50th percentile: 3.423137664794922
60th percentile: 3.4663204193115233
70th percentile: 3.509503173828125
80th percentile: 3.964289951324463
90th percentile: 4.8306807518005375
95th percentile: 5.2638761520385735
99th percentile: 5.610432472229004
mean time: 3.742568826675415
Pipeline stage StressChecker completed in 58.61s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.86s
Shutdown handler de-registered
function_sugar_2024-12-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_sugar_2024-12-27 status is now inactive due to admin request
function_sugar_2024-12-27 status is now torndown due to DeploymentManager action
function_sugar_2024-12-27 status is now torndown due to DeploymentManager action
function_sugar_2024-12-27 status is now torndown due to DeploymentManager action