developer_uid: jxlu90
submission_id: function_ginos_2024-12-28
model_name: llama3_70b_bo1
model_group:
status: torndown
timestamp: 2024-12-28T01:01:53+00:00
num_battles: 9856
num_wins: 4230
celo_rating: 1210.43
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: llama3_70b_bo1
is_internal_developer: False
ranking_group: single
us_pacific_date: 2024-12-27
win_ratio: 0.4291801948051948
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', 'You:', '\n'], 'max_input_tokens': 1024, 'best_of': 1, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.573507308959961s
Received healthy response to inference request in 2.9692904949188232s
Received healthy response to inference request in 2.975128412246704s
Received healthy response to inference request in 4.239201784133911s
Received healthy response to inference request in 4.623020887374878s
5 requests
0 failed requests
5th percentile: 2.9704580783843992
10th percentile: 2.9716256618499757
20th percentile: 2.973960828781128
30th percentile: 3.0948041915893554
40th percentile: 3.3341557502746584
50th percentile: 3.573507308959961
60th percentile: 3.839785099029541
70th percentile: 4.106062889099121
80th percentile: 4.315965604782105
90th percentile: 4.469493246078491
95th percentile: 4.546257066726684
99th percentile: 4.607668123245239
mean time: 3.6760297775268556
%s, retrying in %s seconds...
Received healthy response to inference request in 3.832808256149292s
Received healthy response to inference request in 2.842857837677002s
Received healthy response to inference request in 4.263219594955444s
Received healthy response to inference request in 4.965364694595337s
Received healthy response to inference request in 4.750415086746216s
5 requests
0 failed requests
5th percentile: 3.04084792137146
10th percentile: 3.238838005065918
20th percentile: 3.634818172454834
30th percentile: 3.9188905239105223
40th percentile: 4.091055059432984
50th percentile: 4.263219594955444
60th percentile: 4.458097791671753
70th percentile: 4.652975988388062
80th percentile: 4.79340500831604
90th percentile: 4.879384851455688
95th percentile: 4.9223747730255125
99th percentile: 4.956766710281372
mean time: 4.130933094024658
%s, retrying in %s seconds...
Received healthy response to inference request in 2.7451324462890625s
Received healthy response to inference request in 3.0559022426605225s
Received healthy response to inference request in 2.580732822418213s
Received healthy response to inference request in 2.2148520946502686s
Received healthy response to inference request in 3.094404458999634s
5 requests
0 failed requests
5th percentile: 2.2880282402038574
10th percentile: 2.3612043857574463
20th percentile: 2.507556676864624
30th percentile: 2.613612747192383
40th percentile: 2.6793725967407225
50th percentile: 2.7451324462890625
60th percentile: 2.8694403648376463
70th percentile: 2.9937482833862306
80th percentile: 3.0636026859283447
90th percentile: 3.0790035724639893
95th percentile: 3.0867040157318115
99th percentile: 3.0928643703460694
mean time: 2.73820481300354
Pipeline stage StressChecker completed in 56.26s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
Shutdown handler de-registered
function_ginos_2024-12-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_ginos_2024-12-28 status is now inactive due to auto deactivation removed underperforming models
function_ginos_2024-12-28 status is now torndown due to DeploymentManager action
function_ginos_2024-12-28 status is now torndown due to DeploymentManager action
function_ginos_2024-12-28 status is now torndown due to DeploymentManager action