developer_uid: chai_backend_admin
submission_id: function_honuf_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T17:37:18+00:00
num_battles: 141150
num_wins: 71007
celo_rating: 1255.31
family_friendly_score: 0.5589119719894573
family_friendly_standard_error: 0.0014267165645692754
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-01
win_ratio: 0.5030605738575983
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.814598083496094s
Received healthy response to inference request in 4.533917665481567s
Received healthy response to inference request in 6.152240991592407s
Received healthy response to inference request in 3.7189321517944336s
Received healthy response to inference request in 3.1396615505218506s
5 requests
0 failed requests
5th percentile: 3.2555156707763673
10th percentile: 3.371369791030884
20th percentile: 3.603078031539917
30th percentile: 3.8819292545318604
40th percentile: 4.207923460006714
50th percentile: 4.533917665481567
60th percentile: 4.646189832687378
70th percentile: 4.758461999893188
80th percentile: 5.082126665115356
90th percentile: 5.617183828353882
95th percentile: 5.884712409973145
99th percentile: 6.098735275268555
mean time: 4.471870088577271
Pipeline stage StressChecker completed in 24.38s
Shutdown handler de-registered
function_honuf_2024-10-01 status is now deployed due to DeploymentManager action
function_honuf_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_honuf_2024-10-01 status is now deployed due to admin request
function_honuf_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_honuf_2024-10-01 status is now torndown due to DeploymentManager action