developer_uid: chai_backend_admin
submission_id: function_kafel_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T03:24:10+00:00
num_battles: 142008
num_wins: 71268
celo_rating: 1261.97
family_friendly_score: 0.563058016637131
family_friendly_standard_error: 0.0014099888099813704
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.5018590501943553
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3318426609039307s
Received healthy response to inference request in 5.148839473724365s
Received healthy response to inference request in 4.004338979721069s
Received healthy response to inference request in 2.971566677093506s
Received healthy response to inference request in 3.818763494491577s
5 requests
0 failed requests
5th percentile: 2.459787464141846
10th percentile: 2.587732267379761
20th percentile: 2.8436218738555907
30th percentile: 3.14100604057312
40th percentile: 3.4798847675323485
50th percentile: 3.818763494491577
60th percentile: 3.892993688583374
70th percentile: 3.967223882675171
80th percentile: 4.233239078521729
90th percentile: 4.691039276123047
95th percentile: 4.919939374923706
99th percentile: 5.103059453964233
mean time: 3.65507025718689
Pipeline stage StressChecker completed in 20.23s
Shutdown handler de-registered
function_kafel_2024-10-01 status is now deployed due to DeploymentManager action
function_kafel_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_kafel_2024-10-01 status is now deployed due to admin request
function_kafel_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_kafel_2024-10-01 status is now torndown due to DeploymentManager action