submission_id: function_kafel_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1261.97
display_name: retune_with_base
family_friendly_score: 0.563058016637131
family_friendly_standard_error: 0.0014099888099813704
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 142008
num_wins: 71268
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-01T03:24:10+00:00
us_pacific_date: 2024-09-30
win_ratio: 0.5018590501943553
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3318426609039307s
Received healthy response to inference request in 5.148839473724365s
Received healthy response to inference request in 4.004338979721069s
Received healthy response to inference request in 2.971566677093506s
Received healthy response to inference request in 3.818763494491577s
5 requests
0 failed requests
5th percentile: 2.459787464141846
10th percentile: 2.587732267379761
20th percentile: 2.8436218738555907
30th percentile: 3.14100604057312
40th percentile: 3.4798847675323485
50th percentile: 3.818763494491577
60th percentile: 3.892993688583374
70th percentile: 3.967223882675171
80th percentile: 4.233239078521729
90th percentile: 4.691039276123047
95th percentile: 4.919939374923706
99th percentile: 5.103059453964233
mean time: 3.65507025718689
Pipeline stage StressChecker completed in 20.23s
Shutdown handler de-registered
function_kafel_2024-10-01 status is now deployed due to DeploymentManager action
function_kafel_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_kafel_2024-10-01 status is now deployed due to admin request
function_kafel_2024-10-01 status is now inactive due to auto deactivation removed underperforming models