submission_id: function_kesul_2024-10-13
developer_uid: chai_backend_admin
celo_rating: 1209.02
display_name: retune_with_base
family_friendly_score: 0.6197944835045971
family_friendly_standard_error: 0.005629684619100426
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 7725
num_wins: 3483
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-13T18:26:26+00:00
us_pacific_date: 2024-10-13
win_ratio: 0.450873786407767
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.105458974838257s
Received healthy response to inference request in 2.047084093093872s
Received healthy response to inference request in 2.605055332183838s
Received healthy response to inference request in 2.4076998233795166s
Received healthy response to inference request in 2.9743759632110596s
5 requests
0 failed requests
5th percentile: 2.058759069442749
10th percentile: 2.070434045791626
20th percentile: 2.09378399848938
30th percentile: 2.165907144546509
40th percentile: 2.2868034839630127
50th percentile: 2.4076998233795166
60th percentile: 2.486642026901245
70th percentile: 2.5655842304229735
80th percentile: 2.678919458389282
90th percentile: 2.826647710800171
95th percentile: 2.9005118370056153
99th percentile: 2.9596031379699705
mean time: 2.4279348373413088
Pipeline stage StressChecker completed in 14.81s
Shutdown handler de-registered
function_kesul_2024-10-13 status is now deployed due to DeploymentManager action
function_kesul_2024-10-13 status is now inactive due to auto deactivation removed underperforming models
function_kesul_2024-10-13 status is now torndown due to DeploymentManager action