submission_id: function_dohan_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1271.73
display_name: retune_with_base
family_friendly_score: 0.5700435729847495
family_friendly_standard_error: 0.00892886210118093
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3141
num_wins: 1677
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-01T03:26:52+00:00
us_pacific_date: 2024-09-30
win_ratio: 0.5339063992359121
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3574085235595703s
Received healthy response to inference request in 3.636260747909546s
Received healthy response to inference request in 3.3601274490356445s
Received healthy response to inference request in 3.5422112941741943s
Received healthy response to inference request in 3.8761658668518066s
5 requests
0 failed requests
5th percentile: 3.3579523086547853
10th percentile: 3.35849609375
20th percentile: 3.3595836639404295
30th percentile: 3.3965442180633545
40th percentile: 3.4693777561187744
50th percentile: 3.5422112941741943
60th percentile: 3.579831075668335
70th percentile: 3.6174508571624755
80th percentile: 3.684241771697998
90th percentile: 3.7802038192749023
95th percentile: 3.8281848430633545
99th percentile: 3.866569662094116
mean time: 3.5544347763061523
Pipeline stage StressChecker completed in 19.73s
Shutdown handler de-registered
function_dohan_2024-10-01 status is now deployed due to DeploymentManager action
function_dohan_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_dohan_2024-10-01 status is now torndown due to DeploymentManager action