developer_uid: chai_backend_admin
submission_id: function_dohan_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T03:26:52+00:00
num_battles: 3141
num_wins: 1677
celo_rating: 1271.73
family_friendly_score: 0.5700435729847495
family_friendly_standard_error: 0.00892886210118093
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.5339063992359121
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3574085235595703s
Received healthy response to inference request in 3.636260747909546s
Received healthy response to inference request in 3.3601274490356445s
Received healthy response to inference request in 3.5422112941741943s
Received healthy response to inference request in 3.8761658668518066s
5 requests
0 failed requests
5th percentile: 3.3579523086547853
10th percentile: 3.35849609375
20th percentile: 3.3595836639404295
30th percentile: 3.3965442180633545
40th percentile: 3.4693777561187744
50th percentile: 3.5422112941741943
60th percentile: 3.579831075668335
70th percentile: 3.6174508571624755
80th percentile: 3.684241771697998
90th percentile: 3.7802038192749023
95th percentile: 3.8281848430633545
99th percentile: 3.866569662094116
mean time: 3.5544347763061523
Pipeline stage StressChecker completed in 19.73s
Shutdown handler de-registered
function_dohan_2024-10-01 status is now deployed due to DeploymentManager action
function_dohan_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_dohan_2024-10-01 status is now torndown due to DeploymentManager action