developer_uid: chai_backend_admin
submission_id: function_nimem_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T02:47:56+00:00
num_battles: 52457
num_wins: 25873
celo_rating: 1268.41
family_friendly_score: 0.5737922524944351
family_friendly_standard_error: 0.0022492444098116695
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.49322302075986046
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7674052715301514s
Received healthy response to inference request in 4.1170878410339355s
Received healthy response to inference request in 3.091646432876587s
Received healthy response to inference request in 3.1931960582733154s
Received healthy response to inference request in 2.7962474822998047s
5 requests
0 failed requests
5th percentile: 2.855327272415161
10th percentile: 2.9144070625305174
20th percentile: 3.0325666427612306
30th percentile: 3.1119563579559326
40th percentile: 3.152576208114624
50th percentile: 3.1931960582733154
60th percentile: 3.4228797435760496
70th percentile: 3.6525634288787843
80th percentile: 3.837341785430908
90th percentile: 3.977214813232422
95th percentile: 4.047151327133179
99th percentile: 4.103100538253784
mean time: 3.3931166172027587
Pipeline stage StressChecker completed in 18.94s
Shutdown handler de-registered
function_nimem_2024-10-01 status is now deployed due to DeploymentManager action
function_nimem_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_nimem_2024-10-01 status is now deployed due to admin request
function_nimem_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_nimem_2024-10-01 status is now torndown due to DeploymentManager action