developer_uid: chai_backend_admin
submission_id: function_datam_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T03:29:06+00:00
num_battles: 2976
num_wins: 1532
celo_rating: 1258.66
family_friendly_score: 0.5627153687112336
family_friendly_standard_error: 0.009190485104022367
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.5147849462365591
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3736166954040527s
Received healthy response to inference request in 3.1882832050323486s
Received healthy response to inference request in 2.456106185913086s
Received healthy response to inference request in 5.815902233123779s
Received healthy response to inference request in 4.721414566040039s
5 requests
0 failed requests
5th percentile: 2.6025415897369384
10th percentile: 2.748976993560791
20th percentile: 3.041847801208496
30th percentile: 3.2253499031066895
40th percentile: 3.299483299255371
50th percentile: 3.3736166954040527
60th percentile: 3.912735843658447
70th percentile: 4.451854991912842
80th percentile: 4.940312099456787
90th percentile: 5.378107166290283
95th percentile: 5.597004699707031
99th percentile: 5.77212272644043
mean time: 3.9110645771026613
Pipeline stage StressChecker completed in 21.51s
Shutdown handler de-registered
function_datam_2024-10-01 status is now deployed due to DeploymentManager action
function_datam_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_datam_2024-10-01 status is now torndown due to DeploymentManager action