developer_uid: chai_backend_admin
submission_id: function_bugas_2024-10-13
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-13T18:23:54+00:00
num_battles: 8858
num_wins: 4083
celo_rating: 1215.61
family_friendly_score: 0.6306944444444444
family_friendly_standard_error: 0.005242903282331682
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-13
win_ratio: 0.46093926394219914
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.525437116622925s
Received healthy response to inference request in 2.2507145404815674s
Received healthy response to inference request in 2.2263879776000977s
Received healthy response to inference request in 1.8343980312347412s
Received healthy response to inference request in 2.371703624725342s
5 requests
0 failed requests
5th percentile: 1.9127960205078125
10th percentile: 1.9911940097808838
20th percentile: 2.1479899883270264
30th percentile: 2.2312532901763915
40th percentile: 2.2409839153289797
50th percentile: 2.2507145404815674
60th percentile: 2.299110174179077
70th percentile: 2.347505807876587
80th percentile: 2.4024503231048584
90th percentile: 2.4639437198638916
95th percentile: 2.494690418243408
99th percentile: 2.5192877769470217
mean time: 2.2417282581329347
Pipeline stage StressChecker completed in 13.67s
Shutdown handler de-registered
function_bugas_2024-10-13 status is now deployed due to DeploymentManager action
function_bugas_2024-10-13 status is now inactive due to auto deactivation removed underperforming models
function_bugas_2024-10-13 status is now torndown due to DeploymentManager action