submission_id: function_tihif_2024-09-17
developer_uid: chai_backend_admin
celo_rating: 1214.31
display_name: mixtral-large-bo2
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: mixtral-large-bo2
num_battles: 10050
num_wins: 4517
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-17T01:32:13+00:00
us_pacific_date: 2024-09-16
win_ratio: 0.449452736318408
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.318836688995361s
Received healthy response to inference request in 2.617892265319824s
Received healthy response to inference request in 7.907073497772217s
Received healthy response to inference request in 3.654742479324341s
Received healthy response to inference request in 3.7823965549468994s
5 requests
0 failed requests
5th percentile: 2.8252623081207275
10th percentile: 3.032632350921631
20th percentile: 3.4473724365234375
30th percentile: 3.6802732944488525
40th percentile: 3.731334924697876
50th percentile: 3.7823965549468994
60th percentile: 3.996972608566284
70th percentile: 4.211548662185669
80th percentile: 5.036484050750733
90th percentile: 6.471778774261475
95th percentile: 7.189426136016845
99th percentile: 7.763544025421142
mean time: 4.456188297271728
Pipeline stage StressChecker completed in 23.02s
Shutdown handler de-registered
function_tihif_2024-09-17 status is now deployed due to DeploymentManager action
function_tihif_2024-09-17 status is now inactive due to auto deactivation removed underperforming models
function_tihif_2024-09-17 status is now torndown due to DeploymentManager action