submission_id: function_rigit_2024-08-16
developer_uid: chai_backend_admin
alignment_samples: 10315
alignment_score: 2.758468135298262
celo_rating: 1169.88
display_name: mixtral-7x22b-jb
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: mixtral-7x22b-jb
num_battles: 10315
num_wins: 4361
propriety_score: 0.7543859649122807
propriety_total_count: 855.0
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-08-16T23:52:53+00:00
us_pacific_date: 2024-08-16
win_ratio: 0.42278235579253515
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 5.5969438552856445s
Received healthy response to inference request in 3.9449281692504883s
Received healthy response to inference request in 4.794941425323486s
Received healthy response to inference request in 4.226116895675659s
Received healthy response to inference request in 3.975696325302124s
5 requests
0 failed requests
5th percentile: 3.9510818004608153
10th percentile: 3.9572354316711427
20th percentile: 3.969542694091797
30th percentile: 4.025780439376831
40th percentile: 4.125948667526245
50th percentile: 4.226116895675659
60th percentile: 4.45364670753479
70th percentile: 4.6811765193939205
80th percentile: 4.9553419113159185
90th percentile: 5.276142883300781
95th percentile: 5.436543369293212
99th percentile: 5.564863758087158
mean time: 4.50772533416748
Pipeline stage StressChecker completed in 23.06s
function_rigit_2024-08-16 status is now deployed due to DeploymentManager action
function_rigit_2024-08-16 status is now inactive due to auto deactivation removed underperforming models
function_rigit_2024-08-16 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics