submission_id: function_tonil_2024-08-16
developer_uid: chai_backend_admin
alignment_samples: 5663
alignment_score: 2.242433441908852
celo_rating: 1111.23
display_name: mixtral-7x22b-jb
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: mixtral-7x22b-jb
num_battles: 5663
num_wins: 1960
propriety_score: 0.718978102189781
propriety_total_count: 548.0
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-08-16T23:00:52+00:00
us_pacific_date: 2024-08-16
win_ratio: 0.34610630407911
Download Preferencedata
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 1.6591320037841797s
Received healthy response to inference request in 5.296358346939087s
Received healthy response to inference request in 1.7376775741577148s
Received healthy response to inference request in 1.7182180881500244s
Received healthy response to inference request in 1.9285337924957275s
5 requests
0 failed requests
5th percentile: 1.6709492206573486
10th percentile: 1.6827664375305176
20th percentile: 1.7064008712768555
30th percentile: 1.7221099853515625
40th percentile: 1.7298937797546388
50th percentile: 1.7376775741577148
60th percentile: 1.8140200614929198
70th percentile: 1.890362548828125
80th percentile: 2.6020987033844
90th percentile: 3.949228525161743
95th percentile: 4.622793436050414
99th percentile: 5.161645364761353
mean time: 2.4679839611053467
Pipeline stage StressChecker completed in 12.87s
function_tonil_2024-08-16 status is now deployed due to DeploymentManager action
function_tonil_2024-08-16 status is now inactive due to admin request
function_tonil_2024-08-16 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics