developer_uid: chai_backend_admin
submission_id: function_mugel_2024-08-27
model_name: elo_alignment_amd_quartz_fp8
model_group:
status: torndown
timestamp: 2024-08-27T01:17:13+00:00
num_battles: 10120
num_wins: 4911
celo_rating: 1228.41
family_friendly_score: 0.0
submission_type: function
display_name: elo_alignment_amd_quartz_fp8
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-08-26
win_ratio: 0.4852766798418972
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 1.546388864517212s
Received healthy response to inference request in 2.275167226791382s
Received healthy response to inference request in 1.7557148933410645s
Received healthy response to inference request in 2.50400710105896s
Received healthy response to inference request in 1.814237356185913s
5 requests
0 failed requests
5th percentile: 1.5882540702819825
10th percentile: 1.6301192760467529
20th percentile: 1.7138496875762939
30th percentile: 1.7674193859100342
40th percentile: 1.7908283710479735
50th percentile: 1.814237356185913
60th percentile: 1.9986093044281006
70th percentile: 2.182981252670288
80th percentile: 2.3209352016448976
90th percentile: 2.412471151351929
95th percentile: 2.458239126205444
99th percentile: 2.4948535060882566
mean time: 1.9791030883789062
Pipeline stage StressChecker completed in 10.93s
function_mugel_2024-08-27 status is now deployed due to DeploymentManager action
function_mugel_2024-08-27 status is now inactive due to auto deactivation removed underperforming models
function_mugel_2024-08-27 status is now torndown due to DeploymentManager action
function_mugel_2024-08-27 status is now torndown due to DeploymentManager action