submission_id: function_mugel_2024-08-27
developer_uid: chai_backend_admin
alignment_samples: 10120
alignment_score: -0.639265341089173
celo_rating: 1228.33
display_name: elo_alignment_amd_quartz_fp8
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: elo_alignment_amd_quartz_fp8
num_battles: 10120
num_wins: 4911
propriety_score: 0.7267818574514039
propriety_total_count: 926.0
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-08-27T01:17:13+00:00
us_pacific_date: 2024-08-26
win_ratio: 0.4852766798418972
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 1.546388864517212s
Received healthy response to inference request in 2.275167226791382s
Received healthy response to inference request in 1.7557148933410645s
Received healthy response to inference request in 2.50400710105896s
Received healthy response to inference request in 1.814237356185913s
5 requests
0 failed requests
5th percentile: 1.5882540702819825
10th percentile: 1.6301192760467529
20th percentile: 1.7138496875762939
30th percentile: 1.7674193859100342
40th percentile: 1.7908283710479735
50th percentile: 1.814237356185913
60th percentile: 1.9986093044281006
70th percentile: 2.182981252670288
80th percentile: 2.3209352016448976
90th percentile: 2.412471151351929
95th percentile: 2.458239126205444
99th percentile: 2.4948535060882566
mean time: 1.9791030883789062
Pipeline stage StressChecker completed in 10.93s
function_mugel_2024-08-27 status is now deployed due to DeploymentManager action
function_mugel_2024-08-27 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics