submission_id: function_jobak_2024-08-30
developer_uid: chai_backend_admin
alignment_samples: 10975
alignment_score: 2.6199078296900264
celo_rating: 1057.9
display_name: phi-dummy
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: phi-dummy
num_battles: 10975
num_wins: 2907
propriety_score: 0.7352637021716649
propriety_total_count: 967.0
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-08-30T04:47:20+00:00
us_pacific_date: 2024-08-29
win_ratio: 0.264874715261959
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 3.486923933029175s
Received healthy response to inference request in 3.5126044750213623s
Received healthy response to inference request in 4.512716293334961s
Received healthy response to inference request in 3.2427642345428467s
Received healthy response to inference request in 3.219998836517334s
5 requests
0 failed requests
5th percentile: 3.2245519161224365
10th percentile: 3.229104995727539
20th percentile: 3.238211154937744
30th percentile: 3.2915961742401123
40th percentile: 3.3892600536346436
50th percentile: 3.486923933029175
60th percentile: 3.49719614982605
70th percentile: 3.5074683666229247
80th percentile: 3.7126268386840824
90th percentile: 4.112671566009522
95th percentile: 4.312693929672241
99th percentile: 4.472711820602417
mean time: 3.595001554489136
Pipeline stage StressChecker completed in 18.59s
function_jobak_2024-08-30 status is now deployed due to DeploymentManager action
function_jobak_2024-08-30 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics