submission_id: function_lepif_2024-08-20
developer_uid: chai_backend_admin
alignment_samples: 94
display_name: gpt4-tl
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: gpt4-tl
num_battles: 94
num_wins: 42
propriety_score: 0.7142857142857143
propriety_total_count: 7.0
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-08-20T18:00:13+00:00
us_pacific_date: 2024-08-20
win_ratio: 0.44680851063829785
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 2.208603620529175s
Received healthy response to inference request in 1.9494998455047607s
Received healthy response to inference request in 1.7317965030670166s
Received healthy response to inference request in 3.1193971633911133s
Received healthy response to inference request in 6.702853441238403s
5 requests
0 failed requests
5th percentile: 1.7753371715545654
10th percentile: 1.8188778400421142
20th percentile: 1.905959177017212
30th percentile: 2.0013206005096436
40th percentile: 2.104962110519409
50th percentile: 2.208603620529175
60th percentile: 2.57292103767395
70th percentile: 2.9372384548187256
80th percentile: 3.836088418960572
90th percentile: 5.269470930099487
95th percentile: 5.986162185668944
99th percentile: 6.559515190124512
mean time: 3.1424301147460936
Pipeline stage StressChecker completed in 16.86s
function_lepif_2024-08-20 status is now deployed due to DeploymentManager action
function_lepif_2024-08-20 status is now inactive due to admin request
function_lepif_2024-08-20 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics