submission_id: function_satas_2024-08-09
developer_uid: chai_backend_admin
alignment_samples: 0
display_name: gpt-4o
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64, 'reward_max_token_input': 256}
is_internal_developer: True
model_group:
model_name: gpt-4o
num_battles: 160
num_wins: 70
propriety_score: 0.7272727272727273
propriety_total_count: 11.0
ranking_group: single
reward_repo: ChaiML/gpt2_xl_pairwise_89m_step_347634
status: torndown
submission_type: function
timestamp: 2024-08-09T17:52:09+00:00
us_pacific_date: 2024-08-09
win_ratio: 0.4375
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 4.356706857681274s
Received healthy response to inference request in 2.7771806716918945s
Received healthy response to inference request in 4.140275239944458s
Received healthy response to inference request in 1.422847032546997s
Received healthy response to inference request in 4.658343076705933s
5 requests
0 failed requests
5th percentile: 1.6937137603759767
10th percentile: 1.9645804882049562
20th percentile: 2.506313943862915
30th percentile: 3.049799585342407
40th percentile: 3.595037412643433
50th percentile: 4.140275239944458
60th percentile: 4.226847887039185
70th percentile: 4.313420534133911
80th percentile: 4.417034101486206
90th percentile: 4.537688589096069
95th percentile: 4.598015832901001
99th percentile: 4.646277627944946
mean time: 3.471070575714111
Pipeline stage StressChecker completed in 17.96s
function_satas_2024-08-09 status is now deployed due to DeploymentManager action
function_satas_2024-08-09 status is now torndown due to DeploymentManager action
function_satas_2024-08-09 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics