submission_id: function_muhif_2024-08-09
developer_uid: chai_backend_admin
alignment_samples: 0
display_name: gpt-4o
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64, 'reward_max_token_input': 256}
is_internal_developer: True
model_group:
model_name: gpt-4o
num_battles: 331
num_wins: 102
propriety_score: 0.6551724137931034
propriety_total_count: 29.0
ranking_group: single
reward_repo: ChaiML/gpt2_xl_pairwise_89m_step_347634
status: torndown
submission_type: function
timestamp: 2024-08-09T16:22:30+00:00
us_pacific_date: 2024-08-09
win_ratio: 0.3081570996978852
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 4.127000331878662s
Received healthy response to inference request in 4.254390239715576s
Received healthy response to inference request in 4.13145112991333s
Received healthy response to inference request in 4.749946355819702s
Received healthy response to inference request in 3.8733572959899902s
5 requests
0 failed requests
5th percentile: 3.9240859031677244
10th percentile: 3.974814510345459
20th percentile: 4.076271724700928
30th percentile: 4.127890491485596
40th percentile: 4.129670810699463
50th percentile: 4.13145112991333
60th percentile: 4.180626773834229
70th percentile: 4.229802417755127
80th percentile: 4.353501462936402
90th percentile: 4.551723909378052
95th percentile: 4.650835132598877
99th percentile: 4.730124111175537
mean time: 4.227229070663452
Pipeline stage StressChecker completed in 21.74s
function_muhif_2024-08-09 status is now deployed due to DeploymentManager action
function_muhif_2024-08-09 status is now inactive due to admin request
function_muhif_2024-08-09 status is now torndown due to DeploymentManager action
function_muhif_2024-08-09 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics