submission_id: function_gihek_2024-08-09
developer_uid: chai_backend_admin
alignment_samples: 0
display_name: gpt-4o
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64, 'reward_max_token_input': 256}
is_internal_developer: True
model_group:
model_name: gpt-4o
num_battles: 345
num_wins: 75
propriety_score: 0.6521739130434783
propriety_total_count: 23.0
ranking_group: single
reward_repo: ChaiML/gpt2_xl_pairwise_89m_step_347634
status: torndown
submission_type: function
timestamp: 2024-08-09T15:48:05+00:00
us_pacific_date: 2024-08-09
win_ratio: 0.21739130434782608
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 5.133938312530518s
Received healthy response to inference request in 4.1371612548828125s
Received healthy response to inference request in 4.923888206481934s
Received healthy response to inference request in 4.196765661239624s
Received healthy response to inference request in 3.6312077045440674s
5 requests
0 failed requests
5th percentile: 3.7323984146118163
10th percentile: 3.8335891246795653
20th percentile: 4.035970544815063
30th percentile: 4.149082136154175
40th percentile: 4.172923898696899
50th percentile: 4.196765661239624
60th percentile: 4.487614679336548
70th percentile: 4.778463697433471
80th percentile: 4.965898227691651
90th percentile: 5.049918270111084
95th percentile: 5.091928291320801
99th percentile: 5.1255363082885745
mean time: 4.404592227935791
Pipeline stage StressChecker completed in 22.64s
function_gihek_2024-08-09 status is now deployed due to DeploymentManager action
function_gihek_2024-08-09 status is now inactive due to admin request
function_gihek_2024-08-09 status is now deployed due to admin request
function_gihek_2024-08-09 status is now inactive due to admin request
function_gihek_2024-08-09 status is now torndown due to DeploymentManager action
function_gihek_2024-08-09 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics