submission_id: function_sokuk_2024-08-09
developer_uid: chai_backend_admin
alignment_samples: 0
display_name: gpt-4o
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64, 'reward_max_token_input': 256}
is_internal_developer: True
model_group:
model_name: gpt-4o
num_battles: 70
num_wins: 27
propriety_score: 0.9090909090909091
propriety_total_count: 11.0
ranking_group: single
reward_repo: ChaiML/gpt2_xl_pairwise_89m_step_347634
status: torndown
submission_type: function
timestamp: 2024-08-09T17:48:21+00:00
us_pacific_date: 2024-08-09
win_ratio: 0.38571428571428573
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 1.3967928886413574s
Received healthy response to inference request in 1.1801118850708008s
Received healthy response to inference request in 1.3920187950134277s
Received healthy response to inference request in 1.2964868545532227s
Received healthy response to inference request in 1.9978764057159424s
5 requests
0 failed requests
5th percentile: 1.2033868789672852
10th percentile: 1.2266618728637695
20th percentile: 1.2732118606567382
30th percentile: 1.3155932426452637
40th percentile: 1.3538060188293457
50th percentile: 1.3920187950134277
60th percentile: 1.3939284324645995
70th percentile: 1.3958380699157715
80th percentile: 1.5170095920562745
90th percentile: 1.7574429988861084
95th percentile: 1.8776597023010253
99th percentile: 1.973833065032959
mean time: 1.45265736579895
Pipeline stage StressChecker completed in 8.13s
function_sokuk_2024-08-09 status is now deployed due to DeploymentManager action
function_sokuk_2024-08-09 status is now inactive due to admin request
function_sokuk_2024-08-09 status is now torndown due to DeploymentManager action
function_sokuk_2024-08-09 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics