submission_id: function_papeb_2024-08-16
developer_uid: chai_backend_admin
alignment_samples: 8367
alignment_score: 2.076875050584507
celo_rating: 1217.24
display_name: gpt4-tl
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: gpt4-tl
num_battles: 8367
num_wins: 3950
propriety_score: 0.815989847715736
propriety_total_count: 788.0
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-08-16T17:38:16+00:00
us_pacific_date: 2024-08-16
win_ratio: 0.47209274530895184
Download Preferencedata
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4212098121643066s
Received healthy response to inference request in 2.6970765590667725s
Received healthy response to inference request in 3.4036190509796143s
Received healthy response to inference request in 2.4154560565948486s
Received healthy response to inference request in 7.554021596908569s
5 requests
0 failed requests
5th percentile: 2.41660680770874
10th percentile: 2.4177575588226317
20th percentile: 2.420059061050415
30th percentile: 2.4763831615448
40th percentile: 2.586729860305786
50th percentile: 2.6970765590667725
60th percentile: 2.979693555831909
70th percentile: 3.2623105525970457
80th percentile: 4.233699560165406
90th percentile: 5.893860578536987
95th percentile: 6.723941087722777
99th percentile: 7.388005495071411
mean time: 3.6982766151428224
Pipeline stage StressChecker completed in 19.05s
function_papeb_2024-08-16 status is now deployed due to DeploymentManager action
function_papeb_2024-08-16 status is now inactive due to admin request
function_papeb_2024-08-16 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics