submission_id: function_fogim_2024-08-19
developer_uid: chai_backend_admin
alignment_samples: 27912
alignment_score: 1.7378278000326524
celo_rating: 1230.4
display_name: gpt4-tl
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: gpt4-tl
num_battles: 27912
num_wins: 13263
propriety_score: 0.7894736842105263
propriety_total_count: 2641.0
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-08-19T01:43:31+00:00
us_pacific_date: 2024-08-18
win_ratio: 0.4751719690455718
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 1.732375144958496s
Received healthy response to inference request in 1.6562983989715576s
Received healthy response to inference request in 1.870187520980835s
Received healthy response to inference request in 2.991096258163452s
Received healthy response to inference request in 1.5227301120758057s
5 requests
0 failed requests
5th percentile: 1.549443769454956
10th percentile: 1.5761574268341065
20th percentile: 1.6295847415924072
30th percentile: 1.6715137481689453
40th percentile: 1.7019444465637208
50th percentile: 1.732375144958496
60th percentile: 1.7875000953674316
70th percentile: 1.842625045776367
80th percentile: 2.0943692684173585
90th percentile: 2.5427327632904055
95th percentile: 2.7669145107269286
99th percentile: 2.9462599086761476
mean time: 1.9545374870300294
Pipeline stage StressChecker completed in 10.31s
function_fogim_2024-08-19 status is now deployed due to DeploymentManager action
function_fogim_2024-08-19 status is now inactive due to admin request
function_fogim_2024-08-19 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics