developer_uid: chai_backend_admin
submission_id: function_fogim_2024-08-19
model_name: gpt4-tl
model_group:
status: torndown
timestamp: 2024-08-19T01:43:31+00:00
num_battles: 27912
num_wins: 13263
celo_rating: 1228.06
family_friendly_score: 0.0
submission_type: function
display_name: gpt4-tl
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-08-18
win_ratio: 0.4751719690455718
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 1.732375144958496s
Received healthy response to inference request in 1.6562983989715576s
Received healthy response to inference request in 1.870187520980835s
Received healthy response to inference request in 2.991096258163452s
Received healthy response to inference request in 1.5227301120758057s
5 requests
0 failed requests
5th percentile: 1.549443769454956
10th percentile: 1.5761574268341065
20th percentile: 1.6295847415924072
30th percentile: 1.6715137481689453
40th percentile: 1.7019444465637208
50th percentile: 1.732375144958496
60th percentile: 1.7875000953674316
70th percentile: 1.842625045776367
80th percentile: 2.0943692684173585
90th percentile: 2.5427327632904055
95th percentile: 2.7669145107269286
99th percentile: 2.9462599086761476
mean time: 1.9545374870300294
Pipeline stage StressChecker completed in 10.31s
function_fogim_2024-08-19 status is now deployed due to DeploymentManager action
function_fogim_2024-08-19 status is now inactive due to admin request
function_fogim_2024-08-19 status is now torndown due to DeploymentManager action