submission_id: function_gosot_2024-09-25
developer_uid: chai_backend_admin
celo_rating: 1233.66
display_name: gpt4-tl
family_friendly_score: 0.715109989181392
family_friendly_standard_error: 0.008546315578309767
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: gpt4-tl
num_battles: 2838
num_wins: 1335
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-25T04:30:34+00:00
us_pacific_date: 2024-09-24
win_ratio: 0.4704016913319239
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 1.2542834281921387s
Received healthy response to inference request in 2.0794944763183594s
Received healthy response to inference request in 3.5638561248779297s
Received healthy response to inference request in 3.4475016593933105s
Received healthy response to inference request in 3.1623666286468506s
5 requests
0 failed requests
5th percentile: 1.4193256378173829
10th percentile: 1.584367847442627
20th percentile: 1.9144522666931152
30th percentile: 2.2960689067840576
40th percentile: 2.729217767715454
50th percentile: 3.1623666286468506
60th percentile: 3.2764206409454344
70th percentile: 3.3904746532440186
80th percentile: 3.470772552490234
90th percentile: 3.517314338684082
95th percentile: 3.540585231781006
99th percentile: 3.559201946258545
mean time: 2.7015004634857176
Pipeline stage StressChecker completed in 15.66s
Shutdown handler de-registered
function_gosot_2024-09-25 status is now deployed due to DeploymentManager action
function_gosot_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
function_gosot_2024-09-25 status is now torndown due to DeploymentManager action