submission_id: function_sagar_2024-09-25
developer_uid: chai_backend_admin
celo_rating: 1223.71
display_name: gpt4-tl
family_friendly_score: 0.7224341854254102
family_friendly_standard_error: 0.008717191086140998
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: gpt4-tl
num_battles: 2690
num_wins: 1216
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-25T05:18:56+00:00
us_pacific_date: 2024-09-24
win_ratio: 0.45204460966542753
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.9103779792785645s
Received healthy response to inference request in 2.350773572921753s
Received healthy response to inference request in 1.9638473987579346s
Received healthy response to inference request in 2.566157102584839s
Received healthy response to inference request in 2.1608457565307617s
5 requests
0 failed requests
5th percentile: 2.0032470703125
10th percentile: 2.0426467418670655
20th percentile: 2.1214460849761965
30th percentile: 2.19883131980896
40th percentile: 2.2748024463653564
50th percentile: 2.350773572921753
60th percentile: 2.436926984786987
70th percentile: 2.5230803966522215
80th percentile: 2.8350012779235843
90th percentile: 3.3726896286010746
95th percentile: 3.641533803939819
99th percentile: 3.8566091442108155
mean time: 2.5904003620147704
Pipeline stage StressChecker completed in 13.68s
Shutdown handler de-registered
function_sagar_2024-09-25 status is now deployed due to DeploymentManager action
function_sagar_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
function_sagar_2024-09-25 status is now torndown due to DeploymentManager action