submission_id: function_higil_2024-09-20
developer_uid: chai_backend_admin
celo_rating: 1268.66
display_name: elo_alignment_randomize
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: elo_alignment_randomize
num_battles: 13290
num_wins: 7086
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-20T02:56:16+00:00
us_pacific_date: 2024-09-19
win_ratio: 0.5331828442437924
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.917367696762085s
Received healthy response to inference request in 3.285816192626953s
Received healthy response to inference request in 2.5847232341766357s
Received healthy response to inference request in 3.015385389328003s
Received healthy response to inference request in 3.745885133743286s
5 requests
0 failed requests
5th percentile: 2.670855665206909
10th percentile: 2.7569880962371824
20th percentile: 2.9292529582977296
30th percentile: 3.069471549987793
40th percentile: 3.177643871307373
50th percentile: 3.285816192626953
60th percentile: 3.4698437690734862
70th percentile: 3.6538713455200194
80th percentile: 3.780181646347046
90th percentile: 3.8487746715545654
95th percentile: 3.883071184158325
99th percentile: 3.910508394241333
mean time: 3.3098355293273927
Pipeline stage StressChecker completed in 17.07s
Shutdown handler de-registered
function_higil_2024-09-20 status is now deployed due to DeploymentManager action
function_higil_2024-09-20 status is now inactive due to auto deactivation removed underperforming models
function_higil_2024-09-20 status is now torndown due to DeploymentManager action