developer_uid: chai_backend_admin
submission_id: function_kukur_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T20:49:53+00:00
num_battles: 3804
num_wins: 1925
celo_rating: 1274.5
family_friendly_score: 0.5850717962611758
family_friendly_standard_error: 0.00809860863188636
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-01
win_ratio: 0.5060462670872765
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0138542652130127s
Received healthy response to inference request in 2.1465909481048584s
Received healthy response to inference request in 2.958698272705078s
Received healthy response to inference request in 1.8423740863800049s
Received healthy response to inference request in 2.2892274856567383s
5 requests
0 failed requests
5th percentile: 1.8766701221466064
10th percentile: 1.910966157913208
20th percentile: 1.9795582294464111
30th percentile: 2.0404016017913817
40th percentile: 2.0934962749481203
50th percentile: 2.1465909481048584
60th percentile: 2.2036455631256104
70th percentile: 2.2607001781463625
80th percentile: 2.4231216430664064
90th percentile: 2.6909099578857423
95th percentile: 2.82480411529541
99th percentile: 2.9319194412231444
mean time: 2.2501490116119385
Pipeline stage StressChecker completed in 13.20s
Shutdown handler de-registered
function_kukur_2024-10-01 status is now deployed due to DeploymentManager action
function_kukur_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_kukur_2024-10-01 status is now torndown due to DeploymentManager action