submission_id: function_kukur_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1274.5
display_name: retune_with_base
family_friendly_score: 0.5850717962611758
family_friendly_standard_error: 0.00809860863188636
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3804
num_wins: 1925
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-01T20:49:53+00:00
us_pacific_date: 2024-10-01
win_ratio: 0.5060462670872765
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0138542652130127s
Received healthy response to inference request in 2.1465909481048584s
Received healthy response to inference request in 2.958698272705078s
Received healthy response to inference request in 1.8423740863800049s
Received healthy response to inference request in 2.2892274856567383s
5 requests
0 failed requests
5th percentile: 1.8766701221466064
10th percentile: 1.910966157913208
20th percentile: 1.9795582294464111
30th percentile: 2.0404016017913817
40th percentile: 2.0934962749481203
50th percentile: 2.1465909481048584
60th percentile: 2.2036455631256104
70th percentile: 2.2607001781463625
80th percentile: 2.4231216430664064
90th percentile: 2.6909099578857423
95th percentile: 2.82480411529541
99th percentile: 2.9319194412231444
mean time: 2.2501490116119385
Pipeline stage StressChecker completed in 13.20s
Shutdown handler de-registered
function_kukur_2024-10-01 status is now deployed due to DeploymentManager action
function_kukur_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_kukur_2024-10-01 status is now torndown due to DeploymentManager action