developer_uid: chai_backend_admin
submission_id: function_mifim_2024-10-20
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-20T05:00:40+00:00
num_battles: 7224
num_wins: 3778
celo_rating: 1243.65
family_friendly_score: 0.5656918376254911
family_friendly_standard_error: 0.005953334137757063
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-19
win_ratio: 0.5229789590254706
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.955207109451294s
Received healthy response to inference request in 1.6240887641906738s
Received healthy response to inference request in 5.34559965133667s
Received healthy response to inference request in 1.406965970993042s
Received healthy response to inference request in 4.083773612976074s
5 requests
0 failed requests
5th percentile: 1.4503905296325683
10th percentile: 1.4938150882720946
20th percentile: 1.5806642055511475
30th percentile: 1.690312433242798
40th percentile: 1.8227597713470458
50th percentile: 1.955207109451294
60th percentile: 2.806633710861206
70th percentile: 3.6580603122711177
80th percentile: 4.336138820648194
90th percentile: 4.8408692359924315
95th percentile: 5.09323444366455
99th percentile: 5.295126609802246
mean time: 2.8831270217895506
Pipeline stage StressChecker completed in 15.77s
Shutdown handler de-registered
function_mifim_2024-10-20 status is now deployed due to DeploymentManager action
function_mifim_2024-10-20 status is now inactive due to auto deactivation removed underperforming models
function_mifim_2024-10-20 status is now torndown due to DeploymentManager action