developer_uid: chai_backend_admin
submission_id: function_fidit_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T20:47:19+00:00
num_battles: 3821
num_wins: 1901
celo_rating: 1257.9
family_friendly_score: 0.5541160593792173
family_friendly_standard_error: 0.008153854901940507
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-01
win_ratio: 0.49751373985867575
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.306509494781494s
Received healthy response to inference request in 3.0282199382781982s
Received healthy response to inference request in 4.811127185821533s
Received healthy response to inference request in 3.687277317047119s
Received healthy response to inference request in 4.174870014190674s
5 requests
0 failed requests
5th percentile: 3.0838778495788572
10th percentile: 3.1395357608795167
20th percentile: 3.250851583480835
30th percentile: 3.382663059234619
40th percentile: 3.534970188140869
50th percentile: 3.687277317047119
60th percentile: 3.882314395904541
70th percentile: 4.077351474761963
80th percentile: 4.3021214485168455
90th percentile: 4.55662431716919
95th percentile: 4.6838757514953615
99th percentile: 4.785676898956299
mean time: 3.801600790023804
Pipeline stage StressChecker completed in 20.97s
Shutdown handler de-registered
function_fidit_2024-10-01 status is now deployed due to DeploymentManager action
function_fidit_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_fidit_2024-10-01 status is now torndown due to DeploymentManager action