submission_id: function_neful_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1267.53
display_name: retune_with_base
family_friendly_score: 0.5592425295343989
family_friendly_standard_error: 0.009238183709083317
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2958
num_wins: 1536
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T01:18:21+00:00
us_pacific_date: 2024-09-25
win_ratio: 0.5192697768762677
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.512909412384033s
Received healthy response to inference request in 2.9478774070739746s
Received healthy response to inference request in 2.415830135345459s
Received healthy response to inference request in 2.8175086975097656s
Received healthy response to inference request in 2.1667518615722656s
5 requests
0 failed requests
5th percentile: 2.2165675163269043
10th percentile: 2.266383171081543
20th percentile: 2.3660144805908203
30th percentile: 2.4961658477783204
40th percentile: 2.656837272644043
50th percentile: 2.8175086975097656
60th percentile: 2.8696561813354493
70th percentile: 2.921803665161133
80th percentile: 3.0608838081359866
90th percentile: 3.2868966102600097
95th percentile: 3.399903011322021
99th percentile: 3.4903081321716307
mean time: 2.7721755027771
Pipeline stage StressChecker completed in 15.78s
Shutdown handler de-registered
function_neful_2024-09-26 status is now deployed due to DeploymentManager action
function_neful_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Pipeline stage ProductionBlendMKMLTemplater completed in 48.86s
function_neful_2024-09-26 status is now torndown due to DeploymentManager action