submission_id: function_dohim_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1252.48
display_name: retune_with_base
family_friendly_score: 0.5587254538718044
family_friendly_standard_error: 0.00953787266271005
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2765
num_wins: 1377
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T01:22:06+00:00
us_pacific_date: 2024-09-25
win_ratio: 0.4980108499095841
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.824524164199829s
Received healthy response to inference request in 2.580033540725708s
Received healthy response to inference request in 2.809196710586548s
Received healthy response to inference request in 2.143122434616089s
Received healthy response to inference request in 1.9709124565124512s
5 requests
0 failed requests
5th percentile: 2.0053544521331785
10th percentile: 2.0397964477539063
20th percentile: 2.1086804389953615
30th percentile: 2.2305046558380126
40th percentile: 2.4052690982818605
50th percentile: 2.580033540725708
60th percentile: 2.671698808670044
70th percentile: 2.76336407661438
80th percentile: 2.812262201309204
90th percentile: 2.818393182754517
95th percentile: 2.821458673477173
99th percentile: 2.823911066055298
mean time: 2.465557861328125
Pipeline stage StressChecker completed in 14.29s
Shutdown handler de-registered
function_dohim_2024-09-26 status is now deployed due to DeploymentManager action
function_dohim_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
function_dohim_2024-09-26 status is now torndown due to DeploymentManager action