developer_uid: chai_backend_admin
submission_id: function_pahos_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T03:18:26+00:00
num_battles: 141842
num_wins: 71273
celo_rating: 1258.81
family_friendly_score: 0.5646402377652378
family_friendly_standard_error: 0.0014117485423943334
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.5024816344947195
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.707746505737305s
Received healthy response to inference request in 3.200568199157715s
Received healthy response to inference request in 3.704442262649536s
Received healthy response to inference request in 3.0259463787078857s
Received healthy response to inference request in 3.6479265689849854s
5 requests
0 failed requests
5th percentile: 3.0608707427978517
10th percentile: 3.0957951068878176
20th percentile: 3.165643835067749
30th percentile: 3.290039873123169
40th percentile: 3.468983221054077
50th percentile: 3.6479265689849854
60th percentile: 3.6705328464508056
70th percentile: 3.693139123916626
80th percentile: 3.90510311126709
90th percentile: 4.306424808502197
95th percentile: 4.507085657119751
99th percentile: 4.667614336013794
mean time: 3.6573259830474854
Pipeline stage StressChecker completed in 20.22s
Shutdown handler de-registered
function_pahos_2024-10-01 status is now deployed due to DeploymentManager action
function_pahos_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_pahos_2024-10-01 status is now deployed due to admin request
function_pahos_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_pahos_2024-10-01 status is now torndown due to DeploymentManager action