submission_id: function_pafak_2024-10-05
developer_uid: chai_backend_admin
celo_rating: 1259.75
display_name: retune_with_base
family_friendly_score: 0.5820499979132758
family_friendly_standard_error: 0.005491255497450379
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 8356
num_wins: 4212
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-05T19:23:17+00:00
us_pacific_date: 2024-10-05
win_ratio: 0.5040689325035902
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7052316665649414s
Received healthy response to inference request in 3.5142006874084473s
Received healthy response to inference request in 4.5384931564331055s
Received healthy response to inference request in 3.5746543407440186s
Received healthy response to inference request in 3.2523751258850098s
5 requests
0 failed requests
5th percentile: 3.304740238189697
10th percentile: 3.357105350494385
20th percentile: 3.46183557510376
30th percentile: 3.5262914180755613
40th percentile: 3.55047287940979
50th percentile: 3.5746543407440186
60th percentile: 3.626885271072388
70th percentile: 3.679116201400757
80th percentile: 3.8718839645385743
90th percentile: 4.20518856048584
95th percentile: 4.371840858459472
99th percentile: 4.5051626968383784
mean time: 3.7169909954071043
Pipeline stage StressChecker completed in 19.89s
Shutdown handler de-registered
function_pafak_2024-10-05 status is now deployed due to DeploymentManager action
function_pafak_2024-10-05 status is now inactive due to auto deactivation removed underperforming models
function_pafak_2024-10-05 status is now torndown due to DeploymentManager action