submission_id: function_honuf_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1255.31
display_name: retune_with_base
family_friendly_score: 0.5589119719894573
family_friendly_standard_error: 0.0014267165645692754
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 141150
num_wins: 71007
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-01T17:37:18+00:00
us_pacific_date: 2024-10-01
win_ratio: 0.5030605738575983
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.814598083496094s
Received healthy response to inference request in 4.533917665481567s
Received healthy response to inference request in 6.152240991592407s
Received healthy response to inference request in 3.7189321517944336s
Received healthy response to inference request in 3.1396615505218506s
5 requests
0 failed requests
5th percentile: 3.2555156707763673
10th percentile: 3.371369791030884
20th percentile: 3.603078031539917
30th percentile: 3.8819292545318604
40th percentile: 4.207923460006714
50th percentile: 4.533917665481567
60th percentile: 4.646189832687378
70th percentile: 4.758461999893188
80th percentile: 5.082126665115356
90th percentile: 5.617183828353882
95th percentile: 5.884712409973145
99th percentile: 6.098735275268555
mean time: 4.471870088577271
Pipeline stage StressChecker completed in 24.38s
Shutdown handler de-registered
function_honuf_2024-10-01 status is now deployed due to DeploymentManager action
function_honuf_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_honuf_2024-10-01 status is now deployed due to admin request
function_honuf_2024-10-01 status is now inactive due to auto deactivation removed underperforming models