submission_id: function_liram_2024-10-01
developer_uid: chai_backend_admin
celo_rating: 1253.96
display_name: retune_with_base
family_friendly_score: 0.6043859909695817
family_friendly_standard_error: 0.002613697265644203
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 39747
num_wins: 20007
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-01T17:36:19+00:00
us_pacific_date: 2024-10-01
win_ratio: 0.5033587440561552
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.313370227813721s
Received healthy response to inference request in 4.004070281982422s
Received healthy response to inference request in 2.9853174686431885s
Received healthy response to inference request in 3.116933584213257s
Received healthy response to inference request in 4.254655122756958s
5 requests
0 failed requests
5th percentile: 3.011640691757202
10th percentile: 3.0379639148712156
20th percentile: 3.0906103610992433
30th percentile: 3.2943609237670897
40th percentile: 3.6492156028747558
50th percentile: 4.004070281982422
60th percentile: 4.104304218292237
70th percentile: 4.204538154602051
80th percentile: 4.266398143768311
90th percentile: 4.289884185791015
95th percentile: 4.301627206802368
99th percentile: 4.31102162361145
mean time: 3.7348693370819093
Pipeline stage StressChecker completed in 20.59s
Shutdown handler de-registered
function_liram_2024-10-01 status is now deployed due to DeploymentManager action
function_liram_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_liram_2024-10-01 status is now deployed due to admin request
function_liram_2024-10-01 status is now inactive due to auto deactivation removed underperforming models