submission_id: function_litar_2024-09-25
developer_uid: chai_backend_admin
celo_rating: 1246.48
display_name: retune_with_base
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3374
num_wins: 1649
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-25T23:02:47+00:00
us_pacific_date: 2024-09-25
win_ratio: 0.488737403675163
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.528230905532837s
Received healthy response to inference request in 3.845576047897339s
Received healthy response to inference request in 1.776543140411377s
Received healthy response to inference request in 2.9675378799438477s
Received healthy response to inference request in 3.165945529937744s
5 requests
0 failed requests
5th percentile: 1.926880693435669
10th percentile: 2.077218246459961
20th percentile: 2.377893352508545
30th percentile: 2.616092300415039
40th percentile: 2.791815090179443
50th percentile: 2.9675378799438477
60th percentile: 3.0469009399414064
70th percentile: 3.1262639999389648
80th percentile: 3.301871633529663
90th percentile: 3.573723840713501
95th percentile: 3.70964994430542
99th percentile: 3.818390827178955
mean time: 2.856766700744629
Pipeline stage StressChecker completed in 16.26s
Shutdown handler de-registered
function_litar_2024-09-25 status is now deployed due to DeploymentManager action
function_litar_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
run pipeline stage %s
function_litar_2024-09-25 status is now torndown due to DeploymentManager action