submission_id: function_hudat_2024-09-25
developer_uid: chai_backend_admin
celo_rating: 1255.22
display_name: retune_with_base
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3191
num_wins: 1604
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-25T23:05:47+00:00
us_pacific_date: 2024-09-25
win_ratio: 0.5026637417737386
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.643333911895752s
Received healthy response to inference request in 2.2719478607177734s
Received healthy response to inference request in 2.7400317192077637s
Received healthy response to inference request in 3.442248821258545s
Received healthy response to inference request in 2.3728041648864746s
5 requests
0 failed requests
5th percentile: 2.2921191215515138
10th percentile: 2.312290382385254
20th percentile: 2.3526329040527343
30th percentile: 2.4462496757507326
40th percentile: 2.593140697479248
50th percentile: 2.7400317192077637
60th percentile: 3.0209185600280763
70th percentile: 3.3018054008483886
80th percentile: 3.6824658393859866
90th percentile: 4.1628998756408695
95th percentile: 4.403116893768311
99th percentile: 4.5952905082702635
mean time: 3.0940732955932617
Pipeline stage StressChecker completed in 17.50s
Shutdown handler de-registered
function_hudat_2024-09-25 status is now deployed due to DeploymentManager action
function_hudat_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
Creating inference service blend-rofur-2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
function_hudat_2024-09-25 status is now torndown due to DeploymentManager action