developer_uid: chai_backend_admin
submission_id: function_hudat_2024-09-25
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-09-25T23:05:47+00:00
num_battles: 3191
num_wins: 1604
celo_rating: 1255.22
family_friendly_score: 0.0
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-25
win_ratio: 0.5026637417737386
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.643333911895752s
Received healthy response to inference request in 2.2719478607177734s
Received healthy response to inference request in 2.7400317192077637s
Received healthy response to inference request in 3.442248821258545s
Received healthy response to inference request in 2.3728041648864746s
5 requests
0 failed requests
5th percentile: 2.2921191215515138
10th percentile: 2.312290382385254
20th percentile: 2.3526329040527343
30th percentile: 2.4462496757507326
40th percentile: 2.593140697479248
50th percentile: 2.7400317192077637
60th percentile: 3.0209185600280763
70th percentile: 3.3018054008483886
80th percentile: 3.6824658393859866
90th percentile: 4.1628998756408695
95th percentile: 4.403116893768311
99th percentile: 4.5952905082702635
mean time: 3.0940732955932617
Pipeline stage StressChecker completed in 17.50s
Shutdown handler de-registered
function_hudat_2024-09-25 status is now deployed due to DeploymentManager action
function_hudat_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
Creating inference service blend-rofur-2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
function_hudat_2024-09-25 status is now torndown due to DeploymentManager action