developer_uid: chai_backend_admin
submission_id: function_luhuk_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T02:56:38+00:00
num_battles: 152863
num_wins: 77215
celo_rating: 1278.7
family_friendly_score: 0.5670734514688398
family_friendly_standard_error: 0.0013636123203457306
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.5051255045367421
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2673850059509277s
Received healthy response to inference request in 4.6756463050842285s
Received healthy response to inference request in 4.451874494552612s
Received healthy response to inference request in 4.279386281967163s
Received healthy response to inference request in 2.611269950866699s
5 requests
0 failed requests
5th percentile: 2.336161994934082
10th percentile: 2.404938983917236
20th percentile: 2.542492961883545
30th percentile: 2.944893217086792
40th percentile: 3.612139749526978
50th percentile: 4.279386281967163
60th percentile: 4.348381567001343
70th percentile: 4.417376852035522
80th percentile: 4.496628856658935
90th percentile: 4.586137580871582
95th percentile: 4.630891942977906
99th percentile: 4.666695432662964
mean time: 3.657112407684326
Pipeline stage StressChecker completed in 20.29s
Shutdown handler de-registered
function_luhuk_2024-10-01 status is now deployed due to DeploymentManager action
function_luhuk_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_luhuk_2024-10-01 status is now deployed due to admin request
function_luhuk_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_luhuk_2024-10-01 status is now torndown due to DeploymentManager action