developer_uid: chai_backend_admin
submission_id: function_bajum_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T17:56:31+00:00
num_battles: 34922
num_wins: 17616
celo_rating: 1270.24
family_friendly_score: 0.6266786108971568
family_friendly_standard_error: 0.0027485196407451085
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-01
win_ratio: 0.5044384628600882
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7000186443328857s
Received healthy response to inference request in 2.9345147609710693s
Received healthy response to inference request in 3.451709270477295s
Received healthy response to inference request in 3.096060037612915s
Received healthy response to inference request in 2.7752163410186768s
5 requests
0 failed requests
5th percentile: 2.807076025009155
10th percentile: 2.838935708999634
20th percentile: 2.902655076980591
30th percentile: 2.9668238162994385
40th percentile: 3.0314419269561768
50th percentile: 3.096060037612915
60th percentile: 3.238319730758667
70th percentile: 3.3805794239044187
80th percentile: 3.501371145248413
90th percentile: 3.6006948947906494
95th percentile: 3.6503567695617676
99th percentile: 3.690086269378662
mean time: 3.191503810882568
Pipeline stage StressChecker completed in 17.98s
Shutdown handler de-registered
function_bajum_2024-10-01 status is now deployed due to DeploymentManager action
function_bajum_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_bajum_2024-10-01 status is now deployed due to admin request
function_bajum_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_bajum_2024-10-01 status is now torndown due to DeploymentManager action