developer_uid: chai_backend_admin
submission_id: function_mojen_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T02:52:09+00:00
num_battles: 51433
num_wins: 26125
celo_rating: 1276.27
family_friendly_score: 0.5847252401025596
family_friendly_standard_error: 0.0022617933131610602
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.5079423716291097
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.43135666847229s
Received healthy response to inference request in 3.6488037109375s
Received healthy response to inference request in 2.706852674484253s
Received healthy response to inference request in 3.138986587524414s
Received healthy response to inference request in 3.7430949211120605s
5 requests
0 failed requests
5th percentile: 2.793279457092285
10th percentile: 2.8797062397003175
20th percentile: 3.052559804916382
30th percentile: 3.1974606037139894
40th percentile: 3.3144086360931397
50th percentile: 3.43135666847229
60th percentile: 3.518335485458374
70th percentile: 3.605314302444458
80th percentile: 3.667661952972412
90th percentile: 3.7053784370422362
95th percentile: 3.7242366790771486
99th percentile: 3.7393232727050782
mean time: 3.3338189125061035
Pipeline stage StressChecker completed in 18.56s
Shutdown handler de-registered
function_mojen_2024-10-01 status is now deployed due to DeploymentManager action
function_mojen_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_mojen_2024-10-01 status is now deployed due to admin request
function_mojen_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_mojen_2024-10-01 status is now torndown due to DeploymentManager action