developer_uid: chai_backend_admin
submission_id: function_kobuf_2024-10-21
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-21T18:12:29+00:00
num_battles: 8270
num_wins: 4680
celo_rating: 1250.12
family_friendly_score: 0.6142733937041829
family_friendly_standard_error: 0.005500068301035939
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-21
win_ratio: 0.56590084643289
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8978288173675537s
Received healthy response to inference request in 3.826836585998535s
Received healthy response to inference request in 1.7866296768188477s
Received healthy response to inference request in 2.1944594383239746s
Received healthy response to inference request in 1.206338882446289s
5 requests
0 failed requests
5th percentile: 1.3223970413208008
10th percentile: 1.4384552001953126
20th percentile: 1.670571517944336
30th percentile: 1.8681956291198731
40th percentile: 2.0313275337219237
50th percentile: 2.1944594383239746
60th percentile: 2.8474102973937985
70th percentile: 3.500361156463623
80th percentile: 3.841035032272339
90th percentile: 3.8694319248199465
95th percentile: 3.88363037109375
99th percentile: 3.894989128112793
mean time: 2.58241868019104
Pipeline stage StressChecker completed in 14.37s
Shutdown handler de-registered
function_kobuf_2024-10-21 status is now deployed due to DeploymentManager action
function_kobuf_2024-10-21 status is now inactive due to auto deactivation removed underperforming models
function_kobuf_2024-10-21 status is now torndown due to DeploymentManager action