submission_id: function_kobuf_2024-10-21
developer_uid: chai_backend_admin
celo_rating: 1250.12
display_name: retune_with_base
family_friendly_score: 0.6142733937041829
family_friendly_standard_error: 0.005500068301035939
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 8270
num_wins: 4680
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-21T18:12:29+00:00
us_pacific_date: 2024-10-21
win_ratio: 0.56590084643289
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8978288173675537s
Received healthy response to inference request in 3.826836585998535s
Received healthy response to inference request in 1.7866296768188477s
Received healthy response to inference request in 2.1944594383239746s
Received healthy response to inference request in 1.206338882446289s
5 requests
0 failed requests
5th percentile: 1.3223970413208008
10th percentile: 1.4384552001953126
20th percentile: 1.670571517944336
30th percentile: 1.8681956291198731
40th percentile: 2.0313275337219237
50th percentile: 2.1944594383239746
60th percentile: 2.8474102973937985
70th percentile: 3.500361156463623
80th percentile: 3.841035032272339
90th percentile: 3.8694319248199465
95th percentile: 3.88363037109375
99th percentile: 3.894989128112793
mean time: 2.58241868019104
Pipeline stage StressChecker completed in 14.37s
Shutdown handler de-registered
function_kobuf_2024-10-21 status is now deployed due to DeploymentManager action
function_kobuf_2024-10-21 status is now inactive due to auto deactivation removed underperforming models
function_kobuf_2024-10-21 status is now torndown due to DeploymentManager action