submission_id: function_gedus_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1248.32
display_name: retune_with_base
family_friendly_score: 0.5535589672016747
family_friendly_standard_error: 0.009256365666908644
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2939
num_wins: 1438
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T01:17:44+00:00
us_pacific_date: 2024-09-25
win_ratio: 0.48928206873086083
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.157789468765259s
Received healthy response to inference request in 3.0868844985961914s
Received healthy response to inference request in 2.1589951515197754s
Received healthy response to inference request in 2.586059331893921s
Received healthy response to inference request in 2.3683576583862305s
5 requests
0 failed requests
5th percentile: 2.2008676528930664
10th percentile: 2.2427401542663574
20th percentile: 2.3264851570129395
30th percentile: 2.4118979930877686
40th percentile: 2.4989786624908445
50th percentile: 2.586059331893921
60th percentile: 2.786389398574829
70th percentile: 2.9867194652557374
80th percentile: 3.101065492630005
90th percentile: 3.1294274806976317
95th percentile: 3.1436084747314452
99th percentile: 3.154953269958496
mean time: 2.6716172218322756
Pipeline stage StressChecker completed in 15.32s
Shutdown handler de-registered
function_gedus_2024-09-26 status is now deployed due to DeploymentManager action
function_gedus_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
function_gedus_2024-09-26 status is now torndown due to DeploymentManager action