developer_uid: chai_backend_admin
submission_id: function_gedus_2024-09-26
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-09-26T01:17:44+00:00
num_battles: 2939
num_wins: 1438
celo_rating: 1248.32
family_friendly_score: 0.5535589672016747
family_friendly_standard_error: 0.009256365666908644
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-25
win_ratio: 0.48928206873086083
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.157789468765259s
Received healthy response to inference request in 3.0868844985961914s
Received healthy response to inference request in 2.1589951515197754s
Received healthy response to inference request in 2.586059331893921s
Received healthy response to inference request in 2.3683576583862305s
5 requests
0 failed requests
5th percentile: 2.2008676528930664
10th percentile: 2.2427401542663574
20th percentile: 2.3264851570129395
30th percentile: 2.4118979930877686
40th percentile: 2.4989786624908445
50th percentile: 2.586059331893921
60th percentile: 2.786389398574829
70th percentile: 2.9867194652557374
80th percentile: 3.101065492630005
90th percentile: 3.1294274806976317
95th percentile: 3.1436084747314452
99th percentile: 3.154953269958496
mean time: 2.6716172218322756
Pipeline stage StressChecker completed in 15.32s
Shutdown handler de-registered
function_gedus_2024-09-26 status is now deployed due to DeploymentManager action
function_gedus_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
function_gedus_2024-09-26 status is now torndown due to DeploymentManager action