developer_uid: chai_backend_admin
submission_id: function_fetok_2024-10-18
model_name: sfw_first_10_msg
model_group:
status: torndown
timestamp: 2024-10-18T23:10:50+00:00
num_battles: 7826
num_wins: 3962
celo_rating: 1261.02
family_friendly_score: 0.5502234137622877
family_friendly_standard_error: 0.005738622039401072
submission_type: function
display_name: sfw_first_10_msg
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-18
win_ratio: 0.5062611806797853
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.067270278930664s
Received healthy response to inference request in 1.832939863204956s
Received healthy response to inference request in 3.5121257305145264s
Received healthy response to inference request in 1.5086839199066162s
Received healthy response to inference request in 2.5332088470458984s
5 requests
0 failed requests
5th percentile: 1.573535108566284
10th percentile: 1.6383862972259522
20th percentile: 1.7680886745452882
30th percentile: 1.8798059463500976
40th percentile: 1.9735381126403808
50th percentile: 2.067270278930664
60th percentile: 2.2536457061767576
70th percentile: 2.4400211334228517
80th percentile: 2.728992223739624
90th percentile: 3.120558977127075
95th percentile: 3.316342353820801
99th percentile: 3.4729690551757812
mean time: 2.2908457279205323
Pipeline stage StressChecker completed in 13.00s
Shutdown handler de-registered
function_fetok_2024-10-18 status is now deployed due to DeploymentManager action
function_fetok_2024-10-18 status is now inactive due to auto deactivation removed underperforming models
function_fetok_2024-10-18 status is now torndown due to DeploymentManager action