submission_id: function_borir_2024-09-19
developer_uid: chai_backend_admin
celo_rating: 1252.49
display_name: reward_blend_default_full_bon
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: reward_blend_default_full_bon
num_battles: 13515
num_wins: 6729
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-19T19:34:53+00:00
us_pacific_date: 2024-09-19
win_ratio: 0.4978912319644839
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5614771842956543s
Received healthy response to inference request in 3.9479146003723145s
Received healthy response to inference request in 3.8021016120910645s
Received healthy response to inference request in 2.3569865226745605s
Received healthy response to inference request in 4.7130491733551025s
5 requests
0 failed requests
5th percentile: 2.5978846549987793
10th percentile: 2.838782787322998
20th percentile: 3.3205790519714355
30th percentile: 3.6096020698547364
40th percentile: 3.7058518409729
50th percentile: 3.8021016120910645
60th percentile: 3.8604268074035644
70th percentile: 3.9187520027160643
80th percentile: 4.100941514968873
90th percentile: 4.406995344161987
95th percentile: 4.560022258758544
99th percentile: 4.682443790435791
mean time: 3.676305818557739
Pipeline stage StressChecker completed in 19.38s
Shutdown handler de-registered
function_borir_2024-09-19 status is now deployed due to DeploymentManager action
function_borir_2024-09-19 status is now inactive due to auto deactivation removed underperforming models
function_borir_2024-09-19 status is now torndown due to DeploymentManager action