submission_id: function_sudof_2024-09-19
developer_uid: chai_backend_admin
celo_rating: 1273.15
display_name: reward_blend_default_full_bon
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: reward_blend_default_full_bon
num_battles: 13221
num_wins: 7015
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-19T19:31:15+00:00
us_pacific_date: 2024-09-19
win_ratio: 0.5305952651085395
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.14515495300293s
Received healthy response to inference request in 4.252878904342651s
Received healthy response to inference request in 4.101197242736816s
Received healthy response to inference request in 3.821016550064087s
Received healthy response to inference request in 6.407850503921509s
5 requests
0 failed requests
5th percentile: 3.8770526885986327
10th percentile: 3.9330888271331785
20th percentile: 4.04516110420227
30th percentile: 4.109988784790039
40th percentile: 4.127571868896484
50th percentile: 4.14515495300293
60th percentile: 4.1882445335388185
70th percentile: 4.231334114074707
80th percentile: 4.683873224258424
90th percentile: 5.545861864089966
95th percentile: 5.976856184005737
99th percentile: 6.321651639938354
mean time: 4.545619630813599
Pipeline stage StressChecker completed in 24.65s
Shutdown handler de-registered
function_sudof_2024-09-19 status is now deployed due to DeploymentManager action
function_sudof_2024-09-19 status is now inactive due to auto deactivation removed underperforming models
function_sudof_2024-09-19 status is now torndown due to DeploymentManager action