developer_uid: chai_backend_admin
submission_id: function_gakak_2024-09-19
model_name: reward_blend_default_full_bon
model_group:
status: torndown
timestamp: 2024-09-19T22:13:50+00:00
num_battles: 11108
num_wins: 5669
celo_rating: 1255.55
family_friendly_score: 0.0
submission_type: function
display_name: reward_blend_default_full_bon
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-19
win_ratio: 0.5103528988116672
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.742175817489624s
Received healthy response to inference request in 2.853170871734619s
Received healthy response to inference request in 3.7494258880615234s
Received healthy response to inference request in 3.4053640365600586s
Received healthy response to inference request in 5.2879250049591064s
5 requests
0 failed requests
5th percentile: 2.963609504699707
10th percentile: 3.074048137664795
20th percentile: 3.294925403594971
30th percentile: 3.4741764068603516
40th percentile: 3.6118011474609375
50th percentile: 3.7494258880615234
60th percentile: 4.146525859832764
70th percentile: 4.543625831604004
80th percentile: 4.851325654983521
90th percentile: 5.069625329971314
95th percentile: 5.17877516746521
99th percentile: 5.266095037460327
mean time: 4.007612323760986
Pipeline stage StressChecker completed in 20.64s
Shutdown handler de-registered
function_gakak_2024-09-19 status is now deployed due to DeploymentManager action
function_gakak_2024-09-19 status is now inactive due to auto deactivation removed underperforming models
function_gakak_2024-09-19 status is now torndown due to DeploymentManager action