submission_id: function_supen_2024-09-19
developer_uid: chai_backend_admin
celo_rating: 1256.15
display_name: reward_blend_default_full_bon
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: reward_blend_default_full_bon
num_battles: 12588
num_wins: 6350
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-19T19:32:03+00:00
us_pacific_date: 2024-09-19
win_ratio: 0.5044486812837623
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.685763359069824s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.378129005432129s
Received healthy response to inference request in 6.237608432769775s
Received healthy response to inference request in 4.908308982849121s
Received healthy response to inference request in 4.976133823394775s
5 requests
0 failed requests
5th percentile: 3.639655876159668
10th percentile: 3.901182746887207
20th percentile: 4.424236488342285
30th percentile: 4.730272483825684
40th percentile: 4.819290733337402
50th percentile: 4.908308982849121
60th percentile: 4.935438919067383
70th percentile: 4.962568855285644
80th percentile: 5.228428745269776
90th percentile: 5.733018589019776
95th percentile: 5.985313510894775
99th percentile: 6.187149448394775
mean time: 4.837188720703125
Pipeline stage StressChecker completed in 24.97s
Shutdown handler de-registered
function_supen_2024-09-19 status is now deployed due to DeploymentManager action
function_supen_2024-09-19 status is now inactive due to auto deactivation removed underperforming models
function_supen_2024-09-19 status is now torndown due to DeploymentManager action