submission_id: function_hadum_2024-09-25
developer_uid: chai_backend_admin
celo_rating: 1248.96
display_name: retune_with_base
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3465
num_wins: 1706
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-25T23:03:47+00:00
us_pacific_date: 2024-09-25
win_ratio: 0.4923520923520924
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.862793445587158s
Received healthy response to inference request in 3.4142496585845947s
Received healthy response to inference request in 5.416283130645752s
Received healthy response to inference request in 3.6182186603546143s
Received healthy response to inference request in 3.415637731552124s
5 requests
0 failed requests
5th percentile: 2.9730846881866455
10th percentile: 3.083375930786133
20th percentile: 3.3039584159851074
30th percentile: 3.4145272731781007
40th percentile: 3.415082502365112
50th percentile: 3.415637731552124
60th percentile: 3.49667010307312
70th percentile: 3.5777024745941164
80th percentile: 3.977831554412842
90th percentile: 4.697057342529297
95th percentile: 5.056670236587524
99th percentile: 5.344360551834106
mean time: 3.7454365253448487
Pipeline stage StressChecker completed in 20.73s
Shutdown handler de-registered
function_hadum_2024-09-25 status is now deployed due to DeploymentManager action
function_hadum_2024-09-25 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
function_hadum_2024-09-25 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rofur_2024-10-03