submission_id: function_harol_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1244.41
display_name: retune_with_base
family_friendly_score: 0.5728414442700157
family_friendly_standard_error: 0.0087481820766469
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3311
num_wins: 1622
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T16:51:56+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.4898822108124434
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.7634410858154297s
Received healthy response to inference request in 1.9819011688232422s
Received healthy response to inference request in 2.0608763694763184s
Received healthy response to inference request in 2.47920298576355s
Received healthy response to inference request in 1.8385365009307861s
5 requests
0 failed requests
5th percentile: 1.7784601688385009
10th percentile: 1.7934792518615723
20th percentile: 1.823517417907715
30th percentile: 1.8672094345092773
40th percentile: 1.9245553016662598
50th percentile: 1.9819011688232422
60th percentile: 2.0134912490844727
70th percentile: 2.0450813293457033
80th percentile: 2.144541692733765
90th percentile: 2.3118723392486573
95th percentile: 2.3955376625061033
99th percentile: 2.4624699211120604
mean time: 2.024791622161865
Pipeline stage StressChecker completed in 11.92s
Shutdown handler de-registered
function_harol_2024-09-26 status is now deployed due to DeploymentManager action
function_harol_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_pinen_2024-09-26
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
Creating inference service blend-rofur-2024-10-03
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 36.24s
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_pinen_2024-09-26
Shutdown handler de-registered
Skipping deletion as no model was successfully uploaded
Ignoring service blend-rofur-2024-10-03 already deployed
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 42.13s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 42.00s
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
Creating inference service blend-rofur-2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_pinen_2024-09-26
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 30.10s
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_pinen_2024-09-26
chaiml-0916-intent-suppo_6584_v3 status is now torndown due to DeploymentManager action
Creating inference service blend-rofur-2024-10-03
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 35.04s
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_pinen_2024-09-26
Running pipeline stage MKMLDeployer
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 51.36s
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLModelDeleter completed in 54.19s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 52.70s
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_pinen_2024-09-26
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
Creating inference service blend-rofur-2024-10-03
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 50.51s
Shutdown handler de-registered
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_pinen_2024-09-26
Pipeline stage MKMLModelDeleter completed in 33.81s
Waiting for inference service blend-rofur-2024-10-03 to be ready
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 34.46s
function_harol_2024-09-26 status is now torndown due to DeploymentManager action