submission_id: function_femik_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1218.66
display_name: retune_with_base
family_friendly_score: 0.6239101274312542
family_friendly_standard_error: 0.008854636594259911
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3036
num_wins: 1418
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:53:56+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.4670619235836627
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1723780632019043s
Received healthy response to inference request in 2.782989740371704s
Received healthy response to inference request in 2.3171417713165283s
Received healthy response to inference request in 4.71751594543457s
Received healthy response to inference request in 3.2627036571502686s
5 requests
0 failed requests
5th percentile: 2.4103113651275634
10th percentile: 2.5034809589385985
20th percentile: 2.689820146560669
30th percentile: 2.860867404937744
40th percentile: 3.0166227340698244
50th percentile: 3.1723780632019043
60th percentile: 3.20850830078125
70th percentile: 3.244638538360596
80th percentile: 3.5536661148071294
90th percentile: 4.13559103012085
95th percentile: 4.42655348777771
99th percentile: 4.659323453903198
mean time: 3.250545835494995
Pipeline stage StressChecker completed in 18.04s
Shutdown handler de-registered
function_femik_2024-09-26 status is now deployed due to DeploymentManager action
function_femik_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_sulib_2024-09-26
Cleaning model data from S3
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 58.94s
Service chaiml-0926-nemo-virgo-t-5421-v1 has been torndown
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_sulib_2024-09-26
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 31.71s
Cleaning model data from S3
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_sulib_2024-09-26
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage ProductionBlendMKMLTemplater
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
run pipeline stage %s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of blend_rofur_2024-10-03
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLDeleter completed in 42.17s
run pipeline stage %s
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_femik_2024-09-26
Shutdown handler not registered because Python interpreter is not running in the main thread
Tearing down inference service blend-rofur-2024-10-03
admin requested tearing down of blend_fenik_2024-09-27
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
admin requested tearing down of blend_fuhof_2024-09-27
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLDeleter completed in 94.59s
Pipeline stage %s skipped, reason=%s
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 104.24s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 98.75s
Shutdown handler de-registered
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of function_sulib_2024-09-26
Pipeline stage %s skipped, reason=%s
Waiting for inference service blend-rofur-2024-10-03 to be ready
Shutdown handler de-registered
Creating inference service blend-rofur-2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
Running pipeline stage ProductionBlendMKMLTemplater
Pipeline stage MKMLModelDeleter completed in 111.38s
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tudub_2024-09-26
Pipeline stage MKMLModelDeleter completed in 96.03s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_sulib_2024-09-26
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 32.98s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLModelDeleter
admin requested tearing down of function_sulib_2024-09-26
run pipeline stage %s
Pipeline stage MKMLModelDeleter completed in 4.95s
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
admin requested tearing down of function_sulib_2024-09-26
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_sulib_2024-09-26
Pipeline stage %s skipped, reason=%s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
chaiml-0926-nemo-virgo-t_3956_v6 status is now torndown due to DeploymentManager action
run pipeline %s