function_tadaf_2024-09-27

developer_uid: chai_backend_admin
submission_id: function_tadaf_2024-09-27
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-09-27T05:17:00+00:00
num_battles: 6558
num_wins: 3376
celo_rating: 1267.41
family_friendly_score: 0.5308906882591093
family_friendly_standard_error: 0.006320517065879819
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-26
win_ratio: 0.5147910948459896
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.090327978134155s
Received healthy response to inference request in 3.6591968536376953s
Received healthy response to inference request in 2.994980573654175s
Received healthy response to inference request in 2.6694915294647217s
Received healthy response to inference request in 4.29902982711792s
5 requests
0 failed requests
5th percentile: 2.7345893383026123
10th percentile: 2.799687147140503
20th percentile: 2.929882764816284
30th percentile: 3.127823829650879
40th percentile: 3.393510341644287
50th percentile: 3.6591968536376953
60th percentile: 3.915130043029785
70th percentile: 4.171063232421875
80th percentile: 4.657289457321167
90th percentile: 5.373808717727662
95th percentile: 5.732068347930908
99th percentile: 6.018676052093506
mean time: 3.9426053524017335
Pipeline stage StressChecker completed in 21.85s
Shutdown handler de-registered
function_tadaf_2024-09-27 status is now deployed due to DeploymentManager action
function_tadaf_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
function_hefal_2024-09-27 status is now torndown due to DeploymentManager action
Cleaning model data from S3
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tadaf_2024-09-27
Cleaning model data from model cache
Cleaning model data from model cache
Shutdown handler de-registered
function_nunat_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v111
Tearing down inference service cycy233-nemo-p-e-v4-c4-v1
function_rokam_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
Tearing down inference service cycy233-nemo-p-e-v4-c3-v1
Service cycy233-nemo-p-e-v4-c1-v1 has been torndown
admin requested tearing down of mistralai-mistral-nemo_9330_v112
run pipeline %s
run pipeline %s
function_seden_2024-09-27 status is now torndown due to DeploymentManager action
Service cycy233-nemo-p-e-v4-c3-v1 has been torndown
Pipeline stage MKMLDeleter completed in 7.20s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 5.11s
admin requested tearing down of mistralai-mistral-nemo_9330_v114
run pipeline stage %s
Shutdown handler de-registered
run pipeline stage %s
run pipeline stage %s
run pipeline stage %s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 7.44s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLDeleter
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
admin requested tearing down of mistralai-mistral-nemo_9330_v114
run pipeline stage %s
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
cycy233-nemo-p-e-v4-c4_v1 status is now torndown due to DeploymentManager action
function_hefal_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
admin requested tearing down of function_tadaf_2024-09-27
function_takat_2024-10-05 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 3.52s
function_takat_2024-10-05 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 3.52s
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
run pipeline %s
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 2.78s
cycy233-nemo-p-e-v4-c2_v1 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler de-registered
function_rokam_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
function_seden_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 3.51s
cycy233-nemo-p-e-v4-c3_v1 status is now torndown due to DeploymentManager action
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v112
function_seden_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline stage %s
cycy233-nemo-p-e-v4-c3_v1 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v115
Shutdown handler not registered because Python interpreter is not running in the main thread
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
admin requested tearing down of mistralai-mistral-nemo_9330_v114
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v114
cycy233-nemo-p-e-v4-c3_v1 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler de-registered
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v112
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
rica40325-dpo-1008-5162s_v1 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler de-registered
cycy233-nemo-p-e-v4-c3_v1 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
function_seden_2024-09-27 status is now torndown due to DeploymentManager action
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
cycy233-nemo-p-e-v4-c3_v1 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
run pipeline %s
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
function_nunat_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
Pipeline stage MKMLModelDeleter completed in 3.75s
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
run pipeline %s
Running pipeline stage MKMLModelDeleter
admin requested tearing down of mistralai-mistral-nemo_9330_v111
Shutdown handler de-registered
function_rokam_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 3.58s
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
cycy233-nemo-p-e-v4-c2_v1 status is now torndown due to DeploymentManager action
admin requested tearing down of mistralai-mistral-nemo_9330_v112
Shutdown handler de-registered
function_seden_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLModelDeleter completed in 4.26s
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v114
Pipeline stage MKMLModelDeleter completed in 4.26s
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v114
cycy233-nemo-p-e-v4-c3_v1 status is now torndown due to DeploymentManager action
run pipeline %s
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 7.78s
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v2-7-nemo_v5
Skipping deletion as no model was successfully uploaded
function_hefal_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 9.27s
Running pipeline stage MKMLModelDeleter
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
admin requested tearing down of function_tadaf_2024-09-27
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 10.07s
Running pipeline stage MKMLDeleter
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLDeleter
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLModelDeleter
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
cycy233-nemo-p-e-v4-c4_v1 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v115
Running pipeline stage MKMLModelDeleter
Pipeline stage MKMLModelDeleter completed in 6.36s
function_tadaf_2024-09-27 status is now torndown due to DeploymentManager action
cycy233-nemo-p-e-v4-c2_v1 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
run pipeline %s