function_hanan_2024-09-27

developer_uid: chai_backend_admin
submission_id: function_hanan_2024-09-27
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-09-27T04:20:28+00:00
num_battles: 6761
num_wins: 3440
celo_rating: 1265.69
family_friendly_score: 0.537619500343316
family_friendly_standard_error: 0.006241928535307691
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-26
win_ratio: 0.5088004733027659
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.489241600036621s
Received healthy response to inference request in 2.6479392051696777s
Received healthy response to inference request in 2.8096213340759277s
Received healthy response to inference request in 2.100771188735962s
Received healthy response to inference request in 1.9848711490631104s
5 requests
0 failed requests
5th percentile: 2.0080511569976807
10th percentile: 2.031231164932251
20th percentile: 2.0775911808013916
30th percentile: 2.2102047920227053
40th percentile: 2.4290719985961915
50th percentile: 2.6479392051696777
60th percentile: 2.7126120567321776
70th percentile: 2.7772849082946776
80th percentile: 2.9455453872680666
90th percentile: 3.217393493652344
95th percentile: 3.3533175468444822
99th percentile: 3.4620567893981935
mean time: 2.60648889541626
Pipeline stage StressChecker completed in 15.06s
Shutdown handler de-registered
function_hanan_2024-09-27 status is now deployed due to DeploymentManager action
function_hanan_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Checking if service cycy233-nemo-p-e-v4-c1-v1 is running
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Checking if service cycy233-nemo-p-e-v4-c4-v1 is running
Checking if service cycy233-nemo-p-e-v4-c3-v1 is running
Shutdown handler de-registered
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
Shutdown handler de-registered
admin requested tearing down of function_rokam_2024-09-27
cycy233-nemo-p-e-v4-c1_v1 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_seden_2024-09-27
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
admin requested tearing down of function_rokam_2024-09-27
Shutdown handler de-registered
function_pokin_2024-10-05 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
run pipeline %s
Pipeline stage MKMLModelDeleter completed in 3.51s
run pipeline stage %s
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_hanan_2024-09-27
Running pipeline stage MKMLDeleter
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_hefal_2024-09-27
Pipeline stage %s skipped, reason=%s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_nunat_2024-09-27
Pipeline stage MKMLDeleter completed in 1.53s
Pipeline stage MKMLModelDeleter completed in 1.52s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
admin requested tearing down of function_rokam_2024-09-27
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Running pipeline stage MKMLModelDeleter
Running pipeline stage MKMLModelDeleter
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLDeleter
admin requested tearing down of function_hanan_2024-09-27
run pipeline stage %s
run pipeline %s
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 1.02s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_hefal_2024-09-27
Running pipeline stage MKMLDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 1.35s
Shutdown handler de-registered
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLDeleter
run pipeline stage %s
admin requested tearing down of function_nunat_2024-09-27
cycy233-nemo-p-e-v4-c1_v1 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLDeleter completed in 1.48s
run pipeline %s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline %s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Pipeline stage MKMLDeleter completed in 2.91s
Pipeline stage %s skipped, reason=%s
blend_jerel_2024-10-07 status is now torndown due to DeploymentManager action
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
run pipeline %s
Pipeline stage MKMLModelDeleter completed in 1.71s
run pipeline %s
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
admin requested tearing down of function_hanan_2024-09-27
Pipeline stage MKMLDeleter completed in 1.55s
run pipeline stage %s
run pipeline %s
Running pipeline stage MKMLDeleter
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_hefal_2024-09-27
run pipeline stage %s
Running pipeline stage MKMLDeleter
run pipeline stage %s
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLDeleter completed in 1.71s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_nunat_2024-09-27
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Pipeline stage MKMLDeleter completed in 2.46s
run pipeline stage %s
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Pipeline stage MKMLDeleter completed in 3.01s
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Shutdown handler de-registered
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Pipeline stage MKMLModelDeleter completed in 2.15s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler de-registered
run pipeline %s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 2.93s
Running pipeline stage MKMLModelDeleter
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
cycy233-nemo-p-e-v4-c1_v1 status is now torndown due to DeploymentManager action
run pipeline stage %s
run pipeline %s
Pipeline stage MKMLDeleter completed in 0.92s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_hanan_2024-09-27
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_hefal_2024-09-27
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_nunat_2024-09-27
Pipeline stage MKMLDeleter completed in 2.33s
Pipeline stage %s skipped, reason=%s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
admin requested tearing down of function_rokam_2024-09-27
Pipeline stage MKMLDeleter completed in 3.36s
Pipeline stage MKMLModelDeleter completed in 3.34s
Pipeline stage %s skipped, reason=%s
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 5.96s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Pipeline stage %s skipped, reason=%s
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 6.05s
admin requested tearing down of jic062-dpo-v2-7-nemo_v4
Running pipeline stage MKMLModelDeleter
Shutdown handler de-registered
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 7.81s
admin requested tearing down of function_rokam_2024-09-27
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 8.80s
Running pipeline stage MKMLDeleter
Pipeline stage MKMLDeleter completed in 8.50s
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v2-7-nemo_v4
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
admin requested tearing down of function_nunat_2024-09-27
Running pipeline stage MKMLModelDeleter
Pipeline stage MKMLDeleter completed in 9.58s
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLDeleter completed in 9.85s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Running pipeline stage MKMLModelDeleter
run pipeline %s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
Cleaning model data from S3
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_nunat_2024-09-27
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of jic062-dpo-v2-7-nemo_v6
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
run pipeline %s
Running pipeline stage MKMLModelDeleter
Pipeline stage MKMLDeleter completed in 4.58s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rokam_2024-09-27
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
function_hanan_2024-09-27 status is now torndown due to DeploymentManager action