submission_id: function_jisob_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1226.01
display_name: retune_with_base
family_friendly_score: 0.628445049336509
family_friendly_standard_error: 0.008898704593527358
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2995
num_wins: 1431
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:49:00+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.47779632721202003
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.6174066066741943s
Received healthy response to inference request in 2.872586965560913s
Received healthy response to inference request in 3.4965264797210693s
Received healthy response to inference request in 3.692021369934082s
Received healthy response to inference request in 3.026639461517334s
5 requests
0 failed requests
5th percentile: 2.903397464752197
10th percentile: 2.9342079639434813
20th percentile: 2.99582896232605
30th percentile: 3.1206168651580812
40th percentile: 3.3085716724395753
50th percentile: 3.4965264797210693
60th percentile: 3.544878530502319
70th percentile: 3.5932305812835694
80th percentile: 3.632329559326172
90th percentile: 3.6621754646301268
95th percentile: 3.6770984172821044
99th percentile: 3.6890367794036867
mean time: 3.3410361766815186
Pipeline stage StressChecker completed in 18.47s
Shutdown handler de-registered
function_jisob_2024-09-26 status is now deployed due to DeploymentManager action
function_jisob_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tudub_2024-09-26
Cleaning model data from model cache
Cleaning model data from S3
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 63.34s
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tudub_2024-09-26
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Cleaning model data from model cache
Cleaning model data from S3
Running pipeline stage MKMLModelDeleter
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
admin requested tearing down of function_tudub_2024-09-26
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 101.55s
Pipeline stage %s skipped, reason=%s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
run pipeline %s
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_rofur_2024-10-03
chaiml-0926-nemo-virgo-t_1582_v1 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 122.71s
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of blend_rofur_2024-10-03
Pipeline stage ProductionBlendMKMLTemplater completed in 171.76s
admin requested tearing down of function_tudub_2024-09-26
Pipeline stage MKMLModelDeleter completed in 96.03s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of blend_rofur_2024-10-03
Pipeline stage %s skipped, reason=%s
admin requested tearing down of blend_dones_2024-09-27
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rofur_2024-10-03
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
admin requested tearing down of blend_rofur_2024-10-03
Shutdown handler de-registered
Waiting for inference service blend-rofur-2024-10-03 to be ready
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Pipeline stage ProductionBlendMKMLTemplater completed in 226.35s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tudub_2024-09-26
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 36.49s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tudub_2024-09-26
Running pipeline stage MKMLModelDeleter
Shutdown handler de-registered
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-0926-nemo-virgo-t_1582_v1 status is now torndown due to DeploymentManager action
admin requested tearing down of function_tudub_2024-09-26
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 4.44s
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of meta-llama-llama-3-1-8b-_7331_v1
chaiml-0926-nemo-virgo-t_3956_v6 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLModelDeleter completed in 3.81s
admin requested tearing down of function_tudub_2024-09-26
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler de-registered