developer_uid: chai_backend_admin
submission_id: blend_fulat_2024-09-27
model_name: blend
model_group:
status: torndown
timestamp: 2024-09-27T00:40:19+00:00
num_battles: 3260
num_wins: 1647
celo_rating: 1253.87
family_friendly_score: 0.5437625224085205
family_friendly_standard_error: 0.008838311709863525
submission_type: blend
submissions: ['chaiml-elo-alignment-run-3_v34', 'zonemercy-lexical-nemo-_1518_v18', 'zonemercy-lexical-nemov8_5966_v2', 'zonemercy-virgo-edit-v1-1e5_v3', 'marinaraspaghetti-nemomi_1739_v5']
display_name: blend
is_internal_developer: True
language_model: chaiml-elo-alignment-run-3_v34,zonemercy-lexical-nemo-_1518_v18,zonemercy-lexical-nemov8_5966_v2,zonemercy-virgo-edit-v1-1e5_v3,marinaraspaghetti-nemomi_1739_v5
model_size: n/a
ranking_group: blended
reward_model: random
us_pacific_date: 2024-09-26
win_ratio: 0.5052147239263803
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_fulat_2024-09-27 status is now deployed due to DeploymentManager action
blend_fulat_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
run pipeline stage %s
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
Tearing down inference service mistralai-mistral-nemo-9330-v112
Service mistralai-mistral-nemo-9330-v111 has been torndown
Checking if service mistralai-mistral-nemo-9330-v114 is running
Pipeline stage MKMLDeleter completed in 131.35s
run pipeline stage %s
Running pipeline stage MKMLDeleter
run pipeline stage %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
run pipeline %s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v121
run pipeline stage %s
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_kufab_2024-09-27
Service mistralai-mistral-nemo-9330-v112 has been torndown
Pipeline stage MKMLDeleter completed in 129.81s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Tearing down inference service mistralai-mistral-nemo-9330-v114
Checking if service mistralai-mistral-nemo-9330-v115 is running
Running pipeline stage MKMLDeleter
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_dones_2024-09-27
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
Pipeline stage ProductionBlendMKMLTemplater completed in 34.12s
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
function_keneb_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-0926-nemo-virgo-t_3956_v6 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
run pipeline stage %s
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
run pipeline stage %s
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage MKMLDeleter completed in 54.85s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v119
Cleaning model data from S3
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 60.17s
Shutdown handler de-registered
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
Skipping teardown as no inference service was successfully deployed
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLDeleter
run pipeline %s
run pipeline %s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
Shutdown handler de-registered
Pipeline stage MKMLDeleter completed in 1.07s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
Shutdown handler de-registered
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
admin requested tearing down of blend_kufab_2024-09-27
Skipping deletion as no model was successfully uploaded
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
admin requested tearing down of blend_gelom_2024-09-27
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
run pipeline %s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s