developer_uid: chai_backend_admin
submission_id: blend_fenik_2024-09-27
model_name: blend
model_group:
status: torndown
timestamp: 2024-09-27T00:34:06+00:00
num_battles: 3088
num_wins: 1557
celo_rating: 1255.01
family_friendly_score: 0.5611996458610005
family_friendly_standard_error: 0.009020784991994135
submission_type: blend
submissions: ['chaiml-elo-alignment-run-3_v34', 'zonemercy-lexical-nemo-_1518_v18', 'zonemercy-lexical-nemov8_5966_v2', 'zonemercy-virgo-edit-v1-1e5_v3', 'sao10k-mn-12b-lyra-v4a1_v3']
display_name: blend
is_internal_developer: True
language_model: chaiml-elo-alignment-run-3_v34,zonemercy-lexical-nemo-_1518_v18,zonemercy-lexical-nemov8_5966_v2,zonemercy-virgo-edit-v1-1e5_v3,sao10k-mn-12b-lyra-v4a1_v3
model_size: n/a
ranking_group: blended
reward_model: random
us_pacific_date: 2024-09-26
win_ratio: 0.5042098445595855
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_fenik_2024-09-27 status is now deployed due to DeploymentManager action
blend_fenik_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
admin requested tearing down of blend_rofur_2024-10-03
Shutdown handler de-registered
Cleaning model data from model cache
admin requested tearing down of blend_rofur_2024-10-03
Running pipeline stage MKMLDeleter
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v114
Deleting key chaiml-0926-nemo-virgo-t-1582-v1/tokenizer.json from bucket guanaco-mkml-models
Deleting key chaiml-0916-intent-suppo-6584-v5/tokenizer_config.json from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v6/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v7/flywheel_model.0.safetensors from bucket guanaco-mkml-models
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fenik_2024-09-27
Deleting key chaiml-0926-nemo-virgo-t-5421-v1/config.json from bucket guanaco-mkml-models
Shutdown handler not registered because Python interpreter is not running in the main thread
Checking if service meta-llama-llama-3-1-8b-7331-v1 is running
Shutdown handler not registered because Python interpreter is not running in the main thread
Checking if service meta-llama-llama-3-1-8b-7331-v1 is running
Running pipeline stage MKMLDeleter
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v115
Deleting key chaiml-0926-nemo-virgo-t-3956-v6/tokenizer.json from bucket guanaco-mkml-models
Pipeline stage MKMLModelDeleter completed in 179.55s
Deleting key chaiml-0926-nemo-virgo-t-3956-v7/special_tokens_map.json from bucket guanaco-mkml-models
run pipeline %s
Deleting key chaiml-0926-nemo-virgo-t-5421-v1/flywheel_model.0.safetensors from bucket guanaco-mkml-models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
Pipeline stage %s skipped, reason=%s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of blend_gelom_2024-09-27
Running pipeline stage MKMLDeleter
Running pipeline stage ProductionBlendMKMLTemplater
Checking if service mistralai-mistral-nemo-9330-v111 is running
run pipeline stage %s
Tearing down inference service mistralai-mistral-nemo-9330-v110
Service meta-llama-llama-3-1-8b-7331-v1 has been torndown
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v117
Shutdown handler de-registered
chaiml-0926-nemo-virgo-t_5421_v1 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Running pipeline stage ProductionBlendMKMLTemplater
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
run pipeline stage %s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
admin requested tearing down of function_tudub_2024-09-26
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 101.55s
Pipeline stage %s skipped, reason=%s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
run pipeline %s
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Running pipeline stage ProductionBlendMKMLTemplater
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
Creating inference service blend-rofur-2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
Running pipeline stage ProductionBlendMKMLTemplater
Pipeline stage MKMLModelDeleter completed in 111.38s
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tudub_2024-09-26
Pipeline stage MKMLModelDeleter completed in 96.03s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Ignoring service blend-rofur-2024-10-03 already deployed
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
Pipeline stage %s skipped, reason=%s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
admin requested tearing down of blend_gelom_2024-09-27
Running pipeline stage MKMLDeleter
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v116
run pipeline stage %s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage MKMLDeleter
run pipeline %s
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fenik_2024-09-27
run pipeline %s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
run pipeline %s
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
admin requested tearing down of blend_fulat_2024-09-27
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Skipping teardown as no inference service was successfully deployed
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread