blend_fuhof_2024-09-27

submission_id: blend_fuhof_2024-09-27

developer_uid: chai_backend_admin

celo_rating: 1259.28

display_name: blend

family_friendly_score: 0.5709008710993494

family_friendly_standard_error: 0.00897933259028697

is_internal_developer: True

language_model: chaiml-elo-alignment-run-3_v34,zonemercy-lexical-nemo-_1518_v18,zonemercy-lexical-nemov8_5966_v2,zonemercy-virgo-edit-v1-1e5_v3,chaiml-0926-nemo-virgo-t_1582_v1

model_group:

model_name: blend

model_size: n/a

num_battles: 3114

num_wins: 1590

ranking_group: blended

reward_model: random

status: torndown

submission_type: blend

submissions: ['chaiml-elo-alignment-run-3_v34', 'zonemercy-lexical-nemo-_1518_v18', 'zonemercy-lexical-nemov8_5966_v2', 'zonemercy-virgo-edit-v1-1e5_v3', 'chaiml-0926-nemo-virgo-t_1582_v1']

timestamp: 2024-09-27T00:40:51+00:00

us_pacific_date: 2024-09-26

win_ratio: 0.5105973025048169

Download Preference Data

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_fuhof_2024-09-27 status is now deployed due to DeploymentManager action
blend_fuhof_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Checking if service meta-llama-llama-3-1-8b-7331-v1 is running
Running pipeline stage MKMLDeleter
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v115
Deleting key chaiml-0926-nemo-virgo-t-1582-v1/tokenizer_config.json from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v6/tokenizer.json from bucket guanaco-mkml-models
Pipeline stage MKMLModelDeleter completed in 179.55s
Deleting key chaiml-0926-nemo-virgo-t-3956-v7/special_tokens_map.json from bucket guanaco-mkml-models
run pipeline %s
Deleting key chaiml-0926-nemo-virgo-t-5421-v1/flywheel_model.0.safetensors from bucket guanaco-mkml-models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
Pipeline stage ProductionBlendMKMLTemplater completed in 16.09s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_gujen_2024-09-27
run pipeline %s
Pipeline stage %s skipped, reason=%s
Tearing down inference service mistralai-mistral-nemo-9330-v111
Running pipeline stage MKMLDeleter
Service mistralai-mistral-nemo-9330-v110 has been torndown
Pipeline stage MKMLDeleter completed in 126.72s
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v119
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_rofur_2024-10-03
Pipeline stage %s skipped, reason=%s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_rofur_2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
Pipeline stage ProductionBlendMKMLTemplater completed in 23.75s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler de-registered
admin requested tearing down of blend_dones_2024-09-27
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
function_keneb_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
Pipeline stage ProductionBlendMKMLTemplater completed in 18.65s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
function_tudub_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v112
run pipeline %s
chaiml-0926-nemo-virgo-t_5421_v1 status is now torndown due to DeploymentManager action
run pipeline %s
Running pipeline stage MKMLDeleter
admin requested tearing down of blend_fuhof_2024-09-27
run pipeline stage %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v114
run pipeline %s
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
run pipeline %s
admin requested tearing down of blend_fulat_2024-09-27
Running pipeline stage MKMLDeleter
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v115
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage MKMLDeleter completed in 46.39s
Running pipeline stage ProductionBlendMKMLTemplater
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
admin requested tearing down of blend_gelom_2024-09-27
Running pipeline stage MKMLDeleter
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v116
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage MKMLDeleter
run pipeline %s
Pipeline stage MKMLDeleter completed in 53.67s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
run pipeline %s
Pipeline stage MKMLDeleter completed in 53.67s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
admin requested tearing down of blend_gujen_2024-09-27
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v117
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline stage %s
run pipeline %s
Pipeline stage MKMLDeleter completed in 54.85s
Running pipeline stage MKMLDeleter
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage MKMLDeleter completed in 1.07s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gujen_2024-09-27
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of blend_gujen_2024-09-27
run pipeline %s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered