blend_hanik_2024-09-27

submission_id: blend_hanik_2024-09-27

developer_uid: chai_backend_admin

celo_rating: 1256.43

display_name: blend

family_friendly_score: 0.550578034682081

family_friendly_standard_error: 0.008888004547357407

is_internal_developer: True

language_model: chaiml-elo-alignment-run-3_v34,zonemercy-lexical-nemo-_1518_v18,zonemercy-lexical-nemov8_5966_v2,zonemercy-virgo-edit-v1-1e5_v3,koboldai-llama2-13b-estopia_v1

model_group:

model_name: blend

model_size: n/a

num_battles: 3181

num_wins: 1618

ranking_group: blended

reward_model: random

status: torndown

submission_type: blend

submissions: ['chaiml-elo-alignment-run-3_v34', 'zonemercy-lexical-nemo-_1518_v18', 'zonemercy-lexical-nemov8_5966_v2', 'zonemercy-virgo-edit-v1-1e5_v3', 'koboldai-llama2-13b-estopia_v1']

timestamp: 2024-09-27T00:34:48+00:00

us_pacific_date: 2024-09-26

win_ratio: 0.5086450801634707

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_hanik_2024-09-27 status is now deployed due to DeploymentManager action
blend_hanik_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_pigir_2024-09-27
run pipeline stage %s
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_pigir_2024-09-27
Ignoring service blend-rofur-2024-10-03 already deployed
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
run pipeline %s
Cleaning model data from model cache
Cleaning model data from S3
Deleting key meta-llama-llama-3-1-8b-7331-v1/config.json from bucket guanaco-mkml-models
Checking if service mistralai-mistral-nemo-9330-v117 is running
%s, retrying in %s seconds...
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 310.64s
run pipeline stage %s
Service mistralai-mistral-nemo-9330-v116 has been torndown
run pipeline stage %s
Running pipeline stage MKMLDeleter
run pipeline stage %s
Ignoring service blend-rofur-2024-10-03 already deployed
run pipeline %s
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler de-registered
Cleaning model data from S3
Deleting key mistralai-mistral-nemo-9330-v110/config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key meta-llama-llama-3-1-8b-7331-v1/flywheel_model.0.safetensors from bucket guanaco-mkml-models
admin requested tearing down of blend_dones_2024-09-27
Creating inference service blend-rofur-2024-10-03
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_pigir_2024-09-27
Creating inference service blend-rofur-2024-10-03
Shutdown handler de-registered
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_pigir_2024-09-27
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_pigir_2024-09-27
Ignoring service blend-rofur-2024-10-03 already deployed
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v117
Running pipeline stage MKMLModelDeleter
Pipeline stage ProductionBlendMKMLTemplater completed in 59.94s
Pipeline stage %s skipped, reason=%s
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_hanik_2024-09-27
Running pipeline stage MKMLDeleter
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v119
Cleaning model data from S3
Pipeline stage MKMLDeleter completed in 60.17s
Shutdown handler de-registered
blend_fulat_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_kufab_2024-09-27
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Cleaning model data from model cache
Running pipeline stage MKMLDeployer
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v121
run pipeline stage %s
blend_gelom_2024-09-27 status is now torndown due to DeploymentManager action
Cleaning model data from S3
Running pipeline stage MKMLModelDeleter
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 64.39s
admin requested tearing down of blend_lasut_2024-09-27
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_rofur_2024-10-03
Tearing down inference service blend-rofur-2024-10-03
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of blend_rofur_2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_pigir_2024-09-27
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
mistralai-mistral-nemo_9330_v146 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
blend_gujen_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_pigir_2024-09-27
Shutdown handler de-registered