blend_dones_2024-09-27

submission_id: blend_dones_2024-09-27
developer_uid: chai_backend_admin
celo_rating: 1243.59
display_name: blend
family_friendly_score: 0.5616036505867015
family_friendly_standard_error: 0.00893293194403296
is_internal_developer: True
language_model: chaiml-elo-alignment-run-3_v34,zonemercy-lexical-nemo-_1518_v18,zonemercy-lexical-nemov8_5966_v2,zonemercy-virgo-edit-v1-1e5_v3,chaiml-0926-nemo-virgo-t_5421_v1
model_group:
model_name: blend
model_size: n/a
num_battles: 3155
num_wins: 1553
ranking_group: blended
reward_model: random
status: torndown
submission_type: blend
submissions: ['chaiml-elo-alignment-run-3_v34', 'zonemercy-lexical-nemo-_1518_v18', 'zonemercy-lexical-nemov8_5966_v2', 'zonemercy-virgo-edit-v1-1e5_v3', 'chaiml-0926-nemo-virgo-t_5421_v1']
timestamp: 2024-09-27T00:40:30+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.49223454833597463
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_dones_2024-09-27 status is now deployed due to DeploymentManager action
blend_dones_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_fuhof_2024-09-27
Cleaning model data from S3
function_tudub_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v112
Deleting key chaiml-0926-nemo-virgo-t-1582-v1/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key chaiml-0916-intent-suppo-6584-v5/tokenizer.json from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v6/flywheel_model.0.safetensors from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v7/config.json from bucket guanaco-mkml-models
admin requested tearing down of blend_dones_2024-09-27
Cleaning model data from model cache
admin requested tearing down of blend_rofur_2024-10-03
Running pipeline stage MKMLDeleter
Cleaning model data from model cache
admin requested tearing down of blend_rofur_2024-10-03
Running pipeline stage MKMLDeleter
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
admin requested tearing down of mistralai-mistral-nemo_9330_v114
Deleting key chaiml-0926-nemo-virgo-t-1582-v1/tokenizer.json from bucket guanaco-mkml-models
Deleting key chaiml-0916-intent-suppo-6584-v5/tokenizer_config.json from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v6/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v7/flywheel_model.0.safetensors from bucket guanaco-mkml-models
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fenik_2024-09-27
Deleting key chaiml-0926-nemo-virgo-t-5421-v1/config.json from bucket guanaco-mkml-models
Shutdown handler not registered because Python interpreter is not running in the main thread
Checking if service meta-llama-llama-3-1-8b-7331-v1 is running
Running pipeline stage MKMLDeleter
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v115
Deleting key chaiml-0926-nemo-virgo-t-1582-v1/tokenizer_config.json from bucket guanaco-mkml-models
Deleting key chaiml-0926-nemo-virgo-t-3956-v6/tokenizer.json from bucket guanaco-mkml-models
Pipeline stage MKMLModelDeleter completed in 179.55s
Deleting key chaiml-0926-nemo-virgo-t-3956-v7/special_tokens_map.json from bucket guanaco-mkml-models
run pipeline %s
Deleting key chaiml-0926-nemo-virgo-t-5421-v1/flywheel_model.0.safetensors from bucket guanaco-mkml-models
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fuhof_2024-09-27
run pipeline stage %s
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Pipeline stage MKMLModelDeleter completed in 145.48s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
run pipeline stage %s
run pipeline stage %s
Running pipeline stage MKMLDeleter
Checking if service mistralai-mistral-nemo-9330-v110 is running
run pipeline %s
Tearing down inference service meta-llama-llama-3-1-8b-7331-v1
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v116
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
Running pipeline stage ProductionBlendMKMLTemplater
Running pipeline stage MKMLModelDeleter
Pipeline stage MKMLDeleter completed in 400.79s
Running pipeline stage MKMLDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
run pipeline stage %s
Shutdown handler de-registered
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Waiting for inference service blend-rofur-2024-10-03 to be ready
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_fafot_2024-09-26
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 45.81s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Creating inference service blend-rofur-2024-10-03
admin requested tearing down of blend_dones_2024-09-27
run pipeline stage %s
run pipeline %s
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_rofur_2024-10-03
run pipeline stage %s
run pipeline %s
admin requested tearing down of function_femik_2024-09-26
Running pipeline stage MKMLModelDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 52.08s
Pipeline stage %s skipped, reason=%s
Ignoring service blend-rofur-2024-10-03 already deployed
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fenik_2024-09-27
Running pipeline stage MKMLDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage %s skipped, reason=%s
run pipeline %s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 71.55s
Waiting for inference service blend-rofur-2024-10-03 to be ready
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fuhof_2024-09-27
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_keneb_2024-09-26
Pipeline stage MKMLModelDeleter completed in 78.95s
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
Pipeline stage MKMLDeleter completed in 90.38s
run pipeline stage %s
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
Pipeline stage MKMLDeleter completed in 90.38s
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_sulib_2024-09-26
Shutdown handler de-registered
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 99.89s
Running pipeline stage MKMLModelDeleter
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of blend_gujen_2024-09-27
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-0926-nemo-virgo-t_1582_v1 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 122.71s
admin requested tearing down of blend_rofur_2024-10-03
Pipeline stage %s skipped, reason=%s
run pipeline %s
admin requested tearing down of blend_rofur_2024-10-03
Shutdown handler de-registered
function_keneb_2024-09-26 status is now torndown due to DeploymentManager action
chaiml-0926-nemo-virgo-t_3956_v6 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 237.43s
run pipeline %s
Shutdown handler de-registered
run pipeline %s
Shutdown handler de-registered
run pipeline %s
Running pipeline stage MKMLDeployer
function_tudub_2024-09-26 status is now torndown due to DeploymentManager action
blend_gelom_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler de-registered
admin requested tearing down of blend_dones_2024-09-27
run pipeline stage %s
admin requested tearing down of blend_dones_2024-09-27
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Creating inference service blend-rofur-2024-10-03
Running pipeline stage MKMLModelDeleter
%s, retrying in %s seconds...
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 104.24s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 98.75s
Shutdown handler de-registered
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_femik_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_tudub_2024-09-26
Pipeline stage MKMLModelDeleter completed in 96.03s
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
Ignoring service blend-rofur-2024-10-03 already deployed
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of blend_rofur_2024-10-03
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
admin requested tearing down of blend_dones_2024-09-27
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rofur_2024-10-03
Pipeline stage %s skipped, reason=%s
admin requested tearing down of blend_rofur_2024-10-03
Running pipeline stage MKMLModelDeleter
run pipeline %s
function_jisob_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
admin requested tearing down of blend_rofur_2024-10-03
run pipeline %s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_rofur_2024-10-03
Shutdown handler de-registered
Waiting for inference service blend-rofur-2024-10-03 to be ready
blend_fuhof_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-0926-nemo-virgo-t_1582_v1 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLModelDeleter completed in 237.49s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
function_keneb_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-0926-nemo-virgo-t_3956_v6 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 237.49s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
Running pipeline stage ProductionBlendMKMLTemplater
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
Running pipeline stage MKMLDeleter
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-nemo_9330_v115
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rofur_2024-10-03
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
admin requested tearing down of blend_fulat_2024-09-27
Shutdown handler de-registered
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_gelom_2024-09-27
blend_fenik_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of mistralai-mistral-nemo_9330_v146
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fenik_2024-09-27
run pipeline %s
run pipeline %s
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
admin requested tearing down of blend_fuhof_2024-09-27
run pipeline stage %s
admin requested tearing down of blend_fuhof_2024-09-27
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_dones_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_fulat_2024-09-27
Shutdown handler de-registered
run pipeline %s