developer_uid: chai_backend_admin
submission_id: blend_batat_2024-09-20
model_name: blend_batat_2024-09-20
model_group:
status: torndown
timestamp: 2024-09-20T04:28:06+00:00
num_battles: 2869113
num_wins: 1449896
celo_rating: 1255.38
family_friendly_score: 0.5551123131117928
family_friendly_standard_error: 0.0023721043500125037
submission_type: blend
submissions: ['zonemercy-virgo-edit-v1-1e5_v13', 'chaiml-elo-alignment-run-3_v44', 'chaiml-lexical-nemo-v4-1k1e5_v3', 'zonemercy-lexical-nemov8_5966_v9', 'chaiml-0916-intent-suppo_6584_v3']
display_name: blend_batat_2024-09-20
is_internal_developer: True
language_model: zonemercy-virgo-edit-v1-1e5_v13,chaiml-elo-alignment-run-3_v44,chaiml-lexical-nemo-v4-1k1e5_v3,zonemercy-lexical-nemov8_5966_v9,chaiml-0916-intent-suppo_6584_v3
model_size: n/a
ranking_group: blended
reward_model: random
us_pacific_date: 2024-09-19
win_ratio: 0.5053464258814484
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_batat_2024-09-20 status is now deployed due to DeploymentManager action
blend_batat_2024-09-20 status is now inactive due to auto deactivation removed underperforming models
run pipeline stage %s
Deleting key zonemercy-viral-ss-v0-1e5ep2-v1/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key zonemercy-viral-ss-v0-1e5ep2-v2/flywheel_model.1.safetensors from bucket guanaco-mkml-models
run pipeline %s
Tearing down inference service blend-rofur-2024-10-03
Tearing down inference service blend-rofur-2024-10-03
Tearing down inference service blend-rofur-2024-10-03
Tearing down inference service blend-rofur-2024-10-03
run pipeline stage %s
zonemercy-viral-ss-v0-1e5ep2_v3 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler de-registered
Tearing down inference service blend-rofur-2024-10-03
run pipeline stage %s
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_batat_2024-09-20
admin requested tearing down of blend_rofur_2024-10-03
admin requested tearing down of blend_dimam_2024-09-20
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of mistralai-mistral-small_5341_v37
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of zonemercy-viral-ss-v0-1e5ep2_v5
admin requested tearing down of blend_dupem_2024-09-14
run pipeline %s
Shutdown handler de-registered
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of zonemercy-viral-ss-v0-1e5ep2_v6
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of zonemercy-viral-ss-v0-1e5ep2_v6
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
admin requested tearing down of blend_fedub_2024-09-19
Shutdown handler de-registered
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_hamem_2024-10-04
run pipeline stage %s
run pipeline %s
admin requested tearing down of blend_rofur_2024-10-03
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
blend_notum_2024-09-20 status is now torndown due to DeploymentManager action
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
run pipeline %s
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fedub_2024-09-19
run pipeline stage %s
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_suhem_2024-09-14
admin requested tearing down of blend_batat_2024-09-20
blend_simib_2024-09-20 status is now torndown due to DeploymentManager action
blend_simib_2024-09-20 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
admin requested tearing down of blend_rofur_2024-10-03
Shutdown handler de-registered
run pipeline %s
blend_sudit_2024-09-14 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_talom_2024-09-14
Tearing down inference service blend-rofur-2024-10-03
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fedub_2024-09-19
run pipeline stage %s
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fedub_2024-09-19
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_talom_2024-09-14 status is now torndown due to DeploymentManager action
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Pipeline stage MKMLDeleter completed in 168.22s
Running pipeline stage MKMLModelDeleter
Running pipeline stage MKMLDeployer
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
Deleting key chaiml-0916-intent-suppo-6584-v3/config.json from bucket guanaco-mkml-models
Pipeline stage ProductionBlendMKMLTemplater completed in 67.49s
run pipeline stage %s
run pipeline %s
run pipeline %s
admin requested tearing down of blend_fedub_2024-09-19
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline stage %s
zonemercy-viral-ss-v0-1e5ep2-v9-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-viral-ss-v0-1e5ep2-v7-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
mistralai-mistral-small-5341-v39-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
Job zonemercy-viral-ss-v0-1e5ep2-v8-mkmlizer completed after 439.19s with status: succeeded
run pipeline stage %s
zonemercy-viral-ss-v0-1e5ep2-v9-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
blend_nifob_2024-09-19 status is now torndown due to DeploymentManager action
Job mistralai-mistral-small-5341-v39-mkmlizer completed after 480.79s with status: succeeded
Received healthy response to inference request in 2.4374020099639893s
run pipeline stage %s
zonemercy-viral-ss-v0-1e5ep2-v10-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v10/tokenizer.json
Job zonemercy-viral-ss-v0-1e5ep2-v7-mkmlizer completed after 474.97s with status: succeeded
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action
blend_batat_2024-09-20 status is now torndown due to DeploymentManager action