blend_rakul_2024-09-27

developer_uid: chai_backend_admin

submission_id: blend_rakul_2024-09-27

model_name: blend

model_group:

status: torndown

timestamp: 2024-09-27T00:34:27+00:00

num_battles: 3127

num_wins: 1538

celo_rating: 1243.54

family_friendly_score: 0.5598135964912281

family_friendly_standard_error: 0.008977893363574213

submission_type: blend

submissions: ['chaiml-elo-alignment-run-3_v34', 'zonemercy-lexical-nemo-_1518_v18', 'zonemercy-lexical-nemov8_5966_v2', 'zonemercy-virgo-edit-v1-1e5_v3', 'arliai-mistral-nemo-12b-_9104_v3']

display_name: blend

is_internal_developer: True

language_model: chaiml-elo-alignment-run-3_v34,zonemercy-lexical-nemo-_1518_v18,zonemercy-lexical-nemov8_5966_v2,zonemercy-virgo-edit-v1-1e5_v3,arliai-mistral-nemo-12b-_9104_v3

model_size: n/a

ranking_group: blended

reward_model: random

us_pacific_date: 2024-09-26

win_ratio: 0.4918452190598017

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_rakul_2024-09-27 status is now deployed due to DeploymentManager action
blend_rakul_2024-09-27 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
Waiting for inference service blend-rofur-2024-10-03 to be ready
blend_rakul_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
blend_rakul_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
blend_rakul_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
Waiting for inference service blend-rofur-2024-10-03 to be ready
admin requested tearing down of blend_rakul_2024-09-27
Shutdown handler de-registered
blend_kufab_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
blend_lasut_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rilef_2024-09-27
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_rudum_2024-09-27
blend_pigir_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
blend_rakul_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
blend_rakul_2024-09-27 status is now torndown due to DeploymentManager action
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler de-registered
blend_kufab_2024-09-27 status is now torndown due to DeploymentManager action
blend_kufab_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rilef_2024-09-27
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of blend_rudum_2024-09-27
blend_pigir_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rudum_2024-09-27
blend_pigir_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
blend_hanik_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
mistralai-mistral-nemo_9330_v146 status is now torndown due to DeploymentManager action
run pipeline %s
admin requested tearing down of blend_rakul_2024-09-27
blend_kufab_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler de-registered
blend_lasut_2024-09-27 status is now torndown due to DeploymentManager action
run pipeline %s
blend_pigir_2024-09-27 status is now torndown due to DeploymentManager action
admin requested tearing down of blend_rudum_2024-09-27
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
blend_rakul_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
admin requested tearing down of chaiml-0916-intent-suppo_6584_v5
blend_rakul_2024-09-27 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s