developer_uid: chai_backend_admin
submission_id: blend_luker_2024-10-05
model_name: default_blend
model_group:
status: torndown
timestamp: 2024-10-05T02:33:49+00:00
num_battles: 8712
num_wins: 4389
celo_rating: 1258.5
family_friendly_score: 0.5583946078431372
family_friendly_standard_error: 0.005465087566573015
submission_type: blend
submissions: ['function_nehin_2024-09-28', 'function_nehin_2024-09-28', 'function_nehin_2024-09-28', 'zonemercy-virgo-edit-v1-1e5_v13', 'sao10k-mn-12b-lyra-v4a1_v9', 'zonemercy-lexical-nemov8_5966_v9', 'chaiml-lexical-nemo-v4-1k1e5_v3', 'chaiml-elo-alignment-run-3_v44']
display_name: default_blend
is_internal_developer: True
language_model: function_nehin_2024-09-28,function_nehin_2024-09-28,function_nehin_2024-09-28,zonemercy-virgo-edit-v1-1e5_v13,sao10k-mn-12b-lyra-v4a1_v9,zonemercy-lexical-nemov8_5966_v9,chaiml-lexical-nemo-v4-1k1e5_v3,chaiml-elo-alignment-run-3_v44
model_size: n/a
ranking_group: blended
reward_model: random
us_pacific_date: 2024-10-04
win_ratio: 0.5037878787878788
Resubmit model Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Shutdown handler de-registered
blend_luker_2024-10-05 status is now deployed due to DeploymentManager action
blend_luker_2024-10-05 status is now inactive due to auto deactivation removed underperforming models
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2164.33s
Shutdown handler de-registered
blend_luker_2024-10-05 status is now torndown due to DeploymentManager action