developer_uid: chai_backend_admin
submission_id: blend_jifom_2024-12-20
model_name: blend_jifom_2024-12-20
model_group:
status: inactive
timestamp: 2024-12-20T23:56:32+00:00
num_battles: 11338
num_wins: 5962
celo_rating: 1274.85
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: blend
submissions: ['chaiml-nemo-anthropic-ad_3823_v5', 'nitral-ai-captain-bmo-12b_v15', 'chaiml-nemo-20241017-ti_8098_v12']
display_name: blend_jifom_2024-12-20
is_internal_developer: True
language_model: chaiml-nemo-anthropic-ad_3823_v5,nitral-ai-captain-bmo-12b_v15,chaiml-nemo-20241017-ti_8098_v12
model_size: n/a
ranking_group: blended
reward_model: random
us_pacific_date: 2024-12-20
win_ratio: 0.5258423002293173
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage ProductionBlendMKMLTemplater
Pipeline stage ProductionBlendMKMLTemplater completed in 0.56s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service blend-jifom-2024-12-20
Waiting for inference service blend-jifom-2024-12-20 to be ready
Inference service blend-jifom-2024-12-20 ready after 40.694068908691406s
Pipeline stage MKMLDeployer completed in 43.13s
run pipeline stage %s
Running pipeline stage StressChecker
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.9047420024871826s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 1.9056730270385742s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.030823230743408s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 1.8430910110473633s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 1.7853057384490967s
5 requests
0 failed requests
5th percentile: 1.79686279296875
10th percentile: 1.8084198474884032
20th percentile: 1.83153395652771
30th percentile: 1.8556074142456054
40th percentile: 1.8806402206420898
50th percentile: 1.9056730270385742
60th percentile: 1.9557331085205079
70th percentile: 2.0057931900024415
80th percentile: 2.2056069850921634
90th percentile: 2.5551744937896728
95th percentile: 2.7299582481384275
99th percentile: 2.8697852516174316
mean time: 2.093927001953125
Pipeline stage StressChecker completed in 12.27s
Shutdown handler de-registered
blend_jifom_2024-12-20 status is now deployed due to DeploymentManager action
blend_jifom_2024-12-20 status is now inactive due to auto deactivation removed underperforming models