submission_id: blend_pifos_2024-10-07
developer_uid: end_to_end_test
celo_rating: 1261.13
display_name: blend_pifos_2024-10-07
family_friendly_score: 0.5706109410355384
family_friendly_standard_error: 0.005675976168057747
is_internal_developer: True
language_model: zonemercy-virgo-edit-v1-1e5_v13,chaiml-lexical-nemo-v4-1k1e5_v3,zonemercy-lexical-nemov8_5966_v9,sao10k-mn-12b-lyra-v4a1_v9
model_group:
model_name: blend_pifos_2024-10-07
model_size: n/a
num_battles: 7820
num_wins: 3977
ranking_group: blended
reward_model: random
status: inactive
submission_type: blend
submissions: ['zonemercy-virgo-edit-v1-1e5_v13', 'chaiml-lexical-nemo-v4-1k1e5_v3', 'zonemercy-lexical-nemov8_5966_v9', 'sao10k-mn-12b-lyra-v4a1_v9']
timestamp: 2024-10-07T01:46:01+00:00
us_pacific_date: 2024-10-06
win_ratio: 0.5085677749360614
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage ProductionBlendMKMLTemplater
Pipeline stage ProductionBlendMKMLTemplater completed in 1.77s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service blend-pifos-2024-10-07
Waiting for inference service blend-pifos-2024-10-07 to be ready
Inference service blend-pifos-2024-10-07 ready after 50.859461307525635s
Pipeline stage MKMLDeployer completed in 52.25s
run pipeline stage %s
Running pipeline stage StressChecker
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.7137629985809326s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 1.8969850540161133s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.1370129585266113s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.56329083442688s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.4147441387176514s
5 requests
0 failed requests
5th percentile: 1.944990634918213
10th percentile: 1.9929962158203125
20th percentile: 2.0890073776245117
30th percentile: 2.1925591945648195
40th percentile: 2.3036516666412354
50th percentile: 2.4147441387176514
60th percentile: 2.4741628170013428
70th percentile: 2.533581495285034
80th percentile: 2.7933852672576904
90th percentile: 3.2535741329193115
95th percentile: 3.483668565750122
99th percentile: 3.6677441120147707
mean time: 2.545159196853638
Pipeline stage StressChecker completed in 16.30s
Shutdown handler de-registered
blend_pifos_2024-10-07 status is now deployed due to DeploymentManager action
blend_pifos_2024-10-07 status is now inactive due to auto deactivation removed underperforming models