Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.252582550048828s
Received healthy response to inference request in 3.674372911453247s
Received healthy response to inference request in 3.511911392211914s
Received healthy response to inference request in 2.853055477142334s
Received healthy response to inference request in 2.1792938709259033s
5 requests
0 failed requests
5th percentile: 2.1939516067504883
10th percentile: 2.2086093425750732
20th percentile: 2.237924814224243
30th percentile: 2.372677135467529
40th percentile: 2.6128663063049316
50th percentile: 2.853055477142334
60th percentile: 3.116597843170166
70th percentile: 3.380140209197998
80th percentile: 3.5444036960601806
90th percentile: 3.609388303756714
95th percentile: 3.6418806076049806
99th percentile: 3.667874450683594
mean time: 2.8942432403564453
Pipeline stage StressChecker completed in 16.74s
Shutdown handler de-registered
function_dusok_2024-10-14 status is now deployed due to DeploymentManager action
function_dusok_2024-10-14 status is now inactive due to auto deactivation removed underperforming models
function_dusok_2024-10-14 status is now torndown due to DeploymentManager action