Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.847228527069092s
Received healthy response to inference request in 3.3778300285339355s
Received healthy response to inference request in 2.8604626655578613s
Received healthy response to inference request in 3.368922710418701s
Received healthy response to inference request in 2.2481725215911865s
5 requests
0 failed requests
5th percentile: 2.3706305503845213
10th percentile: 2.4930885791778565
20th percentile: 2.7380046367645265
30th percentile: 2.962154674530029
40th percentile: 3.165538692474365
50th percentile: 3.368922710418701
60th percentile: 3.372485637664795
70th percentile: 3.3760485649108887
80th percentile: 3.471709728240967
90th percentile: 3.6594691276550293
95th percentile: 3.7533488273620605
99th percentile: 3.8284525871276855
mean time: 3.1405232906341554
Pipeline stage StressChecker completed in 16.24s
Shutdown handler de-registered
function_tasof_2024-09-14 status is now deployed due to DeploymentManager action
function_tasof_2024-09-14 status is now inactive due to auto deactivation removed underperforming models