Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.067270278930664s
Received healthy response to inference request in 1.832939863204956s
Received healthy response to inference request in 3.5121257305145264s
Received healthy response to inference request in 1.5086839199066162s
Received healthy response to inference request in 2.5332088470458984s
5 requests
0 failed requests
5th percentile: 1.573535108566284
10th percentile: 1.6383862972259522
20th percentile: 1.7680886745452882
30th percentile: 1.8798059463500976
40th percentile: 1.9735381126403808
50th percentile: 2.067270278930664
60th percentile: 2.2536457061767576
70th percentile: 2.4400211334228517
80th percentile: 2.728992223739624
90th percentile: 3.120558977127075
95th percentile: 3.316342353820801
99th percentile: 3.4729690551757812
mean time: 2.2908457279205323
Pipeline stage StressChecker completed in 13.00s
Shutdown handler de-registered
function_fetok_2024-10-18 status is now deployed due to DeploymentManager action
function_fetok_2024-10-18 status is now inactive due to auto deactivation removed underperforming models
function_fetok_2024-10-18 status is now torndown due to DeploymentManager action