Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.16746187210083s
Received healthy response to inference request in 2.606011390686035s
Received healthy response to inference request in 1.4710993766784668s
Received healthy response to inference request in 2.090207576751709s
Received healthy response to inference request in 3.1384336948394775s
5 requests
0 failed requests
5th percentile: 1.5949210166931151
10th percentile: 1.7187426567077637
20th percentile: 1.9663859367370606
30th percentile: 2.105658435821533
40th percentile: 2.136560153961182
50th percentile: 2.16746187210083
60th percentile: 2.342881679534912
70th percentile: 2.518301486968994
80th percentile: 2.712495851516724
90th percentile: 2.9254647731781005
95th percentile: 3.031949234008789
99th percentile: 3.1171368026733397
mean time: 2.294642782211304
Pipeline stage StressChecker completed in 12.90s
Shutdown handler de-registered
function_dohol_2024-10-18 status is now deployed due to DeploymentManager action
function_dohol_2024-10-18 status is now inactive due to auto deactivation removed underperforming models