Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7210075855255127s
Received healthy response to inference request in 5.058202266693115s
Received healthy response to inference request in 2.858492612838745s
Received healthy response to inference request in 4.55459451675415s
Received healthy response to inference request in 6.837745189666748s
5 requests
0 failed requests
5th percentile: 3.0309956073760986
10th percentile: 3.203498601913452
20th percentile: 3.548504590988159
30th percentile: 3.8877249717712403
40th percentile: 4.221159744262695
50th percentile: 4.55459451675415
60th percentile: 4.756037616729737
70th percentile: 4.957480716705322
80th percentile: 5.414110851287842
90th percentile: 6.1259280204772955
95th percentile: 6.481836605072021
99th percentile: 6.766563472747802
mean time: 4.606008434295655
%s, retrying in %s seconds...
Received healthy response to inference request in 1.5874955654144287s
Received healthy response to inference request in 2.522594690322876s
Received healthy response to inference request in 3.8554539680480957s
Received healthy response to inference request in 7.35457444190979s
Received healthy response to inference request in 4.290758371353149s
5 requests
0 failed requests
5th percentile: 1.7745153903961182
10th percentile: 1.9615352153778076
20th percentile: 2.3355748653411865
30th percentile: 2.78916654586792
40th percentile: 3.322310256958008
50th percentile: 3.8554539680480957
60th percentile: 4.0295757293701175
70th percentile: 4.2036974906921385
80th percentile: 4.903521585464478
90th percentile: 6.129048013687134
95th percentile: 6.741811227798461
99th percentile: 7.232021799087525
mean time: 3.922175407409668
%s, retrying in %s seconds...
Received healthy response to inference request in 4.012295246124268s
Received healthy response to inference request in 2.457204818725586s
Received healthy response to inference request in 4.237481117248535s
Received healthy response to inference request in 1.6204698085784912s
Received healthy response to inference request in 3.0558969974517822s
5 requests
0 failed requests
5th percentile: 1.7878168106079102
10th percentile: 1.9551638126373292
20th percentile: 2.289857816696167
30th percentile: 2.5769432544708253
40th percentile: 2.8164201259613035
50th percentile: 3.0558969974517822
60th percentile: 3.4384562969207764
70th percentile: 3.8210155963897705
80th percentile: 4.0573324203491214
90th percentile: 4.147406768798828
95th percentile: 4.192443943023681
99th percentile: 4.228473682403564
mean time: 3.0766695976257323
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 3.8210155963897705s')
Shutdown handler de-registered
function_timut_2025-11-09 status is now failed due to DeploymentManager action
function_timut_2025-11-09 status is now inactive due to auto deactivation removed underperforming models
function_timut_2025-11-09 status is now torndown due to DeploymentManager action