Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 12.984624862670898s
Received healthy response to inference request in 14.377068042755127s
Received healthy response to inference request in 15.494789361953735s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 14.096574306488037s
Received healthy response to inference request in 13.761645317077637s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 15.785328149795532s
Received healthy response to inference request in 15.492259979248047s
Received healthy response to inference request in 15.277462482452393s
Received healthy response to inference request in 14.471919775009155s
Received healthy response to inference request in 14.378582000732422s
10 requests
0 failed requests
5th percentile: 13.33428406715393
10th percentile: 13.683943271636963
20th percentile: 14.029588508605958
30th percentile: 14.292919921875
40th percentile: 14.377976417541504
50th percentile: 14.425250887870789
60th percentile: 14.79413685798645
70th percentile: 15.341901731491088
80th percentile: 15.492765855789184
90th percentile: 15.523843240737914
95th percentile: 15.654585695266723
99th percentile: 15.75917965888977
mean time: 14.612025427818299
%s, retrying in %s seconds...
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 15.677142143249512s
Received healthy response to inference request in 14.286484718322754s
Received healthy response to inference request in 16.249017477035522s
Received healthy response to inference request in 15.749967575073242s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 15.416194677352905s
Received healthy response to inference request in 13.649633884429932s
Received healthy response to inference request in 14.240098714828491s
Received healthy response to inference request in 15.257628917694092s
Received healthy response to inference request in 15.875240564346313s
Received healthy response to inference request in 12.906180620193481s
10 requests
0 failed requests
5th percentile: 13.240734589099883
10th percentile: 13.575288558006287
20th percentile: 14.12200574874878
30th percentile: 14.272568917274475
40th percentile: 14.869171237945556
50th percentile: 15.336911797523499
60th percentile: 15.520573663711549
70th percentile: 15.698989772796631
80th percentile: 15.775022172927857
90th percentile: 15.912618255615234
95th percentile: 16.08081786632538
99th percentile: 16.215377554893493
mean time: 14.930758929252624
%s, retrying in %s seconds...
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 15.418750286102295s
Received healthy response to inference request in 16.187830209732056s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 16.134636163711548s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 13.101537466049194s
Received healthy response to inference request in 16.49370265007019s
Received healthy response to inference request in 15.35990595817566s
Received healthy response to inference request in 15.407260656356812s
Received healthy response to inference request in 15.851311683654785s
Received healthy response to inference request in 15.478577852249146s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 15.715478658676147s
10 requests
0 failed requests
5th percentile: 14.117803287506103
10th percentile: 15.134069108963013
20th percentile: 15.397789716720581
30th percentile: 15.41530339717865
40th percentile: 15.454646825790405
50th percentile: 15.597028255462646
60th percentile: 15.769811868667603
70th percentile: 15.936309027671815
80th percentile: 16.14527497291565
90th percentile: 16.21841745376587
95th percentile: 16.35606005191803
99th percentile: 16.466174130439757
mean time: 15.514899158477784
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 15.936309027671815s')
Shutdown handler de-registered
function_naran_2026-01-13 status is now failed due to DeploymentManager action
function_naran_2026-01-13 status is now inactive due to admin request
function_naran_2026-01-13 status is now torndown due to DeploymentManager action