Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.2177455425262451s
Received healthy response to inference request in 1.1337623596191406s
Received healthy response to inference request in 0.8187940120697021s
Received healthy response to inference request in 0.9023568630218506s
Received healthy response to inference request in 1.5014493465423584s
5 requests
0 failed requests
5th percentile: 0.8355065822601319
10th percentile: 0.8522191524505616
20th percentile: 0.8856442928314209
30th percentile: 0.9486379623413086
40th percentile: 1.0412001609802246
50th percentile: 1.1337623596191406
60th percentile: 1.1673556327819825
70th percentile: 1.2009489059448242
80th percentile: 1.2744863033294678
90th percentile: 1.387967824935913
95th percentile: 1.4447085857391357
99th percentile: 1.490101194381714
mean time: 1.1148216247558593
Pipeline stage StressChecker completed in 6.95s
Shutdown handler de-registered
function_gidos_2024-10-21 status is now deployed due to DeploymentManager action
function_gidos_2024-10-21 status is now inactive due to auto deactivation removed underperforming models