Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.534904956817627s
Received healthy response to inference request in 4.786635875701904s
Received healthy response to inference request in 3.82002854347229s
Received healthy response to inference request in 2.6092453002929688s
Received healthy response to inference request in 3.240158796310425s
Received healthy response to inference request in 5.853554725646973s
Received healthy response to inference request in 4.0806989669799805s
Received healthy response to inference request in 3.8358020782470703s
Received healthy response to inference request in 4.3899712562561035s
Received healthy response to inference request in 2.947547435760498s
10 requests
0 failed requests
5th percentile: 2.5683581113815306
10th percentile: 2.6018112659454347
20th percentile: 2.879887008666992
30th percentile: 3.1523753881454466
40th percentile: 3.588080644607544
50th percentile: 3.82791531085968
60th percentile: 3.933760833740234
70th percentile: 4.173480653762818
80th percentile: 4.469304180145263
90th percentile: 4.893327760696411
95th percentile: 5.3734412431716905
99th percentile: 5.757532029151917
mean time: 3.809854793548584
Pipeline stage StressChecker completed in 39.85s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.17s
Shutdown handler de-registered
function_gapus_2025-12-16 status is now deployed due to DeploymentManager action
function_gapus_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_gapus_2025-12-16 status is now torndown due to DeploymentManager action