Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.407177448272705s
Received healthy response to inference request in 3.0848217010498047s
Received healthy response to inference request in 3.503256320953369s
Received healthy response to inference request in 4.255126476287842s
Received healthy response to inference request in 0.4792747497558594s
5 requests
0 failed requests
5th percentile: 1.0003841400146485
10th percentile: 1.5214935302734376
20th percentile: 2.563712310791016
30th percentile: 3.1492928504943847
40th percentile: 3.278235149383545
50th percentile: 3.407177448272705
60th percentile: 3.4456089973449706
70th percentile: 3.484040546417236
80th percentile: 3.6536303520202638
90th percentile: 3.9543784141540526
95th percentile: 4.104752445220947
99th percentile: 4.225051670074463
mean time: 2.945931339263916
Pipeline stage StressChecker completed in 15.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_rebal_2025-08-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3108.24s
Shutdown handler de-registered
function_rebal_2025-08-19 status is now inactive due to auto deactivation removed underperforming models
function_rebal_2025-08-19 status is now torndown due to DeploymentManager action