Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.761578559875488s
Received healthy response to inference request in 2.554150104522705s
Received healthy response to inference request in 5.684919357299805s
Received healthy response to inference request in 3.14949893951416s
Received healthy response to inference request in 3.909388780593872s
5 requests
0 failed requests
5th percentile: 2.6732198715209963
10th percentile: 2.792289638519287
20th percentile: 3.030429172515869
30th percentile: 3.3014769077301027
40th percentile: 3.6054328441619874
50th percentile: 3.909388780593872
60th percentile: 4.250264692306518
70th percentile: 4.591140604019165
80th percentile: 4.946246719360352
90th percentile: 5.315583038330078
95th percentile: 5.500251197814941
99th percentile: 5.647985725402832
mean time: 4.011907148361206
%s, retrying in %s seconds...
Received healthy response to inference request in 3.550401449203491s
Received healthy response to inference request in 4.2193756103515625s
Received healthy response to inference request in 3.727433443069458s
Received healthy response to inference request in 2.9018335342407227s
Received healthy response to inference request in 3.5005619525909424s
5 requests
0 failed requests
5th percentile: 3.021579217910767
10th percentile: 3.1413249015808105
20th percentile: 3.3808162689208983
30th percentile: 3.5105298519134522
40th percentile: 3.5304656505584715
50th percentile: 3.550401449203491
60th percentile: 3.621214246749878
70th percentile: 3.692027044296265
80th percentile: 3.825821876525879
90th percentile: 4.022598743438721
95th percentile: 4.120987176895142
99th percentile: 4.1996979236602785
mean time: 3.5799211978912355
Pipeline stage StressChecker completed in 40.39s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
function_batil_2025-07-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3986.63s
Shutdown handler de-registered
function_batil_2025-07-08 status is now inactive due to auto deactivation removed underperforming models
function_batil_2025-07-08 status is now torndown due to DeploymentManager action