Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.9005074501037598s
Received healthy response to inference request in 3.4604074954986572s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.988570213317871s
Received healthy response to inference request in 2.226027011871338s
Received healthy response to inference request in 2.962618350982666s
5 requests
0 failed requests
5th percentile: 2.360923099517822
10th percentile: 2.4958191871643067
20th percentile: 2.7656113624572756
30th percentile: 2.912929630279541
40th percentile: 2.9377739906311033
50th percentile: 2.962618350982666
60th percentile: 3.1617340087890624
70th percentile: 3.360849666595459
80th percentile: 3.5660400390625
90th percentile: 3.7773051261901855
95th percentile: 3.8829376697540283
99th percentile: 3.9674437046051025
mean time: 3.1076261043548583
Pipeline stage StressChecker completed in 17.16s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.84s
Shutdown handler de-registered
function_mosan_2024-11-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3148.12s
Shutdown handler de-registered
function_mosan_2024-11-14 status is now inactive due to auto deactivation removed underperforming models