Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.752941370010376s
Received healthy response to inference request in 2.1711652278900146s
Received healthy response to inference request in 2.850900650024414s
Received healthy response to inference request in 4.83046555519104s
Received healthy response to inference request in 3.4769725799560547s
5 requests
0 failed requests
5th percentile: 2.3071123123168946
10th percentile: 2.4430593967437746
20th percentile: 2.714953565597534
30th percentile: 2.976115036010742
40th percentile: 3.2265438079833983
50th percentile: 3.4769725799560547
60th percentile: 4.0183697700500485
70th percentile: 4.559766960144042
80th percentile: 5.014960718154907
90th percentile: 5.383951044082641
95th percentile: 5.568446207046509
99th percentile: 5.716042337417602
mean time: 3.81648907661438
%s, retrying in %s seconds...
Received healthy response to inference request in 3.278731107711792s
Received healthy response to inference request in 5.120819568634033s
Received healthy response to inference request in 3.2788634300231934s
Received healthy response to inference request in 4.324586868286133s
Received healthy response to inference request in 2.579636573791504s
5 requests
0 failed requests
5th percentile: 2.7194554805755615
10th percentile: 2.859274387359619
20th percentile: 3.1389122009277344
30th percentile: 3.2787575721740723
40th percentile: 3.278810501098633
50th percentile: 3.2788634300231934
60th percentile: 3.697152805328369
70th percentile: 4.115442180633544
80th percentile: 4.483833408355713
90th percentile: 4.802326488494873
95th percentile: 4.961573028564453
99th percentile: 5.088970260620117
mean time: 3.716527509689331
%s, retrying in %s seconds...
Received healthy response to inference request in 2.8501710891723633s
Received healthy response to inference request in 2.490885019302368s
Received healthy response to inference request in 3.103961944580078s
Received healthy response to inference request in 3.5157341957092285s
Received healthy response to inference request in 3.657165288925171s
5 requests
0 failed requests
5th percentile: 2.562742233276367
10th percentile: 2.634599447250366
20th percentile: 2.7783138751983643
30th percentile: 2.900929260253906
40th percentile: 3.002445602416992
50th percentile: 3.103961944580078
60th percentile: 3.268670845031738
70th percentile: 3.4333797454833985
80th percentile: 3.544020414352417
90th percentile: 3.600592851638794
95th percentile: 3.6288790702819824
99th percentile: 3.6515080451965334
mean time: 3.123583507537842
Pipeline stage StressChecker completed in 57.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
function_ragun_2025-06-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3555.57s
Shutdown handler de-registered
function_ragun_2025-06-12 status is now inactive due to auto deactivation removed underperforming models
function_ragun_2025-06-12 status is now protected due to ABTestQueueItem
function_ragun_2025-06-12 status is now inactive due to ABTestQueueItem
function_ragun_2025-06-12 status is now torndown due to DeploymentManager action