Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.2916336059570312s
Received healthy response to inference request in 6.528904914855957s
Received healthy response to inference request in 3.910724401473999s
Received healthy response to inference request in 3.6113739013671875s
Received healthy response to inference request in 3.431788682937622s
5 requests
0 failed requests
5th percentile: 3.3196646213531493
10th percentile: 3.3476956367492674
20th percentile: 3.403757667541504
30th percentile: 3.467705726623535
40th percentile: 3.5395398139953613
50th percentile: 3.6113739013671875
60th percentile: 3.7311141014099123
70th percentile: 3.8508543014526366
80th percentile: 4.434360504150391
90th percentile: 5.481632709503174
95th percentile: 6.005268812179565
99th percentile: 6.4241776943206785
mean time: 4.154885101318359
%s, retrying in %s seconds...
Received healthy response to inference request in 4.368246078491211s
Received healthy response to inference request in 2.5461106300354004s
Received healthy response to inference request in 3.137985944747925s
Received healthy response to inference request in 18.715575695037842s
Received healthy response to inference request in 2.414745569229126s
5 requests
0 failed requests
5th percentile: 2.441018581390381
10th percentile: 2.4672915935516357
20th percentile: 2.5198376178741455
30th percentile: 2.6644856929779053
40th percentile: 2.901235818862915
50th percentile: 3.137985944747925
60th percentile: 3.6300899982452393
70th percentile: 4.122194051742554
80th percentile: 7.23771200180054
90th percentile: 12.97664384841919
95th percentile: 15.846109771728512
99th percentile: 18.141682510375976
mean time: 6.2365327835083
%s, retrying in %s seconds...
Received healthy response to inference request in 3.8141958713531494s
Received healthy response to inference request in 2.6291370391845703s
Received healthy response to inference request in 3.2529027462005615s
Received healthy response to inference request in 2.6653244495391846s
Received healthy response to inference request in 3.2955174446105957s
5 requests
0 failed requests
5th percentile: 2.636374521255493
10th percentile: 2.643612003326416
20th percentile: 2.658086967468262
30th percentile: 2.78284010887146
40th percentile: 3.0178714275360106
50th percentile: 3.2529027462005615
60th percentile: 3.269948625564575
70th percentile: 3.2869945049285887
80th percentile: 3.3992531299591064
90th percentile: 3.606724500656128
95th percentile: 3.7104601860046387
99th percentile: 3.793448734283447
mean time: 3.131415510177612
Pipeline stage StressChecker completed in 70.85s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_gugar_2025-06-25 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3784.40s
Shutdown handler de-registered
function_gugar_2025-06-25 status is now inactive due to auto deactivation removed underperforming models
function_gugar_2025-06-25 status is now torndown due to DeploymentManager action