Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Unable to record family friendly update due to error: HTTPConnectionPool(host='chaiml-nemo-guard-merged-v3-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Max retries exceeded with url: /v1/models/GPT-J-6B-lit-v2:predict (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7a0e36a09190>, 'Connection to chaiml-nemo-guard-merged-v3-predictor.tenant-chaiml-guanaco.k2.chaiverse.com timed out. (connect timeout=12.0)'))
Received healthy response to inference request in 8.610167503356934s
Received healthy response to inference request in 2.64493465423584s
Received healthy response to inference request in 6.148568868637085s
Received healthy response to inference request in 4.427075624465942s
Received healthy response to inference request in 12.68557095527649s
Received healthy response to inference request in 4.229719161987305s
Received healthy response to inference request in 5.2341015338897705s
Received healthy response to inference request in 4.178431510925293s
Received healthy response to inference request in 5.900126934051514s
Received healthy response to inference request in 6.503300428390503s
10 requests
0 failed requests
5th percentile: 3.335008239746094
10th percentile: 4.025081825256348
20th percentile: 4.2194616317749025
30th percentile: 4.367868685722351
40th percentile: 4.911291170120239
50th percentile: 5.567114233970642
60th percentile: 5.999503707885742
70th percentile: 6.254988336563111
80th percentile: 6.92467384338379
90th percentile: 9.017707848548888
95th percentile: 10.851639401912685
99th percentile: 12.31878464460373
mean time: 6.056199717521667
Pipeline stage StressChecker completed in 61.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_jigib_2026-03-08 status is now deployed due to DeploymentManager action
function_jigib_2026-03-08 status is now inactive due to auto deactivation removed underperforming models
function_jigib_2026-03-08 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread