Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.331249952316284s
Received healthy response to inference request in 2.4184958934783936s
Received healthy response to inference request in 3.915849208831787s
Received healthy response to inference request in 3.4335684776306152s
Received healthy response to inference request in 2.1307590007781982s
Received healthy response to inference request in 2.3057053089141846s
Received healthy response to inference request in 2.164257049560547s
Received healthy response to inference request in 1.8195974826812744s
Received healthy response to inference request in 1.5934290885925293s
10 requests
1 failed requests
5th percentile: 1.6952048659324646
10th percentile: 1.7969806432723998
20th percentile: 2.0685266971588137
30th percentile: 2.154207634925842
40th percentile: 2.2491260051727293
50th percentile: 2.3184776306152344
60th percentile: 2.366148328781128
70th percentile: 2.7230176687240597
80th percentile: 3.5300246238708497
90th percentile: 5.53536267280578
95th percentile: 12.823173260688765
99th percentile: 18.65342173099518
mean time: 4.222389531135559
%s, retrying in %s seconds...
Received healthy response to inference request in 2.4271955490112305s
Received healthy response to inference request in 1.7071115970611572s
Received healthy response to inference request in 2.362474203109741s
Received healthy response to inference request in 2.137096405029297s
Received healthy response to inference request in 1.920109748840332s
Received healthy response to inference request in 2.573963165283203s
Received healthy response to inference request in 2.2206602096557617s
Received healthy response to inference request in 5.387409687042236s
Received healthy response to inference request in 1.9375946521759033s
Received healthy response to inference request in 2.5700039863586426s
10 requests
0 failed requests
5th percentile: 1.8029607653617858
10th percentile: 1.8988099336624145
20th percentile: 1.934097671508789
30th percentile: 2.0772458791732786
40th percentile: 2.1872346878051756
50th percentile: 2.2915672063827515
60th percentile: 2.388362741470337
70th percentile: 2.470038080215454
80th percentile: 2.5707958221435545
90th percentile: 2.8553078174591056
95th percentile: 4.121358752250668
99th percentile: 5.134199500083923
mean time: 2.5243619203567507
Pipeline stage StressChecker completed in 70.71s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_gibuk_2025-12-18 status is now deployed due to DeploymentManager action
function_gibuk_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_gibuk_2025-12-18 status is now torndown due to DeploymentManager action