Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.327530145645142s
Received healthy response to inference request in 6.15828275680542s
Received healthy response to inference request in 5.866774797439575s
Failed to get response for submission chaiml-llama31-mer-v2-t_44570_v4: ('http://guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com/models/chaiml-ca18-c13f-linear-w01_v9/predict', '{"detail":"503, message=\'Attempt to decode JSON with unexpected mimetype: text/plain\', url=\'http://10.0.248.12:8080/models/chaiml-ca18-c13f-linear-w01_v9/predict\'"}')
Received healthy response to inference request in 4.834878206253052s
Received healthy response to inference request in 7.370301961898804s
Received healthy response to inference request in 6.028340101242065s
Received healthy response to inference request in 8.313490152359009s
Received healthy response to inference request in 4.940164566040039s
Received healthy response to inference request in 3.7246932983398438s
Received healthy response to inference request in 3.7463271617889404s
10 requests
0 failed requests
5th percentile: 3.7344285368919374
10th percentile: 3.7441637754440307
20th percentile: 4.617167997360229
30th percentile: 4.908578658103943
40th percentile: 5.1725839138031
50th percentile: 5.597152471542358
60th percentile: 5.931400918960572
70th percentile: 6.067322897911072
80th percentile: 6.400686597824097
90th percentile: 7.4646207809448235
95th percentile: 7.889055466651915
99th percentile: 8.228603215217591
mean time: 5.631078314781189
Pipeline stage StressChecker completed in 57.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.45s
Shutdown handler de-registered
function_fotar_2025-12-15 status is now deployed due to DeploymentManager action
function_fotar_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_fotar_2025-12-15 status is now torndown due to DeploymentManager action