Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7737972736358643s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.3497605323791504s
Received healthy response to inference request in 3.123990535736084s
Received healthy response to inference request in 4.598814487457275s
Received healthy response to inference request in 3.637106418609619s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 6.016602039337158s
Received healthy response to inference request in 5.0593342781066895s
Received healthy response to inference request in 3.4680778980255127s
Received healthy response to inference request in 9.93832278251648s
10 requests
1 failed requests
5th percentile: 2.9313842415809632
10th percentile: 3.088971209526062
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
20th percentile: 3.304606533050537
30th percentile: 3.432582688331604
40th percentile: 3.5694950103759764
50th percentile: 4.117960453033447
60th percentile: 4.783022403717041
70th percentile: 5.3465146064758295
80th percentile: 6.8009461879730235
90th percentile: 10.955967378616329
95th percentile: 15.535368061065663
99th percentile: 19.198888607025147
mean time: 6.208057498931884
%s, retrying in %s seconds...
Received healthy response to inference request in 12.504859924316406s
Received healthy response to inference request in 9.841683149337769s
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 5.996414661407471s
Received healthy response to inference request in 7.038724184036255s
Received healthy response to inference request in 6.117353916168213s
Received healthy response to inference request in 4.740399122238159s
Received healthy response to inference request in 4.388178586959839s
Received healthy response to inference request in 4.3408284187316895s
Received healthy response to inference request in 5.815346956253052s
Received healthy response to inference request in 5.829789400100708s
10 requests
0 failed requests
5th percentile: 4.3621359944343565
10th percentile: 4.383443570137024
20th percentile: 4.669955015182495
30th percentile: 5.4928626060485835
40th percentile: 5.824012422561646
50th percentile: 5.913102030754089
60th percentile: 6.044790363311767
70th percentile: 6.393764996528625
80th percentile: 7.599315977096558
90th percentile: 10.108000826835632
95th percentile: 11.306430375576017
99th percentile: 12.265174014568329
mean time: 6.661357831954956
Pipeline stage StressChecker completed in 132.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_tegim_2026-02-16 status is now deployed due to DeploymentManager action
function_tegim_2026-02-16 status is now inactive due to auto deactivation removed underperforming models
function_tegim_2026-02-16 status is now torndown due to DeploymentManager action