Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3610851764678955s
Received healthy response to inference request in 5.230152130126953s
Received healthy response to inference request in 2.101064920425415s
Received healthy response to inference request in 4.674656629562378s
Received healthy response to inference request in 5.141652822494507s
Received healthy response to inference request in 3.363508462905884s
Received healthy response to inference request in 2.735401153564453s
Failed to get response for submission qwen-qwen2-5-7b-instruct_v17: ('http://qwen-qwen2-5-7b-instruct-v17-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/completions', 'activator request timeout')
Received healthy response to inference request in 6.499531030654907s
Received healthy response to inference request in 3.176616668701172s
Received healthy response to inference request in 4.9324140548706055s
10 requests
0 failed requests
5th percentile: 2.2180740356445314
10th percentile: 2.3350831508636474
20th percentile: 2.6605379581451416
30th percentile: 3.0442520141601563
40th percentile: 3.288751745223999
50th percentile: 4.019082546234131
60th percentile: 4.777759599685669
70th percentile: 4.995185685157776
80th percentile: 5.1593526840209964
90th percentile: 5.357090020179748
95th percentile: 5.928310525417326
99th percentile: 6.385286929607392
mean time: 4.021608304977417
Pipeline stage StressChecker completed in 41.91s
Shutdown handler de-registered
function_jijen_2026-04-16 status is now deployed due to DeploymentManager action