Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv1-83165-v2
Waiting for inference service chaiml-kimid-v9-opusdv1-83165-v2 to be ready
Inference service chaiml-kimid-v9-opusdv1-83165-v2 ready after 461.19635128974915s
Pipeline stage VLLMDeployer completed in 461.96s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.7677850723266602s
Received healthy response to inference request in 1.7777247428894043s
Received healthy response to inference request in 1.8648285865783691s
Received healthy response to inference request in 1.8141825199127197s
Received healthy response to inference request in 1.7756028175354004s
Received healthy response to inference request in 1.6883084774017334s
Received healthy response to inference request in 1.896613359451294s
Received healthy response to inference request in 1.7898480892181396s
Received healthy response to inference request in 1.7783222198486328s
Received healthy response to inference request in 2.316157102584839s
Received healthy response to inference request in 1.720263957977295s
Received healthy response to inference request in 2.0355918407440186s
Received healthy response to inference request in 1.9220685958862305s
Received healthy response to inference request in 2.0018444061279297s
Received healthy response to inference request in 1.9641523361206055s
Received healthy response to inference request in 1.6510286331176758s
Received healthy response to inference request in 2.0198657512664795s
Received healthy response to inference request in 2.130880117416382s
Received healthy response to inference request in 1.9603991508483887s
Received healthy response to inference request in 1.983269214630127s
Received healthy response to inference request in 1.705308198928833s
Received healthy response to inference request in 1.695582389831543s
Received healthy response to inference request in 1.6910786628723145s
Received healthy response to inference request in 2.1943860054016113s
Received healthy response to inference request in 1.8203105926513672s
Received healthy response to inference request in 1.7778568267822266s
Received healthy response to inference request in 1.6988484859466553s
Received healthy response to inference request in 1.7143309116363525s
Received healthy response to inference request in 1.6705522537231445s
Received healthy response to inference request in 1.7474162578582764s
30 requests
0 failed requests
5th percentile: 1.6785425543785095
10th percentile: 1.6908016443252563
20th percentile: 1.7040162563323975
30th percentile: 1.739270567893982
40th percentile: 1.7768759727478027
50th percentile: 1.7840851545333862
60th percentile: 1.838117790222168
70th percentile: 1.933567762374878
80th percentile: 1.9869842529296875
90th percentile: 2.045120668411255
95th percentile: 2.1658083558082577
99th percentile: 2.280843484401703
mean time: 1.8524802525838215
Pipeline stage StressChecker completed in 58.34s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
chaiml-kimid-v9-opusdv1_83165_v2 status is now deployed due to DeploymentManager action
chaiml-kimid-v9-opusdv1_83165_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v9-opusdv1_83165_v2 status is now protected due to ABTestQueueItem
chaiml-kimid-v9-opusdv1_83165_v2 status is now protected due to ABTestQueueItem