Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v10-kimidv-35989-v1
Waiting for inference service chaiml-kimid-v10-kimidv-35989-v1 to be ready
Inference service chaiml-kimid-v10-kimidv-35989-v1 ready after 512.285395860672s
Pipeline stage VLLMDeployer completed in 512.83s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.877027988433838s
Received healthy response to inference request in 1.755507230758667s
Received healthy response to inference request in 1.912745714187622s
Received healthy response to inference request in 1.7784996032714844s
Received healthy response to inference request in 1.8361475467681885s
Received healthy response to inference request in 1.7495477199554443s
Received healthy response to inference request in 1.9754621982574463s
Received healthy response to inference request in 2.0755374431610107s
Received healthy response to inference request in 1.6712570190429688s
Received healthy response to inference request in 1.9842519760131836s
Received healthy response to inference request in 1.960700511932373s
Received healthy response to inference request in 2.103532314300537s
Received healthy response to inference request in 1.8919904232025146s
Received healthy response to inference request in 1.6771442890167236s
Received healthy response to inference request in 2.0645549297332764s
Received healthy response to inference request in 1.6736764907836914s
Received healthy response to inference request in 1.7109782695770264s
Received healthy response to inference request in 1.69746994972229s
Received healthy response to inference request in 1.9641435146331787s
Received healthy response to inference request in 1.9088099002838135s
Received healthy response to inference request in 1.8614609241485596s
Received healthy response to inference request in 1.7622361183166504s
Received healthy response to inference request in 1.9673733711242676s
Received healthy response to inference request in 1.8796699047088623s
Received healthy response to inference request in 1.6749584674835205s
Received healthy response to inference request in 1.8012092113494873s
Received healthy response to inference request in 1.8038625717163086s
Received healthy response to inference request in 1.9907732009887695s
Received healthy response to inference request in 1.88273024559021s
Received healthy response to inference request in 1.8519630432128906s
30 requests
0 failed requests
5th percentile: 1.6742533802986146
10th percentile: 1.6769257068634034
20th percentile: 1.7418338298797609
30th percentile: 1.7736205577850341
40th percentile: 1.8232335567474365
50th percentile: 1.8692444562911987
60th percentile: 1.8864343166351318
70th percentile: 1.9271321535110473
80th percentile: 1.9689911365509034
90th percentile: 1.9981513738632204
95th percentile: 2.07059531211853
99th percentile: 2.0954138016700745
mean time: 1.8581740697224935
Pipeline stage StressChecker completed in 58.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.96s
Shutdown handler de-registered
chaiml-kimid-v10-kimidv_35989_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2615.54s
Shutdown handler de-registered
chaiml-kimid-v10-kimidv_35989_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v10-kimidv_35989_v1 status is now torndown due to DeploymentManager action