Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v10-noname-50547-v1
Waiting for inference service chaiml-kimid-v10-noname-50547-v1 to be ready
Inference service chaiml-kimid-v10-noname-50547-v1 ready after 492.31666231155396s
Pipeline stage VLLMDeployer completed in 492.81s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9798996448516846s
Received healthy response to inference request in 2.092679023742676s
Received healthy response to inference request in 1.7829670906066895s
Received healthy response to inference request in 1.8941810131072998s
Received healthy response to inference request in 1.7746682167053223s
Received healthy response to inference request in 1.696950912475586s
Received healthy response to inference request in 2.1723334789276123s
Received healthy response to inference request in 1.8030498027801514s
Received healthy response to inference request in 1.6859462261199951s
Received healthy response to inference request in 1.9523937702178955s
Received healthy response to inference request in 1.7759277820587158s
Received healthy response to inference request in 1.951293706893921s
Received healthy response to inference request in 2.0447845458984375s
Received healthy response to inference request in 2.0579702854156494s
Received healthy response to inference request in 2.35329008102417s
Received healthy response to inference request in 1.7168354988098145s
Received healthy response to inference request in 1.8257009983062744s
Received healthy response to inference request in 1.7407400608062744s
Received healthy response to inference request in 1.9123470783233643s
Received healthy response to inference request in 2.2048888206481934s
Received healthy response to inference request in 1.991926670074463s
Received healthy response to inference request in 1.7106821537017822s
Received healthy response to inference request in 1.7050292491912842s
Received healthy response to inference request in 1.9504163265228271s
Received healthy response to inference request in 1.8903956413269043s
Received healthy response to inference request in 1.9385545253753662s
Received healthy response to inference request in 1.9126434326171875s
Received healthy response to inference request in 1.9031765460968018s
Received healthy response to inference request in 1.7180304527282715s
Received healthy response to inference request in 1.7375564575195312s
30 requests
0 failed requests
5th percentile: 1.70058616399765
10th percentile: 1.7101168632507324
20th percentile: 1.7336512565612794
30th percentile: 1.7755499124526977
40th percentile: 1.8166405200958253
50th percentile: 1.8986787796020508
60th percentile: 1.923007869720459
70th percentile: 1.9516237258911133
80th percentile: 2.002498245239258
90th percentile: 2.1006444692611694
95th percentile: 2.190238916873932
99th percentile: 2.310253715515137
mean time: 1.8959086497624715
Pipeline stage StressChecker completed in 59.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
chaiml-kimid-v10-noname_50547_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2453.26s
Shutdown handler de-registered
chaiml-kimid-v10-noname_50547_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v10-noname_50547_v1 status is now torndown due to DeploymentManager action