Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-opusd-v2b-opusd-33883-v12
Waiting for inference service chaiml-opusd-v2b-opusd-33883-v12 to be ready
Inference service chaiml-opusd-v2b-opusd-33883-v12 ready after 946.1069309711456s
Pipeline stage VLLMDeployer completed in 946.65s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1609995365142822s
Received healthy response to inference request in 2.0831449031829834s
Received healthy response to inference request in 2.2000234127044678s
Received healthy response to inference request in 2.258627414703369s
Received healthy response to inference request in 2.1798925399780273s
Received healthy response to inference request in 2.4579904079437256s
Received healthy response to inference request in 1.856947898864746s
Received healthy response to inference request in 2.245835781097412s
Received healthy response to inference request in 2.0532138347625732s
Received healthy response to inference request in 1.9165830612182617s
Received healthy response to inference request in 2.0146431922912598s
Received healthy response to inference request in 2.7785327434539795s
Received healthy response to inference request in 2.1173861026763916s
Received healthy response to inference request in 2.375373125076294s
Received healthy response to inference request in 2.2956080436706543s
Received healthy response to inference request in 2.2216808795928955s
Received healthy response to inference request in 2.4603965282440186s
Received healthy response to inference request in 2.1262667179107666s
Received healthy response to inference request in 2.4802134037017822s
Received healthy response to inference request in 2.003697633743286s
Received healthy response to inference request in 1.945429801940918s
Received healthy response to inference request in 2.170727014541626s
Received healthy response to inference request in 2.3858325481414795s
Received healthy response to inference request in 2.049142599105835s
Received healthy response to inference request in 2.1505162715911865s
Received healthy response to inference request in 1.881185531616211s
Received healthy response to inference request in 2.4039666652679443s
Received healthy response to inference request in 2.085514783859253s
Received healthy response to inference request in 2.452880382537842s
Received healthy response to inference request in 2.530352830886841s
30 requests
0 failed requests
5th percentile: 1.8971144199371337
10th percentile: 1.9425451278686523
20th percentile: 2.04224271774292
30th percentile: 2.084803819656372
40th percentile: 2.1408164501190186
50th percentile: 2.1753097772598267
60th percentile: 2.231342840194702
70th percentile: 2.319537568092346
80th percentile: 2.413749408721924
90th percentile: 2.462378215789795
95th percentile: 2.5077900886535645
99th percentile: 2.7065605688095093
mean time: 2.211420186360677
Pipeline stage StressChecker completed in 68.48s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
chaiml-opusd-v2b-opusd_33883_v12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2949.97s
Shutdown handler de-registered
chaiml-opusd-v2b-opusd_33883_v12 status is now inactive due to auto deactivation removed underperforming models
chaiml-opusd-v2b-opusd_33883_v12 status is now torndown due to DeploymentManager action