Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-opusd-v2b-opusdv-33883-v2
Waiting for inference service chaiml-opusd-v2b-opusdv-33883-v2 to be ready
Inference service chaiml-opusd-v2b-opusdv-33883-v2 ready after 211.0896852016449s
Pipeline stage VLLMDeployer completed in 211.65s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.335493326187134s
Received healthy response to inference request in 1.9377129077911377s
Received healthy response to inference request in 1.6699230670928955s
Received healthy response to inference request in 1.7917745113372803s
Received healthy response to inference request in 1.927234411239624s
Received healthy response to inference request in 2.314692497253418s
Received healthy response to inference request in 1.9544239044189453s
Received healthy response to inference request in 1.8543050289154053s
Received healthy response to inference request in 1.6812539100646973s
Received healthy response to inference request in 1.977184534072876s
Received healthy response to inference request in 1.9552772045135498s
Received healthy response to inference request in 1.7341992855072021s
Received healthy response to inference request in 1.736938238143921s
Received healthy response to inference request in 1.8799011707305908s
Received healthy response to inference request in 1.6832287311553955s
Received healthy response to inference request in 1.8602945804595947s
Received healthy response to inference request in 2.019392251968384s
Received healthy response to inference request in 1.9376587867736816s
Received healthy response to inference request in 2.2733571529388428s
Received healthy response to inference request in 1.8466603755950928s
Received healthy response to inference request in 1.8744704723358154s
Received healthy response to inference request in 1.8002183437347412s
Received healthy response to inference request in 1.9174671173095703s
Received healthy response to inference request in 1.6595261096954346s
Received healthy response to inference request in 1.788435459136963s
Received healthy response to inference request in 1.7925055027008057s
Received healthy response to inference request in 1.7077715396881104s
Received healthy response to inference request in 1.7079365253448486s
Received healthy response to inference request in 1.6722238063812256s
Received healthy response to inference request in 1.8338072299957275s
30 requests
0 failed requests
5th percentile: 1.670958399772644
10th percentile: 1.68035089969635
20th percentile: 1.7079035282135009
30th percentile: 1.7729862928390503
40th percentile: 1.797133207321167
50th percentile: 1.850482702255249
60th percentile: 1.8766427516937256
70th percentile: 1.9303617238998412
80th percentile: 1.9545945644378662
90th percentile: 2.04478874206543
95th percentile: 2.296091592311859
99th percentile: 2.329461085796356
mean time: 1.8708422660827637
Pipeline stage StressChecker completed in 59.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
Shutdown handler de-registered
chaiml-opusd-v2b-opusdv_33883_v2 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2453.17s
Shutdown handler de-registered
chaiml-opusd-v2b-opusdv_33883_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-opusd-v2b-opusdv_33883_v2 status is now torndown due to DeploymentManager action