Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.37s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service qwen-qwen3-235b-a22b-i-47730-v11
Waiting for inference service qwen-qwen3-235b-a22b-i-47730-v11 to be ready
Inference service qwen-qwen3-235b-a22b-i-47730-v11 ready after 405.7528326511383s
Pipeline stage VLLMDeployer completed in 406.76s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6950881481170654s
Received healthy response to inference request in 2.441723108291626s
Received healthy response to inference request in 2.035120964050293s
Received healthy response to inference request in 2.508113384246826s
Received healthy response to inference request in 2.5596671104431152s
Received healthy response to inference request in 1.7056140899658203s
Received healthy response to inference request in 2.1368138790130615s
Received healthy response to inference request in 1.865126371383667s
Received healthy response to inference request in 2.393852472305298s
Received healthy response to inference request in 1.5870249271392822s
Received healthy response to inference request in 2.24458384513855s
Received healthy response to inference request in 2.4239401817321777s
Received healthy response to inference request in 2.538398504257202s
Received healthy response to inference request in 1.6140613555908203s
Received healthy response to inference request in 2.6025168895721436s
Received healthy response to inference request in 1.5767085552215576s
Received healthy response to inference request in 1.8371844291687012s
Received healthy response to inference request in 1.6958489418029785s
Received healthy response to inference request in 1.6893837451934814s
Received healthy response to inference request in 1.9910650253295898s
Received healthy response to inference request in 1.6412639617919922s
Received healthy response to inference request in 2.1317737102508545s
Received healthy response to inference request in 1.796518087387085s
Received healthy response to inference request in 1.7577102184295654s
Received healthy response to inference request in 1.8810310363769531s
Received healthy response to inference request in 2.0863571166992188s
Received healthy response to inference request in 2.9224138259887695s
Received healthy response to inference request in 1.7169606685638428s
Received healthy response to inference request in 2.0777571201324463s
Received healthy response to inference request in 1.8403241634368896s
30 requests
0 failed requests
5th percentile: 1.5991913199424743
10th percentile: 1.638543701171875
20th percentile: 1.703661060333252
30th percentile: 1.784875726699829
40th percentile: 1.855205488204956
50th percentile: 2.0130929946899414
60th percentile: 2.104523754119873
70th percentile: 2.289364433288574
80th percentile: 2.4550011634826663
90th percentile: 2.563952088356018
95th percentile: 2.6534310817718505
99th percentile: 2.8564893794059754
mean time: 2.0664648612340293
Pipeline stage StressChecker completed in 65.67s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.17s
Shutdown handler de-registered
qwen-qwen3-235b-a22b-i_47730_v11 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2400.97s
Shutdown handler de-registered
qwen-qwen3-235b-a22b-i_47730_v11 status is now inactive due to auto deactivation removed underperforming models
qwen-qwen3-235b-a22b-i_47730_v11 status is now torndown due to DeploymentManager action