Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-goodconvo-v1-dpo-90455-v6
Waiting for inference service chaiml-goodconvo-v1-dpo-90455-v6 to be ready
Inference service chaiml-goodconvo-v1-dpo-90455-v6 ready after 221.07034182548523s
Pipeline stage VLLMDeployer completed in 221.53s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0084545612335205s
Received healthy response to inference request in 2.0462052822113037s
Received healthy response to inference request in 1.9594652652740479s
Received healthy response to inference request in 1.863379716873169s
Received healthy response to inference request in 1.9448280334472656s
Received healthy response to inference request in 1.9227120876312256s
Received healthy response to inference request in 1.907822847366333s
Received healthy response to inference request in 1.894364356994629s
Received healthy response to inference request in 1.8783776760101318s
Received healthy response to inference request in 1.9355158805847168s
Received healthy response to inference request in 2.1179075241088867s
Received healthy response to inference request in 1.9124360084533691s
Received healthy response to inference request in 1.9247345924377441s
Received healthy response to inference request in 2.0799365043640137s
Received healthy response to inference request in 1.8732702732086182s
Received healthy response to inference request in 1.884993314743042s
Received healthy response to inference request in 1.9344589710235596s
Received healthy response to inference request in 1.8773279190063477s
Received healthy response to inference request in 1.8991479873657227s
Received healthy response to inference request in 1.8938193321228027s
Received healthy response to inference request in 1.8408756256103516s
Received healthy response to inference request in 1.9235789775848389s
Received healthy response to inference request in 2.086709499359131s
Received healthy response to inference request in 1.793781042098999s
Received healthy response to inference request in 1.884263038635254s
Received healthy response to inference request in 2.321920156478882s
Received healthy response to inference request in 1.8906786441802979s
Received healthy response to inference request in 1.951948642730713s
Received healthy response to inference request in 2.038074493408203s
Received healthy response to inference request in 2.0115411281585693s
30 requests
0 failed requests
5th percentile: 1.8510024666786193
10th percentile: 1.8722812175750732
20th percentile: 1.8830859661102295
30th percentile: 1.8928771257400512
40th percentile: 1.9043529033660889
50th percentile: 1.9231455326080322
60th percentile: 1.9348817348480225
70th percentile: 1.9542036294937133
80th percentile: 2.0168478012084963
90th percentile: 2.0806138038635256
95th percentile: 2.1038684129714964
99th percentile: 2.2627564930915836
mean time: 1.9500843127568563
Pipeline stage StressChecker completed in 60.80s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
Shutdown handler de-registered
chaiml-goodconvo-v1-dpo_90455_v6 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('None: None')
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 3569.44s
Shutdown handler de-registered
chaiml-goodconvo-v1-dpo_90455_v6 status is now torndown due to DeploymentManager action