Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.21s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv1-83165-v6
Waiting for inference service chaiml-kimid-v9-opusdv1-83165-v6 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Unable to record family friendly update due to error: Invalid JSON input: Expecting value: line 1 column 1 (char 0)
Inference service chaiml-kimid-v9-opusdv1-83165-v6 ready after 310.61059069633484s
Pipeline stage VLLMDeployer completed in 311.03s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8356144428253174s
Received healthy response to inference request in 1.8269948959350586s
Received healthy response to inference request in 1.7756695747375488s
Received healthy response to inference request in 1.8919291496276855s
Received healthy response to inference request in 1.7792024612426758s
Received healthy response to inference request in 2.004683256149292s
Received healthy response to inference request in 1.7124085426330566s
Received healthy response to inference request in 1.676478624343872s
Received healthy response to inference request in 1.7756617069244385s
Received healthy response to inference request in 2.2247633934020996s
Received healthy response to inference request in 2.1034467220306396s
Received healthy response to inference request in 2.0916991233825684s
Received healthy response to inference request in 1.8413715362548828s
Received healthy response to inference request in 2.0783770084381104s
Received healthy response to inference request in 2.0620718002319336s
Received healthy response to inference request in 2.0313549041748047s
Received healthy response to inference request in 1.6696956157684326s
Received healthy response to inference request in 2.0662758350372314s
Received healthy response to inference request in 2.168625831604004s
Received healthy response to inference request in 1.8861005306243896s
Received healthy response to inference request in 1.946793794631958s
Received healthy response to inference request in 1.8431930541992188s
Received healthy response to inference request in 2.0180437564849854s
Received healthy response to inference request in 1.8771145343780518s
Received healthy response to inference request in 1.854346752166748s
Received healthy response to inference request in 1.7516148090362549s
Received healthy response to inference request in 1.864576816558838s
Received healthy response to inference request in 2.077568531036377s
Received healthy response to inference request in 2.1534817218780518s
Received healthy response to inference request in 1.8346683979034424s
30 requests
0 failed requests
5th percentile: 1.6926470875740052
10th percentile: 1.747694182395935
20th percentile: 1.7784958839416505
30th percentile: 1.8353306293487548
40th percentile: 1.8498852729797364
50th percentile: 1.8816075325012207
60th percentile: 1.9699495792388915
70th percentile: 2.040569972991943
80th percentile: 2.0777302265167235
90th percentile: 2.108450222015381
95th percentile: 2.1618109822273253
99th percentile: 2.208483500480652
mean time: 1.9241275707880656
Pipeline stage StressChecker completed in 61.15s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
Shutdown handler de-registered
chaiml-kimid-v9-opusdv1_83165_v6 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 4695.96s
Shutdown handler de-registered
admin requested tearing down of chaiml-kimid-v9-opusdv1_83165_v6
Shutdown handler not registered because Python interpreter is not running in the main thread
Falling back to EndpointApi.from_submission implementation
run pipeline %s
Falling back to EndpointApi.from_submission implementation
run pipeline stage %s
Running pipeline stage VLLMDeleter
Checking if service chaiml-kimid-v9-opusdv1-83165-v6 is running
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Tearing down inference service chaiml-kimid-v9-opusdv1-83165-v6
Falling back to EndpointApi.from_submission implementation
Service chaiml-kimid-v9-opusdv1-83165-v6 has been torndown
Falling back to EndpointApi.from_submission implementation
Pipeline stage VLLMDeleter completed in 0.79s
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
run pipeline stage %s
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Running pipeline stage VLLMModelDeleter
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
Skipping deletion as no model was successfully uploaded
Falling back to EndpointApi.from_submission implementation
Pipeline stage VLLMModelDeleter completed in 0.43s
Shutdown handler de-registered
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation
chaiml-kimid-v9-opusdv1_83165_v6 status is now torndown due to DeploymentManager action
Falling back to EndpointApi.from_submission implementation
Falling back to EndpointApi.from_submission implementation