Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimidv-81429-v8-uploader
Waiting for job on chaiml-kimid-v8b-kimidv-81429-v8-uploader to finish
chaiml-kimid-v8b-kimidv-81429-v8-uploader: {repo_id} is already quantized
chaiml-kimid-v8b-kimidv-81429-v8-uploader: Using quantization_mode: none
chaiml-kimid-v8b-kimidv-81429-v8-uploader: Downloading snapshot of ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-FP8...
2026-04-02T15:31:11.366580+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:32:11.468668+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
chaiml-kimid-v8b-kimidv-81429-v8-uploader: Downloaded in 127.552s
2026-04-02T15:33:11.553221+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
chaiml-kimid-v8b-kimidv-81429-v8-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-FP8 in 212.257s
chaiml-kimid-v8b-kimidv-81429-v8-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kimid-v8b-kimidv-81429-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kimid-v8b-kimidv-81429-v8-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kimid-v8b-kimidv-81429-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v8b-kimidv-81429-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/recipe.yaml
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/generation_config.json
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/added_tokens.json
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/config.json
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/tokenizer_config.json
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/chat_template.jinja
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/merges.txt
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/special_tokens_map.json
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/.gitattributes
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model.safetensors.index.json
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/vocab.json
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/tokenizer.json
2026-04-02T15:34:11.635925+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00048-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00048-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00031-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00031-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00021-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00021-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00009-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00009-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00045-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00045-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00002-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00002-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00036-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00036-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00013-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00013-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00046-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00046-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00012-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00012-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00022-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00022-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00032-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00032-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00015-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00015-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00043-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00043-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00042-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00042-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00035-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00035-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00039-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00039-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00019-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00019-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00020-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00020-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00025-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00025-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00004-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00004-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00044-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00044-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00003-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00003-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00029-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00029-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00016-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00016-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00011-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00011-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00006-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00006-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00026-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00026-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00014-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00014-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00001-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00001-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00033-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00033-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00041-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00041-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00047-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00047-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00007-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00007-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00027-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00027-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00040-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00040-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00008-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00008-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00024-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00024-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00018-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00018-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00023-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00023-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00017-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00017-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00030-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00030-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00010-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00010-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00034-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00034-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00038-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00038-of-00048.safetensors
chaiml-kimid-v8b-kimidv-81429-v8-uploader: cp /dev/shm/model_output/model-00005-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-81429-v8/default/model-00005-of-00048.safetensors
Job chaiml-kimid-v8b-kimidv-81429-v8-uploader completed after 287.32s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimidv-81429-v8-uploader
Pipeline stage VLLMUploader completed in 287.80s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.13s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.69s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v8b-kimidv-81429-v8
Waiting for inference service chaiml-kimid-v8b-kimidv-81429-v8 to be ready
2026-04-02T15:35:11.729104+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:36:11.823837+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:37:11.924736+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:38:12.023761+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:39:12.144080+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:40:12.241806+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:41:12.333765+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:42:12.430620+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:43:12.524889+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:44:12.621950+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:45:12.717591+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:46:12.873432+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:47:12.994665+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:48:13.122163+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
Retrying (%r) after connection broken by '%r': %s
2026-04-02T15:49:13.222558+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:50:13.383084+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:51:13.504641+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:52:13.605423+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:53:13.708422+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:54:13.814149+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
2026-04-02T15:55:13.910869+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
Inference service chaiml-kimid-v8b-kimidv-81429-v8 ready after 1253.3090755939484s
Pipeline stage VLLMDeployer completed in 1253.94s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.810016393661499s
Received healthy response to inference request in 3.7977495193481445s
Received healthy response to inference request in 3.9080517292022705s
Received healthy response to inference request in 2.0885932445526123s
Received healthy response to inference request in 1.8164329528808594s
Received healthy response to inference request in 2.2267332077026367s
2026-04-02T15:56:14.038487+00:00 monitor updated for chaiml-kimid-v8b-kimidv_81429_v8
Received healthy response to inference request in 2.2031679153442383s
Received healthy response to inference request in 1.8425908088684082s
Received healthy response to inference request in 2.4595627784729004s
Received healthy response to inference request in 1.969057559967041s
Received healthy response to inference request in 1.8251128196716309s
Received healthy response to inference request in 1.8619630336761475s
Received healthy response to inference request in 1.8582162857055664s
Received healthy response to inference request in 1.8070271015167236s
Received healthy response to inference request in 1.8553283214569092s
Received healthy response to inference request in 3.9681057929992676s
Received healthy response to inference request in 1.9209253787994385s
Received healthy response to inference request in 1.805832862854004s
Received healthy response to inference request in 1.8657221794128418s
Received healthy response to inference request in 1.861126184463501s
Received healthy response to inference request in 1.8307099342346191s
Received healthy response to inference request in 2.0709238052368164s
Received healthy response to inference request in 2.6235296726226807s
Received healthy response to inference request in 1.9956324100494385s
Received healthy response to inference request in 2.0422635078430176s
Received healthy response to inference request in 1.8474481105804443s
Received healthy response to inference request in 2.5275003910064697s
Received healthy response to inference request in 1.969787359237671s
Received healthy response to inference request in 1.9227879047393799s
Received healthy response to inference request in 1.9241762161254883s
30 requests
0 failed requests
5th percentile: 1.8112597346305848
10th percentile: 1.8242448329925538
20th percentile: 1.8464766502380372
30th percentile: 1.8602532148361206
40th percentile: 1.8988440990448
50th percentile: 1.9466168880462646
60th percentile: 2.01428484916687
70th percentile: 2.1229656457901
80th percentile: 2.4731503009796145
90th percentile: 3.79897620677948
95th percentile: 3.863935828208923
99th percentile: 3.9506901144981383
mean time: 2.250202512741089
Pipeline stage StressChecker completed in 70.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.00s
Shutdown handler de-registered
chaiml-kimid-v8b-kimidv_81429_v8 status is now deployed due to DeploymentManager action
chaiml-kimid-v8b-kimidv_81429_v8 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v8b-kimidv_81429_v8 status is now torndown due to DeploymentManager action