Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-glm-47-bobo-fmt-73905-v5-uploader
Waiting for job on chaiml-glm-47-bobo-fmt-73905-v5-uploader to finish
chaiml-glm-47-bobo-fmt-73905-v5-uploader: Using quantization_mode: fp8
chaiml-glm-47-bobo-fmt-73905-v5-uploader: Checking if ChaiML/glm_47_bobo_fmt_lr3x-step2498-merged-FP8 already exists in ChaiML
chaiml-glm-47-bobo-fmt-73905-v5-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-glm-47-bobo-fmt-73905-v5-uploader: Downloading snapshot of ChaiML/glm_47_bobo_fmt_lr3x-step2498-merged-FP8...
2026-03-26T17:20:42.688598+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
2026-03-26T17:21:42.775365+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
2026-03-26T17:22:42.870211+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
chaiml-glm-47-bobo-fmt-73905-v5-uploader: Downloaded in 165.636s
chaiml-glm-47-bobo-fmt-73905-v5-uploader: Processed model ChaiML/glm_47_bobo_fmt_lr3x-step2498-merged in 169.175s
chaiml-glm-47-bobo-fmt-73905-v5-uploader: creating bucket guanaco-vllm-models
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-47-bobo-fmt-73905-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-glm-47-bobo-fmt-73905-v5-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-47-bobo-fmt-73905-v5-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-47-bobo-fmt-73905-v5-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/.gitattributes
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/config.json
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/generation_config.json
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/chat_template.jinja
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/recipe.yaml
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model.safetensors.index.json
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/special_tokens_map.json
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/tokenizer_config.json
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/tokenizer.json
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00072-of-00072.safetensors
2026-03-26T17:23:42.972723+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00071-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00036-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00064-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00001-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00013-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00022-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00033-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00042-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00048-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00045-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00034-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00005-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00004-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00056-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00041-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00024-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00037-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00014-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00003-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00057-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00059-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00010-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00009-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00016-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00020-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00068-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00052-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00028-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00030-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00019-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00027-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00067-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00007-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00040-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00049-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00011-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00053-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00055-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00039-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00058-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00012-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00015-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00023-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00032-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00029-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00047-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00026-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00051-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00031-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00063-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00066-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00061-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00006-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00025-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00060-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00070-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00038-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00043-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00069-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00017-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00002-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00008-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00018-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00050-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00044-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00065-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00054-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00021-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00035-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00062-of-00072.safetensors
chaiml-glm-47-bobo-fmt-73905-v5-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-fmt-73905-v5/default/model-00046-of-00072.safetensors
2026-03-26T17:24:43.074311+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
Job chaiml-glm-47-bobo-fmt-73905-v5-uploader completed after 309.83s with status: succeeded
Stopping job with name chaiml-glm-47-bobo-fmt-73905-v5-uploader
Pipeline stage VLLMUploader completed in 310.53s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.98s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-glm-47-bobo-fmt-73905-v5
Waiting for inference service chaiml-glm-47-bobo-fmt-73905-v5 to be ready
2026-03-26T17:25:43.181355+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
2026-03-26T17:26:43.302366+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
2026-03-26T17:27:43.404039+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
2026-03-26T17:28:43.510618+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
2026-03-26T17:29:43.614944+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
2026-03-26T17:30:43.731419+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
Inference service chaiml-glm-47-bobo-fmt-73905-v5 ready after 361.7844042778015s
Pipeline stage VLLMDeployer completed in 362.23s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.283879041671753s
Received healthy response to inference request in 1.9814400672912598s
Received healthy response to inference request in 2.033444881439209s
Received healthy response to inference request in 2.3528270721435547s
Received healthy response to inference request in 2.059033155441284s
Received healthy response to inference request in 2.1104400157928467s
Received healthy response to inference request in 9.100368738174438s
Received healthy response to inference request in 2.0279040336608887s
Received healthy response to inference request in 2.131497621536255s
Received healthy response to inference request in 2.1844277381896973s
Received healthy response to inference request in 2.153761625289917s
Received healthy response to inference request in 2.22021484375s
Received healthy response to inference request in 2.0942182540893555s
Received healthy response to inference request in 2.106719493865967s
Received healthy response to inference request in 2.03725004196167s
Received healthy response to inference request in 2.1146180629730225s
Received healthy response to inference request in 2.088613748550415s
2026-03-26T17:31:52.093033+00:00 monitor updated for chaiml-glm-47-bobo-fmt-_73905_v5
Received healthy response to inference request in 2.0995466709136963s
Received healthy response to inference request in 2.0832223892211914s
Received healthy response to inference request in 2.0746994018554688s
Received healthy response to inference request in 9.2622549533844s
Received healthy response to inference request in 2.047952890396118s
Received healthy response to inference request in 2.0246517658233643s
Received healthy response to inference request in 2.19059681892395s
Received healthy response to inference request in 2.165619373321533s
Received healthy response to inference request in 2.2060186862945557s
Received healthy response to inference request in 2.1497957706451416s
Received healthy response to inference request in 2.384103536605835s
Received healthy response to inference request in 2.083813428878784s
Received healthy response to inference request in 2.2236948013305664s
30 requests
0 failed requests
5th percentile: 2.02611528635025
10th percentile: 2.032890796661377
20th percentile: 2.056817102432251
30th percentile: 2.0836361169815065
40th percentile: 2.09741530418396
50th percentile: 2.1125290393829346
60th percentile: 2.1513821125030517
70th percentile: 2.186278462409973
80th percentile: 2.220910835266113
90th percentile: 3.055730056762705
95th percentile: 9.189406156539917
99th percentile: 9.27760805606842
mean time: 2.835887630780538
Pipeline stage StressChecker completed in 90.32s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.73s
Shutdown handler de-registered
chaiml-glm-47-bobo-fmt-_73905_v5 status is now deployed due to DeploymentManager action
chaiml-glm-47-bobo-fmt-_73905_v5 status is now inactive due to auto deactivation removed underperforming models
chaiml-glm-47-bobo-fmt-_73905_v5 status is now torndown due to DeploymentManager action