Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name zai-org-glm-4-5-air-v7-uploader
Waiting for job on zai-org-glm-4-5-air-v7-uploader to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-glm-air-4-5-sft-98673-v1-uploader
Waiting for job on chaiml-glm-air-4-5-sft-98673-v1-uploader to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-glm-air-4-5-sft-84865-v1-uploader
Waiting for job on chaiml-glm-air-4-5-sft-84865-v1-uploader to finish
zai-org-glm-4-5-air-v7-uploader: Using quantization_mode: none
zai-org-glm-4-5-air-v7-uploader: Downloading snapshot of zai-org/GLM-4.5-Air...
chaiml-glm-air-4-5-sft-98673-v1-uploader: Using quantization_mode: none
chaiml-glm-air-4-5-sft-98673-v1-uploader: Downloading snapshot of ChaiML/glm_air_4_5_sft_20260226_v2_e1...
chaiml-glm-air-4-5-sft-84865-v1-uploader: Using quantization_mode: none
chaiml-glm-air-4-5-sft-84865-v1-uploader: Downloading snapshot of ChaiML/glm_air_4_5_sft_20260226_v2_e2...
chaiml-glm-air-4-5-sft-98673-v1-uploader: Downloaded in 77.345s
chaiml-glm-air-4-5-sft-84865-v1-uploader: Downloaded in 74.317s
zai-org-glm-4-5-air-v7-uploader: Downloaded in 116.356s
chaiml-glm-air-4-5-sft-98673-v1-uploader: Processed model ChaiML/glm_air_4_5_sft_20260226_v2_e1 in 161.430s
chaiml-glm-air-4-5-sft-98673-v1-uploader: creating bucket guanaco-vllm-models
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-glm-air-4-5-sft-98673-v1-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-glm-air-4-5-sft-98673-v1-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-air-4-5-sft-98673-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-glm-air-4-5-sft-98673-v1-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-air-4-5-sft-98673-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-air-4-5-sft-98673-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/chat_template.jinja
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/README.md
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/.gitattributes
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model.safetensors.index.json
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/args.json
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/config.json
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/tokenizer.json
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/tokenizer_config.json
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/special_tokens_map.json
zai-org-glm-4-5-air-v7-uploader: Processed model zai-org/GLM-4.5-Air in 200.746s
zai-org-glm-4-5-air-v7-uploader: creating bucket guanaco-vllm-models
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-5-air-v7-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
zai-org-glm-4-5-air-v7-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-5-air-v7-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-5-air-v7-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-5-air-v7-uploader: if re.search("-\.", bucket, re.UNICODE):
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-5-air-v7-uploader: if re.search("\.\.", bucket, re.UNICODE):
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
zai-org-glm-4-5-air-v7-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
zai-org-glm-4-5-air-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
zai-org-glm-4-5-air-v7-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
zai-org-glm-4-5-air-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
zai-org-glm-4-5-air-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/chat_template.jinja
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/README.md
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/.gitattributes
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/generation_config.json
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/config.json
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/tokenizer_config.json
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/tokenizer.json
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model.safetensors.index.json
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00001-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00001-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00019-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00019-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00021-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00021-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00013-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00013-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00035-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00035-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00017-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00017-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00029-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00029-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00041-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00041-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00043-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00043-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00007-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00007-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00027-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00027-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00045-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00045-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00005-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00005-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00037-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00037-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00025-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00025-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00036-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00036-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00022-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00022-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00033-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00033-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00030-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00030-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00038-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00038-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00003-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00003-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00009-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00009-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00044-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00044-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00002-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00002-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00040-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00040-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00034-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00034-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00006-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00006-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00015-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00015-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00032-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00032-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00020-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00020-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00012-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00012-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00011-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00011-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00008-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00008-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00026-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00026-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00023-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00023-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00016-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00016-of-00047.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00047-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00047-of-00047.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00019-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00006-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00034-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00040-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00014-of-00043.safetensors
zai-org-glm-4-5-air-v7-uploader: cp /dev/shm/model_output/model-00046-of-00047.safetensors s3://guanaco-vllm-models/zai-org-glm-4-5-air-v7/default/model-00046-of-00047.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00013-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00015-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00035-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00029-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00037-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00036-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00021-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00025-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00008-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00011-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00009-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00024-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00041-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00032-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00020-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00012-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00018-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00030-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00010-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00016-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00038-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00007-of-00043.safetensors
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00017-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: Processed model ChaiML/glm_air_4_5_sft_20260226_v2_e2 in 274.720s
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00031-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: creating bucket guanaco-vllm-models
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00033-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00003-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00028-of-00043.safetensors
Job zai-org-glm-4-5-air-v7-uploader completed after 296.42s with status: succeeded
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00001-of-00043.safetensors
Stopping job with name zai-org-glm-4-5-air-v7-uploader
chaiml-glm-air-4-5-sft-84865-v1-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00004-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
Pipeline stage VLLMUploader completed in 299.02s
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00022-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
run pipeline stage %s
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00023-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
Running pipeline stage VLLMTemplater
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00042-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00002-of-00043.safetensors
Pipeline stage VLLMTemplater completed in 0.62s
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00005-of-00043.safetensors
run pipeline stage %s
chaiml-glm-air-4-5-sft-84865-v1-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00027-of-00043.safetensors
Running pipeline stage VLLMDeployer
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-98673-v1-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-98673-v1/default/model-00026-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
Creating inference service zai-org-glm-4-5-air-v7
chaiml-glm-air-4-5-sft-84865-v1-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-air-4-5-sft-84865-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
Waiting for inference service zai-org-glm-4-5-air-v7 to be ready
chaiml-glm-air-4-5-sft-84865-v1-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-air-4-5-sft-84865-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-air-4-5-sft-84865-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/README.md
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/chat_template.jinja
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/config.json
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/tokenizer_config.json
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/args.json
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/.gitattributes
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model.safetensors.index.json
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/special_tokens_map.json
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/tokenizer.json
Job chaiml-glm-air-4-5-sft-98673-v1-uploader completed after 307.77s with status: succeeded
Stopping job with name chaiml-glm-air-4-5-sft-98673-v1-uploader
Pipeline stage VLLMUploader completed in 310.04s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.77s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-glm-air-4-5-sft-98673-v1
Waiting for inference service chaiml-glm-air-4-5-sft-98673-v1 to be ready
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00043-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00034-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00036-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00004-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00008-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00002-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00006-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00032-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00031-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00010-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00039-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00040-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00029-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00015-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00012-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00028-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00021-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00023-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00009-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00005-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00030-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00019-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00011-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00001-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00026-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00017-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00027-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00041-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00020-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00007-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00018-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00035-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00038-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00016-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00022-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00037-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00025-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00042-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00003-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00013-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00024-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00014-of-00043.safetensors
chaiml-glm-air-4-5-sft-84865-v1-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-84865-v1/default/model-00033-of-00043.safetensors
Job chaiml-glm-air-4-5-sft-84865-v1-uploader completed after 413.07s with status: succeeded
Stopping job with name chaiml-glm-air-4-5-sft-84865-v1-uploader
Pipeline stage VLLMUploader completed in 417.28s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.60s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-glm-air-4-5-sft-84865-v1
Waiting for inference service chaiml-glm-air-4-5-sft-84865-v1 to be ready
Inference service chaiml-glm-air-4-5-sft-98673-v1 ready after 640.4058511257172s
Pipeline stage VLLMDeployer completed in 642.62s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8982467651367188s
Received healthy response to inference request in 2.3278636932373047s
Received healthy response to inference request in 2.3779304027557373s
Received healthy response to inference request in 2.065176486968994s
Received healthy response to inference request in 2.433896064758301s
Received healthy response to inference request in 12.960428237915039s
Received healthy response to inference request in 2.828817129135132s
Received healthy response to inference request in 2.3573195934295654s
Received healthy response to inference request in 2.197435140609741s
Received healthy response to inference request in 2.1420061588287354s
Inference service zai-org-glm-4-5-air-v7 ready after 699.6179208755493s
Pipeline stage VLLMDeployer completed in 702.55s
run pipeline stage %s
Received healthy response to inference request in 2.233854055404663s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1445868015289307s
Received healthy response to inference request in 2.453554630279541s
Received healthy response to inference request in 2.327357053756714s
Received healthy response to inference request in 2.445692300796509s
Received healthy response to inference request in 2.3791022300720215s
Received healthy response to inference request in 2.3010287284851074s
Received healthy response to inference request in 2.0992374420166016s
Received healthy response to inference request in 2.2056639194488525s
Received healthy response to inference request in 2.123333215713501s
Received healthy response to inference request in 2.1903018951416016s
Received healthy response to inference request in 2.2375314235687256s
Received healthy response to inference request in 2.0795013904571533s
Received healthy response to inference request in 2.942201614379883s
Received healthy response to inference request in 3.0042922496795654s
Received healthy response to inference request in 2.1029367446899414s
Received healthy response to inference request in 2.2868881225585938s
Received healthy response to inference request in 2.079190731048584s
Received healthy response to inference request in 2.093310832977295s
Received healthy response to inference request in 2.1271700859069824s
Received healthy response to inference request in 2.9237380027770996s
Received healthy response to inference request in 2.533402681350708s
Received healthy response to inference request in 2.120051383972168s
Received healthy response to inference request in 2.1888866424560547s
Received healthy response to inference request in 2.1922903060913086s
Inference service chaiml-glm-air-4-5-sft-84865-v1 ready after 610.75821352005s
Pipeline stage VLLMDeployer completed in 613.28s
Received healthy response to inference request in 2.2062127590179443s
Received healthy response to inference request in 2.1297707557678223s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2354602813720703s
Received healthy response to inference request in 2.141880750656128s
Received healthy response to inference request in 2.244415283203125s
Received healthy response to inference request in 2.1212499141693115s
Received healthy response to inference request in 2.2189667224884033s
Received healthy response to inference request in 3.1408300399780273s
Received healthy response to inference request in 2.1074397563934326s
Received healthy response to inference request in 2.1145994663238525s
Received healthy response to inference request in 2.2008216381073s
Received healthy response to inference request in 2.224194049835205s
Received healthy response to inference request in 2.2292275428771973s
Received healthy response to inference request in 2.083425521850586s
Received healthy response to inference request in 2.1709980964660645s
Received healthy response to inference request in 2.0581841468811035s
Received healthy response to inference request in 2.522071123123169s
Received healthy response to inference request in 2.1622846126556396s
Received healthy response to inference request in 2.381683826446533s
30 requests
Received healthy response to inference request in 2.0913732051849365s
0 failed requests
5th percentile: 2.088211750984192
10th percentile: 2.1025668144226075
Received healthy response to inference request in 2.05635142326355s
20th percentile: 2.122916555404663
30th percentile: 2.1438126087188722
Received healthy response to inference request in 2.1566269397735596s
40th percentile: 2.1940157413482666
50th percentile: 2.229024052619934
60th percentile: 2.273461675643921
Received healthy response to inference request in 2.1647231578826904s
70th percentile: 2.363502836227417
80th percentile: 2.392126274108887
90th percentile: 2.8357600927352906
95th percentile: 2.922421932220459
Received healthy response to inference request in 2.8171002864837646s
99th percentile: 10.055142517089852
mean time: 2.6518383026123047
Received healthy response to inference request in 2.197093963623047s
Pipeline stage StressChecker completed in 107.91s
run pipeline stage %s
Received healthy response to inference request in 2.2013919353485107s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Received healthy response to inference request in 2.1748740673065186s
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 2.118535041809082s
Received healthy response to inference request in 2.3481922149658203s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.16s
Shutdown handler de-registered
chaiml-glm-air-4-5-sft-_98673_v1 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 2.214276075363159s
Received healthy response to inference request in 2.137171506881714s
Received healthy response to inference request in 2.11722731590271s
Received healthy response to inference request in 2.144050359725952s
Received healthy response to inference request in 2.4535346031188965s
Received healthy response to inference request in 2.0635509490966797s
Received healthy response to inference request in 2.118577003479004s
Received healthy response to inference request in 2.536357879638672s
Received healthy response to inference request in 2.4600136280059814s
Received healthy response to inference request in 2.1780691146850586s
Received healthy response to inference request in 2.1348235607147217s
Received healthy response to inference request in 2.147071599960327s
30 requests
0 failed requests
5th percentile: 2.060599207878113
10th percentile: 2.077906346321106
20th percentile: 2.118961000442505
Received healthy response to inference request in 2.3334226608276367s
30th percentile: 2.140467977523804
40th percentile: 2.156199407577515
50th percentile: 2.1764715909957886
60th percentile: 2.1942117691040037
Received healthy response to inference request in 2.129385232925415s
70th percentile: 2.2220449686050414
80th percentile: 2.3104614257812504
90th percentile: 2.4618349552154544
95th percentile: 2.7494169473648062
99th percentile: 2.9809315180778504
mean time: 2.249957799911499
Pipeline stage StressChecker completed in 98.21s
run pipeline stage %s
Received healthy response to inference request in 2.702288866043091s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.37s
Received healthy response to inference request in 2.2689313888549805s
Shutdown handler de-registered
zai-org-glm-4-5-air_v7 status is now deployed due to DeploymentManager action
zai-org-glm-4-5-air_v7 status is now inactive due to auto deactivation removed underperforming models
zai-org-glm-4-5-air_v7 status is now torndown due to DeploymentManager action