zai-org-glm-4-6-fp8

developer_uid: chai_backend_admin
submission_id: zai-org-glm-4-6-fp8_v2
model_name: zai-org-glm-4-6-fp8_v2
model_group: zai-org/GLM-4.6-FP8
status: torndown
timestamp: 2026-03-02T16:58:51+00:00
num_battles: 11211
num_wins: 5663
celo_rating: 1299.3
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: zai-org/GLM-4.6-FP8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: zai-org-glm-4-6-fp8_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: zai-org/GLM-4.6-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-25
win_ratio: 0.5051288912675052
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '###', '</s>', '<|im_start|>', 'You:'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>\nRespond as a high quality storyteller.<|user|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name zai-org-glm-4-6-fp8-v2-uploader
Waiting for job on zai-org-glm-4-6-fp8-v2-uploader to finish
zai-org-glm-4-6-fp8-v2-uploader: Using quantization_mode: none
zai-org-glm-4-6-fp8-v2-uploader: Downloading snapshot of zai-org/GLM-4.6-FP8...
zai-org-glm-4-6-fp8-v2-uploader: Processed model zai-org/GLM-4.6-FP8 in 270.141s
zai-org-glm-4-6-fp8-v2-uploader: creating bucket guanaco-vllm-models
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-6-fp8-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
zai-org-glm-4-6-fp8-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-6-fp8-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-6-fp8-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-6-fp8-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
zai-org-glm-4-6-fp8-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
zai-org-glm-4-6-fp8-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
zai-org-glm-4-6-fp8-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
zai-org-glm-4-6-fp8-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
zai-org-glm-4-6-fp8-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
zai-org-glm-4-6-fp8-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/README.md
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/.gitattributes
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/config.json
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/generation_config.json
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/chat_template.jinja
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/tokenizer_config.json
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/tokenizer.json
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model.safetensors.index.json
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00003-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00003-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00002-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00002-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00001-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00001-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00036-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00036-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00030-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00030-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00015-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00015-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00090-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00090-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00091-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00091-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00050-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00050-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00047-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00047-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00060-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00060-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00073-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00073-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00007-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00007-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00069-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00069-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00051-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00051-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00024-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00024-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00061-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00061-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00032-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00032-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00046-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00046-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00085-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00085-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00068-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00068-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00034-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00034-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00041-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00041-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00022-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00022-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00019-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00019-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00038-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00038-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00074-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00074-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00006-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00006-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00064-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00064-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00080-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00080-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00079-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00079-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00021-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00021-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00017-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00017-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00025-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00025-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00027-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00027-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00033-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00033-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00067-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00067-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00052-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00052-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00011-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00011-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00083-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00083-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00054-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00054-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00065-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00065-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00071-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00071-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00066-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00066-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00063-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00063-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00082-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00082-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00010-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00010-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00035-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00035-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00087-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00087-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00031-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00031-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00045-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00045-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00077-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00077-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00081-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00081-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00020-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00020-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00075-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00075-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00039-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00039-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00059-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00059-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00089-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00089-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00009-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00009-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00013-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00013-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00023-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00023-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00037-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00037-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00048-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00048-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00044-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00044-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00016-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00016-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00076-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00076-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00058-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00058-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00004-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00004-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00056-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00056-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00062-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00062-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00057-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00057-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00078-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00078-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00005-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00005-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00026-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00026-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00043-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00043-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00012-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00012-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00084-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00084-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00042-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00042-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00070-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00070-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00086-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00086-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00088-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00088-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00028-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00028-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00018-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00018-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00040-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00040-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00049-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00049-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00029-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00029-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00053-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00053-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00072-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00072-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00008-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00008-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00014-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00014-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00055-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00055-of-00092.safetensors
zai-org-glm-4-6-fp8-v2-uploader: cp /dev/shm/model_output/model-00092-of-00092.safetensors s3://guanaco-vllm-models/zai-org-glm-4-6-fp8-v2/default/model-00092-of-00092.safetensors
Job zai-org-glm-4-6-fp8-v2-uploader completed after 438.8s with status: succeeded
Stopping job with name zai-org-glm-4-6-fp8-v2-uploader
Pipeline stage VLLMUploader completed in 440.06s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.31s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service zai-org-glm-4-6-fp8-v2
Waiting for inference service zai-org-glm-4-6-fp8-v2 to be ready
zai-org-glm-4-6-fp8_v2 status is now inactive due to auto deactivation removed underperforming models
zai-org-glm-4-6-fp8_v2 status is now torndown due to DeploymentManager action
Shutdown handler registered
run pipeline %s
Received signal 2, running shutdown handler
Received signal 2, running shutdown handler
Received signal 2, running shutdown handler
Received signal 2, running shutdown handler
Shutdown handler de-registered