zai-org-glm-5

submission_id: zai-org-glm-5_v2
developer_uid: chai_backend_admin
status: torndown
model_repo: zai-org/GLM-5
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-10T00:22:03+00:00
model_name: zai-org-glm-5_v2
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name zai-org-glm-5-v2-uploader
Waiting for job on zai-org-glm-5-v2-uploader to finish
zai-org-glm-5-v2-uploader: Using quantization_mode: fp8
2026-03-09T23:51:29.148720+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader: Checking if ChaiML/GLM-5-FP8 already exists in ChaiML
zai-org-glm-5-v2-uploader: Downloading snapshot of zai-org/GLM-5...
2026-03-09T23:52:29.399333+00:00 monitor updated for zai-org-glm-5_v2
2026-03-09T23:53:29.490691+00:00 monitor updated for zai-org-glm-5_v2
2026-03-09T23:54:29.580219+00:00 monitor updated for zai-org-glm-5_v2
2026-03-09T23:55:29.706860+00:00 monitor updated for zai-org-glm-5_v2
2026-03-09T23:56:36.538350+00:00 monitor updated for zai-org-glm-5_v2
2026-03-09T23:57:36.630757+00:00 monitor updated for zai-org-glm-5_v2
2026-03-09T23:58:36.725350+00:00 monitor updated for zai-org-glm-5_v2
2026-03-09T23:59:36.817037+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader: Downloaded in 496.885s
zai-org-glm-5-v2-uploader: Loading /tmp/model_input...
zai-org-glm-5-v2-uploader: Traceback (most recent call last):
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 269, in <module>
zai-org-glm-5-v2-uploader:     cli()
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1442, in __call__
zai-org-glm-5-v2-uploader:     return self.main(*args, **kwargs)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1363, in main
zai-org-glm-5-v2-uploader:     rv = self.invoke(ctx)
zai-org-glm-5-v2-uploader:          ^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1830, in invoke
zai-org-glm-5-v2-uploader:     return _process_result(sub_ctx.command.invoke(sub_ctx))
zai-org-glm-5-v2-uploader:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1226, in invoke
zai-org-glm-5-v2-uploader:     return ctx.invoke(self.callback, **ctx.params)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2026-03-10T00:00:36.898464+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 794, in invoke
zai-org-glm-5-v2-uploader:     return callback(*args, **kwargs)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 39, in process
zai-org-glm-5-v2-uploader:     quantize_fp8(repo_id, download_path, output_path, revision, hf_auth_token)
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 159, in quantize_fp8
zai-org-glm-5-v2-uploader:     tokenizer = AutoTokenizer.from_pretrained(input_path)
zai-org-glm-5-v2-uploader:                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/tokenization_auto.py", line 1153, in from_pretrained
zai-org-glm-5-v2-uploader:     raise ValueError(
zai-org-glm-5-v2-uploader: ValueError: Tokenizer class TokenizersBackend does not exist or is not currently imported.
Job zai-org-glm-5-v2-uploader completed after 618.19s with status: failed
Job failed zai-org-glm-5-v2-uploader: 
Stopping job with name zai-org-glm-5-v2-uploader
%s, retrying in %s seconds...
Starting job with name zai-org-glm-5-v2-uploader
Waiting for job on zai-org-glm-5-v2-uploader to finish
zai-org-glm-5-v2-uploader: Using quantization_mode: fp8
2026-03-10T00:01:37.169489+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader: Checking if ChaiML/GLM-5-FP8 already exists in ChaiML
zai-org-glm-5-v2-uploader: Downloading snapshot of zai-org/GLM-5...
2026-03-10T00:02:37.271534+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:03:37.429464+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:04:37.528896+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:05:37.616826+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:06:37.712749+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:07:37.807542+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:08:37.894690+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:09:37.984926+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader: Downloaded in 535.276s
zai-org-glm-5-v2-uploader: Loading /tmp/model_input...
zai-org-glm-5-v2-uploader: Traceback (most recent call last):
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 269, in <module>
zai-org-glm-5-v2-uploader:     cli()
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1442, in __call__
2026-03-10T00:10:38.073323+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader:     return self.main(*args, **kwargs)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1363, in main
zai-org-glm-5-v2-uploader:     rv = self.invoke(ctx)
zai-org-glm-5-v2-uploader:          ^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1830, in invoke
zai-org-glm-5-v2-uploader:     return _process_result(sub_ctx.command.invoke(sub_ctx))
zai-org-glm-5-v2-uploader:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1226, in invoke
zai-org-glm-5-v2-uploader:     return ctx.invoke(self.callback, **ctx.params)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 794, in invoke
zai-org-glm-5-v2-uploader:     return callback(*args, **kwargs)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 39, in process
zai-org-glm-5-v2-uploader:     quantize_fp8(repo_id, download_path, output_path, revision, hf_auth_token)
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 159, in quantize_fp8
zai-org-glm-5-v2-uploader:     tokenizer = AutoTokenizer.from_pretrained(input_path)
zai-org-glm-5-v2-uploader:                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/tokenization_auto.py", line 1153, in from_pretrained
zai-org-glm-5-v2-uploader:     raise ValueError(
zai-org-glm-5-v2-uploader: ValueError: Tokenizer class TokenizersBackend does not exist or is not currently imported.
Job zai-org-glm-5-v2-uploader completed after 625.19s with status: failed
Job failed zai-org-glm-5-v2-uploader: 
Stopping job with name zai-org-glm-5-v2-uploader
%s, retrying in %s seconds...
Starting job with name zai-org-glm-5-v2-uploader
Waiting for job on zai-org-glm-5-v2-uploader to finish
2026-03-10T00:11:42.702901+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader: Using quantization_mode: fp8
zai-org-glm-5-v2-uploader: Checking if ChaiML/GLM-5-FP8 already exists in ChaiML
zai-org-glm-5-v2-uploader: Downloading snapshot of zai-org/GLM-5...
2026-03-10T00:12:43.528771+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:13:44.010671+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:14:44.103152+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:15:44.198610+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:16:44.299566+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:17:44.393966+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:18:44.494056+00:00 monitor updated for zai-org-glm-5_v2
2026-03-10T00:19:44.594353+00:00 monitor updated for zai-org-glm-5_v2
zai-org-glm-5-v2-uploader: Downloaded in 486.219s
zai-org-glm-5-v2-uploader: Loading /tmp/model_input...
zai-org-glm-5-v2-uploader: Traceback (most recent call last):
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 269, in <module>
zai-org-glm-5-v2-uploader:     cli()
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1442, in __call__
zai-org-glm-5-v2-uploader:     return self.main(*args, **kwargs)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1363, in main
zai-org-glm-5-v2-uploader:     rv = self.invoke(ctx)
zai-org-glm-5-v2-uploader:          ^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1830, in invoke
zai-org-glm-5-v2-uploader:     return _process_result(sub_ctx.command.invoke(sub_ctx))
zai-org-glm-5-v2-uploader:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1226, in invoke
zai-org-glm-5-v2-uploader:     return ctx.invoke(self.callback, **ctx.params)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 794, in invoke
zai-org-glm-5-v2-uploader:     return callback(*args, **kwargs)
zai-org-glm-5-v2-uploader:            ^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 39, in process
zai-org-glm-5-v2-uploader:     quantize_fp8(repo_id, download_path, output_path, revision, hf_auth_token)
zai-org-glm-5-v2-uploader:   File "/code/uploading/compress.py", line 159, in quantize_fp8
zai-org-glm-5-v2-uploader:     tokenizer = AutoTokenizer.from_pretrained(input_path)
zai-org-glm-5-v2-uploader:                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
zai-org-glm-5-v2-uploader:   File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/tokenization_auto.py", line 1153, in from_pretrained
zai-org-glm-5-v2-uploader:     raise ValueError(
zai-org-glm-5-v2-uploader: ValueError: Tokenizer class TokenizersBackend does not exist or is not currently imported.
2026-03-10T00:20:44.685754+00:00 monitor updated for zai-org-glm-5_v2
Job zai-org-glm-5-v2-uploader completed after 575.52s with status: failed
Job failed zai-org-glm-5-v2-uploader: 
Stopping job with name zai-org-glm-5-v2-uploader
clean up pipeline due to error=VLLMUploaderError('')
run pipeline stage %s
Running pipeline stage VLLMDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage VLLMDeleter completed in 0.21s
run pipeline stage %s
Running pipeline stage VLLMModelDeleter
Cleaning model data from S3
Pipeline stage VLLMModelDeleter completed in 0.20s
Shutdown handler de-registered
zai-org-glm-5_v2 status is now failed due to DeploymentManager action
admin requested tearing down of zai-org-glm-5_v2
zai-org-glm-5_v2 status is now torndown due to DeploymentManager action