developer_uid: chai_backend_admin
submission_id: chaiml-glm-47-bobo-v1-s_81799_v4
model_name: chaiml-glm-47-bobo-v1-s_81799_v4
model_group: ChaiML/glm_47_bobo_v1-st
status: inactive
timestamp: 2026-03-27T11:18:07+00:00
num_battles: 12044
num_wins: 6991
celo_rating: 1346.46
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/glm_47_bobo_v1-step2498-merged
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1600
max_output_tokens: 80
reward_model: default
display_name: chaiml-glm-47-bobo-v1-s_81799_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/glm_47_bobo_v1-step2498-merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-27
win_ratio: 0.5804549983394222
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|im_start|>', '<|im_end|>', '###', 'You:'], 'max_input_tokens': 1600, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>Respond as a high quality storyteller.<|user|>', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|></think>{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-glm-47-bobo-v1-s-81799-v4-uploader
Waiting for job on chaiml-glm-47-bobo-v1-s-81799-v4-uploader to finish
2026-03-27T09:02:33.445677+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
chaiml-gspo-glm47-cas72-44480-v2-uploader:                              







chaiml-gspo-glm47-cas72-44480-v2-uploader: ---------- 2026-03-27 09:03:04 (0:02:00) ----------
chaiml-gspo-glm47-cas72-44480-v2-uploader: Files:   hashed 45/45 (197.4G/197.4G) | pre-uploaded: 40/40 (197.4G/197.4G) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-gspo-glm47-cas72-44480-v2-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 0 | committing: 1 | waiting: 63
chaiml-gspo-glm47-cas72-44480-v2-uploader: ---------------------------------------------------
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Checking if ChaiML/glm_47_bobo_v1-step2498-merged-W4A16 already exists in ChaiML
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Downloading snapshot of ChaiML/glm_47_bobo_v1-step2498-merged...
2026-03-27T09:03:24.720954+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:03:33.764481+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
chaiml-gspo-glm47-cas72-44480-v2-uploader:                              Processed model ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step500 in 1829.414s
chaiml-gspo-glm47-cas72-44480-v2-uploader: creating bucket guanaco-vllm-models
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-gspo-glm47-cas72-44480-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-gspo-glm47-cas72-44480-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-gspo-glm47-cas72-44480-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gspo-glm47-cas72-44480-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/config.json
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/generation_config.json
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/tokenizer_config.json
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/quantization_config.json
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/chat_template.jinja
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model.safetensors.index.json
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/tokenizer.json
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00038-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00038-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00037-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00037-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00036-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00036-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00011-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00011-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00007-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00007-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00010-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00010-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00006-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00006-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00034-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00034-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00027-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00027-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00001-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00001-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00026-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00026-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00013-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00013-of-00038.safetensors
2026-03-27T09:04:25.046901+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00032-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00032-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00018-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00018-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00023-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00023-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00015-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00015-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00005-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00005-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00014-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00014-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00003-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00003-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00020-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00020-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00012-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00012-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00024-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00024-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00030-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00030-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00021-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00021-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00017-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00017-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00019-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00019-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00022-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00022-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00004-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00004-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00028-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00028-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00035-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00035-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00009-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00009-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00016-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00016-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00008-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00008-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00033-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00033-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00025-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00025-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00002-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00002-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00031-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00031-of-00038.safetensors
chaiml-gspo-glm47-cas72-44480-v2-uploader: cp /dev/shm/model_output/model-00029-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-cas72-44480-v2/default/model-00029-of-00038.safetensors
2026-03-27T09:04:34.112572+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
Job chaiml-gspo-glm47-cas72-44480-v2-uploader completed after 1937.91s with status: succeeded
Stopping job with name chaiml-gspo-glm47-cas72-44480-v2-uploader
Pipeline stage VLLMUploader completed in 1939.74s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.47s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.12s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gspo-glm47-cas72-44480-v2
Waiting for inference service chaiml-gspo-glm47-cas72-44480-v2 to be ready
2026-03-27T09:05:25.666087+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:05:34.498722+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
2026-03-27T09:06:25.985508+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:06:34.862914+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
2026-03-27T09:07:26.343753+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Downloaded in 250.210s
2026-03-27T09:07:35.241072+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
2026-03-27T09:08:26.716014+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:08:35.622514+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
Inference service chaiml-gspo-glm47-cas72-44480-v2 ready after 272.91880679130554s
Pipeline stage VLLMDeployer completed in 274.71s
run pipeline stage %s
Running pipeline stage StressChecker
2026-03-27T09:09:27.187995+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
Received healthy response to inference request in 8.637159824371338s
2026-03-27T09:09:36.000117+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
Received healthy response to inference request in 9.028732776641846s
Received healthy response to inference request in 2.433098554611206s
Received healthy response to inference request in 2.089993476867676s
Received healthy response to inference request in 9.254623889923096s
Received healthy response to inference request in 2.350205898284912s
Received healthy response to inference request in 2.3044228553771973s
Received healthy response to inference request in 8.839781999588013s
Received healthy response to inference request in 2.1314573287963867s
Received healthy response to inference request in 2.3130152225494385s
Received healthy response to inference request in 2.1179702281951904s
Received healthy response to inference request in 2.1941018104553223s
Received healthy response to inference request in 2.717045783996582s
Received healthy response to inference request in 2.1322731971740723s
Received healthy response to inference request in 2.0935580730438232s
Received healthy response to inference request in 2.1006979942321777s
2026-03-27T09:10:36.392302+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v2
2026-03-27T09:10:27.595065+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
Received healthy response to inference request in 2.1885313987731934s
Received healthy response to inference request in 2.285914182662964s
Received healthy response to inference request in 2.607898235321045s
Received healthy response to inference request in 2.1671738624572754s
Received healthy response to inference request in 2.2119898796081543s
Received healthy response to inference request in 2.214454412460327s
Received healthy response to inference request in 2.429957151412964s
Received healthy response to inference request in 2.2102766036987305s
Received healthy response to inference request in 2.207002878189087s
Received healthy response to inference request in 2.302797555923462s
Received healthy response to inference request in 2.1994123458862305s
Received healthy response to inference request in 2.0917775630950928s
Received healthy response to inference request in 2.1471688747406006s
Received healthy response to inference request in 2.1244988441467285s
30 requests
0 failed requests
5th percentile: 2.0925787925720214
10th percentile: 2.0999840021133425
20th percentile: 2.1300656318664553
30th percentile: 2.161172366142273
40th percentile: 2.1972881317138673
50th percentile: 2.2111332416534424
60th percentile: 2.292667531967163
70th percentile: 2.3241724252700804
80th percentile: 2.468058490753174
90th percentile: 8.657422041893005
95th percentile: 8.94370492696762
99th percentile: 9.189115467071533
mean time: 3.137566423416138
Pipeline stage StressChecker completed in 118.42s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.89s
Shutdown handler de-registered
chaiml-gspo-glm47-cas72_44480_v2 status is now deployed due to DeploymentManager action
2026-03-27T09:11:40.140312+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Applying quantization...
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:12:19 INFO __init__.py L202: Patched transformers.models.glm4_moe.modeling_glm4_moe.Glm4MoeMoE -> auto_round.modeling.unfused_moe.glm_moe.LinearGlm4MoeMoE
2026-03-27T09:12:40.354203+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:12:57 INFO base.py L486: using torch.bfloat16 for quantization tuning
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:13:16 INFO device.py L1468:  'peak_ram': 11.81GB, 'peak_vram': 1.44GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:13:30 INFO device.py L1468:  'peak_ram': 16.31GB, 'peak_vram': 1.59GB
2026-03-27T09:13:40.558568+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:13:46 INFO device.py L1468:  'peak_ram': 16.85GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:13:58 INFO device.py L1468:  'peak_ram': 19.26GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:14:16 INFO device.py L1468:  'peak_ram': 19.69GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:14:30 INFO device.py L1468:  'peak_ram': 22.11GB, 'peak_vram': 1.59GB
2026-03-27T09:14:40.782535+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:14:45 INFO device.py L1468:  'peak_ram': 22.11GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:15:02 INFO device.py L1468:  'peak_ram': 22.49GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:15:14 INFO device.py L1468:  'peak_ram': 22.49GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:15:32 INFO device.py L1468:  'peak_ram': 23.27GB, 'peak_vram': 1.59GB
2026-03-27T09:15:41.000565+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:15:44 INFO device.py L1468:  'peak_ram': 23.27GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:15:59 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:16:18 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:16:33 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
2026-03-27T09:16:41.218799+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:16:48 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:17:05 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:17:17 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:17:28 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
2026-03-27T09:17:41.435801+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:17:34 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:17:40 INFO device.py L1468:  'peak_ram': 23.46GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:17:49 INFO device.py L1468:  'peak_ram': 23.48GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:17:55 INFO device.py L1468:  'peak_ram': 23.48GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:18:10 INFO device.py L1468:  'peak_ram': 24.31GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:18:16 INFO device.py L1468:  'peak_ram': 24.76GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:18:31 INFO device.py L1468:  'peak_ram': 25.74GB, 'peak_vram': 1.59GB
2026-03-27T09:18:41.638016+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:18:37 INFO device.py L1468:  'peak_ram': 25.74GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:18:45 INFO device.py L1468:  'peak_ram': 26.35GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:18:51 INFO device.py L1468:  'peak_ram': 26.35GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:00 INFO device.py L1468:  'peak_ram': 27.28GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:05 INFO device.py L1468:  'peak_ram': 27.28GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:11 INFO device.py L1468:  'peak_ram': 27.28GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:19 INFO device.py L1468:  'peak_ram': 27.28GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:24 INFO device.py L1468:  'peak_ram': 27.28GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:30 INFO device.py L1468:  'peak_ram': 27.28GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:38 INFO device.py L1468:  'peak_ram': 27.28GB, 'peak_vram': 1.59GB
2026-03-27T09:19:41.867027+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:44 INFO device.py L1468:  'peak_ram': 27.51GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:19:56 INFO device.py L1468:  'peak_ram': 27.51GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:20:07 INFO device.py L1468:  'peak_ram': 28.38GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:20:18 INFO device.py L1468:  'peak_ram': 28.38GB, 'peak_vram': 1.59GB
2026-03-27T09:20:42.089455+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:20:43 INFO device.py L1468:  'peak_ram': 29.54GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:20:56 INFO device.py L1468:  'peak_ram': 30.37GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:21:08 INFO device.py L1468:  'peak_ram': 30.37GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:21:18 INFO device.py L1468:  'peak_ram': 30.75GB, 'peak_vram': 1.59GB
2026-03-27T09:21:42.385172+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:21:35 INFO device.py L1468:  'peak_ram': 30.75GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:21:49 INFO device.py L1468:  'peak_ram': 31.85GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:22:04 INFO device.py L1468:  'peak_ram': 31.85GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:22:20 INFO device.py L1468:  'peak_ram': 32.67GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:22:33 INFO device.py L1468:  'peak_ram': 32.67GB, 'peak_vram': 1.59GB
2026-03-27T09:22:42.890284+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:22:51 INFO device.py L1468:  'peak_ram': 32.67GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:23:06 INFO device.py L1468:  'peak_ram': 32.67GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:23:20 INFO device.py L1468:  'peak_ram': 32.67GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:23:38 INFO device.py L1468:  'peak_ram': 32.83GB, 'peak_vram': 1.59GB
2026-03-27T09:23:43.095633+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:23:51 INFO device.py L1468:  'peak_ram': 32.83GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:24:10 INFO device.py L1468:  'peak_ram': 33.91GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:24:24 INFO device.py L1468:  'peak_ram': 33.91GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:24:38 INFO device.py L1468:  'peak_ram': 34.28GB, 'peak_vram': 1.59GB
2026-03-27T09:24:43.309583+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:24:57 INFO device.py L1468:  'peak_ram': 34.28GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:25:11 INFO device.py L1468:  'peak_ram': 34.99GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:25:24 INFO device.py L1468:  'peak_ram': 34.99GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:25:39 INFO device.py L1468:  'peak_ram': 36.02GB, 'peak_vram': 1.59GB
2026-03-27T09:25:43.529495+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:25:50 INFO device.py L1468:  'peak_ram': 36.02GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:26:06 INFO device.py L1468:  'peak_ram': 37.09GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:26:22 INFO device.py L1468:  'peak_ram': 37.09GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:26:32 INFO device.py L1468:  'peak_ram': 37.64GB, 'peak_vram': 1.59GB
2026-03-27T09:26:43.854393+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:26:44 INFO device.py L1468:  'peak_ram': 37.64GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:26:59 INFO device.py L1468:  'peak_ram': 38.44GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:27:17 INFO device.py L1468:  'peak_ram': 38.44GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:27:30 INFO device.py L1468:  'peak_ram': 38.44GB, 'peak_vram': 1.59GB
2026-03-27T09:27:44.077370+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:27:43 INFO device.py L1468:  'peak_ram': 38.44GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:27:59 INFO device.py L1468:  'peak_ram': 38.44GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:28:13 INFO device.py L1468:  'peak_ram': 38.6GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:28:27 INFO device.py L1468:  'peak_ram': 38.6GB, 'peak_vram': 1.59GB
2026-03-27T09:28:44.285539+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:28:47 INFO device.py L1468:  'peak_ram': 39.98GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:29:03 INFO device.py L1468:  'peak_ram': 39.98GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:29:25 INFO device.py L1468:  'peak_ram': 41.04GB, 'peak_vram': 1.59GB
2026-03-27T09:29:44.575801+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:29:44 INFO device.py L1468:  'peak_ram': 41.04GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:29:59 INFO device.py L1468:  'peak_ram': 41.49GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:07 INFO device.py L1468:  'peak_ram': 41.49GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:12 INFO device.py L1468:  'peak_ram': 42.55GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:17 INFO device.py L1468:  'peak_ram': 42.55GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:25 INFO device.py L1468:  'peak_ram': 43.68GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:30 INFO device.py L1468:  'peak_ram': 43.68GB, 'peak_vram': 1.59GB
2026-03-27T09:30:44.803810+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:38 INFO device.py L1468:  'peak_ram': 44.87GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:43 INFO device.py L1468:  'peak_ram': 44.87GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:30:56 INFO device.py L1468:  'peak_ram': 45.82GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:31:09 INFO device.py L1468:  'peak_ram': 45.82GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:31:13 INFO device.py L1468:  'peak_ram': 46.11GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:31:21 INFO device.py L1468:  'peak_ram': 46.11GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:31:26 INFO device.py L1468:  'peak_ram': 46.11GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:31:35 INFO shard_writer.py L208: model has been saved to /dev/shm/model_output/
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:31:36 WARNING export.py L336: /dev/shm/model_output already exists, this may cause model conflict
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 2026-03-27 09:31:36 INFO device.py L1468:  'peak_ram': 46.11GB, 'peak_vram': 1.59GB
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Checking if ChaiML/glm_47_bobo_v1-step2498-merged-W4A16 already exists in ChaiML
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Creating repo ChaiML/glm_47_bobo_v1-step2498-merged-W4A16 and uploading /dev/shm/model_output to it
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: ---------- 2026-03-27 09:31:37 (0:00:00) ----------
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Files:   hashed 7/45 (32.0M/197.4G) | pre-uploaded: 0/0 (0.0/197.4G) (+43 unsure) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Workers: hashing: 38 | get upload mode: 1 | pre-uploading: 0 | committing: 0 | waiting: 25
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: ---------------------------------------------------
2026-03-27T09:31:45.100134+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: 







chaiml-glm-47-bobo-v1-s-81799-v4-uploader: ---------- 2026-03-27 09:32:37 (0:01:00) ----------
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Files:   hashed 45/45 (197.4G/197.4G) | pre-uploaded: 13/40 (52.5G/197.4G) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 27 | committing: 0 | waiting: 37
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: ---------------------------------------------------
2026-03-27T09:32:45.348939+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader:                              







chaiml-glm-47-bobo-v1-s-81799-v4-uploader: ---------- 2026-03-27 09:33:37 (0:02:00) ----------
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Files:   hashed 45/45 (197.4G/197.4G) | pre-uploaded: 40/40 (197.4G/197.4G) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 0 | committing: 1 | waiting: 63
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: ---------------------------------------------------
2026-03-27T09:33:45.578933+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader:                              Processed model ChaiML/glm_47_bobo_v1-step2498-merged in 1863.294s
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-glm-47-bobo-v1-s-81799-v4-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-glm-47-bobo-v1-s-81799-v4-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/config.json
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/chat_template.jinja
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/tokenizer_config.json
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/generation_config.json
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/tokenizer.json
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model.safetensors.index.json
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/quantization_config.json
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00038-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00038-of-00038.safetensors
2026-03-27T09:34:45.802606+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00036-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00036-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00037-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00037-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00023-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00023-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00015-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00015-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00017-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00017-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00025-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00025-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00002-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00002-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00014-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00014-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00034-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00034-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00001-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00001-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00019-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00019-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00022-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00022-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00012-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00012-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00024-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00024-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00004-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00004-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00013-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00013-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00021-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00021-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00007-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00007-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00010-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00010-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00035-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00035-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00018-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00018-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00026-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00026-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00009-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00009-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00006-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00006-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00005-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00005-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00016-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00016-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00008-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00008-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00011-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00011-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00027-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00027-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00033-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00033-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00020-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00020-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00003-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00003-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00032-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00032-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00030-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00030-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00031-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00031-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00029-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00029-of-00038.safetensors
chaiml-glm-47-bobo-v1-s-81799-v4-uploader: cp /dev/shm/model_output/model-00028-of-00038.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-v1-s-81799-v4/default/model-00028-of-00038.safetensors
Job chaiml-glm-47-bobo-v1-s-81799-v4-uploader completed after 1968.17s with status: succeeded
Stopping job with name chaiml-glm-47-bobo-v1-s-81799-v4-uploader
Pipeline stage VLLMUploader completed in 1969.78s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.28s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.07s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-glm-47-bobo-v1-s-81799-v4
Waiting for inference service chaiml-glm-47-bobo-v1-s-81799-v4 to be ready
2026-03-27T09:35:46.031816+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:36:46.269864+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:37:46.584333+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:38:46.885092+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
2026-03-27T09:39:47.110205+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
Inference service chaiml-glm-47-bobo-v1-s-81799-v4 ready after 272.9048593044281s
Pipeline stage VLLMDeployer completed in 274.22s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.66614556312561s
Received healthy response to inference request in 2.1862339973449707s
Received healthy response to inference request in 9.119798183441162s
Received healthy response to inference request in 9.774556636810303s
Received healthy response to inference request in 9.931837558746338s
Received healthy response to inference request in 2.325248956680298s
Received healthy response to inference request in 2.32316255569458s
Received healthy response to inference request in 2.8180813789367676s
2026-03-27T09:40:47.350608+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
Received healthy response to inference request in 2.2730491161346436s
Received healthy response to inference request in 2.7809622287750244s
Received healthy response to inference request in 2.349147081375122s
Received healthy response to inference request in 2.276426076889038s
Received healthy response to inference request in 2.592863082885742s
Received healthy response to inference request in 2.338609218597412s
Received healthy response to inference request in 2.321885347366333s
Received healthy response to inference request in 2.6430435180664062s
Received healthy response to inference request in 2.335231304168701s
Received healthy response to inference request in 2.386159896850586s
Received healthy response to inference request in 2.449097156524658s
Received healthy response to inference request in 2.43032169342041s
Received healthy response to inference request in 2.241373062133789s
Received healthy response to inference request in 2.398118257522583s
Received healthy response to inference request in 2.3227477073669434s
Received healthy response to inference request in 2.282442569732666s
Received healthy response to inference request in 2.4074676036834717s
Received healthy response to inference request in 2.2346086502075195s
Received healthy response to inference request in 2.290449857711792s
Received healthy response to inference request in 2.2743024826049805s
Received healthy response to inference request in 2.2334628105163574s
Received healthy response to inference request in 2.4413654804229736s
30 requests
0 failed requests
5th percentile: 2.23397843837738
10th percentile: 2.2406966209411623
20th percentile: 2.2760013580322265
30th percentile: 2.3124547004699707
40th percentile: 2.3244143962860107
50th percentile: 2.343878149986267
60th percentile: 2.4018579959869384
70th percentile: 2.443684983253479
80th percentile: 2.6706272602081302
90th percentile: 9.174432921409608
95th percentile: 9.72577165365219
99th percentile: 9.886226091384888
mean time: 3.3482733011245727
Pipeline stage StressChecker completed in 113.70s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.78s
Shutdown handler de-registered
2026-03-27T09:41:47.866872+00:00 monitor updated for chaiml-glm-47-bobo-v1-s_81799_v4
chaiml-glm-47-bobo-v1-s_81799_v4 status is now deployed due to DeploymentManager action
chaiml-glm-47-bobo-v1-s_81799_v4 status is now inactive due to auto deactivation removed underperforming models