chaiml-glm-47-bobo-crea_98429

developer_uid: rirv938
submission_id: chaiml-glm-47-bobo-crea_98429_v3
model_name: chaiml-glm-47-bobo-crea_98429_v3
model_group: ChaiML/glm_47_bobo_creat
status: deployed
timestamp: 2026-03-23T17:49:13+00:00
num_battles: 2818
num_wins: 1565
celo_rating: 8489.56
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/glm_47_bobo_creative_v2-step2970-merged-FP8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1600
max_output_tokens: 80
reward_model: default
display_name: chaiml-glm-47-bobo-crea_98429_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/glm_47_bobo_creative_v2-step2970-merged-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-23
win_ratio: 0.5553584102200142
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '###', '<|im_start|>', 'You:', '<|im_end|>'], 'max_input_tokens': 1600, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>Respond as a high quality storyteller.<|user|>', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|></think>{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-glm-47-bobo-crea-98429-v3-uploader
Waiting for job on chaiml-glm-47-bobo-crea-98429-v3-uploader to finish
chaiml-glm-47-bobo-crea-98429-v3-uploader: Using quantization_mode: fp8
chaiml-glm-47-bobo-crea-98429-v3-uploader: Repo ChaiML/glm_47_bobo_creative_v2-step2970-merged-FP8 already ends in FP8. Skipping...
chaiml-glm-47-bobo-crea-98429-v3-uploader: Checking if ChaiML/glm_47_bobo_creative_v2-step2970-merged-FP8 already exists in ChaiML
chaiml-glm-47-bobo-crea-98429-v3-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-glm-47-bobo-crea-98429-v3-uploader: Downloading snapshot of ChaiML/glm_47_bobo_creative_v2-step2970-merged-FP8...
2026-03-23T17:15:53.932641+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
Retrying (%r) after connection broken by '%r': %s
2026-03-23T17:16:54.017972+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:17:54.099719+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:18:54.189876+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
chaiml-glm-47-bobo-crea-98429-v3-uploader: Downloaded in 191.216s
chaiml-glm-47-bobo-crea-98429-v3-uploader: Processed model ChaiML/glm_47_bobo_creative_v2-step2970-merged-FP8 in 194.706s
chaiml-glm-47-bobo-crea-98429-v3-uploader: creating bucket guanaco-vllm-models
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-47-bobo-crea-98429-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-glm-47-bobo-crea-98429-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-47-bobo-crea-98429-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-47-bobo-crea-98429-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/config.json
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/chat_template.jinja
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/tokenizer_config.json
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/generation_config.json
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/recipe.yaml
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/special_tokens_map.json
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/.gitattributes
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model.safetensors.index.json
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/tokenizer.json
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00072-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00071-of-00072.safetensors
2026-03-23T17:19:54.274220+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00025-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00008-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00005-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00027-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00047-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00051-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00063-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00054-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00036-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00002-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00066-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00013-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00062-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00015-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00031-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00016-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00068-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00021-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00041-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00004-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00026-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00045-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00034-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00011-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00028-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00070-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00060-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00061-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00029-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00050-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00020-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00039-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00043-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00048-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00064-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00012-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00010-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00006-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00023-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00055-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00038-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00024-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00067-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00032-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00057-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00003-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00018-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00017-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00065-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00040-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00059-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00037-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00046-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00001-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00044-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00035-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00030-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00058-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00056-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00042-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00053-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00019-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00049-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00069-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00007-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00022-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00052-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00014-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00033-of-00072.safetensors
chaiml-glm-47-bobo-crea-98429-v3-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-glm-47-bobo-crea-98429-v3/default/model-00009-of-00072.safetensors
Job chaiml-glm-47-bobo-crea-98429-v3-uploader completed after 328.73s with status: succeeded
Stopping job with name chaiml-glm-47-bobo-crea-98429-v3-uploader
Pipeline stage VLLMUploader completed in 329.28s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.38s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-glm-47-bobo-crea-98429-v3
Waiting for inference service chaiml-glm-47-bobo-crea-98429-v3 to be ready
2026-03-23T17:20:54.367794+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
admin requested tearing down of qwen-qwen3-5-35b-a3b_v1
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMDeleter
Checking if service qwen-qwen3-5-35b-a3b-v1 is running
Tearing down inference service qwen-qwen3-5-35b-a3b-v1
Service qwen-qwen3-5-35b-a3b-v1 has been torndown
Pipeline stage VLLMDeleter completed in 0.90s
run pipeline stage %s
Running pipeline stage VLLMModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key qwen-qwen3-5-35b-a3b-v1/default/.gitattributes from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/LICENSE from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/README.md from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/chat_template.jinja from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/config.json from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/generation_config.json from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/merges.txt from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00001-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00002-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00003-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00004-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00005-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00006-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00007-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00008-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00009-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00010-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00011-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00012-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00013-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors-00014-of-00014.safetensors from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/model.safetensors.index.json from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/preprocessor_config.json from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/tokenizer.json from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/tokenizer_config.json from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/video_preprocessor_config.json from bucket guanaco-vllm-models
Deleting key qwen-qwen3-5-35b-a3b-v1/default/vocab.json from bucket guanaco-vllm-models
Pipeline stage VLLMModelDeleter completed in 10.57s
Shutdown handler de-registered
qwen-qwen3-5-35b-a3b_v1 status is now torndown due to DeploymentManager action
2026-03-23T17:21:54.465168+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:22:54.574187+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:23:54.681773+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:24:54.783772+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:25:54.883586+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:26:54.981138+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:27:55.088851+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:28:55.192709+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:29:55.296106+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:30:55.394541+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:31:55.513998+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:32:55.618239+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:33:55.726733+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:34:55.896738+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:35:56.009085+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:36:56.108339+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:37:56.217157+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:38:56.322071+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:39:56.431206+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:40:56.537686+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:41:56.637045+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:42:56.760988+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:43:56.861980+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:44:56.962221+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:45:57.067963+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:46:57.205934+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
2026-03-23T17:47:57.323360+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
Inference service chaiml-glm-47-bobo-crea-98429-v3 ready after 1653.7527301311493s
Pipeline stage VLLMDeployer completed in 1654.23s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.309007167816162s
Received healthy response to inference request in 2.2233572006225586s
Received healthy response to inference request in 2.01835298538208s
Received healthy response to inference request in 2.217175245285034s
Received healthy response to inference request in 2.066240072250366s
Received healthy response to inference request in 2.0323667526245117s
Received healthy response to inference request in 2.2328271865844727s
Received healthy response to inference request in 2.109804391860962s
Received healthy response to inference request in 2.066713571548462s
Received healthy response to inference request in 2.1442856788635254s
Received healthy response to inference request in 2.2445454597473145s
Received healthy response to inference request in 2.2165932655334473s
Received healthy response to inference request in 2.2820568084716797s
Received healthy response to inference request in 2.1549603939056396s
Received healthy response to inference request in 2.112338066101074s
Received healthy response to inference request in 2.039492607116699s
Received healthy response to inference request in 2.0147595405578613s
Received healthy response to inference request in 2.0234487056732178s
Received healthy response to inference request in 2.123103380203247s
Received healthy response to inference request in 2.2532927989959717s
Received healthy response to inference request in 2.190983533859253s
Received healthy response to inference request in 2.0262444019317627s
Received healthy response to inference request in 1.9844932556152344s
2026-03-23T17:48:57.474099+00:00 monitor updated for chaiml-glm-47-bobo-crea_98429_v3
Received healthy response to inference request in 1.9551818370819092s
Received healthy response to inference request in 2.2260422706604004s
Received healthy response to inference request in 2.1062493324279785s
Received healthy response to inference request in 1.8848905563354492s
Received healthy response to inference request in 2.1241672039031982s
Received healthy response to inference request in 2.0962305068969727s
Received healthy response to inference request in 2.167931318283081s
30 requests
0 failed requests
5th percentile: 1.9683719754219056
10th percentile: 2.0117329120635987
20th percentile: 2.025685262680054
30th percentile: 2.058215832710266
40th percentile: 2.102241802215576
50th percentile: 2.1177207231521606
60th percentile: 2.148555564880371
70th percentile: 2.1986664533615112
80th percentile: 2.223894214630127
90th percentile: 2.2454201936721803
95th percentile: 2.269113004207611
99th percentile: 7.271191563606268
mean time: 2.3549045165379843
Pipeline stage StressChecker completed in 74.26s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.81s
Shutdown handler de-registered
chaiml-glm-47-bobo-crea_98429_v3 status is now deployed due to DeploymentManager action