chaiml-glm-air-4-5-sft-_76742

developer_uid: rirv938
submission_id: chaiml-glm-air-4-5-sft-_76742_v2
model_name: chaiml-glm-air-4-5-sft-_76742_v2
model_group: ChaiML/glm_air_4_5_sft_m
status: inactive
timestamp: 2026-02-24T00:27:28+00:00
num_battles: 10533
num_wins: 5534
celo_rating: 1312.54
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/glm_air_4_5_sft_mid_lr_e1
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 9073971200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-glm-air-4-5-sft-_76742_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/glm_air_4_5_sft_mid_lr_e1
model_size: 9B
ranking_group: single
us_pacific_date: 2026-02-23
win_ratio: 0.5253963733029526
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', 'You:', '<|im_start|>', '###'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>\nRespond as a high quality storyteller.<|user|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-glm-air-4-5-sft-76742-v2-uploader
Waiting for job on chaiml-glm-air-4-5-sft-76742-v2-uploader to finish
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: Using quantization_mode: none
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: Downloading snapshot of ChaiML/glm_air_4_5_sft_mid_lr_e4...
chaiml-glm-air-4-5-sft-76742-v2-uploader: Using quantization_mode: none
chaiml-glm-air-4-5-sft-76742-v2-uploader: Downloading snapshot of ChaiML/glm_air_4_5_sft_mid_lr_e1...
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: Downloaded in 78.162s
chaiml-glm-air-4-5-sft-76742-v2-uploader: Downloaded in 75.296s
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: Processed model ChaiML/glm_air_4_5_sft_mid_lr_e4 in 225.789s
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: creating bucket guanaco-vllm-models
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-glm-air-4-5-sft-m-5311-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/.gitattributes
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/config.json
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/README.md
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/special_tokens_map.json
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/chat_template.jinja
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/args.json
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model.safetensors.index.json
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/tokenizer_config.json
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/tokenizer.json
chaiml-glm-air-4-5-sft-76742-v2-uploader: Processed model ChaiML/glm_air_4_5_sft_mid_lr_e1 in 241.596s
chaiml-glm-air-4-5-sft-76742-v2-uploader: creating bucket guanaco-vllm-models
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-glm-air-4-5-sft-76742-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-glm-air-4-5-sft-76742-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-glm-air-4-5-sft-76742-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-glm-air-4-5-sft-76742-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/.gitattributes
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/args.json
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/README.md
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/chat_template.jinja
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/tokenizer_config.json
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model.safetensors.index.json
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/config.json
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/special_tokens_map.json
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/tokenizer.json
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00043-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00034-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00039-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00010-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00002-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00036-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00022-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00013-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00009-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00023-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00028-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00004-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00003-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00026-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00014-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00011-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00021-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00037-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00020-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00042-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00017-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00018-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00025-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00033-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00006-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00038-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00001-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00005-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00031-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00008-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00019-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00015-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00043-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00043-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00030-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00012-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00040-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00032-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00029-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00027-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00007-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00035-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00016-of-00043.safetensors
chaiml-glm-air-4-5-sft-m-5311-v2-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-m-5311-v2/default/model-00041-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00007-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00007-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00014-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00014-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00018-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00018-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00016-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00016-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00027-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00027-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00017-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00017-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00030-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00030-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00025-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00025-of-00043.safetensors
Job chaiml-glm-air-4-5-sft-m-5311-v2-uploader completed after 372.89s with status: succeeded
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00040-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00040-of-00043.safetensors
Stopping job with name chaiml-glm-air-4-5-sft-m-5311-v2-uploader
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00029-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00029-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00012-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00012-of-00043.safetensors
Pipeline stage VLLMUploader completed in 374.33s
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00038-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00038-of-00043.safetensors
run pipeline stage %s
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00034-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00034-of-00043.safetensors
Running pipeline stage VLLMTemplater
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00041-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00041-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00013-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00013-of-00043.safetensors
Pipeline stage VLLMTemplater completed in 0.43s
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00002-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00002-of-00043.safetensors
run pipeline stage %s
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00005-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00005-of-00043.safetensors
Running pipeline stage VLLMDeployer
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00009-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00009-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00039-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00039-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00036-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00036-of-00043.safetensors
Creating inference service chaiml-glm-air-4-5-sft-m-5311-v2
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00023-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00023-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00022-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00022-of-00043.safetensors
Waiting for inference service chaiml-glm-air-4-5-sft-m-5311-v2 to be ready
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00015-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00015-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00028-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00028-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00008-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00008-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00024-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00024-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00032-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00032-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00004-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00004-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00033-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00033-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00011-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00011-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00026-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00026-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00006-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00006-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00042-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00042-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00001-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00001-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00010-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00010-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00019-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00019-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00035-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00035-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00021-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00021-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00031-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00031-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00020-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00020-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00037-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00037-of-00043.safetensors
chaiml-glm-air-4-5-sft-76742-v2-uploader: cp /dev/shm/model_output/model-00003-of-00043.safetensors s3://guanaco-vllm-models/chaiml-glm-air-4-5-sft-76742-v2/default/model-00003-of-00043.safetensors
Job chaiml-glm-air-4-5-sft-76742-v2-uploader completed after 388.91s with status: succeeded
Stopping job with name chaiml-glm-air-4-5-sft-76742-v2-uploader
Pipeline stage VLLMUploader completed in 390.59s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.54s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-glm-air-4-5-sft-76742-v2
Waiting for inference service chaiml-glm-air-4-5-sft-76742-v2 to be ready
Inference service chaiml-glm-air-4-5-sft-m-5311-v2 ready after 578.4930789470673s
Pipeline stage VLLMDeployer completed in 580.95s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.965501546859741s
Received healthy response to inference request in 2.249999523162842s
Received healthy response to inference request in 2.408273696899414s
Received healthy response to inference request in 2.280057191848755s
Received healthy response to inference request in 2.3378608226776123s
Inference service chaiml-glm-air-4-5-sft-76742-v2 ready after 575.4970350265503s
Pipeline stage VLLMDeployer completed in 577.61s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.159316301345825s
Received healthy response to inference request in 3.3639838695526123s
Received healthy response to inference request in 2.0667521953582764s
Received healthy response to inference request in 7.346920728683472s
Received healthy response to inference request in 2.3703551292419434s
Received healthy response to inference request in 2.280181884765625s
Received healthy response to inference request in 2.3603098392486572s
Received healthy response to inference request in 2.9460768699645996s
Received healthy response to inference request in 2.783061981201172s
Received healthy response to inference request in 2.50441837310791s
Received healthy response to inference request in 2.3294596672058105s
Received healthy response to inference request in 2.2177786827087402s
Received healthy response to inference request in 2.1161277294158936s
Received healthy response to inference request in 2.316314935684204s
Received healthy response to inference request in 2.588941812515259s
Received healthy response to inference request in 2.3198134899139404s
Received healthy response to inference request in 3.3553361892700195s
Received healthy response to inference request in 7.435320615768433s
Received healthy response to inference request in 2.106822967529297s
Received healthy response to inference request in 2.349346876144409s
Received healthy response to inference request in 2.1679189205169678s
Received healthy response to inference request in 2.425603151321411s
Received healthy response to inference request in 2.3411648273468018s
Received healthy response to inference request in 2.2066516876220703s
Received healthy response to inference request in 2.2565841674804688s
Received healthy response to inference request in 5.102078676223755s
Received healthy response to inference request in 8.493861436843872s
Received healthy response to inference request in 2.2310473918914795s
Received healthy response to inference request in 2.3604884147644043s
Received healthy response to inference request in 3.6449618339538574s
Received healthy response to inference request in 2.508737087249756s
Received healthy response to inference request in 2.197235584259033s
Received healthy response to inference request in 2.52174711227417s
Received healthy response to inference request in 2.2620880603790283s
Received healthy response to inference request in 2.7100863456726074s
Received healthy response to inference request in 2.583576202392578s
Received healthy response to inference request in 2.3235480785369873s
Received healthy response to inference request in 2.368931770324707s
Received healthy response to inference request in 2.2645645141601562s
Received healthy response to inference request in 2.229142665863037s
Received healthy response to inference request in 2.3868250846862793s
Received healthy response to inference request in 2.856917142868042s
Received healthy response to inference request in 2.734307050704956s
Received healthy response to inference request in 2.2018041610717773s
Received healthy response to inference request in 2.0768260955810547s
Received healthy response to inference request in 2.5282628536224365s
Received healthy response to inference request in 2.9793593883514404s
30 requests
0 failed requests
5th percentile: 2.0903246879577635
10th percentile: 2.115197253227234
Received healthy response to inference request in 2.4287989139556885s
20th percentile: 2.233583402633667
30th percentile: 2.3078866004943848
40th percentile: 2.3345003604888914
50th percentile: 2.3603991270065308
60th percentile: 2.3954045295715334
Received healthy response to inference request in 2.1819746494293213s
70th percentile: 2.5419055223464966
80th percentile: 2.7440580368041996
90th percentile: 3.3562009572982787
95th percentile: 3.6948185920715315
99th percentile: 7.180637068748478
mean time: 2.701046943664551
Pipeline stage StressChecker completed in 116.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.84s
Received healthy response to inference request in 7.672754764556885s
Shutdown handler de-registered
chaiml-glm-air-4-5-sft-m_5311_v2 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 7.392037391662598s
Received healthy response to inference request in 2.2711641788482666s
Received healthy response to inference request in 7.163716793060303s
Received healthy response to inference request in 2.4896092414855957s
Received healthy response to inference request in 8.333858966827393s
30 requests
0 failed requests
5th percentile: 2.199291443824768
10th percentile: 2.206166934967041
20th percentile: 2.230666446685791
30th percentile: 2.268441343307495
40th percentile: 2.336134099960327
50th percentile: 2.42720103263855
60th percentile: 2.513956165313721
70th percentile: 2.883665060997009
80th percentile: 5.51440629959107
90th percentile: 7.396365714073181
95th percentile: 7.565909397602081
99th percentile: 8.142138748168946
mean time: 3.5475053071975706
Pipeline stage StressChecker completed in 139.04s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.07s
Shutdown handler de-registered
chaiml-glm-air-4-5-sft-_76742_v2 status is now deployed due to DeploymentManager action
chaiml-glm-air-4-5-sft-_76742_v2 status is now inactive due to auto deactivation removed underperforming models