developer_uid: richhx
submission_id: chaiml-grpo-glm46-combi_79432_v8
model_name: chaiml-grpo-glm46-combi_79432_v8
model_group: ChaiML/grpo-glm46-combin
status: deployed
timestamp: 2026-03-21T15:40:47+00:00
num_battles: 7297
num_wins: 4048
celo_rating: 1331.56
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm46-combine-rm82-lr5e6-step150
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm46-combi_79432_v8
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm46-combine-rm82-lr5e6-step150
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-21
win_ratio: 0.5547485267918323
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|im_end|>', '<|user|>', '####', '</s>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{bot_name}: {message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm46-combi-79432-v8-uploader
Waiting for job on chaiml-grpo-glm46-combi-79432-v8-uploader to finish
chaiml-grpo-glm46-combi-79432-v8-uploader: Using quantization_mode: fp8
chaiml-grpo-glm46-combi-79432-v8-uploader: Checking if ChaiML/grpo-glm46-combine-rm82-lr5e6-step150-FP8 already exists in ChaiML
chaiml-grpo-glm46-combi-79432-v8-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-grpo-glm46-combi-79432-v8-uploader: Downloading snapshot of ChaiML/grpo-glm46-combine-rm82-lr5e6-step150-FP8...
2026-03-21T15:23:23.332532+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:24:23.426093+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
chaiml-grpo-glm46-combi-79432-v8-uploader: Downloaded in 123.300s
chaiml-grpo-glm46-combi-79432-v8-uploader: Processed model ChaiML/grpo-glm46-combine-rm82-lr5e6-step150 in 126.726s
chaiml-grpo-glm46-combi-79432-v8-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v8-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm46-combi-79432-v8-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v8-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v8-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v8-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v8-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm46-combi-79432-v8-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm46-combi-79432-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm46-combi-79432-v8-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm46-combi-79432-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm46-combi-79432-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/config.json
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/generation_config.json
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/.gitattributes
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/chat_template.jinja
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/special_tokens_map.json
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/recipe.yaml
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/tokenizer_config.json
2026-03-21T15:25:23.515267+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00072-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00071-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00046-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00019-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00033-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00043-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00011-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00010-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00057-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00027-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00013-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00008-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00041-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00058-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00051-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00059-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00017-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00035-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00014-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00049-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00012-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00023-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00047-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00031-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00048-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00039-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00037-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00032-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00038-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00021-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00030-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00054-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00003-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00055-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00050-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00004-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00036-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00026-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00056-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00009-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00006-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00018-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00042-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00044-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00061-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00016-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00063-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00045-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00020-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00064-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00034-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00052-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00028-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00029-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00001-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00040-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00069-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00002-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00022-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00070-of-00072.safetensors
2026-03-21T15:26:30.602293+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00066-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00067-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00025-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00015-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00062-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00053-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00065-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00060-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00007-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00005-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00024-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v8-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v8/default/model-00068-of-00072.safetensors
Job chaiml-grpo-glm46-combi-79432-v8-uploader completed after 268.03s with status: succeeded
Stopping job with name chaiml-grpo-glm46-combi-79432-v8-uploader
Pipeline stage VLLMUploader completed in 268.49s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.32s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm46-combi-79432-v8
Waiting for inference service chaiml-grpo-glm46-combi-79432-v8 to be ready
2026-03-21T15:27:30.755546+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
Retrying (%r) after connection broken by '%r': %s
2026-03-21T15:28:30.850647+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:29:30.947081+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:30:31.041854+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:31:31.357015+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:32:31.457683+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:33:31.559336+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:34:31.658489+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
2026-03-21T15:35:32.133879+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
Inference service chaiml-grpo-glm46-combi-79432-v8 ready after 571.858363866806s
Pipeline stage VLLMDeployer completed in 572.31s
run pipeline stage %s
Running pipeline stage StressChecker
2026-03-21T15:36:32.247972+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
Received healthy response to inference request in 9.042223930358887s
Received healthy response to inference request in 2.023115873336792s
Received healthy response to inference request in 2.001368284225464s
Received healthy response to inference request in 1.9937517642974854s
Received healthy response to inference request in 2.030457019805908s
Received healthy response to inference request in 2.0311567783355713s
Received healthy response to inference request in 1.9791181087493896s
Received healthy response to inference request in 2.021592855453491s
Received healthy response to inference request in 2.0009872913360596s
Received healthy response to inference request in 2.003732919692993s
Received healthy response to inference request in 1.9542829990386963s
Received healthy response to inference request in 2.0473692417144775s
Received healthy response to inference request in 2.1401736736297607s
Received healthy response to inference request in 2.010835647583008s
Received healthy response to inference request in 1.9891130924224854s
Received healthy response to inference request in 2.078143835067749s
Received healthy response to inference request in 2.0181119441986084s
Received healthy response to inference request in 2.058537006378174s
Received healthy response to inference request in 2.27449893951416s
Received healthy response to inference request in 1.9954347610473633s
Received healthy response to inference request in 2.005488634109497s
Received healthy response to inference request in 2.0552890300750732s
Received healthy response to inference request in 2.108464002609253s
Received healthy response to inference request in 2.1220579147338867s
Received healthy response to inference request in 2.038306951522827s
Received healthy response to inference request in 2.1105897426605225s
Received healthy response to inference request in 2.0552408695220947s
Received healthy response to inference request in 2.0320825576782227s
2026-03-21T15:37:32.349309+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v8
Received healthy response to inference request in 2.0890614986419678s
Received healthy response to inference request in 2.0242080688476562s
30 requests
0 failed requests
5th percentile: 1.9836158514022828
10th percentile: 1.9932878971099854
20th percentile: 2.001292085647583
30th percentile: 2.0092315435409547
40th percentile: 2.022506666183472
50th percentile: 2.0308068990707397
60th percentile: 2.0419318675994873
70th percentile: 2.0562634229660035
80th percentile: 2.092941999435425
90th percentile: 2.1238694906234743
95th percentile: 2.21405256986618
99th percentile: 7.079583683013922
mean time: 2.277826507886251
Pipeline stage StressChecker completed in 71.23s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
chaiml-grpo-glm46-combi_79432_v8 status is now deployed due to DeploymentManager action
chaiml-grpo-glm46-combi_79432_v8 status is now inactive due to system request