chaiml-grpo-glm50-combi_11380

developer_uid: chai_backend_admin
submission_id: chaiml-grpo-glm50-combi_11380_v3
model_name: chaiml-grpo-glm50-combi_11380_v3
model_group: ChaiML/grpo-glm50-combin
status: inactive
timestamp: 2026-03-26T04:43:03+00:00
num_battles: 14914
num_wins: 8718
celo_rating: 1354.7
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm50-combine-rm82-zy-data-step200-int4
model_architecture: GlmMoeDsaForCausalLM
model_num_parameters: 31348144128.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm50-combi_11380_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm50-combine-rm82-zy-data-step200-int4
model_size: 31B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.5845514281882794
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|user|>', '<|im_end|>', '<|assistant|>', '####'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>{message}', 'user_template': '<|user|>{message}', 'response_template': '<|assistant|></think>', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm50-combi-11380-v3-uploader
Waiting for job on chaiml-grpo-glm50-combi-11380-v3-uploader to finish
chaiml-grpo-glm50-combi-11380-v3-uploader: Using quantization_mode: none
chaiml-grpo-glm50-combi-11380-v3-uploader: Downloading snapshot of ChaiML/grpo-glm50-combine-rm82-zy-data-step200-int4...
2026-03-25T23:57:29.276562+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-25T23:58:29.370200+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
chaiml-grpo-glm50-combi-11380-v3-uploader: Downloaded in 110.033s
2026-03-25T23:59:29.463990+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:00:29.549335+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:01:29.640856+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
chaiml-grpo-glm50-combi-11380-v3-uploader: Processed model ChaiML/grpo-glm50-combine-rm82-zy-data-step200-int4 in 253.924s
chaiml-grpo-glm50-combi-11380-v3-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-11380-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm50-combi-11380-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-11380-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-11380-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-11380-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-11380-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm50-combi-11380-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm50-combi-11380-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm50-combi-11380-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm50-combi-11380-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm50-combi-11380-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/.gitattributes
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/generation_config.json
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/chat_template.jinja
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/config.json
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/tokenizer_config.json
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/quantization_config.json
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model.safetensors.index.json
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/tokenizer.json
2026-03-26T00:02:29.738492+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00077-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00077-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00078-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00078-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00007-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00007-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00005-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00005-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00038-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00038-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00052-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00052-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00023-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00023-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00060-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00060-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00061-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00061-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00048-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00048-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00001-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00001-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00034-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00034-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00014-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00014-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00032-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00032-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00040-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00040-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00008-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00008-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00024-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00024-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00072-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00072-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00042-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00042-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00004-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00004-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00013-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00013-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00064-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00064-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00039-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00039-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00050-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00050-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00036-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00036-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00076-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00076-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00073-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00073-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00067-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00067-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00009-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00009-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00029-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00029-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00010-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00010-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00002-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00002-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00057-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00057-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00031-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00031-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00003-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00003-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00071-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00071-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00006-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00006-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00047-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00047-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00045-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00045-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00043-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00043-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00059-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00059-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00030-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00030-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00046-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00046-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00055-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00055-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00066-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00066-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00068-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00068-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00027-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00027-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00028-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00028-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00074-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00074-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00026-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00026-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00049-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00049-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00025-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00025-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00035-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00035-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00051-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00051-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00016-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00016-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00033-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00033-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00012-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00012-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00037-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00037-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00011-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00011-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00020-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00020-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00017-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00017-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00075-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00075-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00015-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00015-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00062-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00062-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00021-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00021-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00054-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00054-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00070-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00070-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00065-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00065-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00044-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00044-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00056-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00056-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00053-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00053-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00069-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00069-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00063-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00063-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00019-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00019-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00058-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00058-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00022-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00022-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00018-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00018-of-00078.safetensors
chaiml-grpo-glm50-combi-11380-v3-uploader: cp /dev/shm/model_output/model-00041-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-11380-v3/default/model-00041-of-00078.safetensors
Job chaiml-grpo-glm50-combi-11380-v3-uploader completed after 411.27s with status: succeeded
Stopping job with name chaiml-grpo-glm50-combi-11380-v3-uploader
Pipeline stage VLLMUploader completed in 411.78s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 3.44s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm50-combi-11380-v3
Waiting for inference service chaiml-grpo-glm50-combi-11380-v3 to be ready
2026-03-26T00:03:29.856714+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:04:30.086384+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:05:30.200151+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:06:30.308111+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:07:30.414057+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:08:30.519314+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:09:30.649540+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:10:30.768827+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:11:30.877724+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
2026-03-26T00:12:30.980298+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
Inference service chaiml-grpo-glm50-combi-11380-v3 ready after 561.2847533226013s
Pipeline stage VLLMDeployer completed in 561.76s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 11.213919401168823s
Received healthy response to inference request in 2.488041639328003s
Received healthy response to inference request in 2.995086193084717s
Received healthy response to inference request in 2.6320595741271973s
Received healthy response to inference request in 2.743159770965576s
Received healthy response to inference request in 2.622375965118408s
Received healthy response to inference request in 2.729088306427002s
Received healthy response to inference request in 3.1134259700775146s
Received healthy response to inference request in 2.586193323135376s
Received healthy response to inference request in 3.070643424987793s
Received healthy response to inference request in 2.662498712539673s
Received healthy response to inference request in 2.5219333171844482s
2026-03-26T00:13:31.121481+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
Received healthy response to inference request in 2.541505813598633s
Received healthy response to inference request in 2.5515685081481934s
Received healthy response to inference request in 2.5503900051116943s
Received healthy response to inference request in 2.6749415397644043s
Received healthy response to inference request in 14.771833419799805s
Received healthy response to inference request in 2.4995951652526855s
Received healthy response to inference request in 3.0301339626312256s
Failed to get request counts for guanaco-submitter. Falling back to default
Received healthy response to inference request in 3.0088951587677s
Received healthy response to inference request in 3.0690295696258545s
Received healthy response to inference request in 3.0696041584014893s
Received healthy response to inference request in 3.0976011753082275s
Received healthy response to inference request in 2.523256778717041s
Received healthy response to inference request in 3.085761070251465s
Received healthy response to inference request in 3.061527967453003s
Received healthy response to inference request in 2.6409547328948975s
Received healthy response to inference request in 2.9442546367645264s
Received healthy response to inference request in 2.5455713272094727s
2026-03-26T00:14:31.232937+00:00 monitor updated for chaiml-grpo-glm50-combi_11380_v3
Received healthy response to inference request in 3.3094964027404785s
30 requests
0 failed requests
5th percentile: 2.5096473336219787
10th percentile: 2.523124432563782
20th percentile: 2.54942626953125
30th percentile: 2.6115211725234984
40th percentile: 2.6538811206817625
50th percentile: 2.736124038696289
60th percentile: 3.00060977935791
70th percentile: 3.063778448104858
80th percentile: 3.0736669540405273
90th percentile: 3.133033013343811
95th percentile: 7.6569290518760456
99th percentile: 13.740038354396823
mean time: 3.4784782330195108
Pipeline stage StressChecker completed in 108.73s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.21s
Shutdown handler de-registered
chaiml-grpo-glm50-combi_11380_v3 status is now deployed due to DeploymentManager action
chaiml-grpo-glm50-combi_11380_v3 status is now inactive due to system request