chaiml-grpo-glm50-combi_78846

developer_uid: chai_backend_admin
submission_id: chaiml-grpo-glm50-combi_78846_v3
model_name: chaiml-grpo-glm50-combi_78846_v3
model_group: ChaiML/grpo-glm50-combin
status: torndown
timestamp: 2026-04-02T20:08:08+00:00
num_battles: 3633
num_wins: 2069
celo_rating: 1357.75
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm50-combine-rm721-mega-kimi-mix8020-step240-int4-fast
model_architecture: GlmMoeDsaForCausalLM
model_num_parameters: 31348144128.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm50-combi_78846_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm50-combine-rm721-mega-kimi-mix8020-step240-int4-fast
model_size: 31B
ranking_group: single
us_pacific_date: 2026-03-30
win_ratio: 0.5695017891549683
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|im_end|>', '<|assistant|>', '</s>', '<|user|>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>{message}', 'user_template': '<|user|>{message}', 'response_template': '<|assistant|></think>', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm50-combi-78846-v3-uploader
Waiting for job on chaiml-grpo-glm50-combi-78846-v3-uploader to finish
chaiml-grpo-glm50-combi-78846-v3-uploader: {repo_id} is already quantized
chaiml-grpo-glm50-combi-78846-v3-uploader: Using quantization_mode: none
chaiml-grpo-glm50-combi-78846-v3-uploader: Downloading snapshot of ChaiML/grpo-glm50-combine-rm721-mega-kimi-mix8020-step240-int4-fast...
2026-03-30T18:17:51.665804+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:18:51.898818+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:19:52.141095+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
chaiml-grpo-glm50-combi-78846-v3-uploader: Downloaded in 175.216s
2026-03-30T18:20:52.378685+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:21:52.468678+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:22:52.557433+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:23:52.672528+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
chaiml-grpo-glm50-combi-78846-v3-uploader: Processed model ChaiML/grpo-glm50-combine-rm721-mega-kimi-mix8020-step240-int4-fast in 412.781s
chaiml-grpo-glm50-combi-78846-v3-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-78846-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm50-combi-78846-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-78846-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-78846-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-78846-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-78846-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm50-combi-78846-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm50-combi-78846-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm50-combi-78846-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm50-combi-78846-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm50-combi-78846-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/chat_template.jinja
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/config.json
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/.gitattributes
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/generation_config.json
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/tokenizer_config.json
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/quantization_config.json
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/tokenizer.json
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model.safetensors.index.json
2026-03-30T18:24:53.195939+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00077-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00077-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00078-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00078-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00032-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00032-of-00078.safetensors
2026-03-30T18:25:53.536986+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00061-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00061-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00041-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00041-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00015-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00015-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00003-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00003-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00033-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00033-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00012-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00012-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00039-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00039-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00028-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00028-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00030-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00030-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00009-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00009-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00010-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00010-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00031-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00031-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00027-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00027-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00005-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00005-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00068-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00068-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00048-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00048-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00029-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00029-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00051-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00051-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00072-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00072-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00022-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00022-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00060-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00060-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00063-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00063-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00066-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00066-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00006-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00006-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00042-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00042-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00043-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00043-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00001-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00001-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00023-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00023-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00070-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00070-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00062-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00062-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00020-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00020-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00017-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00017-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00013-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00013-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00011-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00011-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00054-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00054-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00016-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00016-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00045-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00045-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00046-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00046-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00075-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00075-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00057-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00057-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00047-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00047-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00002-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00002-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00044-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00044-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00008-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00008-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00071-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00071-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00034-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00034-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00014-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00014-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00019-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00019-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00050-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00050-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00018-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00018-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00055-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00055-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00035-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00035-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00058-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00058-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00052-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00052-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00038-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00038-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00065-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00065-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00026-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00026-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00037-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00037-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00021-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00021-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00059-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00059-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00049-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00049-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00004-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00004-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00007-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00007-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00064-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00064-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00074-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00074-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00067-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00067-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00056-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00056-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00053-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00053-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00076-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00076-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00040-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00040-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00036-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00036-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00069-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00069-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00024-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00024-of-00078.safetensors
chaiml-grpo-glm50-combi-78846-v3-uploader: cp /dev/shm/model_output/model-00073-of-00078.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-78846-v3/default/model-00073-of-00078.safetensors
Job chaiml-grpo-glm50-combi-78846-v3-uploader completed after 570.88s with status: succeeded
Stopping job with name chaiml-grpo-glm50-combi-78846-v3-uploader
Pipeline stage VLLMUploader completed in 573.01s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.57s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm50-combi-78846-v3
Waiting for inference service chaiml-grpo-glm50-combi-78846-v3 to be ready
2026-03-30T18:26:53.733858+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:27:54.004932+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:28:54.719962+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:29:54.824011+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:30:55.060466+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:31:55.249797+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:32:55.513137+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:33:55.721924+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:34:55.996289+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:35:56.251814+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:36:56.519583+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:37:56.738678+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
2026-03-30T18:38:56.922473+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
Inference service chaiml-grpo-glm50-combi-78846-v3 ready after 771.5853705406189s
Pipeline stage VLLMDeployer completed in 772.09s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 11.044464111328125s
Received healthy response to inference request in 2.508776903152466s
Received healthy response to inference request in 2.5325160026550293s
Received healthy response to inference request in 2.5905954837799072s
Received healthy response to inference request in 2.478945732116699s
Received healthy response to inference request in 2.573415756225586s
Received healthy response to inference request in 3.05053448677063s
Received healthy response to inference request in 2.5394697189331055s
Received healthy response to inference request in 2.628446578979492s
Received healthy response to inference request in 2.970028877258301s
2026-03-30T18:39:57.021449+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
Received healthy response to inference request in 3.072556495666504s
Received healthy response to inference request in 2.5209689140319824s
Received healthy response to inference request in 2.7061495780944824s
Received healthy response to inference request in 2.7194700241088867s
Received healthy response to inference request in 2.947389602661133s
Received healthy response to inference request in 2.5825679302215576s
Received healthy response to inference request in 2.5957820415496826s
Received healthy response to inference request in 2.8649768829345703s
Received healthy response to inference request in 3.2040743827819824s
Received healthy response to inference request in 5.865431308746338s
Received healthy response to inference request in 2.6923813819885254s
Received healthy response to inference request in 2.6143953800201416s
Received healthy response to inference request in 2.976602792739868s
Received healthy response to inference request in 11.143073081970215s
2026-03-30T18:40:57.327088+00:00 monitor updated for chaiml-grpo-glm50-combi_78846_v3
Received healthy response to inference request in 2.8002748489379883s
Received healthy response to inference request in 2.575638771057129s
Received healthy response to inference request in 2.8457443714141846s
Received healthy response to inference request in 2.5569498538970947s
Received healthy response to inference request in 3.042639970779419s
Received healthy response to inference request in 2.640258312225342s
30 requests
0 failed requests
5th percentile: 2.5142633080482484
10th percentile: 2.531361293792725
20th percentile: 2.570122575759888
30th percentile: 2.5881872177124023
40th percentile: 2.622826099395752
50th percentile: 2.699265480041504
60th percentile: 2.8184626579284666
70th percentile: 2.954181385040283
80th percentile: 3.044218873977661
90th percentile: 3.4702100753784215
95th percentile: 8.713899350166306
99th percentile: 11.11447648048401
mean time: 3.396150652567546
Pipeline stage StressChecker completed in 118.89s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.86s
Shutdown handler de-registered
chaiml-grpo-glm50-combi_78846_v3 status is now deployed due to DeploymentManager action
chaiml-grpo-glm50-combi_78846_v3 status is now inactive due to system request
chaiml-grpo-glm50-combi_78846_v3 status is now torndown due to DeploymentManager action