developer_uid: chai_backend_admin
submission_id: chaiml-grpo-glm50-combi_44700_v2
model_name: chaiml-grpo-glm50-combi_44700_v2
model_group: ChaiML/grpo-glm50-combin
status: inactive
timestamp: 2026-04-04T07:57:15+00:00
num_battles: 11240
num_wins: 6624
celo_rating: 1368.6
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm50-combine-rm3331-mega-kimi-mix8020-step300-int4
model_architecture: GlmMoeDsaForCausalLM
model_num_parameters: 31348144128.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm50-combi_44700_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm50-combine-rm3331-mega-kimi-mix8020-step300-int4
model_size: 31B
ranking_group: single
us_pacific_date: 2026-04-04
win_ratio: 0.5893238434163701
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|user|>', '<|assistant|>', '####', '<|im_end|>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>{message}', 'user_template': '<|user|>{message}', 'response_template': '<|assistant|></think>', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm50-combi-44700-v2-uploader
Waiting for job on chaiml-grpo-glm50-combi-44700-v2-uploader to finish
chaiml-grpo-glm50-combi-44700-v2-uploader: ChaiML/grpo-glm50-combine-rm3331-mega-kimi-mix8020-step300-int4 is already quantized
chaiml-grpo-glm50-combi-44700-v2-uploader: Using quantization_mode: none
chaiml-grpo-glm50-combi-44700-v2-uploader: Downloading snapshot of ChaiML/grpo-glm50-combine-rm3331-mega-kimi-mix8020-step300-int4...
2026-04-04T05:27:15.300191+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
2026-04-04T05:28:15.381947+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
2026-04-04T05:29:15.466214+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
chaiml-grpo-glm50-combi-44700-v2-uploader: Downloaded in 141.655s
chaiml-grpo-glm50-combi-44700-v2-uploader: Processed model ChaiML/grpo-glm50-combine-rm3331-mega-kimi-mix8020-step300-int4 in 141.906s
chaiml-grpo-glm50-combi-44700-v2-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-44700-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm50-combi-44700-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-44700-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-44700-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-44700-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm50-combi-44700-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm50-combi-44700-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm50-combi-44700-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm50-combi-44700-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm50-combi-44700-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm50-combi-44700-v2-uploader: uploading /tmp/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/chat_template.jinja
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/generation_config.json
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/config.json
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/.gitattributes
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/quantization_config.json
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/tokenizer_config.json
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model.safetensors.index.json
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/tokenizer.json
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00075-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00075-of-00075.safetensors
2026-04-04T05:30:15.553355+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: 1f1d8a9f-c104-94a9-971b-b5b6b7d07e5e, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00013-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00013-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00038-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00038-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00033-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00033-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00016-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00016-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00009-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00009-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00040-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00040-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00065-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00065-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00048-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00048-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00036-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00036-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00022-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00022-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00071-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00071-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00007-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00007-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00062-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00062-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00039-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00039-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00010-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00010-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00056-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00056-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00015-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00015-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00035-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00035-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00063-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00063-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00023-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00023-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00024-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00024-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00025-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00025-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00074-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00074-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00060-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00060-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00002-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00002-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00041-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00041-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00020-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00020-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00004-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00004-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00019-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00019-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00043-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00043-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00044-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00044-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00027-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00027-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00064-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00064-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00028-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00028-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00014-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00014-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00029-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00029-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00011-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00011-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00051-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00051-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00046-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00046-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00031-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00031-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00032-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00032-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00006-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00006-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00026-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00026-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00061-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00061-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00017-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00017-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00045-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00045-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00050-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00050-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: e6af1b9d-7c4d-98d9-971b-f0a74861ab0d, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: 6065341f-5662-9cb8-8404-7872a1f7c673, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00055-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00055-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00047-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00047-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00058-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00058-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: 4d4cf4ae-97a2-9955-98bf-0c6f5eb274d0, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00034-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00034-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00052-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00052-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00066-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00066-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00001-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00001-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00068-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00068-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: fc7003a3-fc4b-9aa1-8bdc-c058504e6751, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: 495bf5b0-1b8f-95b5-b2e1-2d972bb5d950, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: 74530880-ca9c-90b8-b0f7-2a74bb562f83, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: DEBUG retryable error: InternalError: We encountered an internal error, please try again.
chaiml-grpo-glm50-combi-44700-v2-uploader: 	status code: 500, request id: 8afbe2d6-ee91-9396-b4ba-8e50ef5574f7, host id: 
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00037-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00037-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00005-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00005-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00053-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00053-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00069-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00069-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00059-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00059-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00067-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00067-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00003-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00003-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00008-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00008-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00070-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00070-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00072-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00072-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00042-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00042-of-00075.safetensors
chaiml-grpo-glm50-combi-44700-v2-uploader: cp /tmp/model_output/model-00021-of-00075.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm50-combi-44700-v2/default/model-00021-of-00075.safetensors
2026-04-04T05:31:15.637660+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
Job chaiml-grpo-glm50-combi-44700-v2-uploader completed after 308.47s with status: succeeded
Stopping job with name chaiml-grpo-glm50-combi-44700-v2-uploader
Pipeline stage VLLMUploader completed in 308.96s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.11s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.09s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm50-combi-44700-v2
Waiting for inference service chaiml-grpo-glm50-combi-44700-v2 to be ready
2026-04-04T05:32:15.735043+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
2026-04-04T05:33:15.828656+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
2026-04-04T05:34:16.157445+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
2026-04-04T05:35:16.288630+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
2026-04-04T05:36:16.382227+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
2026-04-04T05:37:16.667470+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
Inference service chaiml-grpo-glm50-combi-44700-v2 ready after 360.7645127773285s
Pipeline stage VLLMDeployer completed in 361.36s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 11.47958755493164s
Received healthy response to inference request in 2.4972519874572754s
Received healthy response to inference request in 2.668776273727417s
Received healthy response to inference request in 2.553776264190674s
Received healthy response to inference request in 2.6266891956329346s
Received healthy response to inference request in 2.6328065395355225s
Received healthy response to inference request in 2.6669328212738037s
Received healthy response to inference request in 2.721421003341675s
Received healthy response to inference request in 3.372084856033325s
Received healthy response to inference request in 2.748239040374756s
Received healthy response to inference request in 2.795426607131958s
Received healthy response to inference request in 2.670766592025757s
Received healthy response to inference request in 2.627652883529663s
Received healthy response to inference request in 2.6723880767822266s
2026-04-04T05:38:16.837488+00:00 monitor updated for chaiml-grpo-glm50-combi_44700_v2
Received healthy response to inference request in 2.69093918800354s
Received healthy response to inference request in 2.881925106048584s
Received healthy response to inference request in 2.6646833419799805s
Received healthy response to inference request in 2.998957633972168s
Received healthy response to inference request in 2.565645933151245s
Received healthy response to inference request in 2.5539650917053223s
Received healthy response to inference request in 2.5647549629211426s
Received healthy response to inference request in 2.667933702468872s
Received healthy response to inference request in 2.7027175426483154s
Received healthy response to inference request in 2.7101998329162598s
Received healthy response to inference request in 2.804448127746582s
Received healthy response to inference request in 2.72721266746521s
Received healthy response to inference request in 2.581101179122925s
Received healthy response to inference request in 2.7777225971221924s
Received healthy response to inference request in 2.70571231842041s
Received healthy response to inference request in 11.3534996509552s
30 requests
0 failed requests
5th percentile: 2.5538612365722657
10th percentile: 2.5636759757995606
20th percentile: 2.6175715923309326
30th percentile: 2.655120301246643
40th percentile: 2.668439245223999
50th percentile: 2.6816636323928833
60th percentile: 2.70750732421875
70th percentile: 2.7335205793380735
80th percentile: 2.797230911254883
90th percentile: 3.0362703561782842
95th percentile: 7.761862993240333
99th percentile: 11.443022062778473
mean time: 3.289507285753886
Pipeline stage StressChecker completed in 101.62s
Shutdown handler de-registered
chaiml-grpo-glm50-combi_44700_v2 status is now deployed due to DeploymentManager action
chaiml-grpo-glm50-combi_44700_v2 status is now inactive due to auto deactivation removed underperforming models