chaiml-grpo-glm46-combi_83700

developer_uid: richhx
submission_id: chaiml-grpo-glm46-combi_83700_v6
model_name: chaiml-grpo-glm46-combi_83700_v6
model_group: ChaiML/grpo-glm46-combin
status: inactive
timestamp: 2026-03-05T21:15:29+00:00
num_battles: 1334
num_wins: 669
celo_rating: 9271.13
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm46-combine-rm82-step100
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm46-combi_83700_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm46-combine-rm82-step100
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.5014992503748126
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '####', '<|user|>', '<|assistant|>', '<|im_end|>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n<think></think>\n{message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm46-combi-83700-v6-uploader
Waiting for job on chaiml-grpo-glm46-combi-83700-v6-uploader to finish
chaiml-grpo-glm46-combi-83700-v6-uploader: Using quantization_mode: fp8
chaiml-grpo-glm46-combi-83700-v6-uploader: Checking if ChaiML/grpo-glm46-combine-rm82-step100-FP8 already exists in ChaiML
chaiml-grpo-glm46-combi-83700-v6-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-grpo-glm46-combi-83700-v6-uploader: Downloading snapshot of ChaiML/grpo-glm46-combine-rm82-step100-FP8...
chaiml-grpo-glm46-combi-83700-v6-uploader: Downloaded in 157.538s
chaiml-grpo-glm46-combi-83700-v6-uploader: Processed model ChaiML/grpo-glm46-combine-rm82-step100 in 161.113s
chaiml-grpo-glm46-combi-83700-v6-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v6-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm46-combi-83700-v6-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v6-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v6-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v6-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v6-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm46-combi-83700-v6-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm46-combi-83700-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm46-combi-83700-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm46-combi-83700-v6-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm46-combi-83700-v6-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/chat_template.jinja
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/generation_config.json
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/special_tokens_map.json
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/.gitattributes
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model.safetensors.index.json
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/config.json
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/recipe.yaml
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/tokenizer_config.json
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00072-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00071-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00051-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00023-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00048-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00028-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00040-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00041-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00021-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00018-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00065-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00012-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00064-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00042-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00019-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00043-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00050-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00039-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00033-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00052-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00044-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00014-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00025-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00010-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00006-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00054-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00063-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00047-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00067-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00055-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00045-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00031-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00027-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00057-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00009-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00046-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00038-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00003-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00024-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00056-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00068-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00005-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00030-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00004-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00029-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00070-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00011-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00037-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00059-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00053-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00022-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00061-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00020-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00016-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00062-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00066-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00034-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00017-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00049-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00060-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00026-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00035-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00013-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00002-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00001-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00069-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00008-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00015-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00032-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00036-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00007-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v6-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v6/default/model-00058-of-00072.safetensors
Job chaiml-grpo-glm46-combi-83700-v6-uploader completed after 300.79s with status: succeeded
Stopping job with name chaiml-grpo-glm46-combi-83700-v6-uploader
Pipeline stage VLLMUploader completed in 301.36s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.84s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm46-combi-83700-v6
Waiting for inference service chaiml-grpo-glm46-combi-83700-v6 to be ready
Inference service chaiml-grpo-glm46-combi-83700-v6 ready after 590.9593231678009s
Pipeline stage VLLMDeployer completed in 591.40s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.258268117904663s
Received healthy response to inference request in 2.4560904502868652s
Received healthy response to inference request in 2.557966470718384s
Received healthy response to inference request in 2.209489345550537s
Received healthy response to inference request in 2.421567440032959s
Received healthy response to inference request in 2.108684778213501s
Received healthy response to inference request in 2.4644734859466553s
Received healthy response to inference request in 2.1120121479034424s
Received healthy response to inference request in 3.043578863143921s
Received healthy response to inference request in 2.361635446548462s
Received healthy response to inference request in 2.3739819526672363s
Received healthy response to inference request in 2.1869964599609375s
Received healthy response to inference request in 2.469780683517456s
Received healthy response to inference request in 2.1181318759918213s
Received healthy response to inference request in 2.8340511322021484s
Received healthy response to inference request in 2.0743699073791504s
Received healthy response to inference request in 3.175574541091919s
Received healthy response to inference request in 2.298668622970581s
Received healthy response to inference request in 2.764984369277954s
Received healthy response to inference request in 2.393866777420044s
Received healthy response to inference request in 2.4117588996887207s
Received healthy response to inference request in 2.3128581047058105s
Received healthy response to inference request in 2.8181793689727783s
Received healthy response to inference request in 2.9119887351989746s
Received healthy response to inference request in 2.2153453826904297s
Received healthy response to inference request in 2.1808433532714844s
Received healthy response to inference request in 2.7621052265167236s
Received healthy response to inference request in 2.687264919281006s
Received healthy response to inference request in 2.6592142581939697s
Received healthy response to inference request in 2.3576018810272217s
30 requests
0 failed requests
5th percentile: 2.1101820945739744
10th percentile: 2.117519903182983
20th percentile: 2.204990768432617
30th percentile: 2.2865484714508058
40th percentile: 2.360022020339966
50th percentile: 2.4028128385543823
60th percentile: 2.4594436645507813
70th percentile: 2.5883408069610594
80th percentile: 2.7626810550689695
90th percentile: 2.841844892501831
95th percentile: 2.984363305568695
99th percentile: 3.1372957944869997
mean time: 2.466711099942525
Pipeline stage StressChecker completed in 78.06s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.13s
Shutdown handler de-registered
chaiml-grpo-glm46-combi_83700_v6 status is now deployed due to DeploymentManager action
chaiml-grpo-glm46-combi_83700_v6 status is now inactive due to system request