developer_uid: chai_backend_admin
submission_id: chaiml-grpo-glm46-combi_83700_v7
model_name: chaiml-grpo-glm46-combi_83700_v7
model_group: ChaiML/grpo-glm46-combin
status: torndown
timestamp: 2026-03-12T16:41:33+00:00
num_battles: 1114
num_wins: 542
celo_rating: 9066.11
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm46-combine-rm82-step100
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm46-combi_83700_v7
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm46-combine-rm82-step100
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-09
win_ratio: 0.4865350089766607
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '####', '<|user|>', '<|assistant|>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n<think></think>\n{message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm46-combi-83700-v7-uploader
Waiting for job on chaiml-grpo-glm46-combi-83700-v7-uploader to finish
chaiml-grpo-glm46-combi-83700-v7-uploader: Using quantization_mode: fp8
chaiml-grpo-glm46-combi-83700-v7-uploader: Checking if ChaiML/grpo-glm46-combine-rm82-step100-FP8 already exists in ChaiML
chaiml-grpo-glm46-combi-83700-v7-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-grpo-glm46-combi-83700-v7-uploader: Downloading snapshot of ChaiML/grpo-glm46-combine-rm82-step100-FP8...
chaiml-grpo-glm46-combi-83700-v7-uploader: Downloaded in 168.836s
chaiml-grpo-glm46-combi-83700-v7-uploader: Processed model ChaiML/grpo-glm46-combine-rm82-step100 in 172.357s
chaiml-grpo-glm46-combi-83700-v7-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v7-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm46-combi-83700-v7-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v7-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v7-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v7-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-83700-v7-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm46-combi-83700-v7-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm46-combi-83700-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm46-combi-83700-v7-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm46-combi-83700-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm46-combi-83700-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/generation_config.json
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/.gitattributes
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/config.json
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/chat_template.jinja
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/recipe.yaml
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/special_tokens_map.json
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/tokenizer_config.json
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model.safetensors.index.json
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/tokenizer.json
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00072-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00071-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00020-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00037-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00047-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00034-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00060-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00057-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00054-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00055-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00004-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00027-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00026-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00046-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00042-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00009-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00005-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00002-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00044-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00014-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00025-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00066-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00033-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00031-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00007-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00030-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00015-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00012-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00070-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00048-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00024-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00065-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00035-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00036-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00013-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00069-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00003-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00043-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00068-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00061-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00001-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00056-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00041-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00008-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00045-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00010-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00059-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00067-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00049-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00006-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00017-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00023-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00050-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00032-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00062-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00058-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00021-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00040-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00022-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00029-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00039-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00064-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00052-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00063-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00019-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00018-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00028-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00053-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00016-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00011-of-00072.safetensors
chaiml-grpo-glm46-combi-83700-v7-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-83700-v7/default/model-00038-of-00072.safetensors
Job chaiml-grpo-glm46-combi-83700-v7-uploader completed after 313.65s with status: succeeded
Stopping job with name chaiml-grpo-glm46-combi-83700-v7-uploader
Pipeline stage VLLMUploader completed in 314.18s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.18s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm46-combi-83700-v7
Waiting for inference service chaiml-grpo-glm46-combi-83700-v7 to be ready
Inference service chaiml-grpo-glm46-combi-83700-v7 ready after 670.7850668430328s
Pipeline stage VLLMDeployer completed in 671.34s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4212539196014404s
Received healthy response to inference request in 2.083683490753174s
Received healthy response to inference request in 2.127331018447876s
Received healthy response to inference request in 2.120352029800415s
Received healthy response to inference request in 2.185410976409912s
Received healthy response to inference request in 2.1193020343780518s
Received healthy response to inference request in 2.2649364471435547s
Received healthy response to inference request in 2.1514432430267334s
Received healthy response to inference request in 2.158292055130005s
Received healthy response to inference request in 2.4702680110931396s
Received healthy response to inference request in 2.32749605178833s
Received healthy response to inference request in 2.26760196685791s
Received healthy response to inference request in 2.3901946544647217s
Received healthy response to inference request in 2.1227128505706787s
Received healthy response to inference request in 2.0888521671295166s
Received healthy response to inference request in 2.121542453765869s
Received healthy response to inference request in 2.1376993656158447s
Received healthy response to inference request in 2.630044460296631s
Received healthy response to inference request in 2.1170685291290283s
Received healthy response to inference request in 2.2147164344787598s
Received healthy response to inference request in 2.1563446521759033s
Received healthy response to inference request in 2.163182020187378s
Received healthy response to inference request in 2.1705496311187744s
Received healthy response to inference request in 2.3532121181488037s
Received healthy response to inference request in 2.2689642906188965s
Received healthy response to inference request in 2.185224771499634s
Received healthy response to inference request in 2.115335702896118s
Received healthy response to inference request in 2.1187167167663574s
Received healthy response to inference request in 2.225620985031128s
Received healthy response to inference request in 2.3424689769744873s
30 requests
0 failed requests
5th percentile: 2.1007697582244873
10th percentile: 2.116895246505737
20th percentile: 2.120142030715942
30th percentile: 2.125945568084717
40th percentile: 2.1543840885162355
50th percentile: 2.166865825653076
60th percentile: 2.1971331596374513
70th percentile: 2.2657361030578613
80th percentile: 2.3304906368255613
90th percentile: 2.3933005809783934
95th percentile: 2.448211669921875
99th percentile: 2.5837092900276186
mean time: 2.2206607341766356
Pipeline stage StressChecker completed in 70.71s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.18s
Shutdown handler de-registered
chaiml-grpo-glm46-combi_83700_v7 status is now deployed due to DeploymentManager action
chaiml-grpo-glm46-combi_83700_v7 status is now torndown due to DeploymentManager action