chaiml-grpo-glm46-combi_55826

developer_uid: chai_backend_admin
submission_id: chaiml-grpo-glm46-combi_55826_v2
model_name: chaiml-grpo-glm46-combi_55826_v2
model_group: ChaiML/grpo-glm46-combin
status: torndown
timestamp: 2026-03-11T18:28:33+00:00
num_battles: 11351
num_wins: 6111
celo_rating: 1320.46
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm46-combine-rm82-lr5e6-step200
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm46-combi_55826_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm46-combine-rm82-lr5e6-step200
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-08
win_ratio: 0.5383666637300678
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|user|>', '<|im_end|>', '</s>', '<|assistant|>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm46-combi-55826-v2-uploader
Waiting for job on chaiml-grpo-glm46-combi-55826-v2-uploader to finish
chaiml-grpo-glm46-combi-55826-v2-uploader: Using quantization_mode: fp8
chaiml-grpo-glm46-combi-55826-v2-uploader: Checking if ChaiML/grpo-glm46-combine-rm82-lr5e6-step200-FP8 already exists in ChaiML
chaiml-grpo-glm46-combi-55826-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-grpo-glm46-combi-55826-v2-uploader: Downloading snapshot of ChaiML/grpo-glm46-combine-rm82-lr5e6-step200-FP8...
chaiml-grpo-glm46-combi-55826-v2-uploader: Downloaded in 136.094s
chaiml-grpo-glm46-combi-55826-v2-uploader: Processed model ChaiML/grpo-glm46-combine-rm82-lr5e6-step200 in 139.795s
chaiml-grpo-glm46-combi-55826-v2-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-55826-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm46-combi-55826-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-55826-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-55826-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-55826-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-55826-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm46-combi-55826-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm46-combi-55826-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm46-combi-55826-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm46-combi-55826-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm46-combi-55826-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/config.json
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/generation_config.json
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/chat_template.jinja
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/.gitattributes
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/tokenizer_config.json
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/recipe.yaml
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/special_tokens_map.json
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00072-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00071-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00026-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00003-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00048-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00051-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00027-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00017-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00034-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00012-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00047-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00015-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00049-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00058-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00068-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00013-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00052-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00069-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00005-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00010-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00046-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00016-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00045-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00018-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00004-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00014-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00066-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00011-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00029-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00021-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00043-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00009-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00033-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00023-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00028-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00036-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00007-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00030-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00037-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00038-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00042-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00040-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00020-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00001-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00070-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00002-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00054-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00024-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00025-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00019-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00035-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00006-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00044-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00031-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00041-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00060-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00059-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00053-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00039-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00050-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00055-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00032-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00056-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00062-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00057-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00022-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00065-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00063-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00008-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00067-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00061-of-00072.safetensors
chaiml-grpo-glm46-combi-55826-v2-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-55826-v2/default/model-00064-of-00072.safetensors
Job chaiml-grpo-glm46-combi-55826-v2-uploader completed after 279.23s with status: succeeded
Stopping job with name chaiml-grpo-glm46-combi-55826-v2-uploader
Pipeline stage VLLMUploader completed in 279.79s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.61s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm46-combi-55826-v2
Waiting for inference service chaiml-grpo-glm46-combi-55826-v2 to be ready
Inference service chaiml-grpo-glm46-combi-55826-v2 ready after 601.16290807724s
Pipeline stage VLLMDeployer completed in 601.67s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3560447692871094s
Received healthy response to inference request in 2.1366353034973145s
Received healthy response to inference request in 2.18288254737854s
Received healthy response to inference request in 2.3296005725860596s
Received healthy response to inference request in 2.144420862197876s
Received healthy response to inference request in 2.232689619064331s
Received healthy response to inference request in 2.2941107749938965s
Received healthy response to inference request in 2.153416872024536s
Received healthy response to inference request in 2.351649284362793s
Received healthy response to inference request in 2.1471266746520996s
Received healthy response to inference request in 2.208252429962158s
Received healthy response to inference request in 2.2725236415863037s
Received healthy response to inference request in 2.1620309352874756s
Received healthy response to inference request in 2.141896963119507s
Received healthy response to inference request in 2.1931312084198s
Received healthy response to inference request in 2.1408464908599854s
Received healthy response to inference request in 2.2575931549072266s
Received healthy response to inference request in 2.1567652225494385s
Received healthy response to inference request in 2.137751579284668s
Received healthy response to inference request in 2.225938558578491s
Received healthy response to inference request in 2.1464145183563232s
Received healthy response to inference request in 2.1874337196350098s
Received healthy response to inference request in 2.0977425575256348s
Received healthy response to inference request in 2.1614816188812256s
Received healthy response to inference request in 2.4765989780426025s
Received healthy response to inference request in 2.1419906616210938s
Received healthy response to inference request in 2.2926483154296875s
Received healthy response to inference request in 2.3442695140838623s
Received healthy response to inference request in 2.576387405395508s
Received healthy response to inference request in 2.1398441791534424s
30 requests
0 failed requests
5th percentile: 2.1371376276016236
10th percentile: 2.139634919166565
20th percentile: 2.1419719219207765
30th percentile: 2.146913027763367
40th percentile: 2.1595950603485106
50th percentile: 2.185158133506775
60th percentile: 2.2153268814086915
70th percentile: 2.26207230091095
80th percentile: 2.301208734512329
90th percentile: 2.3520888328552245
95th percentile: 2.4223495841026303
99th percentile: 2.5474487614631656
mean time: 2.2263372977574667
Pipeline stage StressChecker completed in 71.02s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.95s
Shutdown handler de-registered
chaiml-grpo-glm46-combi_55826_v2 status is now deployed due to DeploymentManager action
chaiml-grpo-glm46-combi_55826_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-grpo-glm46-combi_55826_v2 status is now torndown due to DeploymentManager action