developer_uid: zonemercy
submission_id: chaiml-opusd-v4-g46-mas_11495_v2
model_name: chaiml-opusd-v4-g46-mas_11495_v2
model_group: ChaiML/opusd-v4-g46-mask
status: torndown
timestamp: 2026-03-08T07:53:08+00:00
num_battles: 11171
num_wins: 6160
celo_rating: 1329.13
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-opusd-v4-g46-mas_11495_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-04
win_ratio: 0.5514278041357086
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-opusd-v4-g46-mas-11495-v2-uploader
Waiting for job on chaiml-opusd-v4-g46-mas-11495-v2-uploader to finish
chaiml-opusd-v4-g46-mas-11495-v2-uploader: Using quantization_mode: fp8
chaiml-opusd-v4-g46-mas-11495-v2-uploader: Checking if ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack-FP8 already exists in ChaiML
chaiml-opusd-v4-g46-mas-11495-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-opusd-v4-g46-mas-11495-v2-uploader: Downloading snapshot of ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack-FP8...
chaiml-opusd-v4-g46-mas-11495-v2-uploader: Downloaded in 136.279s
chaiml-opusd-v4-g46-mas-11495-v2-uploader: Processed model ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack in 139.814s
chaiml-opusd-v4-g46-mas-11495-v2-uploader: creating bucket guanaco-vllm-models
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-opusd-v4-g46-mas-11495-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-opusd-v4-g46-mas-11495-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-opusd-v4-g46-mas-11495-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/special_tokens_map.json
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/.gitattributes
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/generation_config.json
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/tokenizer_config.json
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/config.json
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/chat_template.jinja
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/recipe.yaml
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model.safetensors.index.json
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00072-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00071-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00033-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00028-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00021-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00016-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00034-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00035-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00063-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00038-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00065-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00048-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00040-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00053-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00047-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00046-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00059-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00030-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00012-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00051-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00055-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00052-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00064-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00069-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00010-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00029-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00024-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00020-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00019-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00013-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00036-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00042-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00039-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00054-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00067-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00056-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00018-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00001-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00015-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00066-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00060-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00008-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00032-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00014-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00070-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00023-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00006-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00003-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00057-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00005-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00004-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00011-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00049-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00017-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00031-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00041-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00043-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00050-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00007-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00045-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00002-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00026-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00068-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00058-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00061-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00025-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00037-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00044-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00027-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00009-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00062-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v2-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v2/default/model-00022-of-00072.safetensors
Job chaiml-opusd-v4-g46-mas-11495-v2-uploader completed after 279.28s with status: succeeded
Stopping job with name chaiml-opusd-v4-g46-mas-11495-v2-uploader
Pipeline stage VLLMUploader completed in 279.76s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.74s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-opusd-v4-g46-mas-11495-v2
Waiting for inference service chaiml-opusd-v4-g46-mas-11495-v2 to be ready
Inference service chaiml-opusd-v4-g46-mas-11495-v2 ready after 632.6828036308289s
Pipeline stage VLLMDeployer completed in 634.03s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.09391713142395s
Received healthy response to inference request in 2.650156259536743s
Received healthy response to inference request in 2.585240602493286s
Received healthy response to inference request in 1.9869990348815918s
Received healthy response to inference request in 2.204775333404541s
Received healthy response to inference request in 2.0233261585235596s
Received healthy response to inference request in 2.6113221645355225s
Received healthy response to inference request in 2.167914867401123s
Received healthy response to inference request in 2.0328872203826904s
Received healthy response to inference request in 1.8945598602294922s
Received healthy response to inference request in 1.9193034172058105s
Received healthy response to inference request in 2.029766321182251s
Received healthy response to inference request in 1.956416130065918s
Received healthy response to inference request in 2.490756034851074s
Received healthy response to inference request in 2.04044246673584s
Received healthy response to inference request in 2.203001022338867s
Received healthy response to inference request in 2.284794569015503s
Received healthy response to inference request in 2.4698479175567627s
Received healthy response to inference request in 2.4518089294433594s
Received healthy response to inference request in 2.1902053356170654s
Received healthy response to inference request in 1.9615070819854736s
Received healthy response to inference request in 1.866199016571045s
Received healthy response to inference request in 2.0327606201171875s
Received healthy response to inference request in 2.6512861251831055s
Received healthy response to inference request in 2.217794895172119s
Received healthy response to inference request in 2.0777957439422607s
Received healthy response to inference request in 2.0345869064331055s
Received healthy response to inference request in 2.1639225482940674s
Received healthy response to inference request in 2.128006935119629s
Received healthy response to inference request in 2.0229954719543457s
30 requests
0 failed requests
5th percentile: 1.9056944608688355
10th percentile: 1.9527048587799072
20th percentile: 2.015796184539795
30th percentile: 2.0318623304367067
40th percentile: 2.038100242614746
50th percentile: 2.1109620332717896
60th percentile: 2.1768310546875
70th percentile: 2.2086812019348145
80th percentile: 2.4554167270660403
90th percentile: 2.58784875869751
95th percentile: 2.6326809167861938
99th percentile: 2.6509584641456603
mean time: 2.1814765373865765
Pipeline stage StressChecker completed in 70.17s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
Shutdown handler de-registered
chaiml-opusd-v4-g46-mas_11495_v2 status is now deployed due to DeploymentManager action
chaiml-opusd-v4-g46-mas_11495_v2 status is now inactive due to auto deactivation removed underperforming models
Deleting key chaiml-pony-d2-g46-o4-l-42687-v2/default/tokenizer_config.json from bucket guanaco-vllm-models
chaiml-opusd-v4-g46-mas_11495_v2 status is now torndown due to DeploymentManager action