chaiml-opusd-v4-g46-mas_11495

developer_uid: zonemercy
submission_id: chaiml-opusd-v4-g46-mas_11495_v3
model_name: chaiml-opusd-v4-g46-mas_11495_v3
model_group: ChaiML/opusd-v4-g46-mask
status: torndown
timestamp: 2026-03-08T07:54:03+00:00
num_battles: 10991
num_wins: 6074
celo_rating: 1331.61
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-opusd-v4-g46-mas_11495_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-04
win_ratio: 0.5526339732508416
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-opusd-v4-g46-mas-11495-v3-uploader
Waiting for job on chaiml-opusd-v4-g46-mas-11495-v3-uploader to finish
chaiml-opusd-v4-g46-mas-11495-v3-uploader: Using quantization_mode: fp8
chaiml-opusd-v4-g46-mas-11495-v3-uploader: Checking if ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack-FP8 already exists in ChaiML
chaiml-opusd-v4-g46-mas-11495-v3-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-opusd-v4-g46-mas-11495-v3-uploader: Downloading snapshot of ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack-FP8...
chaiml-opusd-v4-g46-mas-11495-v3-uploader: Downloaded in 123.654s
chaiml-opusd-v4-g46-mas-11495-v3-uploader: Processed model ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack in 127.185s
chaiml-opusd-v4-g46-mas-11495-v3-uploader: creating bucket guanaco-vllm-models
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-opusd-v4-g46-mas-11495-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-opusd-v4-g46-mas-11495-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-opusd-v4-g46-mas-11495-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/generation_config.json
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/chat_template.jinja
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/.gitattributes
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/config.json
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/recipe.yaml
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/tokenizer_config.json
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/special_tokens_map.json
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model.safetensors.index.json
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/tokenizer.json
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00072-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00071-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00027-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00058-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00042-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00033-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00016-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00020-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00030-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00034-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00029-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00019-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00017-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00007-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00038-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00026-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00049-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00031-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00002-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00064-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00070-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00021-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00066-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00048-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00032-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00060-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00061-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00022-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00001-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00050-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00054-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00044-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00004-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00045-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00005-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00028-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00010-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00043-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00006-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00046-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00036-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00067-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00062-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00009-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00065-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00047-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00053-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00039-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00014-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00003-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00037-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00041-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00018-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00055-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00040-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00035-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00063-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00056-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00011-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00008-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00057-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00013-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00015-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00059-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00051-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00052-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00068-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00023-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00069-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00025-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00024-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v3-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v3/default/model-00012-of-00072.safetensors
Job chaiml-opusd-v4-g46-mas-11495-v3-uploader completed after 268.87s with status: succeeded
Stopping job with name chaiml-opusd-v4-g46-mas-11495-v3-uploader
Pipeline stage VLLMUploader completed in 269.34s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.86s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-opusd-v4-g46-mas-11495-v3
Waiting for inference service chaiml-opusd-v4-g46-mas-11495-v3 to be ready
Inference service chaiml-opusd-v4-g46-mas-11495-v3 ready after 620.8287034034729s
Pipeline stage VLLMDeployer completed in 621.27s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2409510612487793s
Received healthy response to inference request in 2.2881884574890137s
Received healthy response to inference request in 2.097485065460205s
Received healthy response to inference request in 1.903806209564209s
Received healthy response to inference request in 1.9986586570739746s
Received healthy response to inference request in 2.0402419567108154s
Received healthy response to inference request in 2.319348096847534s
Received healthy response to inference request in 2.194709539413452s
Received healthy response to inference request in 2.1792845726013184s
Received healthy response to inference request in 3.0403969287872314s
Received healthy response to inference request in 2.196749448776245s
Received healthy response to inference request in 2.0097832679748535s
Received healthy response to inference request in 1.9531598091125488s
Received healthy response to inference request in 2.0899369716644287s
Received healthy response to inference request in 1.8784136772155762s
Received healthy response to inference request in 2.0788846015930176s
Received healthy response to inference request in 2.2086968421936035s
Received healthy response to inference request in 2.017300605773926s
Received healthy response to inference request in 2.3440427780151367s
Received healthy response to inference request in 2.589437961578369s
Received healthy response to inference request in 2.039829969406128s
Received healthy response to inference request in 2.2468461990356445s
Received healthy response to inference request in 2.4478018283843994s
Received healthy response to inference request in 2.419940948486328s
Received healthy response to inference request in 2.4079840183258057s
Received healthy response to inference request in 1.886192798614502s
Received healthy response to inference request in 2.015678882598877s
Received healthy response to inference request in 2.119356870651245s
Received healthy response to inference request in 2.1658449172973633s
Received healthy response to inference request in 2.021538734436035s
30 requests
0 failed requests
5th percentile: 1.8941188335418702
10th percentile: 1.9482244491577148
20th percentile: 2.0144997596740724
30th percentile: 2.0343425989151003
40th percentile: 2.085516023635864
50th percentile: 2.142600893974304
60th percentile: 2.1955255031585694
70th percentile: 2.242719602584839
80th percentile: 2.3242870330810548
90th percentile: 2.422727036476135
95th percentile: 2.5257017016410823
99th percentile: 2.909618828296662
mean time: 2.1813497225443523
Pipeline stage StressChecker completed in 70.27s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.84s
Shutdown handler de-registered
chaiml-opusd-v4-g46-mas_11495_v3 status is now deployed due to DeploymentManager action
chaiml-opusd-v4-g46-mas_11495_v3 status is now inactive due to auto deactivation removed underperforming models
Deleting key chaiml-pony-d2-g46-o4-l-42687-v3/default/tokenizer.json from bucket guanaco-vllm-models
chaiml-opusd-v4-g46-mas_11495_v3 status is now torndown due to DeploymentManager action