developer_uid: zonemercy
submission_id: chaiml-opusd-v4-g46-mas_11495_v4
model_name: chaiml-opusd-v4-g46-mas_11495_v4
model_group: ChaiML/opusd-v4-g46-mask
status: torndown
timestamp: 2026-03-08T12:33:53+00:00
num_battles: 11595
num_wins: 6190
celo_rating: 1319.23
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-opusd-v4-g46-mas_11495_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.5338507977576542
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n<think></think>\n{message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Connection pool is full, discarding connection: %s. Connection pool size: %s
Starting job with name chaiml-opusd-v4-g46-mas-11495-v4-uploader
Waiting for job on chaiml-opusd-v4-g46-mas-11495-v4-uploader to finish
chaiml-opusd-v4-g46-mas-11495-v4-uploader: Using quantization_mode: fp8
chaiml-opusd-v4-g46-mas-11495-v4-uploader: Checking if ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack-FP8 already exists in ChaiML
chaiml-opusd-v4-g46-mas-11495-v4-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-opusd-v4-g46-mas-11495-v4-uploader: Downloading snapshot of ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack-FP8...
chaiml-opusd-v4-g46-mas-11495-v4-uploader: Downloaded in 137.611s
chaiml-opusd-v4-g46-mas-11495-v4-uploader: Processed model ChaiML/opusd-v4-g46-masked-think-lr1e4ep1r64b16-pack in 141.058s
chaiml-opusd-v4-g46-mas-11495-v4-uploader: creating bucket guanaco-vllm-models
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-opusd-v4-g46-mas-11495-v4-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-opusd-v4-g46-mas-11495-v4-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-opusd-v4-g46-mas-11495-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-opusd-v4-g46-mas-11495-v4-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/chat_template.jinja
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/config.json
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/generation_config.json
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/.gitattributes
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/special_tokens_map.json
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/recipe.yaml
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/tokenizer_config.json
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model.safetensors.index.json
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/tokenizer.json
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00072-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00071-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00056-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00007-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00024-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00004-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00036-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00040-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00069-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00031-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00029-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00041-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00003-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00005-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00008-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00019-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00023-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00061-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00010-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00006-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00015-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00066-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00020-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00039-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00013-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00058-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00021-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00037-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00018-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00002-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00054-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00050-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00055-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00065-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00047-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00062-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00038-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00070-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00016-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00067-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00063-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00049-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00026-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00060-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00035-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00001-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00032-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00048-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00009-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00068-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00028-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00052-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00014-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00045-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00051-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00057-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00042-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00011-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00034-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00033-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00017-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00044-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00025-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00043-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00030-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00027-of-00072.safetensors
chaiml-opusd-v4-g46-mas-11495-v4-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-mas-11495-v4/default/model-00053-of-00072.safetensors
Job chaiml-opusd-v4-g46-mas-11495-v4-uploader completed after 278.73s with status: succeeded
Stopping job with name chaiml-opusd-v4-g46-mas-11495-v4-uploader
Pipeline stage VLLMUploader completed in 280.37s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.11s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-opusd-v4-g46-mas-11495-v4
Waiting for inference service chaiml-opusd-v4-g46-mas-11495-v4 to be ready
Inference service chaiml-opusd-v4-g46-mas-11495-v4 ready after 591.9216272830963s
Pipeline stage VLLMDeployer completed in 592.43s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9472301006317139s
Received healthy response to inference request in 2.033951997756958s
Received healthy response to inference request in 2.3611698150634766s
Received healthy response to inference request in 2.186981439590454s
Received healthy response to inference request in 2.140333652496338s
Received healthy response to inference request in 1.8877840042114258s
Received healthy response to inference request in 2.001467227935791s
Received healthy response to inference request in 2.4855005741119385s
Received healthy response to inference request in 2.042462110519409s
Received healthy response to inference request in 2.026655912399292s
Received healthy response to inference request in 1.7351911067962646s
Received healthy response to inference request in 2.780921459197998s
Received healthy response to inference request in 2.1128618717193604s
Received healthy response to inference request in 2.0712878704071045s
Received healthy response to inference request in 2.561647415161133s
Received healthy response to inference request in 1.9379098415374756s
Received healthy response to inference request in 2.0651369094848633s
Received healthy response to inference request in 2.4711005687713623s
Received healthy response to inference request in 2.0282058715820312s
Received healthy response to inference request in 1.8690428733825684s
Received healthy response to inference request in 2.77225661277771s
Received healthy response to inference request in 1.9793860912322998s
Received healthy response to inference request in 2.1681814193725586s
Received healthy response to inference request in 2.0813393592834473s
Received healthy response to inference request in 2.182112216949463s
Received healthy response to inference request in 2.180577516555786s
Received healthy response to inference request in 1.9926369190216064s
Received healthy response to inference request in 2.298887014389038s
Received healthy response to inference request in 1.9418272972106934s
Received healthy response to inference request in 2.212127685546875s
30 requests
0 failed requests
5th percentile: 1.8774763822555542
10th percentile: 1.9328972578048706
20th percentile: 1.9729548931121828
30th percentile: 2.019099307060242
40th percentile: 2.039058065414429
50th percentile: 2.076313614845276
60th percentile: 2.1514727592468263
70th percentile: 2.1835729837417603
80th percentile: 2.311343574523926
90th percentile: 2.493115258216858
95th percentile: 2.6774824738502496
99th percentile: 2.7784086537361143
mean time: 2.151872491836548
Pipeline stage StressChecker completed in 80.26s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.79s
Shutdown handler de-registered
chaiml-opusd-v4-g46-mas_11495_v4 status is now deployed due to DeploymentManager action
chaiml-opusd-v4-g46-mas_11495_v4 status is now inactive due to auto deactivation removed underperforming models
chaiml-opusd-v4-g46-mas_11495_v4 status is now torndown due to DeploymentManager action