developer_uid: zonemercy
submission_id: chaiml-opusd-v4-g46-lr1_69112_v7
model_name: chaiml-opusd-v4-g46-lr1_69112_v7
model_group: ChaiML/opusd-v4-g46-lr1e
status: torndown
timestamp: 2026-03-08T12:33:37+00:00
num_battles: 11652
num_wins: 6499
celo_rating: 1334.62
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/opusd-v4-g46-lr1e4ep1r64b16
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-opusd-v4-g46-lr1_69112_v7
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/opusd-v4-g46-lr1e4ep1r64b16
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.5577583247511156
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-opusd-v4-g46-lr1-69112-v7-uploader
Waiting for job on chaiml-opusd-v4-g46-lr1-69112-v7-uploader to finish
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: Using quantization_mode: fp8
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: Checking if ChaiML/opusd-v4-g46-lr1e4ep1r64b16-FP8 already exists in ChaiML
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: Downloading snapshot of ChaiML/opusd-v4-g46-lr1e4ep1r64b16-FP8...
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: Downloaded in 139.485s
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: Processed model ChaiML/opusd-v4-g46-lr1e4ep1r64b16 in 142.912s
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: creating bucket guanaco-vllm-models
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-opusd-v4-g46-lr1-69112-v7-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/generation_config.json
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/.gitattributes
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/config.json
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/chat_template.jinja
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/recipe.yaml
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/special_tokens_map.json
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/tokenizer_config.json
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model.safetensors.index.json
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/tokenizer.json
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00072-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00071-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00057-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00015-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00061-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00012-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00027-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00004-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00053-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00054-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00019-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00009-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00030-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00010-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00002-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00036-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00049-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00033-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00014-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00069-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00038-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00007-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00050-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00020-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00058-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00028-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00047-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00016-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00046-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00055-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00006-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00063-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00024-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00062-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00042-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00003-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00005-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00032-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00039-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00059-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00001-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00040-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00037-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00021-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00008-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00023-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00068-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00056-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00017-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00060-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00041-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00070-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00048-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00065-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00035-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00066-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00029-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00018-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00011-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00013-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00067-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v7-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v7/default/model-00052-of-00072.safetensors
Job chaiml-opusd-v4-g46-lr1-69112-v7-uploader completed after 288.56s with status: succeeded
Stopping job with name chaiml-opusd-v4-g46-lr1-69112-v7-uploader
Pipeline stage VLLMUploader completed in 289.03s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.09s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-opusd-v4-g46-lr1-69112-v7
Waiting for inference service chaiml-opusd-v4-g46-lr1-69112-v7 to be ready
Inference service chaiml-opusd-v4-g46-lr1-69112-v7 ready after 581.066009759903s
Pipeline stage VLLMDeployer completed in 581.57s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3385672569274902s
Received healthy response to inference request in 2.3892822265625s
Received healthy response to inference request in 2.6626133918762207s
Received healthy response to inference request in 2.219388484954834s
Received healthy response to inference request in 2.1186702251434326s
Received healthy response to inference request in 2.1264829635620117s
Received healthy response to inference request in 2.085916519165039s
Received healthy response to inference request in 2.1008851528167725s
Received healthy response to inference request in 2.0129802227020264s
Received healthy response to inference request in 2.480674982070923s
Received healthy response to inference request in 1.96647047996521s
Received healthy response to inference request in 1.9170236587524414s
Received healthy response to inference request in 1.8385255336761475s
Received healthy response to inference request in 1.8869926929473877s
Received healthy response to inference request in 2.0325851440429688s
Received healthy response to inference request in 2.6158347129821777s
Received healthy response to inference request in 2.0053470134735107s
Received healthy response to inference request in 2.8028130531311035s
Received healthy response to inference request in 1.9832968711853027s
Received healthy response to inference request in 2.0991382598876953s
Received healthy response to inference request in 2.4296622276306152s
Received healthy response to inference request in 2.1000795364379883s
Received healthy response to inference request in 1.9925622940063477s
Received healthy response to inference request in 2.9952197074890137s
Received healthy response to inference request in 2.1285667419433594s
Received healthy response to inference request in 2.345571994781494s
Received healthy response to inference request in 2.009834051132202s
Received healthy response to inference request in 2.3266754150390625s
Received healthy response to inference request in 1.753572702407837s
Received healthy response to inference request in 2.1199278831481934s
30 requests
0 failed requests
5th percentile: 1.8603357553482056
10th percentile: 1.914020562171936
20th percentile: 1.9907092094421386
30th percentile: 2.012036371231079
40th percentile: 2.0938495635986327
50th percentile: 2.1097776889801025
60th percentile: 2.127316474914551
70th percentile: 2.330242967605591
80th percentile: 2.3973582267761233
90th percentile: 2.620512580871582
95th percentile: 2.739723205566406
99th percentile: 2.93942177772522
mean time: 2.1961720466613768
Pipeline stage StressChecker completed in 82.46s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.80s
Shutdown handler de-registered
chaiml-opusd-v4-g46-lr1_69112_v7 status is now deployed due to DeploymentManager action
chaiml-opusd-v4-g46-lr1_69112_v7 status is now inactive due to auto deactivation removed underperforming models
chaiml-opusd-v4-g46-lr1_69112_v7 status is now torndown due to DeploymentManager action