developer_uid: chai_backend_admin
submission_id: chaiml-opusd-v4-g46-lr1_69112_v5
model_name: chaiml-opusd-v4-g46-lr1_69112_v5
model_group: ChaiML/opusd-v4-g46-lr1e
status: inactive
timestamp: 2026-03-02T21:47:41+00:00
num_battles: 10591
num_wins: 5833
celo_rating: 1324.82
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/opusd-v4-g46-lr1e4ep1r64b16
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-opusd-v4-g46-lr1_69112_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/opusd-v4-g46-lr1e4ep1r64b16
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-02
win_ratio: 0.5507506373335851
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['###', '</s>', 'You:', '<|im_end|>', '<|im_start|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[gMASK]<sop><|system|>\nRespond as a high quality storyteller.<|user|>\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-opusd-v4-g46-lr1-69112-v5-uploader
Waiting for job on chaiml-opusd-v4-g46-lr1-69112-v5-uploader to finish
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: Using quantization_mode: fp8
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: Checking if ChaiML/opusd-v4-g46-lr1e4ep1r64b16-FP8 already exists in ChaiML
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: Downloading snapshot of ChaiML/opusd-v4-g46-lr1e4ep1r64b16-FP8...
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: Downloaded in 167.469s
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: Processed model ChaiML/opusd-v4-g46-lr1e4ep1r64b16 in 170.830s
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: creating bucket guanaco-vllm-models
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-opusd-v4-g46-lr1-69112-v5-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/.gitattributes
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/chat_template.jinja
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/config.json
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/generation_config.json
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/recipe.yaml
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model.safetensors.index.json
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/tokenizer_config.json
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/special_tokens_map.json
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/tokenizer.json
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00072-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00071-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00064-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00001-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00049-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00032-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00020-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00012-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00016-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00025-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00031-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00061-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00019-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00041-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00026-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00045-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00068-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00022-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00050-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00033-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00058-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00024-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00013-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00029-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00046-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00059-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00044-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00042-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00003-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00014-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00006-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00062-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00053-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00018-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00010-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00043-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00008-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00067-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00069-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00030-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00015-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00070-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00034-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00063-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00065-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00048-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00023-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00056-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00057-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00038-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00004-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00009-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00054-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00060-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00027-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00017-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00036-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00052-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00021-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00039-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00005-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00040-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00002-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00035-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00047-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00011-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00028-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00066-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00037-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00051-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00055-of-00072.safetensors
chaiml-opusd-v4-g46-lr1-69112-v5-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-opusd-v4-g46-lr1-69112-v5/default/model-00007-of-00072.safetensors
Job chaiml-opusd-v4-g46-lr1-69112-v5-uploader completed after 330.91s with status: succeeded
Stopping job with name chaiml-opusd-v4-g46-lr1-69112-v5-uploader
Pipeline stage VLLMUploader completed in 332.58s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.34s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-opusd-v4-g46-lr1-69112-v5
Waiting for inference service chaiml-opusd-v4-g46-lr1-69112-v5 to be ready
Inference service chaiml-opusd-v4-g46-lr1-69112-v5 ready after 1637.6845655441284s
Pipeline stage VLLMDeployer completed in 1639.06s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.374752998352051s
Received healthy response to inference request in 2.2755866050720215s
Received healthy response to inference request in 2.1812407970428467s
Received healthy response to inference request in 2.2886111736297607s
Received healthy response to inference request in 2.213833808898926s
Received healthy response to inference request in 2.088362455368042s
Received healthy response to inference request in 2.143686056137085s
Received healthy response to inference request in 2.0925381183624268s
Received healthy response to inference request in 2.183443069458008s
Received healthy response to inference request in 2.1321027278900146s
Received healthy response to inference request in 2.1101505756378174s
Received healthy response to inference request in 2.1903979778289795s
Received healthy response to inference request in 2.576624631881714s
Received healthy response to inference request in 2.1133131980895996s
Received healthy response to inference request in 2.4025356769561768s
Received healthy response to inference request in 2.2084760665893555s
Received healthy response to inference request in 2.011828660964966s
Received healthy response to inference request in 2.182082176208496s
Received healthy response to inference request in 2.2133092880249023s
Received healthy response to inference request in 2.0999581813812256s
Received healthy response to inference request in 2.210139274597168s
Received healthy response to inference request in 2.135070323944092s
Received healthy response to inference request in 2.5964722633361816s
Received healthy response to inference request in 2.2089426517486572s
Received healthy response to inference request in 2.172905683517456s
Received healthy response to inference request in 2.560917377471924s
Received healthy response to inference request in 2.3372421264648438s
Received healthy response to inference request in 2.183580160140991s
Received healthy response to inference request in 2.2526421546936035s
Received healthy response to inference request in 2.2898435592651367s
30 requests
0 failed requests
5th percentile: 2.0902415037155153
10th percentile: 2.099216175079346
20th percentile: 2.1283448219299315
30th percentile: 2.1641397953033445
40th percentile: 2.1828987121582033
50th percentile: 2.1994370222091675
60th percentile: 2.211407279968262
70th percentile: 2.2595254898071286
80th percentile: 2.2993232727050783
90th percentile: 2.418373847007752
95th percentile: 2.5695563673973085
99th percentile: 2.590716450214386
mean time: 2.2343529939651487
Pipeline stage StressChecker completed in 77.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.55s
Shutdown handler de-registered
chaiml-opusd-v4-g46-lr1_69112_v5 status is now deployed due to DeploymentManager action
chaiml-opusd-v4-g46-lr1_69112_v5 status is now inactive due to auto deactivation removed underperforming models