developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-pv2-_41910_v9
model_name: chaiml-pony-d3-g46-pv2-_41910_v9
model_group: ChaiML/pony-d3-g46-pv2-l
status: inactive
timestamp: 2026-03-11T17:48:54+00:00
num_battles: 10750
num_wins: 6073
celo_rating: 1358.88
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-pv2-lr5e6ep1r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-pv2-_41910_v9
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-pv2-lr5e6ep1r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-11
win_ratio: 0.5649302325581396
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{bot_name}: {message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-pv2-41910-v9-uploader
Waiting for job on chaiml-pony-d3-g46-pv2-41910-v9-uploader to finish
chaiml-pony-d3-g46-pv2-41910-v9-uploader: Using quantization_mode: fp8
chaiml-pony-d3-g46-pv2-41910-v9-uploader: Checking if ChaiML/pony-d3-g46-pv2-lr5e6ep1r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-pv2-41910-v9-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-pv2-41910-v9-uploader: Downloading snapshot of ChaiML/pony-d3-g46-pv2-lr5e6ep1r64b8-FP8...
2026-03-11T16:25:32.992729+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
2026-03-11T16:26:33.075227+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
2026-03-11T16:27:33.155043+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
chaiml-pony-d3-g46-pv2-41910-v9-uploader: Downloaded in 173.192s
chaiml-pony-d3-g46-pv2-41910-v9-uploader: Processed model ChaiML/pony-d3-g46-pv2-lr5e6ep1r64b8 in 176.636s
chaiml-pony-d3-g46-pv2-41910-v9-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-pv2-41910-v9-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-pv2-41910-v9-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-pv2-41910-v9-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d3-g46-pv2-41910-v9-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/.gitattributes
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/config.json
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/generation_config.json
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/chat_template.jinja
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/recipe.yaml
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/special_tokens_map.json
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/tokenizer_config.json
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model.safetensors.index.json
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/tokenizer.json
2026-03-11T16:28:33.244854+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00072-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00003-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00043-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00058-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00027-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00023-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00056-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00051-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00011-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00033-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00008-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00060-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00062-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00028-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00036-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00044-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00070-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00047-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00066-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00045-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00021-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00064-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00024-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00067-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00001-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00055-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00031-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00022-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00019-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00059-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00029-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00037-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00063-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00018-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00016-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00025-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00046-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00014-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00015-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00006-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-pv2-41910-v9-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-41910-v9/default/model-00004-of-00072.safetensors
2026-03-11T16:29:33.331203+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
Job chaiml-pony-d3-g46-pv2-41910-v9-uploader completed after 317.82s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-pv2-41910-v9-uploader
Pipeline stage VLLMUploader completed in 318.33s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.68s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-pv2-41910-v9
Waiting for inference service chaiml-pony-d3-g46-pv2-41910-v9 to be ready
2026-03-11T16:30:33.424575+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
2026-03-11T16:31:33.517073+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
2026-03-11T16:32:33.609430+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
2026-03-11T16:33:33.718222+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
2026-03-11T16:34:33.810389+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
2026-03-11T16:35:33.902553+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
Inference service chaiml-pony-d3-g46-pv2-41910-v9 ready after 351.2726356983185s
Pipeline stage VLLMDeployer completed in 351.79s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.632689476013184s
Received healthy response to inference request in 8.984328746795654s
Received healthy response to inference request in 2.0453875064849854s
Received healthy response to inference request in 9.135904788970947s
Received healthy response to inference request in 8.899682521820068s
Received healthy response to inference request in 2.0865628719329834s
Received healthy response to inference request in 2.0429368019104004s
Received healthy response to inference request in 1.9412126541137695s
Received healthy response to inference request in 2.002293348312378s
Received healthy response to inference request in 1.976755142211914s
2026-03-11T16:36:34.361679+00:00 monitor updated for chaiml-pony-d3-g46-pv2-_41910_v9
Received healthy response to inference request in 1.9152154922485352s
Received healthy response to inference request in 2.0742440223693848s
Received healthy response to inference request in 2.147883415222168s
Received healthy response to inference request in 1.9898748397827148s
Received healthy response to inference request in 1.9787325859069824s
Received healthy response to inference request in 1.920426368713379s
Received healthy response to inference request in 2.014943838119507s
Received healthy response to inference request in 1.965470790863037s
Received healthy response to inference request in 2.177847385406494s
Received healthy response to inference request in 9.255756139755249s
Received healthy response to inference request in 2.092332363128662s
Received healthy response to inference request in 2.079801082611084s
Received healthy response to inference request in 2.0006556510925293s
Received healthy response to inference request in 2.0717196464538574s
Received healthy response to inference request in 2.3276526927948s
Received healthy response to inference request in 2.0382442474365234s
Received healthy response to inference request in 2.1670453548431396s
Received healthy response to inference request in 2.008409023284912s
Received healthy response to inference request in 2.0110971927642822s
Received healthy response to inference request in 2.0199201107025146s
30 requests
0 failed requests
5th percentile: 1.9297801971435546
10th percentile: 1.9630449771881104
20th percentile: 1.9876463890075684
30th percentile: 2.0065743207931517
40th percentile: 2.0179296016693113
50th percentile: 2.044162154197693
60th percentile: 2.0764668464660643
70th percentile: 2.1089976787567135
80th percentile: 2.207808446884156
90th percentile: 8.999486351013184
95th percentile: 9.201823031902313
99th percentile: 9.523378808498382
mean time: 3.233500870068868
Pipeline stage StressChecker completed in 100.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_41910_v9 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_41910_v9 status is now inactive due to auto deactivation removed underperforming models