developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-pv2-_64172_v3
model_name: chaiml-pony-d3-g46-pv2-_64172_v3
model_group: ChaiML/pony-d3-g46-pv2-l
status: torndown
timestamp: 2026-03-11T08:21:57+00:00
num_battles: 1256
num_wins: 691
celo_rating: 1329.45
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-pv2-_64172_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-08
win_ratio: 0.5501592356687898
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-pv2-64172-v3-uploader
Waiting for job on chaiml-pony-d3-g46-pv2-64172-v3-uploader to finish
chaiml-pony-d3-g46-pv2-64172-v3-uploader: Using quantization_mode: fp8
chaiml-pony-d3-g46-pv2-64172-v3-uploader: Checking if ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-pv2-64172-v3-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-pv2-64172-v3-uploader: Downloading snapshot of ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8...
chaiml-pony-d3-g46-pv2-64172-v3-uploader: Downloaded in 124.100s
chaiml-pony-d3-g46-pv2-64172-v3-uploader: Processed model ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8 in 127.641s
chaiml-pony-d3-g46-pv2-64172-v3-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-pv2-64172-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-pv2-64172-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d3-g46-pv2-64172-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/generation_config.json
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/chat_template.jinja
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/.gitattributes
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/config.json
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model.safetensors.index.json
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/recipe.yaml
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/tokenizer.json
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/tokenizer_config.json
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/special_tokens_map.json
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00072-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00046-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00064-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00022-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00024-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00003-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00060-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00045-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00056-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00070-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00027-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00067-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00043-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00062-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00014-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00011-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00015-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00029-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00055-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00019-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00031-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00008-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00017-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00051-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00021-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00044-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00036-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00025-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00059-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00028-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00004-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00066-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00063-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00018-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00037-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00023-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00047-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v3-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v3/default/model-00001-of-00072.safetensors
Job chaiml-pony-d3-g46-pv2-64172-v3-uploader completed after 271.03s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-pv2-64172-v3-uploader
Pipeline stage VLLMUploader completed in 271.58s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.22s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-pv2-64172-v3
Waiting for inference service chaiml-pony-d3-g46-pv2-64172-v3 to be ready
Inference service chaiml-pony-d3-g46-pv2-64172-v3 ready after 551.3924479484558s
Pipeline stage VLLMDeployer completed in 551.87s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.753716230392456s
Received healthy response to inference request in 2.2884199619293213s
Received healthy response to inference request in 2.2612760066986084s
Received healthy response to inference request in 2.0667083263397217s
Received healthy response to inference request in 2.0466768741607666s
Received healthy response to inference request in 2.0432331562042236s
Received healthy response to inference request in 2.178739547729492s
Received healthy response to inference request in 2.3540279865264893s
Received healthy response to inference request in 2.463001251220703s
Received healthy response to inference request in 2.296025276184082s
Received healthy response to inference request in 2.552238702774048s
Received healthy response to inference request in 2.214625597000122s
Received healthy response to inference request in 2.1717190742492676s
Received healthy response to inference request in 2.033301830291748s
Received healthy response to inference request in 2.2916364669799805s
Received healthy response to inference request in 2.3090453147888184s
Received healthy response to inference request in 2.1075894832611084s
Received healthy response to inference request in 2.2761096954345703s
Received healthy response to inference request in 2.090090751647949s
Received healthy response to inference request in 2.5138206481933594s
Received healthy response to inference request in 2.1545603275299072s
Received healthy response to inference request in 2.089867115020752s
Received healthy response to inference request in 2.2513837814331055s
Received healthy response to inference request in 2.456569194793701s
Received healthy response to inference request in 2.0874812602996826s
Received healthy response to inference request in 2.132143974304199s
Received healthy response to inference request in 2.115330457687378s
Received healthy response to inference request in 2.066021680831909s
Received healthy response to inference request in 2.1296284198760986s
Received healthy response to inference request in 2.0896291732788086s
30 requests
0 failed requests
5th percentile: 2.044782829284668
10th percentile: 2.0640872001647947
20th percentile: 2.089199590682983
30th percentile: 2.1023398637771606
40th percentile: 2.131137752532959
50th percentile: 2.17522931098938
60th percentile: 2.2553406715393067
70th percentile: 2.289384913444519
80th percentile: 2.318041849136353
90th percentile: 2.468083190917969
95th percentile: 2.534950578212738
99th percentile: 2.695287747383118
mean time: 2.2294872522354128
Pipeline stage StressChecker completed in 70.97s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.16s
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_64172_v3 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v3 status is now inactive due to admin request
chaiml-pony-d3-g46-pv2-_64172_v3 status is now torndown due to DeploymentManager action