developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-pv2-_64172_v5
model_name: chaiml-pony-d3-g46-pv2-_64172_v5
model_group: ChaiML/pony-d3-g46-pv2-l
status: torndown
timestamp: 2026-03-11T09:42:05+00:00
num_battles: 12417
num_wins: 7131
celo_rating: 1459.84
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-pv2-_64172_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-08
win_ratio: 0.5742933075622131
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-pv2-64172-v5-uploader
Waiting for job on chaiml-pony-d3-g46-pv2-64172-v5-uploader to finish
chaiml-pony-d3-g46-pv2-64172-v5-uploader: Checking if ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-pv2-64172-v5-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-pv2-64172-v5-uploader: Downloading snapshot of ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8...
chaiml-pony-d3-g46-pv2-64172-v5-uploader: Downloaded in 126.706s
chaiml-pony-d3-g46-pv2-64172-v5-uploader: Processed model ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8 in 130.242s
chaiml-pony-d3-g46-pv2-64172-v5-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-pv2-64172-v5-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/chat_template.jinja
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/recipe.yaml
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/special_tokens_map.json
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/tokenizer_config.json
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model.safetensors.index.json
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/tokenizer.json
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00072-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00017-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00028-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00021-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00006-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00070-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00029-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00025-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00014-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00001-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00046-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00058-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00051-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00016-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00055-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00066-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00018-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00024-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00045-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00063-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00064-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00015-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00003-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00047-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00059-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00037-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00060-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00067-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00004-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00062-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00019-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00022-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00008-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00031-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00023-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00011-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00044-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00056-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v5-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v5/default/model-00036-of-00072.safetensors
Job chaiml-pony-d3-g46-pv2-64172-v5-uploader completed after 269.84s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-pv2-64172-v5-uploader
Pipeline stage VLLMUploader completed in 270.53s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.19s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-pv2-64172-v5
Waiting for inference service chaiml-pony-d3-g46-pv2-64172-v5 to be ready
Inference service chaiml-pony-d3-g46-pv2-64172-v5 ready after 560.9304032325745s
Pipeline stage VLLMDeployer completed in 561.48s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.004084825515747s
Received healthy response to inference request in 2.8359830379486084s
Received healthy response to inference request in 3.809624671936035s
Received healthy response to inference request in 3.276390552520752s
Received healthy response to inference request in 4.716912746429443s
Received healthy response to inference request in 2.807126998901367s
Received healthy response to inference request in 2.109724283218384s
Received healthy response to inference request in 4.291876554489136s
Received healthy response to inference request in 2.857658863067627s
Received healthy response to inference request in 3.170954704284668s
Received healthy response to inference request in 3.185457706451416s
Received healthy response to inference request in 2.1495814323425293s
Received healthy response to inference request in 2.603959321975708s
Received healthy response to inference request in 4.533701658248901s
Received healthy response to inference request in 2.245623826980591s
Received healthy response to inference request in 2.5301215648651123s
Received healthy response to inference request in 2.475961208343506s
Received healthy response to inference request in 2.070155382156372s
Received healthy response to inference request in 5.120290279388428s
Received healthy response to inference request in 3.3521268367767334s
Received healthy response to inference request in 3.8276259899139404s
Received healthy response to inference request in 2.1168415546417236s
Received healthy response to inference request in 2.059117317199707s
Received healthy response to inference request in 4.975843906402588s
Received healthy response to inference request in 2.1464366912841797s
Received healthy response to inference request in 2.437814950942993s
Received healthy response to inference request in 3.625673770904541s
Received healthy response to inference request in 2.7671663761138916s
Received healthy response to inference request in 2.841618537902832s
Received healthy response to inference request in 2.598155975341797s
30 requests
0 failed requests
5th percentile: 2.0879613876342775
10th percentile: 2.11612982749939
20th percentile: 2.2264153480529787
30th percentile: 2.5138734579086304
40th percentile: 2.7018835544586186
50th percentile: 2.83880078792572
60th percentile: 3.176755905151367
70th percentile: 3.434190917015075
80th percentile: 3.8629177570343023
90th percentile: 4.552022767066956
95th percentile: 4.859324884414672
99th percentile: 5.078400831222535
mean time: 3.1181203842163088
Pipeline stage StressChecker completed in 97.07s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.43s
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_64172_v5 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v5 status is now inactive due to auto deactivation removed underperforming models
chaiml-pony-d3-g46-pv2-_64172_v5 status is now torndown due to DeploymentManager action