developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-pv2-_64172_v2
model_name: chaiml-pony-d3-g46-pv2-_64172_v2
model_group: ChaiML/pony-d3-g46-pv2-l
status: torndown
timestamp: 2026-03-09T16:32:24+00:00
num_battles: 11126
num_wins: 6459
celo_rating: 1349.59
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-pv2-_64172_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-06
win_ratio: 0.5805320870034154
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-pv2-64172-v2-uploader
Waiting for job on chaiml-pony-d3-g46-pv2-64172-v2-uploader to finish
chaiml-pony-d3-g46-pv2-64172-v2-uploader: Using quantization_mode: fp8
chaiml-pony-d3-g46-pv2-64172-v2-uploader: Checking if ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-pv2-64172-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-pv2-64172-v2-uploader: Downloading snapshot of ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8...
chaiml-pony-d3-g46-pv2-64172-v2-uploader: Downloaded in 143.093s
chaiml-pony-d3-g46-pv2-64172-v2-uploader: Processed model ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8 in 146.501s
chaiml-pony-d3-g46-pv2-64172-v2-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-pv2-64172-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-pv2-64172-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d3-g46-pv2-64172-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/generation_config.json
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/chat_template.jinja
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/config.json
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/.gitattributes
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/special_tokens_map.json
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/recipe.yaml
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/tokenizer_config.json
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model.safetensors.index.json
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/tokenizer.json
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00072-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00056-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00025-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00058-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00024-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00059-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00003-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00062-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00016-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00001-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00004-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00046-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00017-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00031-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00036-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00051-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00011-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00037-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00070-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00064-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00015-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00044-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00055-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00022-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00066-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00019-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00027-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00029-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00028-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00060-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00018-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00006-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00063-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00043-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00021-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00033-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00047-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00067-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00008-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00045-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00014-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v2-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v2/default/model-00023-of-00072.safetensors
Job chaiml-pony-d3-g46-pv2-64172-v2-uploader completed after 293.04s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-pv2-64172-v2-uploader
Pipeline stage VLLMUploader completed in 293.57s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.34s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-pv2-64172-v2
Waiting for inference service chaiml-pony-d3-g46-pv2-64172-v2 to be ready
Inference service chaiml-pony-d3-g46-pv2-64172-v2 ready after 612.2714748382568s
Pipeline stage VLLMDeployer completed in 612.82s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1465320587158203s
Received healthy response to inference request in 2.2184932231903076s
Received healthy response to inference request in 2.125581979751587s
Received healthy response to inference request in 2.096245050430298s
Received healthy response to inference request in 2.117252826690674s
Received healthy response to inference request in 2.1281936168670654s
Received healthy response to inference request in 2.0854732990264893s
Received healthy response to inference request in 2.193640947341919s
Received healthy response to inference request in 2.220073699951172s
Received healthy response to inference request in 2.146702527999878s
Received healthy response to inference request in 2.1454925537109375s
Received healthy response to inference request in 2.505169630050659s
Received healthy response to inference request in 2.071791172027588s
Received healthy response to inference request in 2.2135298252105713s
Received healthy response to inference request in 2.086822032928467s
Received healthy response to inference request in 2.0831222534179688s
Received healthy response to inference request in 2.5094006061553955s
Received healthy response to inference request in 2.233820915222168s
Received healthy response to inference request in 2.176356077194214s
Received healthy response to inference request in 2.0943493843078613s
Received healthy response to inference request in 2.466423273086548s
Received healthy response to inference request in 2.1936028003692627s
Received healthy response to inference request in 2.349417209625244s
Received healthy response to inference request in 2.078442096710205s
Received healthy response to inference request in 2.169421434402466s
Received healthy response to inference request in 2.2431652545928955s
Received healthy response to inference request in 2.1272459030151367s
Received healthy response to inference request in 2.0804572105407715s
Received healthy response to inference request in 2.3052923679351807s
Received healthy response to inference request in 2.1944336891174316s
30 requests
0 failed requests
5th percentile: 2.07934889793396
10th percentile: 2.082855749130249
20th percentile: 2.0928439140319823
30th percentile: 2.123083233833313
40th percentile: 2.1385729789733885
50th percentile: 2.158061981201172
60th percentile: 2.193618059158325
70th percentile: 2.2150188446044923
80th percentile: 2.2356897830963134
90th percentile: 2.3611178159713746
95th percentile: 2.487733769416809
99th percentile: 2.508173623085022
mean time: 2.1935314973195394
Pipeline stage StressChecker completed in 72.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.79s
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_64172_v2 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-pony-d3-g46-pv2-_64172_v2 status is now torndown due to DeploymentManager action