developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-pv2-_64172_v6
model_name: chaiml-pony-d3-g46-pv2-_64172_v6
model_group: ChaiML/pony-d3-g46-pv2-l
status: torndown
timestamp: 2026-03-11T09:42:13+00:00
num_battles: 13015
num_wins: 7700
celo_rating: 1483.21
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-pv2-_64172_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-08
win_ratio: 0.5916250480215136
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-pv2-64172-v6-uploader
Waiting for job on chaiml-pony-d3-g46-pv2-64172-v6-uploader to finish
chaiml-pony-d3-g46-pv2-64172-v6-uploader: Using quantization_mode: fp8
chaiml-pony-d3-g46-pv2-64172-v6-uploader: Checking if ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-pv2-64172-v6-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-pv2-64172-v6-uploader: Downloading snapshot of ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8...
Failed to get response for submission chaiml-pony-d3-g46-pv2-_64172_v3: ('http://chaiml-pony-d3-g46-pv2-64172-v3-predictor.tenant-chaiml-guanaco.k2.chaiverse.com/v1/completions', 'activator request timeout')
chaiml-pony-d3-g46-pv2-64172-v6-uploader: Downloaded in 116.548s
chaiml-pony-d3-g46-pv2-64172-v6-uploader: Processed model ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8 in 120.019s
chaiml-pony-d3-g46-pv2-64172-v6-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-pv2-64172-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-pv2-64172-v6-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d3-g46-pv2-64172-v6-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/generation_config.json
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/config.json
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/.gitattributes
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/chat_template.jinja
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/recipe.yaml
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00072-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00033-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00004-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00047-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00070-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00023-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00015-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00036-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00051-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00018-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00045-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00029-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00019-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00059-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00001-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00008-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00063-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00067-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00043-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00016-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00062-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00037-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00011-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00064-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00060-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00017-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00028-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00055-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00066-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00044-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00025-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00024-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00027-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00046-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00014-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00006-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v6-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v6/default/model-00058-of-00072.safetensors
Job chaiml-pony-d3-g46-pv2-64172-v6-uploader completed after 258.19s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-pv2-64172-v6-uploader
Pipeline stage VLLMUploader completed in 258.70s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.46s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-pv2-64172-v6
Waiting for inference service chaiml-pony-d3-g46-pv2-64172-v6 to be ready
Inference service chaiml-pony-d3-g46-pv2-64172-v6 ready after 551.8376953601837s
Pipeline stage VLLMDeployer completed in 552.28s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.847595691680908s
Received healthy response to inference request in 4.058953523635864s
Received healthy response to inference request in 4.229936838150024s
Received healthy response to inference request in 4.026129722595215s
Received healthy response to inference request in 2.1382546424865723s
Received healthy response to inference request in 3.4433352947235107s
Received healthy response to inference request in 4.322888135910034s
Received healthy response to inference request in 5.194767713546753s
Received healthy response to inference request in 4.8128838539123535s
Received healthy response to inference request in 2.4964611530303955s
Received healthy response to inference request in 2.5320510864257812s
Received healthy response to inference request in 3.577920436859131s
Received healthy response to inference request in 2.1014859676361084s
Received healthy response to inference request in 3.325784921646118s
Received healthy response to inference request in 2.796107053756714s
Received healthy response to inference request in 3.771174669265747s
Received healthy response to inference request in 2.5177061557769775s
Received healthy response to inference request in 2.487751007080078s
Received healthy response to inference request in 3.180776357650757s
Received healthy response to inference request in 4.31857967376709s
Received healthy response to inference request in 2.418914556503296s
Received healthy response to inference request in 3.9982213973999023s
Received healthy response to inference request in 2.733954429626465s
Received healthy response to inference request in 2.757868766784668s
Received healthy response to inference request in 2.805372953414917s
Received healthy response to inference request in 3.469360113143921s
Received healthy response to inference request in 3.3296079635620117s
Received healthy response to inference request in 3.510373115539551s
Received healthy response to inference request in 2.1115615367889404s
Received healthy response to inference request in 3.05367112159729s
30 requests
0 failed requests
5th percentile: 2.123573434352875
10th percentile: 2.390848565101624
20th percentile: 2.513457155227661
30th percentile: 2.750694465637207
40th percentile: 2.954351854324341
50th percentile: 3.327696442604065
60th percentile: 3.485765314102173
70th percentile: 3.839288687705993
80th percentile: 4.093150186538697
90th percentile: 4.3718877077102665
95th percentile: 4.831975364685058
99th percentile: 5.094087827205659
mean time: 3.3456483284632363
Pipeline stage StressChecker completed in 103.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.08s
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_64172_v6 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v6 status is now inactive due to auto deactivation removed underperforming models
chaiml-pony-d3-g46-pv2-_64172_v6 status is now torndown due to DeploymentManager action