developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-pv2-_64172_v8
model_name: chaiml-pony-d3-g46-pv2-_64172_v8
model_group: ChaiML/pony-d3-g46-pv2-l
status: torndown
timestamp: 2026-03-12T16:21:42+00:00
num_battles: 13748
num_wins: 7935
celo_rating: 1354.85
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-pv2-_64172_v8
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-09
win_ratio: 0.5771748617980798
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-pv2-64172-v8-uploader
Waiting for job on chaiml-pony-d3-g46-pv2-64172-v8-uploader to finish
chaiml-pony-d3-g46-pv2-64172-v8-uploader: Using quantization_mode: fp8
chaiml-pony-d3-g46-pv2-64172-v8-uploader: Checking if ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-pv2-64172-v8-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-pv2-64172-v8-uploader: Downloading snapshot of ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8...
Retrying (%r) after connection broken by '%r': %s
chaiml-pony-d3-g46-pv2-64172-v8-uploader: Downloaded in 141.414s
chaiml-pony-d3-g46-pv2-64172-v8-uploader: Processed model ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8 in 145.199s
chaiml-pony-d3-g46-pv2-64172-v8-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-pv2-64172-v8-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-pv2-64172-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d3-g46-pv2-64172-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/.gitattributes
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/chat_template.jinja
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/recipe.yaml
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/generation_config.json
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/config.json
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/tokenizer_config.json
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model.safetensors.index.json
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/special_tokens_map.json
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/tokenizer.json
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00072-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00031-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00008-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00022-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00016-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00024-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00036-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00001-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00006-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00056-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00027-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00011-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00029-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00047-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00067-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00017-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00070-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00051-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00060-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00043-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00023-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00021-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00062-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00004-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00033-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00046-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00037-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00019-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00055-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00025-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00059-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00028-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00058-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00014-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v8-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v8/default/model-00064-of-00072.safetensors
Job chaiml-pony-d3-g46-pv2-64172-v8-uploader completed after 299.93s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-pv2-64172-v8-uploader
Pipeline stage VLLMUploader completed in 300.48s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.89s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-pv2-64172-v8
Waiting for inference service chaiml-pony-d3-g46-pv2-64172-v8 to be ready
Failed to get response for submission chaiml-llama31-mer-v2-_44570_v66: ('http://guanaco-model-mesh-load-balancer-v2.model-mesh.kchai-google-us-east4.chaiverse.com/models/chaiml-kimid-v9-opusdv_83165_v14/predict', '{"detail":"1 validation error for RuntimeResponse\\npredictions\\n  Field required [type=missing, input_value={\'detail\': \'[Errno 104] Connection reset by peer\'}, input_type=dict]\\n    For further information visit https://errors.pydantic.dev/2.12/v/missing"}')
Inference service chaiml-pony-d3-g46-pv2-64172-v8 ready after 560.8800551891327s
Pipeline stage VLLMDeployer completed in 561.72s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2069296836853027s
Received healthy response to inference request in 2.182985305786133s
Received healthy response to inference request in 2.0290327072143555s
Received healthy response to inference request in 2.110351085662842s
Received healthy response to inference request in 2.184122323989868s
Received healthy response to inference request in 2.1864571571350098s
Received healthy response to inference request in 2.0721774101257324s
Received healthy response to inference request in 2.1003077030181885s
Received healthy response to inference request in 2.050779342651367s
Received healthy response to inference request in 2.233982563018799s
Received healthy response to inference request in 2.2721340656280518s
Received healthy response to inference request in 2.139521598815918s
Received healthy response to inference request in 2.1844663619995117s
Received healthy response to inference request in 2.0794432163238525s
Received healthy response to inference request in 2.169527053833008s
Received healthy response to inference request in 2.19356369972229s
Received healthy response to inference request in 2.0851247310638428s
Received healthy response to inference request in 2.6353647708892822s
Received healthy response to inference request in 2.211691379547119s
Received healthy response to inference request in 2.087833881378174s
Received healthy response to inference request in 2.098168134689331s
Received healthy response to inference request in 2.0737035274505615s
Received healthy response to inference request in 2.0508289337158203s
Received healthy response to inference request in 2.1563496589660645s
Received healthy response to inference request in 2.0386240482330322s
Received healthy response to inference request in 2.076291084289551s
Received healthy response to inference request in 2.098238706588745s
Received healthy response to inference request in 2.0658059120178223s
Received healthy response to inference request in 2.2179741859436035s
Received healthy response to inference request in 2.509507179260254s
30 requests
0 failed requests
5th percentile: 2.044093930721283
10th percentile: 2.050823974609375
20th percentile: 2.073398303985596
30th percentile: 2.0834202766418457
40th percentile: 2.0982104778289794
50th percentile: 2.12493634223938
60th percentile: 2.1749103546142576
70th percentile: 2.185063600540161
80th percentile: 2.207882022857666
90th percentile: 2.237797713279724
95th percentile: 2.402689278125762
99th percentile: 2.598866069316864
mean time: 2.160042913754781
Pipeline stage StressChecker completed in 73.59s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.82s
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_64172_v8 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v8 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
admin requested tearing down of chaiml-pony-d3-g46-pv2-_64172_v8
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage VLLMDeleter
run pipeline %s
Checking if service chaiml-pony-d3-g46-pv2-64172-v7 is running
run pipeline stage %s
Running pipeline stage VLLMDeleter
Tearing down inference service chaiml-pony-d3-g46-pv2-64172-v7
Checking if service chaiml-pony-d3-g46-pv2-64172-v8 is running
Service chaiml-pony-d3-g46-pv2-64172-v7 has been torndown
Pipeline stage VLLMDeleter completed in 0.99s
Tearing down inference service chaiml-pony-d3-g46-pv2-64172-v8
run pipeline stage %s
Service chaiml-pony-d3-g46-pv2-64172-v8 has been torndown
Running pipeline stage VLLMModelDeleter
Pipeline stage VLLMDeleter completed in 1.04s
Cleaning model data from S3
run pipeline stage %s
Cleaning model data from model cache
Running pipeline stage VLLMModelDeleter
Cleaning model data from S3
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/.gitattributes from bucket guanaco-vllm-models
Cleaning model data from model cache
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/chat_template.jinja from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/.gitattributes from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/chat_template.jinja from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/generation_config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00001-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/generation_config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00001-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00002-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00002-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00003-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00003-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00004-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00004-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00005-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00005-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00006-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00006-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00007-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00007-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00008-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00008-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00009-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00009-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00010-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00010-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00011-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00011-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00012-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00012-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00013-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00013-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00014-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00014-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00015-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00015-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00016-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00016-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00017-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00017-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00018-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00018-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00019-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00019-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00020-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00020-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00021-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00021-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00022-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00022-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00023-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00023-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00024-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00024-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00025-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00025-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00026-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00026-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00027-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00027-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00028-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00028-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00029-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00029-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00030-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00030-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00031-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00031-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00032-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00032-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00033-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00033-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00034-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00034-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00035-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00035-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00036-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00036-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00037-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00037-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00038-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00038-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00039-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00039-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00040-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00040-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00041-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00041-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00042-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00042-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00043-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00043-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00044-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00044-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00045-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00045-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00046-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00046-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00047-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00047-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00048-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00048-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00049-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00049-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00050-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00050-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00051-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00051-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00052-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00052-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00053-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00053-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00054-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00054-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00055-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00055-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00056-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00056-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00057-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00057-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00058-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00058-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00059-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00059-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00060-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00060-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00061-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00061-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00062-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00062-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00063-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00063-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00064-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00064-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00065-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00065-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00066-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00066-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00067-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00067-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00068-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00068-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00069-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00069-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00070-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00070-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00071-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00071-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model-00072-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model-00072-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/model.safetensors.index.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/model.safetensors.index.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/recipe.yaml from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/recipe.yaml from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/special_tokens_map.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/special_tokens_map.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/tokenizer.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/tokenizer.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v7/default/tokenizer_config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-64172-v8/default/tokenizer_config.json from bucket guanaco-vllm-models
Pipeline stage VLLMModelDeleter completed in 48.98s
Pipeline stage VLLMModelDeleter completed in 48.54s
Shutdown handler de-registered
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_64172_v7 status is now torndown due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v7 status is now torndown due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v8 status is now torndown due to DeploymentManager action