developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-o4-l_49714_v4
model_name: chaiml-pony-d3-g46-o4-l_49714_v4
model_group: ChaiML/pony-d3-g46-o4-lr
status: torndown
timestamp: 2026-03-14T16:22:00+00:00
num_battles: 10432
num_wins: 5956
celo_rating: 1344.65
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-o4-lr5e6ep1r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-o4-l_49714_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-o4-lr5e6ep1r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-11
win_ratio: 0.5709355828220859
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{bot_name}: {message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-o4-l-49714-v4-uploader
Waiting for job on chaiml-pony-d3-g46-o4-l-49714-v4-uploader to finish
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: Using quantization_mode: fp8
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: Checking if ChaiML/pony-d3-g46-o4-lr5e6ep1r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: Downloading snapshot of ChaiML/pony-d3-g46-o4-lr5e6ep1r64b8-FP8...
2026-03-11T14:43:26.487584+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
2026-03-11T14:44:26.645723+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
2026-03-11T14:45:26.751911+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: Downloaded in 149.986s
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: Processed model ChaiML/pony-d3-g46-o4-lr5e6ep1r64b8 in 153.526s
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/.gitattributes
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/generation_config.json
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/chat_template.jinja
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/config.json
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/recipe.yaml
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/special_tokens_map.json
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/tokenizer_config.json
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/tokenizer.json
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model.safetensors.index.json
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00072-of-00072.safetensors
2026-03-11T14:46:26.837990+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00036-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00015-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00022-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00003-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00056-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00066-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00044-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00021-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00023-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00060-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00047-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00070-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00029-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00027-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00045-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00025-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00058-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00033-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00059-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00046-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00004-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00031-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00016-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00063-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00018-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00064-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00006-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00017-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00067-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00062-of-00072.safetensors
chaiml-pony-d3-g46-o4-l-49714-v4-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00001-of-00072.safetensors
Job chaiml-pony-d3-g46-o4-l-49714-v4-uploader completed after 297.6s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-o4-l-49714-v4-uploader
Pipeline stage VLLMUploader completed in 298.07s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.12s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-o4-l-49714-v4
Waiting for inference service chaiml-pony-d3-g46-o4-l-49714-v4 to be ready
2026-03-11T14:47:26.926664+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
2026-03-11T14:48:27.050315+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
2026-03-11T14:49:27.215215+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
2026-03-11T14:50:27.302220+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
2026-03-11T14:51:27.394276+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
2026-03-11T14:52:27.488314+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
Inference service chaiml-pony-d3-g46-o4-l-49714-v4 ready after 351.8173038959503s
Pipeline stage VLLMDeployer completed in 352.66s
run pipeline stage %s
Running pipeline stage StressChecker
2026-03-11T14:53:27.590736+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
Received healthy response to inference request in 9.477700471878052s
Received healthy response to inference request in 8.941807746887207s
Received healthy response to inference request in 1.9130878448486328s
Received healthy response to inference request in 1.9088294506072998s
Received healthy response to inference request in 2.036195755004883s
Received healthy response to inference request in 2.0029218196868896s
Received healthy response to inference request in 2.087435483932495s
Received healthy response to inference request in 1.989565372467041s
Received healthy response to inference request in 2.0556881427764893s
Received healthy response to inference request in 1.9606523513793945s
Received healthy response to inference request in 1.9692773818969727s
Received healthy response to inference request in 2.0039215087890625s
Received healthy response to inference request in 8.947972774505615s
Received healthy response to inference request in 2.0025100708007812s
Received healthy response to inference request in 1.9147546291351318s
Received healthy response to inference request in 2.0348892211914062s
Received healthy response to inference request in 2.0251569747924805s
Received healthy response to inference request in 2.070068836212158s
Received healthy response to inference request in 1.9367873668670654s
Received healthy response to inference request in 1.9785847663879395s
Received healthy response to inference request in 2.1148059368133545s
Received healthy response to inference request in 2.2666687965393066s
2026-03-11T14:54:27.691232+00:00 monitor updated for chaiml-pony-d3-g46-o4-l_49714_v4
Received healthy response to inference request in 1.9619193077087402s
Received healthy response to inference request in 1.9399189949035645s
Received healthy response to inference request in 1.9817276000976562s
Received healthy response to inference request in 2.1098833084106445s
Received healthy response to inference request in 1.9865384101867676s
Received healthy response to inference request in 1.9094772338867188s
Received healthy response to inference request in 2.3773694038391113s
Received healthy response to inference request in 2.132750988006592s
30 requests
0 failed requests
5th percentile: 1.91110200881958
10th percentile: 1.914587950706482
20th percentile: 1.9565056800842284
30th percentile: 1.9757925510406493
40th percentile: 1.9883545875549316
50th percentile: 2.003421664237976
60th percentile: 2.035411834716797
70th percentile: 2.075278830528259
80th percentile: 2.118394947052002
90th percentile: 3.0338132381439302
95th percentile: 8.945198512077331
99th percentile: 9.324079439640046
mean time: 2.734628931681315
Pipeline stage StressChecker completed in 85.21s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.69s
Shutdown handler de-registered
chaiml-pony-d3-g46-o4-l_49714_v4 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-o4-l_49714_v4 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of chaiml-pony-d3-g46-o4-l_49714_v4
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
admin requested tearing down of chaiml-pony-d3-g46-pv2-_41910_v8
Running pipeline stage VLLMDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Checking if service chaiml-pony-d3-g46-o4-l-49714-v4 is running
run pipeline stage %s
Running pipeline stage VLLMDeleter
Tearing down inference service chaiml-pony-d3-g46-o4-l-49714-v4
Checking if service chaiml-pony-d3-g46-pv2-41910-v8 is running
Service chaiml-pony-d3-g46-o4-l-49714-v4 has been torndown
Pipeline stage VLLMDeleter completed in 1.47s
Tearing down inference service chaiml-pony-d3-g46-pv2-41910-v8
run pipeline stage %s
Service chaiml-pony-d3-g46-pv2-41910-v8 has been torndown
Running pipeline stage VLLMModelDeleter
Pipeline stage VLLMDeleter completed in 1.15s
Cleaning model data from S3
run pipeline stage %s
Cleaning model data from model cache
Running pipeline stage VLLMModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/.gitattributes from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/chat_template.jinja from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/.gitattributes from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/chat_template.jinja from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/generation_config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00001-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/generation_config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00001-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00002-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00002-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00003-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00003-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00004-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00004-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00005-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00005-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00006-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00006-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00007-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00007-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00008-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00008-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00009-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00009-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00010-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00010-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00011-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00011-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00012-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00012-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00013-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00013-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00014-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00014-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00015-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00015-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00016-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00016-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00017-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00017-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00018-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00018-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00019-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00019-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00020-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00020-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00021-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00021-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00022-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00022-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00023-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00023-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00024-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00024-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00025-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00025-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00026-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00026-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00027-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00027-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00028-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00028-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00029-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00029-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00030-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00030-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00031-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00031-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00032-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00032-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00033-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00033-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00034-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00034-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00035-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00035-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00036-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00036-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00037-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00037-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00038-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00038-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00039-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00039-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00040-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00040-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00041-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00041-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00042-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00042-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00043-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00043-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00044-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00044-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00045-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00045-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00046-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00046-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00047-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00047-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00048-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00048-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00049-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00049-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00050-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00050-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00051-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00051-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00052-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00052-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00053-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00053-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00054-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00054-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00055-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00055-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00056-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00056-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00057-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00057-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00058-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00058-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00059-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00059-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00060-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00060-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00061-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00061-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00062-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00062-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00063-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00063-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00064-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00064-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00065-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00065-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00066-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00066-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00067-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00067-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00068-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00068-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00069-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00069-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00070-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00070-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00071-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model-00072-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00071-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/model.safetensors.index.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/recipe.yaml from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model-00072-of-00072.safetensors from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/special_tokens_map.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/tokenizer.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/model.safetensors.index.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-o4-l-49714-v4/default/tokenizer_config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/recipe.yaml from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/special_tokens_map.json from bucket guanaco-vllm-models
Pipeline stage VLLMModelDeleter completed in 53.77s
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/tokenizer.json from bucket guanaco-vllm-models
Shutdown handler de-registered
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/tokenizer_config.json from bucket guanaco-vllm-models
Deleting key chaiml-pony-d3-g46-pv2-41910-v8/default/tokenizer_config.json from bucket guanaco-vllm-models
chaiml-pony-d3-g46-o4-l_49714_v4 status is now torndown due to DeploymentManager action