chaiml-pony-d2-g46-o4-l_42687

developer_uid: zonemercy
submission_id: chaiml-pony-d2-g46-o4-l_42687_v2
model_name: chaiml-pony-d2-g46-o4-l_42687_v2
model_group: ChaiML/pony-d2-g46-o4-lr
status: torndown
timestamp: 2026-03-08T07:53:10+00:00
num_battles: 10964
num_wins: 6278
celo_rating: 1344.52
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d2-g46-o4-l_42687_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-04
win_ratio: 0.5726012404232033
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d2-g46-o4-l-42687-v2-uploader
Waiting for job on chaiml-pony-d2-g46-o4-l-42687-v2-uploader to finish
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: Using quantization_mode: fp8
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: Checking if ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: Downloading snapshot of ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8-FP8...
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: Downloaded in 111.975s
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: Processed model ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8 in 115.673s
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d2-g46-o4-l-42687-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/.gitattributes
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/generation_config.json
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/config.json
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/chat_template.jinja
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model.safetensors.index.json
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/tokenizer.json
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00072-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00071-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00020-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00048-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00056-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00051-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00060-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00057-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00010-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00001-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00042-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00016-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00022-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00050-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00032-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00011-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00046-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00040-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00054-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00012-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00009-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00031-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00004-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00025-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00049-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00034-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00027-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00035-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00058-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00069-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00014-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00021-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00061-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00063-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00036-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00059-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00028-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00003-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00043-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00017-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00006-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00052-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00041-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00023-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00030-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00047-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00005-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00038-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00039-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00070-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00008-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00024-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00065-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00068-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00013-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00019-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00062-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00007-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00067-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00026-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00037-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00055-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00033-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00002-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00018-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00029-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v2-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v2/default/model-00066-of-00072.safetensors
Job chaiml-pony-d2-g46-o4-l-42687-v2-uploader completed after 257.46s with status: succeeded
Stopping job with name chaiml-pony-d2-g46-o4-l-42687-v2-uploader
Pipeline stage VLLMUploader completed in 259.55s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 3.16s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d2-g46-o4-l-42687-v2
Waiting for inference service chaiml-pony-d2-g46-o4-l-42687-v2 to be ready
Inference service chaiml-pony-d2-g46-o4-l-42687-v2 ready after 630.9683406352997s
Pipeline stage VLLMDeployer completed in 634.35s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.233501672744751s
Received healthy response to inference request in 3.074692726135254s
Received healthy response to inference request in 2.4274485111236572s
Received healthy response to inference request in 2.28602933883667s
Received healthy response to inference request in 2.0486574172973633s
Received healthy response to inference request in 2.1901679039001465s
Received healthy response to inference request in 2.0045738220214844s
Received healthy response to inference request in 2.302562952041626s
Received healthy response to inference request in 2.5866408348083496s
Received healthy response to inference request in 2.077390432357788s
Received healthy response to inference request in 2.238727569580078s
Received healthy response to inference request in 2.0044188499450684s
Received healthy response to inference request in 2.032649278640747s
Received healthy response to inference request in 2.240602731704712s
Received healthy response to inference request in 2.2212703227996826s
Received healthy response to inference request in 2.0489983558654785s
Received healthy response to inference request in 2.033165216445923s
Received healthy response to inference request in 2.3615260124206543s
Received healthy response to inference request in 2.5061657428741455s
Received healthy response to inference request in 2.622171401977539s
Received healthy response to inference request in 2.030094861984253s
Received healthy response to inference request in 2.4643971920013428s
Received healthy response to inference request in 2.106428623199463s
Received healthy response to inference request in 2.1037163734436035s
Received healthy response to inference request in 2.235553741455078s
Received healthy response to inference request in 2.0505282878875732s
Received healthy response to inference request in 2.077441453933716s
Received healthy response to inference request in 3.7182693481445312s
Received healthy response to inference request in 2.0468125343322754s
Received healthy response to inference request in 2.1195592880249023s
30 requests
0 failed requests
5th percentile: 2.01605829000473
10th percentile: 2.0323938369750976
20th percentile: 2.048288440704346
30th percentile: 2.0693317890167235
40th percentile: 2.105343723297119
50th percentile: 2.2057191133499146
60th percentile: 2.2368232727050783
70th percentile: 2.2909894227981566
80th percentile: 2.4348382472991945
90th percentile: 2.5901938915252685
95th percentile: 2.871058130264281
99th percentile: 3.531632127761841
mean time: 2.2831387599309285
Pipeline stage StressChecker completed in 73.09s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.92s
Shutdown handler de-registered
chaiml-pony-d2-g46-o4-l_42687_v2 status is now deployed due to DeploymentManager action
chaiml-pony-d2-g46-o4-l_42687_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-pony-d2-g46-o4-l_42687_v2 status is now torndown due to DeploymentManager action