chaiml-pony-d2-g46-o4-l_42687

developer_uid: richhx
submission_id: chaiml-pony-d2-g46-o4-l_42687_v5
model_name: chaiml-pony-d2-g46-o4-l_42687_v5
model_group: ChaiML/pony-d2-g46-o4-lr
status: inactive
timestamp: 2026-03-05T21:04:58+00:00
num_battles: 1537
num_wins: 884
celo_rating: 9272.05
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d2-g46-o4-l_42687_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.5751463890696161
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '<|user|>', '<|assistant|>', '</s>', '####'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d2-g46-o4-l-42687-v5-uploader
Waiting for job on chaiml-pony-d2-g46-o4-l-42687-v5-uploader to finish
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: Using quantization_mode: fp8
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: Checking if ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: Downloading snapshot of ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8-FP8...
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: Downloaded in 151.764s
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: Processed model ChaiML/pony-d2-g46-o4-lr5e6ep2r64b8 in 155.371s
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d2-g46-o4-l-42687-v5-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/chat_template.jinja
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/config.json
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/.gitattributes
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/generation_config.json
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/special_tokens_map.json
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/recipe.yaml
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/tokenizer_config.json
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/tokenizer.json
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model.safetensors.index.json
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00072-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00071-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00024-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00034-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00023-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00003-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00036-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00049-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00040-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00019-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00041-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00009-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00014-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00045-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00017-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00005-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00020-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00053-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00070-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00011-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00025-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00059-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00048-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00018-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00002-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00032-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00007-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00058-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00039-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00004-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00012-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00022-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00035-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00044-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00006-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00021-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00043-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00015-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00037-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00065-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00056-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00010-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00016-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00067-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00054-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00060-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00008-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00001-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00062-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00031-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00050-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00064-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00046-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00068-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00061-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00038-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00033-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00063-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00029-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00030-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00042-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00026-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00055-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00069-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00027-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00066-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00057-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00013-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00047-of-00072.safetensors
chaiml-pony-d2-g46-o4-l-42687-v5-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-g46-o4-l-42687-v5/default/model-00051-of-00072.safetensors
Job chaiml-pony-d2-g46-o4-l-42687-v5-uploader completed after 268.62s with status: succeeded
Stopping job with name chaiml-pony-d2-g46-o4-l-42687-v5-uploader
Pipeline stage VLLMUploader completed in 269.42s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.98s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d2-g46-o4-l-42687-v5
Waiting for inference service chaiml-pony-d2-g46-o4-l-42687-v5 to be ready
Inference service chaiml-pony-d2-g46-o4-l-42687-v5 ready after 551.0980606079102s
Pipeline stage VLLMDeployer completed in 551.73s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5205793380737305s
Received healthy response to inference request in 2.6248714923858643s
Received healthy response to inference request in 2.1295454502105713s
Received healthy response to inference request in 2.2434332370758057s
Received healthy response to inference request in 2.7931602001190186s
Received healthy response to inference request in 2.3336691856384277s
Received healthy response to inference request in 3.011284351348877s
Received healthy response to inference request in 2.517653226852417s
Received healthy response to inference request in 2.518256664276123s
Received healthy response to inference request in 2.2721385955810547s
Received healthy response to inference request in 2.300261974334717s
Received healthy response to inference request in 2.1050047874450684s
Received healthy response to inference request in 2.3925580978393555s
Received healthy response to inference request in 2.7928969860076904s
Received healthy response to inference request in 2.2779788970947266s
Received healthy response to inference request in 2.2300331592559814s
Received healthy response to inference request in 2.441582441329956s
Received healthy response to inference request in 2.256781816482544s
Received healthy response to inference request in 3.0407581329345703s
Received healthy response to inference request in 2.2200052738189697s
Received healthy response to inference request in 2.2167561054229736s
Received healthy response to inference request in 2.412385940551758s
Received healthy response to inference request in 2.3885905742645264s
Received healthy response to inference request in 2.5408942699432373s
Received healthy response to inference request in 2.855865478515625s
Received healthy response to inference request in 2.4117534160614014s
Received healthy response to inference request in 2.531816005706787s
Received healthy response to inference request in 2.362001419067383s
Received healthy response to inference request in 2.739380359649658s
Received healthy response to inference request in 2.25746750831604s
30 requests
0 failed requests
5th percentile: 2.1687902450561523
10th percentile: 2.21968035697937
20th percentile: 2.2541121006011964
30th percentile: 2.276226806640625
40th percentile: 2.350668525695801
50th percentile: 2.4021557569503784
60th percentile: 2.4720107555389403
70th percentile: 2.5239503383636475
80th percentile: 2.6477732658386235
90th percentile: 2.799430727958679
95th percentile: 2.941345858573913
99th percentile: 3.032210736274719
mean time: 2.4579788128534954
Pipeline stage StressChecker completed in 76.67s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.94s
Shutdown handler de-registered
chaiml-pony-d2-g46-o4-l_42687_v5 status is now deployed due to DeploymentManager action
chaiml-pony-d2-g46-o4-l_42687_v5 status is now inactive due to system request