developer_uid: zonemercy
submission_id: chaiml-pony-v4-gm4-31b-_61666_v1
model_name: chaiml-pony-v4-gm4-31b-_61666_v1
model_group: ChaiML/pony-v4-gm4-31b-l
status: inactive
timestamp: 2026-04-14T17:48:53+00:00
num_battles: 10616
num_wins: 5670
celo_rating: 0.0
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-v4-gm4-31b-lr1e5ep2g8
model_architecture: Gemma4ForConditionalGeneration
model_num_parameters: 28830461184.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-v4-gm4-31b-_61666_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-v4-gm4-31b-lr1e5ep2g8
model_size: 29B
ranking_group: single
us_pacific_date: 2026-04-14
win_ratio: 0.5340994724943482
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_start|>', '<|redacted_im_end|>', '</s>', 'You:', '<|turn>', '###', '<turn|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<bos><|turn>system\n{bot_name}'s persona: {memory} <turn|>\n", 'prompt_template': '', 'bot_template': '<|turn>model\n{bot_name}: {message}<turn|>\n', 'user_template': '<|turn>user\n{message}<turn|>\n', 'response_template': '<|turn>model\n<|channel>thought\n<channel|>{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-v4-gm4-31b-61666-v1-uploader
Waiting for job on chaiml-pony-v4-gm4-31b-61666-v1-uploader to finish
2026-04-14T15:08:04.061776+00:00 monitor updated for chaiml-pony-v4-gm4-31b-_61666_v1
chaiml-pony-v4-gm4-31b-61666-v1-uploader: Using quantization_mode: none
chaiml-pony-v4-gm4-31b-61666-v1-uploader: Downloading snapshot of ChaiML/pony-v4-gm4-31b-lr1e5ep2g8...
chaiml-pony-v4-gm4-31b-61666-v1-uploader: Downloaded in 37.948s
chaiml-pony-v4-gm4-31b-61666-v1-uploader: Processed model ChaiML/pony-v4-gm4-31b-lr1e5ep2g8 in 84.532s
chaiml-pony-v4-gm4-31b-61666-v1-uploader: creating bucket guanaco-vllm-models
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-v4-gm4-31b-61666-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-v4-gm4-31b-61666-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-v4-gm4-31b-61666-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-v4-gm4-31b-61666-v1-uploader: uploading /tmp/model_output to s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/processor_config.json s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/processor_config.json
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/args.json s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/args.json
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model.safetensors.index.json
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/tokenizer_config.json
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/config.json
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/chat_template.jinja
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/generation_config.json
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/.gitattributes
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/tokenizer.json
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00010-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00010-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00002-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00002-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00005-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00005-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00006-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00006-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00009-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00009-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00008-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00008-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00007-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00007-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00001-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00001-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00004-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00004-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00012-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00012-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00003-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00003-of-00013.safetensors
chaiml-pony-v4-gm4-31b-61666-v1-uploader: cp /tmp/model_output/model-00011-of-00013.safetensors s3://guanaco-vllm-models/chaiml-pony-v4-gm4-31b-61666-v1/default/model-00011-of-00013.safetensors
Job chaiml-pony-v4-gm4-31b-61666-v1-uploader completed after 115.56s with status: succeeded
Stopping job with name chaiml-pony-v4-gm4-31b-61666-v1-uploader
Pipeline stage VLLMUploader completed in 116.13s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.47s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.30s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-v4-gm4-31b-61666-v1
Waiting for inference service chaiml-pony-v4-gm4-31b-61666-v1 to be ready
2026-04-14T15:09:04.145382+00:00 monitor updated for chaiml-pony-v4-gm4-31b-_61666_v1
2026-04-14T15:10:04.255386+00:00 monitor updated for chaiml-pony-v4-gm4-31b-_61666_v1
2026-04-14T15:11:04.412892+00:00 monitor updated for chaiml-pony-v4-gm4-31b-_61666_v1
2026-04-14T15:12:04.507589+00:00 monitor updated for chaiml-pony-v4-gm4-31b-_61666_v1
Inference service chaiml-pony-v4-gm4-31b-61666-v1 ready after 210.2993721961975s
Pipeline stage VLLMDeployer completed in 210.75s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 10.452631950378418s
Received healthy response to inference request in 10.452224731445312s
Received healthy response to inference request in 2.2757649421691895s
Received healthy response to inference request in 2.393714666366577s
Received healthy response to inference request in 2.36188006401062s
2026-04-14T15:13:04.653555+00:00 monitor updated for chaiml-pony-v4-gm4-31b-_61666_v1
Received healthy response to inference request in 9.4396812915802s
Received healthy response to inference request in 2.5255794525146484s
Received healthy response to inference request in 3.6010217666625977s
Received healthy response to inference request in 2.395989179611206s
Received healthy response to inference request in 2.727998733520508s
Received healthy response to inference request in 2.69124174118042s
Received healthy response to inference request in 2.2931675910949707s
Received healthy response to inference request in 3.0391695499420166s
Received healthy response to inference request in 2.326759099960327s
Received healthy response to inference request in 2.3076019287109375s
Received healthy response to inference request in 2.2840025424957275s
Received healthy response to inference request in 2.60054087638855s
Received healthy response to inference request in 2.5818753242492676s
Received healthy response to inference request in 3.32623028755188s
Received healthy response to inference request in 10.718437671661377s
Received healthy response to inference request in 2.3740997314453125s
Received healthy response to inference request in 3.0970983505249023s
Received healthy response to inference request in 2.2886552810668945s
2026-04-14T15:14:04.756122+00:00 monitor updated for chaiml-pony-v4-gm4-31b-_61666_v1
Received healthy response to inference request in 2.573755979537964s
Received healthy response to inference request in 2.4453914165496826s
Received healthy response to inference request in 2.2976722717285156s
Received healthy response to inference request in 2.3419525623321533s
Received healthy response to inference request in 2.3197786808013916s
Received healthy response to inference request in 2.447338581085205s
Received healthy response to inference request in 2.2967875003814697s
30 requests
0 failed requests
5th percentile: 2.2860962748527527
10th percentile: 2.292716360092163
20th percentile: 2.305615997314453
30th percentile: 2.3373945236206053
40th percentile: 2.385868692398071
50th percentile: 2.446364998817444
60th percentile: 2.5770037174224854
70th percentile: 2.7022688388824463
80th percentile: 3.1429247379302985
90th percentile: 9.540935635566713
95th percentile: 10.45244870185852
99th percentile: 10.64135401248932
mean time: 3.5759347915649413
Pipeline stage StressChecker completed in 110.64s
Shutdown handler de-registered
chaiml-pony-v4-gm4-31b-_61666_v1 status is now deployed due to DeploymentManager action
chaiml-pony-v4-gm4-31b-_61666_v1 status is now inactive due to auto deactivation removed underperforming models