chaiml-pony-d2-q235b-pv_18495

developer_uid: zonemercy

submission_id: chaiml-pony-d2-q235b-pv_18495_v2

model_name: chaiml-pony-d2-q235b-pv_18495_v2

model_group: ChaiML/pony-d2-q235b-pv1

status: inactive

timestamp: 2026-02-28T09:26:58+00:00

num_battles: 12272

num_wins: 6837

celo_rating: 1334.39

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: ChaiML/pony-d2-q235b-pv1-lr5e6ep2r64g4

model_architecture: Qwen3MoeForCausalLM

model_num_parameters: 18790207488.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 80

reward_model: default

display_name: chaiml-pony-d2-q235b-pv_18495_v2

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: ChaiML/pony-d2-q235b-pv1-lr5e6ep2r64g4

model_size: 19B

ranking_group: single

us_pacific_date: 2026-02-28

win_ratio: 0.5571219035202086

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '<|user|>', '</think>', '####', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}

formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d2-q235b-pv-18495-v2-uploader
Waiting for job on chaiml-pony-d2-q235b-pv-18495-v2-uploader to finish
chaiml-pony-d2-q235b-pv-18495-v2-uploader: Using quantization_mode: w4a16
chaiml-pony-d2-q235b-pv-18495-v2-uploader: Checking if ChaiML/pony-d2-q235b-pv1-lr5e6ep2r64g4-W4A16 already exists in ChaiML
chaiml-pony-d2-q235b-pv-18495-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d2-q235b-pv-18495-v2-uploader: Downloading snapshot of ChaiML/pony-d2-q235b-pv1-lr5e6ep2r64g4-W4A16...
chaiml-pony-d2-q235b-pv-18495-v2-uploader: Downloaded in 48.050s
chaiml-pony-d2-q235b-pv-18495-v2-uploader: Processed model ChaiML/pony-d2-q235b-pv1-lr5e6ep2r64g4 in 48.682s
chaiml-pony-d2-q235b-pv-18495-v2-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d2-q235b-pv-18495-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d2-q235b-pv-18495-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d2-q235b-pv-18495-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d2-q235b-pv-18495-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/added_tokens.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/.gitattributes
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/tokenizer_config.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/chat_template.jinja
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/generation_config.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/quantization_config.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/merges.txt
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/special_tokens_map.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/config.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/vocab.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model.safetensors.index.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/tokenizer.json
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00027-of-00027.safetensors
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00026-of-00027.safetensors
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00019-of-00027.safetensors
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00022-of-00027.safetensors
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00023-of-00027.safetensors
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00007-of-00027.safetensors
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00025-of-00027.safetensors
chaiml-pony-d2-q235b-pv-18495-v2-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d2-q235b-pv-18495-v2/default/model-00014-of-00027.safetensors
Job chaiml-pony-d2-q235b-pv-18495-v2-uploader completed after 189.91s with status: succeeded
Stopping job with name chaiml-pony-d2-q235b-pv-18495-v2-uploader
Pipeline stage VLLMUploader completed in 190.30s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.31s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d2-q235b-pv-18495-v2
Waiting for inference service chaiml-pony-d2-q235b-pv-18495-v2 to be ready
Inference service chaiml-pony-d2-q235b-pv-18495-v2 ready after 473.8713529109955s
Pipeline stage VLLMDeployer completed in 474.31s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0538504123687744s
Received healthy response to inference request in 2.0033457279205322s
Received healthy response to inference request in 2.0693366527557373s
Received healthy response to inference request in 1.8900866508483887s
Received healthy response to inference request in 3.0971755981445312s
Received healthy response to inference request in 1.8847806453704834s
Received healthy response to inference request in 1.9192633628845215s
Received healthy response to inference request in 1.8635220527648926s
Received healthy response to inference request in 1.8095386028289795s
Received healthy response to inference request in 2.2390310764312744s
Received healthy response to inference request in 2.01220440864563s
Received healthy response to inference request in 2.044620990753174s
Received healthy response to inference request in 2.1722607612609863s
Received healthy response to inference request in 1.8708093166351318s
Received healthy response to inference request in 1.9949102401733398s
Received healthy response to inference request in 1.885042428970337s
Received healthy response to inference request in 2.1332600116729736s
Received healthy response to inference request in 1.890141248703003s
Received healthy response to inference request in 1.8922197818756104s
Received healthy response to inference request in 1.912675142288208s
Received healthy response to inference request in 2.0008630752563477s
Received healthy response to inference request in 2.0744435787200928s
Received healthy response to inference request in 2.1166133880615234s
Received healthy response to inference request in 1.8845391273498535s
Received healthy response to inference request in 1.9960246086120605s
Received healthy response to inference request in 2.1744823455810547s
Received healthy response to inference request in 1.873180866241455s
Received healthy response to inference request in 1.9927551746368408s
Received healthy response to inference request in 2.300334930419922s
Received healthy response to inference request in 1.9361774921417236s
30 requests
0 failed requests
5th percentile: 1.8668013215065002
10th percentile: 1.8729437112808227
20th percentile: 1.8849900722503663
30th percentile: 1.891596221923828
40th percentile: 1.9294118404388427
50th percentile: 1.9954674243927002
60th percentile: 2.0068892002105714
70th percentile: 2.058496284484863
80th percentile: 2.1199427127838137
90th percentile: 2.180937218666077
95th percentile: 2.2727481961250304
99th percentile: 2.866091804504395
mean time: 2.0329163233439127
Pipeline stage StressChecker completed in 85.50s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
chaiml-pony-d2-q235b-pv_18495_v2 status is now deployed due to DeploymentManager action
chaiml-pony-d2-q235b-pv_18495_v2 status is now inactive due to auto deactivation removed underperforming models