chaiml-pony-d1-q235b-pv_97292

developer_uid: zonemercy
submission_id: chaiml-pony-d1-q235b-pv_97292_v2
model_name: chaiml-pony-d1-q235b-pv_97292_v2
model_group: ChaiML/pony-d1-q235b-pv1
status: inactive
timestamp: 2026-02-28T09:26:58+00:00
num_battles: 11648
num_wins: 6624
celo_rating: 1341.69
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d1-q235b-pv1-lr5e6ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d1-q235b-pv_97292_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d1-q235b-pv1-lr5e6ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-28
win_ratio: 0.5686813186813187
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '<|im_end|>', '<|assistant|>', '<|user|>', '####', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d1-q235b-pv-97292-v2-uploader
Waiting for job on chaiml-pony-d1-q235b-pv-97292-v2-uploader to finish
chaiml-pony-d1-q235b-pv-97292-v2-uploader: Using quantization_mode: w4a16
chaiml-pony-d1-q235b-pv-97292-v2-uploader: Checking if ChaiML/pony-d1-q235b-pv1-lr5e6ep2r64g4-W4A16 already exists in ChaiML
chaiml-pony-d1-q235b-pv-97292-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d1-q235b-pv-97292-v2-uploader: Downloading snapshot of ChaiML/pony-d1-q235b-pv1-lr5e6ep2r64g4-W4A16...
chaiml-pony-d1-q235b-pv-97292-v2-uploader: Downloaded in 48.300s
chaiml-pony-d1-q235b-pv-97292-v2-uploader: Processed model ChaiML/pony-d1-q235b-pv1-lr5e6ep2r64g4 in 48.932s
chaiml-pony-d1-q235b-pv-97292-v2-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d1-q235b-pv-97292-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d1-q235b-pv-97292-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d1-q235b-pv-97292-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d1-q235b-pv-97292-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/.gitattributes
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/tokenizer_config.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/special_tokens_map.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/config.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/chat_template.jinja
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/quantization_config.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/generation_config.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/added_tokens.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/merges.txt
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/vocab.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/tokenizer.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model.safetensors.index.json
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00027-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00009-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00006-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00012-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00025-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00003-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00002-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00004-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00023-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00017-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00013-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00024-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00021-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00010-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00005-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00001-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00018-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00011-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00022-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00020-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00008-of-00027.safetensors
chaiml-pony-d1-q235b-pv-97292-v2-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-d1-q235b-pv-97292-v2/default/model-00026-of-00027.safetensors
Job chaiml-pony-d1-q235b-pv-97292-v2-uploader completed after 161.19s with status: succeeded
Stopping job with name chaiml-pony-d1-q235b-pv-97292-v2-uploader
Pipeline stage VLLMUploader completed in 161.79s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.33s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d1-q235b-pv-97292-v2
Waiting for inference service chaiml-pony-d1-q235b-pv-97292-v2 to be ready
Inference service chaiml-pony-d1-q235b-pv-97292-v2 ready after 470.32835936546326s
Pipeline stage VLLMDeployer completed in 470.70s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0527260303497314s
Received healthy response to inference request in 2.0354464054107666s
Received healthy response to inference request in 1.9728922843933105s
Received healthy response to inference request in 2.0026638507843018s
Received healthy response to inference request in 2.076291084289551s
Received healthy response to inference request in 1.855909824371338s
Received healthy response to inference request in 1.9380362033843994s
Received healthy response to inference request in 2.1937448978424072s
Received healthy response to inference request in 1.923546314239502s
Received healthy response to inference request in 1.8718481063842773s
Received healthy response to inference request in 2.005305767059326s
Received healthy response to inference request in 2.145024061203003s
Received healthy response to inference request in 1.9011855125427246s
Received healthy response to inference request in 1.873366117477417s
Received healthy response to inference request in 1.9804470539093018s
Received healthy response to inference request in 2.1161837577819824s
Received healthy response to inference request in 2.1148056983947754s
Received healthy response to inference request in 1.8777306079864502s
Received healthy response to inference request in 1.9378559589385986s
Received healthy response to inference request in 1.818228006362915s
Received healthy response to inference request in 2.4093730449676514s
Received healthy response to inference request in 1.835932731628418s
Received healthy response to inference request in 2.0679380893707275s
Received healthy response to inference request in 1.989938497543335s
Received healthy response to inference request in 2.146484136581421s
Received healthy response to inference request in 2.0478880405426025s
Received healthy response to inference request in 2.2658791542053223s
Received healthy response to inference request in 2.0016911029815674s
Received healthy response to inference request in 2.1629953384399414s
Received healthy response to inference request in 2.1866400241851807s
30 requests
0 failed requests
5th percentile: 1.844922423362732
10th percentile: 1.8702542781829834
20th percentile: 1.8964945316314696
30th percentile: 1.9379821300506592
40th percentile: 1.9861419200897217
50th percentile: 2.003984808921814
60th percentile: 2.0498232364654543
70th percentile: 2.087845468521118
80th percentile: 2.1453160762786867
90th percentile: 2.1873505115509033
95th percentile: 2.23341873884201
99th percentile: 2.367759816646576
mean time: 2.026933256785075
Pipeline stage StressChecker completed in 70.87s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.13s
Shutdown handler de-registered
chaiml-pony-d1-q235b-pv_97292_v2 status is now deployed due to DeploymentManager action
chaiml-pony-d1-q235b-pv_97292_v2 status is now inactive due to auto deactivation removed underperforming models