developer_uid: zonemercy
submission_id: chaiml-pony-v1-q235b-lr_99625_v7
model_name: chaiml-pony-v1-q235b-lr_99625_v7
model_group: ChaiML/pony-v1-q235b-lr1
status: inactive
timestamp: 2026-02-22T06:57:52+00:00
num_battles: 11175
num_wins: 5713
celo_rating: 1306.78
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-v1-q235b-lr1e4ep1r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: default
display_name: chaiml-pony-v1-q235b-lr_99625_v7
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-v1-q235b-lr1e4ep1r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-21
win_ratio: 0.5112304250559284
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</think>', '####', '<|user|>', '<|assistant|>', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-v1-q235b-lr-99625-v7-uploader
Waiting for job on chaiml-pony-v1-q235b-lr-99625-v7-uploader to finish
HTTP Request: %s %s "%s %d %s"
chaiml-pony-v1-q235b-lr-99625-v7-uploader: Using quantization_mode: w4a16
chaiml-pony-v1-q235b-lr-99625-v7-uploader: Checking if ChaiML/pony-v1-q235b-lr1e4ep1r64g4-W4A16 already exists in ChaiML
chaiml-pony-v1-q235b-lr-99625-v7-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-v1-q235b-lr-99625-v7-uploader: Downloading snapshot of ChaiML/pony-v1-q235b-lr1e4ep1r64g4-W4A16...
chaiml-pony-v1-q235b-lr-99625-v7-uploader: Downloaded in 41.847s
chaiml-pony-v1-q235b-lr-99625-v7-uploader: Processed model ChaiML/pony-v1-q235b-lr1e4ep1r64g4 in 42.513s
chaiml-pony-v1-q235b-lr-99625-v7-uploader: creating bucket guanaco-vllm-models
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-v1-q235b-lr-99625-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-v1-q235b-lr-99625-v7-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-v1-q235b-lr-99625-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-v1-q235b-lr-99625-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/.gitattributes
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/added_tokens.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/config.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/chat_template.jinja
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/tokenizer_config.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/quantization_config.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/merges.txt
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/special_tokens_map.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/generation_config.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model.safetensors.index.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/vocab.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/tokenizer.json
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00027-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00023-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00014-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00025-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00010-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00018-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00017-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00009-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00019-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00016-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00007-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00012-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00015-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00008-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00022-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00001-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00024-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00013-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00020-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00021-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00011-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00002-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00006-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00005-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00026-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00003-of-00027.safetensors
chaiml-pony-v1-q235b-lr-99625-v7-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-pony-v1-q235b-lr-99625-v7/default/model-00004-of-00027.safetensors
Job chaiml-pony-v1-q235b-lr-99625-v7-uploader completed after 137.38s with status: succeeded
Stopping job with name chaiml-pony-v1-q235b-lr-99625-v7-uploader
Pipeline stage VLLMUploader completed in 137.77s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-v1-q235b-lr-99625-v7
Waiting for inference service chaiml-pony-v1-q235b-lr-99625-v7 to be ready
Failed to get response for submission chaiml-grpo-q235b-kimid_37540_v1: HTTPConnectionPool(host='chaiml-grpo-q235b-kimid-37540-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Inference service chaiml-pony-v1-q235b-lr-99625-v7 ready after 451.2201201915741s
Pipeline stage VLLMDeployer completed in 451.70s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9369561672210693s
Received healthy response to inference request in 1.9520554542541504s
Received healthy response to inference request in 1.911891222000122s
Received healthy response to inference request in 1.7296016216278076s
Received healthy response to inference request in 1.7511675357818604s
Received healthy response to inference request in 1.7101008892059326s
Received healthy response to inference request in 1.9272196292877197s
Received healthy response to inference request in 1.7482144832611084s
Received healthy response to inference request in 1.7313342094421387s
Received healthy response to inference request in 1.8218495845794678s
Received healthy response to inference request in 1.8442096710205078s
Received healthy response to inference request in 1.7336835861206055s
Received healthy response to inference request in 1.8270444869995117s
Received healthy response to inference request in 1.8403067588806152s
Received healthy response to inference request in 1.9342267513275146s
Received healthy response to inference request in 1.8241147994995117s
Received healthy response to inference request in 2.052957534790039s
Received healthy response to inference request in 1.7199296951293945s
Received healthy response to inference request in 1.7416682243347168s
Received healthy response to inference request in 1.8616576194763184s
Received healthy response to inference request in 1.7709174156188965s
Received healthy response to inference request in 1.836167812347412s
Received healthy response to inference request in 1.9851503372192383s
Received healthy response to inference request in 1.8566169738769531s
Received healthy response to inference request in 1.804243564605713s
Received healthy response to inference request in 1.9126734733581543s
Received healthy response to inference request in 1.9496512413024902s
Received healthy response to inference request in 1.785973072052002s
Received healthy response to inference request in 1.7871716022491455s
Received healthy response to inference request in 1.9773228168487549s
30 requests
0 failed requests
5th percentile: 1.7242820620536805
10th percentile: 1.7311609506607055
20th percentile: 1.74690523147583
30th percentile: 1.7814563751220702
40th percentile: 1.8148071765899658
50th percentile: 1.831606149673462
60th percentile: 1.849172592163086
70th percentile: 1.9121258974075317
80th percentile: 1.9347726345062255
90th percentile: 1.954582190513611
95th percentile: 1.9816279530525207
99th percentile: 2.033293447494507
mean time: 1.842202607790629
Pipeline stage StressChecker completed in 58.09s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.98s
Shutdown handler de-registered
chaiml-pony-v1-q235b-lr_99625_v7 status is now deployed due to DeploymentManager action
chaiml-pony-v1-q235b-lr_99625_v7 status is now inactive due to auto deactivation removed underperforming models