developer_uid: richhx
submission_id: qwen-qwen3-5-27b_v7
model_name: qwen-qwen3-5-27b_v7
model_group: Qwen/Qwen3.5-27B
status: torndown
timestamp: 2026-03-20T18:42:07+00:00
num_battles: 10306
num_wins: 5012
celo_rating: 1285.7
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: Qwen/Qwen3.5-27B
model_architecture: Qwen3_5ForConditionalGeneration
model_num_parameters: 23564784640.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: qwen-qwen3-5-27b_v7
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: Qwen/Qwen3.5-27B
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-17
win_ratio: 0.4863186493304871
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|user|>', '</s>', '####', '<|im_end|>', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name qwen-qwen3-5-27b-v7-uploader
Waiting for job on qwen-qwen3-5-27b-v7-uploader to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-v2-q27b-lr1-74562-v5-uploader
Waiting for job on chaiml-pony-v2-q27b-lr1-74562-v5-uploader to finish
qwen-qwen3-5-27b-v7-uploader: Using quantization_mode: none
qwen-qwen3-5-27b-v7-uploader: Downloading snapshot of Qwen/Qwen3.5-27B...
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: Using quantization_mode: none
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: Downloading snapshot of ChaiML/pony-v2-q27b-lr1e4ep1r64g8...
qwen-qwen3-5-27b-v7-uploader: Downloaded in 18.159s
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: Downloaded in 32.800s
qwen-qwen3-5-27b-v7-uploader: Processed model Qwen/Qwen3.5-27B in 39.703s
qwen-qwen3-5-27b-v7-uploader: creating bucket guanaco-vllm-models
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
qwen-qwen3-5-27b-v7-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
qwen-qwen3-5-27b-v7-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
qwen-qwen3-5-27b-v7-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
qwen-qwen3-5-27b-v7-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
qwen-qwen3-5-27b-v7-uploader:   if re.search("-\.", bucket, re.UNICODE):
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
qwen-qwen3-5-27b-v7-uploader:   if re.search("\.\.", bucket, re.UNICODE):
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
qwen-qwen3-5-27b-v7-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
qwen-qwen3-5-27b-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
qwen-qwen3-5-27b-v7-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
qwen-qwen3-5-27b-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
qwen-qwen3-5-27b-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/generation_config.json
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/.gitattributes
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/chat_template.jinja
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/README.md
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/config.json
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors.index.json
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/preprocessor_config.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/preprocessor_config.json
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/tokenizer_config.json
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/video_preprocessor_config.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/video_preprocessor_config.json
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/merges.txt
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/vocab.json
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/tokenizer.json
2026-03-17T14:37:50.613285+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:37:51.841895+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: Processed model ChaiML/pony-v2-q27b-lr1e4ep1r64g8 in 52.913s
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: creating bucket guanaco-vllm-models
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00011-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00011-of-00011.safetensors
chaiml-pony-v2-q27b-lr1-74562-v5-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00005-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00005-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00003-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00003-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00004-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00004-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00008-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00008-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00009-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00009-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00010-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00010-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00007-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00007-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00002-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00002-of-00011.safetensors
qwen-qwen3-5-27b-v7-uploader: cp /dev/shm/model_output/model.safetensors-00001-of-00011.safetensors s3://guanaco-vllm-models/qwen-qwen3-5-27b-v7/default/model.safetensors-00001-of-00011.safetensors
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: cp /dev/shm/model_output/model-00002-of-00002.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-q27b-lr1-74562-v5/default/model-00002-of-00002.safetensors
Job qwen-qwen3-5-27b-v7-uploader completed after 75.66s with status: succeeded
Stopping job with name qwen-qwen3-5-27b-v7-uploader
Pipeline stage VLLMUploader completed in 76.34s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.92s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service qwen-qwen3-5-27b-v7
Waiting for inference service qwen-qwen3-5-27b-v7 to be ready
2026-03-17T14:38:50.772738+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:38:51.989892+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
2026-03-17T14:39:50.932686+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:39:52.160306+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
2026-03-17T14:40:51.092513+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:40:52.330868+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
Inference service qwen-qwen3-5-27b-v7 ready after 200.5273985862732s
Pipeline stage VLLMDeployer completed in 201.41s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-17T14:41:51.266190+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:41:52.861323+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
chaiml-pony-v2-q27b-lr1-74562-v5-uploader: cp /dev/shm/model_output/model-00001-of-00002.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-q27b-lr1-74562-v5/default/model-00001-of-00002.safetensors
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Job chaiml-pony-v2-q27b-lr1-74562-v5-uploader completed after 326.23s with status: succeeded
Stopping job with name chaiml-pony-v2-q27b-lr1-74562-v5-uploader
Pipeline stage VLLMUploader completed in 326.99s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.57s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-v2-q27b-lr1-74562-v5
Waiting for inference service chaiml-pony-v2-q27b-lr1-74562-v5 to be ready
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-17T14:42:51.478337+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:42:53.039051+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
Received healthy response to inference request in 4.829145908355713s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 4.6645402908325195s
2026-03-17T14:43:51.654396+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:43:53.217273+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 4.354031801223755s
Received healthy response to inference request in 2.3630921840667725s
Received healthy response to inference request in 4.551205635070801s
Received healthy response to inference request in 4.406728267669678s
Received healthy response to inference request in 2.469947099685669s
Received healthy response to inference request in 2.5007693767547607s
Received healthy response to inference request in 2.358922004699707s
Received healthy response to inference request in 2.376922845840454s
Received healthy response to inference request in 2.444044351577759s
Received healthy response to inference request in 2.3131208419799805s
Received healthy response to inference request in 2.342585802078247s
Received healthy response to inference request in 2.305760145187378s
Received healthy response to inference request in 2.29630446434021s
Received healthy response to inference request in 2.3236541748046875s
Received healthy response to inference request in 2.8384735584259033s
Received healthy response to inference request in 2.3277859687805176s
Received healthy response to inference request in 2.339456558227539s
2026-03-17T14:44:51.822372+00:00 monitor updated for qwen-qwen3-5-27b_v7
2026-03-17T14:44:53.390174+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
Received healthy response to inference request in 2.5630545616149902s
Received healthy response to inference request in 2.688955307006836s
Received healthy response to inference request in 2.357985734939575s
Received healthy response to inference request in 2.462297201156616s
30 requests
7 failed requests
5th percentile: 2.309072458744049
10th percentile: 2.322600841522217
20th percentile: 2.3419599533081055
30th percentile: 2.3618411302566527
40th percentile: 2.4549960613250734
50th percentile: 2.5319119691848755
60th percentile: 3.444696855545042
70th percentile: 4.585206031799316
80th percentile: 20.25076847076416
90th percentile: 20.276528191566467
95th percentile: 20.2787105679512
99th percentile: 20.285012309551238
mean time: 6.945550433794657
%s, retrying in %s seconds...
Received healthy response to inference request in 2.1661388874053955s
Received healthy response to inference request in 2.2955074310302734s
Received healthy response to inference request in 2.2613627910614014s
Received healthy response to inference request in 2.2109766006469727s
Received healthy response to inference request in 2.2399821281433105s
Received healthy response to inference request in 2.255624771118164s
Received healthy response to inference request in 2.5831375122070312s
Received healthy response to inference request in 2.534105062484741s
Received healthy response to inference request in 2.4370808601379395s
Received healthy response to inference request in 2.2423298358917236s
Received healthy response to inference request in 2.503751516342163s
Received healthy response to inference request in 2.3603551387786865s
Received healthy response to inference request in 2.2377495765686035s
Received healthy response to inference request in 2.298863172531128s
Received healthy response to inference request in 2.288902759552002s
Received healthy response to inference request in 2.2757728099823s
Received healthy response to inference request in 2.599712371826172s
Received healthy response to inference request in 2.7310092449188232s
Received healthy response to inference request in 2.2073171138763428s
2026-03-17T14:45:52.027601+00:00 monitor updated for qwen-qwen3-5-27b_v7
Received healthy response to inference request in 2.3413846492767334s
2026-03-17T14:45:53.568436+00:00 monitor updated for chaiml-pony-v2-q27b-lr1_74562_v5
Received healthy response to inference request in 2.3202462196350098s
Received healthy response to inference request in 2.619567632675171s
Received healthy response to inference request in 2.8383724689483643s
Received healthy response to inference request in 2.3169522285461426s
Received healthy response to inference request in 2.2952189445495605s
Received healthy response to inference request in 2.4520442485809326s
Received healthy response to inference request in 2.352935552597046s
Received healthy response to inference request in 2.4857845306396484s
Received healthy response to inference request in 2.4248106479644775s
Received healthy response to inference request in 2.4679532051086426s
30 requests
0 failed requests
5th percentile: 2.2089638829231264
10th percentile: 2.2350722789764403
20th percentile: 2.252965784072876
30th percentile: 2.284963774681091
40th percentile: 2.297520875930786
50th percentile: 2.3308154344558716
60th percentile: 2.386137342453003
70th percentile: 2.4568169355392455
80th percentile: 2.509822225570679
90th percentile: 2.601697897911072
95th percentile: 2.6808605194091792
99th percentile: 2.8072371339797972
mean time: 2.38816499710083
Pipeline stage StressChecker completed in 291.69s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.19s
Shutdown handler de-registered
qwen-qwen3-5-27b_v7 status is now deployed due to DeploymentManager action
qwen-qwen3-5-27b_v7 status is now inactive due to auto deactivation removed underperforming models
qwen-qwen3-5-27b_v7 status is now torndown due to DeploymentManager action