developer_uid: zonemercy
submission_id: chaiml-muster-v0-q235b_52842_v12
model_name: chaiml-muster-v0-q235b_52842_v12
model_group: ChaiML/muster-v0-q235b-l
status: torndown
timestamp: 2026-02-12T16:07:20+00:00
num_battles: 11316
num_wins: 5917
celo_rating: 1319.44
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0-q235b-lr1e4ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: default
display_name: chaiml-muster-v0-q235b_52842_v12
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0-q235b-lr1e4ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-08
win_ratio: 0.5228879462707671
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '<|assistant|>', '####', '<|user|>', '</think>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0-q235b-52842-v12-uploader
Waiting for job on chaiml-muster-v0-q235b-52842-v12-uploader to finish
chaiml-muster-v0-q235b-52842-v12-uploader: Using quantization_mode: w4a16
chaiml-muster-v0-q235b-52842-v12-uploader: Checking if ChaiML/muster-v0-q235b-lr1e4ep2r64g4-W4A16 already exists in ChaiML
Retrying (%r) after connection broken by '%r': %s
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0-q235b-52842-v12-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:09,  3.96it/s]
Fetching 39 files:  15%|█▌        | 6/39 [00:00<00:01, 17.70it/s]
Fetching 39 files:  23%|██▎       | 9/39 [00:14<00:59,  1.99s/it]
Fetching 39 files:  26%|██▌       | 10/39 [00:14<00:48,  1.67s/it]
Fetching 39 files:  33%|███▎      | 13/39 [00:14<00:26,  1.01s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:24<00:52,  2.17s/it]
Fetching 39 files:  41%|████      | 16/39 [00:25<00:45,  1.98s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:27<00:28,  1.44s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:27<00:23,  1.22s/it]
Fetching 39 files:  54%|█████▍    | 21/39 [00:28<00:18,  1.01s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:36<00:33,  2.09s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:38<00:30,  2.07s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:41<00:19,  1.65s/it]
Fetching 39 files:  79%|███████▉  | 31/39 [00:43<00:08,  1.07s/it]
Fetching 39 files:  82%|████████▏ | 32/39 [00:43<00:06,  1.00it/s]
Fetching 39 files: 100%|██████████| 39/39 [00:43<00:00,  1.12s/it]
chaiml-muster-v0-q235b-52842-v12-uploader: Downloaded in 43.905s
chaiml-muster-v0-q235b-52842-v12-uploader: Processed model ChaiML/muster-v0-q235b-lr1e4ep2r64g4 in 44.431s
chaiml-muster-v0-q235b-52842-v12-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v12-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0-q235b-52842-v12-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v12-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v12-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v12-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v12-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0-q235b-52842-v12-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0-q235b-52842-v12-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0-q235b-52842-v12-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0-q235b-52842-v12-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0-q235b-52842-v12-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/.gitattributes
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/generation_config.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/config.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/chat_template.jinja
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/quantization_config.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/merges.txt
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/tokenizer_config.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model.safetensors.index.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/tokenizer.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/added_tokens.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/vocab.json
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/special_tokens_map.json
HTTP Request: %s %s "%s %d %s"
Retrying (%r) after connection broken by '%r': %s
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00011-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00012-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00003-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00013-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00014-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00023-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00021-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00007-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00025-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00018-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00001-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00024-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00022-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00004-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00019-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00008-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00010-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00005-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00015-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00009-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00002-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00020-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00016-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v12-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v12/model-00006-of-00027.safetensors
Job chaiml-muster-v0-q235b-52842-v12-uploader completed after 799.0s with status: succeeded
Stopping job with name chaiml-muster-v0-q235b-52842-v12-uploader
Pipeline stage VLLMUploader completed in 799.60s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0-q235b-52842-v12
Waiting for inference service chaiml-muster-v0-q235b-52842-v12 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0-q235b-52842-v12 ready after 890.9605052471161s
Pipeline stage VLLMDeployer completed in 891.36s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8561530113220215s
Received healthy response to inference request in 2.0457401275634766s
Received healthy response to inference request in 2.169694662094116s
Received healthy response to inference request in 2.2025907039642334s
Received healthy response to inference request in 1.9971468448638916s
Received healthy response to inference request in 1.9093408584594727s
Received healthy response to inference request in 1.8196673393249512s
Received healthy response to inference request in 1.7761428356170654s
Received healthy response to inference request in 1.7786076068878174s
Received healthy response to inference request in 1.7767419815063477s
Received healthy response to inference request in 1.7441473007202148s
Received healthy response to inference request in 1.7283902168273926s
Received healthy response to inference request in 2.206249713897705s
Received healthy response to inference request in 1.8641886711120605s
Received healthy response to inference request in 1.8521339893341064s
Received healthy response to inference request in 1.7672991752624512s
Received healthy response to inference request in 1.87546968460083s
Received healthy response to inference request in 1.759385347366333s
Received healthy response to inference request in 2.2657628059387207s
Received healthy response to inference request in 1.7812352180480957s
Received healthy response to inference request in 1.8936002254486084s
Received healthy response to inference request in 1.8905847072601318s
Received healthy response to inference request in 1.7168092727661133s
Received healthy response to inference request in 1.8661231994628906s
Received healthy response to inference request in 2.207008123397827s
Received healthy response to inference request in 2.2665865421295166s
Received healthy response to inference request in 2.3219568729400635s
Received healthy response to inference request in 1.7683558464050293s
Received healthy response to inference request in 2.023493766784668s
Received healthy response to inference request in 1.9057528972625732s
30 requests
0 failed requests
5th percentile: 1.7354809045791626
10th percentile: 1.7578615427017212
20th percentile: 1.7745854377746582
30th percentile: 1.7804469347000123
40th percentile: 1.8545454025268555
50th percentile: 1.8707964420318604
60th percentile: 1.8984612941741943
70th percentile: 2.0050509214401244
80th percentile: 2.17627387046814
90th percentile: 2.2128835916519165
95th percentile: 2.2662158608436584
99th percentile: 2.305899477005005
mean time: 1.9345453182856243
Pipeline stage StressChecker completed in 61.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
chaiml-muster-v0-q235b_52842_v12 status is now deployed due to DeploymentManager action
chaiml-muster-v0-q235b_52842_v12 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0-q235b_52842_v12 status is now torndown due to DeploymentManager action