developer_uid: zonemercy
submission_id: chaiml-muster-v1-q235b-_25291_v4
model_name: chaiml-muster-v1-q235b-_25291_v4
model_group: ChaiML/muster-v1-q235b-l
status: torndown
timestamp: 2026-02-07T10:27:47+00:00
num_battles: 11054
num_wins: 5853
celo_rating: 1323.95
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v1-q235b-lr1e4ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v1-q235b-_25291_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v1-q235b-lr1e4ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-04
win_ratio: 0.5294915867559254
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '<|assistant|>', '</s>', '<|user|>', '####', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v1-q235b-25291-v4-uploader
Waiting for job on chaiml-muster-v1-q235b-25291-v4-uploader to finish
chaiml-muster-v1-q235b-25291-v4-uploader: Using quantization_mode: w4a16
chaiml-muster-v1-q235b-25291-v4-uploader: Checking if ChaiML/muster-v1-q235b-lr1e4ep2r64g4-W4A16 already exists in ChaiML
chaiml-muster-v1-q235b-25291-v4-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v1-q235b-25291-v4-uploader: Downloading snapshot of ChaiML/muster-v1-q235b-lr1e4ep2r64g4-W4A16...
chaiml-muster-v1-q235b-25291-v4-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:10,  3.51it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:14<01:08,  2.15s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:24<00:38,  1.59s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:26<00:28,  1.38s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:28<00:28,  1.44s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:34<00:22,  1.40s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:35<00:21,  1.41s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:35<00:17,  1.22s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:38<00:19,  1.49s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:42<00:23,  1.97s/it]
Fetching 39 files:  79%|███████▉  | 31/39 [00:43<00:08,  1.02s/it]
Fetching 39 files:  82%|████████▏ | 32/39 [00:44<00:07,  1.04s/it]
Fetching 39 files: 100%|██████████| 39/39 [00:44<00:00,  1.13s/it]
chaiml-muster-v1-q235b-25291-v4-uploader: Downloaded in 44.420s
chaiml-muster-v1-q235b-25291-v4-uploader: Processed model ChaiML/muster-v1-q235b-lr1e4ep2r64g4 in 44.987s
chaiml-muster-v1-q235b-25291-v4-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v4-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v1-q235b-25291-v4-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v4-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v4-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v4-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v4-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v1-q235b-25291-v4-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v1-q235b-25291-v4-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v1-q235b-25291-v4-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v1-q235b-25291-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v1-q235b-25291-v4-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/added_tokens.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/.gitattributes
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/chat_template.jinja
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/generation_config.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/tokenizer_config.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/special_tokens_map.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/quantization_config.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/config.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/merges.txt
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/vocab.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model.safetensors.index.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/tokenizer.json
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00003-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00025-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00002-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00016-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00004-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00010-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00007-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00009-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00006-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00011-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00018-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00019-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00001-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00014-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00013-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00005-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00017-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00023-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00026-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00012-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00021-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00015-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00008-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00024-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v4-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v4/model-00022-of-00027.safetensors
Job chaiml-muster-v1-q235b-25291-v4-uploader completed after 504.17s with status: succeeded
Stopping job with name chaiml-muster-v1-q235b-25291-v4-uploader
Pipeline stage VLLMUploader completed in 504.53s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v1-q235b-25291-v4
Waiting for inference service chaiml-muster-v1-q235b-25291-v4 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v1-q235b-25291-v4 ready after 562.2477986812592s
Pipeline stage VLLMDeployer completed in 562.78s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2379605770111084s
Received healthy response to inference request in 2.0341415405273438s
Received healthy response to inference request in 2.082594394683838s
Received healthy response to inference request in 2.062385320663452s
Received healthy response to inference request in 1.9543571472167969s
Received healthy response to inference request in 2.014920711517334s
Received healthy response to inference request in 1.976081371307373s
Received healthy response to inference request in 2.1362316608428955s
Received healthy response to inference request in 2.0457794666290283s
Received healthy response to inference request in 2.0839858055114746s
Received healthy response to inference request in 2.064276695251465s
Received healthy response to inference request in 2.1064209938049316s
Received healthy response to inference request in 1.9014580249786377s
Received healthy response to inference request in 1.992933750152588s
Received healthy response to inference request in 2.2996163368225098s
Received healthy response to inference request in 2.1901497840881348s
Received healthy response to inference request in 2.336885690689087s
Received healthy response to inference request in 1.9907310009002686s
Received healthy response to inference request in 2.0100607872009277s
Received healthy response to inference request in 1.972559928894043s
Received healthy response to inference request in 1.9951040744781494s
Received healthy response to inference request in 1.9014766216278076s
Received healthy response to inference request in 1.9225153923034668s
Received healthy response to inference request in 2.0025508403778076s
Received healthy response to inference request in 1.9874317646026611s
Received healthy response to inference request in 2.005074977874756s
Received healthy response to inference request in 2.1428284645080566s
Received healthy response to inference request in 2.517958402633667s
Received healthy response to inference request in 2.0564961433410645s
Received healthy response to inference request in 2.0695440769195557s
30 requests
0 failed requests
5th percentile: 1.9109440684318542
10th percentile: 1.9511729717254638
20th percentile: 1.9851616859436034
30th percentile: 1.9944529771804809
40th percentile: 2.008066463470459
50th percentile: 2.039960503578186
60th percentile: 2.063141870498657
70th percentile: 2.083011817932129
80th percentile: 2.137551021575928
90th percentile: 2.2441261529922487
95th percentile: 2.320114481449127
99th percentile: 2.465447316169739
mean time: 2.069817058245341
Pipeline stage StressChecker completed in 65.78s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.83s
Shutdown handler de-registered
chaiml-muster-v1-q235b-_25291_v4 status is now deployed due to DeploymentManager action
chaiml-muster-v1-q235b-_25291_v4 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v1-q235b-_25291_v4 status is now torndown due to DeploymentManager action