developer_uid: zonemercy
submission_id: chaiml-muster-v0-q235b-_52842_v4
model_name: chaiml-muster-v0-q235b-_52842_v4
model_group: ChaiML/muster-v0-q235b-l
status: torndown
timestamp: 2026-02-07T10:27:46+00:00
num_battles: 11427
num_wins: 6142
celo_rating: 1329.33
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0-q235b-lr1e4ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v0-q235b-_52842_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0-q235b-lr1e4ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-04
win_ratio: 0.5374989060995887
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '<|assistant|>', '<|user|>', '</think>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0-q235b-52842-v4-uploader
Waiting for job on chaiml-muster-v0-q235b-52842-v4-uploader to finish
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0-q235b-52842-v4-uploader: Using quantization_mode: w4a16
chaiml-muster-v0-q235b-52842-v4-uploader: Checking if ChaiML/muster-v0-q235b-lr1e4ep2r64g4-W4A16 already exists in ChaiML
chaiml-muster-v0-q235b-52842-v4-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0-q235b-52842-v4-uploader: Downloading snapshot of ChaiML/muster-v0-q235b-lr1e4ep2r64g4-W4A16...
chaiml-muster-v0-q235b-52842-v4-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:11,  3.27it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:11<00:52,  1.64s/it]
Fetching 39 files:  21%|██        | 8/39 [00:11<00:46,  1.48s/it]
Fetching 39 files:  23%|██▎       | 9/39 [00:14<00:50,  1.67s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:21<00:33,  1.39s/it]
Fetching 39 files:  41%|████      | 16/39 [00:24<00:37,  1.64s/it]
Fetching 39 files:  44%|████▎     | 17/39 [00:25<00:31,  1.43s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:27<00:33,  1.61s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:28<00:23,  1.25s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:34<00:23,  1.48s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:35<00:22,  1.48s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:36<00:19,  1.39s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:37<00:16,  1.27s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:41<00:22,  1.83s/it]
Fetching 39 files:  77%|███████▋  | 30/39 [00:41<00:08,  1.05it/s]
Fetching 39 files:  79%|███████▉  | 31/39 [00:42<00:08,  1.01s/it]
Fetching 39 files:  82%|████████▏ | 32/39 [00:43<00:06,  1.00it/s]
Fetching 39 files: 100%|██████████| 39/39 [00:43<00:00,  1.12s/it]
chaiml-muster-v0-q235b-52842-v4-uploader: Downloaded in 43.677s
chaiml-muster-v0-q235b-52842-v4-uploader: Processed model ChaiML/muster-v0-q235b-lr1e4ep2r64g4 in 44.220s
chaiml-muster-v0-q235b-52842-v4-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v4-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0-q235b-52842-v4-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v4-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v4-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v4-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v4-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0-q235b-52842-v4-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0-q235b-52842-v4-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0-q235b-52842-v4-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0-q235b-52842-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0-q235b-52842-v4-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/added_tokens.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/.gitattributes
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/chat_template.jinja
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/tokenizer_config.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/special_tokens_map.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/config.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/quantization_config.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/generation_config.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/merges.txt
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/tokenizer.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/vocab.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model.safetensors.index.json
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00016-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00014-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00018-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00009-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00007-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00024-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00025-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00017-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00002-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00019-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00003-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00026-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00020-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00008-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00010-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00006-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00021-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00022-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00011-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00023-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00012-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00005-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00013-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00004-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00001-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v4-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v4/model-00015-of-00027.safetensors
Job chaiml-muster-v0-q235b-52842-v4-uploader completed after 493.62s with status: succeeded
Stopping job with name chaiml-muster-v0-q235b-52842-v4-uploader
Pipeline stage VLLMUploader completed in 493.99s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0-q235b-52842-v4
Waiting for inference service chaiml-muster-v0-q235b-52842-v4 to be ready
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-csfs-v3-3-dpo-lr_86358_v2: ('http://guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com/models/chaiml-csfs-v3-3-dpo-lr_86358_v2/predict', '{"detail":"1 validation error for RuntimeResponse\\npredictions\\n  Field required [type=missing, input_value={\'detail\': \\"503, message=...o-lr_86358_v2/predict\'\\"}, input_type=dict]\\n    For further information visit https://errors.pydantic.dev/2.12/v/missing"}')
Inference service chaiml-muster-v0-q235b-52842-v4 ready after 512.08740401268s
Pipeline stage VLLMDeployer completed in 512.48s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0354056358337402s
Received healthy response to inference request in 2.2738444805145264s
Received healthy response to inference request in 2.0431318283081055s
Received healthy response to inference request in 1.9761574268341064s
Received healthy response to inference request in 1.8935823440551758s
Received healthy response to inference request in 1.8887097835540771s
Received healthy response to inference request in 1.8622946739196777s
Received healthy response to inference request in 2.439840316772461s
Received healthy response to inference request in 2.1014184951782227s
Received healthy response to inference request in 2.213728904724121s
Received healthy response to inference request in 2.137049674987793s
Received healthy response to inference request in 1.9537417888641357s
Received healthy response to inference request in 1.8270220756530762s
Received healthy response to inference request in 1.9304423332214355s
Received healthy response to inference request in 1.9840400218963623s
Received healthy response to inference request in 2.2687008380889893s
Received healthy response to inference request in 2.226727247238159s
Received healthy response to inference request in 2.056941509246826s
Received healthy response to inference request in 1.9349238872528076s
Received healthy response to inference request in 2.1147353649139404s
Received healthy response to inference request in 1.8909831047058105s
Received healthy response to inference request in 2.1316397190093994s
Received healthy response to inference request in 2.0441501140594482s
Received healthy response to inference request in 2.271468162536621s
Received healthy response to inference request in 2.2471282482147217s
Received healthy response to inference request in 2.1516458988189697s
Received healthy response to inference request in 2.1477701663970947s
Received healthy response to inference request in 2.004838466644287s
Received healthy response to inference request in 1.936638593673706s
Received healthy response to inference request in 2.162954807281494s
30 requests
0 failed requests
5th percentile: 1.8741814732551574
10th percentile: 1.8907557725906372
20th percentile: 1.9340275764465331
30th percentile: 1.9694327354431151
40th percentile: 2.023178768157959
50th percentile: 2.050545811653137
60th percentile: 2.121497106552124
70th percentile: 2.1489328861236574
80th percentile: 2.216328573226929
90th percentile: 2.2689775705337523
95th percentile: 2.272775137424469
99th percentile: 2.3917015242576602
mean time: 2.0717218637466432
Pipeline stage StressChecker completed in 65.88s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.69s
Shutdown handler de-registered
chaiml-muster-v0-q235b-_52842_v4 status is now deployed due to DeploymentManager action
chaiml-muster-v0-q235b-_52842_v4 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0-q235b-_52842_v4 status is now torndown due to DeploymentManager action