developer_uid: zonemercy
submission_id: chaiml-muster-v0b-lr1e_34397_v10
model_name: chaiml-muster-v0b-lr1e_34397_v10
model_group: ChaiML/muster-v0b-lr1e5e
status: torndown
timestamp: 2026-02-11T15:01:21+00:00
num_battles: 10843
num_wins: 6169
celo_rating: 1360.24
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v0b-lr1e_34397_v10
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-07
win_ratio: 0.5689384856589504
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|user|>', '<|assistant|>', '####', '<|im_end|>', '</think>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0b-lr1e-34397-v10-uploader
Waiting for job on chaiml-muster-v0b-lr1e-34397-v10-uploader to finish
chaiml-muster-v0b-lr1e-34397-v10-uploader: Using quantization_mode: w4a16
chaiml-muster-v0b-lr1e-34397-v10-uploader: Checking if ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0b-lr1e-34397-v10-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0b-lr1e-34397-v10-uploader: Downloading snapshot of ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16...
chaiml-muster-v0b-lr1e-34397-v10-uploader: Fetching 39 files: 0%| | 0/39 [00:00<?, ?it/s] Fetching 39 files: 3%|▎ | 1/39 [00:00<00:11, 3.24it/s] Fetching 39 files: 18%|█▊ | 7/39 [00:12<01:00, 1.89s/it] Fetching 39 files: 21%|██ | 8/39 [00:13<00:52, 1.70s/it] Fetching 39 files: 26%|██▌ | 10/39 [00:16<00:44, 1.54s/it] Fetching 39 files: 38%|███▊ | 15/39 [00:24<00:39, 1.63s/it] Fetching 39 files: 41%|████ | 16/39 [00:24<00:33, 1.46s/it] Fetching 39 files: 44%|████▎ | 17/39 [00:25<00:29, 1.35s/it] Fetching 39 files: 46%|████▌ | 18/39 [00:26<00:27, 1.32s/it] Fetching 39 files: 49%|████▊ | 19/39 [00:49<01:54, 5.74s/it] Fetching 39 files: 100%|██████████| 39/39 [00:49<00:00, 1.26s/it]
chaiml-muster-v0b-lr1e-34397-v10-uploader: Downloaded in 49.187s
chaiml-muster-v0b-lr1e-34397-v10-uploader: Processed model ChaiML/muster-v0b-lr1e5ep2r64g4b01 in 49.874s
chaiml-muster-v0b-lr1e-34397-v10-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v10-uploader: RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0b-lr1e-34397-v10-uploader: RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v10-uploader: invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v10-uploader: invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v10-uploader: if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v10-uploader: if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0b-lr1e-34397-v10-uploader: _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v10-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0b-lr1e-34397-v10-uploader: wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0b-lr1e-34397-v10-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0b-lr1e-34397-v10-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/chat_template.jinja
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/generation_config.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/special_tokens_map.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/.gitattributes
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/tokenizer_config.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/quantization_config.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/added_tokens.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/config.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/merges.txt
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/vocab.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model.safetensors.index.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/tokenizer.json
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00027-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00010-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00022-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00023-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00025-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00009-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00001-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00004-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00021-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00015-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00011-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00024-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00016-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00018-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00013-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00008-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00012-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00006-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00007-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00020-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00002-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00026-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00005-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00019-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00003-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v10-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v10/model-00017-of-00027.safetensors
Job chaiml-muster-v0b-lr1e-34397-v10-uploader completed after 635.37s with status: succeeded
Stopping job with name chaiml-muster-v0b-lr1e-34397-v10-uploader
Pipeline stage VLLMUploader completed in 635.73s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0b-lr1e-34397-v10
Waiting for inference service chaiml-muster-v0b-lr1e-34397-v10 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0b-lr1e-34397-v10 ready after 770.6400299072266s
Pipeline stage VLLMDeployer completed in 770.98s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.145902395248413s
Received healthy response to inference request in 2.159317970275879s
Received healthy response to inference request in 2.1484196186065674s
Received healthy response to inference request in 2.208117961883545s
Received healthy response to inference request in 1.986736536026001s
Received healthy response to inference request in 2.126314640045166s
Received healthy response to inference request in 2.115302562713623s
Received healthy response to inference request in 2.041538715362549s
Received healthy response to inference request in 2.3576455116271973s
Received healthy response to inference request in 2.3143701553344727s
Received healthy response to inference request in 2.2080633640289307s
Received healthy response to inference request in 2.468153715133667s
Received healthy response to inference request in 1.9980347156524658s
Received healthy response to inference request in 2.0672433376312256s
Received healthy response to inference request in 2.1001980304718018s
Received healthy response to inference request in 2.0649502277374268s
Received healthy response to inference request in 2.3349850177764893s
Received healthy response to inference request in 2.115978717803955s
Received healthy response to inference request in 2.0090596675872803s
Received healthy response to inference request in 7.265861988067627s
Received healthy response to inference request in 1.9455232620239258s
Received healthy response to inference request in 2.0514345169067383s
Received healthy response to inference request in 2.0113160610198975s
Received healthy response to inference request in 2.0315065383911133s
Received healthy response to inference request in 2.1853768825531006s
Received healthy response to inference request in 1.9821436405181885s
Received healthy response to inference request in 2.1646647453308105s
Received healthy response to inference request in 1.9093618392944336s
Received healthy response to inference request in 2.0413119792938232s
Received healthy response to inference request in 2.3173635005950928s
30 requests
0 failed requests
5th percentile: 1.962002432346344
10th percentile: 1.9862772464752196
20th percentile: 2.010864782333374
30th percentile: 2.041470694541931
40th percentile: 2.0663260936737062
50th percentile: 2.115640640258789
60th percentile: 2.1469092845916746
70th percentile: 2.1708783864974976
80th percentile: 2.2293684005737306
90th percentile: 2.33725106716156
95th percentile: 2.418425023555755
99th percentile: 5.874526588916782
mean time: 2.295873260498047
Pipeline stage StressChecker completed in 71.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
chaiml-muster-v0b-lr1e_34397_v10 status is now deployed due to DeploymentManager action
chaiml-muster-v0b-lr1e_34397_v10 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0b-lr1e_34397_v10 status is now torndown due to DeploymentManager action