chaiml-muster-v0b-lr1e5_34397

developer_uid: zonemercy
submission_id: chaiml-muster-v0b-lr1e5_34397_v8
model_name: chaiml-muster-v0b-lr1e5_34397_v8
model_group: ChaiML/muster-v0b-lr1e5e
status: torndown
timestamp: 2026-02-10T15:01:09+00:00
num_battles: 11051
num_wins: 6188
celo_rating: 9999.0
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v0b-lr1e5_34397_v8
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-07
win_ratio: 0.5599493258528639
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|im_end|>', '</s>', '<|user|>', '####', '</think>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0b-lr1e5-34397-v8-uploader
Waiting for job on chaiml-muster-v0b-lr1e5-34397-v8-uploader to finish
chaiml-muster-v0b-lr1e5-34397-v8-uploader: Using quantization_mode: w4a16
chaiml-muster-v0b-lr1e5-34397-v8-uploader: Checking if ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0b-lr1e5-34397-v8-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0b-lr1e5-34397-v8-uploader: Downloading snapshot of ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16...
chaiml-muster-v0b-lr1e5-34397-v8-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:10,  3.73it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:15<01:12,  2.28s/it]
Fetching 39 files:  21%|██        | 8/39 [00:15<00:59,  1.91s/it]
Fetching 39 files:  36%|███▌      | 14/39 [00:15<00:19,  1.29it/s]
Fetching 39 files:  44%|████▎     | 17/39 [00:27<00:37,  1.73s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:29<00:30,  1.53s/it]
Fetching 39 files:  54%|█████▍    | 21/39 [00:31<00:25,  1.41s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:39<00:34,  2.13s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:41<00:30,  2.03s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:42<00:26,  1.88s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:43<00:16,  1.40s/it]
Fetching 39 files:  72%|███████▏  | 28/39 [00:43<00:13,  1.18s/it]
Fetching 39 files:  74%|███████▍  | 29/39 [00:44<00:11,  1.15s/it]
Fetching 39 files:  77%|███████▋  | 30/39 [00:44<00:08,  1.06it/s]
Fetching 39 files:  79%|███████▉  | 31/39 [00:47<00:10,  1.31s/it]
Fetching 39 files:  82%|████████▏ | 32/39 [00:48<00:08,  1.19s/it]
Fetching 39 files: 100%|██████████| 39/39 [00:48<00:00,  1.24s/it]
chaiml-muster-v0b-lr1e5-34397-v8-uploader: Downloaded in 48.262s
chaiml-muster-v0b-lr1e5-34397-v8-uploader: Processed model ChaiML/muster-v0b-lr1e5ep2r64g4b01 in 48.791s
chaiml-muster-v0b-lr1e5-34397-v8-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0b-lr1e5-34397-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0b-lr1e5-34397-v8-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0b-lr1e5-34397-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0b-lr1e5-34397-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/tokenizer_config.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/generation_config.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/chat_template.jinja
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/special_tokens_map.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/added_tokens.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/.gitattributes
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/config.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/quantization_config.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/tokenizer.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/merges.txt
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/vocab.json
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00027-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00020-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00016-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00004-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00008-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00019-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00015-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00013-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00024-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00011-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00014-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00023-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00005-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00003-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00026-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00001-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00012-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00022-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00017-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00021-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00018-of-00027.safetensors
chaiml-muster-v0b-lr1e5-34397-v8-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e5-34397-v8/model-00009-of-00027.safetensors
Job chaiml-muster-v0b-lr1e5-34397-v8-uploader completed after 613.18s with status: succeeded
Stopping job with name chaiml-muster-v0b-lr1e5-34397-v8-uploader
Pipeline stage VLLMUploader completed in 618.13s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.74s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0b-lr1e5-34397-v8
Waiting for inference service chaiml-muster-v0b-lr1e5-34397-v8 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0b-lr1e5-34397-v8 ready after 692.6087229251862s
Pipeline stage VLLMDeployer completed in 694.21s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0992212295532227s
Received healthy response to inference request in 2.904792547225952s
Received healthy response to inference request in 2.3142149448394775s
Received healthy response to inference request in 3.0983927249908447s
Received healthy response to inference request in 2.831402540206909s
Received healthy response to inference request in 2.281296491622925s
Received healthy response to inference request in 2.147045612335205s
Received healthy response to inference request in 2.4154396057128906s
Received healthy response to inference request in 2.3097288608551025s
Received healthy response to inference request in 2.5571978092193604s
Received healthy response to inference request in 2.6153388023376465s
Received healthy response to inference request in 2.2367801666259766s
Received healthy response to inference request in 2.4480905532836914s
Received healthy response to inference request in 2.623016595840454s
Received healthy response to inference request in 2.7469594478607178s
Received healthy response to inference request in 1.9241969585418701s
Received healthy response to inference request in 2.1835811138153076s
Received healthy response to inference request in 1.8714706897735596s
Received healthy response to inference request in 2.2109603881835938s
Received healthy response to inference request in 2.009368896484375s
Received healthy response to inference request in 2.347841262817383s
Received healthy response to inference request in 1.964289903640747s
Received healthy response to inference request in 2.2257370948791504s
Received healthy response to inference request in 2.2258570194244385s
Received healthy response to inference request in 2.053180456161499s
Received healthy response to inference request in 2.6967666149139404s
Received healthy response to inference request in 2.1407535076141357s
Received healthy response to inference request in 1.9561431407928467s
Received healthy response to inference request in 1.9014759063720703s
Received healthy response to inference request in 2.1991822719573975s
30 requests
0 failed requests
5th percentile: 1.9117003798484802
10th percentile: 1.952948522567749
20th percentile: 2.044418144226074
30th percentile: 2.145157980918884
40th percentile: 2.206249141693115
50th percentile: 2.2313185930252075
60th percentile: 2.3115232944488526
70th percentile: 2.425234889984131
80th percentile: 2.616874361038208
90th percentile: 2.755403757095337
95th percentile: 2.871767044067383
99th percentile: 3.042248673439026
mean time: 2.317990771929423
Pipeline stage StressChecker completed in 81.02s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
chaiml-muster-v0b-lr1e5_34397_v8 status is now deployed due to DeploymentManager action
chaiml-muster-v0b-lr1e5_34397_v8 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0b-lr1e5_34397_v8 status is now torndown due to DeploymentManager action