chaiml-muster-v0b-lr1e_34397

developer_uid: zonemercy
submission_id: chaiml-muster-v0b-lr1e_34397_v12
model_name: chaiml-muster-v0b-lr1e_34397_v12
model_group: ChaiML/muster-v0b-lr1e5e
status: inactive
timestamp: 2026-02-08T18:17:16+00:00
num_battles: 14234
num_wins: 7762
celo_rating: 1336.99
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: default
display_name: chaiml-muster-v0b-lr1e_34397_v12
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-08
win_ratio: 0.5453140368132641
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</think>', '<|assistant|>', '<|user|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0b-lr1e-34397-v12-uploader
Waiting for job on chaiml-muster-v0b-lr1e-34397-v12-uploader to finish
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0b-lr1e-34397-v12-uploader: Using quantization_mode: w4a16
chaiml-muster-v0b-lr1e-34397-v12-uploader: Checking if ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0b-lr1e-34397-v12-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0b-lr1e-34397-v12-uploader: Downloading snapshot of ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16...
chaiml-muster-v0b-lr1e-34397-v12-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:09,  3.85it/s]
Fetching 39 files:  15%|█▌        | 6/39 [00:00<00:01, 18.24it/s]
Fetching 39 files:  23%|██▎       | 9/39 [00:15<01:06,  2.22s/it]
Fetching 39 files:  26%|██▌       | 10/39 [00:15<00:54,  1.87s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:26<00:47,  1.98s/it]
Fetching 39 files:  41%|████      | 16/39 [00:26<00:41,  1.82s/it]
Fetching 39 files:  44%|████▎     | 17/39 [00:27<00:34,  1.55s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:27<00:27,  1.33s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:29<00:27,  1.39s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:30<00:26,  1.42s/it]
Fetching 39 files:  54%|█████▍    | 21/39 [00:30<00:20,  1.13s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:39<00:37,  2.36s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:39<00:29,  1.99s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:40<00:23,  1.70s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:47<00:40,  3.10s/it]
Fetching 39 files: 100%|██████████| 39/39 [00:47<00:00,  1.22s/it]
chaiml-muster-v0b-lr1e-34397-v12-uploader: Downloaded in 47.785s
chaiml-muster-v0b-lr1e-34397-v12-uploader: Processed model ChaiML/muster-v0b-lr1e5ep2r64g4b01 in 48.315s
chaiml-muster-v0b-lr1e-34397-v12-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v12-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0b-lr1e-34397-v12-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0b-lr1e-34397-v12-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0b-lr1e-34397-v12-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model.safetensors.index.json
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00011-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00014-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00005-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00006-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00012-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00009-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00024-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00008-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00013-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00021-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00003-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00020-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00015-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00022-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00025-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00026-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00001-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00007-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00018-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00010-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00023-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00004-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v12-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v12/model-00016-of-00027.safetensors
Job chaiml-muster-v0b-lr1e-34397-v12-uploader completed after 628.15s with status: succeeded
Stopping job with name chaiml-muster-v0b-lr1e-34397-v12-uploader
Pipeline stage VLLMUploader completed in 628.53s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0b-lr1e-34397-v12
Waiting for inference service chaiml-muster-v0b-lr1e-34397-v12 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0b-lr1e-34397-v12 ready after 962.2277040481567s
Pipeline stage VLLMDeployer completed in 962.94s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.958643913269043s
Received healthy response to inference request in 1.7282295227050781s
Received healthy response to inference request in 1.7118103504180908s
Received healthy response to inference request in 1.8108751773834229s
Received healthy response to inference request in 1.916419506072998s
Received healthy response to inference request in 2.123587131500244s
Received healthy response to inference request in 1.8694565296173096s
Received healthy response to inference request in 1.9414122104644775s
Received healthy response to inference request in 1.9477922916412354s
Received healthy response to inference request in 1.7605667114257812s
Received healthy response to inference request in 1.8004107475280762s
Received healthy response to inference request in 1.8238444328308105s
Received healthy response to inference request in 1.7303574085235596s
Received healthy response to inference request in 1.8019616603851318s
Received healthy response to inference request in 1.7964296340942383s
Received healthy response to inference request in 2.0854623317718506s
Received healthy response to inference request in 1.7026171684265137s
Received healthy response to inference request in 1.8322196006774902s
Received healthy response to inference request in 1.9599292278289795s
Received healthy response to inference request in 1.9076616764068604s
Received healthy response to inference request in 2.2224183082580566s
Received healthy response to inference request in 2.006880760192871s
Received healthy response to inference request in 2.3316476345062256s
Received healthy response to inference request in 2.240767002105713s
Received healthy response to inference request in 1.7404892444610596s
Received healthy response to inference request in 1.9921793937683105s
Received healthy response to inference request in 1.7509291172027588s
Received healthy response to inference request in 1.9664478302001953s
Received healthy response to inference request in 1.7287349700927734s
Received healthy response to inference request in 1.7967255115509033s
30 requests
0 failed requests
5th percentile: 1.7191989779472352
10th percentile: 1.728684425354004
20th percentile: 1.748841142654419
30th percentile: 1.7966367483139039
40th percentile: 1.8073097705841064
50th percentile: 1.8508380651474
60th percentile: 1.9264165878295898
70th percentile: 1.9590295076370239
80th percentile: 1.9951196670532227
90th percentile: 2.1334702491760256
95th percentile: 2.2325100898742676
99th percentile: 2.305292251110077
mean time: 1.8995635668436686
Pipeline stage StressChecker completed in 61.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
chaiml-muster-v0b-lr1e_34397_v12 status is now deployed due to DeploymentManager action
chaiml-muster-v0b-lr1e_34397_v12 status is now inactive due to auto deactivation removed underperforming models