chaiml-muster-v0b-lr1e_34397

developer_uid: zonemercy
submission_id: chaiml-muster-v0b-lr1e_34397_v11
model_name: chaiml-muster-v0b-lr1e_34397_v11
model_group: ChaiML/muster-v0b-lr1e5e
status: inactive
timestamp: 2026-02-08T09:26:37+00:00
num_battles: 10790
num_wins: 6149
celo_rating: 1351.02
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v0b-lr1e_34397_v11
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0b-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-08
win_ratio: 0.5698795180722892
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '</think>', '<|assistant|>', '####', '<|im_end|>', '<|user|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0b-lr1e-34397-v11-uploader
Waiting for job on chaiml-muster-v0b-lr1e-34397-v11-uploader to finish
chaiml-muster-v0b-lr1e-34397-v11-uploader: Using quantization_mode: w4a16
chaiml-muster-v0b-lr1e-34397-v11-uploader: Checking if ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0b-lr1e-34397-v11-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0b-lr1e-34397-v11-uploader: Downloading snapshot of ChaiML/muster-v0b-lr1e5ep2r64g4b01-W4A16...
chaiml-muster-v0b-lr1e-34397-v11-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:10,  3.63it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:11<00:52,  1.65s/it]
Fetching 39 files:  21%|██        | 8/39 [00:14<00:57,  1.87s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:20<00:29,  1.23s/it]
Fetching 39 files:  41%|████      | 16/39 [00:21<00:29,  1.30s/it]
Fetching 39 files:  44%|████▎     | 17/39 [00:22<00:27,  1.24s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:24<00:28,  1.34s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:26<00:28,  1.43s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:26<00:23,  1.23s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:31<00:22,  1.40s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:32<00:20,  1.34s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:34<00:20,  1.48s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:38<00:18,  1.57s/it]
Fetching 39 files:  74%|███████▍  | 29/39 [00:38<00:10,  1.07s/it]
Fetching 39 files:  79%|███████▉  | 31/39 [00:39<00:07,  1.13it/s]
Fetching 39 files:  82%|████████▏ | 32/39 [00:40<00:05,  1.21it/s]
Fetching 39 files: 100%|██████████| 39/39 [00:40<00:00,  1.03s/it]
chaiml-muster-v0b-lr1e-34397-v11-uploader: Downloaded in 40.215s
chaiml-muster-v0b-lr1e-34397-v11-uploader: Processed model ChaiML/muster-v0b-lr1e5ep2r64g4b01 in 40.752s
chaiml-muster-v0b-lr1e-34397-v11-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0b-lr1e-34397-v11-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0b-lr1e-34397-v11-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0b-lr1e-34397-v11-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0b-lr1e-34397-v11-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/.gitattributes
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/chat_template.jinja
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/tokenizer_config.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/generation_config.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/special_tokens_map.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/added_tokens.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/config.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/quantization_config.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/merges.txt
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/vocab.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/tokenizer.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model.safetensors.index.json
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00027-of-00027.safetensors
Retrying (%r) after connection broken by '%r': %s
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00010-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00015-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00012-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00019-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00003-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00001-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00009-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00002-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00006-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00026-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00021-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00007-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00024-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00011-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00004-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00018-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00025-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00013-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00005-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00016-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00008-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00022-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00020-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00014-of-00027.safetensors
chaiml-muster-v0b-lr1e-34397-v11-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0b-lr1e-34397-v11/model-00017-of-00027.safetensors
Job chaiml-muster-v0b-lr1e-34397-v11-uploader completed after 606.71s with status: succeeded
Stopping job with name chaiml-muster-v0b-lr1e-34397-v11-uploader
Pipeline stage VLLMUploader completed in 607.11s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0b-lr1e-34397-v11
Waiting for inference service chaiml-muster-v0b-lr1e-34397-v11 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0b-lr1e-34397-v11 ready after 730.5899019241333s
Pipeline stage VLLMDeployer completed in 731.27s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.655477285385132s
Received healthy response to inference request in 1.9656310081481934s
Received healthy response to inference request in 2.0705504417419434s
Received healthy response to inference request in 1.911738634109497s
Received healthy response to inference request in 2.2978882789611816s
Received healthy response to inference request in 2.0310323238372803s
Received healthy response to inference request in 2.2844927310943604s
Received healthy response to inference request in 2.5774168968200684s
Received healthy response to inference request in 1.9231560230255127s
Received healthy response to inference request in 2.0335593223571777s
Received healthy response to inference request in 1.920060157775879s
Received healthy response to inference request in 1.9122543334960938s
Received healthy response to inference request in 2.1355538368225098s
Received healthy response to inference request in 2.5971333980560303s
Received healthy response to inference request in 2.058357000350952s
Received healthy response to inference request in 1.9977989196777344s
Received healthy response to inference request in 2.2742490768432617s
Received healthy response to inference request in 2.267272710800171s
Received healthy response to inference request in 1.9814178943634033s
Received healthy response to inference request in 2.169161558151245s
Received healthy response to inference request in 1.9017627239227295s
Received healthy response to inference request in 1.883718729019165s
Received healthy response to inference request in 2.089453935623169s
Received healthy response to inference request in 1.9987664222717285s
Received healthy response to inference request in 2.0807840824127197s
Received healthy response to inference request in 2.0037145614624023s
Received healthy response to inference request in 2.1605441570281982s
Received healthy response to inference request in 2.1122515201568604s
Received healthy response to inference request in 1.9529085159301758s
Received healthy response to inference request in 1.9674873352050781s
30 requests
0 failed requests
5th percentile: 1.906251883506775
10th percentile: 1.9122027635574341
20th percentile: 1.9469580173492431
30th percentile: 1.9772387266159057
40th percentile: 2.001735305786133
50th percentile: 2.045958161354065
60th percentile: 2.0842520236968993
70th percentile: 2.143050932884216
80th percentile: 2.268667984008789
90th percentile: 2.3258411407470705
95th percentile: 2.5882609724998473
99th percentile: 2.6385575580596923
mean time: 2.107186460494995
Pipeline stage StressChecker completed in 67.43s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
chaiml-muster-v0b-lr1e_34397_v11 status is now deployed due to DeploymentManager action
chaiml-muster-v0b-lr1e_34397_v11 status is now inactive due to auto deactivation removed underperforming models