chaiml-muster-v0a-lr1e5_44160

developer_uid: zonemercy
submission_id: chaiml-muster-v0a-lr1e5_44160_v6
model_name: chaiml-muster-v0a-lr1e5_44160_v6
model_group: ChaiML/muster-v0a-lr1e5e
status: inactive
timestamp: 2026-02-08T18:17:16+00:00
num_battles: 13175
num_wins: 7200
celo_rating: 1337.95
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0a-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: default
display_name: chaiml-muster-v0a-lr1e5_44160_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0a-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-08
win_ratio: 0.5464895635673624
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|user|>', '####', '</think>', '</s>', '<|im_end|>', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0a-lr1e5-44160-v6-uploader
Waiting for job on chaiml-muster-v0a-lr1e5-44160-v6-uploader to finish
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0a-lr1e5-44160-v6-uploader: Using quantization_mode: w4a16
chaiml-muster-v0a-lr1e5-44160-v6-uploader: Checking if ChaiML/muster-v0a-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0a-lr1e5-44160-v6-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0a-lr1e5-44160-v6-uploader: Downloading snapshot of ChaiML/muster-v0a-lr1e5ep2r64g4b01-W4A16...
chaiml-muster-v0a-lr1e5-44160-v6-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:10,  3.61it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:16<01:17,  2.42s/it]
Fetching 39 files:  31%|███       | 12/39 [00:16<00:32,  1.21s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:24<00:40,  1.69s/it]
Fetching 39 files:  41%|████      | 16/39 [00:28<00:44,  1.92s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:29<00:31,  1.51s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:31<00:33,  1.67s/it]
Fetching 39 files:  54%|█████▍    | 21/39 [00:32<00:21,  1.20s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:40<00:33,  2.07s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:41<00:28,  1.93s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:42<00:24,  1.76s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:43<00:19,  1.49s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:46<00:22,  1.86s/it]
Fetching 39 files:  74%|███████▍  | 29/39 [00:47<00:12,  1.28s/it]
Fetching 39 files:  79%|███████▉  | 31/39 [00:48<00:08,  1.12s/it]
Fetching 39 files:  82%|████████▏ | 32/39 [00:49<00:07,  1.07s/it]
Fetching 39 files: 100%|██████████| 39/39 [00:49<00:00,  1.27s/it]
chaiml-muster-v0a-lr1e5-44160-v6-uploader: Downloaded in 49.665s
chaiml-muster-v0a-lr1e5-44160-v6-uploader: Processed model ChaiML/muster-v0a-lr1e5ep2r64g4b01 in 50.187s
chaiml-muster-v0a-lr1e5-44160-v6-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0a-lr1e5-44160-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0a-lr1e5-44160-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0a-lr1e5-44160-v6-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0a-lr1e5-44160-v6-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/added_tokens.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/generation_config.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/.gitattributes
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/chat_template.jinja
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/tokenizer_config.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/config.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/special_tokens_map.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/merges.txt
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/quantization_config.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/vocab.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/tokenizer.json
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model.safetensors.index.json
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Retrying (%r) after connection broken by '%r': %s
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00015-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00011-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00021-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00013-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00006-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00026-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00024-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00022-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00002-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00020-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00025-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00012-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00008-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00010-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00018-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00014-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00007-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00016-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00019-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00004-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00005-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00009-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00001-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00023-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v6-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v6/model-00017-of-00027.safetensors
Job chaiml-muster-v0a-lr1e5-44160-v6-uploader completed after 630.08s with status: succeeded
Stopping job with name chaiml-muster-v0a-lr1e5-44160-v6-uploader
Pipeline stage VLLMUploader completed in 630.45s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0a-lr1e5-44160-v6
Waiting for inference service chaiml-muster-v0a-lr1e5-44160-v6 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0a-lr1e5-44160-v6 ready after 1072.7844696044922s
Pipeline stage VLLMDeployer completed in 1073.14s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2921664714813232s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.749295473098755s
Received healthy response to inference request in 1.9175429344177246s
Received healthy response to inference request in 1.7907323837280273s
Received healthy response to inference request in 1.7962241172790527s
Received healthy response to inference request in 2.172703504562378s
Received healthy response to inference request in 2.2776269912719727s
Received healthy response to inference request in 1.9069759845733643s
Received healthy response to inference request in 1.8590319156646729s
Received healthy response to inference request in 1.8351926803588867s
Received healthy response to inference request in 2.1901051998138428s
Received healthy response to inference request in 1.7647171020507812s
Received healthy response to inference request in 1.8097598552703857s
Received healthy response to inference request in 1.9368035793304443s
Received healthy response to inference request in 2.3872838020324707s
Received healthy response to inference request in 1.9511871337890625s
Received healthy response to inference request in 2.02439284324646s
Received healthy response to inference request in 1.7449865341186523s
Received healthy response to inference request in 1.8380529880523682s
Received healthy response to inference request in 2.1631040573120117s
Received healthy response to inference request in 1.865584373474121s
Received healthy response to inference request in 1.831157922744751s
Received healthy response to inference request in 2.316344738006592s
Received healthy response to inference request in 1.7017576694488525s
Received healthy response to inference request in 1.9014041423797607s
Received healthy response to inference request in 1.9907476902008057s
Received healthy response to inference request in 1.7871956825256348s
Received healthy response to inference request in 2.56689453125s
Received healthy response to inference request in 1.916778564453125s
Received healthy response to inference request in 2.280416965484619s
30 requests
0 failed requests
5th percentile: 1.7538652896881104
10th percentile: 1.7849478244781494
20th percentile: 1.8070527076721192
30th percentile: 1.8371948957443238
40th percentile: 1.887076234817505
50th percentile: 1.9171607494354248
60th percentile: 1.9670113563537597
70th percentile: 2.1659838914871217
80th percentile: 2.278184986114502
90th percentile: 2.3234386444091797
95th percentile: 2.4860697031021113
99th percentile: 2.6963991999626162
mean time: 2.0188722610473633
Pipeline stage StressChecker completed in 64.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
chaiml-muster-v0a-lr1e5_44160_v6 status is now deployed due to DeploymentManager action
chaiml-muster-v0a-lr1e5_44160_v6 status is now inactive due to auto deactivation removed underperforming models