chaiml-muster-v0c-lr1e5e_3996

developer_uid: zonemercy
submission_id: chaiml-muster-v0c-lr1e5e_3996_v2
model_name: chaiml-muster-v0c-lr1e5e_3996_v2
model_group: ChaiML/muster-v0c-lr1e5e
status: torndown
timestamp: 2026-02-12T16:07:27+00:00
num_battles: 10715
num_wins: 5895
celo_rating: 1339.72
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0c-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: default
display_name: chaiml-muster-v0c-lr1e5e_3996_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0c-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-08
win_ratio: 0.5501633224451703
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '####', '<|user|>', '<|im_end|>', '<|assistant|>', '</think>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0c-lr1e5e-3996-v2-uploader
Waiting for job on chaiml-muster-v0c-lr1e5e-3996-v2-uploader to finish
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: Using quantization_mode: w4a16
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: Checking if ChaiML/muster-v0c-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: Downloading snapshot of ChaiML/muster-v0c-lr1e5ep2r64g4b01-W4A16...
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:10,  3.75it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:11<00:52,  1.64s/it]
Fetching 39 files:  21%|██        | 8/39 [00:15<01:04,  2.07s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:25<00:40,  1.67s/it]
Fetching 39 files:  41%|████      | 16/39 [00:25<00:34,  1.50s/it]
Fetching 39 files:  44%|████▎     | 17/39 [00:26<00:30,  1.40s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:27<00:27,  1.31s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:28<00:20,  1.09s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:39<00:33,  2.12s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:39<00:17,  1.38s/it]
Fetching 39 files:  72%|███████▏  | 28/39 [00:41<00:13,  1.24s/it]
Fetching 39 files:  74%|███████▍  | 29/39 [00:41<00:11,  1.13s/it]
Fetching 39 files:  79%|███████▉  | 31/39 [00:43<00:08,  1.08s/it]
Fetching 39 files:  82%|████████▏ | 32/39 [00:45<00:08,  1.21s/it]
Fetching 39 files: 100%|██████████| 39/39 [00:45<00:00,  1.17s/it]
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: Downloaded in 45.566s
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: Processed model ChaiML/muster-v0c-lr1e5ep2r64g4b01 in 46.128s
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0c-lr1e5e-3996-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/added_tokens.json
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/.gitattributes
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/generation_config.json
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/chat_template.jinja
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/tokenizer_config.json
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/special_tokens_map.json
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/merges.txt
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/vocab.json
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/tokenizer.json
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model.safetensors.index.json
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00009-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00019-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00018-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00021-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00016-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00002-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00020-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00014-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00013-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00005-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00017-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00026-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00006-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00007-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00003-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00024-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00012-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00001-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00010-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00008-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00023-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00025-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00015-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00011-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00022-of-00027.safetensors
chaiml-muster-v0c-lr1e5e-3996-v2-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0c-lr1e5e-3996-v2/model-00004-of-00027.safetensors
Job chaiml-muster-v0c-lr1e5e-3996-v2-uploader completed after 789.71s with status: succeeded
Stopping job with name chaiml-muster-v0c-lr1e5e-3996-v2-uploader
Pipeline stage VLLMUploader completed in 790.27s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0c-lr1e5e-3996-v2
Waiting for inference service chaiml-muster-v0c-lr1e5e-3996-v2 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0c-lr1e5e-3996-v2 ready after 913.2439594268799s
Pipeline stage VLLMDeployer completed in 913.62s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.082153558731079s
Received healthy response to inference request in 1.9121720790863037s
Received healthy response to inference request in 1.7803072929382324s
Received healthy response to inference request in 1.7148048877716064s
Received healthy response to inference request in 1.710994005203247s
Received healthy response to inference request in 2.1384365558624268s
Received healthy response to inference request in 1.8118138313293457s
Received healthy response to inference request in 2.178050994873047s
Received healthy response to inference request in 1.866382122039795s
Received healthy response to inference request in 2.041470527648926s
Received healthy response to inference request in 2.7472739219665527s
Received healthy response to inference request in 2.388643980026245s
Received healthy response to inference request in 1.707284927368164s
Received healthy response to inference request in 2.0525217056274414s
Received healthy response to inference request in 1.8291125297546387s
Received healthy response to inference request in 2.012882947921753s
Received healthy response to inference request in 2.028898000717163s
Received healthy response to inference request in 1.941199779510498s
Received healthy response to inference request in 1.7246596813201904s
Received healthy response to inference request in 1.8196873664855957s
Received healthy response to inference request in 1.740384578704834s
Received healthy response to inference request in 1.8221182823181152s
Received healthy response to inference request in 1.7873644828796387s
Received healthy response to inference request in 2.131405830383301s
Received healthy response to inference request in 1.8904147148132324s
Received healthy response to inference request in 2.2000675201416016s
Received healthy response to inference request in 1.835880994796753s
Received healthy response to inference request in 1.916039228439331s
Received healthy response to inference request in 1.8603246212005615s
Received healthy response to inference request in 1.8692834377288818s
30 requests
0 failed requests
5th percentile: 1.7127089023590087
10th percentile: 1.723674201965332
20th percentile: 1.7859530448913574
30th percentile: 1.8213890075683594
40th percentile: 1.8505471706390382
50th percentile: 1.8798490762710571
60th percentile: 1.9261034488677977
70th percentile: 2.032669758796692
80th percentile: 2.0920040130615236
90th percentile: 2.1802526473999024
95th percentile: 2.303784573078155
99th percentile: 2.6432712388038637
mean time: 1.9514011462529501
Pipeline stage StressChecker completed in 62.66s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
chaiml-muster-v0c-lr1e5e_3996_v2 status is now deployed due to DeploymentManager action
chaiml-muster-v0c-lr1e5e_3996_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0c-lr1e5e_3996_v2 status is now torndown due to DeploymentManager action