chaiml-muster-v0a-lr1e5_44160

developer_uid: zonemercy
submission_id: chaiml-muster-v0a-lr1e5_44160_v5
model_name: chaiml-muster-v0a-lr1e5_44160_v5
model_group: ChaiML/muster-v0a-lr1e5e
status: torndown
timestamp: 2026-02-11T15:01:20+00:00
num_battles: 11127
num_wins: 6355
celo_rating: 1354.03
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0a-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v0a-lr1e5_44160_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0a-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-08
win_ratio: 0.5711332794104431
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|assistant|>', '<|user|>', '<|im_end|>', '</think>', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0a-lr1e5-44160-v5-uploader
Waiting for job on chaiml-muster-v0a-lr1e5-44160-v5-uploader to finish
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0a-lr1e5-44160-v5-uploader: Using quantization_mode: w4a16
chaiml-muster-v0a-lr1e5-44160-v5-uploader: Checking if ChaiML/muster-v0a-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0a-lr1e5-44160-v5-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0a-lr1e5-44160-v5-uploader: Downloading snapshot of ChaiML/muster-v0a-lr1e5ep2r64g4b01-W4A16...
chaiml-muster-v0a-lr1e5-44160-v5-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:10,  3.47it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:11<00:56,  1.75s/it]
Fetching 39 files:  21%|██        | 8/39 [00:13<00:52,  1.71s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:21<00:32,  1.35s/it]
Fetching 39 files:  41%|████      | 16/39 [00:23<00:34,  1.49s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:24<00:24,  1.15s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:25<00:23,  1.19s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:25<00:19,  1.03s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:33<00:26,  1.66s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:35<00:27,  1.83s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:36<00:17,  1.31s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:37<00:15,  1.27s/it]
Fetching 39 files:  74%|███████▍  | 29/39 [00:38<00:09,  1.02it/s]
Fetching 39 files:  79%|███████▉  | 31/39 [00:40<00:07,  1.08it/s]
Fetching 39 files:  82%|████████▏ | 32/39 [00:40<00:06,  1.14it/s]
Fetching 39 files: 100%|██████████| 39/39 [00:40<00:00,  1.04s/it]
chaiml-muster-v0a-lr1e5-44160-v5-uploader: Downloaded in 40.817s
chaiml-muster-v0a-lr1e5-44160-v5-uploader: Processed model ChaiML/muster-v0a-lr1e5ep2r64g4b01 in 41.368s
chaiml-muster-v0a-lr1e5-44160-v5-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0a-lr1e5-44160-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0a-lr1e5-44160-v5-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0a-lr1e5-44160-v5-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0a-lr1e5-44160-v5-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/chat_template.jinja
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/added_tokens.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/special_tokens_map.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/tokenizer_config.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/.gitattributes
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/generation_config.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/quantization_config.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/config.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/merges.txt
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model.safetensors.index.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/tokenizer.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/vocab.json
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00011-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00023-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00018-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00021-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00022-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00002-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00012-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00016-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00005-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00009-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00010-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00007-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00003-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00008-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00020-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00024-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00015-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00004-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00025-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00013-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00014-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00006-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00019-of-00027.safetensors
chaiml-muster-v0a-lr1e5-44160-v5-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0a-lr1e5-44160-v5/model-00001-of-00027.safetensors
Job chaiml-muster-v0a-lr1e5-44160-v5-uploader completed after 605.3s with status: succeeded
Stopping job with name chaiml-muster-v0a-lr1e5-44160-v5-uploader
Pipeline stage VLLMUploader completed in 605.68s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0a-lr1e5-44160-v5
Waiting for inference service chaiml-muster-v0a-lr1e5-44160-v5 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Retrying (%r) after connection broken by '%r': %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Retrying (%r) after connection broken by '%r': %s
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0a-lr1e5-44160-v5 ready after 781.3464407920837s
Pipeline stage VLLMDeployer completed in 781.83s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0554401874542236s
Received healthy response to inference request in 2.4474711418151855s
Received healthy response to inference request in 1.9360129833221436s
Received healthy response to inference request in 2.535400152206421s
Received healthy response to inference request in 2.3427987098693848s
Received healthy response to inference request in 2.1915862560272217s
Received healthy response to inference request in 1.9302146434783936s
Received healthy response to inference request in 1.9135878086090088s
Received healthy response to inference request in 2.3919284343719482s
Received healthy response to inference request in 2.2208399772644043s
Received healthy response to inference request in 1.8772385120391846s
Received healthy response to inference request in 2.395806312561035s
Received healthy response to inference request in 2.1408910751342773s
Received healthy response to inference request in 2.168034553527832s
Received healthy response to inference request in 2.1294281482696533s
Received healthy response to inference request in 2.3085360527038574s
Received healthy response to inference request in 1.941230297088623s
Received healthy response to inference request in 2.075845241546631s
Received healthy response to inference request in 2.226062536239624s
Received healthy response to inference request in 2.263075590133667s
Received healthy response to inference request in 1.985236406326294s
Received healthy response to inference request in 1.9036188125610352s
Received healthy response to inference request in 1.9237444400787354s
Received healthy response to inference request in 2.4005320072174072s
Received healthy response to inference request in 1.9537663459777832s
Received healthy response to inference request in 2.231574535369873s
Received healthy response to inference request in 2.899973154067993s
Received healthy response to inference request in 2.8073651790618896s
Received healthy response to inference request in 2.397404670715332s
Received healthy response to inference request in 2.5818591117858887s
30 requests
0 failed requests
5th percentile: 1.9081048607826232
10th percentile: 1.9227287769317627
20th percentile: 1.9401868343353272
30th percentile: 2.0343790531158445
40th percentile: 2.136305904388428
50th percentile: 2.206213116645813
60th percentile: 2.2441749572753906
70th percentile: 2.357537627220154
80th percentile: 2.398030138015747
90th percentile: 2.540046048164368
95th percentile: 2.7058874487876885
99th percentile: 2.8731168413162234
mean time: 2.219216775894165
Pipeline stage StressChecker completed in 70.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.69s
Shutdown handler de-registered
chaiml-muster-v0a-lr1e5_44160_v5 status is now deployed due to DeploymentManager action
chaiml-muster-v0a-lr1e5_44160_v5 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0a-lr1e5_44160_v5 status is now torndown due to DeploymentManager action