developer_uid: zonemercy
submission_id: chaiml-muster-v2-q235b-_77862_v3
model_name: chaiml-muster-v2-q235b-_77862_v3
model_group: ChaiML/muster-v2-q235b-l
status: inactive
timestamp: 2026-02-10T15:16:59+00:00
num_battles: 11405
num_wins: 5977
celo_rating: 1325.34
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v2-q235b-lr1e4ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v2-q235b-_77862_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v2-q235b-lr1e4ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-10
win_ratio: 0.5240683910565541
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|im_end|>', '<|user|>', '</think>', '<|assistant|>', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v2-q235b-77862-v3-uploader
Waiting for job on chaiml-muster-v2-q235b-77862-v3-uploader to finish
chaiml-muster-v2-q235b-77862-v3-uploader: Using quantization_mode: w4a16
chaiml-muster-v2-q235b-77862-v3-uploader: Checking if ChaiML/muster-v2-q235b-lr1e4ep2r64g4-W4A16 already exists in ChaiML
chaiml-muster-v2-q235b-77862-v3-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v2-q235b-77862-v3-uploader: Downloading snapshot of ChaiML/muster-v2-q235b-lr1e4ep2r64g4-W4A16...
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v2-q235b-77862-v3-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:10,  3.66it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:12<00:58,  1.82s/it]
Fetching 39 files:  21%|██        | 8/39 [00:16<01:08,  2.21s/it]
Fetching 39 files:  23%|██▎       | 9/39 [00:17<00:58,  1.95s/it]
Fetching 39 files:  28%|██▊       | 11/39 [00:17<00:35,  1.28s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:26<00:43,  1.82s/it]
Fetching 39 files:  41%|████      | 16/39 [00:29<00:43,  1.89s/it]
Fetching 39 files:  44%|████▎     | 17/39 [00:30<00:38,  1.77s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:32<00:38,  1.81s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:35<00:42,  2.12s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:43<00:33,  2.08s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:45<00:29,  1.96s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:48<00:32,  2.29s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:50<00:29,  2.30s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:56<00:36,  3.01s/it]
Fetching 39 files:  79%|███████▉  | 31/39 [00:57<00:11,  1.45s/it]
Fetching 39 files: 100%|██████████| 39/39 [00:57<00:00,  1.47s/it]
chaiml-muster-v2-q235b-77862-v3-uploader: Downloaded in 57.533s
chaiml-muster-v2-q235b-77862-v3-uploader: Processed model ChaiML/muster-v2-q235b-lr1e4ep2r64g4 in 58.058s
chaiml-muster-v2-q235b-77862-v3-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v2-q235b-77862-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v2-q235b-77862-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v2-q235b-77862-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v2-q235b-77862-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v2-q235b-77862-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v2-q235b-77862-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v2-q235b-77862-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v2-q235b-77862-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v2-q235b-77862-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v2-q235b-77862-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v2-q235b-77862-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/special_tokens_map.json
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/added_tokens.json
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/generation_config.json
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/chat_template.jinja
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/tokenizer_config.json
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/.gitattributes
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/quantization_config.json
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/config.json
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00013-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00015-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00012-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00018-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00009-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00003-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00001-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00007-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00008-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00019-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00002-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00014-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00006-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00005-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00004-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00016-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00022-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00024-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00017-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00011-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00026-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00020-of-00027.safetensors
chaiml-muster-v2-q235b-77862-v3-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v2-q235b-77862-v3/model-00010-of-00027.safetensors
Job chaiml-muster-v2-q235b-77862-v3-uploader completed after 310.28s with status: succeeded
Stopping job with name chaiml-muster-v2-q235b-77862-v3-uploader
Pipeline stage VLLMUploader completed in 323.11s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v2-q235b-77862-v3
Waiting for inference service chaiml-muster-v2-q235b-77862-v3 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Unable to record family friendly update due to error: Invalid JSON input: Expecting value: line 1 column 1 (char 0)
Inference service chaiml-muster-v2-q235b-77862-v3 ready after 591.1506655216217s
Pipeline stage VLLMDeployer completed in 594.05s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2828125953674316s
Received healthy response to inference request in 2.4299848079681396s
Received healthy response to inference request in 1.9525408744812012s
Received healthy response to inference request in 1.890777349472046s
Received healthy response to inference request in 2.0259103775024414s
Received healthy response to inference request in 2.1275217533111572s
Received healthy response to inference request in 1.988393783569336s
Received healthy response to inference request in 2.055572748184204s
Received healthy response to inference request in 1.9248685836791992s
Received healthy response to inference request in 2.5209851264953613s
Received healthy response to inference request in 2.1307501792907715s
Received healthy response to inference request in 2.39575457572937s
Received healthy response to inference request in 2.048449754714966s
Received healthy response to inference request in 2.225628137588501s
Received healthy response to inference request in 2.126666307449341s
Received healthy response to inference request in 2.4771597385406494s
Received healthy response to inference request in 2.184148073196411s
Received healthy response to inference request in 1.9131906032562256s
Received healthy response to inference request in 2.2419395446777344s
Received healthy response to inference request in 2.7345781326293945s
Received healthy response to inference request in 1.98484468460083s
Received healthy response to inference request in 2.3149986267089844s
Received healthy response to inference request in 1.9396028518676758s
Received healthy response to inference request in 2.105043888092041s
Received healthy response to inference request in 2.0005624294281006s
Received healthy response to inference request in 1.9789495468139648s
Received healthy response to inference request in 2.0060412883758545s
Received healthy response to inference request in 2.2020692825317383s
Received healthy response to inference request in 3.552109479904175s
Received healthy response to inference request in 1.9256796836853027s
30 requests
0 failed requests
5th percentile: 1.9184456944465638
10th percentile: 1.9255985736846923
20th percentile: 1.973667812347412
30th percentile: 1.9969118356704711
40th percentile: 2.039434003829956
50th percentile: 2.115855097770691
60th percentile: 2.152109336853027
70th percentile: 2.230521559715271
80th percentile: 2.331149816513062
90th percentile: 2.481542277336121
95th percentile: 2.638461279869079
99th percentile: 3.3150253891944894
mean time: 2.189584493637085
Pipeline stage StressChecker completed in 70.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
chaiml-muster-v2-q235b-_77862_v3 status is now deployed due to DeploymentManager action
chaiml-muster-v2-q235b-_77862_v3 status is now inactive due to auto deactivation removed underperforming models