developer_uid: zonemercy
submission_id: chaiml-muster-v0-q235b_52842_v11
model_name: chaiml-muster-v0-q235b_52842_v11
model_group: ChaiML/muster-v0-q235b-l
status: torndown
timestamp: 2026-02-12T16:07:20+00:00
num_battles: 11772
num_wins: 6352
celo_rating: 1330.69
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0-q235b-lr1e4ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v0-q235b_52842_v11
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0-q235b-lr1e4ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-08
win_ratio: 0.5395854570166497
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '</s>', '<|user|>', '<|im_end|>', '####', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0-q235b-52842-v11-uploader
Waiting for job on chaiml-muster-v0-q235b-52842-v11-uploader to finish
chaiml-muster-v0-q235b-52842-v11-uploader: Using quantization_mode: w4a16
chaiml-muster-v0-q235b-52842-v11-uploader: Checking if ChaiML/muster-v0-q235b-lr1e4ep2r64g4-W4A16 already exists in ChaiML
chaiml-muster-v0-q235b-52842-v11-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v0-q235b-52842-v11-uploader: Downloading snapshot of ChaiML/muster-v0-q235b-lr1e4ep2r64g4-W4A16...
chaiml-muster-v0-q235b-52842-v11-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:11,  3.37it/s]
Fetching 39 files:   8%|▊         | 3/39 [00:00<00:04,  8.58it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:13<01:10,  2.20s/it]
Fetching 39 files:  21%|██        | 8/39 [00:16<01:14,  2.40s/it]
Fetching 39 files:  38%|███▊      | 15/39 [00:27<00:44,  1.87s/it]
Fetching 39 files:  41%|████      | 16/39 [00:28<00:40,  1.74s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:29<00:25,  1.26s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:30<00:24,  1.26s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:42<00:36,  2.28s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:42<00:29,  2.00s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:43<00:24,  1.74s/it]
Fetching 39 files:  69%|██████▉   | 27/39 [00:44<00:15,  1.31s/it]
Fetching 39 files:  72%|███████▏  | 28/39 [00:45<00:13,  1.25s/it]
Fetching 39 files:  74%|███████▍  | 29/39 [00:46<00:11,  1.18s/it]
Fetching 39 files:  79%|███████▉  | 31/39 [00:49<00:10,  1.31s/it]
Fetching 39 files:  82%|████████▏ | 32/39 [00:49<00:07,  1.05s/it]
Fetching 39 files: 100%|██████████| 39/39 [00:49<00:00,  1.27s/it]
chaiml-muster-v0-q235b-52842-v11-uploader: Downloaded in 49.593s
chaiml-muster-v0-q235b-52842-v11-uploader: Processed model ChaiML/muster-v0-q235b-lr1e4ep2r64g4 in 50.305s
chaiml-muster-v0-q235b-52842-v11-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v11-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v0-q235b-52842-v11-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v11-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v11-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v11-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v0-q235b-52842-v11-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v0-q235b-52842-v11-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v0-q235b-52842-v11-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v0-q235b-52842-v11-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v0-q235b-52842-v11-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v0-q235b-52842-v11-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/.gitattributes
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/added_tokens.json
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/tokenizer_config.json
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/chat_template.jinja
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/config.json
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/generation_config.json
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/quantization_config.json
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/special_tokens_map.json
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/merges.txt
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00025-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00006-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00017-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00021-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00019-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00004-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00005-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00001-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00016-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00026-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00015-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00010-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00014-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00007-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00018-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00008-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00009-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00013-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00020-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00011-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00002-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00022-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00012-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00023-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00024-of-00027.safetensors
chaiml-muster-v0-q235b-52842-v11-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0-q235b-52842-v11/model-00003-of-00027.safetensors
Job chaiml-muster-v0-q235b-52842-v11-uploader completed after 462.19s with status: succeeded
Stopping job with name chaiml-muster-v0-q235b-52842-v11-uploader
Pipeline stage VLLMUploader completed in 462.57s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0-q235b-52842-v11
Waiting for inference service chaiml-muster-v0-q235b-52842-v11 to be ready
Failed to get response for submission chaiml-02f4-69d4-linear-w01_v8: ('http://chaiml-safety-grpo-2025-50335-v5-predictor.tenant-chaiml-guanaco.k2.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:52712->127.0.0.1:8080: read: connection reset by peer\n')
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0-q235b-52842-v11 ready after 622.746325969696s
Pipeline stage VLLMDeployer completed in 623.50s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3904733657836914s
Received healthy response to inference request in 2.502835750579834s
Received healthy response to inference request in 2.203451633453369s
Received healthy response to inference request in 1.9806714057922363s
Received healthy response to inference request in 1.9243230819702148s
Received healthy response to inference request in 1.879899024963379s
Received healthy response to inference request in 2.4435667991638184s
Received healthy response to inference request in 2.2587010860443115s
Received healthy response to inference request in 2.073782205581665s
Received healthy response to inference request in 2.002465009689331s
Received healthy response to inference request in 2.316972255706787s
Received healthy response to inference request in 2.5852649211883545s
Received healthy response to inference request in 2.043564558029175s
Received healthy response to inference request in 2.533832550048828s
Received healthy response to inference request in 4.298237562179565s
Received healthy response to inference request in 2.113980770111084s
Received healthy response to inference request in 2.166666269302368s
Received healthy response to inference request in 2.536602735519409s
Received healthy response to inference request in 2.1355557441711426s
Received healthy response to inference request in 2.3477957248687744s
Received healthy response to inference request in 2.2055184841156006s
Received healthy response to inference request in 2.1337316036224365s
Received healthy response to inference request in 2.202692747116089s
Received healthy response to inference request in 2.216339588165283s
Received healthy response to inference request in 2.044463634490967s
Received healthy response to inference request in 2.0204169750213623s
Received healthy response to inference request in 2.199047565460205s
Received healthy response to inference request in 2.189969062805176s
Received healthy response to inference request in 2.0004844665527344s
Received healthy response to inference request in 2.0438036918640137s
30 requests
0 failed requests
5th percentile: 1.9496798276901246
10th percentile: 1.9985031604766845
20th percentile: 2.0389350414276124
30th percentile: 2.0649866342544554
40th percentile: 2.13482608795166
50th percentile: 2.1945083141326904
60th percentile: 2.2042783737182616
70th percentile: 2.276182436943054
80th percentile: 2.401092052459717
90th percentile: 2.5341095685958863
95th percentile: 2.563366937637329
99th percentile: 3.801475496292116
mean time: 2.266503675778707
Pipeline stage StressChecker completed in 83.69s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
Shutdown handler de-registered
chaiml-muster-v0-q235b_52842_v11 status is now deployed due to DeploymentManager action
chaiml-muster-v0-q235b_52842_v11 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0-q235b_52842_v11 status is now torndown due to DeploymentManager action