chaiml-muster-v1-q235b-_25291

developer_uid: zonemercy
submission_id: chaiml-muster-v1-q235b-_25291_v5
model_name: chaiml-muster-v1-q235b-_25291_v5
model_group: ChaiML/muster-v1-q235b-l
status: torndown
timestamp: 2026-02-07T11:37:43+00:00
num_battles: 11552
num_wins: 6205
celo_rating: 1333.29
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v1-q235b-lr1e4ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: chaiml-prm-kimi-v1-300k_92220_v7
display_name: chaiml-muster-v1-q235b-_25291_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v1-q235b-lr1e4ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-04
win_ratio: 0.5371364265927978
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|im_end|>', '</think>', '<|assistant|>', '<|user|>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v1-q235b-25291-v5-uploader
Waiting for job on chaiml-muster-v1-q235b-25291-v5-uploader to finish
chaiml-muster-v1-q235b-25291-v5-uploader: Using quantization_mode: w4a16
chaiml-muster-v1-q235b-25291-v5-uploader: Checking if ChaiML/muster-v1-q235b-lr1e4ep2r64g4-W4A16 already exists in ChaiML
chaiml-muster-v1-q235b-25291-v5-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v1-q235b-25291-v5-uploader: Downloading snapshot of ChaiML/muster-v1-q235b-lr1e4ep2r64g4-W4A16...
chaiml-muster-v1-q235b-25291-v5-uploader: 
Fetching 39 files:   0%|          | 0/39 [00:00<?, ?it/s]
Fetching 39 files:   3%|▎         | 1/39 [00:00<00:11,  3.39it/s]
Fetching 39 files:  18%|█▊        | 7/39 [00:13<01:03,  1.98s/it]
Fetching 39 files:  33%|███▎      | 13/39 [00:13<00:23,  1.12it/s]
Fetching 39 files:  38%|███▊      | 15/39 [00:20<00:33,  1.39s/it]
Fetching 39 files:  41%|████      | 16/39 [00:23<00:39,  1.70s/it]
Fetching 39 files:  46%|████▌     | 18/39 [00:25<00:29,  1.42s/it]
Fetching 39 files:  49%|████▊     | 19/39 [00:25<00:26,  1.30s/it]
Fetching 39 files:  51%|█████▏    | 20/39 [00:26<00:22,  1.21s/it]
Fetching 39 files:  54%|█████▍    | 21/39 [00:27<00:19,  1.07s/it]
Fetching 39 files:  59%|█████▉    | 23/39 [00:32<00:25,  1.60s/it]
Fetching 39 files:  62%|██████▏   | 24/39 [00:35<00:30,  2.00s/it]
Fetching 39 files:  64%|██████▍   | 25/39 [00:36<00:23,  1.69s/it]
Fetching 39 files:  67%|██████▋   | 26/39 [00:37<00:20,  1.56s/it]
Fetching 39 files:  72%|███████▏  | 28/39 [00:39<00:13,  1.22s/it]
Fetching 39 files:  77%|███████▋  | 30/39 [00:39<00:07,  1.25it/s]
Fetching 39 files:  79%|███████▉  | 31/39 [00:40<00:07,  1.13it/s]
Fetching 39 files:  82%|████████▏ | 32/39 [00:41<00:06,  1.13it/s]
Fetching 39 files: 100%|██████████| 39/39 [00:41<00:00,  1.06s/it]
chaiml-muster-v1-q235b-25291-v5-uploader: Downloaded in 41.388s
chaiml-muster-v1-q235b-25291-v5-uploader: Processed model ChaiML/muster-v1-q235b-lr1e4ep2r64g4 in 42.043s
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v5-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v1-q235b-25291-v5-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v5-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v5-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v5-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v5-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v1-q235b-25291-v5-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v1-q235b-25291-v5-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v1-q235b-25291-v5-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v1-q235b-25291-v5-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v1-q235b-25291-v5-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/chat_template.jinja
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/.gitattributes
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/added_tokens.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/special_tokens_map.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/generation_config.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/tokenizer_config.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/config.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/quantization_config.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/merges.txt
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/vocab.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model.safetensors.index.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/tokenizer.json
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00027-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00023-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00008-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00011-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00007-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00013-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00001-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00021-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00005-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00026-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00018-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00002-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00004-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00019-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00017-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00025-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00015-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00014-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00003-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00012-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00009-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00020-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00006-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00016-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v5-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v5/model-00010-of-00027.safetensors
Job chaiml-muster-v1-q235b-25291-v5-uploader completed after 451.66s with status: succeeded
Stopping job with name chaiml-muster-v1-q235b-25291-v5-uploader
Pipeline stage VLLMUploader completed in 452.08s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v1-q235b-25291-v5
Waiting for inference service chaiml-muster-v1-q235b-25291-v5 to be ready
Unable to record family friendly update due to error: Invalid JSON input: Expecting value: line 1 column 1 (char 0)
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v1-q235b-25291-v5 ready after 520.6200132369995s
Pipeline stage VLLMDeployer completed in 521.14s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9056620597839355s
Received healthy response to inference request in 1.8123178482055664s
Received healthy response to inference request in 2.0427308082580566s
Received healthy response to inference request in 1.7963967323303223s
Received healthy response to inference request in 1.8792142868041992s
Received healthy response to inference request in 1.8629095554351807s
Received healthy response to inference request in 1.7809441089630127s
Received healthy response to inference request in 1.8017570972442627s
Received healthy response to inference request in 1.8670628070831299s
Received healthy response to inference request in 1.8493568897247314s
Received healthy response to inference request in 1.808452844619751s
Received healthy response to inference request in 1.8203179836273193s
Received healthy response to inference request in 1.8005669116973877s
Received healthy response to inference request in 1.8230526447296143s
Received healthy response to inference request in 1.7846198081970215s
Received healthy response to inference request in 1.8093128204345703s
Received healthy response to inference request in 1.8523261547088623s
Received healthy response to inference request in 1.8140201568603516s
Received healthy response to inference request in 1.8352231979370117s
Received healthy response to inference request in 1.7927312850952148s
Received healthy response to inference request in 1.9724643230438232s
Received healthy response to inference request in 2.1202337741851807s
Received healthy response to inference request in 1.8044874668121338s
Received healthy response to inference request in 1.8751893043518066s
Received healthy response to inference request in 1.7987339496612549s
Received healthy response to inference request in 1.8722972869873047s
Received healthy response to inference request in 1.8051981925964355s
Received healthy response to inference request in 1.8503599166870117s
Received healthy response to inference request in 2.1995084285736084s
Received healthy response to inference request in 1.7607243061065674s
30 requests
0 failed requests
5th percentile: 1.7825981736183167
10th percentile: 1.7919201374053955
20th percentile: 1.8002003192901612
30th percentile: 1.804984974861145
40th percentile: 1.811115837097168
50th percentile: 1.8216853141784668
60th percentile: 1.8497581005096435
70th percentile: 1.8641555309295654
80th percentile: 1.8759943008422852
90th percentile: 1.9794909715652467
95th percentile: 2.0853574395179746
99th percentile: 2.1765187788009643
mean time: 1.8599390983581543
Pipeline stage StressChecker completed in 58.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
chaiml-muster-v1-q235b-_25291_v5 status is now deployed due to DeploymentManager action
chaiml-muster-v1-q235b-_25291_v5 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v1-q235b-_25291_v5 status is now torndown due to DeploymentManager action