chaiml-muster-v1-q235b-_25291

developer_uid: zonemercy
submission_id: chaiml-muster-v1-q235b-_25291_v3
model_name: chaiml-muster-v1-q235b-_25291_v3
model_group: ChaiML/muster-v1-q235b-l
status: torndown
timestamp: 2026-02-07T08:17:28+00:00
num_battles: 12444
num_wins: 6742
celo_rating: 1334.72
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v1-q235b-lr1e4ep2r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: chaiml-prm-kimi-v1-300k_92220_v7
display_name: chaiml-muster-v1-q235b-_25291_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v1-q235b-lr1e4ep2r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-04
win_ratio: 0.541787206685953
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '</think>', '####', '<|im_end|>', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v1-q235b-25291-v3-uploader
Waiting for job on chaiml-muster-v1-q235b-25291-v3-uploader to finish
chaiml-muster-v1-q235b-25291-v3-uploader: Using quantization_mode: w4a16
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v1-q235b-25291-v3-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v1-q235b-25291-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v1-q235b-25291-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v1-q235b-25291-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v1-q235b-25291-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v1-q235b-25291-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v1-q235b-25291-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v1-q235b-25291-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/.gitattributes
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/special_tokens_map.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/chat_template.jinja
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/added_tokens.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/tokenizer_config.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/generation_config.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/config.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/merges.txt
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/quantization_config.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/vocab.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/tokenizer.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model.safetensors.index.json
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00027-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00018-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00006-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00026-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00019-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00004-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00023-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00016-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00009-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00025-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00017-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00005-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00011-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00007-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00003-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00001-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00015-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00024-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00014-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00008-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00012-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00002-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00022-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00021-of-00027.safetensors
chaiml-muster-v1-q235b-25291-v3-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v1-q235b-25291-v3/model-00013-of-00027.safetensors
Job chaiml-muster-v1-q235b-25291-v3-uploader completed after 474.71s with status: succeeded
Stopping job with name chaiml-muster-v1-q235b-25291-v3-uploader
Pipeline stage VLLMUploader completed in 475.09s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v1-q235b-25291-v3
Waiting for inference service chaiml-muster-v1-q235b-25291-v3 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-02f4-69d4-linear-w01_v8: HTTPConnectionPool(host='guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v1-q235b-25291-v3 ready after 580.8256092071533s
Pipeline stage VLLMDeployer completed in 581.21s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8404059410095215s
Received healthy response to inference request in 1.839867353439331s
Received healthy response to inference request in 1.804337978363037s
Received healthy response to inference request in 1.7423906326293945s
Received healthy response to inference request in 2.1863884925842285s
Received healthy response to inference request in 1.833723545074463s
Received healthy response to inference request in 1.7966203689575195s
Received healthy response to inference request in 1.7865359783172607s
Received healthy response to inference request in 1.7360248565673828s
Received healthy response to inference request in 2.2840938568115234s
Received healthy response to inference request in 1.7664220333099365s
Received healthy response to inference request in 1.7652533054351807s
Received healthy response to inference request in 1.8156893253326416s
Received healthy response to inference request in 1.8051059246063232s
Received healthy response to inference request in 1.7541484832763672s
Received healthy response to inference request in 2.1084420680999756s
Received healthy response to inference request in 1.8124594688415527s
Received healthy response to inference request in 1.8119688034057617s
Received healthy response to inference request in 1.8746588230133057s
Received healthy response to inference request in 1.7785675525665283s
Received healthy response to inference request in 1.7769103050231934s
Received healthy response to inference request in 1.7791788578033447s
Received healthy response to inference request in 1.7463788986206055s
Received healthy response to inference request in 1.843829870223999s
Received healthy response to inference request in 1.7262258529663086s
Received healthy response to inference request in 1.9695148468017578s
Received healthy response to inference request in 1.8097364902496338s
Received healthy response to inference request in 1.7875151634216309s
Received healthy response to inference request in 1.7978882789611816s
Received healthy response to inference request in 1.8697059154510498s
30 requests
0 failed requests
5th percentile: 1.738889455795288
10th percentile: 1.7459800720214844
20th percentile: 1.7661882877349853
30th percentile: 1.7789954662322998
40th percentile: 1.792978286743164
50th percentile: 1.8047219514846802
60th percentile: 1.8121650695800782
70th percentile: 1.8355666875839234
80th percentile: 1.8490050792694093
90th percentile: 1.9834075689315798
95th percentile: 2.1513126015663144
99th percentile: 2.255759301185608
mean time: 1.841666309038798
Pipeline stage StressChecker completed in 58.37s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-muster-v1-q235b-_25291_v3 status is now deployed due to DeploymentManager action
chaiml-muster-v1-q235b-_25291_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v1-q235b-_25291_v3 status is now torndown due to DeploymentManager action