chaiml-muster-v3c-kakit_51472

developer_uid: zonemercy
submission_id: chaiml-muster-v3c-kakit_51472_v2
model_name: chaiml-muster-v3c-kakit_51472_v2
model_group: ChaiML/muster-v3c-kakit-
status: inactive
timestamp: 2026-02-15T10:17:20+00:00
num_battles: 10904
num_wins: 5750
celo_rating: 1314.96
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v3c-kakit-q235b-lr1e4ep1r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v3c-kakit_51472_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v3c-kakit-q235b-lr1e4ep1r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-15
win_ratio: 0.5273294203961849
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '</s>', '<|assistant|>', '####', '<|user|>', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v3c-kakit-51472-v2-uploader
Waiting for job on chaiml-muster-v3c-kakit-51472-v2-uploader to finish
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-muster-v3c-kakit-51472-v2-uploader: Using quantization_mode: w4a16
chaiml-muster-v3c-kakit-51472-v2-uploader: Checking if ChaiML/muster-v3c-kakit-q235b-lr1e4ep1r64g4-W4A16 already exists in ChaiML
chaiml-muster-v3c-kakit-51472-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v3c-kakit-51472-v2-uploader: Downloading snapshot of ChaiML/muster-v3c-kakit-q235b-lr1e4ep1r64g4-W4A16...
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-muster-v3c-kakit-51472-v2-uploader: Downloaded in 46.301s
chaiml-muster-v3c-kakit-51472-v2-uploader: Processed model ChaiML/muster-v3c-kakit-q235b-lr1e4ep1r64g4 in 46.943s
chaiml-muster-v3c-kakit-51472-v2-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3c-kakit-51472-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v3c-kakit-51472-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3c-kakit-51472-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3c-kakit-51472-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3c-kakit-51472-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3c-kakit-51472-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v3c-kakit-51472-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v3c-kakit-51472-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v3c-kakit-51472-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v3c-kakit-51472-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v3c-kakit-51472-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/tokenizer_config.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/special_tokens_map.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/added_tokens.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/.gitattributes
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/generation_config.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/chat_template.jinja
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/config.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/quantization_config.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/merges.txt
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/vocab.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model.safetensors.index.json
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/tokenizer.json
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00027-of-00027.safetensors
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00021-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00014-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00004-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00025-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00010-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00006-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00009-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00023-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00008-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00001-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00003-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00020-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00002-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00005-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00013-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00016-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00012-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00022-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00018-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00024-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00026-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00011-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00007-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00019-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00017-of-00027.safetensors
chaiml-muster-v3c-kakit-51472-v2-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3c-kakit-51472-v2/default/model-00015-of-00027.safetensors
Job chaiml-muster-v3c-kakit-51472-v2-uploader completed after 653.19s with status: succeeded
Stopping job with name chaiml-muster-v3c-kakit-51472-v2-uploader
Pipeline stage VLLMUploader completed in 653.61s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v3c-kakit-51472-v2
Waiting for inference service chaiml-muster-v3c-kakit-51472-v2 to be ready
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Inference service chaiml-muster-v3c-kakit-51472-v2 ready after 672.1686310768127s
Pipeline stage VLLMDeployer completed in 672.54s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.669203758239746s
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 1.9319534301757812s
Received healthy response to inference request in 1.9297282695770264s
Received healthy response to inference request in 2.1084280014038086s
Received healthy response to inference request in 2.1464684009552s
Received healthy response to inference request in 2.2227981090545654s
Received healthy response to inference request in 2.063865900039673s
Received healthy response to inference request in 2.4743165969848633s
Received healthy response to inference request in 2.3806216716766357s
Received healthy response to inference request in 2.0379230976104736s
Received healthy response to inference request in 1.9299850463867188s
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 1.886561632156372s
Received healthy response to inference request in 2.304696798324585s
Received healthy response to inference request in 1.9744529724121094s
Received healthy response to inference request in 2.0707027912139893s
Received healthy response to inference request in 2.1161046028137207s
Received healthy response to inference request in 2.103208065032959s
Received healthy response to inference request in 1.9774696826934814s
Received healthy response to inference request in 2.3465919494628906s
Received healthy response to inference request in 1.9767472743988037s
Received healthy response to inference request in 1.8901348114013672s
Received healthy response to inference request in 2.14353609085083s
Received healthy response to inference request in 2.172999858856201s
Received healthy response to inference request in 2.4400434494018555s
Received healthy response to inference request in 1.7588026523590088s
Received healthy response to inference request in 2.3886706829071045s
Received healthy response to inference request in 1.9398834705352783s
Received healthy response to inference request in 2.251173257827759s
Received healthy response to inference request in 2.028343915939331s
Received healthy response to inference request in 2.0298080444335938s
30 requests
0 failed requests
5th percentile: 1.88816956281662
10th percentile: 1.9257689237594604
20th percentile: 1.9382974624633789
30th percentile: 1.9772529602050781
40th percentile: 2.0346770763397215
50th percentile: 2.086955428123474
60th percentile: 2.1270771980285645
70th percentile: 2.1879393339157103
80th percentile: 2.3130758285522464
90th percentile: 2.3938079595565798
95th percentile: 2.4588936805725097
99th percentile: 2.6126864814758304
mean time: 2.1231741428375246
Pipeline stage StressChecker completed in 67.66s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
chaiml-muster-v3c-kakit_51472_v2 status is now deployed due to DeploymentManager action
chaiml-muster-v3c-kakit_51472_v2 status is now inactive due to auto deactivation removed underperforming models