developer_uid: zonemercy
submission_id: chaiml-kimid-v12-mv1-wi_79693_v3
model_name: chaiml-kimid-v12-mv1-wi_79693_v3
model_group: ChaiML/kimid-v12-mv1-win
status: torndown
timestamp: 2026-03-28T20:01:24+00:00
num_battles: 11236
num_wins: 5706
celo_rating: 8467.11
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8
model_architecture: Qwen3_5MoeForConditionalGeneration
model_num_parameters: 33753909248.0
best_of: 16
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v12-mv1-wi_79693_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8
model_size: 34B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.5078319686721253
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 1.5, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '<|assistant|>', '####', '<|user|>'], 'max_input_tokens': 2048, 'best_of': 16, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v12-mv1-wi-79693-v3-uploader
Waiting for job on chaiml-kimid-v12-mv1-wi-79693-v3-uploader to finish
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: Using quantization_mode: none
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: Downloading snapshot of ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8...
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: Downloaded in 24.286s
Retrying (%r) after connection broken by '%r': %s
2026-03-25T17:32:39.262755+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: Processed model ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8 in 50.793s
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kimid-v12-mv1-wi-79693-v3-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/special_tokens_map.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/chat_template.jinja
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/args.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/added_tokens.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/tokenizer_config.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model.safetensors.index.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/vocab.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/preprocessor_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/preprocessor_config.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/README.md
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/generation_config.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/config.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/processor_config.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/.gitattributes
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/merges.txt
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/tokenizer.json
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00016-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00016-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00010-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00010-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00013-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00013-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00007-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00007-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00004-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00004-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00001-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00001-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00002-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00002-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00011-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00011-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00005-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00005-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00014-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00014-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00008-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00008-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00012-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00012-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00015-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00015-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00009-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00009-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00003-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00003-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v3-uploader: cp /dev/shm/model_output/model-00006-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v3/default/model-00006-of-00016.safetensors
Job chaiml-kimid-v12-mv1-wi-79693-v3-uploader completed after 84.47s with status: succeeded
Stopping job with name chaiml-kimid-v12-mv1-wi-79693-v3-uploader
Pipeline stage VLLMUploader completed in 85.04s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.92s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v12-mv1-wi-79693-v3
Waiting for inference service chaiml-kimid-v12-mv1-wi-79693-v3 to be ready
2026-03-25T17:33:39.393838+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
2026-03-25T17:34:39.520049+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
2026-03-25T17:35:39.806759+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
Inference service chaiml-kimid-v12-mv1-wi-79693-v3 ready after 173.47868704795837s
Pipeline stage VLLMDeployer completed in 174.05s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-25T17:36:39.951571+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Failed to get request counts for guanaco-submitter. Falling back to default
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 16.456899642944336s
2026-03-25T17:37:40.306928+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
Received healthy response to inference request in 6.974302768707275s
Received healthy response to inference request in 2.4411680698394775s
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.9589529037475586s
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-25T17:38:40.401959+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.3180618286132812s
Received healthy response to inference request in 14.910747528076172s
Received healthy response to inference request in 1.798304796218872s
Received healthy response to inference request in 1.401960849761963s
Received healthy response to inference request in 1.4148285388946533s
Received healthy response to inference request in 1.5634219646453857s
2026-03-25T17:39:40.496003+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
Received healthy response to inference request in 7.085163354873657s
Received healthy response to inference request in 2.303476572036743s
Received healthy response to inference request in 6.97775936126709s
Received healthy response to inference request in 1.5066249370574951s
Received healthy response to inference request in 1.9743969440460205s
Received healthy response to inference request in 1.5259499549865723s
Received healthy response to inference request in 1.6212608814239502s
Received healthy response to inference request in 1.473379135131836s
Received healthy response to inference request in 2.071218967437744s
Received healthy response to inference request in 1.5601167678833008s
Received healthy response to inference request in 1.4923529624938965s
Received healthy response to inference request in 1.5892698764801025s
30 requests
8 failed requests
5th percentile: 1.4411763072013855
10th percentile: 1.4904555797576904
20th percentile: 1.553283405303955
30th percentile: 1.611663579940796
40th percentile: 1.9682193279266358
50th percentile: 2.310769200325012
60th percentile: 6.975685405731201
70th percentile: 15.374593162536616
80th percentile: 20.130962467193605
90th percentile: 20.178414082527162
95th percentile: 20.21552323102951
99th percentile: 20.541502861976625
mean time: 8.142446462313334
%s, retrying in %s seconds...
Received healthy response to inference request in 1.3712399005889893s
Received healthy response to inference request in 2.0534989833831787s
Received healthy response to inference request in 1.9306848049163818s
Received healthy response to inference request in 2.2055346965789795s
Received healthy response to inference request in 1.8273110389709473s
Received healthy response to inference request in 2.071347236633301s
Received healthy response to inference request in 1.3596956729888916s
Received healthy response to inference request in 1.3960692882537842s
Received healthy response to inference request in 1.5301218032836914s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 1.5007810592651367s
Received healthy response to inference request in 1.5451159477233887s
Received healthy response to inference request in 2.4336020946502686s
Received healthy response to inference request in 1.42226243019104s
2026-03-25T17:40:41.087360+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v3
Received healthy response to inference request in 1.3381247520446777s
Received healthy response to inference request in 1.4372282028198242s
Received healthy response to inference request in 2.0074665546417236s
Received healthy response to inference request in 1.3372573852539062s
Received healthy response to inference request in 1.638892650604248s
Received healthy response to inference request in 1.975248098373413s
Received healthy response to inference request in 1.5328867435455322s
Received healthy response to inference request in 1.949361801147461s
Received healthy response to inference request in 1.6240620613098145s
Received healthy response to inference request in 1.5847597122192383s
Received healthy response to inference request in 1.5196013450622559s
Received healthy response to inference request in 1.3989183902740479s
Received healthy response to inference request in 1.3628809452056885s
Received healthy response to inference request in 1.7646877765655518s
Received healthy response to inference request in 1.459686517715454s
Received healthy response to inference request in 1.4002344608306885s
Received healthy response to inference request in 1.3668253421783447s
30 requests
0 failed requests
5th percentile: 1.347831666469574
10th percentile: 1.3625624179840088
20th percentile: 1.391103410720825
30th percentile: 1.4156540393829347
40th percentile: 1.4843432426452636
50th percentile: 1.5315042734146118
60th percentile: 1.6004806518554686
70th percentile: 1.7834747552871701
80th percentile: 1.9545390605926514
90th percentile: 2.055283808708191
95th percentile: 2.1451503396034237
99th percentile: 2.367462549209595
mean time: 1.644846256573995
Pipeline stage StressChecker completed in 309.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.71s
Shutdown handler de-registered
chaiml-kimid-v12-mv1-wi_79693_v3 status is now deployed due to DeploymentManager action
chaiml-kimid-v12-mv1-wi_79693_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v12-mv1-wi_79693_v3 status is now torndown due to DeploymentManager action