developer_uid: zonemercy
submission_id: chaiml-kimid-v12-mv1-wi_79693_v1
model_name: chaiml-kimid-v12-mv1-wi_79693_v1
model_group: ChaiML/kimid-v12-mv1-win
status: torndown
timestamp: 2026-03-28T20:01:23+00:00
num_battles: 11290
num_wins: 5763
celo_rating: 8467.11
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8
model_architecture: Qwen3_5MoeForConditionalGeneration
model_num_parameters: 33753909248.0
best_of: 16
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v12-mv1-wi_79693_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8
model_size: 34B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.5104517271922054
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|assistant|>', '<|im_end|>', '####', '<|user|>'], 'max_input_tokens': 2048, 'best_of': 16, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v12-mv1-wi-79693-v1-uploader
Waiting for job on chaiml-kimid-v12-mv1-wi-79693-v1-uploader to finish
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: Using quantization_mode: none
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: Downloading snapshot of ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8...
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: Downloaded in 29.776s
2026-03-25T17:32:17.472579+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: Processed model ChaiML/kimid-v12-mv1-winall-q35b-lr5e6ep2g8 in 56.237s
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kimid-v12-mv1-wi-79693-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/generation_config.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/added_tokens.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/preprocessor_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/preprocessor_config.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/.gitattributes
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/chat_template.jinja
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/args.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/special_tokens_map.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/processor_config.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/tokenizer_config.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/README.md
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/config.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model.safetensors.index.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/merges.txt
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/vocab.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/tokenizer.json
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00004-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00004-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00007-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00007-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00013-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00013-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00010-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00010-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00001-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00001-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00011-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00011-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00008-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00008-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00014-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00014-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00005-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00005-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00002-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00002-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00003-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00003-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00012-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00012-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00015-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00015-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00006-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00006-of-00016.safetensors
chaiml-kimid-v12-mv1-wi-79693-v1-uploader: cp /dev/shm/model_output/model-00009-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-wi-79693-v1/default/model-00009-of-00016.safetensors
Job chaiml-kimid-v12-mv1-wi-79693-v1-uploader completed after 94.93s with status: succeeded
Stopping job with name chaiml-kimid-v12-mv1-wi-79693-v1-uploader
Pipeline stage VLLMUploader completed in 95.62s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 3.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v12-mv1-wi-79693-v1
Waiting for inference service chaiml-kimid-v12-mv1-wi-79693-v1 to be ready
2026-03-25T17:33:17.646890+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
2026-03-25T17:34:17.799772+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
2026-03-25T17:35:17.887253+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
2026-03-25T17:36:17.982634+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service chaiml-kimid-v12-mv1-wi-79693-v1 ready after 203.10556054115295s
Pipeline stage VLLMDeployer completed in 203.69s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-25T17:37:18.086207+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 6.088156223297119s
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-25T17:38:18.298657+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.201193332672119s
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-25T17:39:18.384638+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
Received healthy response to inference request in 10.641268968582153s
Received healthy response to inference request in 1.6768274307250977s
Received healthy response to inference request in 6.776744365692139s
Received healthy response to inference request in 2.8440184593200684s
Received healthy response to inference request in 2.1186163425445557s
Received healthy response to inference request in 6.455756187438965s
Received healthy response to inference request in 1.9775199890136719s
Received healthy response to inference request in 1.45412278175354s
Received healthy response to inference request in 1.3443329334259033s
Received healthy response to inference request in 1.6502900123596191s
Received healthy response to inference request in 2.5964465141296387s
Received healthy response to inference request in 1.4210450649261475s
Received healthy response to inference request in 2.1868362426757812s
Received healthy response to inference request in 1.7387452125549316s
Received healthy response to inference request in 2.052762746810913s
Received healthy response to inference request in 1.7819786071777344s
Received healthy response to inference request in 1.5388262271881104s
Received healthy response to inference request in 1.40380859375s
Received healthy response to inference request in 1.4144790172576904s
Received healthy response to inference request in 1.5302116870880127s
30 requests
8 failed requests
5th percentile: 1.4086102843284607
10th percentile: 1.4203884601593018
20th percentile: 1.5371033191680907
30th percentile: 1.7201698780059813
40th percentile: 2.0226656436920165
50th percentile: 2.39164137840271
60th percentile: 4.355978488922116
70th percentile: 7.936101746559132
80th percentile: 20.106326246261595
90th percentile: 20.1365505695343
95th percentile: 20.21124577522278
99th percentile: 20.49123931646347
mean time: 7.515925033887227
%s, retrying in %s seconds...
Received healthy response to inference request in 1.4440627098083496s
Received healthy response to inference request in 1.3048341274261475s
Received healthy response to inference request in 1.3594090938568115s
Received healthy response to inference request in 1.4289028644561768s
Received healthy response to inference request in 1.3380792140960693s
Received healthy response to inference request in 1.5458769798278809s
2026-03-25T17:40:18.479343+00:00 monitor updated for chaiml-kimid-v12-mv1-wi_79693_v1
Received healthy response to inference request in 1.9797589778900146s
Received healthy response to inference request in 1.4832432270050049s
Received healthy response to inference request in 1.2797250747680664s
Received healthy response to inference request in 1.467620611190796s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 1.5119826793670654s
Received healthy response to inference request in 1.516737699508667s
Received healthy response to inference request in 1.5838124752044678s
Received healthy response to inference request in 1.673729419708252s
Received healthy response to inference request in 1.4322454929351807s
Received healthy response to inference request in 2.276536703109741s
Received healthy response to inference request in 1.49932861328125s
Received healthy response to inference request in 2.1112060546875s
Received healthy response to inference request in 1.4212753772735596s
Received healthy response to inference request in 1.5381197929382324s
Received healthy response to inference request in 1.4805629253387451s
Received healthy response to inference request in 1.4302423000335693s
Received healthy response to inference request in 1.4340009689331055s
Received healthy response to inference request in 1.5345728397369385s
Received healthy response to inference request in 1.4513318538665771s
Received healthy response to inference request in 1.496321201324463s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 1.4839727878570557s
Received healthy response to inference request in 1.856112003326416s
Received healthy response to inference request in 1.4011197090148926s
Received healthy response to inference request in 1.6218829154968262s
30 requests
0 failed requests
5th percentile: 1.3197944164276123
10th percentile: 1.3572761058807372
20th percentile: 1.4273773670196532
30th percentile: 1.433474326133728
40th percentile: 1.4611051082611084
50th percentile: 1.4836080074310303
60th percentile: 1.5043902397155762
70th percentile: 1.5356369256973266
80th percentile: 1.5914265632629396
90th percentile: 1.868476700782776
95th percentile: 2.0520548701286314
99th percentile: 2.2285908150672915
mean time: 1.5462202231089275
Pipeline stage StressChecker completed in 290.75s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.31s
Shutdown handler de-registered
chaiml-kimid-v12-mv1-wi_79693_v1 status is now deployed due to DeploymentManager action
chaiml-kimid-v12-mv1-wi_79693_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v12-mv1-wi_79693_v1 status is now torndown due to DeploymentManager action