chaiml-kimid-v12-mv1-to_30309

developer_uid: zonemercy
submission_id: chaiml-kimid-v12-mv1-to_30309_v1
model_name: chaiml-kimid-v12-mv1-to_30309_v1
model_group: ChaiML/kimid-v12-mv1-top
status: torndown
timestamp: 2026-03-28T19:21:01+00:00
num_battles: 11727
num_wins: 6059
celo_rating: 8468.04
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/kimid-v12-mv1-top2-q35b-lr5e6ep2g8
model_architecture: Qwen3_5MoeForConditionalGeneration
model_num_parameters: 33753909248.0
best_of: 16
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v12-mv1-to_30309_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v12-mv1-top2-q35b-lr5e6ep2g8
model_size: 34B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.5166709303317132
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '<|user|>', '####', '<|assistant|>', '</s>'], 'max_input_tokens': 2048, 'best_of': 16, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v12-mv1-to-30309-v1-uploader
Waiting for job on chaiml-kimid-v12-mv1-to-30309-v1-uploader to finish
chaiml-kimid-v12-mv1-to-30309-v1-uploader: Using quantization_mode: none
chaiml-kimid-v12-mv1-to-30309-v1-uploader: Downloading snapshot of ChaiML/kimid-v12-mv1-top2-q35b-lr5e6ep2g8...
chaiml-kimid-v12-mv1-to-30309-v1-uploader: Downloaded in 30.542s
2026-03-25T16:57:01.669624+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
chaiml-kimid-v12-mv1-to-30309-v1-uploader: Processed model ChaiML/kimid-v12-mv1-top2-q35b-lr5e6ep2g8 in 56.665s
chaiml-kimid-v12-mv1-to-30309-v1-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kimid-v12-mv1-to-30309-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kimid-v12-mv1-to-30309-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kimid-v12-mv1-to-30309-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v12-mv1-to-30309-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/chat_template.jinja
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/preprocessor_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/preprocessor_config.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/README.md
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/args.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/tokenizer_config.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/special_tokens_map.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/processor_config.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/.gitattributes
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/config.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/generation_config.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/added_tokens.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model.safetensors.index.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/vocab.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/merges.txt
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/tokenizer.json
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00016-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00016-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00007-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00007-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00010-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00010-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00004-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00004-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00013-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00013-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00001-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00001-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00002-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00002-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00014-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00014-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00011-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00011-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00005-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00005-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00008-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00008-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00003-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00003-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00006-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00006-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00015-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00015-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00012-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00012-of-00016.safetensors
chaiml-kimid-v12-mv1-to-30309-v1-uploader: cp /dev/shm/model_output/model-00009-of-00016.safetensors s3://guanaco-vllm-models/chaiml-kimid-v12-mv1-to-30309-v1/default/model-00009-of-00016.safetensors
Job chaiml-kimid-v12-mv1-to-30309-v1-uploader completed after 93.34s with status: succeeded
Stopping job with name chaiml-kimid-v12-mv1-to-30309-v1-uploader
Pipeline stage VLLMUploader completed in 93.93s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 4.66s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v12-mv1-to-30309-v1
Waiting for inference service chaiml-kimid-v12-mv1-to-30309-v1 to be ready
2026-03-25T16:58:01.755365+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
2026-03-25T16:59:01.843604+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
2026-03-25T17:00:01.924820+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
Inference service chaiml-kimid-v12-mv1-to-30309-v1 ready after 160.42887091636658s
Pipeline stage VLLMDeployer completed in 160.96s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
2026-03-25T17:01:02.013448+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-25T17:02:02.120204+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 6.944763898849487s
Received healthy response to inference request in 6.331458568572998s
Received healthy response to inference request in 2.035351514816284s
Received healthy response to inference request in 1.3549020290374756s
Received healthy response to inference request in 1.5128920078277588s
Received healthy response to inference request in 1.9350237846374512s
Received healthy response to inference request in 13.655989646911621s
Received healthy response to inference request in 2.0844948291778564s
Received healthy response to inference request in 2.5616848468780518s
Received healthy response to inference request in 1.417914628982544s
Received healthy response to inference request in 2.105130910873413s
Received healthy response to inference request in 1.3660507202148438s
Received healthy response to inference request in 1.6614701747894287s
Received healthy response to inference request in 1.384263277053833s
Received healthy response to inference request in 1.4078235626220703s
Received healthy response to inference request in 1.4889121055603027s
Received healthy response to inference request in 1.7006702423095703s
Received healthy response to inference request in 1.4771332740783691s
2026-03-25T17:03:02.214206+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
Received healthy response to inference request in 7.372299671173096s
Received healthy response to inference request in 2.035930871963501s
Received healthy response to inference request in 1.6031086444854736s
Received healthy response to inference request in 2.5251624584198s
Received healthy response to inference request in 1.451056957244873s
Received healthy response to inference request in 2.453319549560547s
Received healthy response to inference request in 2.0757522583007812s
30 requests
5 failed requests
5th percentile: 1.3742463707923889
10th percentile: 1.4054675340652465
20th percentile: 1.4719180107116698
30th percentile: 1.5760436534881592
40th percentile: 1.8412823677062993
50th percentile: 2.055841565132141
60th percentile: 2.244406366348266
70th percentile: 3.692616963386525
80th percentile: 8.62903766632082
90th percentile: 20.128537082672118
95th percentile: 20.149253964424133
99th percentile: 20.174593801498414
mean time: 5.755405219395955
%s, retrying in %s seconds...
Received healthy response to inference request in 1.3384802341461182s
Received healthy response to inference request in 1.5820341110229492s
Received healthy response to inference request in 1.3007609844207764s
Received healthy response to inference request in 1.3704771995544434s
Received healthy response to inference request in 1.462747573852539s
Received healthy response to inference request in 1.3953535556793213s
Received healthy response to inference request in 1.7536463737487793s
Received healthy response to inference request in 1.3673629760742188s
Received healthy response to inference request in 1.6597449779510498s
Received healthy response to inference request in 1.743730068206787s
Received healthy response to inference request in 1.4642162322998047s
Received healthy response to inference request in 1.5184805393218994s
Received healthy response to inference request in 1.591892957687378s
Received healthy response to inference request in 1.3790206909179688s
Received healthy response to inference request in 1.361717700958252s
Received healthy response to inference request in 1.8917253017425537s
Received healthy response to inference request in 1.5577726364135742s
Received healthy response to inference request in 1.4062461853027344s
Received healthy response to inference request in 1.2962908744812012s
Received healthy response to inference request in 2.0300111770629883s
Received healthy response to inference request in 1.4620671272277832s
Received healthy response to inference request in 1.4041740894317627s
Received healthy response to inference request in 1.40187668800354s
Received healthy response to inference request in 1.391449213027954s
Received healthy response to inference request in 1.3970201015472412s
Received healthy response to inference request in 1.5339407920837402s
Received healthy response to inference request in 1.5992069244384766s
Received healthy response to inference request in 1.3903048038482666s
2026-03-25T17:04:02.324985+00:00 monitor updated for chaiml-kimid-v12-mv1-to_30309_v1
Received healthy response to inference request in 2.132672071456909s
Received healthy response to inference request in 1.4080054759979248s
30 requests
0 failed requests
5th percentile: 1.3177346467971802
10th percentile: 1.3593939542770386
20th percentile: 1.3773119926452637
30th percentile: 1.3941822528839112
40th percentile: 1.4032551288604735
50th percentile: 1.435036301612854
60th percentile: 1.4859219551086424
70th percentile: 1.5650510787963867
80th percentile: 1.6113145351409914
90th percentile: 1.767454266548157
95th percentile: 1.9677825331687924
99th percentile: 2.1029004120826724
mean time: 1.5197476545969646
Pipeline stage StressChecker completed in 224.38s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.82s
Shutdown handler de-registered
chaiml-kimid-v12-mv1-to_30309_v1 status is now deployed due to DeploymentManager action
chaiml-kimid-v12-mv1-to_30309_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v12-mv1-to_30309_v1 status is now torndown due to DeploymentManager action