developer_uid: richhx
submission_id: chaiml-kimid-v8b-kimidv_77693_v2
model_name: chaiml-kimid-v8b-kimidv_77693_v2
model_group: ChaiML/kimid-v8b-kimidv5
status: inactive
timestamp: 2026-03-05T19:11:32+00:00
num_battles: 37
num_wins: 23
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v8b-kimidv_77693_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.6216216216216216
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|user|>', '<|im_end|>', '</s>', '</think>', '####', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimidv-77693-v2-uploader
Waiting for job on chaiml-kimid-v8b-kimidv-77693-v2-uploader to finish
chaiml-kimid-v8b-kimidv-77693-v2-uploader: Using quantization_mode: w4a16
chaiml-kimid-v8b-kimidv-77693-v2-uploader: Checking if ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-kimid-v8b-kimidv-77693-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-kimid-v8b-kimidv-77693-v2-uploader: Downloading snapshot of ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-W4A16...
chaiml-kimid-v8b-kimidv-77693-v2-uploader: Downloaded in 56.728s
chaiml-kimid-v8b-kimidv-77693-v2-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01 in 57.419s
chaiml-kimid-v8b-kimidv-77693-v2-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kimid-v8b-kimidv-77693-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kimid-v8b-kimidv-77693-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kimid-v8b-kimidv-77693-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v8b-kimidv-77693-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/generation_config.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/added_tokens.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/chat_template.jinja
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/special_tokens_map.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/quantization_config.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/.gitattributes
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/tokenizer_config.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/config.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/vocab.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/merges.txt
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model.safetensors.index.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/tokenizer.json
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00027-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00024-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00010-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00023-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00011-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00020-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00002-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00022-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00014-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00016-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00019-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00015-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00021-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00006-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00013-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00026-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00012-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00025-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00018-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00001-of-00027.safetensors
chaiml-kimid-v8b-kimidv-77693-v2-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-77693-v2/default/model-00005-of-00027.safetensors
Job chaiml-kimid-v8b-kimidv-77693-v2-uploader completed after 152.97s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimidv-77693-v2-uploader
Pipeline stage VLLMUploader completed in 153.46s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.80s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v8b-kimidv-77693-v2
Waiting for inference service chaiml-kimid-v8b-kimidv-77693-v2 to be ready
Inference service chaiml-kimid-v8b-kimidv-77693-v2 ready after 350.55116057395935s
Pipeline stage VLLMDeployer completed in 350.97s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.5566303730010986s
Received healthy response to inference request in 2.3581056594848633s
Received healthy response to inference request in 2.7695765495300293s
Received healthy response to inference request in 2.10414457321167s
Received healthy response to inference request in 2.382290840148926s
Received healthy response to inference request in 2.0637900829315186s
Received healthy response to inference request in 2.161613941192627s
Received healthy response to inference request in 2.1981618404388428s
Received healthy response to inference request in 2.4076569080352783s
Received healthy response to inference request in 2.0126445293426514s
Received healthy response to inference request in 2.389854907989502s
Received healthy response to inference request in 2.124596357345581s
Received healthy response to inference request in 2.047067403793335s
Received healthy response to inference request in 2.110673666000366s
Received healthy response to inference request in 1.9344394207000732s
Received healthy response to inference request in 2.5915114879608154s
Received healthy response to inference request in 2.0171048641204834s
Received healthy response to inference request in 2.491060256958008s
Received healthy response to inference request in 2.5336506366729736s
Received healthy response to inference request in 2.443195343017578s
Received healthy response to inference request in 1.9676012992858887s
Received healthy response to inference request in 1.9245777130126953s
Received healthy response to inference request in 2.2704715728759766s
Received healthy response to inference request in 1.951216220855713s
Received healthy response to inference request in 3.0667941570281982s
Received healthy response to inference request in 1.8982329368591309s
Received healthy response to inference request in 1.992157220840454s
Received healthy response to inference request in 2.692490577697754s
Received healthy response to inference request in 1.9460935592651367s
30 requests
1 failed requests
5th percentile: 1.9290154814720153
10th percentile: 1.9449281454086305
20th percentile: 1.987246036529541
30th percentile: 2.0380786418914796
40th percentile: 2.1080620288848877
50th percentile: 2.179887890815735
60th percentile: 2.3677797317504883
70th percentile: 2.418318438529968
80th percentile: 2.538246583938599
90th percentile: 2.7001991748809817
95th percentile: 2.9330462336540215
99th percentile: 15.185753691196457
mean time: 2.851438538233439
%s, retrying in %s seconds...
Received healthy response to inference request in 2.3497567176818848s
Received healthy response to inference request in 1.9584870338439941s
Received healthy response to inference request in 2.300060272216797s
Received healthy response to inference request in 2.0562868118286133s
Received healthy response to inference request in 2.451449394226074s
Received healthy response to inference request in 1.9446678161621094s
Received healthy response to inference request in 2.020418167114258s
Received healthy response to inference request in 1.9572482109069824s
Received healthy response to inference request in 2.0689454078674316s
Received healthy response to inference request in 2.0458953380584717s
Received healthy response to inference request in 2.4476239681243896s
Received healthy response to inference request in 2.308605194091797s
Received healthy response to inference request in 1.9263358116149902s
Received healthy response to inference request in 2.6014888286590576s
Received healthy response to inference request in 2.540257215499878s
Received healthy response to inference request in 2.1607277393341064s
Received healthy response to inference request in 2.2571861743927s
Received healthy response to inference request in 1.9769103527069092s
Received healthy response to inference request in 2.3776965141296387s
Received healthy response to inference request in 2.1997711658477783s
Received healthy response to inference request in 2.1166882514953613s
Received healthy response to inference request in 2.2080721855163574s
Received healthy response to inference request in 2.6342763900756836s
Received healthy response to inference request in 2.148512840270996s
Received healthy response to inference request in 2.4953811168670654s
Received healthy response to inference request in 2.0580596923828125s
Received healthy response to inference request in 2.2688639163970947s
Received healthy response to inference request in 2.0898919105529785s
Received healthy response to inference request in 1.986661672592163s
Received healthy response to inference request in 1.9336824417114258s
30 requests
0 failed requests
5th percentile: 1.9386258602142334
10th percentile: 1.9559901714324952
20th percentile: 1.9847114086151123
30th percentile: 2.053169369697571
40th percentile: 2.0815133094787597
50th percentile: 2.1546202898025513
60th percentile: 2.2277177810668944
70th percentile: 2.302623748779297
80th percentile: 2.391682004928589
90th percentile: 2.4998687267303468
95th percentile: 2.5739346027374266
99th percentile: 2.624767997264862
mean time: 2.1963302850723267
Pipeline stage StressChecker completed in 161.52s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.74s
Shutdown handler de-registered
chaiml-kimid-v8b-kimidv_77693_v2 status is now deployed due to DeploymentManager action
chaiml-kimid-v8b-kimidv_77693_v2 status is now inactive due to system request