developer_uid: rirv938
submission_id: chaiml-kimid-v8b-kimid_77693_v18
model_name: chaiml-kimid-v8b-kimid_77693_v18
model_group: ChaiML/kimid-v8b-kimidv5
status: torndown
timestamp: 2026-04-06T22:22:10+00:00
num_battles: 10817
num_wins: 5901
celo_rating: 1337.38
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 1821417132032.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v8b-kimid_77693_v18
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01
model_size: 1821B
ranking_group: single
us_pacific_date: 2026-04-03
win_ratio: 0.5455301839696773
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '<|user|>', '<|im_end|>', '<|assistant|>', '####', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimid-77693-v18-uploader
Waiting for job on chaiml-kimid-v8b-kimid-77693-v18-uploader to finish
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
chaiml-kimid-v8b-kimid-77693-v18-uploader: Using quantization_mode: w4a16
chaiml-kimid-v8b-kimid-77693-v18-uploader: Checking if ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-kimid-v8b-kimid-77693-v18-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-kimid-v8b-kimid-77693-v18-uploader: Downloading snapshot of ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-W4A16...
2026-04-03T17:26:56.312007+00:00 monitor updated for chaiml-kimid-v8b-kimid_77693_v18
Failed to get response for submission chaiml-qwen-bobo-dpo-ju_56781_v7: HTTPConnectionPool(host='chaiml-qwen-bobo-dpo-ju-56781-v7-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=20.0)
chaiml-kimid-v8b-kimid-77693-v18-uploader: Downloaded in 53.336s
chaiml-kimid-v8b-kimid-77693-v18-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01 in 56.106s
chaiml-kimid-v8b-kimid-77693-v18-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kimid-v8b-kimid-77693-v18-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kimid-v8b-kimid-77693-v18-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kimid-v8b-kimid-77693-v18-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v8b-kimid-77693-v18-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/chat_template.jinja
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/tokenizer_config.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/.gitattributes
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/config.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/generation_config.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/added_tokens.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/merges.txt
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/special_tokens_map.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/quantization_config.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/vocab.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model.safetensors.index.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/tokenizer.json
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00027-of-00027.safetensors
2026-04-03T17:27:56.479236+00:00 monitor updated for chaiml-kimid-v8b-kimid_77693_v18
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00006-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00014-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00025-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00018-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00026-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00013-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00005-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00023-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00022-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00012-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00020-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00019-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00002-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00021-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00015-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00001-of-00027.safetensors
chaiml-kimid-v8b-kimid-77693-v18-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-77693-v18/default/model-00024-of-00027.safetensors
Job chaiml-kimid-v8b-kimid-77693-v18-uploader completed after 136.2s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimid-77693-v18-uploader
Pipeline stage VLLMUploader completed in 136.78s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.10s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.68s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v8b-kimid-77693-v18
Waiting for inference service chaiml-kimid-v8b-kimid-77693-v18 to be ready
2026-04-03T17:28:56.578989+00:00 monitor updated for chaiml-kimid-v8b-kimid_77693_v18
2026-04-03T17:29:56.720111+00:00 monitor updated for chaiml-kimid-v8b-kimid_77693_v18
2026-04-03T17:30:57.009879+00:00 monitor updated for chaiml-kimid-v8b-kimid_77693_v18
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service chaiml-kimid-v8b-kimid-77693-v18 ready after 212.2803463935852s
Pipeline stage VLLMDeployer completed in 212.92s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7698726654052734s
Received healthy response to inference request in 3.5615129470825195s
2026-04-03T17:31:57.176162+00:00 monitor updated for chaiml-kimid-v8b-kimid_77693_v18
Received healthy response to inference request in 3.546832799911499s
Received healthy response to inference request in 3.5707669258117676s
Received healthy response to inference request in 1.472031593322754s
Received healthy response to inference request in 1.7226059436798096s
Received healthy response to inference request in 1.6000657081604004s
Received healthy response to inference request in 1.4768695831298828s
Received healthy response to inference request in 1.6028501987457275s
Received healthy response to inference request in 1.5573148727416992s
Received healthy response to inference request in 2.2678961753845215s
Received healthy response to inference request in 1.4730501174926758s
Received healthy response to inference request in 1.4569392204284668s
Received healthy response to inference request in 1.7386107444763184s
Received healthy response to inference request in 1.9570446014404297s
Received healthy response to inference request in 1.5461146831512451s
Received healthy response to inference request in 3.7701621055603027s
Received healthy response to inference request in 1.675621747970581s
Received healthy response to inference request in 2.130485773086548s
Received healthy response to inference request in 1.4504826068878174s
Received healthy response to inference request in 1.5351898670196533s
Received healthy response to inference request in 1.5351595878601074s
Received healthy response to inference request in 1.5366287231445312s
Received healthy response to inference request in 1.8769750595092773s
Received healthy response to inference request in 1.5606000423431396s
Received healthy response to inference request in 1.6290221214294434s
Received healthy response to inference request in 2.1030802726745605s
Received healthy response to inference request in 1.8439338207244873s
Received healthy response to inference request in 1.5128955841064453s
Received healthy response to inference request in 2.0215418338775635s
30 requests
0 failed requests
5th percentile: 1.463730788230896
10th percentile: 1.4729482650756835
20th percentile: 1.530706787109375
30th percentile: 1.543268895149231
40th percentile: 1.5842794418334962
50th percentile: 1.6523219347000122
60th percentile: 1.780739974975586
70th percentile: 1.9763937711715696
80th percentile: 2.157967853546143
90th percentile: 3.5624383449554444
95th percentile: 3.6802750825881954
99th percentile: 3.770078167915344
mean time: 2.016738597551982
Pipeline stage StressChecker completed in 65.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.75s
Shutdown handler de-registered
chaiml-kimid-v8b-kimid_77693_v18 status is now deployed due to DeploymentManager action
chaiml-kimid-v8b-kimid_77693_v18 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v8b-kimid_77693_v18 status is now torndown due to DeploymentManager action