developer_uid: richhx
submission_id: chaiml-kimid-v8b-kimid_63800_v16
model_name: chaiml-kimid-v8b-kimid_63800_v16
model_group: ChaiML/kimid-v8b-kimidv5
status: inactive
timestamp: 2026-01-19T16:32:35+00:00
num_battles: 1454
num_wins: 781
celo_rating: 1329.91
family_friendly_score: 0.5127999999999999
family_friendly_standard_error: 0.007068750384615374
submission_type: basic
model_repo: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 4
max_input_tokens: 2048
max_output_tokens: 72
reward_model: default
display_name: chaiml-kimid-v8b-kimid_63800_v16
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-19
win_ratio: 0.5371389270976616
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '<|assistant|>', '</s>', '<|user|>', '####', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimid-63800-v16-uploader
Waiting for job on chaiml-kimid-v8b-kimid-63800-v16-uploader to finish
chaiml-kimid-v8b-kimid-63800-v16-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v8b-kimid-63800-v16-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v8b-kimid-63800-v16-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v16-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v8b-kimid-63800-v16-uploader: Downloaded to shared memory in 141.593s
chaiml-kimid-v8b-kimid-63800-v16-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed in 207.803s
chaiml-kimid-v8b-kimid-63800-v16-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v8b-kimid-63800-v16-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v8b-kimid-63800-v16-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/.gitattributes
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/added_tokens.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/tokenizer_config.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/chat_template.jinja
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/README.md
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/special_tokens_map.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/generation_config.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/quantization_config.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/config.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/merges.txt
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/vocab.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model.safetensors.index.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/tokenizer.json
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00027-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00011-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00001-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00012-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00024-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00020-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00022-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00006-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00026-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00018-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00002-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00019-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00014-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00010-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00021-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00023-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00025-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00005-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00016-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v16-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v16/model-00015-of-00027.safetensors
Job chaiml-kimid-v8b-kimid-63800-v16-uploader completed after 414.44s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimid-63800-v16-uploader
Pipeline stage VLLMUploader completed in 415.63s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.26s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v8b-kimid-63800-v16
Waiting for inference service chaiml-kimid-v8b-kimid-63800-v16 to be ready
Inference service chaiml-kimid-v8b-kimid-63800-v16 ready after 466.3532888889313s
Pipeline stage VLLMDeployer completed in 468.22s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1973845958709717s
Received healthy response to inference request in 1.656165361404419s
Received healthy response to inference request in 2.1742966175079346s
Received healthy response to inference request in 1.850250482559204s
Received healthy response to inference request in 1.787811279296875s
Received healthy response to inference request in 1.7535805702209473s
Received healthy response to inference request in 2.0078532695770264s
Received healthy response to inference request in 2.6676228046417236s
Received healthy response to inference request in 2.051278829574585s
Received healthy response to inference request in 2.8651771545410156s
Received healthy response to inference request in 1.8542203903198242s
Received healthy response to inference request in 1.8007960319519043s
Received healthy response to inference request in 2.77382755279541s
Received healthy response to inference request in 2.2171568870544434s
Received healthy response to inference request in 2.4568169116973877s
Received healthy response to inference request in 2.80452561378479s
Received healthy response to inference request in 1.8260271549224854s
Received healthy response to inference request in 2.2530248165130615s
Received healthy response to inference request in 2.4487924575805664s
Received healthy response to inference request in 2.207993984222412s
Received healthy response to inference request in 2.0970444679260254s
Received healthy response to inference request in 1.9851467609405518s
Received healthy response to inference request in 1.699922800064087s
Received healthy response to inference request in 2.1238856315612793s
Received healthy response to inference request in 1.7618772983551025s
Received healthy response to inference request in 1.929826021194458s
Received healthy response to inference request in 2.047414779663086s
Received healthy response to inference request in 1.6890575885772705s
Received healthy response to inference request in 1.767885446548462s
Received healthy response to inference request in 2.603027105331421s
30 requests
0 failed requests
5th percentile: 1.693946933746338
10th percentile: 1.7482147932052612
20th percentile: 1.7838261127471924
30th percentile: 1.8429834842681885
40th percentile: 1.9630184650421143
50th percentile: 2.0493468046188354
60th percentile: 2.1440500259399413
70th percentile: 2.2279172658920285
80th percentile: 2.486058950424195
90th percentile: 2.776897358894348
95th percentile: 2.837883961200714
99th percentile: 3.101044437885285
mean time: 2.1453230222066244
Pipeline stage StressChecker completed in 70.00s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.39s
Shutdown handler de-registered
chaiml-kimid-v8b-kimid_63800_v16 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 3129.85s
Shutdown handler de-registered