developer_uid: zonemercy
submission_id: chaiml-kimid-v8b-kimid_63800_v28
model_name: chaiml-kimid-v8b-kimid_63800_v28
model_group: ChaiML/kimid-v8b-kimidv5
status: torndown
timestamp: 2026-02-05T15:21:02+00:00
num_battles: 12437
num_wins: 7222
celo_rating: 1361.86
family_friendly_score: 0.5167999999999999
family_friendly_standard_error: 0.00706707520831638
submission_type: basic
model_repo: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: chaiml-prm-kimi-v1-300k_92220_v7
display_name: chaiml-kimid-v8b-kimid_63800_v28
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-02
win_ratio: 0.5806866607702822
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '####', '</think>', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimid-63800-v28-uploader
Waiting for job on chaiml-kimid-v8b-kimid-63800-v28-uploader to finish
chaiml-kimid-v8b-kimid-63800-v28-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-kimid-v8b-kimid-63800-v28-uploader: bash: no job control in this shell
chaiml-kimid-v8b-kimid-63800-v28-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v8b-kimid-63800-v28-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v8b-kimid-63800-v28-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v28-uploader: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
chaiml-kimid-v8b-kimid-63800-v28-uploader: Downloaded to shared memory in 128.908s
chaiml-kimid-v8b-kimid-63800-v28-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed in 194.848s
chaiml-kimid-v8b-kimid-63800-v28-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v8b-kimid-63800-v28-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v8b-kimid-63800-v28-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/README.md
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/added_tokens.json
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/.gitattributes
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/tokenizer_config.json
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/generation_config.json
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/chat_template.jinja
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/special_tokens_map.json
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/quantization_config.json
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/config.json
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/merges.txt
HTTP Request: %s %s "%s %d %s"
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/vocab.json
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/tokenizer.json
HTTP Request: %s %s "%s %d %s"
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00027-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00011-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00020-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00022-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00002-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00010-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00018-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00019-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00006-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00016-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00012-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00014-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00025-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00005-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00021-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00015-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00001-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00013-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00024-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v28-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v28/model-00026-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
Job chaiml-kimid-v8b-kimid-63800-v28-uploader completed after 556.35s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimid-63800-v28-uploader
Pipeline stage VLLMUploader completed in 557.07s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.41s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v8b-kimid-63800-v28
Waiting for inference service chaiml-kimid-v8b-kimid-63800-v28 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-kimid-v8b-kimid-63800-v28 ready after 530.3674685955048s
Pipeline stage VLLMDeployer completed in 530.78s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0790767669677734s
Received healthy response to inference request in 2.3630213737487793s
Received healthy response to inference request in 2.0600955486297607s
Received healthy response to inference request in 1.9257993698120117s
Received healthy response to inference request in 2.2201309204101562s
Received healthy response to inference request in 2.0349113941192627s
Received healthy response to inference request in 1.960660696029663s
Received healthy response to inference request in 2.3967511653900146s
Received healthy response to inference request in 2.2716758251190186s
Received healthy response to inference request in 1.9930088520050049s
Received healthy response to inference request in 2.0191733837127686s
Received healthy response to inference request in 2.281320571899414s
Received healthy response to inference request in 1.9183149337768555s
Received healthy response to inference request in 1.972933292388916s
Received healthy response to inference request in 1.9389030933380127s
Received healthy response to inference request in 2.2096850872039795s
Received healthy response to inference request in 1.9831953048706055s
Received healthy response to inference request in 1.985011100769043s
Received healthy response to inference request in 1.959010124206543s
Received healthy response to inference request in 1.970597743988037s
Received healthy response to inference request in 2.2545948028564453s
Received healthy response to inference request in 2.024547815322876s
Received healthy response to inference request in 2.060347318649292s
Received healthy response to inference request in 2.2251083850860596s
Received healthy response to inference request in 2.382538080215454s
Received healthy response to inference request in 1.9768388271331787s
Received healthy response to inference request in 2.9031364917755127s
Received healthy response to inference request in 1.9907991886138916s
Received healthy response to inference request in 1.940058946609497s
Received healthy response to inference request in 2.073972702026367s
30 requests
0 failed requests
5th percentile: 1.9316960453987122
10th percentile: 1.9399433612823487
20th percentile: 1.9686103343963623
30th percentile: 1.9812883615493775
40th percentile: 1.9921249866485595
50th percentile: 2.0297296047210693
60th percentile: 2.065797472000122
70th percentile: 2.2128188371658326
80th percentile: 2.25801100730896
90th percentile: 2.364973044395447
95th percentile: 2.3903552770614622
99th percentile: 2.756284747123719
mean time: 2.1125073035558066
Pipeline stage StressChecker completed in 67.37s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
chaiml-kimid-v8b-kimid_63800_v28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 5632.91s
Shutdown handler de-registered
chaiml-kimid-v8b-kimid_63800_v28 status is now torndown due to DeploymentManager action