developer_uid: richhx
submission_id: chaiml-kimid-v8b-kimid_63800_v12
model_name: chaiml-kimid-v8b-kimid_63800_v12
model_group: ChaiML/kimid-v8b-kimidv5
status: inactive
timestamp: 2026-01-15T17:43:15+00:00
num_battles: 203534
num_wins: 114928
celo_rating: 1341.12
family_friendly_score: 0.5045999999999999
family_friendly_standard_error: 0.00707076855794333
submission_type: basic
model_repo: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 4
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v8b-kimid_63800_v12
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-15
win_ratio: 0.5646624151247458
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</s>', '</think>', '<|assistant|>', '####', '<|user|>'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimid-63800-v12-uploader
Waiting for job on chaiml-kimid-v8b-kimid-63800-v12-uploader to finish
chaiml-kimid-v8b-kimid-63800-v12-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-kimid-v8b-kimid-63800-v12-uploader: bash: no job control in this shell
chaiml-kimid-v9-opusdv-83165-v12-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v9-opusdv-83165-v12-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v9-opusdv-83165-v12-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v8b-kimid-63800-v12-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v9-opusdv-83165-v12-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimid-63800-v12-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v8b-kimid-63800-v12-uploader: Downloaded to shared memory in 126.466s
chaiml-kimid-v9-opusdv-83165-v12-uploader: Downloaded to shared memory in 139.139s
chaiml-kimid-v8b-kimid-63800-v12-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed in 193.620s
chaiml-kimid-v8b-kimid-63800-v12-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v8b-kimid-63800-v12-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v8b-kimid-63800-v12-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/tokenizer_config.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/README.md
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/.gitattributes
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/added_tokens.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/special_tokens_map.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/generation_config.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/chat_template.jinja
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/config.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/quantization_config.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/merges.txt
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/vocab.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model.safetensors.index.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/tokenizer.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: Processed model ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-int4-mixed in 207.039s
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/.gitattributes
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/chat_template.jinja
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/README.md
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/added_tokens.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/generation_config.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/special_tokens_map.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/tokenizer_config.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/quantization_config.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/config.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/merges.txt
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/vocab.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model.safetensors.index.json
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/tokenizer.json
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00027-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00027-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00015-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00016-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00006-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00026-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00012-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00011-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00013-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00010-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00014-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00023-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00006-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00001-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00024-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00019-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00021-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00003-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00015-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00025-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00004-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00018-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00002-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00016-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00001-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00011-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00007-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00008-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00014-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00019-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00017-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00023-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00018-of-00027.safetensors
chaiml-kimid-v8b-kimid-63800-v12-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimid-63800-v12/model-00005-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00021-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00022-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00005-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00020-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00026-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v12-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v12/model-00013-of-00027.safetensors
Job chaiml-kimid-v8b-kimid-63800-v12-uploader completed after 615.87s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimid-63800-v12-uploader
Pipeline stage VLLMUploader completed in 617.21s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.32s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v8b-kimid-63800-v12
Job chaiml-kimid-v9-opusdv-83165-v12-uploader completed after 619.42s with status: succeeded
Stopping job with name chaiml-kimid-v9-opusdv-83165-v12-uploader
Waiting for inference service chaiml-kimid-v8b-kimid-63800-v12 to be ready
Pipeline stage VLLMUploader completed in 620.71s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.35s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv-83165-v12
Waiting for inference service chaiml-kimid-v9-opusdv-83165-v12 to be ready
Inference service chaiml-kimid-v8b-kimid-63800-v12 ready after 455.8895959854126s
Pipeline stage VLLMDeployer completed in 457.59s
run pipeline stage %s
Running pipeline stage StressChecker
Inference service chaiml-kimid-v9-opusdv-83165-v12 ready after 455.33354568481445s
Pipeline stage VLLMDeployer completed in 456.59s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3034019470214844s
Received healthy response to inference request in 1.988511562347412s
Received healthy response to inference request in 2.27156400680542s
Received healthy response to inference request in 2.340904712677002s
Received healthy response to inference request in 1.7890434265136719s
Received healthy response to inference request in 2.5930848121643066s
Received healthy response to inference request in 2.2214133739471436s
Received healthy response to inference request in 2.1100571155548096s
Received healthy response to inference request in 2.0287840366363525s
Received healthy response to inference request in 1.8490965366363525s
Received healthy response to inference request in 2.1071622371673584s
Received healthy response to inference request in 2.146009683609009s
Received healthy response to inference request in 2.4875261783599854s
Received healthy response to inference request in 2.0472652912139893s
Received healthy response to inference request in 2.220942497253418s
Received healthy response to inference request in 1.9503536224365234s
Received healthy response to inference request in 1.935776710510254s
Received healthy response to inference request in 2.8972790241241455s
Received healthy response to inference request in 1.7989537715911865s
Received healthy response to inference request in 1.832184076309204s
Received healthy response to inference request in 1.924445390701294s
Received healthy response to inference request in 1.7822959423065186s
Received healthy response to inference request in 2.0010972023010254s
Received healthy response to inference request in 1.982328176498413s
Received healthy response to inference request in 1.8761332035064697s
Received healthy response to inference request in 2.471190929412842s
Received healthy response to inference request in 2.0720176696777344s
Received healthy response to inference request in 1.7940587997436523s
Received healthy response to inference request in 2.3702828884124756s
Received healthy response to inference request in 1.8044548034667969s
Received healthy response to inference request in 1.7484667301177979s
Received healthy response to inference request in 1.8417518138885498s
Received healthy response to inference request in 2.085972309112549s
Received healthy response to inference request in 2.058638572692871s
Received healthy response to inference request in 1.7880125045776367s
Received healthy response to inference request in 1.825376272201538s
Received healthy response to inference request in 1.8591010570526123s
Received healthy response to inference request in 2.2608835697174072s
Received healthy response to inference request in 2.0189337730407715s
Received healthy response to inference request in 1.8988029956817627s
Received healthy response to inference request in 1.961181402206421s
Received healthy response to inference request in 1.979975938796997s
Received healthy response to inference request in 1.844355583190918s
Received healthy response to inference request in 2.150360584259033s
Received healthy response to inference request in 2.0392603874206543s
Received healthy response to inference request in 1.8763136863708496s
Received healthy response to inference request in 2.053288459777832s
Received healthy response to inference request in 2.5529658794403076s
Received healthy response to inference request in 3.042825222015381s
Received healthy response to inference request in 2.295238733291626s
Received healthy response to inference request in 1.8486988544464111s
Received healthy response to inference request in 1.9563086032867432s
Received healthy response to inference request in 2.2239716053009033s
Received healthy response to inference request in 1.7733054161071777s
Received healthy response to inference request in 2.373302936553955s
Received healthy response to inference request in 1.8264496326446533s
Received healthy response to inference request in 1.8507697582244873s
Received healthy response to inference request in 1.8592703342437744s
Received healthy response to inference request in 1.8311080932617188s
30 requests
0 failed requests
5th percentile: 1.7962615370750428
10th percentile: 1.8039047002792359
20th percentile: 1.8396230697631837
30th percentile: 1.8762595415115357
40th percentile: 1.93124418258667
50th percentile: 1.9905365705490112
Received healthy response to inference request in 1.8855862617492676s
60th percentile: 2.0639902114868165
30 requests
70th percentile: 2.1715351581573485
0 failed requests
80th percentile: 2.26301965713501
5th percentile: 1.777351152896881
90th percentile: 2.3103920459747314
10th percentile: 1.7874408483505249
95th percentile: 2.436125719547271
20th percentile: 1.8419212818145752
99th percentile: 2.5339883661270144
30th percentile: 1.8560997009277345
mean time: 2.0462857564290364
40th percentile: 1.9244466781616212
Pipeline stage StressChecker completed in 71.96s
50th percentile: 1.9854198694229126
run pipeline stage %s
60th percentile: 2.0424623489379883
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
70th percentile: 2.093197751045227
run_pipeline:run_in_cloud %s
80th percentile: 2.2473582267761234
starting trigger_guanaco_pipeline args=%s
90th percentile: 2.4833803176879883
95th percentile: 2.760391628742217
99th percentile: 3.0006168246269227
mean time: 2.073984130223592
triggered trigger_guanaco_pipeline args=%s
Pipeline stage StressChecker completed in 72.97s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.89s
run pipeline stage %s
Shutdown handler de-registered
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
chaiml-kimid-v8b-kimid_63800_v12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2697.18s
Shutdown handler de-registered
chaiml-kimid-v8b-kimid_63800_v12 status is now inactive due to system request