developer_uid: richhx
submission_id: chaiml-kimid-v9-opusdv1_83165_v9
model_name: chaiml-kimid-v9-opusdv1_83165_v9
model_group: ChaiML/kimid-v9-opusdv1-
status: torndown
timestamp: 2026-01-14T00:19:52+00:00
num_battles: 38
num_wins: 19
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 4
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v9-opusdv1_83165_v9
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-13
win_ratio: 0.5
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|assistant|>', '####', '</think>', '<|user|>', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v9-opusdv1-83165-v9-uploader
Waiting for job on chaiml-kimid-v9-opusdv1-83165-v9-uploader to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v8b-kimidv-63800-v9-uploader
Waiting for job on chaiml-kimid-v8b-kimidv-63800-v9-uploader to finish
chaiml-kimid-v9-opusdv1-83165-v9-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v9-opusdv1-83165-v9-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v9-opusdv1-83165-v9-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ║                                                                     ║
chaiml-kimid-v8b-kimidv-63800-v9-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v9-opusdv1-83165-v9-uploader: Downloaded to shared memory in 132.385s
chaiml-kimid-v8b-kimidv-63800-v9-uploader: Downloaded to shared memory in 126.127s
chaiml-kimid-v8b-kimidv-63800-v9-uploader: Processed model ChaiML/kimid-v8b-kimidv5a-lr5e6ep2r64g4b01-int4-mixed in 190.199s
chaiml-kimid-v8b-kimidv-63800-v9-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v8b-kimidv-63800-v9-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v8b-kimidv-63800-v9-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/.gitattributes
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/chat_template.jinja
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/special_tokens_map.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/added_tokens.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/generation_config.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/tokenizer_config.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/quantization_config.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/config.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/README.md
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/vocab.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/merges.txt
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model.safetensors.index.json
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/tokenizer.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: Processed model ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-int4-mixed in 197.958s
chaiml-kimid-v9-opusdv1-83165-v9-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v9-opusdv1-83165-v9-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v9-opusdv1-83165-v9-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/.gitattributes
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/special_tokens_map.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/README.md
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/chat_template.jinja
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/added_tokens.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/generation_config.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/tokenizer_config.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/config.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/quantization_config.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model.safetensors.index.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/merges.txt
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/vocab.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/tokenizer.json
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00027-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00027-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00008-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00016-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00019-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00006-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00014-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00015-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00023-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00024-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00010-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00025-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00021-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00026-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00004-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00005-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00012-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00003-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00026-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00008-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00011-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00013-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00002-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00017-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00009-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00018-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00005-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00001-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00019-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00012-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00010-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00013-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00006-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00002-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00007-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00001-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00023-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00021-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00009-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00015-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00016-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00022-of-00027.safetensors
chaiml-kimid-v8b-kimidv-63800-v9-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v8b-kimidv-63800-v9/model-00025-of-00027.safetensors
chaiml-kimid-v9-opusdv1-83165-v9-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-83165-v9/model-00022-of-00027.safetensors
Job chaiml-kimid-v9-opusdv1-83165-v9-uploader completed after 577.84s with status: succeeded
Stopping job with name chaiml-kimid-v9-opusdv1-83165-v9-uploader
Pipeline stage VLLMUploader completed in 579.38s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.40s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv1-83165-v9
Waiting for inference service chaiml-kimid-v9-opusdv1-83165-v9 to be ready
Job chaiml-kimid-v8b-kimidv-63800-v9-uploader completed after 581.76s with status: succeeded
Stopping job with name chaiml-kimid-v8b-kimidv-63800-v9-uploader
Pipeline stage VLLMUploader completed in 583.23s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.40s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v8b-kimidv-63800-v9
Waiting for inference service chaiml-kimid-v8b-kimidv-63800-v9 to be ready
Inference service chaiml-kimid-v9-opusdv1-83165-v9 ready after 435.18931341171265s
Pipeline stage VLLMDeployer completed in 436.89s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.195591449737549s
Received healthy response to inference request in 1.9830985069274902s
Inference service chaiml-kimid-v8b-kimidv-63800-v9 ready after 436.05786776542664s
Pipeline stage VLLMDeployer completed in 437.42s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.272951602935791s
Received healthy response to inference request in 1.9845199584960938s
Received healthy response to inference request in 2.2446014881134033s
Received healthy response to inference request in 1.8925933837890625s
Received healthy response to inference request in 1.9535961151123047s
Received healthy response to inference request in 1.8419575691223145s
Received healthy response to inference request in 2.1377930641174316s
Received healthy response to inference request in 2.0504088401794434s
Received healthy response to inference request in 2.0450236797332764s
Received healthy response to inference request in 1.8058383464813232s
Received healthy response to inference request in 2.100444793701172s
Received healthy response to inference request in 1.807023048400879s
Received healthy response to inference request in 1.8236982822418213s
Received healthy response to inference request in 2.289942979812622s
Received healthy response to inference request in 1.934370517730713s
Received healthy response to inference request in 1.8768033981323242s
Received healthy response to inference request in 2.0630013942718506s
Received healthy response to inference request in 2.96530818939209s
Received healthy response to inference request in 1.8391187191009521s
Received healthy response to inference request in 2.020782232284546s
Received healthy response to inference request in 1.8225760459899902s
Received healthy response to inference request in 2.5664772987365723s
Received healthy response to inference request in 2.0574612617492676s
Received healthy response to inference request in 2.3882081508636475s
Received healthy response to inference request in 1.8500418663024902s
Received healthy response to inference request in 1.7621121406555176s
Received healthy response to inference request in 1.893571376800537s
Received healthy response to inference request in 2.000142812728882s
Received healthy response to inference request in 1.7671546936035156s
Received healthy response to inference request in 1.8745582103729248s
Received healthy response to inference request in 1.8345942497253418s
Received healthy response to inference request in 1.9584946632385254s
Received healthy response to inference request in 1.9373037815093994s
Received healthy response to inference request in 2.303239107131958s
Received healthy response to inference request in 1.850311040878296s
Received healthy response to inference request in 1.7823433876037598s
Received healthy response to inference request in 2.490994453430176s
Received healthy response to inference request in 1.8060855865478516s
Received healthy response to inference request in 1.8283331394195557s
Received healthy response to inference request in 1.7548952102661133s
Received healthy response to inference request in 1.7674298286437988s
Received healthy response to inference request in 1.7777838706970215s
Received healthy response to inference request in 1.8398995399475098s
Received healthy response to inference request in 2.0109264850616455s
Received healthy response to inference request in 1.9252550601959229s
Received healthy response to inference request in 2.2723188400268555s
Received healthy response to inference request in 1.9031221866607666s
Received healthy response to inference request in 2.0663094520568848s
Received healthy response to inference request in 2.0339443683624268s
Received healthy response to inference request in 1.8547065258026123s
Received healthy response to inference request in 1.957702398300171s
Received healthy response to inference request in 2.3836474418640137s
Received healthy response to inference request in 2.323542356491089s
Received healthy response to inference request in 2.748257875442505s
Received healthy response to inference request in 1.8336114883422852s
30 requests
0 failed requests
5th percentile: 1.7691644191741944
10th percentile: 1.7818874359130858
20th percentile: 1.823473834991455
30th percentile: 1.8641606092453002
Received healthy response to inference request in 1.813652515411377s
40th percentile: 1.9307243347167968
50th percentile: 1.9580985307693481
60th percentile: 2.0083985805511473
70th percentile: 2.0616500139236447
80th percentile: 2.20539345741272
90th percentile: 2.3052694320678713
95th percentile: 2.3591085433959957
99th percentile: 2.797949178218842
mean time: 2.0241592168807983
Pipeline stage StressChecker completed in 71.21s
Received healthy response to inference request in 2.1074538230895996s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 1.7791931629180908s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.79s
30 requests
Shutdown handler de-registered
0 failed requests
5th percentile: 1.7727233290672302
chaiml-kimid-v9-opusdv1_83165_v9 status is now deployed due to DeploymentManager action
chaiml-kimid-v9-opusdv1_83165_v9 status is now torndown due to DeploymentManager action