developer_uid: richhx
submission_id: chaiml-kimid-v9-opusdv1_14626_v3
model_name: chaiml-kimid-v9-opusdv1_14626_v3
model_group: ChaiML/kimid-v9-opusdv1-
status: torndown
timestamp: 2026-01-24T09:28:40+00:00
num_battles: 11588
num_wins: 6313
celo_rating: 1337.88
family_friendly_score: 0.5546
family_friendly_standard_error: 0.007028781402206217
submission_type: basic
model_repo: ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 4
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-kimid-v9-opusdv1_14626_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-21
win_ratio: 0.5447877114256127
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '####', '</s>', '</think>', '<|user|>', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v9-opusdv1-14626-v3-uploader
Waiting for job on chaiml-kimid-v9-opusdv1-14626-v3-uploader to finish
chaiml-kimid-v9-opusdv1-14626-v3-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-kimid-v9-opusdv1-14626-v3-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv1-14626-v3-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v9-opusdv1-14626-v3-uploader: HTTP Error 504 thrown while requesting HEAD https://huggingface.co/ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8/resolve/f92cc86026578a208b34c65f4c23ed199e79e65f/model-00012-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: WARNING:huggingface_hub.utils._http:HTTP Error 504 thrown while requesting HEAD https://huggingface.co/ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8/resolve/f92cc86026578a208b34c65f4c23ed199e79e65f/model-00012-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Retrying in 1s [Retry 1/5].
chaiml-kimid-v9-opusdv1-14626-v3-uploader: WARNING:huggingface_hub.utils._http:Retrying in 1s [Retry 1/5].
chaiml-kimid-v9-opusdv1-14626-v3-uploader: HTTP Error 504 thrown while requesting HEAD https://huggingface.co/ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8/resolve/f92cc86026578a208b34c65f4c23ed199e79e65f/model-00012-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: WARNING:huggingface_hub.utils._http:HTTP Error 504 thrown while requesting HEAD https://huggingface.co/ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8/resolve/f92cc86026578a208b34c65f4c23ed199e79e65f/model-00012-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Retrying in 2s [Retry 2/5].
chaiml-kimid-v9-opusdv1-14626-v3-uploader: WARNING:huggingface_hub.utils._http:Retrying in 2s [Retry 2/5].
chaiml-kimid-v9-opusdv1-14626-v3-uploader: HTTP Error 504 thrown while requesting HEAD https://huggingface.co/ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8/resolve/f92cc86026578a208b34c65f4c23ed199e79e65f/model-00012-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: WARNING:huggingface_hub.utils._http:HTTP Error 504 thrown while requesting HEAD https://huggingface.co/ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8/resolve/f92cc86026578a208b34c65f4c23ed199e79e65f/model-00012-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Retrying in 4s [Retry 3/5].
chaiml-kimid-v9-opusdv1-14626-v3-uploader: WARNING:huggingface_hub.utils._http:Retrying in 4s [Retry 3/5].
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Downloaded to shared memory in 295.303s
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Processed model ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8 in 398.038s
chaiml-kimid-v9-opusdv1-14626-v3-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v9-opusdv1-14626-v3-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/config.json
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/chat_template.jinja
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/.gitattributes
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/tokenizer_config.json
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/generation_config.json
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/tokenizer.json
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/added_tokens.json
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/special_tokens_map.json
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/recipe.yaml s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/recipe.yaml
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/vocab.json
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/merges.txt
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model.safetensors.index.json
Stopping job with name chaiml-kimid-v9-opusdv1-14626-v3-uploader
%s, retrying in %s seconds...
Starting job with name chaiml-kimid-v9-opusdv1-14626-v3-uploader
Waiting for job on chaiml-kimid-v9-opusdv1-14626-v3-uploader to finish
chaiml-kimid-v9-opusdv1-14626-v3-uploader: unable to retrieve container logs for containerd://0b415fd6497e9afa89dc4
chaiml-kimid-v9-opusdv1-14626-v3-uploader: unable to retrieve container logs for containerd://0b415fd6497e9afa89dc4
chaiml-kimid-v9-opusdv1-14626-v3-uploader: unable to retrieve container logs for containerd://0b415fd6497e9afa89dc4
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Downloaded to shared memory in 260.238s
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Processed model ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-FP8 in 370.815s
chaiml-kimid-v9-opusdv1-14626-v3-uploader: creating bucket guanaco-vllm-models
chaiml-kimid-v9-opusdv1-14626-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v9-opusdv1-14626-v3-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/.gitattributes": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/added_tokens.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/chat_template.jinja": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/config.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/generation_config.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/merges.txt": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model.safetensors.index.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/recipe.yaml s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/recipe.yaml": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/special_tokens_map.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/tokenizer.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/tokenizer_config.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: DEBUG "sync /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/vocab.json": object size matches
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00048-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00048-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00031-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00031-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00026-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00026-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00002-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00002-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00023-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00023-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00029-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00029-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00018-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00018-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00025-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00025-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00036-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00036-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00011-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00011-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00015-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00015-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00040-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00040-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00003-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00003-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00033-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00033-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00047-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00047-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00035-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00035-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00024-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00024-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00014-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00014-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00009-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00009-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00042-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00042-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00038-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00038-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00020-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00020-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00041-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00041-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00008-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00008-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00045-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00045-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00005-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00005-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00034-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00034-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00044-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00044-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00039-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00039-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00010-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00010-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00028-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00028-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00016-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00016-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00032-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00032-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00017-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00017-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00030-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00030-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00012-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00012-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00022-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00022-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00027-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00027-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00004-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00004-of-00048.safetensors
chaiml-kimid-v9-opusdv1-14626-v3-uploader: cp /dev/shm/model_cache/model-00013-of-00048.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv1-14626-v3/model-00013-of-00048.safetensors
Job chaiml-kimid-v9-opusdv1-14626-v3-uploader completed after 721.97s with status: succeeded
Stopping job with name chaiml-kimid-v9-opusdv1-14626-v3-uploader
Pipeline stage VLLMUploader completed in 1175.75s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.22s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv1-14626-v3
Waiting for inference service chaiml-kimid-v9-opusdv1-14626-v3 to be ready
Inference service chaiml-kimid-v9-opusdv1-14626-v3 ready after 678.6226217746735s
Pipeline stage VLLMDeployer completed in 679.98s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.28762149810791s
Received healthy response to inference request in 1.9983811378479004s
Received healthy response to inference request in 2.0130839347839355s
Received healthy response to inference request in 2.218780517578125s
Received healthy response to inference request in 2.043583393096924s
Received healthy response to inference request in 1.9903995990753174s
Received healthy response to inference request in 1.9956004619598389s
Received healthy response to inference request in 2.1716878414154053s
Received healthy response to inference request in 2.0979816913604736s
Received healthy response to inference request in 2.0634052753448486s
Received healthy response to inference request in 2.209456443786621s
Received healthy response to inference request in 2.072711944580078s
Received healthy response to inference request in 2.126891851425171s
Received healthy response to inference request in 1.9878103733062744s
Received healthy response to inference request in 2.571218967437744s
Received healthy response to inference request in 2.003781795501709s
Received healthy response to inference request in 2.1465229988098145s
Received healthy response to inference request in 2.0753183364868164s
Received healthy response to inference request in 2.151357889175415s
Received healthy response to inference request in 2.0020737648010254s
Received healthy response to inference request in 2.027221918106079s
Received healthy response to inference request in 2.0878713130950928s
Received healthy response to inference request in 2.498657464981079s
Received healthy response to inference request in 2.3900978565216064s
Received healthy response to inference request in 2.0881617069244385s
Received healthy response to inference request in 2.024008274078369s
Received healthy response to inference request in 2.21463680267334s
Received healthy response to inference request in 2.007356643676758s
Received healthy response to inference request in 2.2661850452423096s
Received healthy response to inference request in 2.0955562591552734s
30 requests
0 failed requests
5th percentile: 1.992739987373352
10th percentile: 1.9981030702590943
20th percentile: 2.006641674041748
30th percentile: 2.0262578248977663
40th percentile: 2.0689892768859863
50th percentile: 2.0880165100097656
60th percentile: 2.1095457553863524
70th percentile: 2.157456874847412
80th percentile: 2.215465545654297
90th percentile: 2.29786913394928
95th percentile: 2.449805641174316
99th percentile: 2.5501761317253115
mean time: 2.1309141000111897
Pipeline stage StressChecker completed in 68.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.40s
Shutdown handler de-registered
chaiml-kimid-v9-opusdv1_14626_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2930.20s
Shutdown handler de-registered
chaiml-kimid-v9-opusdv1_14626_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-kimid-v9-opusdv1_14626_v3 status is now torndown due to DeploymentManager action