chaiml-bol-v4-opusdv1b-l_4012

developer_uid: zonemercy
submission_id: chaiml-bol-v4-opusdv1b-l_4012_v1
model_name: chaiml-bol-v4-opusdv1b-l_4012_v1
model_group: ChaiML/bol-v4-opusdv1b-l
status: torndown
timestamp: 2026-02-04T06:57:56+00:00
num_battles: 13243
num_wins: 7062
celo_rating: 1328.45
family_friendly_score: 0.5646
family_friendly_standard_error: 0.0070118020508283035
submission_type: basic
model_repo: ChaiML/bol-v4-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: chaiml-prm-kimi-v1-300k_92220_v7
display_name: chaiml-bol-v4-opusdv1b-l_4012_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/bol-v4-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-31
win_ratio: 0.5332628558483727
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|user|>', '</s>', '####', '<|im_end|>', '</think>', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-bol-v4-opusdv1b-l-4012-v1-uploader
Waiting for job on chaiml-bol-v4-opusdv1b-l-4012-v1-uploader to finish
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: bash: no job control in this shell
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  belonging to:                                                      ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: Downloaded to shared memory in 104.692s
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: Processed model ChaiML/bol-v4-opusdv1b-lr1e5ep2r64g4b01-int4-mixed in 175.579s
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/.gitattributes
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/chat_template.jinja
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/added_tokens.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/special_tokens_map.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/generation_config.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/tokenizer_config.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/config.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/vocab.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/merges.txt
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/tokenizer.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model.safetensors.index.json
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG retryable error: RequestError: send request failed
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: caused by: Put "https://object.ord1.coreweave.com/guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00010-of-00027.safetensors?partNumber=24&uploadId=2~pkjPmnlabz05nbkptbheewFYxQeu9qM": write tcp 10.1.95.211:49174->216.153.53.63:443: write: connection reset by peer
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ERROR "cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00010-of-00027.safetensors": MultipartUpload: upload multipart failed upload id: 2~pkjPmnlabz05nbkptbheewFYxQeu9qM caused by: SignatureDoesNotMatch:  status code: 403, request id: tx00000146356c53a1e7c27-00697ef44a-14995edef0-default, host id:
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00027-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00026-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00007-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00025-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00002-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00015-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00008-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00003-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00019-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00018-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00014-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00013-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00001-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00020-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00009-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00023-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00024-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00017-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00004-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00016-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00022-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00006-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00012-of-00027.safetensors
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00021-of-00027.safetensors
Job chaiml-bol-v4-opusdv1b-l-4012-v1-uploader completed after 678.4s with status: failed
Stopping job with name chaiml-bol-v4-opusdv1b-l-4012-v1-uploader
%s, retrying in %s seconds...
Starting job with name chaiml-bol-v4-opusdv1b-l-4012-v1-uploader
Waiting for job on chaiml-bol-v4-opusdv1b-l-4012-v1-uploader to finish
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: bash: no job control in this shell
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  belonging to:                                                      ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ║                                                                     ║
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: Downloaded to shared memory in 102.072s
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: Processed model ChaiML/bol-v4-opusdv1b-lr1e5ep2r64g4b01-int4-mixed in 170.239s
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/.gitattributes": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/added_tokens.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/chat_template.jinja": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/config.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/generation_config.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/merges.txt": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00001-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00002-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00003-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00004-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00005-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00006-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00007-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00008-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00009-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00011-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00012-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00013-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00014-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00015-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00016-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00017-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00018-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00019-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00020-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00021-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00022-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00023-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00024-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00025-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00026-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00027-of-00027.safetensors": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model.safetensors.index.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/quantization_config.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/special_tokens_map.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/tokenizer.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/tokenizer_config.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: DEBUG "sync /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/vocab.json": object size matches
chaiml-bol-v4-opusdv1b-l-4012-v1-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v4-opusdv1b-l-4012-v1/model-00010-of-00027.safetensors
Job chaiml-bol-v4-opusdv1b-l-4012-v1-uploader completed after 240.89s with status: succeeded
Stopping job with name chaiml-bol-v4-opusdv1b-l-4012-v1-uploader
Pipeline stage VLLMUploader completed in 920.10s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-bol-v4-opusdv1b-l-4012-v1
Waiting for inference service chaiml-bol-v4-opusdv1b-l-4012-v1 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-bol-v4-opusdv1b-l-4012-v1 ready after 470.3109202384949s
Pipeline stage VLLMDeployer completed in 470.71s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.878683090209961s
Received healthy response to inference request in 2.464718818664551s
Received healthy response to inference request in 1.8342843055725098s
Received healthy response to inference request in 1.9830844402313232s
Received healthy response to inference request in 2.3162591457366943s
Received healthy response to inference request in 1.6800625324249268s
Received healthy response to inference request in 2.270681619644165s
Received healthy response to inference request in 2.2718448638916016s
Received healthy response to inference request in 1.7521049976348877s
Received healthy response to inference request in 1.7438769340515137s
Received healthy response to inference request in 1.8123650550842285s
Received healthy response to inference request in 1.9023690223693848s
Received healthy response to inference request in 1.9751689434051514s
Received healthy response to inference request in 1.8655712604522705s
Received healthy response to inference request in 2.1276865005493164s
Received healthy response to inference request in 1.73488187789917s
Received healthy response to inference request in 1.795614242553711s
Received healthy response to inference request in 1.7351856231689453s
Received healthy response to inference request in 2.2518885135650635s
Received healthy response to inference request in 1.803941011428833s
Received healthy response to inference request in 2.208871364593506s
Received healthy response to inference request in 1.7650282382965088s
Received healthy response to inference request in 2.2992448806762695s
Received healthy response to inference request in 1.9042036533355713s
Received healthy response to inference request in 1.8097519874572754s
Received healthy response to inference request in 1.9118735790252686s
Received healthy response to inference request in 1.9575929641723633s
Received healthy response to inference request in 1.8584911823272705s
Received healthy response to inference request in 1.940481185913086s
Received healthy response to inference request in 1.7421741485595703s
30 requests
0 failed requests
5th percentile: 1.7350185632705688
10th percentile: 1.7414752960205078
20th percentile: 1.7624435901641846
30th percentile: 1.8080086946487426
40th percentile: 1.8488084316253663
50th percentile: 1.8905260562896729
60th percentile: 1.9233166217803954
70th percentile: 1.977543592453003
80th percentile: 2.2174747943878175
90th percentile: 2.2745848655700684
95th percentile: 2.3086027264595033
99th percentile: 2.4216655135154723
mean time: 1.95326619942983
Pipeline stage StressChecker completed in 63.21s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
chaiml-bol-v4-opusdv1b-l_4012_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 4916.59s
Shutdown handler de-registered
chaiml-bol-v4-opusdv1b-l_4012_v1 status is now torndown due to DeploymentManager action