chaiml-bol-v1-opusdv1b-_13427

developer_uid: zonemercy
submission_id: chaiml-bol-v1-opusdv1b-_13427_v1
model_name: chaiml-bol-v1-opusdv1b-_13427_v1
model_group: ChaiML/bol-v1-opusdv1b-l
status: inactive
timestamp: 2026-01-24T14:17:00+00:00
num_battles: 13543
num_wins: 7299
celo_rating: 1333.52
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 80
reward_model: chaiml-prm-kimi-v1-300k_92220_v2
display_name: chaiml-bol-v1-opusdv1b-_13427_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-24
win_ratio: 0.5389500110758325
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|user|>', '<|im_end|>', '</s>', '</think>', '<|assistant|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-bol-v1-opusdv1b-13427-v1-uploader
Waiting for job on chaiml-bol-v1-opusdv1b-13427-v1-uploader to finish
chaiml-bol-v1-opusdv1b-13427-v1-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v1-opusdv1b-13427-v1-uploader: bash: no job control in this shell
chaiml-bol-v1-opusdv1b-13427-v1-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v1-opusdv1b-13427-v1-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  belonging to:                                                      ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-13427-v1-uploader: Downloaded to shared memory in 107.374s
chaiml-bol-v1-opusdv1b-13427-v1-uploader: Processed model ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed in 166.771s
chaiml-bol-v1-opusdv1b-13427-v1-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v1-opusdv1b-13427-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v1-opusdv1b-13427-v1-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/chat_template.jinja
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/generation_config.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/.gitattributes
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/added_tokens.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/quantization_config.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/special_tokens_map.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/config.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/merges.txt
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/tokenizer_config.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/vocab.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/tokenizer.json
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model.safetensors.index.json
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00027-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00014-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00021-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00012-of-00027.safetensors
Stopping job with name chaiml-bol-v1-opusdv1b-13427-v1-uploader
%s, retrying in %s seconds...
Starting job with name chaiml-bol-v1-opusdv1b-13427-v1-uploader
Waiting for job on chaiml-bol-v1-opusdv1b-13427-v1-uploader to finish
chaiml-bol-v1-opusdv1b-13427-v1-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v1-opusdv1b-13427-v1-uploader: bash: no job control in this shell
chaiml-bol-v1-opusdv1b-13427-v1-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v1-opusdv1b-13427-v1-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  belonging to:                                                      ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v1-uploader: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-13427-v1-uploader: Downloaded to shared memory in 109.402s
chaiml-bol-v1-opusdv1b-13427-v1-uploader: Processed model ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed in 168.467s
chaiml-bol-v1-opusdv1b-13427-v1-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v1-opusdv1b-13427-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v1-opusdv1b-13427-v1-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/.gitattributes": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/added_tokens.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/chat_template.jinja": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/generation_config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/merges.txt": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00003-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00006-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00008-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00009-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00010-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00012-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00013-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00014-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00015-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00018-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00021-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00022-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00023-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00025-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00027-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model.safetensors.index.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/quantization_config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/special_tokens_map.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/tokenizer.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/tokenizer_config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v1-uploader: DEBUG "sync /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/vocab.json": object size matches
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00007-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00002-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00001-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00024-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00020-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00004-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00017-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00026-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00019-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v1-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v1/model-00016-of-00027.safetensors
Job chaiml-bol-v1-opusdv1b-13427-v1-uploader completed after 309.02s with status: succeeded
Stopping job with name chaiml-bol-v1-opusdv1b-13427-v1-uploader
Pipeline stage VLLMUploader completed in 788.66s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-bol-v1-opusdv1b-13427-v1
Waiting for inference service chaiml-bol-v1-opusdv1b-13427-v1 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-bol-v1-opusdv1b-13427-v1 ready after 461.7088348865509s
Pipeline stage VLLMDeployer completed in 462.24s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.0397651195526123s
Received healthy response to inference request in 2.04106068611145s
Received healthy response to inference request in 2.240940809249878s
Received healthy response to inference request in 1.9356262683868408s
Received healthy response to inference request in 1.993636131286621s
Received healthy response to inference request in 2.9676589965820312s
Received healthy response to inference request in 2.020799398422241s
Received healthy response to inference request in 2.0789132118225098s
Received healthy response to inference request in 2.290447235107422s
Received healthy response to inference request in 1.9599318504333496s
Received healthy response to inference request in 1.9369256496429443s
Received healthy response to inference request in 2.8542842864990234s
Received healthy response to inference request in 1.905935525894165s
Received healthy response to inference request in 2.484774112701416s
Received healthy response to inference request in 2.3841476440429688s
Received healthy response to inference request in 2.130218505859375s
Received healthy response to inference request in 2.1967408657073975s
Received healthy response to inference request in 2.253511905670166s
Received healthy response to inference request in 1.9788179397583008s
Received healthy response to inference request in 2.4853687286376953s
Received healthy response to inference request in 2.0820999145507812s
Received healthy response to inference request in 2.198915719985962s
Received healthy response to inference request in 1.9720585346221924s
Received healthy response to inference request in 1.9882392883300781s
Received healthy response to inference request in 2.51049542427063s
Received healthy response to inference request in 2.096235752105713s
Received healthy response to inference request in 1.989649772644043s
Received healthy response to inference request in 2.245382070541382s
Received healthy response to inference request in 1.9640514850616455s
Received healthy response to inference request in 2.174529552459717s
30 requests
0 failed requests
5th percentile: 1.9362109899520874
10th percentile: 1.957631230354309
20th percentile: 1.977466058731079
30th percentile: 1.9924402236938477
40th percentile: 2.040542459487915
50th percentile: 2.089167833328247
60th percentile: 2.183414077758789
70th percentile: 2.242273187637329
80th percentile: 2.3091873168945316
90th percentile: 2.487881398200989
95th percentile: 2.6995792984962454
99th percentile: 2.934780330657959
mean time: 2.180038746198018
Pipeline stage StressChecker completed in 69.30s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
Shutdown handler de-registered
chaiml-bol-v1-opusdv1b-_13427_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('None: None')
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('None: None')
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('None: None')
Shutdown handler de-registered
chaiml-bol-v1-opusdv1b-_13427_v1 status is now inactive due to auto deactivation removed underperforming models