developer_uid: zonemercy
submission_id: chaiml-bol-v1-opusdv1b-_13427_v4
model_name: chaiml-bol-v1-opusdv1b-_13427_v4
model_group: ChaiML/bol-v1-opusdv1b-l
status: inactive
timestamp: 2026-01-24T15:23:05+00:00
num_battles: 4502
num_wins: 2335
celo_rating: 1318.01
family_friendly_score: 0.5726
family_friendly_standard_error: 0.006996130930735931
submission_type: basic
model_repo: ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 72
reward_model: chaiml-prm-kimi-v1-300k_92220_v2
display_name: chaiml-bol-v1-opusdv1b-_13427_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-24
win_ratio: 0.5186583740559751
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '</think>', '<|user|>', '</s>', '####', '<|assistant|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Connection pool is full, discarding connection: %s. Connection pool size: %s
Starting job with name chaiml-bol-v1-opusdv1b-13427-v4-uploader
Waiting for job on chaiml-bol-v1-opusdv1b-13427-v4-uploader to finish
chaiml-bol-v1-opusdv1b-13427-v4-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v1-opusdv1b-13427-v4-uploader: bash: no job control in this shell
chaiml-bol-v1-opusdv1b-13427-v4-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v1-opusdv1b-13427-v4-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  belonging to:                                                      ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission function_genen_2026-01-12: ('http://guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com/models/chaiml-7b07-69d4-linear-w01_v7/predict', '{"detail":"1 validation error for RuntimeResponse\\npredictions\\n  Field required [type=missing, input_value={\'detail\': \\"503, message=...linear-w01_v7/predict\'\\"}, input_type=dict]\\n    For further information visit https://errors.pydantic.dev/2.12/v/missing"}')
chaiml-bol-v1-opusdv1b-13427-v4-uploader: Downloaded to shared memory in 121.619s
chaiml-bol-v1-opusdv1b-13427-v4-uploader: Processed model ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed in 182.485s
chaiml-bol-v1-opusdv1b-13427-v4-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v1-opusdv1b-13427-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v1-opusdv1b-13427-v4-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/generation_config.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/chat_template.jinja
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/.gitattributes
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/added_tokens.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/config.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/tokenizer_config.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/quantization_config.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/special_tokens_map.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/merges.txt
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/tokenizer.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/vocab.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model.safetensors.index.json
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG retryable error: RequestError: send request failed
chaiml-bol-v1-opusdv1b-13427-v4-uploader: caused by: Put "https://object.ord1.coreweave.com/guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00018-of-00027.safetensors?partNumber=24&uploadId=2~J0-akKKtcf9Lmr4N5CF0UKIvgvplh1Q": write tcp 10.0.1.230:34722->216.153.53.63:443: write: connection reset by peer
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ERROR "cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00018-of-00027.safetensors": MultipartUpload: upload multipart failed upload id: 2~J0-akKKtcf9Lmr4N5CF0UKIvgvplh1Q caused by: SignatureDoesNotMatch:  status code: 403, request id: tx00000e5027d69f8e93bae-006974dfe8-14a24de22e-default, host id:
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00027-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00002-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00007-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00009-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00014-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00013-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00021-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00005-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00001-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00012-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00010-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00011-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00023-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00008-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00004-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00003-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00016-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00006-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00026-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00019-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00015-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00020-of-00027.safetensors
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00024-of-00027.safetensors
Job chaiml-bol-v1-opusdv1b-13427-v4-uploader completed after 370.02s with status: failed
Stopping job with name chaiml-bol-v1-opusdv1b-13427-v4-uploader
%s, retrying in %s seconds...
Starting job with name chaiml-bol-v1-opusdv1b-13427-v4-uploader
Waiting for job on chaiml-bol-v1-opusdv1b-13427-v4-uploader to finish
chaiml-bol-v1-opusdv1b-13427-v4-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v1-opusdv1b-13427-v4-uploader: bash: no job control in this shell
chaiml-bol-v1-opusdv1b-13427-v4-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v1-opusdv1b-13427-v4-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  belonging to:                                                      ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-13427-v4-uploader: ╚═════════════════════════════════════════════════════════════════════╝
Connection pool is full, discarding connection: %s. Connection pool size: %s
chaiml-bol-v1-opusdv1b-13427-v4-uploader: Downloaded to shared memory in 129.026s
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-13427-v4-uploader: Processed model ChaiML/bol-v1-opusdv1b-lr5e6ep2r64g4b01-int4-mixed in 190.453s
chaiml-bol-v1-opusdv1b-13427-v4-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v1-opusdv1b-13427-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v1-opusdv1b-13427-v4-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/.gitattributes": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/added_tokens.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/chat_template.jinja": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/generation_config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/merges.txt": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00001-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00002-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00003-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00004-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00005-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00006-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00007-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00008-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00009-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00010-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00011-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00012-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00013-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00014-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00015-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00016-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00017-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00019-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00020-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00021-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00022-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00023-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00024-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00025-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00026-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00027-of-00027.safetensors": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model.safetensors.index.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/quantization_config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/special_tokens_map.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/tokenizer.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/tokenizer_config.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: DEBUG "sync /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/vocab.json": object size matches
chaiml-bol-v1-opusdv1b-13427-v4-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-13427-v4/model-00018-of-00027.safetensors
Job chaiml-bol-v1-opusdv1b-13427-v4-uploader completed after 250.24s with status: succeeded
Stopping job with name chaiml-bol-v1-opusdv1b-13427-v4-uploader
Pipeline stage VLLMUploader completed in 624.35s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.24s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-bol-v1-opusdv1b-13427-v4
Waiting for inference service chaiml-bol-v1-opusdv1b-13427-v4 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission blend_litaf_2026-01-22: HTTPConnectionPool(host='guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-bol-v1-opusdv1b-13427-v4 ready after 452.5790128707886s
Pipeline stage VLLMDeployer completed in 453.12s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8727633953094482s
Received healthy response to inference request in 2.2524962425231934s
Received healthy response to inference request in 1.790229082107544s
Received healthy response to inference request in 1.8534164428710938s
Received healthy response to inference request in 1.89697265625s
Received healthy response to inference request in 1.8581702709197998s
Received healthy response to inference request in 1.806807279586792s
Received healthy response to inference request in 1.7946233749389648s
Received healthy response to inference request in 1.7551417350769043s
Received healthy response to inference request in 2.2446956634521484s
Received healthy response to inference request in 1.8940393924713135s
Received healthy response to inference request in 1.8132238388061523s
Received healthy response to inference request in 3.845961332321167s
Received healthy response to inference request in 1.7989304065704346s
Received healthy response to inference request in 1.7979726791381836s
Received healthy response to inference request in 2.9032464027404785s
Received healthy response to inference request in 1.7458992004394531s
Received healthy response to inference request in 2.1671974658966064s
Received healthy response to inference request in 2.055049180984497s
Received healthy response to inference request in 2.231454610824585s
Received healthy response to inference request in 1.8459703922271729s
Received healthy response to inference request in 2.139688014984131s
Received healthy response to inference request in 2.232069730758667s
Received healthy response to inference request in 1.8461825847625732s
Received healthy response to inference request in 2.493365526199341s
Received healthy response to inference request in 1.9557583332061768s
Received healthy response to inference request in 2.0440611839294434s
Received healthy response to inference request in 1.818373441696167s
Received healthy response to inference request in 2.114464521408081s
Received healthy response to inference request in 1.7848877906799316s
30 requests
0 failed requests
5th percentile: 1.7685274600982666
10th percentile: 1.7896949529647828
20th percentile: 1.7987388610839843
30th percentile: 1.8168285608291626
40th percentile: 1.8505228996276855
50th percentile: 1.8834013938903809
60th percentile: 1.9910794734954833
70th percentile: 2.122031569480896
80th percentile: 2.2315776348114014
90th percentile: 2.2765831708908086
95th percentile: 2.718800008296965
99th percentile: 3.572574002742768
mean time: 2.0551037391026816
Pipeline stage StressChecker completed in 65.49s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
chaiml-bol-v1-opusdv1b-_13427_v4 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2567.22s
Shutdown handler de-registered