chaiml-bol-v1-opusdv1b-_66571

developer_uid: zonemercy
submission_id: chaiml-bol-v1-opusdv1b-_66571_v2
model_name: chaiml-bol-v1-opusdv1b-_66571_v2
model_group: ChaiML/bol-v1-opusdv1b-l
status: torndown
timestamp: 2026-01-29T14:43:35+00:00
num_battles: 12162
num_wins: 6466
celo_rating: 1324.69
family_friendly_score: 0.5746
family_friendly_standard_error: 0.006991921624274688
submission_type: basic
model_repo: ChaiML/bol-v1-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: chaiml-prm-kimi-v1-300k_92220_v7
display_name: chaiml-bol-v1-opusdv1b-_66571_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/bol-v1-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-26
win_ratio: 0.5316559776352574
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|im_end|>', '</think>', '####', '<|user|>', '<|assistant|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-bol-v1-opusdv1b-66571-v2-uploader
Waiting for job on chaiml-bol-v1-opusdv1b-66571-v2-uploader to finish
chaiml-bol-v1-opusdv1b-66571-v2-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v1-opusdv1b-66571-v2-uploader: bash: no job control in this shell
chaiml-bol-v1-opusdv1b-66571-v2-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v1-opusdv1b-66571-v2-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  belonging to:                                                      ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v2-uploader: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-66571-v2-uploader: Downloaded to shared memory in 122.605s
chaiml-bol-v1-opusdv1b-66571-v2-uploader: Processed model ChaiML/bol-v1-opusdv1b-lr1e5ep2r64g4b01-int4-mixed in 186.619s
chaiml-bol-v1-opusdv1b-66571-v2-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v1-opusdv1b-66571-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v1-opusdv1b-66571-v2-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/added_tokens.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/.gitattributes
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/tokenizer_config.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/chat_template.jinja
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/special_tokens_map.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/generation_config.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/quantization_config.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/config.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/merges.txt
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/tokenizer.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/vocab.json
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model.safetensors.index.json
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00007-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00017-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00005-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00022-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00008-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00004-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00019-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00015-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00021-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00020-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00016-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00006-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00024-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00014-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00013-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00023-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00001-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00025-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00011-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00003-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00012-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v2-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v2/model-00018-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Job chaiml-bol-v1-opusdv1b-66571-v2-uploader completed after 640.65s with status: succeeded
Stopping job with name chaiml-bol-v1-opusdv1b-66571-v2-uploader
Pipeline stage VLLMUploader completed in 641.53s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.25s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-bol-v1-opusdv1b-66571-v2
Waiting for inference service chaiml-bol-v1-opusdv1b-66571-v2 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission blend_samot_2026-01-22: HTTPConnectionPool(host='guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-bol-v1-opusdv1b-66571-v2 ready after 441.24531173706055s
Pipeline stage VLLMDeployer completed in 441.57s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9385371208190918s
Received healthy response to inference request in 1.9590065479278564s
Received healthy response to inference request in 2.376290798187256s
Received healthy response to inference request in 1.7533283233642578s
Received healthy response to inference request in 1.7873759269714355s
Received healthy response to inference request in 1.7273130416870117s
Received healthy response to inference request in 1.7444074153900146s
Received healthy response to inference request in 1.8982398509979248s
Received healthy response to inference request in 2.2287721633911133s
Received healthy response to inference request in 1.9679691791534424s
Received healthy response to inference request in 1.8205459117889404s
Received healthy response to inference request in 1.8019959926605225s
Received healthy response to inference request in 2.0766146183013916s
Received healthy response to inference request in 1.9718639850616455s
Received healthy response to inference request in 1.7616534233093262s
Received healthy response to inference request in 2.4806787967681885s
Received healthy response to inference request in 2.4797520637512207s
Received healthy response to inference request in 2.2955756187438965s
Received healthy response to inference request in 1.7534620761871338s
Received healthy response to inference request in 2.427286386489868s
Received healthy response to inference request in 1.738654375076294s
Received healthy response to inference request in 2.6772048473358154s
Received healthy response to inference request in 1.993417501449585s
Received healthy response to inference request in 2.3390867710113525s
Received healthy response to inference request in 2.013418436050415s
Received healthy response to inference request in 2.1471917629241943s
Received healthy response to inference request in 2.201829433441162s
Received healthy response to inference request in 1.7589569091796875s
Received healthy response to inference request in 2.042874574661255s
Received healthy response to inference request in 1.9184701442718506s
30 requests
0 failed requests
5th percentile: 1.7412432432174683
10th percentile: 1.7524362325668335
20th percentile: 1.7611141204833984
30th percentile: 1.814980936050415
40th percentile: 1.9305103302001954
50th percentile: 1.969916582107544
60th percentile: 2.025200891494751
70th percentile: 2.1635830640792846
80th percentile: 2.304277849197388
90th percentile: 2.4325329542160037
95th percentile: 2.480261766910553
99th percentile: 2.6202122926712037
mean time: 2.0360591332117717
Pipeline stage StressChecker completed in 64.51s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-bol-v1-opusdv1b-_66571_v2 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 5349.03s
Shutdown handler de-registered
chaiml-bol-v1-opusdv1b-_66571_v2 status is now torndown due to DeploymentManager action