chaiml-bol-v1-opusdv1b-_66571

developer_uid: zonemercy
submission_id: chaiml-bol-v1-opusdv1b-_66571_v3
model_name: chaiml-bol-v1-opusdv1b-_66571_v3
model_group: ChaiML/bol-v1-opusdv1b-l
status: torndown
timestamp: 2026-01-30T05:11:00+00:00
num_battles: 12015
num_wins: 6361
celo_rating: 1324.5
family_friendly_score: 0.5762
family_friendly_standard_error: 0.006988469932681975
submission_type: basic
model_repo: ChaiML/bol-v1-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: chaiml-prm-kimi-v1-300k_92220_v7
display_name: chaiml-bol-v1-opusdv1b-_66571_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/bol-v1-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-26
win_ratio: 0.5294215563878485
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####', '</think>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-bol-v1-opusdv1b-66571-v3-uploader
Waiting for job on chaiml-bol-v1-opusdv1b-66571-v3-uploader to finish
chaiml-bol-v1-opusdv1b-66571-v3-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v1-opusdv1b-66571-v3-uploader: bash: no job control in this shell
chaiml-bol-v1-opusdv1b-66571-v3-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v1-opusdv1b-66571-v3-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  belonging to:                                                      ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ║                                                                     ║
chaiml-bol-v1-opusdv1b-66571-v3-uploader: ╚═════════════════════════════════════════════════════════════════════╝
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-66571-v3-uploader: Downloaded to shared memory in 153.924s
chaiml-bol-v1-opusdv1b-66571-v3-uploader: Processed model ChaiML/bol-v1-opusdv1b-lr1e5ep2r64g4b01-int4-mixed in 219.274s
chaiml-bol-v1-opusdv1b-66571-v3-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v1-opusdv1b-66571-v3-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v1-opusdv1b-66571-v3-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/added_tokens.json
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/chat_template.jinja
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/generation_config.json
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/special_tokens_map.json
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/tokenizer_config.json
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/.gitattributes
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/quantization_config.json
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/config.json
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/merges.txt
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model.safetensors.index.json
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/tokenizer.json
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission blend_litaf_2026-01-22: HTTPConnectionPool(host='guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00026-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00022-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00012-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00008-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00003-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00014-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00009-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00006-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00001-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00005-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00023-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00024-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00017-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00016-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00002-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00018-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00004-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00010-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00019-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00013-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00025-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00020-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00015-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00011-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00007-of-00027.safetensors
chaiml-bol-v1-opusdv1b-66571-v3-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v1-opusdv1b-66571-v3/model-00021-of-00027.safetensors
Job chaiml-bol-v1-opusdv1b-66571-v3-uploader completed after 1427.68s with status: succeeded
Stopping job with name chaiml-bol-v1-opusdv1b-66571-v3-uploader
Pipeline stage VLLMUploader completed in 1428.08s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-bol-v1-opusdv1b-66571-v3
Waiting for inference service chaiml-bol-v1-opusdv1b-66571-v3 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-bol-v1-opusdv1b-66571-v3 ready after 430.7562777996063s
Pipeline stage VLLMDeployer completed in 431.14s
run pipeline stage %s
Running pipeline stage StressChecker
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
HTTP Request: %s %s "%s %d %s"
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 6.899458169937134s
Received healthy response to inference request in 1.7639694213867188s
Received healthy response to inference request in 2.049288272857666s
Received healthy response to inference request in 1.7903578281402588s
Received healthy response to inference request in 1.702930212020874s
Received healthy response to inference request in 2.0579423904418945s
Received healthy response to inference request in 1.770036220550537s
Received healthy response to inference request in 1.7848389148712158s
Received healthy response to inference request in 1.792043685913086s
Received healthy response to inference request in 1.7447724342346191s
30 requests
20 failed requests
5th percentile: 1.7534110784530639
10th percentile: 1.7694295406341554
20th percentile: 1.7917065143585205
30th percentile: 5.447003436088559
40th percentile: 13.841246366500854
50th percentile: 13.864385485649109
60th percentile: 13.879739713668823
70th percentile: 13.910917735099792
80th percentile: 13.984293746948243
90th percentile: 14.080635952949525
95th percentile: 14.149968087673187
99th percentile: 14.37941717863083
mean time: 10.084310833613078
%s, retrying in %s seconds...
Received healthy response to inference request in 1.7433428764343262s
Received healthy response to inference request in 1.7664265632629395s
Received healthy response to inference request in 1.7294375896453857s
Received healthy response to inference request in 1.7775802612304688s
Received healthy response to inference request in 1.7628228664398193s
Received healthy response to inference request in 2.0145890712738037s
Received healthy response to inference request in 1.7860090732574463s
Received healthy response to inference request in 1.7656588554382324s
Received healthy response to inference request in 1.78059983253479s
Received healthy response to inference request in 1.7203936576843262s
Received healthy response to inference request in 1.841752529144287s
Received healthy response to inference request in 1.7935383319854736s
Received healthy response to inference request in 1.803842306137085s
Received healthy response to inference request in 1.7905278205871582s
Received healthy response to inference request in 1.7729053497314453s
Received healthy response to inference request in 1.9922544956207275s
Received healthy response to inference request in 1.7770955562591553s
Received healthy response to inference request in 1.7381303310394287s
Received healthy response to inference request in 1.9831223487854004s
Received healthy response to inference request in 1.732802152633667s
Received healthy response to inference request in 1.7485458850860596s
Received healthy response to inference request in 1.7408158779144287s
Received healthy response to inference request in 1.7460625171661377s
Received healthy response to inference request in 1.9872448444366455s
Received healthy response to inference request in 1.7586150169372559s
Received healthy response to inference request in 1.8259458541870117s
Received healthy response to inference request in 1.8307034969329834s
Received healthy response to inference request in 1.7576332092285156s
Received healthy response to inference request in 1.7780194282531738s
Received healthy response to inference request in 1.7679970264434814s
30 requests
0 failed requests
5th percentile: 1.7309516429901124
10th percentile: 1.7375975131988526
20th percentile: 1.7455185890197753
30th percentile: 1.7583204746246337
40th percentile: 1.7661194801330566
50th percentile: 1.7750004529953003
60th percentile: 1.7790515899658204
70th percentile: 1.7914309740066527
80th percentile: 1.826897382736206
90th percentile: 1.9835345983505248
95th percentile: 1.9900001525878905
99th percentile: 2.008112044334412
mean time: 1.8004805008570353
Pipeline stage StressChecker completed in 361.73s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.75s
Shutdown handler de-registered
chaiml-bol-v1-opusdv1b-_66571_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 5613.33s
Shutdown handler de-registered
chaiml-bol-v1-opusdv1b-_66571_v3 status is now torndown due to DeploymentManager action