chaiml-bol-v2-opusdv1b-_74531

developer_uid: zonemercy
submission_id: chaiml-bol-v2-opusdv1b-_74531_v1
model_name: chaiml-bol-v2-opusdv1b-_74531_v1
model_group: ChaiML/bol-v2-opusdv1b-l
status: torndown
timestamp: 2026-01-30T05:11:00+00:00
num_battles: 10874
num_wins: 5767
celo_rating: 1322.63
family_friendly_score: 0.573
family_friendly_standard_error: 0.006995298421082549
submission_type: basic
model_repo: ChaiML/bol-v2-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 72
reward_model: chaiml-prm-kimi-v1-300k_92220_v7
display_name: chaiml-bol-v2-opusdv1b-_74531_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/bol-v2-opusdv1b-lr1e5ep2r64g4b01-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-26
win_ratio: 0.5303476181717859
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '</think>', '</s>', '<|im_end|>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 72}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-bol-v2-opusdv1b-74531-v1-uploader
Waiting for job on chaiml-bol-v2-opusdv1b-74531-v1-uploader to finish
chaiml-bol-v2-opusdv1b-74531-v1-uploader: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-bol-v2-opusdv1b-74531-v1-uploader: bash: no job control in this shell
chaiml-bol-v2-opusdv1b-74531-v1-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-bol-v2-opusdv1b-74531-v1-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║                                                                     ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║                                                                     ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  https://mk1.ai                                                     ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║                                                                     ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  The license key for the current software has been verified as      ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  belonging to:                                                      ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║                                                                     ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  Chai Research Corp.                                                ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ║                                                                     ║
chaiml-bol-v2-opusdv1b-74531-v1-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-bol-v2-opusdv1b-74531-v1-uploader: Downloaded to shared memory in 122.781s
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v2-opusdv1b-74531-v1-uploader: Processed model ChaiML/bol-v2-opusdv1b-lr1e5ep2r64g4b01-int4-mixed in 188.314s
chaiml-bol-v2-opusdv1b-74531-v1-uploader: creating bucket guanaco-vllm-models
chaiml-bol-v2-opusdv1b-74531-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-bol-v2-opusdv1b-74531-v1-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/added_tokens.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/.gitattributes
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/generation_config.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/chat_template.jinja
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/special_tokens_map.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/tokenizer_config.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/config.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/quantization_config.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/vocab.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/tokenizer.json
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/merges.txt
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model.safetensors.index.json
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00027-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00016-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00007-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00014-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00009-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00019-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00013-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00026-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00012-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00025-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00018-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00005-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00001-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00008-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00017-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00002-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00010-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00023-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00015-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00020-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00022-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00021-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00004-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00003-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00006-of-00027.safetensors
chaiml-bol-v2-opusdv1b-74531-v1-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-bol-v2-opusdv1b-74531-v1/model-00011-of-00027.safetensors
Job chaiml-bol-v2-opusdv1b-74531-v1-uploader completed after 1420.1s with status: succeeded
Stopping job with name chaiml-bol-v2-opusdv1b-74531-v1-uploader
Pipeline stage VLLMUploader completed in 1420.48s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-bol-v2-opusdv1b-74531-v1
Waiting for inference service chaiml-bol-v2-opusdv1b-74531-v1 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-bol-v2-opusdv1b-74531-v1 ready after 430.2746036052704s
Pipeline stage VLLMDeployer completed in 430.63s
run pipeline stage %s
Running pipeline stage StressChecker
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
HTTP Request: %s %s "%s %d %s"
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-prm-kimi-v1-300k-92220-v7-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 11.819348573684692s
Received healthy response to inference request in 1.721459150314331s
Received healthy response to inference request in 1.7630000114440918s
Received healthy response to inference request in 1.7534847259521484s
Received healthy response to inference request in 1.9039218425750732s
Received healthy response to inference request in 1.9202072620391846s
Received healthy response to inference request in 1.7431418895721436s
Received healthy response to inference request in 1.8122215270996094s
Received healthy response to inference request in 1.7607800960540771s
Received healthy response to inference request in 1.7779548168182373s
30 requests
20 failed requests
5th percentile: 1.7477961659431458
10th percentile: 1.7600505590438842
20th percentile: 1.805368185043335
30th percentile: 8.849606180191033
40th percentile: 13.845141077041626
50th percentile: 13.863548755645752
60th percentile: 13.873271131515503
70th percentile: 13.891377472877503
80th percentile: 13.916322231292725
90th percentile: 13.989450526237487
95th percentile: 14.023169291019439
99th percentile: 14.085641057491303
mean time: 10.20444570382436
%s, retrying in %s seconds...
Received healthy response to inference request in 1.7717154026031494s
Received healthy response to inference request in 1.7553317546844482s
Received healthy response to inference request in 1.7580533027648926s
Received healthy response to inference request in 1.7462561130523682s
Received healthy response to inference request in 1.7550430297851562s
Received healthy response to inference request in 1.750192642211914s
Received healthy response to inference request in 1.7464690208435059s
Received healthy response to inference request in 1.7929062843322754s
Received healthy response to inference request in 1.7123324871063232s
Received healthy response to inference request in 1.7704384326934814s
Received healthy response to inference request in 1.6901493072509766s
Received healthy response to inference request in 1.7507359981536865s
Received healthy response to inference request in 1.986548900604248s
Received healthy response to inference request in 1.7744824886322021s
Received healthy response to inference request in 2.0230185985565186s
Received healthy response to inference request in 1.762505054473877s
Received healthy response to inference request in 1.7704427242279053s
Received healthy response to inference request in 1.7481396198272705s
Received healthy response to inference request in 1.7600843906402588s
Received healthy response to inference request in 1.7473785877227783s
Received healthy response to inference request in 1.7520849704742432s
Received healthy response to inference request in 1.7501425743103027s
Received healthy response to inference request in 1.6917533874511719s
Received healthy response to inference request in 1.7494969367980957s
Received healthy response to inference request in 1.6801602840423584s
Received healthy response to inference request in 1.7867884635925293s
Received healthy response to inference request in 1.8529620170593262s
Received healthy response to inference request in 1.7739768028259277s
Received healthy response to inference request in 1.7205746173858643s
Received healthy response to inference request in 2.211216688156128s
30 requests
0 failed requests
5th percentile: 1.6908711433410644
10th percentile: 1.710274577140808
20th percentile: 1.7464264392852784
30th percentile: 1.749089741706848
40th percentile: 1.7505186557769776
50th percentile: 1.7551873922348022
60th percentile: 1.761052656173706
70th percentile: 1.7708245277404786
80th percentile: 1.7769436836242676
90th percentile: 1.8663207054138184
95th percentile: 2.006607234477997
99th percentile: 2.1566392421722416
mean time: 1.7847126960754394
Pipeline stage StressChecker completed in 365.37s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.74s
Shutdown handler de-registered
chaiml-bol-v2-opusdv1b-_74531_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 5512.02s
Shutdown handler de-registered
chaiml-bol-v2-opusdv1b-_74531_v1 status is now torndown due to DeploymentManager action