developer_uid: rirv938
submission_id: chaiml-reward-dpo-9974-_93951_v1
model_name: chaiml-reward-dpo-9974-_93951_v1
model_group: ChaiML/reward-dpo-9974-c
status: torndown
timestamp: 2026-01-31T23:18:34+00:00
num_battles: 14359
num_wins: 8050
celo_rating: 1338.29
family_friendly_score: 0.5509999999999999
family_friendly_standard_error: 0.007034187941759872
submission_type: basic
model_repo: ChaiML/reward-dpo-9974-chaiml-kimid-v9-opusdv_83165_v12-int4-mixed
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 4
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-reward-dpo-9974-_93951_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/reward-dpo-9974-chaiml-kimid-v9-opusdv_83165_v12-int4-mixed
model_size: 19B
ranking_group: single
us_pacific_date: 2026-01-28
win_ratio: 0.5606239988857162
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '<|assistant|>', '####', '</think>', '<|user|>', '</s>'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-reward-dpo-9974-93951-v1-uploader
Waiting for job on chaiml-reward-dpo-9974-93951-v1-uploader to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kimid-v9-opusdv-83165-v18-uploader
Waiting for job on chaiml-kimid-v9-opusdv-83165-v18-uploader to finish
chaiml-reward-dpo-9974-93951-v1-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-reward-dpo-9974-93951-v1-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-reward-dpo-9974-93951-v1-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-reward-dpo-9974-93951-v1-uploader: ║                                                                     ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-reward-dpo-9974-93951-v1-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-kimid-v9-opusdv-83165-v18-uploader:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-reward-dpo-9974-93951-v1-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-reward-dpo-9974-93951-v1-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║                                                                     ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║                                                                     ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  Version: 0.30.6+torch280                                           ║
chaiml-reward-dpo-9974-93951-v1-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-reward-dpo-9974-93951-v1-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  https://mk1.ai                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  The license key for the current software has been verified as      ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  belonging to:                                                      ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  Chai Research Corp.                                                ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ║                                                                     ║
chaiml-kimid-v9-opusdv-83165-v18-uploader: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-reward-dpo-9974-93951-v1-uploader: Downloaded to shared memory in 117.399s
chaiml-kimid-v9-opusdv-83165-v18-uploader: Downloaded to shared memory in 121.789s
chaiml-reward-dpo-9974-93951-v1-uploader: Processed model ChaiML/reward-dpo-9974-chaiml-kimid-v9-opusdv_83165_v12-int4-mixed in 174.747s
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/.gitattributes
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/generation_config.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/special_tokens_map.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/added_tokens.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/chat_template.jinja
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/quantization_config.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/config.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/tokenizer_config.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/vocab.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/merges.txt
chaiml-kimid-v9-opusdv-83165-v18-uploader: Processed model ChaiML/kimid-v9-opusdv1-lr5e6ep2r64g4b01-int4-mixed in 181.345s
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/tokenizer.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: creating bucket guanaco-vllm-models
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model.safetensors.index.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kimid-v9-opusdv-83165-v18-uploader: uploading /dev/shm/model_cache to s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/.gitattributes s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/.gitattributes
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/README.md s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/README.md
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/generation_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/generation_config.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/chat_template.jinja
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/tokenizer_config.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/special_tokens_map.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/added_tokens.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/merges.txt s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/merges.txt
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/quantization_config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/quantization_config.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/config.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/config.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/vocab.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/vocab.json
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/tokenizer.json
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00027-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00027-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00021-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00008-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00004-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00018-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00019-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00025-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00007-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00020-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00013-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00017-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00016-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00015-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00023-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00015-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00001-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00003-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00026-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00006-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00002-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00011-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00019-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00023-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00004-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00005-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00002-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00008-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00021-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00011-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00001-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00012-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00018-of-00027.safetensors
chaiml-reward-dpo-9974-93951-v1-uploader: cp /dev/shm/model_cache/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-reward-dpo-9974-93951-v1/model-00009-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00007-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00016-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00010-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00024-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00014-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00012-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00005-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00006-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00022-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00017-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00003-of-00027.safetensors
chaiml-kimid-v9-opusdv-83165-v18-uploader: cp /dev/shm/model_cache/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-kimid-v9-opusdv-83165-v18/model-00025-of-00027.safetensors
Job chaiml-reward-dpo-9974-93951-v1-uploader completed after 542.82s with status: succeeded
Stopping job with name chaiml-reward-dpo-9974-93951-v1-uploader
Pipeline stage VLLMUploader completed in 544.18s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.35s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-reward-dpo-9974-93951-v1
Waiting for inference service chaiml-reward-dpo-9974-93951-v1 to be ready
Job chaiml-kimid-v9-opusdv-83165-v18-uploader completed after 553.63s with status: succeeded
Stopping job with name chaiml-kimid-v9-opusdv-83165-v18-uploader
Pipeline stage VLLMUploader completed in 554.95s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.37s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kimid-v9-opusdv-83165-v18
Waiting for inference service chaiml-kimid-v9-opusdv-83165-v18 to be ready
Inference service chaiml-reward-dpo-9974-93951-v1 ready after 537.2672734260559s
Pipeline stage VLLMDeployer completed in 538.70s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3809735774993896s
Received healthy response to inference request in 2.912872314453125s
Received healthy response to inference request in 2.6710355281829834s
Received healthy response to inference request in 2.2821667194366455s
Received healthy response to inference request in 2.6164450645446777s
Received healthy response to inference request in 3.1730427742004395s
Received healthy response to inference request in 2.366715431213379s
Received healthy response to inference request in 2.2423455715179443s
Received healthy response to inference request in 2.490765333175659s
Received healthy response to inference request in 2.4435575008392334s
Received healthy response to inference request in 2.353994369506836s
Received healthy response to inference request in 2.352816343307495s
Received healthy response to inference request in 2.381748676300049s
Received healthy response to inference request in 2.521620750427246s
Received healthy response to inference request in 2.4248945713043213s
Received healthy response to inference request in 2.7003867626190186s
Received healthy response to inference request in 7.317824363708496s
Received healthy response to inference request in 2.314748764038086s
Received healthy response to inference request in 2.3506226539611816s
Inference service chaiml-kimid-v9-opusdv-83165-v18 ready after 589.0568408966064s
Received healthy response to inference request in 2.2297415733337402s
Pipeline stage VLLMDeployer completed in 590.47s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.9528322219848633s
Received healthy response to inference request in 2.5821890830993652s
Received healthy response to inference request in 2.551558494567871s
Received healthy response to inference request in 2.1529183387756348s
Received healthy response to inference request in 2.2054009437561035s
Received healthy response to inference request in 2.095733642578125s
Received healthy response to inference request in 2.1079959869384766s
Received healthy response to inference request in 2.5069165229797363s
Received healthy response to inference request in 2.431014060974121s
Received healthy response to inference request in 2.1494452953338623s
Received healthy response to inference request in 2.3041062355041504s
Received healthy response to inference request in 2.1672098636627197s
Received healthy response to inference request in 2.202632188796997s
Received healthy response to inference request in 2.266322135925293s
Received healthy response to inference request in 2.0125739574432373s
Received healthy response to inference request in 2.3597049713134766s
Received healthy response to inference request in 2.3235676288604736s
Received healthy response to inference request in 2.105581760406494s
Received healthy response to inference request in 2.1784605979919434s
30 requests
0 failed requests
Received healthy response to inference request in 2.454911708831787s
5th percentile: 2.1397050619125366
10th percentile: 2.2002150297164915
20th percentile: 2.2398247718811035
30th percentile: 2.311556005477905
40th percentile: 2.3519388675689696
50th percentile: 2.374232053756714
60th percentile: 2.436031436920166
70th percentile: 2.5306020736694337
80th percentile: 2.6769057750701903
90th percentile: 2.9748532772064213
95th percentile: 3.2874047160148616
Received healthy response to inference request in 2.2883236408233643s
99th percentile: 6.176137635707859
mean time: 2.626615365346273
Pipeline stage StressChecker completed in 93.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 2.3571035861968994s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.91s
Shutdown handler de-registered
chaiml-reward-dpo-9974-_93951_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2954.05s
Shutdown handler de-registered
chaiml-reward-dpo-9974-_93951_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-reward-dpo-9974-_93951_v1 status is now torndown due to DeploymentManager action
HTTP Request: %s %s "%s %d %s"