chaiml-mistral-24b-2048-1_404

developer_uid: rirv938
submission_id: chaiml-mistral-24b-2048-1_404_v2
model_name: chaiml-mistral-24b-2048-1_404_v2
model_group: ChaiML/mistral_24b_2048_
status: inactive
timestamp: 2026-02-14T22:17:08+00:00
num_battles: 12482
num_wins: 6705
celo_rating: 1324.98
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-mistral-24b-2048-1_404_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-14
win_ratio: 0.5371735298830316
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['###', '<|im_start|>', '<|im_end|>', 'You:', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '[SYSTEM_PROMPT]Respond as a high quality storyteller.[/SYSTEM_PROMPT][INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-1-404-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-1-404-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-72304-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-72304-v2-mkmlizer to finish
chaiml-mistral-24b-204-54327-v11-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-204-54327-v11-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-204-54327-v11-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-204-54327-v11-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-204-54327-v11-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-204-54327-v11-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-90555-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-37531-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-72304-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-90555-v2-mkmlizer: Downloaded to shared memory in 85.766s
chaiml-mistral-24b-2048-90555-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_instruct_v2_merged already exists in ChaiML
chaiml-mistral-24b-2048-90555-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpox34mag1, device:0
chaiml-mistral-24b-2048-90555-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-204-54327-v11-mkmlizer: Downloaded to shared memory in 91.640s
chaiml-mistral-24b-204-54327-v11-mkmlizer: Checking if ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged already exists in ChaiML
chaiml-mistral-24b-204-54327-v11-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp7_oekwop, device:0
chaiml-mistral-24b-204-54327-v11-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: Downloaded to shared memory in 85.570s
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged already exists in ChaiML
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp0i2gg9s3, device:0
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-37531-v2-mkmlizer: Downloaded to shared memory in 90.028s
chaiml-mistral-24b-2048-37531-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_instruct_v2_merged already exists in ChaiML
chaiml-mistral-24b-2048-37531-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpt7qkm825, device:0
chaiml-mistral-24b-2048-37531-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-72304-v2-mkmlizer: Downloaded to shared memory in 84.110s
chaiml-mistral-24b-2048-72304-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_2472_instruct_v2_merged already exists in ChaiML
chaiml-mistral-24b-2048-72304-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp9wag047i, device:0
chaiml-mistral-24b-2048-72304-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-90555-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:56, 1.52it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:56, 1.52it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:23, 1.07s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:23, 1.07s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:12, 1.38s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:12, 1.38s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:40, 2.18it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:40, 2.18it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:49, 1.53it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:49, 1.53it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:59, 1.17it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:59, 1.17it/s]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:14, 1.08s/it]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:14, 1.08s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:43, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:43, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:43, 1.15it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:43, 1.15it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:16, 1.26it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:16, 1.26it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:09, 1.04it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:09, 1.04it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:10, 1.15s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:10, 1.15s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:32, 2.06it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:32, 2.06it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:05, 1.25it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:05, 1.25it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:56, 1.03it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:56, 1.03it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:53, 1.16s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:53, 1.16s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:24, 2.05it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:24, 2.05it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.79it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.79it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:27, 1.41it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:27, 1.41it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:20, 1.12it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:20, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:51, 1.24it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:51, 1.24it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:38, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:38, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:32, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:32, 1.16s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:15, 2.05it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:15, 2.05it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:32, 1.80it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:32, 1.80it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:13, 1.41it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:13, 1.41it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:03, 1.12it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:03, 1.12it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:57, 2.26it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:57, 2.26it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:12, 1.98it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:12, 1.98it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:49, 1.14s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:49, 1.14s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:53, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:53, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:24<04:34, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:24<04:34, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:18, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:18, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 2.00it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 2.00it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:30, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:30, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:40<01:48, 2.06it/s]
Loading 0:  38%|███▊      | 139/363 [01:40<01:48, 2.06it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:35, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:35, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:14, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:14, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:52, 1.25it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:52, 1.25it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:27, 1.03it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:27, 1.03it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:07, 1.16s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:07, 1.16s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.06it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.06it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.25it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.25it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:46, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:46, 1.16s/it]
Loading 0:  48%|████▊     | 175/363 [02:07<01:31, 2.06it/s]
Loading 0:  48%|████▊     | 175/363 [02:07<01:31, 2.06it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:09, 1.42it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:09, 1.42it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:42, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:42, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:23, 1.25it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:23, 1.25it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:19<03:25, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:19<03:25, 1.15s/it]
Loading 0:  53%|█████▎    | 192/363 [02:20<01:27, 1.96it/s]
Loading 0:  53%|█████▎    | 192/363 [02:20<01:27, 1.96it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:55, 1.44it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:55, 1.44it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:24, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:24, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:07, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:07, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 210/363 [02:33<01:17, 1.97it/s]
Loading 0:  58%|█████▊    | 210/363 [02:33<01:17, 1.97it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:42, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:42, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:08, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:08, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:45<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:45<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 228/363 [02:46<01:09, 1.96it/s]
Loading 0:  63%|██████▎   | 228/363 [02:46<01:09, 1.96it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 233/363 [02:51<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 233/363 [02:51<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 234/363 [02:53<01:52, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:53<01:52, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:55<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:55<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:57<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:57<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:59<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [02:59<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 247/363 [03:00<00:55, 2.07it/s]
Loading 0:  68%|██████▊   | 247/363 [03:00<00:55, 2.07it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.42it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.42it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:38, 1.13it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:38, 1.13it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:26, 1.25it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:26, 1.25it/s]
Loading 0:  71%|███████   | 256/363 [03:10<01:43, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:10<01:43, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:12<02:02, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:12<02:02, 1.15s/it]
Loading 0:  73%|███████▎  | 264/363 [03:13<00:50, 1.96it/s]
Loading 0:  73%|███████▎  | 264/363 [03:13<00:50, 1.96it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:52, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:52, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:35<03:42, 2.47s/it]
Loading 0:  75%|███████▌  | 273/363 [03:35<03:42, 2.47s/it]
Loading 0:  75%|███████▌  | 274/363 [03:37<03:33, 2.39s/it]
Loading 0:  75%|███████▌  | 274/363 [03:37<03:33, 2.39s/it]
Loading 0:  76%|███████▌  | 275/363 [03:39<03:26, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:39<03:26, 2.35s/it]
Loading 0:  78%|███████▊  | 283/363 [03:40<01:10, 1.13it/s]
Loading 0:  78%|███████▊  | 283/363 [03:40<01:10, 1.13it/s]
Loading 0:  79%|███████▉  | 286/363 [03:42<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:42<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:44<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:44<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:46<01:22, 1.10s/it]
Loading 0:  79%|███████▉  | 288/363 [03:46<01:22, 1.10s/it]
Loading 0:  80%|████████  | 291/363 [03:48<01:07, 1.07it/s]
Loading 0:  80%|████████  | 291/363 [03:48<01:07, 1.07it/s]
Loading 0:  80%|████████  | 292/363 [03:50<01:17, 1.09s/it]
Loading 0:  80%|████████  | 292/363 [03:50<01:17, 1.09s/it]
Loading 0:  81%|████████  | 293/363 [03:52<01:28, 1.26s/it]
Loading 0:  81%|████████  | 293/363 [03:52<01:28, 1.26s/it]
Loading 0:  83%|████████▎ | 301/363 [03:53<00:31, 1.95it/s]
Loading 0:  83%|████████▎ | 301/363 [03:53<00:31, 1.95it/s]
Loading 0:  84%|████████▎ | 304/363 [03:56<00:33, 1.76it/s]
Loading 0:  84%|████████▎ | 304/363 [03:56<00:33, 1.76it/s]
Loading 0:  84%|████████▍ | 305/363 [03:58<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 305/363 [03:58<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 306/363 [04:00<00:50, 1.13it/s]
Loading 0:  84%|████████▍ | 306/363 [04:00<00:50, 1.13it/s]
Loading 0:  85%|████████▌ | 309/363 [04:01<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [04:01<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:03<00:51, 1.03it/s]
Loading 0:  85%|████████▌ | 310/363 [04:03<00:51, 1.03it/s]
Loading 0:  86%|████████▌ | 311/363 [04:05<01:00, 1.17s/it]
Loading 0:  86%|████████▌ | 311/363 [04:05<01:00, 1.17s/it]
Loading 0:  88%|████████▊ | 319/363 [04:07<00:21, 2.08it/s]
Loading 0:  88%|████████▊ | 319/363 [04:07<00:21, 2.08it/s]
Loading 0:  89%|████████▊ | 322/363 [04:09<00:22, 1.81it/s]
Loading 0:  89%|████████▊ | 322/363 [04:09<00:22, 1.81it/s]
Loading 0:  89%|████████▉ | 323/363 [04:11<00:28, 1.41it/s]
Loading 0:  89%|████████▉ | 323/363 [04:11<00:28, 1.41it/s]
Loading 0:  89%|████████▉ | 324/363 [04:13<00:34, 1.12it/s]
Loading 0:  89%|████████▉ | 324/363 [04:13<00:34, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:15<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 327/363 [04:15<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 328/363 [04:17<00:34, 1.02it/s]
Loading 0:  90%|█████████ | 328/363 [04:17<00:34, 1.02it/s]
Loading 0:  91%|█████████ | 329/363 [04:19<00:39, 1.17s/it]
Loading 0:  91%|█████████ | 329/363 [04:19<00:39, 1.17s/it]
Loading 0:  93%|█████████▎| 337/363 [04:20<00:12, 2.08it/s]
Loading 0:  93%|█████████▎| 337/363 [04:20<00:12, 2.08it/s]
Loading 0:  94%|█████████▎| 340/363 [04:22<00:12, 1.80it/s]
Loading 0:  94%|█████████▎| 340/363 [04:22<00:12, 1.80it/s]
Loading 0:  94%|█████████▍| 341/363 [04:24<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 341/363 [04:24<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 342/363 [04:26<00:18, 1.12it/s]
Loading 0:  94%|█████████▍| 342/363 [04:26<00:18, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 346/363 [04:30<00:16, 1.02it/s]
Loading 0:  95%|█████████▌| 346/363 [04:30<00:16, 1.02it/s]
Loading 0:  96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0:  96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0:  98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0:  98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0:  99%|█████████▉| 359/363 [04:36<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 359/363 [04:36<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 360/363 [04:38<00:02, 1.46it/s]
Loading 0:  99%|█████████▉| 360/363 [04:38<00:02, 1.46it/s]
Loading 0:  99%|█████████▉| 361/363 [04:40<00:01, 1.16it/s]
Loading 0:  99%|█████████▉| 361/363 [04:40<00:01, 1.16it/s]
Loading 0: 100%|██████████| 363/363 [04:40<00:00, 1.16it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:40<00:00, 1.29it/s]
chaiml-mistral-24b-2048-90555-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-90555-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-90555-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-90555-v2/nvidia
chaiml-mistral-24b-2048-90555-v2-mkmlizer: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-mkml-models/chaiml-mistral-24b-2048-90555-v2/nvidia/chat_template.jinja
chaiml-mistral-24b-2048-90555-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-90555-v2/nvidia/config.json
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:19, 1.39it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:19, 1.39it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:07, 1.19s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:07, 1.19s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:44, 1.47s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:44, 1.47s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:02, 1.93it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:02, 1.93it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:51, 1.51it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:51, 1.51it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:00, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:00, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:15, 1.08s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:15, 1.08s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:47, 1.50it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:47, 1.50it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:42, 1.21it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:42, 1.21it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:45, 1.02s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:45, 1.02s/it]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:35, 2.14it/s]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:35, 2.14it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:58, 1.85it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:58, 1.85it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:46, 1.45it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:46, 1.45it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:46, 1.14it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:46, 1.14it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:16, 1.26it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:16, 1.26it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:10, 1.04it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:10, 1.04it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:10, 1.15s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:10, 1.15s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.07it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.07it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:05, 1.25it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:05, 1.25it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:56, 1.03it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:56, 1.03it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:53, 1.16s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:53, 1.16s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:47<02:32, 1.95it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:47<02:32, 1.95it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:50<02:41, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:50<02:41, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:52<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:52<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:54<04:17, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:54<04:17, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:56<03:50, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:56<03:50, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [00:58<04:37, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [00:58<04:37, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [01:00<05:30, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [01:00<05:30, 1.16s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:01<02:23, 1.95it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:01<02:23, 1.95it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:31, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:31, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<04:00, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<04:00, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.27it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.27it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 1.99it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 1.99it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  29%|██▉       | 106/363 [01:17<03:21, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:17<03:21, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.05it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.05it/s]
Loading 0:  30%|██▉       | 108/363 [01:21<04:50, 1.14s/it]
Loading 0:  30%|██▉       | 108/363 [01:21<04:50, 1.14s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:54, 1.07it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:54, 1.07it/s]
Loading 0:  31%|███       | 112/363 [01:24<04:35, 1.10s/it]
Loading 0:  31%|███       | 112/363 [01:24<04:35, 1.10s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:21, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:21, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:28<02:01, 1.99it/s]
Loading 0:  33%|███▎      | 121/363 [01:28<02:01, 1.99it/s]
Loading 0:  34%|███▍      | 124/363 [01:30<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:30<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:32<02:52, 1.38it/s]
Loading 0:  34%|███▍      | 125/363 [01:32<02:52, 1.38it/s]
Loading 0:  35%|███▍      | 126/363 [01:34<03:35, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:34<03:35, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:36<03:09, 1.23it/s]
Loading 0:  36%|███▌      | 129/363 [01:36<03:09, 1.23it/s]
Loading 0:  36%|███▌      | 130/363 [01:38<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:38<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:40<04:32, 1.17s/it]
Loading 0:  36%|███▌      | 131/363 [01:40<04:32, 1.17s/it]
Loading 0:  38%|███▊      | 139/363 [01:41<01:49, 2.04it/s]
Loading 0:  38%|███▊      | 139/363 [01:41<01:49, 2.04it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:03, 1.79it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:03, 1.79it/s]
Loading 0:  39%|███▉      | 143/363 [01:45<02:36, 1.40it/s]
Loading 0:  39%|███▉      | 143/363 [01:45<02:36, 1.40it/s]
Loading 0:  40%|███▉      | 144/363 [01:47<03:15, 1.12it/s]
Loading 0:  40%|███▉      | 144/363 [01:47<03:15, 1.12it/s]
Loading 0:  40%|████      | 147/363 [01:49<02:53, 1.24it/s]
Loading 0:  40%|████      | 147/363 [01:49<02:53, 1.24it/s]
Loading 0:  41%|████      | 148/363 [01:51<03:29, 1.03it/s]
Loading 0:  41%|████      | 148/363 [01:51<03:29, 1.03it/s]
Loading 0:  41%|████      | 149/363 [01:53<04:10, 1.17s/it]
Loading 0:  41%|████      | 149/363 [01:53<04:10, 1.17s/it]
Loading 0:  43%|████▎     | 156/363 [01:54<01:46, 1.94it/s]
Loading 0:  43%|████▎     | 156/363 [01:54<01:46, 1.94it/s]
Loading 0:  44%|████▍     | 160/363 [01:57<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:57<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:59<02:22, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:59<02:22, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [02:01<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [02:01<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:03<02:38, 1.25it/s]
Loading 0:  45%|████▌     | 165/363 [02:03<02:38, 1.25it/s]
Loading 0:  46%|████▌     | 166/363 [02:05<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 166/363 [02:05<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 167/363 [02:07<03:46, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:07<03:46, 1.16s/it]
Loading 0:  48%|████▊     | 174/363 [02:08<01:36, 1.95it/s]
Loading 0:  48%|████▊     | 174/363 [02:08<01:36, 1.95it/s]
Loading 0:  49%|████▉     | 178/363 [02:10<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 178/363 [02:10<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 179/363 [02:12<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:12<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:14<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:14<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:16<02:23, 1.25it/s]
Loading 0:  50%|█████     | 183/363 [02:16<02:23, 1.25it/s]
Loading 0:  51%|█████     | 184/363 [02:18<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:18<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:20<03:25, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:20<03:25, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:21<01:22, 2.05it/s]
Loading 0:  53%|█████▎    | 193/363 [02:21<01:22, 2.05it/s]
Loading 0:  54%|█████▍    | 196/363 [02:24<01:32, 1.80it/s]
Loading 0:  54%|█████▍    | 196/363 [02:24<01:32, 1.80it/s]
Loading 0:  54%|█████▍    | 197/363 [02:25<01:57, 1.41it/s]
Loading 0:  54%|█████▍    | 197/363 [02:25<01:57, 1.41it/s]
Loading 0:  55%|█████▍    | 198/363 [02:28<02:27, 1.12it/s]
Loading 0:  55%|█████▍    | 198/363 [02:28<02:27, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:29<02:10, 1.25it/s]
Loading 0:  55%|█████▌    | 201/363 [02:29<02:10, 1.25it/s]
Loading 0:  56%|█████▌    | 202/363 [02:31<02:36, 1.03it/s]
Loading 0:  56%|█████▌    | 202/363 [02:31<02:36, 1.03it/s]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:06, 1.17s/it]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:06, 1.17s/it]
Loading 0:  58%|█████▊    | 210/363 [02:34<01:18, 1.94it/s]
Loading 0:  58%|█████▊    | 210/363 [02:34<01:18, 1.94it/s]
Loading 0:  59%|█████▉    | 214/363 [02:37<01:22, 1.81it/s]
Loading 0:  59%|█████▉    | 214/363 [02:37<01:22, 1.81it/s]
Loading 0:  59%|█████▉    | 215/363 [02:39<01:44, 1.42it/s]
Loading 0:  59%|█████▉    | 215/363 [02:39<01:44, 1.42it/s]
Loading 0:  60%|█████▉    | 216/363 [02:41<02:09, 1.13it/s]
Loading 0:  60%|█████▉    | 216/363 [02:41<02:09, 1.13it/s]
Loading 0:  60%|██████    | 219/363 [02:43<01:54, 1.25it/s]
Loading 0:  60%|██████    | 219/363 [02:43<01:54, 1.25it/s]
Loading 0:  61%|██████    | 220/363 [02:45<02:18, 1.03it/s]
Loading 0:  61%|██████    | 220/363 [02:45<02:18, 1.03it/s]
Loading 0:  61%|██████    | 221/363 [02:47<02:44, 1.16s/it]
Loading 0:  61%|██████    | 221/363 [02:47<02:44, 1.16s/it]
Loading 0:  63%|██████▎   | 228/363 [02:48<01:09, 1.95it/s]
Loading 0:  63%|██████▎   | 228/363 [02:48<01:09, 1.95it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:54, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:54, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:40, 1.25it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:40, 1.25it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:00, 1.03it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:00, 1.03it/s]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:23, 1.16s/it]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:23, 1.16s/it]
Loading 0:  68%|██████▊   | 246/363 [03:01<00:59, 1.95it/s]
Loading 0:  68%|██████▊   | 246/363 [03:01<00:59, 1.95it/s]
Loading 0:  69%|██████▉   | 250/363 [03:04<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:04<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:06<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:06<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:08<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:08<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:10<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:10<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:12<01:43, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:12<01:43, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:14<02:02, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:14<02:02, 1.15s/it]
Loading 0:  73%|███████▎  | 264/363 [03:15<00:50, 1.95it/s]
Loading 0:  73%|███████▎  | 264/363 [03:15<00:50, 1.95it/s]
Loading 0:  74%|███████▍  | 268/363 [03:17<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:17<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:19<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:19<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:21<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:21<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:37<03:44, 2.50s/it]
Loading 0:  75%|███████▌  | 273/363 [03:37<03:44, 2.50s/it]
Loading 0:  75%|███████▌  | 274/363 [03:39<03:35, 2.42s/it]
Loading 0:  75%|███████▌  | 274/363 [03:39<03:35, 2.42s/it]
Loading 0:  76%|███████▌  | 275/363 [03:41<03:28, 2.37s/it]
Loading 0:  76%|███████▌  | 275/363 [03:41<03:28, 2.37s/it]
Loading 0:  78%|███████▊  | 283/363 [03:42<01:11, 1.12it/s]
Loading 0:  78%|███████▊  | 283/363 [03:42<01:11, 1.12it/s]
Loading 0:  79%|███████▉  | 286/363 [03:45<01:05, 1.18it/s]
Loading 0:  79%|███████▉  | 286/363 [03:45<01:05, 1.18it/s]
Loading 0:  79%|███████▉  | 287/363 [03:47<01:13, 1.03it/s]
Loading 0:  79%|███████▉  | 287/363 [03:47<01:13, 1.03it/s]
Loading 0:  79%|███████▉  | 288/363 [03:49<01:24, 1.12s/it]
Loading 0:  79%|███████▉  | 288/363 [03:49<01:24, 1.12s/it]
Loading 0:  80%|████████  | 291/363 [03:50<01:07, 1.07it/s]
Loading 0:  80%|████████  | 291/363 [03:50<01:07, 1.07it/s]
Loading 0:  80%|████████  | 292/363 [03:52<01:17, 1.09s/it]
Loading 0:  80%|████████  | 292/363 [03:52<01:17, 1.09s/it]
Loading 0:  81%|████████  | 293/363 [03:55<01:28, 1.26s/it]
Loading 0:  81%|████████  | 293/363 [03:55<01:28, 1.26s/it]
Loading 0:  83%|████████▎ | 301/363 [03:56<00:31, 1.95it/s]
Loading 0:  83%|████████▎ | 301/363 [03:56<00:31, 1.95it/s]
Loading 0:  84%|████████▎ | 304/363 [03:58<00:33, 1.76it/s]
Loading 0:  84%|████████▎ | 304/363 [03:58<00:33, 1.76it/s]
Loading 0:  84%|████████▍ | 305/363 [04:00<00:41, 1.38it/s]
Loading 0:  84%|████████▍ | 305/363 [04:00<00:41, 1.38it/s]
Loading 0:  84%|████████▍ | 306/363 [04:02<00:51, 1.10it/s]
Loading 0:  84%|████████▍ | 306/363 [04:02<00:51, 1.10it/s]
Loading 0:  85%|████████▌ | 309/363 [04:04<00:44, 1.22it/s]
Loading 0:  85%|████████▌ | 309/363 [04:04<00:44, 1.22it/s]
Loading 0:  85%|████████▌ | 310/363 [04:06<00:52, 1.01it/s]
Loading 0:  85%|████████▌ | 310/363 [04:06<00:52, 1.01it/s]
Loading 0:  86%|████████▌ | 311/363 [04:08<01:01, 1.18s/it]
Loading 0:  86%|████████▌ | 311/363 [04:08<01:01, 1.18s/it]
Loading 0:  88%|████████▊ | 319/363 [04:09<00:21, 2.05it/s]
Loading 0:  88%|████████▊ | 319/363 [04:09<00:21, 2.05it/s]
Loading 0:  89%|████████▊ | 322/363 [04:11<00:22, 1.79it/s]
Loading 0:  89%|████████▊ | 322/363 [04:11<00:22, 1.79it/s]
Loading 0:  89%|████████▉ | 323/363 [04:13<00:28, 1.40it/s]
Loading 0:  89%|████████▉ | 323/363 [04:13<00:28, 1.40it/s]
Loading 0:  89%|████████▉ | 324/363 [04:15<00:35, 1.11it/s]
Loading 0:  89%|████████▉ | 324/363 [04:15<00:35, 1.11it/s]
Loading 0:  90%|█████████ | 327/363 [04:17<00:29, 1.23it/s]
Loading 0:  90%|█████████ | 327/363 [04:17<00:29, 1.23it/s]
Loading 0:  90%|█████████ | 328/363 [04:19<00:34, 1.02it/s]
Loading 0:  90%|█████████ | 328/363 [04:19<00:34, 1.02it/s]
Loading 0:  91%|█████████ | 329/363 [04:21<00:39, 1.18s/it]
Loading 0:  91%|█████████ | 329/363 [04:21<00:39, 1.18s/it]
Loading 0:  93%|█████████▎| 337/363 [04:23<00:12, 2.05it/s]
Loading 0:  93%|█████████▎| 337/363 [04:23<00:12, 2.05it/s]
Loading 0:  94%|█████████▎| 340/363 [04:25<00:12, 1.79it/s]
Loading 0:  94%|█████████▎| 340/363 [04:25<00:12, 1.79it/s]
Loading 0:  94%|█████████▍| 341/363 [04:27<00:15, 1.40it/s]
Loading 0:  94%|█████████▍| 341/363 [04:27<00:15, 1.40it/s]
Loading 0:  94%|█████████▍| 342/363 [04:29<00:18, 1.11it/s]
Loading 0:  94%|█████████▍| 342/363 [04:29<00:18, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [04:31<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 345/363 [04:31<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 346/363 [04:33<00:16, 1.01it/s]
Loading 0:  95%|█████████▌| 346/363 [04:33<00:16, 1.01it/s]
Loading 0:  96%|█████████▌| 347/363 [04:35<00:18, 1.18s/it]
Loading 0:  96%|█████████▌| 347/363 [04:35<00:18, 1.18s/it]
Loading 0:  98%|█████████▊| 355/363 [04:36<00:03, 2.04it/s]
Loading 0:  98%|█████████▊| 355/363 [04:36<00:03, 2.04it/s]
Loading 0:  99%|█████████▉| 359/363 [04:39<00:02, 1.84it/s]
Loading 0:  99%|█████████▉| 359/363 [04:39<00:02, 1.84it/s]
Loading 0:  99%|█████████▉| 360/363 [04:41<00:02, 1.45it/s]
Loading 0:  99%|█████████▉| 360/363 [04:41<00:02, 1.45it/s]
Loading 0:  99%|█████████▉| 361/363 [04:43<00:01, 1.15it/s]
Loading 0:  99%|█████████▉| 361/363 [04:43<00:01, 1.15it/s]
Loading 0: 100%|██████████| 363/363 [04:43<00:00, 1.15it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:43<00:00, 1.28it/s]
chaiml-mistral-24b-2048-90555-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-90555-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp0i2gg9s3' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-90555-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-90555-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: quantized model in 290.226s
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged in 375.796s
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-1-404-v2/nvidia/tokenizer.json
chaiml-mistral-24b-204-54327-v11-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:16, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:16, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.38it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.38it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:56, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:56, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:23, 1.13s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:23, 1.13s/it]
Loading 0:   8%|▊         | 30.0/363 [00:22<03:00, 1.85it/s]
Loading 0:   8%|▊         | 30.0/363 [00:22<03:00, 1.85it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:54, 1.29s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:54, 1.29s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:01, 1.74it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:01, 1.74it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:13, 1.61it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:13, 1.61it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:04, 1.27it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:04, 1.27it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:07, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:07, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:35, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:35, 1.11it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:32, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:32, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:36, 1.31s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:36, 1.31s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:52, 1.72it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:52, 1.72it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:02, 1.61it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:02, 1.61it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:40, 1.74it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:40, 1.74it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:35, 1.27it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:35, 1.27it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:17, 1.94it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:17, 1.94it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:27, 1.78it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:27, 1.78it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:00, 1.08it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:00, 1.08it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:31, 1.06s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:31, 1.06s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:24, 1.05s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:24, 1.05s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:11, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:11, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  36%|███▌      | 129/363 [01:48<03:32, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:48<03:32, 1.10it/s]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:05, 1.32s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:05, 1.32s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:17, 1.60it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:17, 1.60it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:54, 1.26it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:54, 1.26it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:38, 1.00it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:38, 1.00it/s]
Loading 0:  40%|████      | 147/363 [02:03<03:14, 1.11it/s]
Loading 0:  40%|████      | 147/363 [02:03<03:14, 1.11it/s]
Loading 0:  41%|████      | 148/363 [02:05<03:54, 1.09s/it]
Loading 0:  41%|████      | 148/363 [02:05<03:54, 1.09s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:39, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:39, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:08<01:58, 1.74it/s]
Loading 0:  43%|████▎     | 156/363 [02:08<01:58, 1.74it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:04, 1.63it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:04, 1.63it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:19, 1.01it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:19, 1.01it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.12it/s]
Loading 0:  46%|████▌     | 166/363 [02:20<03:33, 1.09s/it]
Loading 0:  46%|████▌     | 166/363 [02:20<03:33, 1.09s/it]
Loading 0:  46%|████▌     | 167/363 [02:22<04:15, 1.30s/it]
Loading 0:  46%|████▌     | 167/363 [02:22<04:15, 1.30s/it]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.74it/s]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.74it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:25, 1.27it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:25, 1.27it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:02, 1.00it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:02, 1.00it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.11it/s]
Loading 0:  51%|█████     | 184/363 [02:35<03:15, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:35<03:15, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:51, 1.30s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:51, 1.30s/it]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:37, 1.75it/s]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:37, 1.75it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.62it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.62it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:24, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:24, 1.12it/s]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:54, 1.09s/it]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:54, 1.09s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.30s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.30s/it]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:28, 1.74it/s]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:28, 1.74it/s]
Loading 0:  59%|█████▉    | 214/363 [02:56<01:32, 1.61it/s]
Loading 0:  59%|█████▉    | 214/363 [02:56<01:32, 1.61it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:57, 1.26it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:57, 1.26it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:26, 1.00it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:26, 1.00it/s]
Loading 0:  60%|██████    | 219/363 [03:03<02:09, 1.11it/s]
Loading 0:  60%|██████    | 219/363 [03:03<02:09, 1.11it/s]
Loading 0:  61%|██████    | 220/363 [03:05<02:35, 1.09s/it]
Loading 0:  61%|██████    | 220/363 [03:05<02:35, 1.09s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:05, 1.31s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:05, 1.31s/it]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.73it/s]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.73it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:21, 1.61it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:21, 1.61it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:08, 1.00it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:08, 1.00it/s]
Loading 0:  65%|██████▌   | 237/363 [03:18<01:53, 1.11it/s]
Loading 0:  65%|██████▌   | 237/363 [03:18<01:53, 1.11it/s]
Loading 0:  66%|██████▌   | 238/363 [03:20<02:16, 1.09s/it]
Loading 0:  66%|██████▌   | 238/363 [03:20<02:16, 1.09s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:42, 1.31s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:42, 1.31s/it]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.72it/s]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.72it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:50, 1.00it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:50, 1.00it/s]
Loading 0:  70%|███████   | 255/363 [03:33<01:37, 1.11it/s]
Loading 0:  70%|███████   | 255/363 [03:33<01:37, 1.11it/s]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:18, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:18, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.74it/s]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.74it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:59, 1.61it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:59, 1.61it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 270/363 [03:46<01:32, 1.00it/s]
Loading 0:  74%|███████▍  | 270/363 [03:46<01:32, 1.00it/s]
Loading 0:  75%|███████▌  | 273/363 [04:03<04:00, 2.67s/it]
Loading 0:  75%|███████▌  | 273/363 [04:03<04:00, 2.67s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:51, 2.60s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:51, 2.60s/it]
Loading 0:  76%|███████▌  | 275/363 [04:08<03:45, 2.56s/it]
Loading 0:  76%|███████▌  | 275/363 [04:08<03:45, 2.56s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:23, 1.03s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:23, 1.03s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.10it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.10it/s]
Loading 0:  79%|███████▉  | 287/363 [04:14<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:14<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:31, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:31, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:14, 1.04s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:14, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:25, 1.21s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:25, 1.21s/it]
Loading 0:  81%|████████  | 293/363 [04:23<01:38, 1.40s/it]
Loading 0:  81%|████████  | 293/363 [04:23<01:38, 1.40s/it]
Loading 0:  83%|████████▎ | 300/363 [04:24<00:38, 1.65it/s]
Loading 0:  83%|████████▎ | 300/363 [04:24<00:38, 1.65it/s]
Loading 0:  84%|████████▎ | 304/363 [04:27<00:37, 1.56it/s]
Loading 0:  84%|████████▎ | 304/363 [04:27<00:37, 1.56it/s]
Loading 0:  84%|████████▍ | 305/363 [04:29<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 305/363 [04:29<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:57, 1.01s/it]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:57, 1.01s/it]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:49, 1.10it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:49, 1.10it/s]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:58, 1.10s/it]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:58, 1.10s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:08, 1.31s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:08, 1.31s/it]
Loading 0:  88%|████████▊ | 318/363 [04:39<00:25, 1.74it/s]
Loading 0:  88%|████████▊ | 318/363 [04:39<00:25, 1.74it/s]
Loading 0:  89%|████████▊ | 322/363 [04:42<00:25, 1.61it/s]
Loading 0:  89%|████████▊ | 322/363 [04:42<00:25, 1.61it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:31, 1.26it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:31, 1.26it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.00it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.00it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 328/363 [04:51<00:38, 1.09s/it]
Loading 0:  90%|█████████ | 328/363 [04:51<00:38, 1.09s/it]
Loading 0:  91%|█████████ | 329/363 [04:53<00:44, 1.31s/it]
Loading 0:  91%|█████████ | 329/363 [04:53<00:44, 1.31s/it]
Loading 0:  93%|█████████▎| 336/363 [04:54<00:15, 1.72it/s]
Loading 0:  93%|█████████▎| 336/363 [04:54<00:15, 1.72it/s]
Loading 0:  94%|█████████▎| 340/363 [04:57<00:14, 1.61it/s]
Loading 0:  94%|█████████▎| 340/363 [04:57<00:14, 1.61it/s]
Loading 0:  94%|█████████▍| 341/363 [04:59<00:17, 1.26it/s]
Loading 0:  94%|█████████▍| 341/363 [04:59<00:17, 1.26it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.00it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.00it/s]
Loading 0:  95%|█████████▌| 345/363 [05:04<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [05:04<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 346/363 [05:06<00:18, 1.09s/it]
Loading 0:  95%|█████████▌| 346/363 [05:06<00:18, 1.09s/it]
Loading 0:  96%|█████████▌| 347/363 [05:08<00:20, 1.31s/it]
Loading 0:  96%|█████████▌| 347/363 [05:08<00:20, 1.31s/it]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.72it/s]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.72it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.65it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.65it/s]
Loading 0:  99%|█████████▉| 360/363 [05:15<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 360/363 [05:15<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 361/363 [05:17<00:01, 1.04it/s]
Loading 0:  99%|█████████▉| 361/363 [05:17<00:01, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:17<00:00, 1.04it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:17<00:00, 1.14it/s]
chaiml-mistral-24b-204-54327-v11-mkmlizer: The tokenizer you are loading from '/tmp/tmp7_oekwop' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-204-54327-v11-mkmlizer: quantized model in 324.914s
chaiml-mistral-24b-204-54327-v11-mkmlizer: Processed model ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged in 416.554s
chaiml-mistral-24b-2048-72304-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:34, 1.31it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:34, 1.31it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:22, 1.23s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:22, 1.23s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:27, 1.58s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:27, 1.58s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:17, 1.79it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:17, 1.79it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:43, 1.02it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:43, 1.02it/s]
Loading 0:   4%|▍         | 15.0/363 [00:15<07:11, 1.24s/it]
Loading 0:   4%|▍         | 15.0/363 [00:15<07:11, 1.24s/it]
Loading 0:   6%|▌         | 21.0/363 [00:18<04:35, 1.24it/s]
Loading 0:   6%|▌         | 21.0/363 [00:18<04:35, 1.24it/s]
Loading 0:   6%|▌         | 22.0/363 [00:20<05:48, 1.02s/it]
Loading 0:   6%|▌         | 22.0/363 [00:20<05:48, 1.02s/it]
Loading 0:   6%|▋         | 23.0/363 [00:23<07:01, 1.24s/it]
Loading 0:   6%|▋         | 23.0/363 [00:23<07:01, 1.24s/it]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:16, 1.69it/s]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:16, 1.69it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:25, 1.60it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:25, 1.60it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:17, 1.27it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:17, 1.27it/s]
Loading 0:  10%|▉         | 36.0/363 [00:31<05:20, 1.02it/s]
Loading 0:  10%|▉         | 36.0/363 [00:31<05:20, 1.02it/s]
Loading 0:  11%|█         | 39.0/363 [00:33<04:46, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:33<04:46, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:35<05:45, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:35<05:45, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:38<06:51, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:38<06:51, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:39<02:56, 1.78it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:39<02:56, 1.78it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:06, 1.67it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:06, 1.67it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:44<03:57, 1.31it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:44<03:57, 1.31it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:46<04:58, 1.03it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:46<04:58, 1.03it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:48<04:28, 1.14it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:48<04:28, 1.14it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:24, 1.06s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:24, 1.06s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:27, 1.27s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:27, 1.27s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:46, 1.79it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:46, 1.79it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<02:56, 1.66it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<02:56, 1.66it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:44, 1.30it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:44, 1.30it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:01<04:42, 1.03it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:01<04:42, 1.03it/s]
Loading 0:  21%|██        | 75.0/363 [01:03<04:13, 1.14it/s]
Loading 0:  21%|██        | 75.0/363 [01:03<04:13, 1.14it/s]
Loading 0:  21%|██        | 76.0/363 [01:05<05:05, 1.07s/it]
Loading 0:  21%|██        | 76.0/363 [01:05<05:05, 1.07s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:04, 1.27s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:04, 1.27s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:36, 1.78it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:36, 1.78it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:45, 1.66it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:45, 1.66it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:31, 1.30it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:31, 1.30it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:24, 1.03it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:24, 1.03it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:13, 2.00it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:13, 2.00it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:22, 1.83it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:22, 1.83it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:05, 1.41it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:05, 1.41it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<03:55, 1.10it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<03:55, 1.10it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:39, 1.17it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:39, 1.17it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:26, 1.04s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:26, 1.04s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:17, 1.25s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:17, 1.25s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:18, 1.02s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:18, 1.02s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:04, 1.21s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:04, 1.21s/it]
Loading 0:  31%|███       | 113/363 [01:37<05:53, 1.41s/it]
Loading 0:  31%|███       | 113/363 [01:37<05:53, 1.41s/it]
Loading 0:  33%|███▎      | 121/363 [01:38<02:12, 1.83it/s]
Loading 0:  33%|███▎      | 121/363 [01:38<02:12, 1.83it/s]
Loading 0:  34%|███▍      | 124/363 [01:40<02:28, 1.61it/s]
Loading 0:  34%|███▍      | 124/363 [01:40<02:28, 1.61it/s]
Loading 0:  34%|███▍      | 125/363 [01:42<03:08, 1.26it/s]
Loading 0:  34%|███▍      | 125/363 [01:42<03:08, 1.26it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<03:56, 1.00it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<03:56, 1.00it/s]
Loading 0:  36%|███▌      | 129/363 [01:47<03:29, 1.12it/s]
Loading 0:  36%|███▌      | 129/363 [01:47<03:29, 1.12it/s]
Loading 0:  36%|███▌      | 130/363 [01:49<04:12, 1.08s/it]
Loading 0:  36%|███▌      | 130/363 [01:49<04:12, 1.08s/it]
Loading 0:  36%|███▌      | 131/363 [01:51<05:00, 1.30s/it]
Loading 0:  36%|███▌      | 131/363 [01:51<05:00, 1.30s/it]
Loading 0:  38%|███▊      | 138/363 [01:52<02:07, 1.77it/s]
Loading 0:  38%|███▊      | 138/363 [01:52<02:07, 1.77it/s]
Loading 0:  39%|███▉      | 142/363 [01:55<02:13, 1.65it/s]
Loading 0:  39%|███▉      | 142/363 [01:55<02:13, 1.65it/s]
Loading 0:  39%|███▉      | 143/363 [01:57<02:50, 1.29it/s]
Loading 0:  39%|███▉      | 143/363 [01:57<02:50, 1.29it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:33, 1.03it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:33, 1.03it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:10, 1.13it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:10, 1.13it/s]
Loading 0:  41%|████      | 148/363 [02:04<03:49, 1.07s/it]
Loading 0:  41%|████      | 148/363 [02:04<03:49, 1.07s/it]
Loading 0:  41%|████      | 149/363 [02:06<04:33, 1.28s/it]
Loading 0:  41%|████      | 149/363 [02:06<04:33, 1.28s/it]
Loading 0:  43%|████▎     | 156/363 [02:07<01:56, 1.78it/s]
Loading 0:  43%|████▎     | 156/363 [02:07<01:56, 1.78it/s]
Loading 0:  44%|████▍     | 160/363 [02:10<02:03, 1.64it/s]
Loading 0:  44%|████▍     | 160/363 [02:10<02:03, 1.64it/s]
Loading 0:  44%|████▍     | 161/363 [02:12<02:37, 1.28it/s]
Loading 0:  44%|████▍     | 161/363 [02:12<02:37, 1.28it/s]
Loading 0:  45%|████▍     | 162/363 [02:14<03:16, 1.02it/s]
Loading 0:  45%|████▍     | 162/363 [02:14<03:16, 1.02it/s]
Loading 0:  45%|████▌     | 165/363 [02:17<02:55, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:17<02:55, 1.13it/s]
Loading 0:  46%|████▌     | 166/363 [02:19<03:31, 1.07s/it]
Loading 0:  46%|████▌     | 166/363 [02:19<03:31, 1.07s/it]
Loading 0:  46%|████▌     | 167/363 [02:21<04:11, 1.28s/it]
Loading 0:  46%|████▌     | 167/363 [02:21<04:11, 1.28s/it]
Loading 0:  48%|████▊     | 174/363 [02:22<01:46, 1.77it/s]
Loading 0:  48%|████▊     | 174/363 [02:22<01:46, 1.77it/s]
Loading 0:  49%|████▉     | 178/363 [02:25<01:51, 1.65it/s]
Loading 0:  49%|████▉     | 178/363 [02:25<01:51, 1.65it/s]
Loading 0:  49%|████▉     | 179/363 [02:27<02:22, 1.29it/s]
Loading 0:  49%|████▉     | 179/363 [02:27<02:22, 1.29it/s]
Loading 0:  50%|████▉     | 180/363 [02:29<02:58, 1.03it/s]
Loading 0:  50%|████▉     | 180/363 [02:29<02:58, 1.03it/s]
Loading 0:  50%|█████     | 183/363 [02:31<02:38, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:31<02:38, 1.14it/s]
Loading 0:  51%|█████     | 184/363 [02:34<03:11, 1.07s/it]
Loading 0:  51%|█████     | 184/363 [02:34<03:11, 1.07s/it]
Loading 0:  51%|█████     | 185/363 [02:36<03:47, 1.28s/it]
Loading 0:  51%|█████     | 185/363 [02:36<03:47, 1.28s/it]
Loading 0:  53%|█████▎    | 192/363 [02:37<01:36, 1.78it/s]
Loading 0:  53%|█████▎    | 192/363 [02:37<01:36, 1.78it/s]
Loading 0:  54%|█████▍    | 196/363 [02:40<01:41, 1.65it/s]
Loading 0:  54%|█████▍    | 196/363 [02:40<01:41, 1.65it/s]
Loading 0:  54%|█████▍    | 197/363 [02:42<02:08, 1.29it/s]
Loading 0:  54%|█████▍    | 197/363 [02:42<02:08, 1.29it/s]
Loading 0:  55%|█████▍    | 198/363 [02:44<02:40, 1.03it/s]
Loading 0:  55%|█████▍    | 198/363 [02:44<02:40, 1.03it/s]
Loading 0:  55%|█████▌    | 201/363 [02:46<02:22, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:46<02:22, 1.14it/s]
Loading 0:  56%|█████▌    | 202/363 [02:48<02:52, 1.07s/it]
Loading 0:  56%|█████▌    | 202/363 [02:48<02:52, 1.07s/it]
Loading 0:  56%|█████▌    | 203/363 [02:51<03:24, 1.28s/it]
Loading 0:  56%|█████▌    | 203/363 [02:51<03:24, 1.28s/it]
Loading 0:  58%|█████▊    | 210/363 [02:52<01:26, 1.77it/s]
Loading 0:  58%|█████▊    | 210/363 [02:52<01:26, 1.77it/s]
Loading 0:  59%|█████▉    | 214/363 [02:54<01:30, 1.65it/s]
Loading 0:  59%|█████▉    | 214/363 [02:54<01:30, 1.65it/s]
Loading 0:  59%|█████▉    | 215/363 [02:57<01:54, 1.29it/s]
Loading 0:  59%|█████▉    | 215/363 [02:57<01:54, 1.29it/s]
Loading 0:  60%|█████▉    | 216/363 [02:59<02:22, 1.03it/s]
Loading 0:  60%|█████▉    | 216/363 [02:59<02:22, 1.03it/s]
Loading 0:  60%|██████    | 219/363 [03:01<02:06, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [03:01<02:06, 1.14it/s]
Loading 0:  61%|██████    | 220/363 [03:03<02:32, 1.07s/it]
Loading 0:  61%|██████    | 220/363 [03:03<02:32, 1.07s/it]
Loading 0:  61%|██████    | 221/363 [03:05<03:01, 1.28s/it]
Loading 0:  61%|██████    | 221/363 [03:05<03:01, 1.28s/it]
Loading 0:  63%|██████▎   | 228/363 [03:06<01:15, 1.78it/s]
Loading 0:  63%|██████▎   | 228/363 [03:06<01:15, 1.78it/s]
Loading 0:  64%|██████▍   | 232/363 [03:09<01:19, 1.66it/s]
Loading 0:  64%|██████▍   | 232/363 [03:09<01:19, 1.66it/s]
Loading 0:  64%|██████▍   | 233/363 [03:11<01:40, 1.30it/s]
Loading 0:  64%|██████▍   | 233/363 [03:11<01:40, 1.30it/s]
Loading 0:  64%|██████▍   | 234/363 [03:14<02:04, 1.03it/s]
Loading 0:  64%|██████▍   | 234/363 [03:14<02:04, 1.03it/s]
Loading 0:  65%|██████▌   | 237/363 [03:16<01:50, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [03:16<01:50, 1.14it/s]
Loading 0:  66%|██████▌   | 238/363 [03:18<02:13, 1.06s/it]
Loading 0:  66%|██████▌   | 238/363 [03:18<02:13, 1.06s/it]
Loading 0:  66%|██████▌   | 239/363 [03:20<02:38, 1.28s/it]
Loading 0:  66%|██████▌   | 239/363 [03:20<02:38, 1.28s/it]
Loading 0:  68%|██████▊   | 246/363 [03:21<01:05, 1.78it/s]
Loading 0:  68%|██████▊   | 246/363 [03:21<01:05, 1.78it/s]
Loading 0:  69%|██████▉   | 250/363 [03:24<01:08, 1.66it/s]
Loading 0:  69%|██████▉   | 250/363 [03:24<01:08, 1.66it/s]
Loading 0:  69%|██████▉   | 251/363 [03:26<01:26, 1.30it/s]
Loading 0:  69%|██████▉   | 251/363 [03:26<01:26, 1.30it/s]
Loading 0:  69%|██████▉   | 252/363 [03:28<01:47, 1.03it/s]
Loading 0:  69%|██████▉   | 252/363 [03:28<01:47, 1.03it/s]
Loading 0:  70%|███████   | 255/363 [03:31<01:34, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:31<01:34, 1.14it/s]
Loading 0:  71%|███████   | 256/363 [03:33<01:54, 1.07s/it]
Loading 0:  71%|███████   | 256/363 [03:33<01:54, 1.07s/it]
Loading 0:  71%|███████   | 257/363 [03:35<02:14, 1.27s/it]
Loading 0:  71%|███████   | 257/363 [03:35<02:14, 1.27s/it]
Loading 0:  73%|███████▎  | 264/363 [03:36<00:55, 1.78it/s]
Loading 0:  73%|███████▎  | 264/363 [03:36<00:55, 1.78it/s]
Loading 0:  74%|███████▍  | 268/363 [03:39<00:57, 1.66it/s]
Loading 0:  74%|███████▍  | 268/363 [03:39<00:57, 1.66it/s]
Loading 0:  74%|███████▍  | 269/363 [03:41<01:12, 1.30it/s]
Loading 0:  74%|███████▍  | 269/363 [03:41<01:12, 1.30it/s]
Loading 0:  74%|███████▍  | 270/363 [03:43<01:30, 1.03it/s]
Loading 0:  74%|███████▍  | 270/363 [03:43<01:30, 1.03it/s]
Loading 0:  75%|███████▌  | 273/363 [04:05<04:51, 3.24s/it]
Loading 0:  75%|███████▌  | 273/363 [04:05<04:51, 3.24s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<04:33, 3.08s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<04:33, 3.08s/it]
Loading 0:  76%|███████▌  | 275/363 [04:09<04:18, 2.94s/it]
Loading 0:  76%|███████▌  | 275/363 [04:09<04:18, 2.94s/it]
Loading 0:  78%|███████▊  | 282/363 [04:10<01:34, 1.16s/it]
Loading 0:  78%|███████▊  | 282/363 [04:10<01:34, 1.16s/it]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:15, 1.02it/s]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:15, 1.02it/s]
Loading 0:  79%|███████▉  | 287/363 [04:15<01:24, 1.11s/it]
Loading 0:  79%|███████▉  | 287/363 [04:15<01:24, 1.11s/it]
Loading 0:  79%|███████▉  | 288/363 [04:17<01:34, 1.26s/it]
Loading 0:  79%|███████▉  | 288/363 [04:17<01:34, 1.26s/it]
Loading 0:  80%|████████  | 291/363 [04:19<01:16, 1.06s/it]
Loading 0:  80%|████████  | 291/363 [04:19<01:16, 1.06s/it]
Loading 0:  80%|████████  | 292/363 [04:21<01:26, 1.22s/it]
Loading 0:  80%|████████  | 292/363 [04:21<01:26, 1.22s/it]
Loading 0:  81%|████████  | 293/363 [04:24<01:37, 1.39s/it]
Loading 0:  81%|████████  | 293/363 [04:24<01:37, 1.39s/it]
Loading 0:  83%|████████▎ | 301/363 [04:25<00:34, 1.77it/s]
Loading 0:  83%|████████▎ | 301/363 [04:25<00:34, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [04:27<00:37, 1.58it/s]
Loading 0:  84%|████████▎ | 304/363 [04:27<00:37, 1.58it/s]
Loading 0:  84%|████████▍ | 305/363 [04:29<00:46, 1.26it/s]
Loading 0:  84%|████████▍ | 305/363 [04:29<00:46, 1.26it/s]
Loading 0:  84%|████████▍ | 306/363 [04:32<00:56, 1.01it/s]
Loading 0:  84%|████████▍ | 306/363 [04:32<00:56, 1.01it/s]
Loading 0:  85%|████████▌ | 309/363 [04:34<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:34<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 310/363 [04:36<00:56, 1.07s/it]
Loading 0:  85%|████████▌ | 310/363 [04:36<00:56, 1.07s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:06, 1.28s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:06, 1.28s/it]
Loading 0:  88%|████████▊ | 319/363 [04:39<00:23, 1.91it/s]
Loading 0:  88%|████████▊ | 319/363 [04:39<00:23, 1.91it/s]
Loading 0:  89%|████████▊ | 322/363 [04:42<00:24, 1.69it/s]
Loading 0:  89%|████████▊ | 322/363 [04:42<00:24, 1.69it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:30, 1.31it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:30, 1.31it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:37, 1.04it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:37, 1.04it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:31, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:31, 1.14it/s]
Loading 0:  90%|█████████ | 328/363 [04:50<00:37, 1.06s/it]
Loading 0:  90%|█████████ | 328/363 [04:50<00:37, 1.06s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:43, 1.27s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:43, 1.27s/it]
Loading 0:  93%|█████████▎| 337/363 [04:54<00:13, 1.92it/s]
Loading 0:  93%|█████████▎| 337/363 [04:54<00:13, 1.92it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:13, 1.67it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:13, 1.67it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:16, 1.30it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:16, 1.30it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.03it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.03it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:15, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:15, 1.14it/s]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.07s/it]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.07s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.27s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.27s/it]
Loading 0:  98%|█████████▊| 355/363 [05:08<00:04, 1.92it/s]
Loading 0:  98%|█████████▊| 355/363 [05:08<00:04, 1.92it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.73it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.73it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.35it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.35it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.07it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.07it/s]
Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.07it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.15it/s]
chaiml-mistral-24b-204-54327-v11-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-204-54327-v11-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-204-54327-v11-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-204-54327-v11/nvidia
chaiml-mistral-24b-204-54327-v11-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-204-54327-v11/nvidia/config.json
chaiml-mistral-24b-204-54327-v11-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-204-54327-v11/nvidia/special_tokens_map.json
chaiml-mistral-24b-204-54327-v11-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-204-54327-v11/nvidia/tokenizer_config.json
chaiml-mistral-24b-204-54327-v11-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-204-54327-v11/nvidia/tokenizer.json
chaiml-mistral-24b-2048-37531-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:25, 1.36it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:25, 1.36it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:10, 1.20s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:10, 1.20s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:15, 1.55s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:15, 1.55s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:12, 1.39it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:12, 1.39it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:55, 1.19s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:55, 1.19s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   8%|▊         | 30.0/363 [00:22<03:01, 1.84it/s]
Loading 0:   8%|▊         | 30.0/363 [00:22<03:01, 1.84it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:45, 1.14it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:45, 1.14it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:54, 1.29s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:54, 1.29s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:12, 1.62it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:12, 1.62it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:07, 1.00it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:07, 1.00it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:35, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:35, 1.11it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:32, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:32, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:37, 1.31s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:37, 1.31s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:51, 1.74it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:51, 1.74it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:01, 1.61it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:01, 1.61it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.26it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.26it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:32, 1.00it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:32, 1.00it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:17, 1.93it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:17, 1.93it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:27, 1.78it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:27, 1.78it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:11, 1.37it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:11, 1.37it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:02, 1.07it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:02, 1.07it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:46, 1.13it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:46, 1.13it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:34, 1.07s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:34, 1.07s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:27, 1.29s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:27, 1.29s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:25, 1.05s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:25, 1.05s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:11, 1.24s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:11, 1.24s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:02, 1.45s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:02, 1.45s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:26, 1.66it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:26, 1.66it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:32, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:32, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.23it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.23it/s]
Loading 0:  35%|███▍      | 126/363 [01:46<04:01, 1.02s/it]
Loading 0:  35%|███▍      | 126/363 [01:46<04:01, 1.02s/it]
Loading 0:  36%|███▌      | 129/363 [01:48<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 129/363 [01:48<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 130/363 [01:50<04:20, 1.12s/it]
Loading 0:  36%|███▌      | 130/363 [01:50<04:20, 1.12s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:12, 1.35s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:12, 1.35s/it]
Loading 0:  38%|███▊      | 138/363 [01:54<02:13, 1.69it/s]
Loading 0:  38%|███▊      | 138/363 [01:54<02:13, 1.69it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:21, 1.56it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:21, 1.56it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<03:01, 1.21it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<03:01, 1.21it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:47, 1.04s/it]
Loading 0:  40%|███▉      | 144/363 [02:01<03:47, 1.04s/it]
Loading 0:  40%|████      | 147/363 [02:04<03:23, 1.06it/s]
Loading 0:  40%|████      | 147/363 [02:04<03:23, 1.06it/s]
Loading 0:  41%|████      | 148/363 [02:06<04:06, 1.14s/it]
Loading 0:  41%|████      | 148/363 [02:06<04:06, 1.14s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:52, 1.37s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:52, 1.37s/it]
Loading 0:  43%|████▎     | 156/363 [02:10<02:04, 1.66it/s]
Loading 0:  43%|████▎     | 156/363 [02:10<02:04, 1.66it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:11, 1.54it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:11, 1.54it/s]
Loading 0:  44%|████▍     | 161/363 [02:15<02:52, 1.17it/s]
Loading 0:  44%|████▍     | 161/363 [02:15<02:52, 1.17it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:34, 1.07s/it]
Loading 0:  45%|████▍     | 162/363 [02:17<03:34, 1.07s/it]
Loading 0:  45%|████▌     | 165/363 [02:20<03:10, 1.04it/s]
Loading 0:  45%|████▌     | 165/363 [02:20<03:10, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:22<03:49, 1.16s/it]
Loading 0:  46%|████▌     | 166/363 [02:22<03:49, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:25<04:31, 1.38s/it]
Loading 0:  46%|████▌     | 167/363 [02:25<04:31, 1.38s/it]
Loading 0:  48%|████▊     | 174/363 [02:26<01:55, 1.64it/s]
Loading 0:  48%|████▊     | 174/363 [02:26<01:55, 1.64it/s]
Loading 0:  49%|████▉     | 178/363 [02:29<02:00, 1.53it/s]
Loading 0:  49%|████▉     | 178/363 [02:29<02:00, 1.53it/s]
Loading 0:  49%|████▉     | 179/363 [02:31<02:32, 1.20it/s]
Loading 0:  49%|████▉     | 179/363 [02:31<02:32, 1.20it/s]
Loading 0:  50%|████▉     | 180/363 [02:33<03:11, 1.05s/it]
Loading 0:  50%|████▉     | 180/363 [02:33<03:11, 1.05s/it]
Loading 0:  50%|█████     | 183/363 [02:36<02:50, 1.06it/s]
Loading 0:  50%|█████     | 183/363 [02:36<02:50, 1.06it/s]
Loading 0:  51%|█████     | 184/363 [02:38<03:24, 1.14s/it]
Loading 0:  51%|█████     | 184/363 [02:38<03:24, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:40<04:02, 1.36s/it]
Loading 0:  51%|█████     | 185/363 [02:40<04:02, 1.36s/it]
Loading 0:  53%|█████▎    | 192/363 [02:42<01:42, 1.67it/s]
Loading 0:  53%|█████▎    | 192/363 [02:42<01:42, 1.67it/s]
Loading 0:  54%|█████▍    | 196/363 [02:44<01:47, 1.55it/s]
Loading 0:  54%|█████▍    | 196/363 [02:44<01:47, 1.55it/s]
Loading 0:  54%|█████▍    | 197/363 [02:47<02:18, 1.20it/s]
Loading 0:  54%|█████▍    | 197/363 [02:47<02:18, 1.20it/s]
Loading 0:  55%|█████▍    | 198/363 [02:49<02:53, 1.05s/it]
Loading 0:  55%|█████▍    | 198/363 [02:49<02:53, 1.05s/it]
Loading 0:  55%|█████▌    | 201/363 [02:52<02:33, 1.06it/s]
Loading 0:  55%|█████▌    | 201/363 [02:52<02:33, 1.06it/s]
Loading 0:  56%|█████▌    | 202/363 [02:54<03:04, 1.15s/it]
Loading 0:  56%|█████▌    | 202/363 [02:54<03:04, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:56<03:38, 1.37s/it]
Loading 0:  56%|█████▌    | 203/363 [02:56<03:38, 1.37s/it]
Loading 0:  58%|█████▊    | 210/363 [02:57<01:32, 1.66it/s]
Loading 0:  58%|█████▊    | 210/363 [02:57<01:32, 1.66it/s]
Loading 0:  59%|█████▉    | 214/363 [03:00<01:36, 1.55it/s]
Loading 0:  59%|█████▉    | 214/363 [03:00<01:36, 1.55it/s]
Loading 0:  59%|█████▉    | 215/363 [03:03<02:01, 1.21it/s]
Loading 0:  59%|█████▉    | 215/363 [03:03<02:01, 1.21it/s]
Loading 0:  60%|█████▉    | 216/363 [03:05<02:32, 1.04s/it]
Loading 0:  60%|█████▉    | 216/363 [03:05<02:32, 1.04s/it]
Loading 0:  60%|██████    | 219/363 [03:07<02:15, 1.07it/s]
Loading 0:  60%|██████    | 219/363 [03:07<02:15, 1.07it/s]
Loading 0:  61%|██████    | 220/363 [03:10<02:42, 1.14s/it]
Loading 0:  61%|██████    | 220/363 [03:10<02:42, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [03:12<03:13, 1.36s/it]
Loading 0:  61%|██████    | 221/363 [03:12<03:13, 1.36s/it]
Loading 0:  63%|██████▎   | 228/363 [03:13<01:20, 1.68it/s]
Loading 0:  63%|██████▎   | 228/363 [03:13<01:20, 1.68it/s]
Loading 0:  64%|██████▍   | 232/363 [03:16<01:23, 1.56it/s]
Loading 0:  64%|██████▍   | 232/363 [03:16<01:23, 1.56it/s]
Loading 0:  64%|██████▍   | 233/363 [03:18<01:46, 1.22it/s]
Loading 0:  64%|██████▍   | 233/363 [03:18<01:46, 1.22it/s]
Loading 0:  64%|██████▍   | 234/363 [03:21<02:13, 1.03s/it]
Loading 0:  64%|██████▍   | 234/363 [03:21<02:13, 1.03s/it]
Loading 0:  65%|██████▌   | 237/363 [03:23<01:57, 1.07it/s]
Loading 0:  65%|██████▌   | 237/363 [03:23<01:57, 1.07it/s]
Loading 0:  66%|██████▌   | 238/363 [03:25<02:21, 1.13s/it]
Loading 0:  66%|██████▌   | 238/363 [03:25<02:21, 1.13s/it]
Loading 0:  66%|██████▌   | 239/363 [03:28<02:48, 1.36s/it]
Loading 0:  66%|██████▌   | 239/363 [03:28<02:48, 1.36s/it]
Loading 0:  68%|██████▊   | 246/363 [03:29<01:10, 1.67it/s]
Loading 0:  68%|██████▊   | 246/363 [03:29<01:10, 1.67it/s]
Loading 0:  69%|██████▉   | 250/363 [03:32<01:12, 1.55it/s]
Loading 0:  69%|██████▉   | 250/363 [03:32<01:12, 1.55it/s]
Loading 0:  69%|██████▉   | 251/363 [03:34<01:32, 1.22it/s]
Loading 0:  69%|██████▉   | 251/363 [03:34<01:32, 1.22it/s]
Loading 0:  69%|██████▉   | 252/363 [03:36<01:54, 1.04s/it]
Loading 0:  69%|██████▉   | 252/363 [03:36<01:54, 1.04s/it]
Loading 0:  70%|███████   | 255/363 [03:39<01:41, 1.07it/s]
Loading 0:  70%|███████   | 255/363 [03:39<01:41, 1.07it/s]
Loading 0:  71%|███████   | 256/363 [03:41<02:01, 1.14s/it]
Loading 0:  71%|███████   | 256/363 [03:41<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:43<02:24, 1.36s/it]
Loading 0:  71%|███████   | 257/363 [03:43<02:24, 1.36s/it]
Loading 0:  73%|███████▎  | 264/363 [03:45<00:59, 1.67it/s]
Loading 0:  73%|███████▎  | 264/363 [03:45<00:59, 1.67it/s]
Loading 0:  74%|███████▍  | 268/363 [03:48<01:02, 1.53it/s]
Loading 0:  74%|███████▍  | 268/363 [03:48<01:02, 1.53it/s]
Loading 0:  74%|███████▍  | 269/363 [03:50<01:18, 1.20it/s]
Loading 0:  74%|███████▍  | 269/363 [03:50<01:18, 1.20it/s]
Loading 0:  74%|███████▍  | 270/363 [03:52<01:37, 1.04s/it]
Loading 0:  74%|███████▍  | 270/363 [03:52<01:37, 1.04s/it]
Loading 0:  75%|███████▌  | 273/363 [04:09<04:05, 2.73s/it]
Loading 0:  75%|███████▌  | 273/363 [04:09<04:05, 2.73s/it]
Loading 0:  75%|███████▌  | 274/363 [04:12<03:56, 2.66s/it]
Loading 0:  75%|███████▌  | 274/363 [04:12<03:56, 2.66s/it]
Loading 0:  76%|███████▌  | 275/363 [04:14<03:50, 2.62s/it]
Loading 0:  76%|███████▌  | 275/363 [04:14<03:50, 2.62s/it]
Loading 0:  77%|███████▋  | 281/363 [04:15<01:34, 1.15s/it]
Loading 0:  77%|███████▋  | 281/363 [04:15<01:34, 1.15s/it]
Loading 0:  79%|███████▉  | 286/363 [04:18<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 286/363 [04:18<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 287/363 [04:20<01:21, 1.08s/it]
Loading 0:  79%|███████▉  | 287/363 [04:20<01:21, 1.08s/it]
Loading 0:  79%|███████▉  | 288/363 [04:23<01:33, 1.25s/it]
Loading 0:  79%|███████▉  | 288/363 [04:23<01:33, 1.25s/it]
Loading 0:  80%|████████  | 291/363 [04:25<01:17, 1.08s/it]
Loading 0:  80%|████████  | 291/363 [04:25<01:17, 1.08s/it]
Loading 0:  80%|████████  | 292/363 [04:27<01:28, 1.25s/it]
Loading 0:  80%|████████  | 292/363 [04:27<01:28, 1.25s/it]
Loading 0:  81%|████████  | 293/363 [04:30<01:41, 1.45s/it]
Loading 0:  81%|████████  | 293/363 [04:30<01:41, 1.45s/it]
Loading 0:  83%|████████▎ | 300/363 [04:31<00:39, 1.60it/s]
Loading 0:  83%|████████▎ | 300/363 [04:31<00:39, 1.60it/s]
Loading 0:  84%|████████▎ | 304/363 [04:34<00:38, 1.52it/s]
Loading 0:  84%|████████▎ | 304/363 [04:34<00:38, 1.52it/s]
Loading 0:  84%|████████▍ | 305/363 [04:36<00:48, 1.20it/s]
Loading 0:  84%|████████▍ | 305/363 [04:36<00:48, 1.20it/s]
Loading 0:  84%|████████▍ | 306/363 [04:38<00:59, 1.05s/it]
Loading 0:  84%|████████▍ | 306/363 [04:38<00:59, 1.05s/it]
Loading 0:  85%|████████▌ | 309/363 [04:41<00:51, 1.06it/s]
Loading 0:  85%|████████▌ | 309/363 [04:41<00:51, 1.06it/s]
Loading 0:  85%|████████▌ | 310/363 [04:43<01:00, 1.14s/it]
Loading 0:  85%|████████▌ | 310/363 [04:43<01:00, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:46<01:13, 1.41s/it]
Loading 0:  86%|████████▌ | 311/363 [04:46<01:13, 1.41s/it]
Loading 0:  88%|████████▊ | 318/363 [04:47<00:27, 1.65it/s]
Loading 0:  88%|████████▊ | 318/363 [04:47<00:27, 1.65it/s]
Loading 0:  89%|████████▊ | 322/363 [04:50<00:26, 1.54it/s]
Loading 0:  89%|████████▊ | 322/363 [04:50<00:26, 1.54it/s]
Loading 0:  89%|████████▉ | 323/363 [04:52<00:33, 1.21it/s]
Loading 0:  89%|████████▉ | 323/363 [04:52<00:33, 1.21it/s]
Loading 0:  89%|████████▉ | 324/363 [04:54<00:40, 1.04s/it]
Loading 0:  89%|████████▉ | 324/363 [04:54<00:40, 1.04s/it]
Loading 0:  90%|█████████ | 327/363 [04:57<00:34, 1.06it/s]
Loading 0:  90%|█████████ | 327/363 [04:57<00:34, 1.06it/s]
Loading 0:  90%|█████████ | 328/363 [04:59<00:40, 1.15s/it]
Loading 0:  90%|█████████ | 328/363 [04:59<00:40, 1.15s/it]
Loading 0:  91%|█████████ | 329/363 [05:01<00:46, 1.37s/it]
Loading 0:  91%|█████████ | 329/363 [05:01<00:46, 1.37s/it]
Loading 0:  93%|█████████▎| 336/363 [05:03<00:16, 1.68it/s]
Loading 0:  93%|█████████▎| 336/363 [05:03<00:16, 1.68it/s]
Loading 0:  94%|█████████▎| 340/363 [05:05<00:14, 1.55it/s]
Loading 0:  94%|█████████▎| 340/363 [05:05<00:14, 1.55it/s]
Loading 0:  94%|█████████▍| 341/363 [05:08<00:18, 1.21it/s]
Loading 0:  94%|█████████▍| 341/363 [05:08<00:18, 1.21it/s]
Loading 0:  94%|█████████▍| 342/363 [05:10<00:21, 1.04s/it]
Loading 0:  94%|█████████▍| 342/363 [05:10<00:21, 1.04s/it]
Loading 0:  95%|█████████▌| 345/363 [05:13<00:17, 1.06it/s]
Loading 0:  95%|█████████▌| 345/363 [05:13<00:17, 1.06it/s]
Loading 0:  95%|█████████▌| 346/363 [05:15<00:19, 1.15s/it]
Loading 0:  95%|█████████▌| 346/363 [05:15<00:19, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [05:17<00:21, 1.37s/it]
Loading 0:  96%|█████████▌| 347/363 [05:17<00:21, 1.37s/it]
Loading 0:  98%|█████████▊| 354/363 [05:18<00:05, 1.68it/s]
Loading 0:  98%|█████████▊| 354/363 [05:18<00:05, 1.68it/s]
Loading 0:  99%|█████████▉| 359/363 [05:22<00:02, 1.61it/s]
Loading 0:  99%|█████████▉| 359/363 [05:22<00:02, 1.61it/s]
Loading 0:  99%|█████████▉| 360/363 [05:24<00:02, 1.27it/s]
Loading 0:  99%|█████████▉| 360/363 [05:24<00:02, 1.27it/s]
Loading 0:  99%|█████████▉| 361/363 [05:26<00:01, 1.01it/s]
Loading 0:  99%|█████████▉| 361/363 [05:26<00:01, 1.01it/s]
Loading 0: 100%|██████████| 363/363 [05:26<00:00, 1.35it/s]
Loading 0: 100%|██████████| 363/363 [05:26<00:00, 1.35it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:26<00:00, 1.11it/s]
chaiml-mistral-24b-2048-72304-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp9wag047i' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-72304-v2-mkmlizer: quantized model in 326.089s
chaiml-mistral-24b-2048-72304-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_2472_instruct_v2_merged in 410.199s
chaiml-mistral-24b-2048-72304-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-72304-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-72304-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia
chaiml-mistral-24b-2048-72304-v2-mkmlizer: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia/chat_template.jinja
chaiml-mistral-24b-2048-72304-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia/config.json
chaiml-mistral-24b-2048-72304-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-72304-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-72304-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-37531-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-37531-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-37531-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia
chaiml-mistral-24b-2048-37531-v2-mkmlizer: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia/chat_template.jinja
chaiml-mistral-24b-2048-37531-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia/config.json
chaiml-mistral-24b-2048-37531-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-37531-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-37531-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-90555-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-90555-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-1-404-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-204-54327-v11-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-204-54327-v11/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-37531-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-72304-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-90555-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-90555-v2/nvidia/flywheel_model.0.safetensors
chaiml-mistral-24b-2048-1-404-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-1-404-v2/nvidia/flywheel_model.0.safetensors
chaiml-mistral-24b-204-54327-v11-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-204-54327-v11/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-90555-v2-mkmlizer completed after 707.69s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-90555-v2-mkmlizer
Pipeline stage MKMLizer completed in 709.97s
chaiml-mistral-24b-2048-72304-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-72304-v2/nvidia/flywheel_model.0.safetensors
run pipeline stage %s
Job chaiml-mistral-24b-2048-72304-v2-mkmlizer completed after 694.93s with status: succeeded
Job chaiml-mistral-24b-2048-1-404-v2-mkmlizer completed after 700.94s with status: succeeded
Running pipeline stage MKMLTemplater
Stopping job with name chaiml-mistral-24b-2048-72304-v2-mkmlizer
Stopping job with name chaiml-mistral-24b-2048-1-404-v2-mkmlizer
Pipeline stage MKMLTemplater completed in 1.56s
Pipeline stage MKMLizer completed in 698.90s
run pipeline stage %s
Pipeline stage MKMLizer completed in 704.68s
run pipeline stage %s
Running pipeline stage MKMLDeployer
run pipeline stage %s
Running pipeline stage MKMLTemplater
Creating inference service chaiml-mistral-24b-2048-90555-v2
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.94s
Job chaiml-mistral-24b-204-54327-v11-mkmlizer completed after 721.23s with status: succeeded
Waiting for inference service chaiml-mistral-24b-2048-90555-v2 to be ready
run pipeline stage %s
Pipeline stage MKMLTemplater completed in 1.70s
Stopping job with name chaiml-mistral-24b-204-54327-v11-mkmlizer
Running pipeline stage MKMLDeployer
run pipeline stage %s
Pipeline stage MKMLizer completed in 724.60s
Creating inference service chaiml-mistral-24b-2048-72304-v2
Running pipeline stage MKMLDeployer
run pipeline stage %s
Waiting for inference service chaiml-mistral-24b-2048-72304-v2 to be ready
Creating inference service chaiml-mistral-24b-2048-1-404-v2
Running pipeline stage MKMLTemplater
Waiting for inference service chaiml-mistral-24b-2048-1-404-v2 to be ready
Pipeline stage MKMLTemplater completed in 1.46s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-204-54327-v11
chaiml-mistral-24b-2048-37531-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-37531-v2/nvidia/flywheel_model.0.safetensors
Waiting for inference service chaiml-mistral-24b-204-54327-v11 to be ready
Job chaiml-mistral-24b-2048-37531-v2-mkmlizer completed after 722.01s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-37531-v2-mkmlizer
Pipeline stage MKMLizer completed in 724.77s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.94s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-37531-v2
Waiting for inference service chaiml-mistral-24b-2048-37531-v2 to be ready
Inference service chaiml-mistral-24b-2048-90555-v2 ready after 163.35106563568115s
Pipeline stage MKMLDeployer completed in 168.33s
run pipeline stage %s
Running pipeline stage StressChecker
Inference service chaiml-mistral-24b-2048-72304-v2 ready after 162.2259590625763s
Inference service chaiml-mistral-24b-2048-1-404-v2 ready after 162.1456696987152s
Pipeline stage MKMLDeployer completed in 166.65s
Pipeline stage MKMLDeployer completed in 166.31s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage StressChecker
Running pipeline stage StressChecker
Received healthy response to inference request in 4.024766206741333s
Inference service chaiml-mistral-24b-204-54327-v11 ready after 162.22663569450378s
Pipeline stage MKMLDeployer completed in 166.31s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.263028383255005s
Received healthy response to inference request in 4.342169761657715s
Received healthy response to inference request in 3.239485740661621s
Received healthy response to inference request in 3.007068634033203s
Received healthy response to inference request in 3.232280731201172s
Received healthy response to inference request in 2.9305453300476074s
Received healthy response to inference request in 3.2591283321380615s
Inference service chaiml-mistral-24b-2048-37531-v2 ready after 162.10667324066162s
Pipeline stage MKMLDeployer completed in 166.59s
run pipeline stage %s
Received healthy response to inference request in 2.9856019020080566s
Received healthy response to inference request in 3.0483810901641846s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1536641120910645s
Received healthy response to inference request in 3.042123794555664s
Received healthy response to inference request in 2.970109224319458s
Received healthy response to inference request in 3.0277791023254395s
Received healthy response to inference request in 2.8228557109832764s
Received healthy response to inference request in 3.0902228355407715s
Received healthy response to inference request in 3.1804468631744385s
5 requests
0 failed requests
5th percentile: 3.069788408279419
Received healthy response to inference request in 3.1341450214385986s
Received healthy response to inference request in 2.821925401687622s
Received healthy response to inference request in 2.996752977371216s
10th percentile: 3.0974530220031737
Received healthy response to inference request in 2.930741786956787s
5 requests
20th percentile: 3.1527822494506834
5 requests
0 failed requests
30th percentile: 3.192254638671875
0 failed requests
5th percentile: 2.9732077598571776
40th percentile: 3.215870189666748
5th percentile: 2.9305846214294435
10th percentile: 2.9763062953948975
Received healthy response to inference request in 2.625082492828369s
Received healthy response to inference request in 3.1892216205596924s
50th percentile: 3.239485740661621
10th percentile: 2.930623912811279
20th percentile: 2.982503366470337
5 requests
60th percentile: 3.2473427772521974
20th percentile: 2.930702495574951
30th percentile: 2.989895248413086
0 failed requests
70th percentile: 3.2551998138427733
30th percentile: 2.962637996673584
40th percentile: 2.9984819412231447
5th percentile: 2.6994165897369387
80th percentile: 3.412255907058716
Received healthy response to inference request in 2.9940474033355713s
40th percentile: 3.0264304161071776
50th percentile: 3.007068634033203
10th percentile: 2.7737506866455077
90th percentile: 3.7185110569000246
50th percentile: 3.0902228355407715
60th percentile: 3.0578991889953615
20th percentile: 2.9224188804626463
95th percentile: 3.8716386318206784
60th percentile: 3.115599346160889
70th percentile: 3.1087297439575194
30th percentile: 3.0029582023620605
99th percentile: 3.994140691757202
70th percentile: 3.1409758567810058
80th percentile: 3.1599216938018797
40th percentile: 3.01536865234375
mean time: 3.349190187454224
Received healthy response to inference request in 3.7723453044891357s
80th percentile: 3.3913652420043947
90th percentile: 3.2114750385284423
50th percentile: 3.0277791023254395
Pipeline stage StressChecker completed in 45.33s
5 requests
90th percentile: 3.8667675018310548
95th percentile: 3.237251710891724
60th percentile: 3.0360198974609376
run pipeline stage %s
0 failed requests
95th percentile: 4.104468631744385
99th percentile: 3.257873048782349
70th percentile: 3.0442606925964357
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
5th percentile: 2.822111463546753
99th percentile: 4.294629535675049
mean time: 3.071990633010864
80th percentile: 3.085161018371582
run_pipeline:run_in_cloud %s
10th percentile: 2.822297525405884
mean time: 3.289468765258789
Pipeline stage StressChecker completed in 47.71s
90th percentile: 3.158720874786377
starting trigger_guanaco_pipeline args=%s
20th percentile: 2.8226696491241454
Pipeline stage StressChecker completed in 49.95s
run pipeline stage %s
95th percentile: 3.1955008029937746
triggered trigger_guanaco_pipeline args=%s
30th percentile: 2.8570940494537354
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
99th percentile: 3.2249247455596923
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 8.55s
40th percentile: 2.9255707263946533
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
mean time: 2.986055278778076
run pipeline stage %s
50th percentile: 2.9940474033355713
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage StressChecker completed in 51.33s
Running pipeline stage TriggerMKMLProfilingPipeline
60th percentile: 3.0721170902252197
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
run_pipeline:run_in_cloud %s
70th percentile: 3.150186777114868
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 7.42s
starting trigger_guanaco_pipeline args=%s
80th percentile: 3.305846357345581
run_pipeline:run_in_cloud %s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 7.58s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
90th percentile: 3.5390958309173586
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Pipeline stage TriggerMKMLProfilingPipeline completed in 8.16s
95th percentile: 3.655720567703247
Running pipeline stage TriggerMKMLProfilingPipeline
triggered trigger_guanaco_pipeline args=%s
run_pipeline:run_in_cloud %s
Shutdown handler de-registered
99th percentile: 3.749020357131958
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 7.39s
starting trigger_guanaco_pipeline args=%s
chaiml-mistral-24b-2048_90555_v2 status is now deployed due to DeploymentManager action
mean time: 3.1200790882110594
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
Pipeline stage StressChecker completed in 55.42s
triggered trigger_guanaco_pipeline args=%s
Running pipeline stage TriggerMKMLProfilingPipeline
triggered trigger_guanaco_pipeline args=%s
run pipeline stage %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 7.22s
run_pipeline:run_in_cloud %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 6.79s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Shutdown handler de-registered
starting trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
Shutdown handler de-registered
run_pipeline:run_in_cloud %s
chaiml-mistral-24b-2048-1_404_v2 status is now inactive due to auto deactivation removed underperforming models