chaiml-mistral-24b-2048_44577

developer_uid: rirv938
submission_id: chaiml-mistral-24b-2048_44577_v2
model_name: chaiml-mistral-24b-2048_44577_v2
model_group: ChaiML/mistral_24b_2048_
status: torndown
timestamp: 2026-02-16T07:31:52+00:00
num_battles: 10333
num_wins: 5796
celo_rating: 1343.68
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 96
reward_model: default
display_name: chaiml-mistral-24b-2048_44577_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-12
win_ratio: 0.560921320042582
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['###', 'You:', '<|im_start|>', '</s>', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 96}
formatter: {'memory_template': '[SYSTEM_PROMPT]Respond as a high quality storyteller.[/SYSTEM_PROMPT][INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-44577-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-76177-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-86542-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-43874-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-96633-v3-mkmlizer to finish
chaiml-mistral-24b-2048-76177-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-76177-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Downloaded to shared memory in 87.419s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmptrya8kdx, device:0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Downloaded to shared memory in 88.185s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged already exists in ChaiML
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmprxnhlspj, device:0
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Downloaded to shared memory in 83.519s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged already exists in ChaiML
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp8x96bzps, device:0
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Downloaded to shared memory in 85.670s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp0orit2cp, device:0
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Downloaded to shared memory in 90.956s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged already exists in ChaiML
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp042ru3xu, device:0
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-76177-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:32, 1.32it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:32, 1.32it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:44, 1.13s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:44, 1.13s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:26, 1.41s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:26, 1.41s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:44, 1.15it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:44, 1.15it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:15, 1.27it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:15, 1.27it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.31it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.31it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:09, 2.02it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:09, 2.02it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:47, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:47, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:33, 1.22it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:33, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:47, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:47, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:32, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:32, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:14, 1.78it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:14, 1.78it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:50, 1.40it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:50, 1.40it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:32, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:32, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:40<01:47, 2.08it/s]
Loading 0:  38%|███▊      | 139/363 [01:40<01:47, 2.08it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.09it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.09it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.09it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.09it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.10it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.10it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.08it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.08it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:03, 2.10it/s]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:03, 2.10it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.15s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:46, 2.10it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:46, 2.10it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.84it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.84it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:37, 2.41s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:37, 2.41s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.34s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.34s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.29s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.29s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:22, 1.10s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:22, 1.10s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 292/363 [03:48<01:16, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:48<01:16, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.24s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.24s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:51, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:51, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.15s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.15s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0:  98%|█████████▊| 355/363 [04:31<00:03, 2.09it/s]
Loading 0:  98%|█████████▊| 355/363 [04:31<00:03, 2.09it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.88it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.88it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.48it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.48it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmptrya8kdx' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantized model in 284.265s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged in 371.685s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:20, 1.38it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:20, 1.38it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:03, 1.18s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:03, 1.18s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:05, 1.53s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:05, 1.53s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:10, 1.84it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:10, 1.84it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:07, 1.41it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:07, 1.41it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:25, 1.07it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:25, 1.07it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:49, 1.18s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:49, 1.18s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:09, 1.37it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:09, 1.37it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:10, 1.10it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:10, 1.10it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:20, 1.12s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:20, 1.12s/it]
Loading 0:   8%|▊         | 30.0/363 [00:22<02:58, 1.87it/s]
Loading 0:   8%|▊         | 30.0/363 [00:22<02:58, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:28, 1.58it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:28, 1.58it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:20, 1.26it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:20, 1.26it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:22, 1.02it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:22, 1.02it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:47, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:47, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:35, 1.23s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:35, 1.23s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:37<02:41, 1.94it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:37<02:41, 1.94it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<02:59, 1.73it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<02:59, 1.73it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<03:45, 1.38it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<03:45, 1.38it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:44<04:40, 1.10it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:44<04:40, 1.10it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:46<04:08, 1.23it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:46<04:08, 1.23it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:47<04:58, 1.02it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:47<04:58, 1.02it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:49<05:54, 1.17s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:49<05:54, 1.17s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:51<02:24, 2.05it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:51<02:24, 2.05it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:53<02:43, 1.79it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:53<02:43, 1.79it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:55<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:55<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:57<04:19, 1.12it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:57<04:19, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [00:59<03:50, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:59<03:50, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [01:01<04:37, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [01:01<04:37, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [01:03<05:30, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [01:03<05:30, 1.16s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:04<02:14, 2.06it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:04<02:14, 2.06it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:06<02:32, 1.81it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:06<02:32, 1.81it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:08<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:08<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:10<04:02, 1.12it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:10<04:02, 1.12it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:11<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:11<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:13<02:10, 2.00it/s] 
Loading 0:  28%|██▊       | 101/363 [01:13<02:10, 2.00it/s]
Loading 0:  28%|██▊       | 102/363 [01:15<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 102/363 [01:15<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 103/363 [01:17<03:35, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:17<03:35, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:19<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:19<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:21<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:21<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:23<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:23<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:25<03:53, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:25<03:53, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:27<04:34, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:27<04:34, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:29<05:19, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:29<05:19, 1.28s/it]
Loading 0:  33%|███▎      | 120/363 [01:30<02:08, 1.89it/s]
Loading 0:  33%|███▎      | 120/363 [01:30<02:08, 1.89it/s]
Loading 0:  34%|███▍      | 124/363 [01:33<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 124/363 [01:33<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 125/363 [01:35<02:49, 1.41it/s]
Loading 0:  34%|███▍      | 125/363 [01:35<02:49, 1.41it/s]
Loading 0:  35%|███▍      | 126/363 [01:37<03:32, 1.12it/s]
Loading 0:  35%|███▍      | 126/363 [01:37<03:32, 1.12it/s]
Loading 0:  36%|███▌      | 129/363 [01:39<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:39<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:41<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:41<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:43<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:43<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 138/363 [01:44<01:55, 1.96it/s]
Loading 0:  38%|███▊      | 138/363 [01:44<01:55, 1.96it/s]
Loading 0:  39%|███▉      | 142/363 [01:46<02:01, 1.83it/s]
Loading 0:  39%|███▉      | 142/363 [01:46<02:01, 1.83it/s]
Loading 0:  39%|███▉      | 143/363 [01:48<02:33, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:48<02:33, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:50<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:50<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:52<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:52<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:54<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:54<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:56<04:06, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:56<04:06, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:57<01:40, 2.05it/s]
Loading 0:  43%|████▎     | 157/363 [01:57<01:40, 2.05it/s]
Loading 0:  44%|████▍     | 160/363 [01:59<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 160/363 [01:59<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 161/363 [02:01<02:22, 1.41it/s]
Loading 0:  44%|████▍     | 161/363 [02:01<02:22, 1.41it/s]
Loading 0:  45%|████▍     | 162/363 [02:03<02:58, 1.12it/s]
Loading 0:  45%|████▍     | 162/363 [02:03<02:58, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:05<02:38, 1.25it/s]
Loading 0:  45%|████▌     | 165/363 [02:05<02:38, 1.25it/s]
Loading 0:  46%|████▌     | 166/363 [02:07<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 166/363 [02:07<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 167/363 [02:09<03:46, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:09<03:46, 1.16s/it]
Loading 0:  48%|████▊     | 175/363 [02:11<01:31, 2.05it/s]
Loading 0:  48%|████▊     | 175/363 [02:11<01:31, 2.05it/s]
Loading 0:  49%|████▉     | 178/363 [02:13<01:42, 1.80it/s]
Loading 0:  49%|████▉     | 178/363 [02:13<01:42, 1.80it/s]
Loading 0:  49%|████▉     | 179/363 [02:15<02:10, 1.41it/s]
Loading 0:  49%|████▉     | 179/363 [02:15<02:10, 1.41it/s]
Loading 0:  50%|████▉     | 180/363 [02:17<02:42, 1.12it/s]
Loading 0:  50%|████▉     | 180/363 [02:17<02:42, 1.12it/s]
Loading 0:  50%|█████     | 183/363 [02:19<02:23, 1.25it/s]
Loading 0:  50%|█████     | 183/363 [02:19<02:23, 1.25it/s]
Loading 0:  51%|█████     | 184/363 [02:21<02:53, 1.03it/s]
Loading 0:  51%|█████     | 184/363 [02:21<02:53, 1.03it/s]
Loading 0:  51%|█████     | 185/363 [02:23<03:26, 1.16s/it]
Loading 0:  51%|█████     | 185/363 [02:23<03:26, 1.16s/it]
Loading 0:  53%|█████▎    | 193/363 [02:24<01:22, 2.05it/s]
Loading 0:  53%|█████▎    | 193/363 [02:24<01:22, 2.05it/s]
Loading 0:  54%|█████▍    | 196/363 [02:26<01:32, 1.80it/s]
Loading 0:  54%|█████▍    | 196/363 [02:26<01:32, 1.80it/s]
Loading 0:  54%|█████▍    | 197/363 [02:28<01:57, 1.41it/s]
Loading 0:  54%|█████▍    | 197/363 [02:28<01:57, 1.41it/s]
Loading 0:  55%|█████▍    | 198/363 [02:30<02:26, 1.13it/s]
Loading 0:  55%|█████▍    | 198/363 [02:30<02:26, 1.13it/s]
Loading 0:  55%|█████▌    | 201/363 [02:32<02:09, 1.25it/s]
Loading 0:  55%|█████▌    | 201/363 [02:32<02:09, 1.25it/s]
Loading 0:  56%|█████▌    | 202/363 [02:34<02:35, 1.03it/s]
Loading 0:  56%|█████▌    | 202/363 [02:34<02:35, 1.03it/s]
Loading 0:  56%|█████▌    | 203/363 [02:36<03:04, 1.16s/it]
Loading 0:  56%|█████▌    | 203/363 [02:36<03:04, 1.16s/it]
Loading 0:  58%|█████▊    | 210/363 [02:37<01:18, 1.96it/s]
Loading 0:  58%|█████▊    | 210/363 [02:37<01:18, 1.96it/s]
Loading 0:  59%|█████▉    | 214/363 [02:39<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:39<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:41<01:43, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:41<01:43, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:43<02:08, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:43<02:08, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:45<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:45<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:47<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:47<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:49<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:49<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:51<01:04, 2.07it/s]
Loading 0:  63%|██████▎   | 229/363 [02:51<01:04, 2.07it/s]
Loading 0:  64%|██████▍   | 232/363 [02:53<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 232/363 [02:53<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 233/363 [02:55<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 233/363 [02:55<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 234/363 [02:57<01:53, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:57<01:53, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [02:59<01:40, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:59<01:40, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [03:01<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [03:01<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [03:03<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [03:03<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 247/363 [03:04<00:56, 2.07it/s]
Loading 0:  68%|██████▊   | 247/363 [03:04<00:56, 2.07it/s]
Loading 0:  69%|██████▉   | 250/363 [03:06<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 250/363 [03:06<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 251/363 [03:08<01:19, 1.42it/s]
Loading 0:  69%|██████▉   | 251/363 [03:08<01:19, 1.42it/s]
Loading 0:  69%|██████▉   | 252/363 [03:10<01:38, 1.13it/s]
Loading 0:  69%|██████▉   | 252/363 [03:10<01:38, 1.13it/s]
Loading 0:  70%|███████   | 255/363 [03:12<01:26, 1.25it/s]
Loading 0:  70%|███████   | 255/363 [03:12<01:26, 1.25it/s]
Loading 0:  71%|███████   | 256/363 [03:14<01:43, 1.03it/s]
Loading 0:  71%|███████   | 256/363 [03:14<01:43, 1.03it/s]
Loading 0:  71%|███████   | 257/363 [03:16<02:02, 1.16s/it]
Loading 0:  71%|███████   | 257/363 [03:16<02:02, 1.16s/it]
Loading 0:  73%|███████▎  | 265/363 [03:17<00:47, 2.08it/s]
Loading 0:  73%|███████▎  | 265/363 [03:17<00:47, 2.08it/s]
Loading 0:  74%|███████▍  | 268/363 [03:19<00:52, 1.81it/s]
Loading 0:  74%|███████▍  | 268/363 [03:19<00:52, 1.81it/s]
Loading 0:  74%|███████▍  | 269/363 [03:21<01:06, 1.42it/s]
Loading 0:  74%|███████▍  | 269/363 [03:21<01:06, 1.42it/s]
Loading 0:  74%|███████▍  | 270/363 [03:23<01:22, 1.12it/s]
Loading 0:  74%|███████▍  | 270/363 [03:23<01:22, 1.12it/s]
Loading 0:  75%|███████▌  | 273/363 [03:39<03:43, 2.48s/it]
Loading 0:  75%|███████▌  | 273/363 [03:39<03:43, 2.48s/it]
Loading 0:  75%|███████▌  | 274/363 [03:41<03:33, 2.40s/it]
Loading 0:  75%|███████▌  | 274/363 [03:41<03:33, 2.40s/it]
Loading 0:  76%|███████▌  | 275/363 [03:43<03:26, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:43<03:26, 2.35s/it]
Loading 0:  78%|███████▊  | 283/363 [03:44<01:10, 1.14it/s]
Loading 0:  78%|███████▊  | 283/363 [03:44<01:10, 1.14it/s]
Loading 0:  79%|███████▉  | 286/363 [03:46<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:46<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:48<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:48<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:50<01:22, 1.10s/it]
Loading 0:  79%|███████▉  | 288/363 [03:50<01:22, 1.10s/it]
Loading 0:  80%|████████  | 291/363 [03:52<01:06, 1.09it/s]
Loading 0:  80%|████████  | 291/363 [03:52<01:06, 1.09it/s]
Loading 0:  80%|████████  | 292/363 [03:54<01:16, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:54<01:16, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:56<01:27, 1.25s/it]
Loading 0:  81%|████████  | 293/363 [03:56<01:27, 1.25s/it]
Loading 0:  83%|████████▎ | 301/363 [03:57<00:31, 1.96it/s]
Loading 0:  83%|████████▎ | 301/363 [03:57<00:31, 1.96it/s]
Loading 0:  84%|████████▎ | 304/363 [03:59<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:59<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [04:01<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 305/363 [04:01<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 306/363 [04:03<00:51, 1.11it/s]
Loading 0:  84%|████████▍ | 306/363 [04:03<00:51, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:05<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [04:05<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:07<00:51, 1.03it/s]
Loading 0:  85%|████████▌ | 310/363 [04:07<00:51, 1.03it/s]
Loading 0:  86%|████████▌ | 311/363 [04:09<01:00, 1.16s/it]
Loading 0:  86%|████████▌ | 311/363 [04:09<01:00, 1.16s/it]
Loading 0:  88%|████████▊ | 319/363 [04:10<00:21, 2.07it/s]
Loading 0:  88%|████████▊ | 319/363 [04:10<00:21, 2.07it/s]
Loading 0:  89%|████████▊ | 322/363 [04:13<00:22, 1.81it/s]
Loading 0:  89%|████████▊ | 322/363 [04:13<00:22, 1.81it/s]
Loading 0:  89%|████████▉ | 323/363 [04:14<00:28, 1.41it/s]
Loading 0:  89%|████████▉ | 323/363 [04:14<00:28, 1.41it/s]
Loading 0:  89%|████████▉ | 324/363 [04:17<00:34, 1.12it/s]
Loading 0:  89%|████████▉ | 324/363 [04:17<00:34, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:18<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 327/363 [04:18<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 328/363 [04:20<00:34, 1.02it/s]
Loading 0:  90%|█████████ | 328/363 [04:20<00:34, 1.02it/s]
Loading 0:  91%|█████████ | 329/363 [04:23<00:39, 1.17s/it]
Loading 0:  91%|█████████ | 329/363 [04:23<00:39, 1.17s/it]
Loading 0:  93%|█████████▎| 337/363 [04:24<00:12, 2.07it/s]
Loading 0:  93%|█████████▎| 337/363 [04:24<00:12, 2.07it/s]
Loading 0:  94%|█████████▎| 340/363 [04:26<00:12, 1.80it/s]
Loading 0:  94%|█████████▎| 340/363 [04:26<00:12, 1.80it/s]
Loading 0:  94%|█████████▍| 341/363 [04:28<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 341/363 [04:28<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 342/363 [04:30<00:18, 1.12it/s]
Loading 0:  94%|█████████▍| 342/363 [04:30<00:18, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [04:32<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 345/363 [04:32<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 346/363 [04:34<00:16, 1.02it/s]
Loading 0:  95%|█████████▌| 346/363 [04:34<00:16, 1.02it/s]
Loading 0:  96%|█████████▌| 347/363 [04:36<00:18, 1.17s/it]
Loading 0:  96%|█████████▌| 347/363 [04:36<00:18, 1.17s/it]
Loading 0:  98%|█████████▊| 355/363 [04:37<00:03, 2.06it/s]
Loading 0:  98%|█████████▊| 355/363 [04:37<00:03, 2.06it/s]
Loading 0:  99%|█████████▉| 359/363 [04:40<00:02, 1.84it/s]
Loading 0:  99%|█████████▉| 359/363 [04:40<00:02, 1.84it/s]
Loading 0:  99%|█████████▉| 360/363 [04:42<00:02, 1.45it/s]
Loading 0:  99%|█████████▉| 360/363 [04:42<00:02, 1.45it/s]
Loading 0:  99%|█████████▉| 361/363 [04:44<00:01, 1.16it/s]
Loading 0:  99%|█████████▉| 361/363 [04:44<00:01, 1.16it/s]
Loading 0: 100%|██████████| 363/363 [04:44<00:00, 1.16it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:44<00:00, 1.28it/s]
chaiml-mistral-24b-2048-96633-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmp0orit2cp' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantized model in 285.136s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged in 370.807s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp8x96bzps' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantized model in 291.990s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged in 375.511s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:45, 1.26it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:45, 1.26it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:43, 1.29s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:43, 1.29s/it]
Loading 0:   1%|▏         | 5.00/363 [00:07<09:54, 1.66s/it]
Loading 0:   1%|▏         | 5.00/363 [00:07<09:54, 1.66s/it]
Loading 0:   3%|▎         | 11.0/363 [00:08<03:25, 1.71it/s]
Loading 0:   3%|▎         | 11.0/363 [00:08<03:25, 1.71it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0:   4%|▍         | 14.0/363 [00:13<05:50, 1.00s/it]
Loading 0:   4%|▍         | 14.0/363 [00:13<05:50, 1.00s/it]
Loading 0:   4%|▍         | 15.0/363 [00:15<07:21, 1.27s/it]
Loading 0:   4%|▍         | 15.0/363 [00:15<07:21, 1.27s/it]
Loading 0:   6%|▌         | 21.0/363 [00:18<04:28, 1.27it/s]
Loading 0:   6%|▌         | 21.0/363 [00:18<04:28, 1.27it/s]
Loading 0:   6%|▌         | 22.0/363 [00:20<05:35, 1.02it/s]
Loading 0:   6%|▌         | 22.0/363 [00:20<05:35, 1.02it/s]
Loading 0:   6%|▋         | 23.0/363 [00:23<06:51, 1.21s/it]
Loading 0:   6%|▋         | 23.0/363 [00:23<06:51, 1.21s/it]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:14, 1.72it/s]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:14, 1.72it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:28, 1.57it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:28, 1.57it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:30, 1.21it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:30, 1.21it/s]
Loading 0:  10%|▉         | 36.0/363 [00:32<05:36, 1.03s/it]
Loading 0:  10%|▉         | 36.0/363 [00:32<05:36, 1.03s/it]
Loading 0:  11%|█         | 39.0/363 [00:34<05:01, 1.08it/s]
Loading 0:  11%|█         | 39.0/363 [00:34<05:01, 1.08it/s]
Loading 0:  11%|█         | 40.0/363 [00:36<06:02, 1.12s/it]
Loading 0:  11%|█         | 40.0/363 [00:36<06:02, 1.12s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:39<07:10, 1.34s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:39<07:10, 1.34s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:40<03:06, 1.69it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:40<03:06, 1.69it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:43<03:15, 1.59it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:43<03:15, 1.59it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:45<04:08, 1.25it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:45<04:08, 1.25it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:47<05:11, 1.01s/it]
Loading 0:  15%|█▍        | 54.0/363 [00:47<05:11, 1.01s/it]
Loading 0:  16%|█▌        | 57.0/363 [00:49<04:38, 1.10it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:49<04:38, 1.10it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:52<05:37, 1.11s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:52<05:37, 1.11s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:54<06:42, 1.32s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:54<06:42, 1.32s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:55<02:54, 1.70it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:55<02:54, 1.70it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:58<03:04, 1.59it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:58<03:04, 1.59it/s]
Loading 0:  20%|█▉        | 71.0/363 [01:00<03:54, 1.24it/s]
Loading 0:  20%|█▉        | 71.0/363 [01:00<03:54, 1.24it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:03<04:55, 1.01s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:03<04:55, 1.01s/it]
Loading 0:  21%|██        | 75.0/363 [01:05<04:23, 1.09it/s]
Loading 0:  21%|██        | 75.0/363 [01:05<04:23, 1.09it/s]
Loading 0:  21%|██        | 76.0/363 [01:07<05:17, 1.10s/it]
Loading 0:  21%|██        | 76.0/363 [01:07<05:17, 1.10s/it]
Loading 0:  21%|██        | 77.0/363 [01:09<06:16, 1.32s/it]
Loading 0:  21%|██        | 77.0/363 [01:09<06:16, 1.32s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:10<02:41, 1.73it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:10<02:41, 1.73it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:13<02:50, 1.61it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:13<02:50, 1.61it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:15<03:36, 1.26it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:15<03:36, 1.26it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:18<04:31, 1.00it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:18<04:31, 1.00it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:19<02:16, 1.95it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:19<02:16, 1.95it/s]
Loading 0:  28%|██▊       | 101/363 [01:21<02:26, 1.79it/s] 
Loading 0:  28%|██▊       | 101/363 [01:21<02:26, 1.79it/s]
Loading 0:  28%|██▊       | 102/363 [01:24<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:24<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:26<04:02, 1.07it/s]
Loading 0:  28%|██▊       | 103/363 [01:26<04:02, 1.07it/s]
Loading 0:  29%|██▉       | 106/363 [01:28<03:47, 1.13it/s]
Loading 0:  29%|██▉       | 106/363 [01:28<03:47, 1.13it/s]
Loading 0:  29%|██▉       | 107/363 [01:31<04:44, 1.11s/it]
Loading 0:  29%|██▉       | 107/363 [01:31<04:44, 1.11s/it]
Loading 0:  30%|██▉       | 108/363 [01:33<05:40, 1.34s/it]
Loading 0:  30%|██▉       | 108/363 [01:33<05:40, 1.34s/it]
Loading 0:  31%|███       | 111/363 [01:36<04:38, 1.11s/it]
Loading 0:  31%|███       | 111/363 [01:36<04:38, 1.11s/it]
Loading 0:  31%|███       | 112/363 [01:38<05:32, 1.32s/it]
Loading 0:  31%|███       | 112/363 [01:38<05:32, 1.32s/it]
Loading 0:  31%|███       | 113/363 [01:40<06:26, 1.55s/it]
Loading 0:  31%|███       | 113/363 [01:40<06:26, 1.55s/it]
Loading 0:  33%|███▎      | 120/363 [01:42<02:35, 1.56it/s]
Loading 0:  33%|███▎      | 120/363 [01:42<02:35, 1.56it/s]
Loading 0:  34%|███▍      | 124/363 [01:45<02:55, 1.36it/s]
Loading 0:  34%|███▍      | 124/363 [01:45<02:55, 1.36it/s]
Loading 0:  34%|███▍      | 125/363 [01:48<03:50, 1.03it/s]
Loading 0:  34%|███▍      | 125/363 [01:48<03:50, 1.03it/s]
Loading 0:  35%|███▍      | 126/363 [01:51<04:35, 1.16s/it]
Loading 0:  35%|███▍      | 126/363 [01:51<04:35, 1.16s/it]
Loading 0:  36%|███▌      | 129/363 [01:53<03:56, 1.01s/it]
Loading 0:  36%|███▌      | 129/363 [01:53<03:56, 1.01s/it]
Loading 0:  36%|███▌      | 130/363 [01:55<04:47, 1.23s/it]
Loading 0:  36%|███▌      | 130/363 [01:55<04:47, 1.23s/it]
Loading 0:  36%|███▌      | 131/363 [01:58<05:47, 1.50s/it]
Loading 0:  36%|███▌      | 131/363 [01:58<05:47, 1.50s/it]
Loading 0:  38%|███▊      | 138/363 [01:59<02:27, 1.52it/s]
Loading 0:  38%|███▊      | 138/363 [01:59<02:27, 1.52it/s]
Loading 0:  39%|███▉      | 142/363 [02:02<02:34, 1.43it/s]
Loading 0:  39%|███▉      | 142/363 [02:02<02:34, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [02:05<03:13, 1.14it/s]
Loading 0:  39%|███▉      | 143/363 [02:05<03:13, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [02:07<03:59, 1.09s/it]
Loading 0:  40%|███▉      | 144/363 [02:07<03:59, 1.09s/it]
Loading 0:  40%|████      | 147/363 [02:10<03:31, 1.02it/s]
Loading 0:  40%|████      | 147/363 [02:10<03:31, 1.02it/s]
Loading 0:  41%|████      | 148/363 [02:12<04:14, 1.19s/it]
Loading 0:  41%|████      | 148/363 [02:12<04:14, 1.19s/it]
Loading 0:  41%|████      | 149/363 [02:14<05:02, 1.41s/it]
Loading 0:  41%|████      | 149/363 [02:14<05:02, 1.41s/it]
Loading 0:  43%|████▎     | 156/363 [02:16<02:08, 1.61it/s]
Loading 0:  43%|████▎     | 156/363 [02:16<02:08, 1.61it/s]
Loading 0:  44%|████▍     | 160/363 [02:18<02:12, 1.54it/s]
Loading 0:  44%|████▍     | 160/363 [02:18<02:12, 1.54it/s]
Loading 0:  44%|████▍     | 161/363 [02:21<02:47, 1.20it/s]
Loading 0:  44%|████▍     | 161/363 [02:21<02:47, 1.20it/s]
Loading 0:  45%|████▍     | 162/363 [02:23<03:23, 1.01s/it]
Loading 0:  45%|████▍     | 162/363 [02:23<03:23, 1.01s/it]
Loading 0:  45%|████▌     | 165/363 [02:25<02:57, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:25<02:57, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:27<03:32, 1.08s/it]
Loading 0:  46%|████▌     | 166/363 [02:27<03:32, 1.08s/it]
Loading 0:  46%|████▌     | 167/363 [02:29<04:10, 1.28s/it]
Loading 0:  46%|████▌     | 167/363 [02:29<04:10, 1.28s/it]
Loading 0:  48%|████▊     | 174/363 [02:30<01:45, 1.78it/s]
Loading 0:  48%|████▊     | 174/363 [02:30<01:45, 1.78it/s]
Loading 0:  49%|████▉     | 178/363 [02:33<01:50, 1.68it/s]
Loading 0:  49%|████▉     | 178/363 [02:33<01:50, 1.68it/s]
Loading 0:  49%|████▉     | 179/363 [02:35<02:19, 1.32it/s]
Loading 0:  49%|████▉     | 179/363 [02:35<02:19, 1.32it/s]
Loading 0:  50%|████▉     | 180/363 [02:37<02:53, 1.05it/s]
Loading 0:  50%|████▉     | 180/363 [02:37<02:53, 1.05it/s]
Loading 0:  50%|█████     | 183/363 [02:39<02:34, 1.17it/s]
Loading 0:  50%|█████     | 183/363 [02:39<02:34, 1.17it/s]
Loading 0:  51%|█████     | 184/363 [02:41<03:05, 1.04s/it]
Loading 0:  51%|█████     | 184/363 [02:41<03:05, 1.04s/it]
Loading 0:  51%|█████     | 185/363 [02:44<03:40, 1.24s/it]
Loading 0:  51%|█████     | 185/363 [02:44<03:40, 1.24s/it]
Loading 0:  53%|█████▎    | 192/363 [02:45<01:34, 1.82it/s]
Loading 0:  53%|█████▎    | 192/363 [02:45<01:34, 1.82it/s]
Loading 0:  54%|█████▍    | 196/363 [02:47<01:38, 1.69it/s]
Loading 0:  54%|█████▍    | 196/363 [02:47<01:38, 1.69it/s]
Loading 0:  54%|█████▍    | 197/363 [02:50<02:04, 1.33it/s]
Loading 0:  54%|█████▍    | 197/363 [02:50<02:04, 1.33it/s]
Loading 0:  55%|█████▍    | 198/363 [02:52<02:35, 1.06it/s]
Loading 0:  55%|█████▍    | 198/363 [02:52<02:35, 1.06it/s]
Loading 0:  55%|█████▌    | 201/363 [02:54<02:18, 1.17it/s]
Loading 0:  55%|█████▌    | 201/363 [02:54<02:18, 1.17it/s]
Loading 0:  56%|█████▌    | 202/363 [02:56<02:46, 1.04s/it]
Loading 0:  56%|█████▌    | 202/363 [02:56<02:46, 1.04s/it]
Loading 0:  56%|█████▌    | 203/363 [02:58<03:18, 1.24s/it]
Loading 0:  56%|█████▌    | 203/363 [02:58<03:18, 1.24s/it]
Loading 0:  58%|█████▊    | 210/363 [02:59<01:23, 1.82it/s]
Loading 0:  58%|█████▊    | 210/363 [02:59<01:23, 1.82it/s]
Loading 0:  59%|█████▉    | 214/363 [03:02<01:27, 1.69it/s]
Loading 0:  59%|█████▉    | 214/363 [03:02<01:27, 1.69it/s]
Loading 0:  59%|█████▉    | 215/363 [03:04<01:51, 1.33it/s]
Loading 0:  59%|█████▉    | 215/363 [03:04<01:51, 1.33it/s]
Loading 0:  60%|█████▉    | 216/363 [03:06<02:18, 1.06it/s]
Loading 0:  60%|█████▉    | 216/363 [03:06<02:18, 1.06it/s]
Loading 0:  60%|██████    | 219/363 [03:08<02:02, 1.17it/s]
Loading 0:  60%|██████    | 219/363 [03:08<02:02, 1.17it/s]
Loading 0:  61%|██████    | 220/363 [03:10<02:27, 1.03s/it]
Loading 0:  61%|██████    | 220/363 [03:10<02:27, 1.03s/it]
Loading 0:  61%|██████    | 221/363 [03:12<02:56, 1.24s/it]
Loading 0:  61%|██████    | 221/363 [03:12<02:56, 1.24s/it]
Loading 0:  63%|██████▎   | 228/363 [03:14<01:14, 1.82it/s]
Loading 0:  63%|██████▎   | 228/363 [03:14<01:14, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [03:16<01:17, 1.69it/s]
Loading 0:  64%|██████▍   | 232/363 [03:16<01:17, 1.69it/s]
Loading 0:  64%|██████▍   | 233/363 [03:18<01:37, 1.33it/s]
Loading 0:  64%|██████▍   | 233/363 [03:18<01:37, 1.33it/s]
Loading 0:  64%|██████▍   | 234/363 [03:21<02:01, 1.06it/s]
Loading 0:  64%|██████▍   | 234/363 [03:21<02:01, 1.06it/s]
Loading 0:  65%|██████▌   | 237/363 [03:23<01:47, 1.17it/s]
Loading 0:  65%|██████▌   | 237/363 [03:23<01:47, 1.17it/s]
Loading 0:  66%|██████▌   | 238/363 [03:25<02:09, 1.04s/it]
Loading 0:  66%|██████▌   | 238/363 [03:25<02:09, 1.04s/it]
Loading 0:  66%|██████▌   | 239/363 [03:27<02:33, 1.24s/it]
Loading 0:  66%|██████▌   | 239/363 [03:27<02:33, 1.24s/it]
Loading 0:  68%|██████▊   | 246/363 [03:28<01:04, 1.82it/s]
Loading 0:  68%|██████▊   | 246/363 [03:28<01:04, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:31<01:06, 1.69it/s]
Loading 0:  69%|██████▉   | 250/363 [03:31<01:06, 1.69it/s]
Loading 0:  69%|██████▉   | 251/363 [03:33<01:24, 1.33it/s]
Loading 0:  69%|██████▉   | 251/363 [03:33<01:24, 1.33it/s]
Loading 0:  69%|██████▉   | 252/363 [03:35<01:45, 1.06it/s]
Loading 0:  69%|██████▉   | 252/363 [03:35<01:45, 1.06it/s]
Loading 0:  70%|███████   | 255/363 [03:37<01:32, 1.17it/s]
Loading 0:  70%|███████   | 255/363 [03:37<01:32, 1.17it/s]
Loading 0:  71%|███████   | 256/363 [03:39<01:50, 1.04s/it]
Loading 0:  71%|███████   | 256/363 [03:39<01:50, 1.04s/it]
Loading 0:  71%|███████   | 257/363 [03:41<02:11, 1.24s/it]
Loading 0:  71%|███████   | 257/363 [03:41<02:11, 1.24s/it]
Loading 0:  73%|███████▎  | 264/363 [03:42<00:54, 1.82it/s]
Loading 0:  73%|███████▎  | 264/363 [03:42<00:54, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:45<00:56, 1.69it/s]
Loading 0:  74%|███████▍  | 268/363 [03:45<00:56, 1.69it/s]
Loading 0:  74%|███████▍  | 269/363 [03:47<01:10, 1.33it/s]
Loading 0:  74%|███████▍  | 269/363 [03:47<01:10, 1.33it/s]
Loading 0:  74%|███████▍  | 270/363 [03:49<01:27, 1.06it/s]
Loading 0:  74%|███████▍  | 270/363 [03:49<01:27, 1.06it/s]
Loading 0:  75%|███████▌  | 273/363 [04:10<04:38, 3.09s/it]
Loading 0:  75%|███████▌  | 273/363 [04:10<04:38, 3.09s/it]
Loading 0:  75%|███████▌  | 274/363 [04:12<04:21, 2.94s/it]
Loading 0:  75%|███████▌  | 274/363 [04:12<04:21, 2.94s/it]
Loading 0:  76%|███████▌  | 275/363 [04:14<04:07, 2.82s/it]
Loading 0:  76%|███████▌  | 275/363 [04:14<04:07, 2.82s/it]
Loading 0:  78%|███████▊  | 283/363 [04:15<01:23, 1.04s/it]
Loading 0:  78%|███████▊  | 283/363 [04:15<01:23, 1.04s/it]
Loading 0:  79%|███████▉  | 286/363 [04:18<01:14, 1.03it/s]
Loading 0:  79%|███████▉  | 286/363 [04:18<01:14, 1.03it/s]
Loading 0:  79%|███████▉  | 287/363 [04:19<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 287/363 [04:19<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [04:22<01:31, 1.22s/it]
Loading 0:  79%|███████▉  | 288/363 [04:22<01:31, 1.22s/it]
Loading 0:  80%|████████  | 291/363 [04:24<01:13, 1.03s/it]
Loading 0:  80%|████████  | 291/363 [04:24<01:13, 1.03s/it]
Loading 0:  80%|████████  | 292/363 [04:26<01:24, 1.18s/it]
Loading 0:  80%|████████  | 292/363 [04:26<01:24, 1.18s/it]
Loading 0:  81%|████████  | 293/363 [04:28<01:35, 1.36s/it]
Loading 0:  81%|████████  | 293/363 [04:28<01:35, 1.36s/it]
Loading 0:  83%|████████▎ | 301/363 [04:29<00:34, 1.82it/s]
Loading 0:  83%|████████▎ | 301/363 [04:29<00:34, 1.82it/s]
Loading 0:  84%|████████▎ | 304/363 [04:31<00:35, 1.65it/s]
Loading 0:  84%|████████▎ | 304/363 [04:31<00:35, 1.65it/s]
Loading 0:  84%|████████▍ | 305/363 [04:33<00:44, 1.30it/s]
Loading 0:  84%|████████▍ | 305/363 [04:33<00:44, 1.30it/s]
Loading 0:  84%|████████▍ | 306/363 [04:36<00:55, 1.04it/s]
Loading 0:  84%|████████▍ | 306/363 [04:36<00:55, 1.04it/s]
Loading 0:  85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0:  85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0:  85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0:  85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0:  86%|████████▌ | 311/363 [04:42<01:03, 1.23s/it]
Loading 0:  86%|████████▌ | 311/363 [04:42<01:03, 1.23s/it]
Loading 0:  88%|████████▊ | 319/363 [04:43<00:22, 1.98it/s]
Loading 0:  88%|████████▊ | 319/363 [04:43<00:22, 1.98it/s]
Loading 0:  89%|████████▊ | 322/363 [04:45<00:23, 1.71it/s]
Loading 0:  89%|████████▊ | 322/363 [04:45<00:23, 1.71it/s]
Loading 0:  89%|████████▉ | 323/363 [04:47<00:30, 1.33it/s]
Loading 0:  89%|████████▉ | 323/363 [04:47<00:30, 1.33it/s]
Loading 0:  89%|████████▉ | 324/363 [04:50<00:36, 1.05it/s]
Loading 0:  89%|████████▉ | 324/363 [04:50<00:36, 1.05it/s]
Loading 0:  90%|█████████ | 327/363 [04:52<00:30, 1.17it/s]
Loading 0:  90%|█████████ | 327/363 [04:52<00:30, 1.17it/s]
Loading 0:  90%|█████████ | 328/363 [04:54<00:36, 1.04s/it]
Loading 0:  90%|█████████ | 328/363 [04:54<00:36, 1.04s/it]
Loading 0:  91%|█████████ | 329/363 [04:56<00:42, 1.24s/it]
Loading 0:  91%|█████████ | 329/363 [04:56<00:42, 1.24s/it]
Loading 0:  93%|█████████▎| 337/363 [04:57<00:13, 1.96it/s]
Loading 0:  93%|█████████▎| 337/363 [04:57<00:13, 1.96it/s]
Loading 0:  94%|█████████▎| 340/363 [05:00<00:13, 1.70it/s]
Loading 0:  94%|█████████▎| 340/363 [05:00<00:13, 1.70it/s]
Loading 0:  94%|█████████▍| 341/363 [05:02<00:16, 1.33it/s]
Loading 0:  94%|█████████▍| 341/363 [05:02<00:16, 1.33it/s]
Loading 0:  94%|█████████▍| 342/363 [05:04<00:19, 1.05it/s]
Loading 0:  94%|█████████▍| 342/363 [05:04<00:19, 1.05it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:15, 1.16it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:15, 1.16it/s]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:17, 1.04s/it]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:17, 1.04s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:19, 1.24s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:19, 1.24s/it]
Loading 0:  98%|█████████▊| 355/363 [05:11<00:04, 1.95it/s]
Loading 0:  98%|█████████▊| 355/363 [05:11<00:04, 1.95it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.75it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.75it/s]
Loading 0:  99%|█████████▉| 360/363 [05:16<00:02, 1.37it/s]
Loading 0:  99%|█████████▉| 360/363 [05:16<00:02, 1.37it/s]
Loading 0:  99%|█████████▉| 361/363 [05:18<00:01, 1.09it/s]
Loading 0:  99%|█████████▉| 361/363 [05:18<00:01, 1.09it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.09it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.14it/s]
chaiml-mistral-24b-2048-43874-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:11, 1.20s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:11, 1.20s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.85it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.85it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:44, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:44, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:51, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:51, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:10, 1.63it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:10, 1.63it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:01, 1.28it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:01, 1.28it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:04, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:04, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:32, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:32, 1.12it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:29, 1.08s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:29, 1.08s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:34, 1.30s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:34, 1.30s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<03:01, 1.62it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<03:01, 1.62it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:40, 1.73it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:40, 1.73it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:00, 1.08it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:00, 1.08it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.06s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.06s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:24, 1.27s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:24, 1.27s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:22, 1.04s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:22, 1.04s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:08, 1.23s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:08, 1.23s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:02, 1.45s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:02, 1.45s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:32, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:32, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<04:00, 1.01s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<04:00, 1.01s/it]
Loading 0:  36%|███▌      | 129/363 [01:47<03:32, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:47<03:32, 1.10it/s]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:04, 1.31s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:04, 1.31s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:53, 1.27it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:53, 1.27it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:37, 1.01it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:37, 1.01it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:13, 1.12it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:13, 1.12it/s]
Loading 0:  41%|████      | 148/363 [02:05<03:53, 1.09s/it]
Loading 0:  41%|████      | 148/363 [02:05<03:53, 1.09s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:38, 1.30s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:38, 1.30s/it]
Loading 0:  43%|████▎     | 156/363 [02:08<01:58, 1.75it/s]
Loading 0:  43%|████▎     | 156/363 [02:08<01:58, 1.75it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:04, 1.62it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:04, 1.62it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.12it/s]
Loading 0:  46%|████▌     | 166/363 [02:20<03:36, 1.10s/it]
Loading 0:  46%|████▌     | 166/363 [02:20<03:36, 1.10s/it]
Loading 0:  46%|████▌     | 167/363 [02:22<04:16, 1.31s/it]
Loading 0:  46%|████▌     | 167/363 [02:22<04:16, 1.31s/it]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.74it/s]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.74it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.62it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.62it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:24, 1.27it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:24, 1.27it/s]
Loading 0:  50%|████▉     | 180/363 [02:30<03:01, 1.01it/s]
Loading 0:  50%|████▉     | 180/363 [02:30<03:01, 1.01it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.12it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.12it/s]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:51, 1.30s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:51, 1.30s/it]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:37, 1.76it/s]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:37, 1.76it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:42, 1.63it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:42, 1.63it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:09, 1.28it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:09, 1.28it/s]
Loading 0:  55%|█████▍    | 198/363 [02:45<02:42, 1.02it/s]
Loading 0:  55%|█████▍    | 198/363 [02:45<02:42, 1.02it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:24, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:24, 1.12it/s]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:55, 1.09s/it]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:55, 1.09s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.30s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.30s/it]
Loading 0:  58%|█████▊    | 210/363 [02:53<01:27, 1.75it/s]
Loading 0:  58%|█████▊    | 210/363 [02:53<01:27, 1.75it/s]
Loading 0:  59%|█████▉    | 214/363 [02:56<01:31, 1.63it/s]
Loading 0:  59%|█████▉    | 214/363 [02:56<01:31, 1.63it/s]
Loading 0:  59%|█████▉    | 215/363 [02:58<01:56, 1.27it/s]
Loading 0:  59%|█████▉    | 215/363 [02:58<01:56, 1.27it/s]
Loading 0:  60%|█████▉    | 216/363 [03:00<02:25, 1.01it/s]
Loading 0:  60%|█████▉    | 216/363 [03:00<02:25, 1.01it/s]
Loading 0:  60%|██████    | 219/363 [03:03<02:08, 1.12it/s]
Loading 0:  60%|██████    | 219/363 [03:03<02:08, 1.12it/s]
Loading 0:  61%|██████    | 220/363 [03:05<02:35, 1.08s/it]
Loading 0:  61%|██████    | 220/363 [03:05<02:35, 1.08s/it]
Loading 0:  61%|██████    | 221/363 [03:07<03:04, 1.30s/it]
Loading 0:  61%|██████    | 221/363 [03:07<03:04, 1.30s/it]
Loading 0:  63%|██████▎   | 228/363 [03:08<01:17, 1.75it/s]
Loading 0:  63%|██████▎   | 228/363 [03:08<01:17, 1.75it/s]
Loading 0:  64%|██████▍   | 232/363 [03:11<01:20, 1.62it/s]
Loading 0:  64%|██████▍   | 232/363 [03:11<01:20, 1.62it/s]
Loading 0:  64%|██████▍   | 233/363 [03:13<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 233/363 [03:13<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:18<01:52, 1.12it/s]
Loading 0:  65%|██████▌   | 237/363 [03:18<01:52, 1.12it/s]
Loading 0:  66%|██████▌   | 238/363 [03:20<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 238/363 [03:20<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 239/363 [03:22<02:40, 1.30s/it]
Loading 0:  66%|██████▌   | 239/363 [03:22<02:40, 1.30s/it]
Loading 0:  68%|██████▊   | 246/363 [03:23<01:07, 1.74it/s]
Loading 0:  68%|██████▊   | 246/363 [03:23<01:07, 1.74it/s]
Loading 0:  69%|██████▉   | 250/363 [03:26<01:09, 1.62it/s]
Loading 0:  69%|██████▉   | 250/363 [03:26<01:09, 1.62it/s]
Loading 0:  69%|██████▉   | 251/363 [03:28<01:27, 1.27it/s]
Loading 0:  69%|██████▉   | 251/363 [03:28<01:27, 1.27it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:49, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:49, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:33<01:36, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:33<01:36, 1.12it/s]
Loading 0:  71%|███████   | 256/363 [03:35<01:55, 1.08s/it]
Loading 0:  71%|███████   | 256/363 [03:35<01:55, 1.08s/it]
Loading 0:  71%|███████   | 257/363 [03:37<02:17, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:37<02:17, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:38<00:56, 1.75it/s]
Loading 0:  73%|███████▎  | 264/363 [03:38<00:56, 1.75it/s]
Loading 0:  74%|███████▍  | 268/363 [03:41<00:58, 1.63it/s]
Loading 0:  74%|███████▍  | 268/363 [03:41<00:58, 1.63it/s]
Loading 0:  74%|███████▍  | 269/363 [03:43<01:13, 1.28it/s]
Loading 0:  74%|███████▍  | 269/363 [03:43<01:13, 1.28it/s]
Loading 0:  74%|███████▍  | 270/363 [03:46<01:31, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:46<01:31, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:02<03:55, 2.62s/it]
Loading 0:  75%|███████▌  | 273/363 [04:02<03:55, 2.62s/it]
Loading 0:  75%|███████▌  | 274/363 [04:04<03:46, 2.55s/it]
Loading 0:  75%|███████▌  | 274/363 [04:04<03:46, 2.55s/it]
Loading 0:  76%|███████▌  | 275/363 [04:06<03:40, 2.51s/it]
Loading 0:  76%|███████▌  | 275/363 [04:06<03:40, 2.51s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:22, 1.01s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:22, 1.01s/it]
Loading 0:  79%|███████▉  | 286/363 [04:10<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 286/363 [04:10<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 287/363 [04:12<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:12<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:31, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:31, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:17<01:14, 1.04s/it]
Loading 0:  80%|████████  | 291/363 [04:17<01:14, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [04:19<01:25, 1.21s/it]
Loading 0:  80%|████████  | 292/363 [04:19<01:25, 1.21s/it]
Loading 0:  81%|████████  | 293/363 [04:21<01:37, 1.40s/it]
Loading 0:  81%|████████  | 293/363 [04:21<01:37, 1.40s/it]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0:  84%|████████▎ | 304/363 [04:25<00:37, 1.57it/s]
Loading 0:  84%|████████▎ | 304/363 [04:25<00:37, 1.57it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:57, 1.00s/it]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:57, 1.00s/it]
Loading 0:  85%|████████▌ | 309/363 [04:32<00:48, 1.10it/s]
Loading 0:  85%|████████▌ | 309/363 [04:32<00:48, 1.10it/s]
Loading 0:  85%|████████▌ | 310/363 [04:34<00:58, 1.10s/it]
Loading 0:  85%|████████▌ | 310/363 [04:34<00:58, 1.10s/it]
Loading 0:  86%|████████▌ | 311/363 [04:36<01:07, 1.31s/it]
Loading 0:  86%|████████▌ | 311/363 [04:36<01:07, 1.31s/it]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0:  89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 328/363 [04:49<00:38, 1.09s/it]
Loading 0:  90%|█████████ | 328/363 [04:49<00:38, 1.09s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.31s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.31s/it]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.74it/s]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.74it/s]
Loading 0:  94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0:  94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0:  95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.31s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.31s/it]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.74it/s]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.74it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.66it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.66it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.40it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.40it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.15it/s]
chaiml-mistral-24b-2048-86542-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmprxnhlspj' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantized model in 329.653s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged in 417.842s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-43874-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp042ru3xu' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantized model in 323.456s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged in 414.413s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: Error parsing xml: syntax error: line 1, column 0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: b'upstream connect error or disconnect/reset before headers. reset reason: connection termination'
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (Service Unavailable))
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Waiting 3 sec...
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: Error parsing xml: syntax error: line 1, column 0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: b'upstream connect error or disconnect/reset before headers. reset reason: connection timeout'
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (Service Unavailable))
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Waiting 6 sec...
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Retrying failed request: / (503 (SlowDown))
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Waiting 3 sec...
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Retrying failed request: / (503 (SlowDown))
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Waiting 6 sec...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (SlowDown))
chaiml-mistral-24b-2048-86542-v2-mkmlizer: WARNING: Waiting 3 sec...
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (SlowDown))
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Waiting 12 sec...
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Retrying failed request: / (503 (SlowDown))
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Waiting 9 sec...
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-43874-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia
chaiml-mistral-24b-2048-43874-v2-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-43874-v2-mkmlizer: 	status code: 503, request id: tx000003d302fd6d8699b35-00698ea831-149d0ff886-default, host id: 
chaiml-mistral-24b-2048-44577-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/config.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/config.json
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/config.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/config.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/config.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-44577-v2-mkmlizer: 	status code: 504, request id: , host id: 
chaiml-mistral-24b-2048-43874-v2-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-43874-v2-mkmlizer: 	status code: 503, request id: , host id: 
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-96633-v3-mkmlizer: 	status code: 503, request id: , host id: 
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG retryable error: SlowDown: 
chaiml-mistral-24b-2048-96633-v3-mkmlizer: 	status code: 503, request id: tx00000c3c81122789cf4c8-00698eaa71-14a24de22e-default, host id: 
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~k4kjcIkpzSnJomj4iPqL8AQIhffOxLM caused by: SignatureDoesNotMatch:  status code: 403, request id: tx00000d5239dbad605b42b-00698eaa6c-14b33dd27d-default, host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-86542-v2-mkmlizer: 	status code: 504, request id: , host id: 
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-76177-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-76177-v2-mkmlizer: 	status code: 504, request id: , host id: 
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/flywheel_model.1.safetensors
Job chaiml-mistral-24b-2048-86542-v2-mkmlizer completed after 1208.72s with status: failed
Job failed chaiml-mistral-24b-2048-86542-v2-mkmlizer: 
Stopping job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-86542-v2-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-86542-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-86542-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: 	status code: 504, request id: , host id: 
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~dfjM52EwMr8dt5K7yQJivPxvXy1YuSz caused by: SignatureDoesNotMatch:  status code: 403, request id: tx000002607b794f12cfa60-00698eaa74-14a24de22e-default, host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
Job chaiml-mistral-24b-2048-96633-v3-mkmlizer completed after 1241.47s with status: failed
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
Job failed chaiml-mistral-24b-2048-96633-v3-mkmlizer: 
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~lUPYgZ09IprrDFHql6bC17E1cnur9kV caused by: SignatureDoesNotMatch:  status code: 403, request id: tx000008f342f17993101b9-00698eaa81-14a19326cd-default, host id:
Stopping job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
Job chaiml-mistral-24b-2048-76177-v2-mkmlizer completed after 1259.01s with status: failed
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~rVQch-gtjBbQkECUALXxbEFOrUIY3BP caused by: SignatureDoesNotMatch:  status code: 403, request id: tx00000051ad2f5b3b4e259-00698eaa6d-14b33dd27d-default, host id:
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
Job failed chaiml-mistral-24b-2048-76177-v2-mkmlizer: 
Job chaiml-mistral-24b-2048-43874-v2-mkmlizer completed after 1251.13s with status: failed
Starting job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
Stopping job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
Job failed chaiml-mistral-24b-2048-43874-v2-mkmlizer: 
Waiting for job on chaiml-mistral-24b-2048-96633-v3-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
%s, retrying in %s seconds...
Stopping job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
Starting job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/flywheel_model.1.safetensors": MultipartUpload: upload multipart failed upload id: 2~yj537QbuRgJ05ixOsjL6TTnYtr6TjRa caused by: SignatureDoesNotMatch:  status code: 403, request id: tx000001bf656bd2398699c-00698eaab0-14a24de22e-default, host id:
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: no job control in this shell
Waiting for job on chaiml-mistral-24b-2048-76177-v2-mkmlizer to finish
Starting job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
Job chaiml-mistral-24b-2048-44577-v2-mkmlizer completed after 1271.05s with status: failed
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
Waiting for job on chaiml-mistral-24b-2048-43874-v2-mkmlizer to finish
Job failed chaiml-mistral-24b-2048-44577-v2-mkmlizer: 
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  https://mk1.ai                                                     ║
Stopping job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
Starting job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
Waiting for job on chaiml-mistral-24b-2048-44577-v2-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Downloaded to shared memory in 85.689s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged already exists in ChaiML
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpfmjv9r1h, device:0
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Downloaded to shared memory in 81.489s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Downloaded to shared memory in 83.645s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged already exists in ChaiML
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Downloaded to shared memory in 80.818s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpeud9c_ya, device:0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpdfxn2f_s, device:0
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged already exists in ChaiML
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp9vlvegk0, device:0
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Downloaded to shared memory in 87.371s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpw4icn4mf, device:0
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-86542-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:37, 1.30it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:37, 1.30it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:28, 1.25s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:28, 1.25s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:36, 1.61s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:36, 1.61s/it]
Loading 0:   3%|▎         | 11.0/363 [00:08<03:20, 1.75it/s]
Loading 0:   3%|▎         | 11.0/363 [00:08<03:20, 1.75it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0:   4%|▍         | 14.0/363 [00:13<05:53, 1.01s/it]
Loading 0:   4%|▍         | 14.0/363 [00:13<05:53, 1.01s/it]
Loading 0:   4%|▍         | 15.0/363 [00:15<07:24, 1.28s/it]
Loading 0:   4%|▍         | 15.0/363 [00:15<07:24, 1.28s/it]
Loading 0:   6%|▌         | 21.0/363 [00:18<04:31, 1.26it/s]
Loading 0:   6%|▌         | 21.0/363 [00:18<04:31, 1.26it/s]
Loading 0:   6%|▌         | 22.0/363 [00:20<05:38, 1.01it/s]
Loading 0:   6%|▌         | 22.0/363 [00:20<05:38, 1.01it/s]
Loading 0:   6%|▋         | 23.0/363 [00:23<07:02, 1.24s/it]
Loading 0:   6%|▋         | 23.0/363 [00:23<07:02, 1.24s/it]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:19, 1.67it/s]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:19, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:28<03:47, 1.44it/s]
Loading 0:   9%|▉         | 34.0/363 [00:28<03:47, 1.44it/s]
Loading 0:  10%|▉         | 35.0/363 [00:31<05:06, 1.07it/s]
Loading 0:  10%|▉         | 35.0/363 [00:31<05:06, 1.07it/s]
Loading 0:  10%|▉         | 36.0/363 [00:34<06:42, 1.23s/it]
Loading 0:  10%|▉         | 36.0/363 [00:34<06:42, 1.23s/it]
Loading 0:  11%|█         | 39.0/363 [00:37<06:11, 1.15s/it]
Loading 0:  11%|█         | 39.0/363 [00:37<06:11, 1.15s/it]
Loading 0:  11%|█         | 40.0/363 [00:40<07:39, 1.42s/it]
Loading 0:  11%|█         | 40.0/363 [00:40<07:39, 1.42s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:43<09:15, 1.73s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:43<09:15, 1.73s/it]
Loading 0:  13%|█▎        | 47.0/363 [00:44<04:13, 1.25it/s]
Loading 0:  13%|█▎        | 47.0/363 [00:44<04:13, 1.25it/s]
Loading 0:  14%|█▍        | 51.0/363 [00:45<03:09, 1.65it/s]
Loading 0:  14%|█▍        | 51.0/363 [00:45<03:09, 1.65it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:48<04:28, 1.16it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:48<04:28, 1.16it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:51<05:51, 1.13s/it]
Loading 0:  15%|█▍        | 53.0/363 [00:51<05:51, 1.13s/it]
Loading 0:  15%|█▍        | 54.0/363 [00:54<07:20, 1.43s/it]
Loading 0:  15%|█▍        | 54.0/363 [00:54<07:20, 1.43s/it]
Loading 0:  16%|█▌        | 57.0/363 [00:57<06:16, 1.23s/it]
Loading 0:  16%|█▌        | 57.0/363 [00:57<06:16, 1.23s/it]
Loading 0:  16%|█▌        | 58.0/363 [01:00<07:46, 1.53s/it]
Loading 0:  16%|█▌        | 58.0/363 [01:00<07:46, 1.53s/it]
Loading 0:  16%|█▋        | 59.0/363 [01:03<09:20, 1.84s/it]
Loading 0:  16%|█▋        | 59.0/363 [01:03<09:20, 1.84s/it]
Loading 0:  18%|█▊        | 64.0/363 [01:04<04:28, 1.12it/s]
Loading 0:  18%|█▊        | 64.0/363 [01:04<04:28, 1.12it/s]
Loading 0:  19%|█▊        | 68.0/363 [01:05<03:09, 1.56it/s]
Loading 0:  19%|█▊        | 68.0/363 [01:05<03:09, 1.56it/s]
Loading 0:  19%|█▉        | 70.0/363 [01:08<04:03, 1.20it/s]
Loading 0:  19%|█▉        | 70.0/363 [01:08<04:03, 1.20it/s]
Loading 0:  20%|█▉        | 71.0/363 [01:11<05:15, 1.08s/it]
Loading 0:  20%|█▉        | 71.0/363 [01:11<05:15, 1.08s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:13<06:38, 1.37s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:13<06:38, 1.37s/it]
Loading 0:  21%|██        | 75.0/363 [01:16<05:44, 1.20s/it]
Loading 0:  21%|██        | 75.0/363 [01:16<05:44, 1.20s/it]
Loading 0:  21%|██        | 76.0/363 [01:19<06:37, 1.38s/it]
Loading 0:  21%|██        | 76.0/363 [01:19<06:37, 1.38s/it]
Loading 0:  21%|██        | 77.0/363 [01:21<07:54, 1.66s/it]
Loading 0:  21%|██        | 77.0/363 [01:21<07:54, 1.66s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:23<03:12, 1.45it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:23<03:12, 1.45it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:25<03:09, 1.45it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:25<03:09, 1.45it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:28<03:53, 1.18it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:28<03:53, 1.18it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:30<04:47, 1.05s/it]
Loading 0:  25%|██▍       | 90.0/363 [01:30<04:47, 1.05s/it]
Loading 0:  27%|██▋       | 97.0/363 [01:31<02:21, 1.88it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:31<02:21, 1.88it/s]
Loading 0:  28%|██▊       | 101/363 [01:33<02:27, 1.78it/s] 
Loading 0:  28%|██▊       | 101/363 [01:33<02:27, 1.78it/s]
Loading 0:  28%|██▊       | 102/363 [01:36<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:36<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:38<03:56, 1.10it/s]
Loading 0:  28%|██▊       | 103/363 [01:38<03:56, 1.10it/s]
Loading 0:  29%|██▉       | 106/363 [01:40<03:37, 1.18it/s]
Loading 0:  29%|██▉       | 106/363 [01:40<03:37, 1.18it/s]
Loading 0:  29%|██▉       | 107/363 [01:42<04:20, 1.02s/it]
Loading 0:  29%|██▉       | 107/363 [01:42<04:20, 1.02s/it]
Loading 0:  30%|██▉       | 108/363 [01:44<05:08, 1.21s/it]
Loading 0:  30%|██▉       | 108/363 [01:44<05:08, 1.21s/it]
Loading 0:  31%|███       | 111/363 [01:46<04:08, 1.01it/s]
Loading 0:  31%|███       | 111/363 [01:46<04:08, 1.01it/s]
Loading 0:  31%|███       | 112/363 [01:48<04:51, 1.16s/it]
Loading 0:  31%|███       | 112/363 [01:48<04:51, 1.16s/it]
Loading 0:  31%|███       | 113/363 [01:50<05:37, 1.35s/it]
Loading 0:  31%|███       | 113/363 [01:50<05:37, 1.35s/it]
Loading 0:  33%|███▎      | 121/363 [01:52<02:07, 1.90it/s]
Loading 0:  33%|███▎      | 121/363 [01:52<02:07, 1.90it/s]
Loading 0:  34%|███▍      | 124/363 [01:54<02:22, 1.68it/s]
Loading 0:  34%|███▍      | 124/363 [01:54<02:22, 1.68it/s]
Loading 0:  34%|███▍      | 125/363 [01:56<03:00, 1.32it/s]
Loading 0:  34%|███▍      | 125/363 [01:56<03:00, 1.32it/s]
Loading 0:  35%|███▍      | 126/363 [01:58<03:45, 1.05it/s]
Loading 0:  35%|███▍      | 126/363 [01:58<03:45, 1.05it/s]
Loading 0:  36%|███▌      | 129/363 [02:00<03:19, 1.17it/s]
Loading 0:  36%|███▌      | 129/363 [02:00<03:19, 1.17it/s]
Loading 0:  36%|███▌      | 130/363 [02:02<04:00, 1.03s/it]
Loading 0:  36%|███▌      | 130/363 [02:02<04:00, 1.03s/it]
Loading 0:  36%|███▌      | 131/363 [02:04<04:45, 1.23s/it]
Loading 0:  36%|███▌      | 131/363 [02:04<04:45, 1.23s/it]
Loading 0:  38%|███▊      | 138/363 [02:05<02:01, 1.86it/s]
Loading 0:  38%|███▊      | 138/363 [02:05<02:01, 1.86it/s]
Loading 0:  39%|███▉      | 142/363 [02:08<02:07, 1.73it/s]
Loading 0:  39%|███▉      | 142/363 [02:08<02:07, 1.73it/s]
Loading 0:  39%|███▉      | 143/363 [02:10<02:42, 1.36it/s]
Loading 0:  39%|███▉      | 143/363 [02:10<02:42, 1.36it/s]
Loading 0:  40%|███▉      | 144/363 [02:12<03:23, 1.08it/s]
Loading 0:  40%|███▉      | 144/363 [02:12<03:23, 1.08it/s]
Loading 0:  40%|████      | 147/363 [02:14<03:01, 1.19it/s]
Loading 0:  40%|████      | 147/363 [02:14<03:01, 1.19it/s]
Loading 0:  41%|████      | 148/363 [02:16<03:38, 1.02s/it]
Loading 0:  41%|████      | 148/363 [02:16<03:38, 1.02s/it]
Loading 0:  41%|████      | 149/363 [02:18<04:20, 1.22s/it]
Loading 0:  41%|████      | 149/363 [02:18<04:20, 1.22s/it]
Loading 0:  43%|████▎     | 156/363 [02:19<01:50, 1.87it/s]
Loading 0:  43%|████▎     | 156/363 [02:19<01:50, 1.87it/s]
Loading 0:  44%|████▍     | 160/363 [02:22<01:56, 1.74it/s]
Loading 0:  44%|████▍     | 160/363 [02:22<01:56, 1.74it/s]
Loading 0:  44%|████▍     | 161/363 [02:24<02:28, 1.36it/s]
Loading 0:  44%|████▍     | 161/363 [02:24<02:28, 1.36it/s]
Loading 0:  45%|████▍     | 162/363 [02:26<03:05, 1.08it/s]
Loading 0:  45%|████▍     | 162/363 [02:26<03:05, 1.08it/s]
Loading 0:  45%|████▌     | 165/363 [02:28<02:45, 1.20it/s]
Loading 0:  45%|████▌     | 165/363 [02:28<02:45, 1.20it/s]
Loading 0:  46%|████▌     | 166/363 [02:30<03:19, 1.01s/it]
Loading 0:  46%|████▌     | 166/363 [02:30<03:19, 1.01s/it]
Loading 0:  46%|████▌     | 167/363 [02:32<03:57, 1.21s/it]
Loading 0:  46%|████▌     | 167/363 [02:32<03:57, 1.21s/it]
Loading 0:  48%|████▊     | 174/363 [02:34<01:41, 1.86it/s]
Loading 0:  48%|████▊     | 174/363 [02:34<01:41, 1.86it/s]
Loading 0:  49%|████▉     | 178/363 [02:36<01:46, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:36<01:46, 1.73it/s]
Loading 0:  49%|████▉     | 179/363 [02:38<02:15, 1.36it/s]
Loading 0:  49%|████▉     | 179/363 [02:38<02:15, 1.36it/s]
Loading 0:  50%|████▉     | 180/363 [02:40<02:49, 1.08it/s]
Loading 0:  50%|████▉     | 180/363 [02:40<02:49, 1.08it/s]
Loading 0:  50%|█████     | 183/363 [02:42<02:30, 1.19it/s]
Loading 0:  50%|█████     | 183/363 [02:42<02:30, 1.19it/s]
Loading 0:  51%|█████     | 184/363 [02:44<03:01, 1.02s/it]
Loading 0:  51%|█████     | 184/363 [02:44<03:01, 1.02s/it]
Loading 0:  51%|█████     | 185/363 [02:47<03:36, 1.21s/it]
Loading 0:  51%|█████     | 185/363 [02:47<03:36, 1.21s/it]
Loading 0:  53%|█████▎    | 192/363 [02:48<01:31, 1.87it/s]
Loading 0:  53%|█████▎    | 192/363 [02:48<01:31, 1.87it/s]
Loading 0:  54%|█████▍    | 196/363 [02:50<01:35, 1.74it/s]
Loading 0:  54%|█████▍    | 196/363 [02:50<01:35, 1.74it/s]
Loading 0:  54%|█████▍    | 197/363 [02:52<02:01, 1.36it/s]
Loading 0:  54%|█████▍    | 197/363 [02:52<02:01, 1.36it/s]
Loading 0:  55%|█████▍    | 198/363 [02:54<02:32, 1.09it/s]
Loading 0:  55%|█████▍    | 198/363 [02:54<02:32, 1.09it/s]
Loading 0:  55%|█████▌    | 201/363 [02:56<02:15, 1.20it/s]
Loading 0:  55%|█████▌    | 201/363 [02:56<02:15, 1.20it/s]
Loading 0:  56%|█████▌    | 202/363 [02:58<02:42, 1.01s/it]
Loading 0:  56%|█████▌    | 202/363 [02:58<02:42, 1.01s/it]
Loading 0:  56%|█████▌    | 203/363 [03:01<03:13, 1.21s/it]
Loading 0:  56%|█████▌    | 203/363 [03:01<03:13, 1.21s/it]
Loading 0:  58%|█████▊    | 210/363 [03:02<01:21, 1.88it/s]
Loading 0:  58%|█████▊    | 210/363 [03:02<01:21, 1.88it/s]
Loading 0:  59%|█████▉    | 214/363 [03:04<01:25, 1.75it/s]
Loading 0:  59%|█████▉    | 214/363 [03:04<01:25, 1.75it/s]
Loading 0:  59%|█████▉    | 215/363 [03:06<01:48, 1.37it/s]
Loading 0:  59%|█████▉    | 215/363 [03:06<01:48, 1.37it/s]
Loading 0:  60%|█████▉    | 216/363 [03:08<02:15, 1.09it/s]
Loading 0:  60%|█████▉    | 216/363 [03:08<02:15, 1.09it/s]
Loading 0:  60%|██████    | 219/363 [03:10<01:59, 1.20it/s]
Loading 0:  60%|██████    | 219/363 [03:10<01:59, 1.20it/s]
Loading 0:  61%|██████    | 220/363 [03:12<02:24, 1.01s/it]
Loading 0:  61%|██████    | 220/363 [03:12<02:24, 1.01s/it]
Loading 0:  61%|██████    | 221/363 [03:15<02:51, 1.21s/it]
Loading 0:  61%|██████    | 221/363 [03:15<02:51, 1.21s/it]
Loading 0:  63%|██████▎   | 229/363 [03:16<01:07, 1.98it/s]
Loading 0:  63%|██████▎   | 229/363 [03:16<01:07, 1.98it/s]
Loading 0:  64%|██████▍   | 232/363 [03:18<01:15, 1.73it/s]
Loading 0:  64%|██████▍   | 232/363 [03:18<01:15, 1.73it/s]
Loading 0:  64%|██████▍   | 233/363 [03:20<01:36, 1.35it/s]
Loading 0:  64%|██████▍   | 233/363 [03:20<01:36, 1.35it/s]
Loading 0:  64%|██████▍   | 234/363 [03:22<02:00, 1.07it/s]
Loading 0:  64%|██████▍   | 234/363 [03:22<02:00, 1.07it/s]
Loading 0:  65%|██████▌   | 237/363 [03:24<01:45, 1.19it/s]
Loading 0:  65%|██████▌   | 237/363 [03:24<01:45, 1.19it/s]
Loading 0:  66%|██████▌   | 238/363 [03:26<02:07, 1.02s/it]
Loading 0:  66%|██████▌   | 238/363 [03:26<02:07, 1.02s/it]
Loading 0:  66%|██████▌   | 239/363 [03:29<02:31, 1.22s/it]
Loading 0:  66%|██████▌   | 239/363 [03:29<02:31, 1.22s/it]
Loading 0:  68%|██████▊   | 246/363 [03:30<01:02, 1.87it/s]
Loading 0:  68%|██████▊   | 246/363 [03:30<01:02, 1.87it/s]
Loading 0:  69%|██████▉   | 250/363 [03:32<01:05, 1.74it/s]
Loading 0:  69%|██████▉   | 250/363 [03:32<01:05, 1.74it/s]
Loading 0:  69%|██████▉   | 251/363 [03:34<01:22, 1.36it/s]
Loading 0:  69%|██████▉   | 251/363 [03:34<01:22, 1.36it/s]
Loading 0:  69%|██████▉   | 252/363 [03:36<01:43, 1.08it/s]
Loading 0:  69%|██████▉   | 252/363 [03:36<01:43, 1.08it/s]
Loading 0:  70%|███████   | 255/363 [03:38<01:30, 1.19it/s]
Loading 0:  70%|███████   | 255/363 [03:38<01:30, 1.19it/s]
Loading 0:  71%|███████   | 256/363 [03:41<01:49, 1.02s/it]
Loading 0:  71%|███████   | 256/363 [03:41<01:49, 1.02s/it]
Loading 0:  71%|███████   | 257/363 [03:43<02:09, 1.22s/it]
Loading 0:  71%|███████   | 257/363 [03:43<02:09, 1.22s/it]
Loading 0:  73%|███████▎  | 264/363 [03:44<00:53, 1.85it/s]
Loading 0:  73%|███████▎  | 264/363 [03:44<00:53, 1.85it/s]
Loading 0:  74%|███████▍  | 268/363 [03:46<00:55, 1.71it/s]
Loading 0:  74%|███████▍  | 268/363 [03:46<00:55, 1.71it/s]
Loading 0:  74%|███████▍  | 269/363 [03:48<01:09, 1.35it/s]
Loading 0:  74%|███████▍  | 269/363 [03:48<01:09, 1.35it/s]
Loading 0:  74%|███████▍  | 270/363 [03:51<01:26, 1.07it/s]
Loading 0:  74%|███████▍  | 270/363 [03:51<01:26, 1.07it/s]
Loading 0:  75%|███████▌  | 273/363 [04:11<04:33, 3.04s/it]
Loading 0:  75%|███████▌  | 273/363 [04:11<04:33, 3.04s/it]
Loading 0:  75%|███████▌  | 274/363 [04:13<04:17, 2.89s/it]
Loading 0:  75%|███████▌  | 274/363 [04:13<04:17, 2.89s/it]
Loading 0:  76%|███████▌  | 275/363 [04:15<04:03, 2.77s/it]
Loading 0:  76%|███████▌  | 275/363 [04:15<04:03, 2.77s/it]
Loading 0:  78%|███████▊  | 282/363 [04:16<01:29, 1.10s/it]
Loading 0:  78%|███████▊  | 282/363 [04:16<01:29, 1.10s/it]
Loading 0:  79%|███████▉  | 286/363 [04:18<01:12, 1.07it/s]
Loading 0:  79%|███████▉  | 286/363 [04:18<01:12, 1.07it/s]
Loading 0:  79%|███████▉  | 287/363 [04:20<01:18, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:20<01:18, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:22<01:29, 1.19s/it]
Loading 0:  79%|███████▉  | 288/363 [04:22<01:29, 1.19s/it]
Loading 0:  80%|████████  | 291/363 [04:25<01:12, 1.01s/it]
Loading 0:  80%|████████  | 291/363 [04:25<01:12, 1.01s/it]
Loading 0:  80%|████████  | 292/363 [04:27<01:22, 1.16s/it]
Loading 0:  80%|████████  | 292/363 [04:27<01:22, 1.16s/it]
Loading 0:  81%|████████  | 293/363 [04:29<01:33, 1.33s/it]
Loading 0:  81%|████████  | 293/363 [04:29<01:33, 1.33s/it]
Loading 0:  83%|████████▎ | 301/363 [04:30<00:33, 1.84it/s]
Loading 0:  83%|████████▎ | 301/363 [04:30<00:33, 1.84it/s]
Loading 0:  84%|████████▎ | 304/363 [04:32<00:35, 1.66it/s]
Loading 0:  84%|████████▎ | 304/363 [04:32<00:35, 1.66it/s]
Loading 0:  84%|████████▍ | 305/363 [04:34<00:43, 1.35it/s]
Loading 0:  84%|████████▍ | 305/363 [04:34<00:43, 1.35it/s]
Loading 0:  84%|████████▍ | 306/363 [04:36<00:53, 1.07it/s]
Loading 0:  84%|████████▍ | 306/363 [04:36<00:53, 1.07it/s]
Loading 0:  85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0:  85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0:  85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0:  85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0:  86%|████████▌ | 311/363 [04:43<01:03, 1.23s/it]
Loading 0:  86%|████████▌ | 311/363 [04:43<01:03, 1.23s/it]
Loading 0:  88%|████████▊ | 319/363 [04:44<00:22, 1.98it/s]
Loading 0:  88%|████████▊ | 319/363 [04:44<00:22, 1.98it/s]
Loading 0:  89%|████████▊ | 322/363 [04:46<00:23, 1.72it/s]
Loading 0:  89%|████████▊ | 322/363 [04:46<00:23, 1.72it/s]
Loading 0:  89%|████████▉ | 323/363 [04:48<00:29, 1.34it/s]
Loading 0:  89%|████████▉ | 323/363 [04:48<00:29, 1.34it/s]
Loading 0:  89%|████████▉ | 324/363 [04:50<00:36, 1.07it/s]
Loading 0:  89%|████████▉ | 324/363 [04:50<00:36, 1.07it/s]
Loading 0:  90%|█████████ | 327/363 [04:52<00:30, 1.18it/s]
Loading 0:  90%|█████████ | 327/363 [04:52<00:30, 1.18it/s]
Loading 0:  90%|█████████ | 328/363 [04:54<00:35, 1.03s/it]
Loading 0:  90%|█████████ | 328/363 [04:54<00:35, 1.03s/it]
Loading 0:  91%|█████████ | 329/363 [04:57<00:41, 1.23s/it]
Loading 0:  91%|█████████ | 329/363 [04:57<00:41, 1.23s/it]
Loading 0:  93%|█████████▎| 337/363 [04:58<00:13, 1.99it/s]
Loading 0:  93%|█████████▎| 337/363 [04:58<00:13, 1.99it/s]
Loading 0:  94%|█████████▎| 340/363 [05:00<00:13, 1.72it/s]
Loading 0:  94%|█████████▎| 340/363 [05:00<00:13, 1.72it/s]
Loading 0:  94%|█████████▍| 341/363 [05:02<00:16, 1.34it/s]
Loading 0:  94%|█████████▍| 341/363 [05:02<00:16, 1.34it/s]
Loading 0:  94%|█████████▍| 342/363 [05:04<00:19, 1.06it/s]
Loading 0:  94%|█████████▍| 342/363 [05:04<00:19, 1.06it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:15, 1.17it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:15, 1.17it/s]
Loading 0:  95%|█████████▌| 346/363 [05:09<00:17, 1.04s/it]
Loading 0:  95%|█████████▌| 346/363 [05:09<00:17, 1.04s/it]
Loading 0:  96%|█████████▌| 347/363 [05:11<00:19, 1.24s/it]
Loading 0:  96%|█████████▌| 347/363 [05:11<00:19, 1.24s/it]
Loading 0:  98%|█████████▊| 355/363 [05:12<00:04, 1.95it/s]
Loading 0:  98%|█████████▊| 355/363 [05:12<00:04, 1.95it/s]
Loading 0:  99%|█████████▉| 359/363 [05:15<00:02, 1.72it/s]
Loading 0:  99%|█████████▉| 359/363 [05:15<00:02, 1.72it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.36it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.36it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.09it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.09it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.09it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.14it/s]
chaiml-mistral-24b-2048-44577-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:29, 1.42s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:29, 1.42s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<02:58, 1.97it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<02:58, 1.97it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:49, 1.53it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:49, 1.53it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:56, 1.18it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:56, 1.18it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:09, 1.06s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:09, 1.06s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:40, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:40, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.29it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.29it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.83it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.83it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:46<02:30, 1.97it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:46<02:30, 1.97it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:39, 1.84it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:39, 1.84it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:22, 1.44it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:22, 1.44it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:13, 1.15it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:13, 1.15it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:46, 1.27it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:46, 1.27it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:33, 1.05it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:33, 1.05it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:26, 1.14s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:26, 1.14s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:21, 1.98it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:21, 1.98it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:29, 1.84it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:29, 1.84it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:56, 2.28it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:56, 2.28it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.00it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.00it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.07it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.07it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:31, 1.08s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:31, 1.08s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.78it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.78it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.40it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.40it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.12it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.12it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.07it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.07it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.81it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.81it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.08it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.08it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.83it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.83it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.05it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.05it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:23, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:23, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:20, 2.10it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:20, 2.10it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:30, 1.84it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:30, 1.84it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.44it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.44it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.14s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.07it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.07it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.14s/it]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.09it/s]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.09it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:52, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:52, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.08it/s]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.08it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:00, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:00, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.08it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.08it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:36, 2.41s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:36, 2.41s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:27, 2.33s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:27, 2.33s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:10, 1.08it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:10, 1.08it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:20, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:20, 1.07s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:05, 1.10it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:05, 1.10it/s]
Loading 0:  80%|████████  | 292/363 [03:48<01:16, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:48<01:16, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.24s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.24s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:21, 2.09it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:21, 2.09it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:16, 1.05s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:16, 1.05s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:19, 1.40s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:19, 1.40s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:43, 2.15it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:43, 2.15it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:58, 1.17it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:58, 1.17it/s]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:13, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:13, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:38, 1.00it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:38, 1.00it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:01, 1.12s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:01, 1.12s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:29, 2.10it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:29, 2.10it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:31, 1.14it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:31, 1.14it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:23, 2.06it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:23, 2.06it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.79it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.79it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:19, 1.12it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:19, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:50, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:50, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:36, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:36, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:58<05:29, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:58<05:29, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:32, 1.81it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:32, 1.81it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:32, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:32, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:17, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:17, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<02:00, 2.01it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<02:00, 2.01it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:33, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:33, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:35, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:35, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:22, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:22, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.81it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.81it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.42it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.42it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:02, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:02, 1.14s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.09it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.09it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.14s/it]
Loading 0:  63%|██████▎   | 228/363 [02:45<01:08, 1.98it/s]
Loading 0:  63%|██████▎   | 228/363 [02:45<01:08, 1.98it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:51, 1.15it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:51, 1.15it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:38, 1.28it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:38, 1.28it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:58, 1.06it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:58, 1.06it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:20, 1.13s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:20, 1.13s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:24, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:24, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:41, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:41, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:00, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:00, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:46, 2.09it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:46, 2.09it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 274/363 [03:34<03:25, 2.31s/it]
Loading 0:  75%|███████▌  | 274/363 [03:34<03:25, 2.31s/it]
Loading 0:  76%|███████▌  | 275/363 [03:36<03:19, 2.26s/it]
Loading 0:  76%|███████▌  | 275/363 [03:36<03:19, 2.26s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.18it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.18it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:02, 1.23it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:02, 1.23it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:09, 1.09it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:09, 1.09it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:19, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:19, 1.07s/it]
Loading 0:  80%|████████  | 291/363 [03:45<01:05, 1.10it/s]
Loading 0:  80%|████████  | 291/363 [03:45<01:05, 1.10it/s]
Loading 0:  80%|████████  | 292/363 [03:47<01:15, 1.06s/it]
Loading 0:  80%|████████  | 292/363 [03:47<01:15, 1.06s/it]
Loading 0:  81%|████████  | 293/363 [03:49<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:49<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0:  99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0:  99%|█████████▉| 360/363 [04:34<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 360/363 [04:34<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0:  99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.18it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.31it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpdfxn2f_s' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-43874-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:20, 1.06s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:20, 1.06s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:38, 1.45s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:38, 1.45s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:01, 1.94it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:01, 1.94it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:52, 1.51it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:52, 1.51it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.17it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.17it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:13, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:13, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:44, 1.46it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:44, 1.46it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:42, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:42, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.09it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.09it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:21, 1.97it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:21, 1.97it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.28it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.28it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.00it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.00it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.00it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.00it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.44it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.44it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:11, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:11, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:50, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:50, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:25, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:25, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:04, 1.14s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:04, 1.14s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:45, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:45, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:07<01:31, 2.06it/s]
Loading 0:  48%|████▊     | 175/363 [02:07<01:31, 2.06it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:09, 1.42it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:09, 1.42it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:19<03:25, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:19<03:25, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.06it/s]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.06it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.13it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.13it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:13, 2.07it/s]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:13, 2.07it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:22, 1.82it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:22, 1.82it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.13it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.13it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:45<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:45<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:04, 2.06it/s]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:04, 2.06it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.08it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.08it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.15s/it]
Loading 0:  73%|███████▎  | 265/363 [03:13<00:47, 2.08it/s]
Loading 0:  73%|███████▎  | 265/363 [03:13<00:47, 2.08it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:28, 2.35s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:28, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:38<03:22, 2.30s/it]
Loading 0:  76%|███████▌  | 275/363 [03:38<03:22, 2.30s/it]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.16it/s]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.16it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:03, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:03, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:22, 1.10s/it]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:22, 1.10s/it]
Loading 0:  80%|████████  | 291/363 [03:47<01:06, 1.08it/s]
Loading 0:  80%|████████  | 291/363 [03:47<01:06, 1.08it/s]
Loading 0:  80%|████████  | 292/363 [03:49<01:16, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:49<01:16, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:27, 1.24s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:27, 1.24s/it]
Loading 0:  83%|████████▎ | 301/363 [03:52<00:31, 1.97it/s]
Loading 0:  83%|████████▎ | 301/363 [03:52<00:31, 1.97it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.75it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.75it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:51, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:51, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.03it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.03it/s]
Loading 0:  86%|████████▌ | 311/363 [04:04<01:00, 1.16s/it]
Loading 0:  86%|████████▌ | 311/363 [04:04<01:00, 1.16s/it]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0:  89%|████████▊ | 322/363 [04:08<00:22, 1.83it/s]
Loading 0:  89%|████████▊ | 322/363 [04:08<00:22, 1.83it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  91%|█████████ | 329/363 [04:17<00:39, 1.15s/it]
Loading 0:  91%|█████████ | 329/363 [04:17<00:39, 1.15s/it]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.09it/s]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.09it/s]
Loading 0:  94%|█████████▎| 340/363 [04:21<00:12, 1.83it/s]
Loading 0:  94%|█████████▎| 340/363 [04:21<00:12, 1.83it/s]
Loading 0:  94%|█████████▍| 341/363 [04:23<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 341/363 [04:23<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 342/363 [04:25<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:25<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:27<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:27<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  98%|█████████▊| 355/363 [04:32<00:03, 2.09it/s]
Loading 0:  98%|█████████▊| 355/363 [04:32<00:03, 2.09it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.88it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.88it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.48it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.48it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.18it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.58it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.58it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.30it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantized model in 283.433s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp9vlvegk0' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged in 367.078s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantized model in 285.402s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged in 366.220s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpfmjv9r1h' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantized model in 329.190s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged in 414.880s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-86542-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:12, 1.38it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:12, 1.38it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:55, 1.19s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:55, 1.19s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:17, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:17, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:09, 1.00s/it]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:09, 1.00s/it]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:37, 1.10it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:37, 1.10it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:34, 1.10s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:34, 1.10s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:39, 1.31s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:39, 1.31s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:06, 1.57it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:06, 1.57it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:55, 1.24it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:55, 1.24it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:54, 1.01s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:54, 1.01s/it]
Loading 0:  21%|██        | 75.0/363 [01:03<04:23, 1.09it/s]
Loading 0:  21%|██        | 75.0/363 [01:03<04:23, 1.09it/s]
Loading 0:  21%|██        | 76.0/363 [01:05<05:17, 1.10s/it]
Loading 0:  21%|██        | 76.0/363 [01:05<05:17, 1.10s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:18, 1.32s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:18, 1.32s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:43, 1.70it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:43, 1.70it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:54, 1.57it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:54, 1.57it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:14<03:40, 1.24it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:14<03:40, 1.24it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:35, 1.01s/it]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:35, 1.01s/it]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:18, 1.92it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:18, 1.92it/s]
Loading 0:  28%|██▊       | 101/363 [01:20<02:28, 1.77it/s] 
Loading 0:  28%|██▊       | 101/363 [01:20<02:28, 1.77it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:03, 1.07it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:03, 1.07it/s]
Loading 0:  29%|██▉       | 106/363 [01:27<03:48, 1.12it/s]
Loading 0:  29%|██▉       | 106/363 [01:27<03:48, 1.12it/s]
Loading 0:  29%|██▉       | 107/363 [01:29<04:35, 1.08s/it]
Loading 0:  29%|██▉       | 107/363 [01:29<04:35, 1.08s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:29, 1.29s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:29, 1.29s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:26, 1.06s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:26, 1.06s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:04, 1.46s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:04, 1.46s/it]
Loading 0:  33%|███▎      | 120/363 [01:39<02:25, 1.67it/s]
Loading 0:  33%|███▎      | 120/363 [01:39<02:25, 1.67it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:33, 1.56it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:33, 1.56it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:13, 1.23it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:13, 1.23it/s]
Loading 0:  35%|███▍      | 126/363 [01:46<04:01, 1.02s/it]
Loading 0:  35%|███▍      | 126/363 [01:46<04:01, 1.02s/it]
Loading 0:  36%|███▌      | 129/363 [01:49<03:33, 1.09it/s]
Loading 0:  36%|███▌      | 129/363 [01:49<03:33, 1.09it/s]
Loading 0:  36%|███▌      | 130/363 [01:51<04:17, 1.11s/it]
Loading 0:  36%|███▌      | 130/363 [01:51<04:17, 1.11s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:06, 1.32s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:06, 1.32s/it]
Loading 0:  38%|███▊      | 138/363 [01:54<02:10, 1.73it/s]
Loading 0:  38%|███▊      | 138/363 [01:54<02:10, 1.73it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:17, 1.60it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:17, 1.60it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:54, 1.26it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:54, 1.26it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:38, 1.00it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:38, 1.00it/s]
Loading 0:  40%|████      | 147/363 [02:04<03:14, 1.11it/s]
Loading 0:  40%|████      | 147/363 [02:04<03:14, 1.11it/s]
Loading 0:  41%|████      | 148/363 [02:06<03:54, 1.09s/it]
Loading 0:  41%|████      | 148/363 [02:06<03:54, 1.09s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.74it/s]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.74it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.60it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.60it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:40, 1.26it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:40, 1.26it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:21, 1.00s/it]
Loading 0:  45%|████▍     | 162/363 [02:17<03:21, 1.00s/it]
Loading 0:  45%|████▌     | 165/363 [02:19<02:59, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:19<02:59, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:21<03:36, 1.10s/it]
Loading 0:  46%|████▌     | 166/363 [02:21<03:36, 1.10s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:17, 1.31s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:17, 1.31s/it]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.72it/s]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.72it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.60it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.60it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:26, 1.26it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:26, 1.26it/s]
Loading 0:  50%|████▉     | 180/363 [02:32<03:03, 1.00s/it]
Loading 0:  50%|████▉     | 180/363 [02:32<03:03, 1.00s/it]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.11it/s]
Loading 0:  51%|█████     | 184/363 [02:36<03:15, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:36<03:15, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:12, 1.26it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:12, 1.26it/s]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:44, 1.00it/s]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:44, 1.00it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:26, 1.11it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:26, 1.11it/s]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:55, 1.09s/it]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:55, 1.09s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:29, 1.31s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:29, 1.31s/it]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:28, 1.73it/s]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:28, 1.73it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:33, 1.60it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:33, 1.60it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:57, 1.26it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:57, 1.26it/s]
Loading 0:  60%|█████▉    | 216/363 [03:02<02:26, 1.00it/s]
Loading 0:  60%|█████▉    | 216/363 [03:02<02:26, 1.00it/s]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.10it/s]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.10it/s]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.10s/it]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.10s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 233/363 [03:16<01:48, 1.19it/s]
Loading 0:  64%|██████▍   | 233/363 [03:16<01:48, 1.19it/s]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:13, 1.04s/it]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:13, 1.04s/it]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:56, 1.08it/s]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:56, 1.08it/s]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:19, 1.11s/it]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:19, 1.11s/it]
Loading 0:  66%|██████▌   | 239/363 [03:25<02:44, 1.33s/it]
Loading 0:  66%|██████▌   | 239/363 [03:25<02:44, 1.33s/it]
Loading 0:  68%|██████▊   | 246/363 [03:26<01:08, 1.70it/s]
Loading 0:  68%|██████▊   | 246/363 [03:26<01:08, 1.70it/s]
Loading 0:  69%|██████▉   | 250/363 [03:29<01:11, 1.59it/s]
Loading 0:  69%|██████▉   | 250/363 [03:29<01:11, 1.59it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:29, 1.25it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:29, 1.25it/s]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.01s/it]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.01s/it]
Loading 0:  70%|███████   | 255/363 [03:35<01:38, 1.10it/s]
Loading 0:  70%|███████   | 255/363 [03:35<01:38, 1.10it/s]
Loading 0:  71%|███████   | 256/363 [03:38<01:57, 1.10s/it]
Loading 0:  71%|███████   | 256/363 [03:38<01:57, 1.10s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:19, 1.32s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:19, 1.32s/it]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:57, 1.71it/s]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:57, 1.71it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.60it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.60it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:33, 1.00s/it]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:33, 1.00s/it]
Loading 0:  75%|███████▌  | 273/363 [04:05<03:57, 2.64s/it]
Loading 0:  75%|███████▌  | 273/363 [04:05<03:57, 2.64s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:49, 2.58s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:49, 2.58s/it]
Loading 0:  76%|███████▌  | 275/363 [04:09<03:42, 2.53s/it]
Loading 0:  76%|███████▌  | 275/363 [04:09<03:42, 2.53s/it]
Loading 0:  78%|███████▊  | 282/363 [04:11<01:22, 1.02s/it]
Loading 0:  78%|███████▊  | 282/363 [04:11<01:22, 1.02s/it]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 287/363 [04:15<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:15<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:18<01:31, 1.22s/it]
Loading 0:  79%|███████▉  | 288/363 [04:18<01:31, 1.22s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:13, 1.02s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:13, 1.02s/it]
Loading 0:  80%|████████  | 292/363 [04:22<01:24, 1.20s/it]
Loading 0:  80%|████████  | 292/363 [04:22<01:24, 1.20s/it]
Loading 0:  81%|████████  | 293/363 [04:24<01:36, 1.37s/it]
Loading 0:  81%|████████  | 293/363 [04:24<01:36, 1.37s/it]
Loading 0:  83%|████████▎ | 300/363 [04:25<00:37, 1.68it/s]
Loading 0:  83%|████████▎ | 300/363 [04:25<00:37, 1.68it/s]
Loading 0:  84%|████████▎ | 304/363 [04:28<00:36, 1.60it/s]
Loading 0:  84%|████████▎ | 304/363 [04:28<00:36, 1.60it/s]
Loading 0:  84%|████████▍ | 305/363 [04:30<00:45, 1.28it/s]
Loading 0:  84%|████████▍ | 305/363 [04:30<00:45, 1.28it/s]
Loading 0:  84%|████████▍ | 306/363 [04:32<00:56, 1.01it/s]
Loading 0:  84%|████████▍ | 306/363 [04:32<00:56, 1.01it/s]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0:  86%|████████▌ | 311/363 [04:39<01:07, 1.30s/it]
Loading 0:  86%|████████▌ | 311/363 [04:39<01:07, 1.30s/it]
Loading 0:  88%|████████▊ | 318/363 [04:40<00:25, 1.75it/s]
Loading 0:  88%|████████▊ | 318/363 [04:40<00:25, 1.75it/s]
Loading 0:  89%|████████▊ | 322/363 [04:43<00:25, 1.62it/s]
Loading 0:  89%|████████▊ | 322/363 [04:43<00:25, 1.62it/s]
Loading 0:  89%|████████▉ | 323/363 [04:45<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 323/363 [04:45<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 324/363 [04:47<00:38, 1.01it/s]
Loading 0:  89%|████████▉ | 324/363 [04:47<00:38, 1.01it/s]
Loading 0:  90%|█████████ | 327/363 [04:50<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 327/363 [04:50<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 328/363 [04:52<00:38, 1.09s/it]
Loading 0:  90%|█████████ | 328/363 [04:52<00:38, 1.09s/it]
Loading 0:  91%|█████████ | 329/363 [04:54<00:44, 1.31s/it]
Loading 0:  91%|█████████ | 329/363 [04:54<00:44, 1.31s/it]
Loading 0:  93%|█████████▎| 336/363 [04:55<00:15, 1.75it/s]
Loading 0:  93%|█████████▎| 336/363 [04:55<00:15, 1.75it/s]
Loading 0:  94%|█████████▎| 340/363 [04:58<00:14, 1.61it/s]
Loading 0:  94%|█████████▎| 340/363 [04:58<00:14, 1.61it/s]
Loading 0:  94%|█████████▍| 341/363 [05:00<00:17, 1.26it/s]
Loading 0:  94%|█████████▍| 341/363 [05:00<00:17, 1.26it/s]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:20, 1.00it/s]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:20, 1.00it/s]
Loading 0:  95%|█████████▌| 345/363 [05:05<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [05:05<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 346/363 [05:07<00:18, 1.10s/it]
Loading 0:  95%|█████████▌| 346/363 [05:07<00:18, 1.10s/it]
Loading 0:  96%|█████████▌| 347/363 [05:09<00:21, 1.32s/it]
Loading 0:  96%|█████████▌| 347/363 [05:09<00:21, 1.32s/it]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.73it/s]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.73it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.66it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.66it/s]
Loading 0:  99%|█████████▉| 360/363 [05:16<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 360/363 [05:16<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 361/363 [05:18<00:01, 1.04it/s]
Loading 0:  99%|█████████▉| 361/363 [05:18<00:01, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:18<00:00, 1.04it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:18<00:00, 1.14it/s]
chaiml-mistral-24b-2048-96633-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmpw4icn4mf' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantized model in 326.095s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged in 413.466s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-86542-v2-mkmlizer: 	status code: 503, request id: , host id: 
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-96633-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.1.safetensors": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~32xfkZ2a49JSJDym0VPaJoGrYiKJLf1 caused by: SignatureDoesNotMatch:  status code: 403, request id: tx00000500517ea3cb70050-00698eacb5-14995edef0-default, host id:
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: SlowDown: 
Job chaiml-mistral-24b-2048-86542-v2-mkmlizer completed after 623.18s with status: failed
chaiml-mistral-24b-2048-44577-v2-mkmlizer: 	status code: 503, request id: tx0000095a07a375ef01f90-00698eacf7-14b31daae8-default, host id: 
Job failed chaiml-mistral-24b-2048-86542-v2-mkmlizer: 
Stopping job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-86542-v2-mkmlizer to finish
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: SlowDown: 
chaiml-mistral-24b-2048-44577-v2-mkmlizer: 	status code: 503, request id: tx00000be3a9538774ddc25-00698ead1e-14b31daae8-default, host id: 
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-86542-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-86542-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/flywheel_model.1.safetensors": MultipartUpload: upload multipart failed upload id: 2~XuuU4uHnsDOcyq7xWehPTfiFdwadpac caused by: SignatureDoesNotMatch:  status code: 403, request id: tx00000cd45c3de09689b37-00698ead21-14af544255-default, host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
Job chaiml-mistral-24b-2048-44577-v2-mkmlizer completed after 613.16s with status: failed
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
Job failed chaiml-mistral-24b-2048-44577-v2-mkmlizer: 
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
Stopping job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
Starting job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
Waiting for job on chaiml-mistral-24b-2048-44577-v2-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-44577-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-44577-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Downloaded to shared memory in 95.237s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged already exists in ChaiML
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmppwz7f05g, device:0
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Downloaded to shared memory in 76.733s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged already exists in ChaiML
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp4u7h47yj, device:0
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-86542-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:57, 1.17it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:57, 1.17it/s]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:11, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:11, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:31, 2.19it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:31, 2.19it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:16, 1.26it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:16, 1.26it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:31, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:31, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:22, 2.08it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:22, 2.08it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.82it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.82it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:35, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:35, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:58<05:27, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:58<05:27, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:35, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:35, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:02, 1.05it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:02, 1.05it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:49, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:49, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:53, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:53, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<02:00, 2.01it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<02:00, 2.01it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:14, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:14, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:34, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:34, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:14, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:14, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.14s/it]
Loading 0:  58%|█████▊    | 210/363 [02:32<01:17, 1.98it/s]
Loading 0:  58%|█████▊    | 210/363 [02:32<01:17, 1.98it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:20, 1.84it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:20, 1.84it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.45it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.45it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:07, 1.15it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:07, 1.15it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:52, 1.28it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:52, 1.28it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:15, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:15, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:41, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:41, 1.14s/it]
Loading 0:  63%|██████▎   | 228/363 [02:45<01:08, 1.98it/s]
Loading 0:  63%|██████▎   | 228/363 [02:45<01:08, 1.98it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:10, 1.85it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:10, 1.85it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:51, 1.16it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:51, 1.16it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:38, 1.28it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:38, 1.28it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:58, 1.06it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:58, 1.06it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:20, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:20, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.08it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.08it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:34, 2.39s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:34, 2.39s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:25, 2.31s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:25, 2.31s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:19, 2.27s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:19, 2.27s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.18it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.18it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.09it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.09it/s]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.12it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.12it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.10it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.10it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-86542-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmppwz7f05g' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantized model in 283.678s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged in 378.915s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-86542-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/flywheel_model.1.safetensors": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp4u7h47yj' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantized model in 284.906s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged in 361.640s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-76177-v2-mkmlizer completed after 1106.6s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
Pipeline stage MKMLizer completed in 2378.86s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.55s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-76177-v2
Waiting for inference service chaiml-mistral-24b-2048-76177-v2 to be ready
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-43874-v2-mkmlizer completed after 1146.31s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
Pipeline stage MKMLizer completed in 2411.92s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.53s
run pipeline stage %s
Running pipeline stage MKMLDeployer
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.0.safetensors
Creating inference service chaiml-mistral-24b-2048-43874-v2
Job chaiml-mistral-24b-2048-96633-v3-mkmlizer completed after 1167.74s with status: succeeded
Waiting for inference service chaiml-mistral-24b-2048-43874-v2 to be ready
Stopping job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
Pipeline stage MKMLizer completed in 2421.03s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.51s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-96633-v3
Waiting for inference service chaiml-mistral-24b-2048-96633-v3 to be ready
Inference service chaiml-mistral-24b-2048-76177-v2 ready after 304.8912103176117s
Pipeline stage MKMLDeployer completed in 311.30s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7759127616882324s
Received healthy response to inference request in 2.7835707664489746s
Received healthy response to inference request in 3.0513617992401123s
Received healthy response to inference request in 2.745479106903076s
Received healthy response to inference request in 2.7560651302337646s
5 requests
0 failed requests
5th percentile: 2.7475963115692137
10th percentile: 2.7497135162353517
20th percentile: 2.753947925567627
30th percentile: 2.7615662574768067
40th percentile: 2.7725685119628904
50th percentile: 2.7835707664489746
60th percentile: 2.89068717956543
70th percentile: 2.9978035926818847
80th percentile: 3.1962719917297364
90th percentile: 3.486092376708984
95th percentile: 3.6310025691986083
99th percentile: 3.7469307231903075
mean time: 3.022477912902832
Pipeline stage StressChecker completed in 44.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Inference service chaiml-mistral-24b-2048-43874-v2 ready after 314.2314672470093s
run_pipeline:run_in_cloud %s
Pipeline stage MKMLDeployer completed in 324.39s
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
Running pipeline stage StressChecker
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 9.55s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Received healthy response to inference request in 3.5605883598327637s
Inference service chaiml-mistral-24b-2048-96633-v3 ready after 314.4733934402466s
run_pipeline:run_in_cloud %s
Pipeline stage MKMLDeployer completed in 321.53s
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
Received healthy response to inference request in 3.297139883041382s
triggered trigger_guanaco_pipeline args=%s
Running pipeline stage StressChecker
Pipeline stage TriggerMKMLProfilingPipeline completed in 9.84s
Shutdown handler de-registered
Received healthy response to inference request in 3.270233154296875s
chaiml-mistral-24b-2048_76177_v2 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 3.750248670578003s
Received healthy response to inference request in 3.5327718257904053s
Received healthy response to inference request in 3.266512632369995s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-86542-v2-mkmlizer completed after 930.73s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
Received healthy response to inference request in 3.7582719326019287s
Received healthy response to inference request in 3.105674982070923s
Pipeline stage MKMLizer completed in 2781.47s
5 requests
run pipeline stage %s
0 failed requests
Running pipeline stage MKMLTemplater
5th percentile: 3.2756145000457764
Received healthy response to inference request in 3.2650742530822754s
Pipeline stage MKMLTemplater completed in 1.44s
10th percentile: 3.2809958457946777
run pipeline stage %s
20th percentile: 3.2917585372924805
Running pipeline stage MKMLDeployer
30th percentile: 3.3442662715911866
Creating inference service chaiml-mistral-24b-2048-86542-v2
Received healthy response to inference request in 3.148712158203125s
40th percentile: 3.4385190486907957
Waiting for inference service chaiml-mistral-24b-2048-86542-v2 to be ready
5 requests
50th percentile: 3.5327718257904053
0 failed requests
60th percentile: 3.5438984394073487
5th percentile: 3.114282417297363
70th percentile: 3.555025053024292
10th percentile: 3.122889852523804
80th percentile: 3.6001250743865967
20th percentile: 3.1401047229766847
90th percentile: 3.6791985034942627
30th percentile: 3.171984577178955
95th percentile: 3.7187352180480957
40th percentile: 3.2185294151306154
99th percentile: 3.750364589691162
50th percentile: 3.2650742530822754
mean time: 3.483801031112671
60th percentile: 3.265649604797363
Pipeline stage StressChecker completed in 51.88s
70th percentile: 3.2662249565124513
run pipeline stage %s
80th percentile: 3.363259840011597
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
90th percentile: 3.5567542552947997
run_pipeline:run_in_cloud %s
95th percentile: 3.653501462936401
starting trigger_guanaco_pipeline args=%s
99th percentile: 3.7308992290496827
Job chaiml-mistral-24b-2048-44577-v2-mkmlizer completed after 916.76s with status: succeeded
triggered trigger_guanaco_pipeline args=%s
mean time: 3.3072445392608643
Stopping job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 6.80s
Pipeline stage StressChecker completed in 50.00s
Pipeline stage MKMLizer completed in 2823.24s
run pipeline stage %s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Running pipeline stage MKMLTemplater
run_pipeline:run_in_cloud %s
run_pipeline:run_in_cloud %s
Pipeline stage MKMLTemplater completed in 1.70s
starting trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
Running pipeline stage MKMLDeployer
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 7.77s
Creating inference service chaiml-mistral-24b-2048-44577-v2
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 8.65s
Shutdown handler de-registered
Waiting for inference service chaiml-mistral-24b-2048-44577-v2 to be ready
run pipeline stage %s
chaiml-mistral-24b-2048_43874_v2 status is now deployed due to DeploymentManager action
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 5.40s
Shutdown handler de-registered
chaiml-mistral-24b-2048_96633_v3 status is now deployed due to DeploymentManager action
Inference service chaiml-mistral-24b-2048-86542-v2 ready after 304.15715503692627s
Pipeline stage MKMLDeployer completed in 309.55s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.664898157119751s
Received healthy response to inference request in 3.0384955406188965s
Received healthy response to inference request in 3.2107043266296387s
Received healthy response to inference request in 3.4262008666992188s
Received healthy response to inference request in 3.069580554962158s
5 requests
0 failed requests
5th percentile: 3.044712543487549
10th percentile: 3.050929546356201
20th percentile: 3.063363552093506
30th percentile: 3.097805309295654
40th percentile: 3.1542548179626464
50th percentile: 3.2107043266296387
60th percentile: 3.2969029426574705
70th percentile: 3.383101558685303
80th percentile: 3.4739403247833254
90th percentile: 3.569419240951538
95th percentile: 3.6171586990356444
99th percentile: 3.6553502655029297
mean time: 3.2819758892059325
Pipeline stage StressChecker completed in 30.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.88s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 3.15s
Shutdown handler de-registered
chaiml-mistral-24b-2048_86542_v2 status is now deployed due to DeploymentManager action
Inference service chaiml-mistral-24b-2048-44577-v2 ready after 324.3038275241852s
Pipeline stage MKMLDeployer completed in 331.31s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.180900812149048s
Received healthy response to inference request in 3.321460008621216s
Received healthy response to inference request in 3.0790700912475586s
Received healthy response to inference request in 3.1549928188323975s
Received healthy response to inference request in 3.3281350135803223s
5 requests
0 failed requests
5th percentile: 3.0942546367645263
10th percentile: 3.109439182281494
20th percentile: 3.1398082733154298
30th percentile: 3.1601744174957274
40th percentile: 3.1705376148223876
50th percentile: 3.180900812149048
60th percentile: 3.237124490737915
70th percentile: 3.2933481693267823
80th percentile: 3.322795009613037
90th percentile: 3.3254650115966795
95th percentile: 3.326800012588501
99th percentile: 3.327868013381958
mean time: 3.2129117488861083
Pipeline stage StressChecker completed in 34.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.28s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.23s
Shutdown handler de-registered
chaiml-mistral-24b-2048_44577_v2 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048_44577_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-mistral-24b-2048_44577_v2 status is now torndown due to DeploymentManager action