developer_uid: rirv938
submission_id: chaiml-98p-2ff-chaiml-m_97330_v1
model_name: chaiml-98p-2ff-chaiml-m_97330_v1
model_group: ChaiML/98p_2ff_chaiml_mi
status: torndown
timestamp: 2026-02-23T11:51:43+00:00
num_battles: 10368
num_wins: 6204
celo_rating: 1367.46
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp624_merged
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 96
reward_model: default
display_name: chaiml-98p-2ff-chaiml-m_97330_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp624_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-17
win_ratio: 0.5983796296296297
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_start|>', '###', '</s>', '<|im_end|>', 'You:'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 96}
formatter: {'memory_template': '[SYSTEM_PROMPT]Respond as a high quality storyteller.[/SYSTEM_PROMPT][INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer
Waiting for job on chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer
Waiting for job on chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer
Shutdown handler not registered because Python interpreter is not running in the main thread
Waiting for job on chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer to finish
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Shutdown handler not registered because Python interpreter is not running in the main thread
Starting job with name chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer
run pipeline %s
Waiting for job on chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer to finish
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Waiting for job on chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer to finish
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLizer
run pipeline %s
Starting job with name chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer
run pipeline stage %s
Waiting for job on chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer to finish
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-1-404-v4-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-1-404-v4-mkmlizer to finish
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: bash: no job control in this shell
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: bash: no job control in this shell
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: bash: no job control in this shell
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Downloaded to shared memory in 77.397s
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp624_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpzde0t1xs, device:0
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Downloaded to shared memory in 69.586s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp156_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Downloaded to shared memory in 76.519s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmphm75suwp, device:0
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp624_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Downloaded to shared memory in 81.025s
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp5tfibchk, device:0
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp468_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp_nqshyye, device:0
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Downloaded to shared memory in 85.774s
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp312_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp8huzjr3o, device:0
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Downloaded to shared memory in 78.516s
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged already exists in ChaiML
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp5p4hwfcu, device:0
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Downloaded to shared memory in 100.136s
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp312_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpise9ql0c, device:0
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:46, 1.54it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:46, 1.54it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:55, 1.18it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:55, 1.18it/s]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:09, 1.06s/it]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:09, 1.06s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:41, 1.54it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:41, 1.54it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:35, 1.24it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:35, 1.24it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:37, 1.01it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:37, 1.01it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:30, 2.21it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:30, 2.21it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:52, 1.90it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:52, 1.90it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:38, 1.17it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:38, 1.17it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:28, 2.11it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:28, 2.11it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:48, 1.84it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:48, 1.84it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:34, 1.44it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:34, 1.44it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:30, 1.14it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:30, 1.14it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:00, 1.27it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:00, 1.27it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:50, 1.05it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:50, 1.05it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:46, 1.14s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:46, 1.14s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:21, 2.09it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:21, 2.09it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:48<02:40, 1.83it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:48<02:40, 1.83it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:50<03:23, 1.44it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:50<03:23, 1.44it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:52<04:15, 1.14it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:52<04:15, 1.14it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:46, 1.27it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:46, 1.27it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:33, 1.05it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:33, 1.05it/s]
Loading 0:  21%|██        | 77.0/363 [00:58<05:25, 1.14s/it]
Loading 0:  21%|██        | 77.0/363 [00:58<05:25, 1.14s/it]
Loading 0:  23%|██▎       | 85.0/363 [00:59<02:12, 2.10it/s]
Loading 0:  23%|██▎       | 85.0/363 [00:59<02:12, 2.10it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:01<02:29, 1.84it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:01<02:29, 1.84it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:03<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:03<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:05<04:01, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:05<04:01, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:06<01:54, 2.31it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:06<01:54, 2.31it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:10<02:47, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:10<02:47, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:12<03:33, 1.22it/s]
Loading 0:  28%|██▊       | 103/363 [01:12<03:33, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:14<03:18, 1.30it/s]
Loading 0:  29%|██▉       | 106/363 [01:14<03:18, 1.30it/s]
Loading 0:  29%|██▉       | 107/363 [01:16<03:59, 1.07it/s]
Loading 0:  29%|██▉       | 107/363 [01:16<03:59, 1.07it/s]
Loading 0:  30%|██▉       | 108/363 [01:18<04:46, 1.12s/it]
Loading 0:  30%|██▉       | 108/363 [01:18<04:46, 1.12s/it]
Loading 0:  31%|███       | 111/363 [01:20<03:50, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:20<03:50, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:22<04:31, 1.08s/it]
Loading 0:  31%|███       | 112/363 [01:22<04:31, 1.08s/it]
Loading 0:  31%|███       | 113/363 [01:24<05:15, 1.26s/it]
Loading 0:  31%|███       | 113/363 [01:24<05:15, 1.26s/it]
Loading 0:  33%|███▎      | 121/363 [01:25<01:59, 2.03it/s]
Loading 0:  33%|███▎      | 121/363 [01:25<01:59, 2.03it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.41it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.41it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:31, 1.12it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:31, 1.12it/s]
Loading 0:  36%|███▌      | 129/363 [01:33<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:33<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:35<03:44, 1.04it/s]
Loading 0:  36%|███▌      | 130/363 [01:35<03:44, 1.04it/s]
Loading 0:  36%|███▌      | 131/363 [01:37<04:27, 1.15s/it]
Loading 0:  36%|███▌      | 131/363 [01:37<04:27, 1.15s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.09it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.09it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:33, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:33, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:50, 1.27it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:50, 1.27it/s]
Loading 0:  41%|████      | 148/363 [01:48<03:25, 1.05it/s]
Loading 0:  41%|████      | 148/363 [01:48<03:25, 1.05it/s]
Loading 0:  41%|████      | 149/363 [01:50<04:04, 1.14s/it]
Loading 0:  41%|████      | 149/363 [01:50<04:04, 1.14s/it]
Loading 0:  43%|████▎     | 157/363 [01:52<01:38, 2.10it/s]
Loading 0:  43%|████▎     | 157/363 [01:52<01:38, 2.10it/s]
Loading 0:  44%|████▍     | 160/363 [01:54<01:50, 1.84it/s]
Loading 0:  44%|████▍     | 160/363 [01:54<01:50, 1.84it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:20, 1.44it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:20, 1.44it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:55, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:55, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:35, 1.27it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:35, 1.27it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:07, 1.05it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:07, 1.05it/s]
Loading 0:  46%|████▌     | 167/363 [02:04<03:43, 1.14s/it]
Loading 0:  46%|████▌     | 167/363 [02:04<03:43, 1.14s/it]
Loading 0:  48%|████▊     | 175/363 [02:05<01:29, 2.10it/s]
Loading 0:  48%|████▊     | 175/363 [02:05<01:29, 2.10it/s]
Loading 0:  49%|████▉     | 178/363 [02:07<01:40, 1.84it/s]
Loading 0:  49%|████▉     | 178/363 [02:07<01:40, 1.84it/s]
Loading 0:  49%|████▉     | 179/363 [02:09<02:07, 1.44it/s]
Loading 0:  49%|████▉     | 179/363 [02:09<02:07, 1.44it/s]
Loading 0:  50%|████▉     | 180/363 [02:11<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:11<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:13<02:21, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:13<02:21, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:50, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:50, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  53%|█████▎    | 193/363 [02:18<01:20, 2.11it/s]
Loading 0:  53%|█████▎    | 193/363 [02:18<01:20, 2.11it/s]
Loading 0:  54%|█████▍    | 196/363 [02:20<01:30, 1.85it/s]
Loading 0:  54%|█████▍    | 196/363 [02:20<01:30, 1.85it/s]
Loading 0:  54%|█████▍    | 197/363 [02:22<01:54, 1.44it/s]
Loading 0:  54%|█████▍    | 197/363 [02:22<01:54, 1.44it/s]
Loading 0:  55%|█████▍    | 198/363 [02:24<02:24, 1.15it/s]
Loading 0:  55%|█████▍    | 198/363 [02:24<02:24, 1.15it/s]
Loading 0:  55%|█████▌    | 201/363 [02:26<02:07, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:26<02:07, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:28<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:28<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:30<03:02, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:30<03:02, 1.14s/it]
Loading 0:  58%|█████▊    | 211/363 [02:31<01:11, 2.11it/s]
Loading 0:  58%|█████▊    | 211/363 [02:31<01:11, 2.11it/s]
Loading 0:  59%|█████▉    | 214/363 [02:33<01:20, 1.85it/s]
Loading 0:  59%|█████▉    | 214/363 [02:33<01:20, 1.85it/s]
Loading 0:  59%|█████▉    | 215/363 [02:35<01:42, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:35<01:42, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:37<02:08, 1.15it/s]
Loading 0:  60%|█████▉    | 216/363 [02:37<02:08, 1.15it/s]
Loading 0:  60%|██████    | 219/363 [02:39<01:52, 1.28it/s]
Loading 0:  60%|██████    | 219/363 [02:39<01:52, 1.28it/s]
Loading 0:  61%|██████    | 220/363 [02:41<02:15, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:41<02:15, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:43<02:41, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:43<02:41, 1.14s/it]
Loading 0:  63%|██████▎   | 229/363 [02:44<01:03, 2.11it/s]
Loading 0:  63%|██████▎   | 229/363 [02:44<01:03, 2.11it/s]
Loading 0:  64%|██████▍   | 232/363 [02:46<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 232/363 [02:46<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 233/363 [02:48<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 233/363 [02:48<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 234/363 [02:50<01:52, 1.15it/s]
Loading 0:  64%|██████▍   | 234/363 [02:50<01:52, 1.15it/s]
Loading 0:  65%|██████▌   | 237/363 [02:52<01:38, 1.28it/s]
Loading 0:  65%|██████▌   | 237/363 [02:52<01:38, 1.28it/s]
Loading 0:  66%|██████▌   | 238/363 [02:54<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:54<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:56<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [02:56<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 247/363 [02:57<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:57<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [02:59<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [02:59<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:01<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 251/363 [03:01<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 252/363 [03:03<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:03<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:05<01:24, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:05<01:24, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:07<01:41, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:07<01:41, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:09<02:00, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:09<02:00, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:10<00:46, 2.09it/s]
Loading 0:  73%|███████▎  | 265/363 [03:10<00:46, 2.09it/s]
Loading 0:  74%|███████▍  | 268/363 [03:12<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:12<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:14<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 269/363 [03:14<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 270/363 [03:16<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:16<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:31<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 273/363 [03:31<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 274/363 [03:33<03:25, 2.31s/it]
Loading 0:  75%|███████▌  | 274/363 [03:33<03:25, 2.31s/it]
Loading 0:  76%|███████▌  | 275/363 [03:35<03:18, 2.26s/it]
Loading 0:  76%|███████▌  | 275/363 [03:35<03:18, 2.26s/it]
Loading 0:  78%|███████▊  | 283/363 [03:36<01:07, 1.18it/s]
Loading 0:  78%|███████▊  | 283/363 [03:36<01:07, 1.18it/s]
Loading 0:  79%|███████▉  | 286/363 [03:38<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:38<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:40<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 287/363 [03:40<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 288/363 [03:42<01:21, 1.08s/it]
Loading 0:  79%|███████▉  | 288/363 [03:42<01:21, 1.08s/it]
Loading 0:  80%|████████  | 291/363 [03:44<01:06, 1.09it/s]
Loading 0:  80%|████████  | 291/363 [03:44<01:06, 1.09it/s]
Loading 0:  80%|████████  | 292/363 [03:46<01:15, 1.06s/it]
Loading 0:  80%|████████  | 292/363 [03:46<01:15, 1.06s/it]
Loading 0:  81%|████████  | 293/363 [03:48<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:48<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:49<00:31, 1.99it/s]
Loading 0:  83%|████████▎ | 301/363 [03:49<00:31, 1.99it/s]
Loading 0:  84%|████████▎ | 304/363 [03:51<00:33, 1.78it/s]
Loading 0:  84%|████████▎ | 304/363 [03:51<00:33, 1.78it/s]
Loading 0:  84%|████████▍ | 305/363 [03:53<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 305/363 [03:53<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 306/363 [03:55<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:55<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:57<00:43, 1.26it/s]
Loading 0:  85%|████████▌ | 309/363 [03:57<00:43, 1.26it/s]
Loading 0:  85%|████████▌ | 310/363 [03:59<00:50, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [03:59<00:50, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:01<00:59, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:01<00:59, 1.14s/it]
Loading 0:  88%|████████▊ | 319/363 [04:02<00:20, 2.11it/s]
Loading 0:  88%|████████▊ | 319/363 [04:02<00:20, 2.11it/s]
Loading 0:  89%|████████▊ | 322/363 [04:04<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:04<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:06<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:06<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:08<00:34, 1.15it/s]
Loading 0:  89%|████████▉ | 324/363 [04:08<00:34, 1.15it/s]
Loading 0:  90%|█████████ | 327/363 [04:10<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:10<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:12<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:12<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:14<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:14<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:15<00:12, 2.12it/s]
Loading 0:  93%|█████████▎| 337/363 [04:15<00:12, 2.12it/s]
Loading 0:  94%|█████████▎| 340/363 [04:18<00:12, 1.84it/s]
Loading 0:  94%|█████████▎| 340/363 [04:18<00:12, 1.84it/s]
Loading 0:  94%|█████████▍| 341/363 [04:19<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:19<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:21<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:21<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:23<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:23<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:25<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:25<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:27<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:27<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:28<00:03, 2.12it/s]
Loading 0:  98%|█████████▊| 355/363 [04:28<00:03, 2.12it/s]
Loading 0:  99%|█████████▉| 359/363 [04:31<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 359/363 [04:31<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 360/363 [04:33<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 360/363 [04:33<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 361/363 [04:35<00:01, 1.19it/s]
Loading 0:  99%|█████████▉| 361/363 [04:35<00:01, 1.19it/s]
Loading 0: 100%|██████████| 363/363 [04:35<00:00, 1.19it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:35<00:00, 1.32it/s]
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpzde0t1xs' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: quantized model in 281.887s
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp624_merged in 359.284s
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/tokenizer.json
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:06, 1.46it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:06, 1.46it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:51, 1.15s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:51, 1.15s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:58, 1.50s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:58, 1.50s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:11, 1.84it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:11, 1.84it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:54, 1.49it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:54, 1.49it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:12, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:12, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:33, 2.17it/s]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:33, 2.17it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:57, 1.86it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:57, 1.86it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:45, 1.45it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:45, 1.45it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:43, 1.15it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:43, 1.15it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:15, 1.27it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:15, 1.27it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:08, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:08, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:08, 1.15s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:08, 1.15s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:32, 2.06it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:32, 2.06it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.80it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.80it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:39, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:39, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:04, 1.25it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:04, 1.25it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:55, 1.03it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:55, 1.03it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:52, 1.16s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:52, 1.16s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:47<02:31, 1.96it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:47<02:31, 1.96it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:50<02:40, 1.82it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:50<02:40, 1.82it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:52<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:52<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:54<04:16, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:54<04:16, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:56<03:49, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:56<03:49, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:30, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:30, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<03:59, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<03:59, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.27it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.27it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 1.99it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 1.99it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:21, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:21, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.05it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.05it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:50, 1.14s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:50, 1.14s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:54, 1.07it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:54, 1.07it/s]
Loading 0:  31%|███       | 112/363 [01:24<04:35, 1.10s/it]
Loading 0:  31%|███       | 112/363 [01:24<04:35, 1.10s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:20, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:20, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.99it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.99it/s]
Loading 0:  34%|███▍      | 124/363 [01:30<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:30<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:32<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:32<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:34<03:34, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:34<03:34, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:36<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:36<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:40<04:31, 1.17s/it]
Loading 0:  36%|███▌      | 131/363 [01:40<04:31, 1.17s/it]
Loading 0:  38%|███▊      | 139/363 [01:41<01:49, 2.05it/s]
Loading 0:  38%|███▊      | 139/363 [01:41<01:49, 2.05it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 143/363 [01:45<02:36, 1.41it/s]
Loading 0:  39%|███▉      | 143/363 [01:45<02:36, 1.41it/s]
Loading 0:  40%|███▉      | 144/363 [01:47<03:15, 1.12it/s]
Loading 0:  40%|███▉      | 144/363 [01:47<03:15, 1.12it/s]
Loading 0:  40%|████      | 147/363 [01:49<02:53, 1.25it/s]
Loading 0:  40%|████      | 147/363 [01:49<02:53, 1.25it/s]
Loading 0:  41%|████      | 148/363 [01:51<03:28, 1.03it/s]
Loading 0:  41%|████      | 148/363 [01:51<03:28, 1.03it/s]
Loading 0:  41%|████      | 149/363 [01:53<04:08, 1.16s/it]
Loading 0:  41%|████      | 149/363 [01:53<04:08, 1.16s/it]
Loading 0:  43%|████▎     | 157/363 [01:54<01:40, 2.06it/s]
Loading 0:  43%|████▎     | 157/363 [01:54<01:40, 2.06it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.41it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.41it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.12it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:02<02:38, 1.25it/s]
Loading 0:  45%|████▌     | 165/363 [02:02<02:38, 1.25it/s]
Loading 0:  46%|████▌     | 166/363 [02:04<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 166/363 [02:04<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 167/363 [02:06<03:47, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:06<03:47, 1.16s/it]
Loading 0:  48%|████▊     | 174/363 [02:07<01:36, 1.96it/s]
Loading 0:  48%|████▊     | 174/363 [02:07<01:36, 1.96it/s]
Loading 0:  49%|████▉     | 178/363 [02:10<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 178/363 [02:10<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 179/363 [02:12<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:12<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:14<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:14<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:16<02:23, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:16<02:23, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:18<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:18<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:20<03:25, 1.16s/it]
Loading 0:  51%|█████     | 185/363 [02:20<03:25, 1.16s/it]
Loading 0:  53%|█████▎    | 192/363 [02:21<01:27, 1.96it/s]
Loading 0:  53%|█████▎    | 192/363 [02:21<01:27, 1.96it/s]
Loading 0:  54%|█████▍    | 196/363 [02:23<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 196/363 [02:23<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 197/363 [02:25<01:55, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:25<01:55, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:27<02:24, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:27<02:24, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:29<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:29<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:31<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:31<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:04, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:04, 1.15s/it]
Loading 0:  58%|█████▊    | 210/363 [02:34<01:18, 1.96it/s]
Loading 0:  58%|█████▊    | 210/363 [02:34<01:18, 1.96it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:43, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:43, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:08, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:08, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:46<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:46<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 228/363 [02:47<01:08, 1.96it/s]
Loading 0:  63%|██████▎   | 228/363 [02:47<01:08, 1.96it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:39, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:39, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 246/363 [03:01<00:59, 1.96it/s]
Loading 0:  68%|██████▊   | 246/363 [03:01<00:59, 1.96it/s]
Loading 0:  69%|██████▉   | 250/363 [03:03<01:01, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:03<01:01, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:05<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:05<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:07<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:07<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:09<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:09<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:11<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:11<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:13<02:01, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:13<02:01, 1.15s/it]
Loading 0:  73%|███████▎  | 265/363 [03:14<00:47, 2.06it/s]
Loading 0:  73%|███████▎  | 265/363 [03:14<00:47, 2.06it/s]
Loading 0:  74%|███████▍  | 268/363 [03:16<00:52, 1.80it/s]
Loading 0:  74%|███████▍  | 268/363 [03:16<00:52, 1.80it/s]
Loading 0:  74%|███████▍  | 269/363 [03:18<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 269/363 [03:18<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 270/363 [03:20<01:22, 1.12it/s]
Loading 0:  74%|███████▍  | 270/363 [03:20<01:22, 1.12it/s]
Loading 0:  75%|███████▌  | 273/363 [03:36<03:42, 2.47s/it]
Loading 0:  75%|███████▌  | 273/363 [03:36<03:42, 2.47s/it]
Loading 0:  75%|███████▌  | 274/363 [03:38<03:32, 2.39s/it]
Loading 0:  75%|███████▌  | 274/363 [03:38<03:32, 2.39s/it]
Loading 0:  76%|███████▌  | 275/363 [03:40<03:26, 2.34s/it]
Loading 0:  76%|███████▌  | 275/363 [03:40<03:26, 2.34s/it]
Loading 0:  78%|███████▊  | 283/363 [03:41<01:10, 1.14it/s]
Loading 0:  78%|███████▊  | 283/363 [03:41<01:10, 1.14it/s]
Loading 0:  79%|███████▉  | 286/363 [03:43<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:43<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:45<01:12, 1.04it/s]
Loading 0:  79%|███████▉  | 287/363 [03:45<01:12, 1.04it/s]
Loading 0:  79%|███████▉  | 288/363 [03:47<01:23, 1.11s/it]
Loading 0:  79%|███████▉  | 288/363 [03:47<01:23, 1.11s/it]
Loading 0:  80%|████████  | 291/363 [03:49<01:07, 1.06it/s]
Loading 0:  80%|████████  | 291/363 [03:49<01:07, 1.06it/s]
Loading 0:  80%|████████  | 292/363 [03:51<01:17, 1.09s/it]
Loading 0:  80%|████████  | 292/363 [03:51<01:17, 1.09s/it]
Loading 0:  81%|████████  | 293/363 [03:53<01:28, 1.27s/it]
Loading 0:  81%|████████  | 293/363 [03:53<01:28, 1.27s/it]
Loading 0:  83%|████████▎ | 301/363 [03:55<00:32, 1.93it/s]
Loading 0:  83%|████████▎ | 301/363 [03:55<00:32, 1.93it/s]
Loading 0:  84%|████████▎ | 304/363 [03:57<00:34, 1.70it/s]
Loading 0:  84%|████████▎ | 304/363 [03:57<00:34, 1.70it/s]
Loading 0:  84%|████████▍ | 305/363 [03:59<00:42, 1.35it/s]
Loading 0:  84%|████████▍ | 305/363 [03:59<00:42, 1.35it/s]
Loading 0:  84%|████████▍ | 306/363 [04:01<00:52, 1.08it/s]
Loading 0:  84%|████████▍ | 306/363 [04:01<00:52, 1.08it/s]
Loading 0:  85%|████████▌ | 309/363 [04:03<00:44, 1.21it/s]
Loading 0:  85%|████████▌ | 309/363 [04:03<00:44, 1.21it/s]
Loading 0:  85%|████████▌ | 310/363 [04:05<00:52, 1.01it/s]
Loading 0:  85%|████████▌ | 310/363 [04:05<00:52, 1.01it/s]
Loading 0:  86%|████████▌ | 311/363 [04:07<01:01, 1.19s/it]
Loading 0:  86%|████████▌ | 311/363 [04:07<01:01, 1.19s/it]
Loading 0:  88%|████████▊ | 319/363 [04:08<00:21, 2.04it/s]
Loading 0:  88%|████████▊ | 319/363 [04:08<00:21, 2.04it/s]
Loading 0:  89%|████████▊ | 322/363 [04:10<00:23, 1.76it/s]
Loading 0:  89%|████████▊ | 322/363 [04:10<00:23, 1.76it/s]
Loading 0:  89%|████████▉ | 323/363 [04:12<00:28, 1.38it/s]
Loading 0:  89%|████████▉ | 323/363 [04:12<00:28, 1.38it/s]
Loading 0:  89%|████████▉ | 324/363 [04:14<00:35, 1.10it/s]
Loading 0:  89%|████████▉ | 324/363 [04:14<00:35, 1.10it/s]
Loading 0:  90%|█████████ | 327/363 [04:16<00:29, 1.23it/s]
Loading 0:  90%|█████████ | 327/363 [04:16<00:29, 1.23it/s]
Loading 0:  90%|█████████ | 328/363 [04:18<00:34, 1.01it/s]
Loading 0:  90%|█████████ | 328/363 [04:18<00:34, 1.01it/s]
Loading 0:  91%|█████████ | 329/363 [04:20<00:40, 1.18s/it]
Loading 0:  91%|█████████ | 329/363 [04:20<00:40, 1.18s/it]
Loading 0:  93%|█████████▎| 337/363 [04:22<00:12, 2.06it/s]
Loading 0:  93%|█████████▎| 337/363 [04:22<00:12, 2.06it/s]
Loading 0:  94%|█████████▎| 340/363 [04:24<00:12, 1.78it/s]
Loading 0:  94%|█████████▎| 340/363 [04:24<00:12, 1.78it/s]
Loading 0:  94%|█████████▍| 341/363 [04:26<00:15, 1.39it/s]
Loading 0:  94%|█████████▍| 341/363 [04:26<00:15, 1.39it/s]
Loading 0:  94%|█████████▍| 342/363 [04:28<00:19, 1.10it/s]
Loading 0:  94%|█████████▍| 342/363 [04:28<00:19, 1.10it/s]
Loading 0:  95%|█████████▌| 345/363 [04:30<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 345/363 [04:30<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 346/363 [04:32<00:16, 1.02it/s]
Loading 0:  95%|█████████▌| 346/363 [04:32<00:16, 1.02it/s]
Loading 0:  96%|█████████▌| 347/363 [04:34<00:18, 1.18s/it]
Loading 0:  96%|█████████▌| 347/363 [04:34<00:18, 1.18s/it]
Loading 0:  98%|█████████▊| 355/363 [04:35<00:03, 2.04it/s]
Loading 0:  98%|█████████▊| 355/363 [04:35<00:03, 2.04it/s]
Loading 0:  99%|█████████▉| 359/363 [04:38<00:02, 1.81it/s]
Loading 0:  99%|█████████▉| 359/363 [04:38<00:02, 1.81it/s]
Loading 0:  99%|█████████▉| 360/363 [04:40<00:02, 1.44it/s]
Loading 0:  99%|█████████▉| 360/363 [04:40<00:02, 1.44it/s]
Loading 0:  99%|█████████▉| 361/363 [04:42<00:01, 1.14it/s]
Loading 0:  99%|█████████▉| 361/363 [04:42<00:01, 1.14it/s]
Loading 0: 100%|██████████| 363/363 [04:42<00:00, 1.53it/s]
Loading 0: 100%|██████████| 363/363 [04:42<00:00, 1.53it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:42<00:00, 1.28it/s]
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmphm75suwp' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:40, 1.45s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:40, 1.45s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.09it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.09it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:55, 1.49it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:55, 1.49it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:04, 1.15it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:04, 1.15it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:17, 1.09s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:17, 1.09s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:08, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:08, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:34, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:34, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:03, 1.25it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:03, 1.25it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:54, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:54, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:51, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:51, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:24, 2.06it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:24, 2.06it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.80it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.80it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:30, 1.83it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:30, 1.83it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:10, 1.44it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:10, 1.44it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:55, 2.29it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:55, 2.29it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.00it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.00it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:24<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:24<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:18, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:18, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.01it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.01it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:29, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:29, 1.16s/it]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:46, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:46, 1.15s/it]
Loading 0:  48%|████▊     | 174/363 [02:06<01:36, 1.96it/s]
Loading 0:  48%|████▊     | 174/363 [02:06<01:36, 1.96it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:07, 1.44it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:07, 1.44it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:21, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:21, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:51, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:51, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:19<03:23, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:19<03:23, 1.14s/it]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.07it/s]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.07it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.13it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.13it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:12, 2.09it/s]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:12, 2.09it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:45<02:42, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:45<02:42, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:03, 2.09it/s]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:03, 2.09it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:13<00:46, 2.10it/s]
Loading 0:  73%|███████▎  | 265/363 [03:13<00:46, 2.10it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:35, 2.40s/it]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:35, 2.40s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:26, 2.32s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:26, 2.32s/it]
Loading 0:  76%|███████▌  | 275/363 [03:38<03:20, 2.28s/it]
Loading 0:  76%|███████▌  | 275/363 [03:38<03:20, 2.28s/it]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.17it/s]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.17it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:21, 1.09s/it]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:21, 1.09s/it]
Loading 0:  80%|████████  | 291/363 [03:47<01:05, 1.10it/s]
Loading 0:  80%|████████  | 291/363 [03:47<01:05, 1.10it/s]
Loading 0:  80%|████████  | 292/363 [03:49<01:13, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [03:49<01:13, 1.04s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:25, 1.22s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:25, 1.22s/it]
Loading 0:  83%|████████▎ | 300/363 [03:52<00:33, 1.88it/s]
Loading 0:  83%|████████▎ | 300/363 [03:52<00:33, 1.88it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.78it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.78it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:04<00:59, 1.15s/it]
Loading 0:  86%|████████▌ | 311/363 [04:04<00:59, 1.15s/it]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.82it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.82it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.13it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.13it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  91%|█████████ | 329/363 [04:17<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:17<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.12it/s]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.12it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  98%|█████████▊| 354/363 [04:31<00:04, 1.97it/s]
Loading 0:  98%|█████████▊| 354/363 [04:31<00:04, 1.97it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.20it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.20it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.20it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.30it/s]
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: quantized model in 291.523s
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmp5tfibchk' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp156_merged in 361.110s
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: quantized model in 285.172s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp624_merged in 361.692s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:23, 1.41s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:23, 1.41s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:43, 2.14it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:43, 2.14it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:14, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:14, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:55, 1.88it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:55, 1.88it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.82it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.82it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<02:01, 1.99it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<02:01, 1.99it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:34, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:34, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:29, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:29, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.08it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.08it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.09it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.09it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:50, 1.83it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:50, 1.83it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:20, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:20, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.08it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.08it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.10it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.10it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.84it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.84it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:08, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:08, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.07it/s]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.07it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.08it/s]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.08it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:38, 1.13it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:38, 1.13it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.35s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:32, 1.80it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:32, 1.80it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:50, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:50, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.14s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.13it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.13it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.47it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.47it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.17it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.17it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.56it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.56it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: The tokenizer you are loading from '/tmp/tmp5p4hwfcu' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/config.json
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: quantized model in 283.793s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged in 362.309s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:41, 1.28it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:41, 1.28it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:44, 1.29s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:44, 1.29s/it]
Loading 0:   1%|▏         | 5.00/363 [00:08<12:20, 2.07s/it]
Loading 0:   1%|▏         | 5.00/363 [00:08<12:20, 2.07s/it]
Loading 0:   3%|▎         | 11.0/363 [00:09<04:03, 1.45it/s]
Loading 0:   3%|▎         | 11.0/363 [00:09<04:03, 1.45it/s]
Loading 0:   4%|▎         | 13.0/363 [00:11<04:46, 1.22it/s]
Loading 0:   4%|▎         | 13.0/363 [00:11<04:46, 1.22it/s]
Loading 0:   4%|▍         | 14.0/363 [00:14<06:01, 1.03s/it]
Loading 0:   4%|▍         | 14.0/363 [00:14<06:01, 1.03s/it]
Loading 0:   4%|▍         | 15.0/363 [00:16<07:21, 1.27s/it]
Loading 0:   4%|▍         | 15.0/363 [00:16<07:21, 1.27s/it]
Loading 0:   6%|▌         | 21.0/363 [00:19<04:24, 1.29it/s]
Loading 0:   6%|▌         | 21.0/363 [00:19<04:24, 1.29it/s]
Loading 0:   6%|▌         | 22.0/363 [00:21<05:26, 1.05it/s]
Loading 0:   6%|▌         | 22.0/363 [00:21<05:26, 1.05it/s]
Loading 0:   6%|▋         | 23.0/363 [00:23<06:33, 1.16s/it]
Loading 0:   6%|▋         | 23.0/363 [00:23<06:33, 1.16s/it]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:03, 1.81it/s]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:03, 1.81it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:16, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:16, 1.67it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:08, 1.32it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:08, 1.32it/s]
Loading 0:  10%|▉         | 36.0/363 [00:31<05:15, 1.04it/s]
Loading 0:  10%|▉         | 36.0/363 [00:31<05:15, 1.04it/s]
Loading 0:  11%|█         | 39.0/363 [00:34<04:38, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:34<04:38, 1.16it/s]
Loading 0:  11%|█         | 40.0/363 [00:36<05:32, 1.03s/it]
Loading 0:  11%|█         | 40.0/363 [00:36<05:32, 1.03s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:38<06:28, 1.21s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:38<06:28, 1.21s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:39<02:38, 1.98it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:39<02:38, 1.98it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<02:57, 1.76it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<02:57, 1.76it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<03:43, 1.39it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<03:43, 1.39it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<04:38, 1.11it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<04:38, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:07, 1.24it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:07, 1.24it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<04:58, 1.02it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<04:58, 1.02it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:51<05:55, 1.17s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<05:55, 1.17s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:52<02:24, 2.04it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:52<02:24, 2.04it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:54<02:44, 1.79it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:54<02:44, 1.79it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:56<03:28, 1.40it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:56<03:28, 1.40it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:58<04:20, 1.12it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:58<04:20, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [01:00<03:51, 1.24it/s]
Loading 0:  21%|██        | 75.0/363 [01:00<03:51, 1.24it/s]
Loading 0:  21%|██        | 76.0/363 [01:02<04:39, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [01:02<04:39, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [01:04<05:32, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [01:04<05:32, 1.16s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:06<02:15, 2.05it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:06<02:15, 2.05it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:08<02:33, 1.79it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:08<02:33, 1.79it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:10<03:14, 1.41it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:10<03:14, 1.41it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:12<04:04, 1.12it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:12<04:04, 1.12it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:13<01:56, 2.27it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:13<01:56, 2.27it/s]
Loading 0:  28%|██▊       | 101/363 [01:15<02:12, 1.98it/s] 
Loading 0:  28%|██▊       | 101/363 [01:15<02:12, 1.98it/s]
Loading 0:  28%|██▊       | 102/363 [01:17<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 102/363 [01:17<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 103/363 [01:19<03:37, 1.20it/s]
Loading 0:  28%|██▊       | 103/363 [01:19<03:37, 1.20it/s]
Loading 0:  29%|██▉       | 106/363 [01:21<03:21, 1.27it/s]
Loading 0:  29%|██▉       | 106/363 [01:21<03:21, 1.27it/s]
Loading 0:  29%|██▉       | 107/363 [01:23<04:03, 1.05it/s]
Loading 0:  29%|██▉       | 107/363 [01:23<04:03, 1.05it/s]
Loading 0:  30%|██▉       | 108/363 [01:25<04:50, 1.14s/it]
Loading 0:  30%|██▉       | 108/363 [01:25<04:50, 1.14s/it]
Loading 0:  31%|███       | 111/363 [01:27<03:54, 1.07it/s]
Loading 0:  31%|███       | 111/363 [01:27<03:54, 1.07it/s]
Loading 0:  31%|███       | 112/363 [01:29<04:36, 1.10s/it]
Loading 0:  31%|███       | 112/363 [01:29<04:36, 1.10s/it]
Loading 0:  31%|███       | 113/363 [01:31<05:20, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:31<05:20, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:32<02:02, 1.98it/s]
Loading 0:  33%|███▎      | 121/363 [01:32<02:02, 1.98it/s]
Loading 0:  34%|███▍      | 124/363 [01:35<02:16, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:35<02:16, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:36<02:52, 1.38it/s]
Loading 0:  34%|███▍      | 125/363 [01:36<02:52, 1.38it/s]
Loading 0:  35%|███▍      | 126/363 [01:39<03:35, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:39<03:35, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:40<03:09, 1.23it/s]
Loading 0:  36%|███▌      | 129/363 [01:40<03:09, 1.23it/s]
Loading 0:  36%|███▌      | 130/363 [01:42<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:42<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:44<04:31, 1.17s/it]
Loading 0:  36%|███▌      | 131/363 [01:44<04:31, 1.17s/it]
Loading 0:  38%|███▊      | 138/363 [01:45<01:55, 1.95it/s]
Loading 0:  38%|███▊      | 138/363 [01:45<01:55, 1.95it/s]
Loading 0:  39%|███▉      | 142/363 [01:48<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:48<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:50<02:34, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:50<02:34, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:52<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:52<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:54<02:52, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:54<02:52, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:56<03:27, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:56<03:27, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:58<04:07, 1.16s/it]
Loading 0:  41%|████      | 149/363 [01:58<04:07, 1.16s/it]
Loading 0:  43%|████▎     | 157/363 [01:59<01:40, 2.05it/s]
Loading 0:  43%|████▎     | 157/363 [01:59<01:40, 2.05it/s]
Loading 0:  44%|████▍     | 160/363 [02:01<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 160/363 [02:01<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 161/363 [02:03<02:23, 1.41it/s]
Loading 0:  44%|████▍     | 161/363 [02:03<02:23, 1.41it/s]
Loading 0:  45%|████▍     | 162/363 [02:05<02:59, 1.12it/s]
Loading 0:  45%|████▍     | 162/363 [02:05<02:59, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:07<02:38, 1.25it/s]
Loading 0:  45%|████▌     | 165/363 [02:07<02:38, 1.25it/s]
Loading 0:  46%|████▌     | 166/363 [02:09<03:11, 1.03it/s]
Loading 0:  46%|████▌     | 166/363 [02:09<03:11, 1.03it/s]
Loading 0:  46%|████▌     | 167/363 [02:11<03:47, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:11<03:47, 1.16s/it]
Loading 0:  48%|████▊     | 174/363 [02:12<01:36, 1.96it/s]
Loading 0:  48%|████▊     | 174/363 [02:12<01:36, 1.96it/s]
Loading 0:  49%|████▉     | 178/363 [02:15<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:15<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:17<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:17<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:19<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:19<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:21<02:23, 1.25it/s]
Loading 0:  50%|█████     | 183/363 [02:21<02:23, 1.25it/s]
Loading 0:  51%|█████     | 184/363 [02:23<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:23<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:25<03:25, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:25<03:25, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:26<01:22, 2.06it/s]
Loading 0:  53%|█████▎    | 193/363 [02:26<01:22, 2.06it/s]
Loading 0:  54%|█████▍    | 196/363 [02:28<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:28<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:30<01:57, 1.42it/s]
Loading 0:  54%|█████▍    | 197/363 [02:30<01:57, 1.42it/s]
Loading 0:  55%|█████▍    | 198/363 [02:32<02:26, 1.12it/s]
Loading 0:  55%|█████▍    | 198/363 [02:32<02:26, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:34<02:09, 1.25it/s]
Loading 0:  55%|█████▌    | 201/363 [02:34<02:09, 1.25it/s]
Loading 0:  56%|█████▌    | 202/363 [02:36<02:35, 1.03it/s]
Loading 0:  56%|█████▌    | 202/363 [02:36<02:35, 1.03it/s]
Loading 0:  56%|█████▌    | 203/363 [02:38<03:05, 1.16s/it]
Loading 0:  56%|█████▌    | 203/363 [02:38<03:05, 1.16s/it]
Loading 0:  58%|█████▊    | 210/363 [02:39<01:18, 1.96it/s]
Loading 0:  58%|█████▊    | 210/363 [02:39<01:18, 1.96it/s]
Loading 0:  59%|█████▉    | 214/363 [02:41<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:41<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:43<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:43<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:45<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:45<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:47<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:47<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:49<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:49<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:51<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:51<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 228/363 [02:52<01:08, 1.96it/s]
Loading 0:  63%|██████▎   | 228/363 [02:52<01:08, 1.96it/s]
Loading 0:  64%|██████▍   | 232/363 [02:55<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:55<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:57<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:57<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:59<01:53, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:59<01:53, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [03:01<01:40, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [03:01<01:40, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [03:03<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [03:03<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [03:05<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [03:05<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 246/363 [03:06<00:59, 1.96it/s]
Loading 0:  68%|██████▊   | 246/363 [03:06<00:59, 1.96it/s]
Loading 0:  69%|██████▉   | 250/363 [03:08<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 250/363 [03:08<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 251/363 [03:10<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:10<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:12<01:37, 1.13it/s]
Loading 0:  69%|██████▉   | 252/363 [03:12<01:37, 1.13it/s]
Loading 0:  70%|███████   | 255/363 [03:14<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:14<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:16<01:43, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:16<01:43, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:18<02:02, 1.16s/it]
Loading 0:  71%|███████   | 257/363 [03:18<02:02, 1.16s/it]
Loading 0:  73%|███████▎  | 265/363 [03:19<00:47, 2.05it/s]
Loading 0:  73%|███████▎  | 265/363 [03:19<00:47, 2.05it/s]
Loading 0:  74%|███████▍  | 268/363 [03:22<00:53, 1.79it/s]
Loading 0:  74%|███████▍  | 268/363 [03:22<00:53, 1.79it/s]
Loading 0:  74%|███████▍  | 269/363 [03:23<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 269/363 [03:23<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 270/363 [03:26<01:23, 1.12it/s]
Loading 0:  74%|███████▍  | 270/363 [03:26<01:23, 1.12it/s]
Loading 0:  75%|███████▌  | 273/363 [03:41<03:41, 2.46s/it]
Loading 0:  75%|███████▌  | 273/363 [03:41<03:41, 2.46s/it]
Loading 0:  75%|███████▌  | 274/363 [03:43<03:31, 2.38s/it]
Loading 0:  75%|███████▌  | 274/363 [03:43<03:31, 2.38s/it]
Loading 0:  76%|███████▌  | 275/363 [03:45<03:25, 2.33s/it]
Loading 0:  76%|███████▌  | 275/363 [03:45<03:25, 2.33s/it]
Loading 0:  78%|███████▊  | 283/363 [03:46<01:09, 1.15it/s]
Loading 0:  78%|███████▊  | 283/363 [03:46<01:09, 1.15it/s]
Loading 0:  79%|███████▉  | 286/363 [03:48<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:48<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:50<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 287/363 [03:50<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 288/363 [03:52<01:21, 1.08s/it]
Loading 0:  79%|███████▉  | 288/363 [03:52<01:21, 1.08s/it]
Loading 0:  80%|████████  | 291/363 [03:54<01:05, 1.11it/s]
Loading 0:  80%|████████  | 291/363 [03:54<01:05, 1.11it/s]
Loading 0:  80%|████████  | 292/363 [03:56<01:13, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [03:56<01:13, 1.04s/it]
Loading 0:  81%|████████  | 293/363 [03:58<01:25, 1.22s/it]
Loading 0:  81%|████████  | 293/363 [03:58<01:25, 1.22s/it]
Loading 0:  83%|████████▎ | 301/363 [03:59<00:30, 2.00it/s]
Loading 0:  83%|████████▎ | 301/363 [03:59<00:30, 2.00it/s]
Loading 0:  84%|████████▎ | 304/363 [04:01<00:32, 1.81it/s]
Loading 0:  84%|████████▎ | 304/363 [04:01<00:32, 1.81it/s]
Loading 0:  84%|████████▍ | 305/363 [04:03<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 305/363 [04:03<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 306/363 [04:05<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [04:05<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:07<00:43, 1.24it/s]
Loading 0:  85%|████████▌ | 309/363 [04:07<00:43, 1.24it/s]
Loading 0:  85%|████████▌ | 310/363 [04:09<00:51, 1.02it/s]
Loading 0:  85%|████████▌ | 310/363 [04:09<00:51, 1.02it/s]
Loading 0:  86%|████████▌ | 311/363 [04:11<01:00, 1.17s/it]
Loading 0:  86%|████████▌ | 311/363 [04:11<01:00, 1.17s/it]
Loading 0:  88%|████████▊ | 319/363 [04:12<00:21, 2.07it/s]
Loading 0:  88%|████████▊ | 319/363 [04:12<00:21, 2.07it/s]
Loading 0:  89%|████████▊ | 322/363 [04:14<00:22, 1.80it/s]
Loading 0:  89%|████████▊ | 322/363 [04:14<00:22, 1.80it/s]
Loading 0:  89%|████████▉ | 323/363 [04:16<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:16<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:18<00:34, 1.13it/s]
Loading 0:  89%|████████▉ | 324/363 [04:18<00:34, 1.13it/s]
Loading 0:  90%|█████████ | 327/363 [04:20<00:28, 1.25it/s]
Loading 0:  90%|█████████ | 327/363 [04:20<00:28, 1.25it/s]
Loading 0:  90%|█████████ | 328/363 [04:22<00:33, 1.03it/s]
Loading 0:  90%|█████████ | 328/363 [04:22<00:33, 1.03it/s]
Loading 0:  91%|█████████ | 329/363 [04:24<00:39, 1.16s/it]
Loading 0:  91%|█████████ | 329/363 [04:24<00:39, 1.16s/it]
Loading 0:  93%|█████████▎| 337/363 [04:25<00:12, 2.08it/s]
Loading 0:  93%|█████████▎| 337/363 [04:25<00:12, 2.08it/s]
Loading 0:  94%|█████████▎| 340/363 [04:28<00:12, 1.80it/s]
Loading 0:  94%|█████████▎| 340/363 [04:28<00:12, 1.80it/s]
Loading 0:  94%|█████████▍| 341/363 [04:30<00:15, 1.40it/s]
Loading 0:  94%|█████████▍| 341/363 [04:30<00:15, 1.40it/s]
Loading 0:  94%|█████████▍| 342/363 [04:32<00:18, 1.11it/s]
Loading 0:  94%|█████████▍| 342/363 [04:32<00:18, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [04:34<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 345/363 [04:34<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 346/363 [04:36<00:16, 1.01it/s]
Loading 0:  95%|█████████▌| 346/363 [04:36<00:16, 1.01it/s]
Loading 0:  96%|█████████▌| 347/363 [04:38<00:18, 1.18s/it]
Loading 0:  96%|█████████▌| 347/363 [04:38<00:18, 1.18s/it]
Loading 0:  98%|█████████▊| 355/363 [04:39<00:03, 2.04it/s]
Loading 0:  98%|█████████▊| 355/363 [04:39<00:03, 2.04it/s]
Loading 0:  99%|█████████▉| 359/363 [04:42<00:02, 1.77it/s]
Loading 0:  99%|█████████▉| 359/363 [04:42<00:02, 1.77it/s]
Loading 0:  99%|█████████▉| 360/363 [04:44<00:02, 1.41it/s]
Loading 0:  99%|█████████▉| 360/363 [04:44<00:02, 1.41it/s]
Loading 0:  99%|█████████▉| 361/363 [04:46<00:01, 1.13it/s]
Loading 0:  99%|█████████▉| 361/363 [04:46<00:01, 1.13it/s]
Loading 0: 100%|██████████| 363/363 [04:46<00:00, 1.13it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:46<00:00, 1.27it/s]
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmp_nqshyye' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: quantized model in 294.125s
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp468_merged in 375.151s
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:23, 1.37it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:23, 1.37it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.37it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.37it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.36it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.36it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:23, 1.13s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:23, 1.13s/it]
Loading 0:   8%|▊         | 30.0/363 [00:22<02:59, 1.85it/s]
Loading 0:   8%|▊         | 30.0/363 [00:22<02:59, 1.85it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:50, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:50, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:37<02:58, 1.77it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:37<02:58, 1.77it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:01, 1.02it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:01, 1.02it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:27, 1.07s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:27, 1.07s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:30, 1.29s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:30, 1.29s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:52<02:49, 1.75it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:52<02:49, 1.75it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:57<03:48, 1.28it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:57<03:48, 1.28it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:46, 1.02it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:46, 1.02it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:09, 1.08s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:09, 1.08s/it]
Loading 0:  21%|██        | 77.0/363 [01:06<06:24, 1.34s/it]
Loading 0:  21%|██        | 77.0/363 [01:06<06:24, 1.34s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:45, 1.69it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:45, 1.69it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:10<02:52, 1.59it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:10<02:52, 1.59it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:37, 1.26it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:37, 1.26it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.94it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.94it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.39it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.39it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<03:59, 1.08it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<03:59, 1.08it/s]
Loading 0:  29%|██▉       | 106/363 [01:25<03:43, 1.15it/s]
Loading 0:  29%|██▉       | 106/363 [01:25<03:43, 1.15it/s]
Loading 0:  29%|██▉       | 107/363 [01:27<04:30, 1.06s/it]
Loading 0:  29%|██▉       | 107/363 [01:27<04:30, 1.06s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:22, 1.27s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:22, 1.27s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:21, 1.04s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:21, 1.04s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:07, 1.22s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:07, 1.22s/it]
Loading 0:  31%|███       | 113/363 [01:36<05:58, 1.43s/it]
Loading 0:  31%|███       | 113/363 [01:36<05:58, 1.43s/it]
Loading 0:  33%|███▎      | 120/363 [01:37<02:23, 1.69it/s]
Loading 0:  33%|███▎      | 120/363 [01:37<02:23, 1.69it/s]
Loading 0:  34%|███▍      | 124/363 [01:40<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:40<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:42<03:11, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:42<03:11, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  36%|███▌      | 129/363 [01:47<03:31, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:47<03:31, 1.11it/s]
Loading 0:  36%|███▌      | 130/363 [01:49<04:14, 1.09s/it]
Loading 0:  36%|███▌      | 130/363 [01:49<04:14, 1.09s/it]
Loading 0:  36%|███▌      | 131/363 [01:51<05:02, 1.30s/it]
Loading 0:  36%|███▌      | 131/363 [01:51<05:02, 1.30s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  39%|███▉      | 142/363 [01:55<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 142/363 [01:55<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 143/363 [01:57<02:52, 1.27it/s]
Loading 0:  39%|███▉      | 143/363 [01:57<02:52, 1.27it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:36, 1.01it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:36, 1.01it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:12, 1.12it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:12, 1.12it/s]
Loading 0:  41%|████      | 148/363 [02:04<03:52, 1.08s/it]
Loading 0:  41%|████      | 148/363 [02:04<03:52, 1.08s/it]
Loading 0:  41%|████      | 149/363 [02:06<04:38, 1.30s/it]
Loading 0:  41%|████      | 149/363 [02:06<04:38, 1.30s/it]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.74it/s]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.74it/s]
Loading 0:  44%|████▍     | 160/363 [02:10<02:05, 1.62it/s]
Loading 0:  44%|████▍     | 160/363 [02:10<02:05, 1.62it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▌     | 165/363 [02:17<02:57, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:17<02:57, 1.12it/s]
Loading 0:  46%|████▌     | 166/363 [02:19<03:33, 1.08s/it]
Loading 0:  46%|████▌     | 166/363 [02:19<03:33, 1.08s/it]
Loading 0:  46%|████▌     | 167/363 [02:21<04:13, 1.29s/it]
Loading 0:  46%|████▌     | 167/363 [02:21<04:13, 1.29s/it]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.75it/s]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.75it/s]
Loading 0:  49%|████▉     | 178/363 [02:25<01:53, 1.63it/s]
Loading 0:  49%|████▉     | 178/363 [02:25<01:53, 1.63it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:24, 1.28it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:24, 1.28it/s]
Loading 0:  50%|████▉     | 180/363 [02:30<03:00, 1.02it/s]
Loading 0:  50%|████▉     | 180/363 [02:30<03:00, 1.02it/s]
Loading 0:  50%|█████     | 183/363 [02:32<02:40, 1.12it/s]
Loading 0:  50%|█████     | 183/363 [02:32<02:40, 1.12it/s]
Loading 0:  51%|█████     | 184/363 [02:34<03:12, 1.08s/it]
Loading 0:  51%|█████     | 184/363 [02:34<03:12, 1.08s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:55, 1.32s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:55, 1.32s/it]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:39, 1.72it/s]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:39, 1.72it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  55%|█████▍    | 198/363 [02:45<02:43, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:45<02:43, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:47<02:24, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:47<02:24, 1.12it/s]
Loading 0:  56%|█████▌    | 202/363 [02:49<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 202/363 [02:49<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.29s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.29s/it]
Loading 0:  58%|█████▊    | 210/363 [02:53<01:27, 1.76it/s]
Loading 0:  58%|█████▊    | 210/363 [02:53<01:27, 1.76it/s]
Loading 0:  59%|█████▉    | 214/363 [02:55<01:31, 1.63it/s]
Loading 0:  59%|█████▉    | 214/363 [02:55<01:31, 1.63it/s]
Loading 0:  59%|█████▉    | 215/363 [02:58<01:55, 1.28it/s]
Loading 0:  59%|█████▉    | 215/363 [02:58<01:55, 1.28it/s]
Loading 0:  60%|█████▉    | 216/363 [03:00<02:24, 1.02it/s]
Loading 0:  60%|█████▉    | 216/363 [03:00<02:24, 1.02it/s]
Loading 0:  60%|██████    | 219/363 [03:02<02:08, 1.12it/s]
Loading 0:  60%|██████    | 219/363 [03:02<02:08, 1.12it/s]
Loading 0:  61%|██████    | 220/363 [03:04<02:34, 1.08s/it]
Loading 0:  61%|██████    | 220/363 [03:04<02:34, 1.08s/it]
Loading 0:  61%|██████    | 221/363 [03:07<03:03, 1.29s/it]
Loading 0:  61%|██████    | 221/363 [03:07<03:03, 1.29s/it]
Loading 0:  63%|██████▎   | 228/363 [03:08<01:17, 1.75it/s]
Loading 0:  63%|██████▎   | 228/363 [03:08<01:17, 1.75it/s]
Loading 0:  64%|██████▍   | 232/363 [03:10<01:20, 1.63it/s]
Loading 0:  64%|██████▍   | 232/363 [03:10<01:20, 1.63it/s]
Loading 0:  64%|██████▍   | 233/363 [03:13<01:41, 1.28it/s]
Loading 0:  64%|██████▍   | 233/363 [03:13<01:41, 1.28it/s]
Loading 0:  64%|██████▍   | 234/363 [03:15<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:15<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:17<01:52, 1.12it/s]
Loading 0:  65%|██████▌   | 237/363 [03:17<01:52, 1.12it/s]
Loading 0:  66%|██████▌   | 238/363 [03:19<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 238/363 [03:19<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 239/363 [03:22<02:41, 1.30s/it]
Loading 0:  66%|██████▌   | 239/363 [03:22<02:41, 1.30s/it]
Loading 0:  68%|██████▊   | 246/363 [03:23<01:07, 1.73it/s]
Loading 0:  68%|██████▊   | 246/363 [03:23<01:07, 1.73it/s]
Loading 0:  69%|██████▉   | 250/363 [03:26<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 250/363 [03:26<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 251/363 [03:28<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 251/363 [03:28<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 252/363 [03:30<01:50, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:30<01:50, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:32<01:36, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:32<01:36, 1.12it/s]
Loading 0:  71%|███████   | 256/363 [03:34<01:56, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:34<01:56, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:37<02:17, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:37<02:17, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:38<00:57, 1.73it/s]
Loading 0:  73%|███████▎  | 264/363 [03:38<00:57, 1.73it/s]
Loading 0:  74%|███████▍  | 268/363 [03:41<00:58, 1.61it/s]
Loading 0:  74%|███████▍  | 268/363 [03:41<00:58, 1.61it/s]
Loading 0:  74%|███████▍  | 269/363 [03:43<01:14, 1.27it/s]
Loading 0:  74%|███████▍  | 269/363 [03:43<01:14, 1.27it/s]
Loading 0:  74%|███████▍  | 270/363 [03:45<01:32, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:45<01:32, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:02<03:58, 2.65s/it]
Loading 0:  75%|███████▌  | 273/363 [04:02<03:58, 2.65s/it]
Loading 0:  75%|███████▌  | 274/363 [04:04<03:49, 2.58s/it]
Loading 0:  75%|███████▌  | 274/363 [04:04<03:49, 2.58s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:50, 2.62s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:50, 2.62s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:25, 1.05s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:25, 1.05s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:31, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:31, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:17<01:14, 1.04s/it]
Loading 0:  80%|████████  | 291/363 [04:17<01:14, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [04:19<01:25, 1.21s/it]
Loading 0:  80%|████████  | 292/363 [04:19<01:25, 1.21s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:38, 1.40s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:38, 1.40s/it]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0:  84%|████████▎ | 304/363 [04:25<00:37, 1.59it/s]
Loading 0:  84%|████████▎ | 304/363 [04:25<00:37, 1.59it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.25it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.25it/s]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:56, 1.00it/s]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:56, 1.00it/s]
Loading 0:  85%|████████▌ | 309/363 [04:32<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:32<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 310/363 [04:34<00:57, 1.09s/it]
Loading 0:  85%|████████▌ | 310/363 [04:34<00:57, 1.09s/it]
Loading 0:  86%|████████▌ | 311/363 [04:36<01:07, 1.30s/it]
Loading 0:  86%|████████▌ | 311/363 [04:36<01:07, 1.30s/it]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0:  89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0:  90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.30s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.30s/it]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.76it/s]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.76it/s]
Loading 0:  94%|█████████▎| 340/363 [04:55<00:14, 1.63it/s]
Loading 0:  94%|█████████▎| 340/363 [04:55<00:14, 1.63it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0:  95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.30s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.30s/it]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.75it/s]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.75it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.05it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.15it/s]
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmp8huzjr3o' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: quantized model in 323.307s
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp312_merged in 409.082s
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:28, 1.34it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:28, 1.34it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:14, 1.21s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:14, 1.21s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:19, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:19, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:17, 1.36it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:17, 1.36it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:35, 1.04it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:35, 1.04it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:16, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:16, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:22<06:27, 1.14s/it]
Loading 0:   6%|▋         | 23.0/363 [00:22<06:27, 1.14s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0:   9%|▉         | 34.0/363 [00:26<03:18, 1.66it/s]
Loading 0:   9%|▉         | 34.0/363 [00:26<03:18, 1.66it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:12, 1.30it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:12, 1.30it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:08, 1.00it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:08, 1.00it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:36, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:36, 1.11it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:33, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:33, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:38, 1.31s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:38, 1.31s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:05, 1.58it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:05, 1.58it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:54, 1.25it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:54, 1.25it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:01<04:52, 1.01s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:01<04:52, 1.01s/it]
Loading 0:  21%|██        | 75.0/363 [01:03<04:21, 1.10it/s]
Loading 0:  21%|██        | 75.0/363 [01:03<04:21, 1.10it/s]
Loading 0:  21%|██        | 76.0/363 [01:05<05:14, 1.10s/it]
Loading 0:  21%|██        | 76.0/363 [01:05<05:14, 1.10s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:14, 1.31s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:14, 1.31s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.72it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.72it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:52, 1.59it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:52, 1.59it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:38, 1.25it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:38, 1.25it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:33, 1.00s/it]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:33, 1.00s/it]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:17, 1.93it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:17, 1.93it/s]
Loading 0:  28%|██▊       | 101/363 [01:20<02:27, 1.77it/s] 
Loading 0:  28%|██▊       | 101/363 [01:20<02:27, 1.77it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:03, 1.07it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:03, 1.07it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:49, 1.12it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:49, 1.12it/s]
Loading 0:  29%|██▉       | 107/363 [01:29<04:36, 1.08s/it]
Loading 0:  29%|██▉       | 107/363 [01:29<04:36, 1.08s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:28, 1.29s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:28, 1.29s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:26, 1.06s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:26, 1.06s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:05, 1.46s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:05, 1.46s/it]
Loading 0:  33%|███▎      | 120/363 [01:39<02:27, 1.65it/s]
Loading 0:  33%|███▎      | 120/363 [01:39<02:27, 1.65it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:34, 1.55it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:34, 1.55it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:14, 1.22it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:14, 1.22it/s]
Loading 0:  35%|███▍      | 126/363 [01:46<04:02, 1.03s/it]
Loading 0:  35%|███▍      | 126/363 [01:46<04:02, 1.03s/it]
Loading 0:  36%|███▌      | 129/363 [01:49<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 129/363 [01:49<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 130/363 [01:51<04:18, 1.11s/it]
Loading 0:  36%|███▌      | 130/363 [01:51<04:18, 1.11s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:07, 1.33s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:07, 1.33s/it]
Loading 0:  38%|███▊      | 138/363 [01:54<02:11, 1.71it/s]
Loading 0:  38%|███▊      | 138/363 [01:54<02:11, 1.71it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:19, 1.58it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:19, 1.58it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:56, 1.25it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:56, 1.25it/s]
Loading 0:  40%|███▉      | 144/363 [02:02<03:39, 1.00s/it]
Loading 0:  40%|███▉      | 144/363 [02:02<03:39, 1.00s/it]
Loading 0:  40%|████      | 147/363 [02:04<03:15, 1.11it/s]
Loading 0:  40%|████      | 147/363 [02:04<03:15, 1.11it/s]
Loading 0:  41%|████      | 148/363 [02:06<03:55, 1.09s/it]
Loading 0:  41%|████      | 148/363 [02:06<03:55, 1.09s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.26it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.26it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:20, 1.00it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:20, 1.00it/s]
Loading 0:  45%|████▌     | 165/363 [02:19<02:57, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:19<02:57, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:21<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 166/363 [02:21<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.73it/s]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.61it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.61it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:25, 1.26it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:25, 1.26it/s]
Loading 0:  50%|████▉     | 180/363 [02:32<03:02, 1.00it/s]
Loading 0:  50%|████▉     | 180/363 [02:32<03:02, 1.00it/s]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.11it/s]
Loading 0:  51%|█████     | 184/363 [02:36<03:14, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:36<03:14, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:14, 1.24it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:14, 1.24it/s]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:47, 1.01s/it]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:47, 1.01s/it]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:27, 1.10it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:27, 1.10it/s]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:57, 1.10s/it]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:57, 1.10s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:31, 1.32s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:31, 1.32s/it]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:29, 1.71it/s]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:29, 1.71it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:34, 1.58it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:34, 1.58it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:58, 1.25it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:58, 1.25it/s]
Loading 0:  60%|█████▉    | 216/363 [03:03<02:27, 1.00s/it]
Loading 0:  60%|█████▉    | 216/363 [03:03<02:27, 1.00s/it]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.10it/s]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.10it/s]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.10s/it]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.10s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 233/363 [03:15<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 233/363 [03:15<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:09, 1.00s/it]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:09, 1.00s/it]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:53, 1.11it/s]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:53, 1.11it/s]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:17, 1.10s/it]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:17, 1.10s/it]
Loading 0:  66%|██████▌   | 239/363 [03:24<02:42, 1.31s/it]
Loading 0:  66%|██████▌   | 239/363 [03:24<02:42, 1.31s/it]
Loading 0:  68%|██████▊   | 246/363 [03:26<01:08, 1.72it/s]
Loading 0:  68%|██████▊   | 246/363 [03:26<01:08, 1.72it/s]
Loading 0:  69%|██████▉   | 250/363 [03:29<01:11, 1.59it/s]
Loading 0:  69%|██████▉   | 250/363 [03:29<01:11, 1.59it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:29, 1.25it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:29, 1.25it/s]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.00s/it]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.00s/it]
Loading 0:  70%|███████   | 255/363 [03:35<01:37, 1.11it/s]
Loading 0:  70%|███████   | 255/363 [03:35<01:37, 1.11it/s]
Loading 0:  71%|███████   | 256/363 [03:37<01:57, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:37<01:57, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:19, 1.31s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:19, 1.31s/it]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:57, 1.72it/s]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:57, 1.72it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.60it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.60it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:32, 1.00it/s]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:32, 1.00it/s]
Loading 0:  75%|███████▌  | 273/363 [04:05<04:01, 2.68s/it]
Loading 0:  75%|███████▌  | 273/363 [04:05<04:01, 2.68s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:51, 2.60s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:51, 2.60s/it]
Loading 0:  76%|███████▌  | 275/363 [04:10<03:45, 2.56s/it]
Loading 0:  76%|███████▌  | 275/363 [04:10<03:45, 2.56s/it]
Loading 0:  78%|███████▊  | 282/363 [04:11<01:23, 1.03s/it]
Loading 0:  78%|███████▊  | 282/363 [04:11<01:23, 1.03s/it]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 287/363 [04:16<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 287/363 [04:16<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [04:18<01:32, 1.24s/it]
Loading 0:  79%|███████▉  | 288/363 [04:18<01:32, 1.24s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:15, 1.05s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:15, 1.05s/it]
Loading 0:  80%|████████  | 292/363 [04:23<01:27, 1.23s/it]
Loading 0:  80%|████████  | 292/363 [04:23<01:27, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [04:25<01:39, 1.42s/it]
Loading 0:  81%|████████  | 293/363 [04:25<01:39, 1.42s/it]
Loading 0:  83%|████████▎ | 300/363 [04:26<00:38, 1.63it/s]
Loading 0:  83%|████████▎ | 300/363 [04:26<00:38, 1.63it/s]
Loading 0:  84%|████████▎ | 304/363 [04:29<00:37, 1.56it/s]
Loading 0:  84%|████████▎ | 304/363 [04:29<00:37, 1.56it/s]
Loading 0:  84%|████████▍ | 305/363 [04:31<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 305/363 [04:31<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 306/363 [04:33<00:57, 1.01s/it]
Loading 0:  84%|████████▍ | 306/363 [04:33<00:57, 1.01s/it]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:48, 1.10it/s]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:48, 1.10it/s]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0:  86%|████████▌ | 311/363 [04:40<01:08, 1.31s/it]
Loading 0:  86%|████████▌ | 311/363 [04:40<01:08, 1.31s/it]
Loading 0:  88%|████████▊ | 318/363 [04:41<00:25, 1.75it/s]
Loading 0:  88%|████████▊ | 318/363 [04:41<00:25, 1.75it/s]
Loading 0:  89%|████████▊ | 322/363 [04:44<00:25, 1.63it/s]
Loading 0:  89%|████████▊ | 322/363 [04:44<00:25, 1.63it/s]
Loading 0:  89%|████████▉ | 323/363 [04:46<00:32, 1.23it/s]
Loading 0:  89%|████████▉ | 323/363 [04:46<00:32, 1.23it/s]
Loading 0:  89%|████████▉ | 324/363 [04:48<00:39, 1.01s/it]
Loading 0:  89%|████████▉ | 324/363 [04:48<00:39, 1.01s/it]
Loading 0:  90%|█████████ | 327/363 [04:51<00:32, 1.10it/s]
Loading 0:  90%|█████████ | 327/363 [04:51<00:32, 1.10it/s]
Loading 0:  90%|█████████ | 328/363 [04:53<00:38, 1.10s/it]
Loading 0:  90%|█████████ | 328/363 [04:53<00:38, 1.10s/it]
Loading 0:  91%|█████████ | 329/363 [04:55<00:44, 1.31s/it]
Loading 0:  91%|█████████ | 329/363 [04:55<00:44, 1.31s/it]
Loading 0:  93%|█████████▎| 336/363 [04:56<00:15, 1.75it/s]
Loading 0:  93%|█████████▎| 336/363 [04:56<00:15, 1.75it/s]
Loading 0:  94%|█████████▎| 340/363 [04:59<00:14, 1.62it/s]
Loading 0:  94%|█████████▎| 340/363 [04:59<00:14, 1.62it/s]
Loading 0:  94%|█████████▍| 341/363 [05:01<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 341/363 [05:01<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:18, 1.09s/it]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:18, 1.09s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:20, 1.30s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:20, 1.30s/it]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.76it/s]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.76it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.39it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.39it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.14it/s]
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-26775-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpise9ql0c' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: quantized model in 326.905s
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp312_merged in 427.041s
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/tokenizer.json
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-1-404-v4/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer completed after 521.33s with status: succeeded
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/flywheel_model.1.safetensors
Stopping job with name chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer
Pipeline stage MKMLizer completed in 538.84s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.26s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-98p-2ff-chaiml-m-97330-v1
Waiting for inference service chaiml-98p-2ff-chaiml-m-97330-v1 to be ready
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer completed after 547.0s with status: succeeded
Stopping job with name chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer
Pipeline stage MKMLizer completed in 551.50s
run pipeline stage %s
Running pipeline stage MKMLTemplater
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-26775-v1/nvidia/flywheel_model.0.safetensors
Pipeline stage MKMLTemplater completed in 1.26s
Job chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer completed after 551.56s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer
Running pipeline stage MKMLDeployer
Pipeline stage MKMLizer completed in 555.64s
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-1-404-v4/nvidia/flywheel_model.0.safetensors
Creating inference service chaiml-98p-2ff-chaiml-m-29442-v1
run pipeline stage %s
Running pipeline stage MKMLTemplater
Waiting for inference service chaiml-98p-2ff-chaiml-m-29442-v1 to be ready
Pipeline stage MKMLTemplater completed in 1.53s
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/flywheel_model.0.safetensors
run pipeline stage %s
Job chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer completed after 566.55s with status: succeeded
Running pipeline stage MKMLDeployer
Stopping job with name chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer
Creating inference service chaiml-98p-2ff-chaiml-m-26775-v1
Pipeline stage MKMLizer completed in 570.05s
run pipeline stage %s
Waiting for inference service chaiml-98p-2ff-chaiml-m-26775-v1 to be ready
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.28s
Job chaiml-mistral-24b-2048-1-404-v4-mkmlizer completed after 563.82s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-mistral-24b-2048-1-404-v4-mkmlizer
Running pipeline stage MKMLDeployer
Pipeline stage MKMLizer completed in 568.29s
Creating inference service chaiml-98p-2ff-chaiml-mi-5577-v1
run pipeline stage %s
Waiting for inference service chaiml-98p-2ff-chaiml-mi-5577-v1 to be ready
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.28s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-1-404-v4
Waiting for inference service chaiml-mistral-24b-2048-1-404-v4 to be ready
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer completed after 587.01s with status: succeeded
Stopping job with name chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer
Pipeline stage MKMLizer completed in 590.64s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.85s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-98p-2ff-chaiml-m-24271-v1
Waiting for inference service chaiml-98p-2ff-chaiml-m-24271-v1 to be ready
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer completed after 594.22s with status: succeeded
Stopping job with name chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer
Pipeline stage MKMLizer completed in 598.59s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.36s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-98p-2ff-chaiml-mi-7904-v1
Waiting for inference service chaiml-98p-2ff-chaiml-mi-7904-v1 to be ready
Inference service chaiml-98p-2ff-chaiml-m-97330-v1 ready after 162.30547952651978s
Pipeline stage MKMLDeployer completed in 167.21s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.0279693603515625s
Received healthy response to inference request in 3.3125665187835693s
Received healthy response to inference request in 3.5405468940734863s
Inference service chaiml-98p-2ff-chaiml-m-29442-v1 ready after 162.24224281311035s
Pipeline stage MKMLDeployer completed in 169.34s
run pipeline stage %s
Received healthy response to inference request in 2.8764586448669434s
Running pipeline stage StressChecker
Inference service chaiml-98p-2ff-chaiml-m-26775-v1 ready after 162.23782753944397s
Received healthy response to inference request in 3.1069746017456055s
Received healthy response to inference request in 3.2790422439575195s
Pipeline stage MKMLDeployer completed in 168.07s
5 requests
run pipeline stage %s
0 failed requests
Running pipeline stage StressChecker
5th percentile: 2.922561836242676
10th percentile: 2.968665027618408
Received healthy response to inference request in 3.3512439727783203s
Inference service chaiml-98p-2ff-chaiml-mi-5577-v1 ready after 162.43351411819458s
20th percentile: 3.060871410369873
Pipeline stage MKMLDeployer completed in 168.72s
30th percentile: 3.1480929851531982
Received healthy response to inference request in 3.201908826828003s
run pipeline stage %s
40th percentile: 3.230329751968384
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0138161182403564s
50th percentile: 3.3125665187835693
60th percentile: 3.403758668899536
Inference service chaiml-mistral-24b-2048-1-404-v4 ready after 162.2154459953308s
Received healthy response to inference request in 3.229271173477173s
70th percentile: 3.4949508190155028
Pipeline stage MKMLDeployer completed in 167.50s
Received healthy response to inference request in 3.3603248596191406s
Received healthy response to inference request in 3.288726568222046s
80th percentile: 3.6380313873291015
run pipeline stage %s
Inference service chaiml-98p-2ff-chaiml-m-24271-v1 ready after 152.38188934326172s
90th percentile: 3.833000373840332
Running pipeline stage StressChecker
Received healthy response to inference request in 3.278508186340332s
Pipeline stage MKMLDeployer completed in 157.82s
95th percentile: 3.9304848670959474
Received healthy response to inference request in 3.3437111377716064s
run pipeline stage %s
Received healthy response to inference request in 3.336179256439209s
99th percentile: 4.008472461700439
Running pipeline stage StressChecker
5 requests
mean time: 3.3729032039642335
Received healthy response to inference request in 3.3869218826293945s
Received healthy response to inference request in 3.2099225521087646s
0 failed requests
Pipeline stage StressChecker completed in 51.24s
Received healthy response to inference request in 3.474846839904785s
5th percentile: 3.0668613433837892
run pipeline stage %s
Received healthy response to inference request in 3.3269381523132324s
10th percentile: 3.1199065685272216
Received healthy response to inference request in 3.1541669368743896s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Received healthy response to inference request in 3.172478675842285s
20th percentile: 3.2259970188140867
Received healthy response to inference request in 3.1980111598968506s
Inference service chaiml-98p-2ff-chaiml-mi-7904-v1 ready after 152.0316994190216s
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.598950147628784s
5 requests
30th percentile: 3.280979108810425
Pipeline stage MKMLDeployer completed in 159.60s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.3095247745513916s
0 failed requests
40th percentile: 3.2848528385162354
run pipeline stage %s
Received healthy response to inference request in 3.273332118988037s
triggered trigger_guanaco_pipeline args=%s
5th percentile: 3.178364706039429
Received healthy response to inference request in 3.5333213806152344s
50th percentile: 3.288726568222046
Running pipeline stage StressChecker
5 requests
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 11.87s
10th percentile: 3.184250736236572
Received healthy response to inference request in 3.6479368209838867s
60th percentile: 3.307707643508911
0 failed requests
run pipeline stage %s
Received healthy response to inference request in 3.3414437770843506s
20th percentile: 3.196022796630859
70th percentile: 3.3266887187957765
Received healthy response to inference request in 3.697134494781494s
5th percentile: 3.213075351715088
Running pipeline stage TriggerMKMLProfilingPipeline
30th percentile: 3.2035115718841554
80th percentile: 3.339192199707031
Received healthy response to inference request in 2.997227191925049s
10th percentile: 3.228139543533325
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.309713840484619s
40th percentile: 3.20671706199646
90th percentile: 3.3452180862426757
5 requests
20th percentile: 3.2582679271697996
Received healthy response to inference request in 3.4517791271209717s
starting trigger_guanaco_pipeline args=%s
5 requests
50th percentile: 3.2099225521087646
95th percentile: 3.3482310295104982
0 failed requests
30th percentile: 3.287407922744751
triggered trigger_guanaco_pipeline args=%s
0 failed requests
60th percentile: 3.217662000656128
99th percentile: 3.350641384124756
5th percentile: 3.028615140914917
40th percentile: 3.3155595302581786
Received healthy response to inference request in 3.1979072093963623s
Pipeline stage TriggerMKMLProfilingPipeline completed in 13.81s
5th percentile: 3.313158702850342
70th percentile: 3.225401449203491
mean time: 3.25380163192749
10th percentile: 3.060003089904785
50th percentile: 3.3437111377716064
Shutdown handler de-registered
10th percentile: 3.3166035652160644
80th percentile: 3.2391185760498047
Pipeline stage StressChecker completed in 71.44s
20th percentile: 3.1227789878845216
60th percentile: 3.35035662651062
10th percentile: 3.3166035652160644
80th percentile: 3.2391185760498047
Pipeline stage StressChecker completed in 71.44s
20th percentile: 3.1227789878845216
60th percentile: 3.35035662651062
chaiml-98p-2ff-chaiml-m_97330_v1 status is now deployed due to DeploymentManager action
20th percentile: 3.3234932899475096
chaiml-98p-2ff-chaiml-m_97330_v1 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of chaiml-98p-2ff-chaiml-m_97330_v1
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLDeleter
Checking if service chaiml-98p-2ff-chaiml-m-97330-v1 is running
Tearing down inference service chaiml-98p-2ff-chaiml-m-97330-v1
Service chaiml-98p-2ff-chaiml-m-97330-v1 has been torndown
Pipeline stage MKMLDeleter completed in 2.01s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
%s, retrying in %s seconds...
Cleaning model data from S3
Cleaning model data from model cache
%s, retrying in %s seconds...
Cleaning model data from S3
Cleaning model data from model cache
clean up pipeline due to error=TeardownError("Got unexpected keyword argument 'request_checksum_calculation'")
Shutdown handler de-registered
chaiml-98p-2ff-chaiml-m_97330_v1 status is now torndown due to DeploymentManager action