developer_uid: rirv938
submission_id: chaiml-98p-2ff-chaiml-m_26775_v1
model_name: chaiml-98p-2ff-chaiml-m_26775_v1
model_group: ChaiML/98p_2ff_chaiml_mi
status: torndown
timestamp: 2026-02-23T11:51:42+00:00
num_battles: 10263
num_wins: 6187
celo_rating: 1371.12
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp624_merged
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 96
reward_model: default
display_name: chaiml-98p-2ff-chaiml-m_26775_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp624_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-17
win_ratio: 0.6028451719770048
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '<|im_start|>', 'You:', '</s>', '###'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 96}
formatter: {'memory_template': '[SYSTEM_PROMPT]Respond as a high quality storyteller.[/SYSTEM_PROMPT][INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
Starting job with name chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer
run pipeline %s
Waiting for job on chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer to finish
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Waiting for job on chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer to finish
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLizer
run pipeline %s
Starting job with name chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer
run pipeline stage %s
Waiting for job on chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer to finish
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-1-404-v4-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-1-404-v4-mkmlizer to finish
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: bash: no job control in this shell
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: bash: no job control in this shell
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: bash: no job control in this shell
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Downloaded to shared memory in 77.397s
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp624_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpzde0t1xs, device:0
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Downloaded to shared memory in 69.586s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp156_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Downloaded to shared memory in 76.519s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmphm75suwp, device:0
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp624_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Downloaded to shared memory in 81.025s
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp5tfibchk, device:0
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp468_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp_nqshyye, device:0
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Downloaded to shared memory in 85.774s
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp312_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp8huzjr3o, device:0
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Downloaded to shared memory in 78.516s
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged already exists in ChaiML
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp5p4hwfcu, device:0
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Downloaded to shared memory in 100.136s
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp312_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpise9ql0c, device:0
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:46, 1.54it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:46, 1.54it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:55, 1.18it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:55, 1.18it/s]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:09, 1.06s/it]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:09, 1.06s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:41, 1.54it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:41, 1.54it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:35, 1.24it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:35, 1.24it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:37, 1.01it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:37, 1.01it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:30, 2.21it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:30, 2.21it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:52, 1.90it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:52, 1.90it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:38, 1.17it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:38, 1.17it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:28, 2.11it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:28, 2.11it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:48, 1.84it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:48, 1.84it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:34, 1.44it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:34, 1.44it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:30, 1.14it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:30, 1.14it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:00, 1.27it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:00, 1.27it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:50, 1.05it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:50, 1.05it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:46, 1.14s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:46, 1.14s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:21, 2.09it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:21, 2.09it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:48<02:40, 1.83it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:48<02:40, 1.83it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:50<03:23, 1.44it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:50<03:23, 1.44it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:52<04:15, 1.14it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:52<04:15, 1.14it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:46, 1.27it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:46, 1.27it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:33, 1.05it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:33, 1.05it/s]
Loading 0:  21%|██        | 77.0/363 [00:58<05:25, 1.14s/it]
Loading 0:  21%|██        | 77.0/363 [00:58<05:25, 1.14s/it]
Loading 0:  23%|██▎       | 85.0/363 [00:59<02:12, 2.10it/s]
Loading 0:  23%|██▎       | 85.0/363 [00:59<02:12, 2.10it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:01<02:29, 1.84it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:01<02:29, 1.84it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:03<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:03<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:05<04:01, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:05<04:01, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:06<01:54, 2.31it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:06<01:54, 2.31it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:10<02:47, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:10<02:47, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:12<03:33, 1.22it/s]
Loading 0:  28%|██▊       | 103/363 [01:12<03:33, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:14<03:18, 1.30it/s]
Loading 0:  29%|██▉       | 106/363 [01:14<03:18, 1.30it/s]
Loading 0:  29%|██▉       | 107/363 [01:16<03:59, 1.07it/s]
Loading 0:  29%|██▉       | 107/363 [01:16<03:59, 1.07it/s]
Loading 0:  30%|██▉       | 108/363 [01:18<04:46, 1.12s/it]
Loading 0:  30%|██▉       | 108/363 [01:18<04:46, 1.12s/it]
Loading 0:  31%|███       | 111/363 [01:20<03:50, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:20<03:50, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:22<04:31, 1.08s/it]
Loading 0:  31%|███       | 112/363 [01:22<04:31, 1.08s/it]
Loading 0:  31%|███       | 113/363 [01:24<05:15, 1.26s/it]
Loading 0:  31%|███       | 113/363 [01:24<05:15, 1.26s/it]
Loading 0:  33%|███▎      | 121/363 [01:25<01:59, 2.03it/s]
Loading 0:  33%|███▎      | 121/363 [01:25<01:59, 2.03it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.41it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.41it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:31, 1.12it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:31, 1.12it/s]
Loading 0:  36%|███▌      | 129/363 [01:33<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:33<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:35<03:44, 1.04it/s]
Loading 0:  36%|███▌      | 130/363 [01:35<03:44, 1.04it/s]
Loading 0:  36%|███▌      | 131/363 [01:37<04:27, 1.15s/it]
Loading 0:  36%|███▌      | 131/363 [01:37<04:27, 1.15s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.09it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.09it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:33, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:33, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:50, 1.27it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:50, 1.27it/s]
Loading 0:  41%|████      | 148/363 [01:48<03:25, 1.05it/s]
Loading 0:  41%|████      | 148/363 [01:48<03:25, 1.05it/s]
Loading 0:  41%|████      | 149/363 [01:50<04:04, 1.14s/it]
Loading 0:  41%|████      | 149/363 [01:50<04:04, 1.14s/it]
Loading 0:  43%|████▎     | 157/363 [01:52<01:38, 2.10it/s]
Loading 0:  43%|████▎     | 157/363 [01:52<01:38, 2.10it/s]
Loading 0:  44%|████▍     | 160/363 [01:54<01:50, 1.84it/s]
Loading 0:  44%|████▍     | 160/363 [01:54<01:50, 1.84it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:20, 1.44it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:20, 1.44it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:55, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:55, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:35, 1.27it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:35, 1.27it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:07, 1.05it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:07, 1.05it/s]
Loading 0:  46%|████▌     | 167/363 [02:04<03:43, 1.14s/it]
Loading 0:  46%|████▌     | 167/363 [02:04<03:43, 1.14s/it]
Loading 0:  48%|████▊     | 175/363 [02:05<01:29, 2.10it/s]
Loading 0:  48%|████▊     | 175/363 [02:05<01:29, 2.10it/s]
Loading 0:  49%|████▉     | 178/363 [02:07<01:40, 1.84it/s]
Loading 0:  49%|████▉     | 178/363 [02:07<01:40, 1.84it/s]
Loading 0:  49%|████▉     | 179/363 [02:09<02:07, 1.44it/s]
Loading 0:  49%|████▉     | 179/363 [02:09<02:07, 1.44it/s]
Loading 0:  50%|████▉     | 180/363 [02:11<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:11<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:13<02:21, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:13<02:21, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:50, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:50, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  53%|█████▎    | 193/363 [02:18<01:20, 2.11it/s]
Loading 0:  53%|█████▎    | 193/363 [02:18<01:20, 2.11it/s]
Loading 0:  54%|█████▍    | 196/363 [02:20<01:30, 1.85it/s]
Loading 0:  54%|█████▍    | 196/363 [02:20<01:30, 1.85it/s]
Loading 0:  54%|█████▍    | 197/363 [02:22<01:54, 1.44it/s]
Loading 0:  54%|█████▍    | 197/363 [02:22<01:54, 1.44it/s]
Loading 0:  55%|█████▍    | 198/363 [02:24<02:24, 1.15it/s]
Loading 0:  55%|█████▍    | 198/363 [02:24<02:24, 1.15it/s]
Loading 0:  55%|█████▌    | 201/363 [02:26<02:07, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:26<02:07, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:28<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:28<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:30<03:02, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:30<03:02, 1.14s/it]
Loading 0:  58%|█████▊    | 211/363 [02:31<01:11, 2.11it/s]
Loading 0:  58%|█████▊    | 211/363 [02:31<01:11, 2.11it/s]
Loading 0:  59%|█████▉    | 214/363 [02:33<01:20, 1.85it/s]
Loading 0:  59%|█████▉    | 214/363 [02:33<01:20, 1.85it/s]
Loading 0:  59%|█████▉    | 215/363 [02:35<01:42, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:35<01:42, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:37<02:08, 1.15it/s]
Loading 0:  60%|█████▉    | 216/363 [02:37<02:08, 1.15it/s]
Loading 0:  60%|██████    | 219/363 [02:39<01:52, 1.28it/s]
Loading 0:  60%|██████    | 219/363 [02:39<01:52, 1.28it/s]
Loading 0:  61%|██████    | 220/363 [02:41<02:15, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:41<02:15, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:43<02:41, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:43<02:41, 1.14s/it]
Loading 0:  63%|██████▎   | 229/363 [02:44<01:03, 2.11it/s]
Loading 0:  63%|██████▎   | 229/363 [02:44<01:03, 2.11it/s]
Loading 0:  64%|██████▍   | 232/363 [02:46<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 232/363 [02:46<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 233/363 [02:48<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 233/363 [02:48<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 234/363 [02:50<01:52, 1.15it/s]
Loading 0:  64%|██████▍   | 234/363 [02:50<01:52, 1.15it/s]
Loading 0:  65%|██████▌   | 237/363 [02:52<01:38, 1.28it/s]
Loading 0:  65%|██████▌   | 237/363 [02:52<01:38, 1.28it/s]
Loading 0:  66%|██████▌   | 238/363 [02:54<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:54<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:56<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [02:56<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 247/363 [02:57<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:57<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [02:59<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [02:59<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:01<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 251/363 [03:01<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 252/363 [03:03<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:03<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:05<01:24, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:05<01:24, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:07<01:41, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:07<01:41, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:09<02:00, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:09<02:00, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:10<00:46, 2.09it/s]
Loading 0:  73%|███████▎  | 265/363 [03:10<00:46, 2.09it/s]
Loading 0:  74%|███████▍  | 268/363 [03:12<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:12<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:14<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 269/363 [03:14<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 270/363 [03:16<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:16<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:31<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 273/363 [03:31<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 274/363 [03:33<03:25, 2.31s/it]
Loading 0:  75%|███████▌  | 274/363 [03:33<03:25, 2.31s/it]
Loading 0:  76%|███████▌  | 275/363 [03:35<03:18, 2.26s/it]
Loading 0:  76%|███████▌  | 275/363 [03:35<03:18, 2.26s/it]
Loading 0:  78%|███████▊  | 283/363 [03:36<01:07, 1.18it/s]
Loading 0:  78%|███████▊  | 283/363 [03:36<01:07, 1.18it/s]
Loading 0:  79%|███████▉  | 286/363 [03:38<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:38<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:40<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 287/363 [03:40<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 288/363 [03:42<01:21, 1.08s/it]
Loading 0:  79%|███████▉  | 288/363 [03:42<01:21, 1.08s/it]
Loading 0:  80%|████████  | 291/363 [03:44<01:06, 1.09it/s]
Loading 0:  80%|████████  | 291/363 [03:44<01:06, 1.09it/s]
Loading 0:  80%|████████  | 292/363 [03:46<01:15, 1.06s/it]
Loading 0:  80%|████████  | 292/363 [03:46<01:15, 1.06s/it]
Loading 0:  81%|████████  | 293/363 [03:48<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:48<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:49<00:31, 1.99it/s]
Loading 0:  83%|████████▎ | 301/363 [03:49<00:31, 1.99it/s]
Loading 0:  84%|████████▎ | 304/363 [03:51<00:33, 1.78it/s]
Loading 0:  84%|████████▎ | 304/363 [03:51<00:33, 1.78it/s]
Loading 0:  84%|████████▍ | 305/363 [03:53<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 305/363 [03:53<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 306/363 [03:55<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:55<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:57<00:43, 1.26it/s]
Loading 0:  85%|████████▌ | 309/363 [03:57<00:43, 1.26it/s]
Loading 0:  85%|████████▌ | 310/363 [03:59<00:50, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [03:59<00:50, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:01<00:59, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:01<00:59, 1.14s/it]
Loading 0:  88%|████████▊ | 319/363 [04:02<00:20, 2.11it/s]
Loading 0:  88%|████████▊ | 319/363 [04:02<00:20, 2.11it/s]
Loading 0:  89%|████████▊ | 322/363 [04:04<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:04<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:06<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:06<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:08<00:34, 1.15it/s]
Loading 0:  89%|████████▉ | 324/363 [04:08<00:34, 1.15it/s]
Loading 0:  90%|█████████ | 327/363 [04:10<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:10<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:12<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:12<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:14<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:14<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:15<00:12, 2.12it/s]
Loading 0:  93%|█████████▎| 337/363 [04:15<00:12, 2.12it/s]
Loading 0:  94%|█████████▎| 340/363 [04:18<00:12, 1.84it/s]
Loading 0:  94%|█████████▎| 340/363 [04:18<00:12, 1.84it/s]
Loading 0:  94%|█████████▍| 341/363 [04:19<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:19<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:21<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:21<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:23<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:23<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:25<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:25<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:27<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:27<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:28<00:03, 2.12it/s]
Loading 0:  98%|█████████▊| 355/363 [04:28<00:03, 2.12it/s]
Loading 0:  99%|█████████▉| 359/363 [04:31<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 359/363 [04:31<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 360/363 [04:33<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 360/363 [04:33<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 361/363 [04:35<00:01, 1.19it/s]
Loading 0:  99%|█████████▉| 361/363 [04:35<00:01, 1.19it/s]
Loading 0: 100%|██████████| 363/363 [04:35<00:00, 1.19it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:35<00:00, 1.32it/s]
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpzde0t1xs' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: quantized model in 281.887s
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp624_merged in 359.284s
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/tokenizer.json
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:06, 1.46it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:06, 1.46it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:51, 1.15s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:51, 1.15s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:58, 1.50s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:58, 1.50s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:11, 1.84it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:11, 1.84it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:54, 1.49it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:54, 1.49it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:12, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:12, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:33, 2.17it/s]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:33, 2.17it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:57, 1.86it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:57, 1.86it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:45, 1.45it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:45, 1.45it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:43, 1.15it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:43, 1.15it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:15, 1.27it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:15, 1.27it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:08, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:08, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:08, 1.15s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:08, 1.15s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:32, 2.06it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:32, 2.06it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.80it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:52, 1.80it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:39, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:39, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:35, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:04, 1.25it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:04, 1.25it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:55, 1.03it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:55, 1.03it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:52, 1.16s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:52, 1.16s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:47<02:31, 1.96it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:47<02:31, 1.96it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:50<02:40, 1.82it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:50<02:40, 1.82it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:52<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:52<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:54<04:16, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:54<04:16, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:56<03:49, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:56<03:49, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:30, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:30, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<03:59, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<03:59, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.27it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.27it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 1.99it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 1.99it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:36, 1.20it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:21, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:21, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.05it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.05it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:50, 1.14s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:50, 1.14s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:54, 1.07it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:54, 1.07it/s]
Loading 0:  31%|███       | 112/363 [01:24<04:35, 1.10s/it]
Loading 0:  31%|███       | 112/363 [01:24<04:35, 1.10s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:20, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:20, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.99it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.99it/s]
Loading 0:  34%|███▍      | 124/363 [01:30<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:30<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:32<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:32<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:34<03:34, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:34<03:34, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:36<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:36<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:40<04:31, 1.17s/it]
Loading 0:  36%|███▌      | 131/363 [01:40<04:31, 1.17s/it]
Loading 0:  38%|███▊      | 139/363 [01:41<01:49, 2.05it/s]
Loading 0:  38%|███▊      | 139/363 [01:41<01:49, 2.05it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 143/363 [01:45<02:36, 1.41it/s]
Loading 0:  39%|███▉      | 143/363 [01:45<02:36, 1.41it/s]
Loading 0:  40%|███▉      | 144/363 [01:47<03:15, 1.12it/s]
Loading 0:  40%|███▉      | 144/363 [01:47<03:15, 1.12it/s]
Loading 0:  40%|████      | 147/363 [01:49<02:53, 1.25it/s]
Loading 0:  40%|████      | 147/363 [01:49<02:53, 1.25it/s]
Loading 0:  41%|████      | 148/363 [01:51<03:28, 1.03it/s]
Loading 0:  41%|████      | 148/363 [01:51<03:28, 1.03it/s]
Loading 0:  41%|████      | 149/363 [01:53<04:08, 1.16s/it]
Loading 0:  41%|████      | 149/363 [01:53<04:08, 1.16s/it]
Loading 0:  43%|████▎     | 157/363 [01:54<01:40, 2.06it/s]
Loading 0:  43%|████▎     | 157/363 [01:54<01:40, 2.06it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.41it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.41it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.12it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:02<02:38, 1.25it/s]
Loading 0:  45%|████▌     | 165/363 [02:02<02:38, 1.25it/s]
Loading 0:  46%|████▌     | 166/363 [02:04<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 166/363 [02:04<03:10, 1.03it/s]
Loading 0:  46%|████▌     | 167/363 [02:06<03:47, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:06<03:47, 1.16s/it]
Loading 0:  48%|████▊     | 174/363 [02:07<01:36, 1.96it/s]
Loading 0:  48%|████▊     | 174/363 [02:07<01:36, 1.96it/s]
Loading 0:  49%|████▉     | 178/363 [02:10<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 178/363 [02:10<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 179/363 [02:12<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:12<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:14<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:14<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:16<02:23, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:16<02:23, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:18<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:18<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:20<03:25, 1.16s/it]
Loading 0:  51%|█████     | 185/363 [02:20<03:25, 1.16s/it]
Loading 0:  53%|█████▎    | 192/363 [02:21<01:27, 1.96it/s]
Loading 0:  53%|█████▎    | 192/363 [02:21<01:27, 1.96it/s]
Loading 0:  54%|█████▍    | 196/363 [02:23<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 196/363 [02:23<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 197/363 [02:25<01:55, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:25<01:55, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:27<02:24, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:27<02:24, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:29<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:29<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:31<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:31<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:04, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:04, 1.15s/it]
Loading 0:  58%|█████▊    | 210/363 [02:34<01:18, 1.96it/s]
Loading 0:  58%|█████▊    | 210/363 [02:34<01:18, 1.96it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:43, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:43, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:08, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:08, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:46<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:46<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 228/363 [02:47<01:08, 1.96it/s]
Loading 0:  63%|██████▎   | 228/363 [02:47<01:08, 1.96it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:39, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:39, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 246/363 [03:01<00:59, 1.96it/s]
Loading 0:  68%|██████▊   | 246/363 [03:01<00:59, 1.96it/s]
Loading 0:  69%|██████▉   | 250/363 [03:03<01:01, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:03<01:01, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:05<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:05<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:07<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:07<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:09<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:09<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:11<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:11<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:13<02:01, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:13<02:01, 1.15s/it]
Loading 0:  73%|███████▎  | 265/363 [03:14<00:47, 2.06it/s]
Loading 0:  73%|███████▎  | 265/363 [03:14<00:47, 2.06it/s]
Loading 0:  74%|███████▍  | 268/363 [03:16<00:52, 1.80it/s]
Loading 0:  74%|███████▍  | 268/363 [03:16<00:52, 1.80it/s]
Loading 0:  74%|███████▍  | 269/363 [03:18<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 269/363 [03:18<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 270/363 [03:20<01:22, 1.12it/s]
Loading 0:  74%|███████▍  | 270/363 [03:20<01:22, 1.12it/s]
Loading 0:  75%|███████▌  | 273/363 [03:36<03:42, 2.47s/it]
Loading 0:  75%|███████▌  | 273/363 [03:36<03:42, 2.47s/it]
Loading 0:  75%|███████▌  | 274/363 [03:38<03:32, 2.39s/it]
Loading 0:  75%|███████▌  | 274/363 [03:38<03:32, 2.39s/it]
Loading 0:  76%|███████▌  | 275/363 [03:40<03:26, 2.34s/it]
Loading 0:  76%|███████▌  | 275/363 [03:40<03:26, 2.34s/it]
Loading 0:  78%|███████▊  | 283/363 [03:41<01:10, 1.14it/s]
Loading 0:  78%|███████▊  | 283/363 [03:41<01:10, 1.14it/s]
Loading 0:  79%|███████▉  | 286/363 [03:43<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:43<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:45<01:12, 1.04it/s]
Loading 0:  79%|███████▉  | 287/363 [03:45<01:12, 1.04it/s]
Loading 0:  79%|███████▉  | 288/363 [03:47<01:23, 1.11s/it]
Loading 0:  79%|███████▉  | 288/363 [03:47<01:23, 1.11s/it]
Loading 0:  80%|████████  | 291/363 [03:49<01:07, 1.06it/s]
Loading 0:  80%|████████  | 291/363 [03:49<01:07, 1.06it/s]
Loading 0:  80%|████████  | 292/363 [03:51<01:17, 1.09s/it]
Loading 0:  80%|████████  | 292/363 [03:51<01:17, 1.09s/it]
Loading 0:  81%|████████  | 293/363 [03:53<01:28, 1.27s/it]
Loading 0:  81%|████████  | 293/363 [03:53<01:28, 1.27s/it]
Loading 0:  83%|████████▎ | 301/363 [03:55<00:32, 1.93it/s]
Loading 0:  83%|████████▎ | 301/363 [03:55<00:32, 1.93it/s]
Loading 0:  84%|████████▎ | 304/363 [03:57<00:34, 1.70it/s]
Loading 0:  84%|████████▎ | 304/363 [03:57<00:34, 1.70it/s]
Loading 0:  84%|████████▍ | 305/363 [03:59<00:42, 1.35it/s]
Loading 0:  84%|████████▍ | 305/363 [03:59<00:42, 1.35it/s]
Loading 0:  84%|████████▍ | 306/363 [04:01<00:52, 1.08it/s]
Loading 0:  84%|████████▍ | 306/363 [04:01<00:52, 1.08it/s]
Loading 0:  85%|████████▌ | 309/363 [04:03<00:44, 1.21it/s]
Loading 0:  85%|████████▌ | 309/363 [04:03<00:44, 1.21it/s]
Loading 0:  85%|████████▌ | 310/363 [04:05<00:52, 1.01it/s]
Loading 0:  85%|████████▌ | 310/363 [04:05<00:52, 1.01it/s]
Loading 0:  86%|████████▌ | 311/363 [04:07<01:01, 1.19s/it]
Loading 0:  86%|████████▌ | 311/363 [04:07<01:01, 1.19s/it]
Loading 0:  88%|████████▊ | 319/363 [04:08<00:21, 2.04it/s]
Loading 0:  88%|████████▊ | 319/363 [04:08<00:21, 2.04it/s]
Loading 0:  89%|████████▊ | 322/363 [04:10<00:23, 1.76it/s]
Loading 0:  89%|████████▊ | 322/363 [04:10<00:23, 1.76it/s]
Loading 0:  89%|████████▉ | 323/363 [04:12<00:28, 1.38it/s]
Loading 0:  89%|████████▉ | 323/363 [04:12<00:28, 1.38it/s]
Loading 0:  89%|████████▉ | 324/363 [04:14<00:35, 1.10it/s]
Loading 0:  89%|████████▉ | 324/363 [04:14<00:35, 1.10it/s]
Loading 0:  90%|█████████ | 327/363 [04:16<00:29, 1.23it/s]
Loading 0:  90%|█████████ | 327/363 [04:16<00:29, 1.23it/s]
Loading 0:  90%|█████████ | 328/363 [04:18<00:34, 1.01it/s]
Loading 0:  90%|█████████ | 328/363 [04:18<00:34, 1.01it/s]
Loading 0:  91%|█████████ | 329/363 [04:20<00:40, 1.18s/it]
Loading 0:  91%|█████████ | 329/363 [04:20<00:40, 1.18s/it]
Loading 0:  93%|█████████▎| 337/363 [04:22<00:12, 2.06it/s]
Loading 0:  93%|█████████▎| 337/363 [04:22<00:12, 2.06it/s]
Loading 0:  94%|█████████▎| 340/363 [04:24<00:12, 1.78it/s]
Loading 0:  94%|█████████▎| 340/363 [04:24<00:12, 1.78it/s]
Loading 0:  94%|█████████▍| 341/363 [04:26<00:15, 1.39it/s]
Loading 0:  94%|█████████▍| 341/363 [04:26<00:15, 1.39it/s]
Loading 0:  94%|█████████▍| 342/363 [04:28<00:19, 1.10it/s]
Loading 0:  94%|█████████▍| 342/363 [04:28<00:19, 1.10it/s]
Loading 0:  95%|█████████▌| 345/363 [04:30<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 345/363 [04:30<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 346/363 [04:32<00:16, 1.02it/s]
Loading 0:  95%|█████████▌| 346/363 [04:32<00:16, 1.02it/s]
Loading 0:  96%|█████████▌| 347/363 [04:34<00:18, 1.18s/it]
Loading 0:  96%|█████████▌| 347/363 [04:34<00:18, 1.18s/it]
Loading 0:  98%|█████████▊| 355/363 [04:35<00:03, 2.04it/s]
Loading 0:  98%|█████████▊| 355/363 [04:35<00:03, 2.04it/s]
Loading 0:  99%|█████████▉| 359/363 [04:38<00:02, 1.81it/s]
Loading 0:  99%|█████████▉| 359/363 [04:38<00:02, 1.81it/s]
Loading 0:  99%|█████████▉| 360/363 [04:40<00:02, 1.44it/s]
Loading 0:  99%|█████████▉| 360/363 [04:40<00:02, 1.44it/s]
Loading 0:  99%|█████████▉| 361/363 [04:42<00:01, 1.14it/s]
Loading 0:  99%|█████████▉| 361/363 [04:42<00:01, 1.14it/s]
Loading 0: 100%|██████████| 363/363 [04:42<00:00, 1.53it/s]
Loading 0: 100%|██████████| 363/363 [04:42<00:00, 1.53it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:42<00:00, 1.28it/s]
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmphm75suwp' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:40, 1.45s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:40, 1.45s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.09it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.09it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:55, 1.49it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:55, 1.49it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:04, 1.15it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:04, 1.15it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:17, 1.09s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:17, 1.09s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:08, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:08, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:34, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:34, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:03, 1.25it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:03, 1.25it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:54, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:54, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:51, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:51, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:24, 2.06it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:24, 2.06it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.80it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:43, 1.80it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:30, 1.83it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:30, 1.83it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:10, 1.44it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:10, 1.44it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:55, 2.29it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:55, 2.29it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.00it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.00it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:24<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:24<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:18, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:18, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.01it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.01it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:29, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:29, 1.16s/it]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:22, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:58, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:46, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:46, 1.15s/it]
Loading 0:  48%|████▊     | 174/363 [02:06<01:36, 1.96it/s]
Loading 0:  48%|████▊     | 174/363 [02:06<01:36, 1.96it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:07, 1.44it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:07, 1.44it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:21, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:21, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:51, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:51, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:19<03:23, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:19<03:23, 1.14s/it]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.07it/s]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.07it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.13it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.13it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:12, 2.09it/s]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:12, 2.09it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.82it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:45<02:42, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:45<02:42, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:03, 2.09it/s]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:03, 2.09it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:13<00:46, 2.10it/s]
Loading 0:  73%|███████▎  | 265/363 [03:13<00:46, 2.10it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:35, 2.40s/it]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:35, 2.40s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:26, 2.32s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:26, 2.32s/it]
Loading 0:  76%|███████▌  | 275/363 [03:38<03:20, 2.28s/it]
Loading 0:  76%|███████▌  | 275/363 [03:38<03:20, 2.28s/it]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.17it/s]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.17it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:21, 1.09s/it]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:21, 1.09s/it]
Loading 0:  80%|████████  | 291/363 [03:47<01:05, 1.10it/s]
Loading 0:  80%|████████  | 291/363 [03:47<01:05, 1.10it/s]
Loading 0:  80%|████████  | 292/363 [03:49<01:13, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [03:49<01:13, 1.04s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:25, 1.22s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:25, 1.22s/it]
Loading 0:  83%|████████▎ | 300/363 [03:52<00:33, 1.88it/s]
Loading 0:  83%|████████▎ | 300/363 [03:52<00:33, 1.88it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.78it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.78it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:04<00:59, 1.15s/it]
Loading 0:  86%|████████▌ | 311/363 [04:04<00:59, 1.15s/it]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.82it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.82it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.13it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.13it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  91%|█████████ | 329/363 [04:17<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:17<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.12it/s]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.12it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  98%|█████████▊| 354/363 [04:31<00:04, 1.97it/s]
Loading 0:  98%|█████████▊| 354/363 [04:31<00:04, 1.97it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.20it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.20it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.20it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.30it/s]
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: quantized model in 291.523s
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmp5tfibchk' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp156_merged in 361.110s
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: quantized model in 285.172s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp624_merged in 361.692s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:41, 1.12s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:23, 1.41s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:23, 1.41s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:43, 2.14it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:43, 2.14it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:14, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:14, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:55, 1.88it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:55, 1.88it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.82it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.82it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<02:01, 1.99it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<02:01, 1.99it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:34, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:34, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:29, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:29, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.08it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.08it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:06, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.09it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:38, 2.09it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:50, 1.83it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:50, 1.83it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:20, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:20, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:56, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.08it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.08it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.07it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.10it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.10it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.84it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.84it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:08, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:08, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.07it/s]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.07it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.08it/s]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.08it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:38, 1.13it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:38, 1.13it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.35s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.16it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:32, 1.80it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:32, 1.80it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:50, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:50, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.14s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.13it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.13it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.47it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.47it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.17it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.17it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.56it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.56it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: The tokenizer you are loading from '/tmp/tmp5p4hwfcu' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/config.json
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: quantized model in 283.793s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1854_instruct_v2_merged in 362.309s
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:41, 1.28it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:41, 1.28it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:44, 1.29s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:44, 1.29s/it]
Loading 0:   1%|▏         | 5.00/363 [00:08<12:20, 2.07s/it]
Loading 0:   1%|▏         | 5.00/363 [00:08<12:20, 2.07s/it]
Loading 0:   3%|▎         | 11.0/363 [00:09<04:03, 1.45it/s]
Loading 0:   3%|▎         | 11.0/363 [00:09<04:03, 1.45it/s]
Loading 0:   4%|▎         | 13.0/363 [00:11<04:46, 1.22it/s]
Loading 0:   4%|▎         | 13.0/363 [00:11<04:46, 1.22it/s]
Loading 0:   4%|▍         | 14.0/363 [00:14<06:01, 1.03s/it]
Loading 0:   4%|▍         | 14.0/363 [00:14<06:01, 1.03s/it]
Loading 0:   4%|▍         | 15.0/363 [00:16<07:21, 1.27s/it]
Loading 0:   4%|▍         | 15.0/363 [00:16<07:21, 1.27s/it]
Loading 0:   6%|▌         | 21.0/363 [00:19<04:24, 1.29it/s]
Loading 0:   6%|▌         | 21.0/363 [00:19<04:24, 1.29it/s]
Loading 0:   6%|▌         | 22.0/363 [00:21<05:26, 1.05it/s]
Loading 0:   6%|▌         | 22.0/363 [00:21<05:26, 1.05it/s]
Loading 0:   6%|▋         | 23.0/363 [00:23<06:33, 1.16s/it]
Loading 0:   6%|▋         | 23.0/363 [00:23<06:33, 1.16s/it]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:03, 1.81it/s]
Loading 0:   8%|▊         | 30.0/363 [00:24<03:03, 1.81it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:16, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:27<03:16, 1.67it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:08, 1.32it/s]
Loading 0:  10%|▉         | 35.0/363 [00:29<04:08, 1.32it/s]
Loading 0:  10%|▉         | 36.0/363 [00:31<05:15, 1.04it/s]
Loading 0:  10%|▉         | 36.0/363 [00:31<05:15, 1.04it/s]
Loading 0:  11%|█         | 39.0/363 [00:34<04:38, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:34<04:38, 1.16it/s]
Loading 0:  11%|█         | 40.0/363 [00:36<05:32, 1.03s/it]
Loading 0:  11%|█         | 40.0/363 [00:36<05:32, 1.03s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:38<06:28, 1.21s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:38<06:28, 1.21s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:39<02:38, 1.98it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:39<02:38, 1.98it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<02:57, 1.76it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<02:57, 1.76it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<03:43, 1.39it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<03:43, 1.39it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<04:38, 1.11it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<04:38, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:07, 1.24it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:07, 1.24it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<04:58, 1.02it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<04:58, 1.02it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:51<05:55, 1.17s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<05:55, 1.17s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:52<02:24, 2.04it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:52<02:24, 2.04it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:54<02:44, 1.79it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:54<02:44, 1.79it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:56<03:28, 1.40it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:56<03:28, 1.40it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:58<04:20, 1.12it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:58<04:20, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [01:00<03:51, 1.24it/s]
Loading 0:  21%|██        | 75.0/363 [01:00<03:51, 1.24it/s]
Loading 0:  21%|██        | 76.0/363 [01:02<04:39, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [01:02<04:39, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [01:04<05:32, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [01:04<05:32, 1.16s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:06<02:15, 2.05it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:06<02:15, 2.05it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:08<02:33, 1.79it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:08<02:33, 1.79it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:10<03:14, 1.41it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:10<03:14, 1.41it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:12<04:04, 1.12it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:12<04:04, 1.12it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:13<01:56, 2.27it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:13<01:56, 2.27it/s]
Loading 0:  28%|██▊       | 101/363 [01:15<02:12, 1.98it/s] 
Loading 0:  28%|██▊       | 101/363 [01:15<02:12, 1.98it/s]
Loading 0:  28%|██▊       | 102/363 [01:17<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 102/363 [01:17<02:50, 1.53it/s]
Loading 0:  28%|██▊       | 103/363 [01:19<03:37, 1.20it/s]
Loading 0:  28%|██▊       | 103/363 [01:19<03:37, 1.20it/s]
Loading 0:  29%|██▉       | 106/363 [01:21<03:21, 1.27it/s]
Loading 0:  29%|██▉       | 106/363 [01:21<03:21, 1.27it/s]
Loading 0:  29%|██▉       | 107/363 [01:23<04:03, 1.05it/s]
Loading 0:  29%|██▉       | 107/363 [01:23<04:03, 1.05it/s]
Loading 0:  30%|██▉       | 108/363 [01:25<04:50, 1.14s/it]
Loading 0:  30%|██▉       | 108/363 [01:25<04:50, 1.14s/it]
Loading 0:  31%|███       | 111/363 [01:27<03:54, 1.07it/s]
Loading 0:  31%|███       | 111/363 [01:27<03:54, 1.07it/s]
Loading 0:  31%|███       | 112/363 [01:29<04:36, 1.10s/it]
Loading 0:  31%|███       | 112/363 [01:29<04:36, 1.10s/it]
Loading 0:  31%|███       | 113/363 [01:31<05:20, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:31<05:20, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:32<02:02, 1.98it/s]
Loading 0:  33%|███▎      | 121/363 [01:32<02:02, 1.98it/s]
Loading 0:  34%|███▍      | 124/363 [01:35<02:16, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:35<02:16, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:36<02:52, 1.38it/s]
Loading 0:  34%|███▍      | 125/363 [01:36<02:52, 1.38it/s]
Loading 0:  35%|███▍      | 126/363 [01:39<03:35, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:39<03:35, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:40<03:09, 1.23it/s]
Loading 0:  36%|███▌      | 129/363 [01:40<03:09, 1.23it/s]
Loading 0:  36%|███▌      | 130/363 [01:42<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:42<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:44<04:31, 1.17s/it]
Loading 0:  36%|███▌      | 131/363 [01:44<04:31, 1.17s/it]
Loading 0:  38%|███▊      | 138/363 [01:45<01:55, 1.95it/s]
Loading 0:  38%|███▊      | 138/363 [01:45<01:55, 1.95it/s]
Loading 0:  39%|███▉      | 142/363 [01:48<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:48<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:50<02:34, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:50<02:34, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:52<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:52<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:54<02:52, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:54<02:52, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:56<03:27, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:56<03:27, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:58<04:07, 1.16s/it]
Loading 0:  41%|████      | 149/363 [01:58<04:07, 1.16s/it]
Loading 0:  43%|████▎     | 157/363 [01:59<01:40, 2.05it/s]
Loading 0:  43%|████▎     | 157/363 [01:59<01:40, 2.05it/s]
Loading 0:  44%|████▍     | 160/363 [02:01<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 160/363 [02:01<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 161/363 [02:03<02:23, 1.41it/s]
Loading 0:  44%|████▍     | 161/363 [02:03<02:23, 1.41it/s]
Loading 0:  45%|████▍     | 162/363 [02:05<02:59, 1.12it/s]
Loading 0:  45%|████▍     | 162/363 [02:05<02:59, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:07<02:38, 1.25it/s]
Loading 0:  45%|████▌     | 165/363 [02:07<02:38, 1.25it/s]
Loading 0:  46%|████▌     | 166/363 [02:09<03:11, 1.03it/s]
Loading 0:  46%|████▌     | 166/363 [02:09<03:11, 1.03it/s]
Loading 0:  46%|████▌     | 167/363 [02:11<03:47, 1.16s/it]
Loading 0:  46%|████▌     | 167/363 [02:11<03:47, 1.16s/it]
Loading 0:  48%|████▊     | 174/363 [02:12<01:36, 1.96it/s]
Loading 0:  48%|████▊     | 174/363 [02:12<01:36, 1.96it/s]
Loading 0:  49%|████▉     | 178/363 [02:15<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:15<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:17<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:17<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:19<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:19<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:21<02:23, 1.25it/s]
Loading 0:  50%|█████     | 183/363 [02:21<02:23, 1.25it/s]
Loading 0:  51%|█████     | 184/363 [02:23<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:23<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:25<03:25, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:25<03:25, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:26<01:22, 2.06it/s]
Loading 0:  53%|█████▎    | 193/363 [02:26<01:22, 2.06it/s]
Loading 0:  54%|█████▍    | 196/363 [02:28<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:28<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:30<01:57, 1.42it/s]
Loading 0:  54%|█████▍    | 197/363 [02:30<01:57, 1.42it/s]
Loading 0:  55%|█████▍    | 198/363 [02:32<02:26, 1.12it/s]
Loading 0:  55%|█████▍    | 198/363 [02:32<02:26, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:34<02:09, 1.25it/s]
Loading 0:  55%|█████▌    | 201/363 [02:34<02:09, 1.25it/s]
Loading 0:  56%|█████▌    | 202/363 [02:36<02:35, 1.03it/s]
Loading 0:  56%|█████▌    | 202/363 [02:36<02:35, 1.03it/s]
Loading 0:  56%|█████▌    | 203/363 [02:38<03:05, 1.16s/it]
Loading 0:  56%|█████▌    | 203/363 [02:38<03:05, 1.16s/it]
Loading 0:  58%|█████▊    | 210/363 [02:39<01:18, 1.96it/s]
Loading 0:  58%|█████▊    | 210/363 [02:39<01:18, 1.96it/s]
Loading 0:  59%|█████▉    | 214/363 [02:41<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:41<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:43<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:43<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:45<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:45<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:47<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:47<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:49<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:49<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:51<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:51<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 228/363 [02:52<01:08, 1.96it/s]
Loading 0:  63%|██████▎   | 228/363 [02:52<01:08, 1.96it/s]
Loading 0:  64%|██████▍   | 232/363 [02:55<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:55<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:57<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:57<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:59<01:53, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:59<01:53, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [03:01<01:40, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [03:01<01:40, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [03:03<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [03:03<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [03:05<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [03:05<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 246/363 [03:06<00:59, 1.96it/s]
Loading 0:  68%|██████▊   | 246/363 [03:06<00:59, 1.96it/s]
Loading 0:  69%|██████▉   | 250/363 [03:08<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 250/363 [03:08<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 251/363 [03:10<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:10<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:12<01:37, 1.13it/s]
Loading 0:  69%|██████▉   | 252/363 [03:12<01:37, 1.13it/s]
Loading 0:  70%|███████   | 255/363 [03:14<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:14<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:16<01:43, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:16<01:43, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:18<02:02, 1.16s/it]
Loading 0:  71%|███████   | 257/363 [03:18<02:02, 1.16s/it]
Loading 0:  73%|███████▎  | 265/363 [03:19<00:47, 2.05it/s]
Loading 0:  73%|███████▎  | 265/363 [03:19<00:47, 2.05it/s]
Loading 0:  74%|███████▍  | 268/363 [03:22<00:53, 1.79it/s]
Loading 0:  74%|███████▍  | 268/363 [03:22<00:53, 1.79it/s]
Loading 0:  74%|███████▍  | 269/363 [03:23<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 269/363 [03:23<01:06, 1.41it/s]
Loading 0:  74%|███████▍  | 270/363 [03:26<01:23, 1.12it/s]
Loading 0:  74%|███████▍  | 270/363 [03:26<01:23, 1.12it/s]
Loading 0:  75%|███████▌  | 273/363 [03:41<03:41, 2.46s/it]
Loading 0:  75%|███████▌  | 273/363 [03:41<03:41, 2.46s/it]
Loading 0:  75%|███████▌  | 274/363 [03:43<03:31, 2.38s/it]
Loading 0:  75%|███████▌  | 274/363 [03:43<03:31, 2.38s/it]
Loading 0:  76%|███████▌  | 275/363 [03:45<03:25, 2.33s/it]
Loading 0:  76%|███████▌  | 275/363 [03:45<03:25, 2.33s/it]
Loading 0:  78%|███████▊  | 283/363 [03:46<01:09, 1.15it/s]
Loading 0:  78%|███████▊  | 283/363 [03:46<01:09, 1.15it/s]
Loading 0:  79%|███████▉  | 286/363 [03:48<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 286/363 [03:48<01:04, 1.20it/s]
Loading 0:  79%|███████▉  | 287/363 [03:50<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 287/363 [03:50<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 288/363 [03:52<01:21, 1.08s/it]
Loading 0:  79%|███████▉  | 288/363 [03:52<01:21, 1.08s/it]
Loading 0:  80%|████████  | 291/363 [03:54<01:05, 1.11it/s]
Loading 0:  80%|████████  | 291/363 [03:54<01:05, 1.11it/s]
Loading 0:  80%|████████  | 292/363 [03:56<01:13, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [03:56<01:13, 1.04s/it]
Loading 0:  81%|████████  | 293/363 [03:58<01:25, 1.22s/it]
Loading 0:  81%|████████  | 293/363 [03:58<01:25, 1.22s/it]
Loading 0:  83%|████████▎ | 301/363 [03:59<00:30, 2.00it/s]
Loading 0:  83%|████████▎ | 301/363 [03:59<00:30, 2.00it/s]
Loading 0:  84%|████████▎ | 304/363 [04:01<00:32, 1.81it/s]
Loading 0:  84%|████████▎ | 304/363 [04:01<00:32, 1.81it/s]
Loading 0:  84%|████████▍ | 305/363 [04:03<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 305/363 [04:03<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 306/363 [04:05<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [04:05<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:07<00:43, 1.24it/s]
Loading 0:  85%|████████▌ | 309/363 [04:07<00:43, 1.24it/s]
Loading 0:  85%|████████▌ | 310/363 [04:09<00:51, 1.02it/s]
Loading 0:  85%|████████▌ | 310/363 [04:09<00:51, 1.02it/s]
Loading 0:  86%|████████▌ | 311/363 [04:11<01:00, 1.17s/it]
Loading 0:  86%|████████▌ | 311/363 [04:11<01:00, 1.17s/it]
Loading 0:  88%|████████▊ | 319/363 [04:12<00:21, 2.07it/s]
Loading 0:  88%|████████▊ | 319/363 [04:12<00:21, 2.07it/s]
Loading 0:  89%|████████▊ | 322/363 [04:14<00:22, 1.80it/s]
Loading 0:  89%|████████▊ | 322/363 [04:14<00:22, 1.80it/s]
Loading 0:  89%|████████▉ | 323/363 [04:16<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:16<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:18<00:34, 1.13it/s]
Loading 0:  89%|████████▉ | 324/363 [04:18<00:34, 1.13it/s]
Loading 0:  90%|█████████ | 327/363 [04:20<00:28, 1.25it/s]
Loading 0:  90%|█████████ | 327/363 [04:20<00:28, 1.25it/s]
Loading 0:  90%|█████████ | 328/363 [04:22<00:33, 1.03it/s]
Loading 0:  90%|█████████ | 328/363 [04:22<00:33, 1.03it/s]
Loading 0:  91%|█████████ | 329/363 [04:24<00:39, 1.16s/it]
Loading 0:  91%|█████████ | 329/363 [04:24<00:39, 1.16s/it]
Loading 0:  93%|█████████▎| 337/363 [04:25<00:12, 2.08it/s]
Loading 0:  93%|█████████▎| 337/363 [04:25<00:12, 2.08it/s]
Loading 0:  94%|█████████▎| 340/363 [04:28<00:12, 1.80it/s]
Loading 0:  94%|█████████▎| 340/363 [04:28<00:12, 1.80it/s]
Loading 0:  94%|█████████▍| 341/363 [04:30<00:15, 1.40it/s]
Loading 0:  94%|█████████▍| 341/363 [04:30<00:15, 1.40it/s]
Loading 0:  94%|█████████▍| 342/363 [04:32<00:18, 1.11it/s]
Loading 0:  94%|█████████▍| 342/363 [04:32<00:18, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [04:34<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 345/363 [04:34<00:14, 1.23it/s]
Loading 0:  95%|█████████▌| 346/363 [04:36<00:16, 1.01it/s]
Loading 0:  95%|█████████▌| 346/363 [04:36<00:16, 1.01it/s]
Loading 0:  96%|█████████▌| 347/363 [04:38<00:18, 1.18s/it]
Loading 0:  96%|█████████▌| 347/363 [04:38<00:18, 1.18s/it]
Loading 0:  98%|█████████▊| 355/363 [04:39<00:03, 2.04it/s]
Loading 0:  98%|█████████▊| 355/363 [04:39<00:03, 2.04it/s]
Loading 0:  99%|█████████▉| 359/363 [04:42<00:02, 1.77it/s]
Loading 0:  99%|█████████▉| 359/363 [04:42<00:02, 1.77it/s]
Loading 0:  99%|█████████▉| 360/363 [04:44<00:02, 1.41it/s]
Loading 0:  99%|█████████▉| 360/363 [04:44<00:02, 1.41it/s]
Loading 0:  99%|█████████▉| 361/363 [04:46<00:01, 1.13it/s]
Loading 0:  99%|█████████▉| 361/363 [04:46<00:01, 1.13it/s]
Loading 0: 100%|██████████| 363/363 [04:46<00:00, 1.13it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:46<00:00, 1.27it/s]
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmp_nqshyye' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: quantized model in 294.125s
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp468_merged in 375.151s
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:23, 1.37it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:23, 1.37it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.37it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.37it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.36it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.36it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:23, 1.13s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:23, 1.13s/it]
Loading 0:   8%|▊         | 30.0/363 [00:22<02:59, 1.85it/s]
Loading 0:   8%|▊         | 30.0/363 [00:22<02:59, 1.85it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:50, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:50, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:37<02:58, 1.77it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:37<02:58, 1.77it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:01, 1.02it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:01, 1.02it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:27, 1.07s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:27, 1.07s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:30, 1.29s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:30, 1.29s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:52<02:49, 1.75it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:52<02:49, 1.75it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:57<03:48, 1.28it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:57<03:48, 1.28it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:46, 1.02it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:46, 1.02it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:09, 1.08s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:09, 1.08s/it]
Loading 0:  21%|██        | 77.0/363 [01:06<06:24, 1.34s/it]
Loading 0:  21%|██        | 77.0/363 [01:06<06:24, 1.34s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:45, 1.69it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:45, 1.69it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:10<02:52, 1.59it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:10<02:52, 1.59it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:37, 1.26it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:37, 1.26it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.94it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.94it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.39it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.39it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<03:59, 1.08it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<03:59, 1.08it/s]
Loading 0:  29%|██▉       | 106/363 [01:25<03:43, 1.15it/s]
Loading 0:  29%|██▉       | 106/363 [01:25<03:43, 1.15it/s]
Loading 0:  29%|██▉       | 107/363 [01:27<04:30, 1.06s/it]
Loading 0:  29%|██▉       | 107/363 [01:27<04:30, 1.06s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:22, 1.27s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:22, 1.27s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:21, 1.04s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:21, 1.04s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:07, 1.22s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:07, 1.22s/it]
Loading 0:  31%|███       | 113/363 [01:36<05:58, 1.43s/it]
Loading 0:  31%|███       | 113/363 [01:36<05:58, 1.43s/it]
Loading 0:  33%|███▎      | 120/363 [01:37<02:23, 1.69it/s]
Loading 0:  33%|███▎      | 120/363 [01:37<02:23, 1.69it/s]
Loading 0:  34%|███▍      | 124/363 [01:40<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:40<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:42<03:11, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:42<03:11, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  36%|███▌      | 129/363 [01:47<03:31, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:47<03:31, 1.11it/s]
Loading 0:  36%|███▌      | 130/363 [01:49<04:14, 1.09s/it]
Loading 0:  36%|███▌      | 130/363 [01:49<04:14, 1.09s/it]
Loading 0:  36%|███▌      | 131/363 [01:51<05:02, 1.30s/it]
Loading 0:  36%|███▌      | 131/363 [01:51<05:02, 1.30s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  39%|███▉      | 142/363 [01:55<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 142/363 [01:55<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 143/363 [01:57<02:52, 1.27it/s]
Loading 0:  39%|███▉      | 143/363 [01:57<02:52, 1.27it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:36, 1.01it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:36, 1.01it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:12, 1.12it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:12, 1.12it/s]
Loading 0:  41%|████      | 148/363 [02:04<03:52, 1.08s/it]
Loading 0:  41%|████      | 148/363 [02:04<03:52, 1.08s/it]
Loading 0:  41%|████      | 149/363 [02:06<04:38, 1.30s/it]
Loading 0:  41%|████      | 149/363 [02:06<04:38, 1.30s/it]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.74it/s]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.74it/s]
Loading 0:  44%|████▍     | 160/363 [02:10<02:05, 1.62it/s]
Loading 0:  44%|████▍     | 160/363 [02:10<02:05, 1.62it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:38, 1.27it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▌     | 165/363 [02:17<02:57, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:17<02:57, 1.12it/s]
Loading 0:  46%|████▌     | 166/363 [02:19<03:33, 1.08s/it]
Loading 0:  46%|████▌     | 166/363 [02:19<03:33, 1.08s/it]
Loading 0:  46%|████▌     | 167/363 [02:21<04:13, 1.29s/it]
Loading 0:  46%|████▌     | 167/363 [02:21<04:13, 1.29s/it]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.75it/s]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.75it/s]
Loading 0:  49%|████▉     | 178/363 [02:25<01:53, 1.63it/s]
Loading 0:  49%|████▉     | 178/363 [02:25<01:53, 1.63it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:24, 1.28it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:24, 1.28it/s]
Loading 0:  50%|████▉     | 180/363 [02:30<03:00, 1.02it/s]
Loading 0:  50%|████▉     | 180/363 [02:30<03:00, 1.02it/s]
Loading 0:  50%|█████     | 183/363 [02:32<02:40, 1.12it/s]
Loading 0:  50%|█████     | 183/363 [02:32<02:40, 1.12it/s]
Loading 0:  51%|█████     | 184/363 [02:34<03:12, 1.08s/it]
Loading 0:  51%|█████     | 184/363 [02:34<03:12, 1.08s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:55, 1.32s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:55, 1.32s/it]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:39, 1.72it/s]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:39, 1.72it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  55%|█████▍    | 198/363 [02:45<02:43, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:45<02:43, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:47<02:24, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:47<02:24, 1.12it/s]
Loading 0:  56%|█████▌    | 202/363 [02:49<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 202/363 [02:49<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.29s/it]
Loading 0:  56%|█████▌    | 203/363 [02:52<03:27, 1.29s/it]
Loading 0:  58%|█████▊    | 210/363 [02:53<01:27, 1.76it/s]
Loading 0:  58%|█████▊    | 210/363 [02:53<01:27, 1.76it/s]
Loading 0:  59%|█████▉    | 214/363 [02:55<01:31, 1.63it/s]
Loading 0:  59%|█████▉    | 214/363 [02:55<01:31, 1.63it/s]
Loading 0:  59%|█████▉    | 215/363 [02:58<01:55, 1.28it/s]
Loading 0:  59%|█████▉    | 215/363 [02:58<01:55, 1.28it/s]
Loading 0:  60%|█████▉    | 216/363 [03:00<02:24, 1.02it/s]
Loading 0:  60%|█████▉    | 216/363 [03:00<02:24, 1.02it/s]
Loading 0:  60%|██████    | 219/363 [03:02<02:08, 1.12it/s]
Loading 0:  60%|██████    | 219/363 [03:02<02:08, 1.12it/s]
Loading 0:  61%|██████    | 220/363 [03:04<02:34, 1.08s/it]
Loading 0:  61%|██████    | 220/363 [03:04<02:34, 1.08s/it]
Loading 0:  61%|██████    | 221/363 [03:07<03:03, 1.29s/it]
Loading 0:  61%|██████    | 221/363 [03:07<03:03, 1.29s/it]
Loading 0:  63%|██████▎   | 228/363 [03:08<01:17, 1.75it/s]
Loading 0:  63%|██████▎   | 228/363 [03:08<01:17, 1.75it/s]
Loading 0:  64%|██████▍   | 232/363 [03:10<01:20, 1.63it/s]
Loading 0:  64%|██████▍   | 232/363 [03:10<01:20, 1.63it/s]
Loading 0:  64%|██████▍   | 233/363 [03:13<01:41, 1.28it/s]
Loading 0:  64%|██████▍   | 233/363 [03:13<01:41, 1.28it/s]
Loading 0:  64%|██████▍   | 234/363 [03:15<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:15<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:17<01:52, 1.12it/s]
Loading 0:  65%|██████▌   | 237/363 [03:17<01:52, 1.12it/s]
Loading 0:  66%|██████▌   | 238/363 [03:19<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 238/363 [03:19<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 239/363 [03:22<02:41, 1.30s/it]
Loading 0:  66%|██████▌   | 239/363 [03:22<02:41, 1.30s/it]
Loading 0:  68%|██████▊   | 246/363 [03:23<01:07, 1.73it/s]
Loading 0:  68%|██████▊   | 246/363 [03:23<01:07, 1.73it/s]
Loading 0:  69%|██████▉   | 250/363 [03:26<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 250/363 [03:26<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 251/363 [03:28<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 251/363 [03:28<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 252/363 [03:30<01:50, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:30<01:50, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:32<01:36, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:32<01:36, 1.12it/s]
Loading 0:  71%|███████   | 256/363 [03:34<01:56, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:34<01:56, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:37<02:17, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:37<02:17, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:38<00:57, 1.73it/s]
Loading 0:  73%|███████▎  | 264/363 [03:38<00:57, 1.73it/s]
Loading 0:  74%|███████▍  | 268/363 [03:41<00:58, 1.61it/s]
Loading 0:  74%|███████▍  | 268/363 [03:41<00:58, 1.61it/s]
Loading 0:  74%|███████▍  | 269/363 [03:43<01:14, 1.27it/s]
Loading 0:  74%|███████▍  | 269/363 [03:43<01:14, 1.27it/s]
Loading 0:  74%|███████▍  | 270/363 [03:45<01:32, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:45<01:32, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:02<03:58, 2.65s/it]
Loading 0:  75%|███████▌  | 273/363 [04:02<03:58, 2.65s/it]
Loading 0:  75%|███████▌  | 274/363 [04:04<03:49, 2.58s/it]
Loading 0:  75%|███████▌  | 274/363 [04:04<03:49, 2.58s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:50, 2.62s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:50, 2.62s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:25, 1.05s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:25, 1.05s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:31, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:31, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:17<01:14, 1.04s/it]
Loading 0:  80%|████████  | 291/363 [04:17<01:14, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [04:19<01:25, 1.21s/it]
Loading 0:  80%|████████  | 292/363 [04:19<01:25, 1.21s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:38, 1.40s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:38, 1.40s/it]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0:  84%|████████▎ | 304/363 [04:25<00:37, 1.59it/s]
Loading 0:  84%|████████▎ | 304/363 [04:25<00:37, 1.59it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.25it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.25it/s]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:56, 1.00it/s]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:56, 1.00it/s]
Loading 0:  85%|████████▌ | 309/363 [04:32<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:32<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 310/363 [04:34<00:57, 1.09s/it]
Loading 0:  85%|████████▌ | 310/363 [04:34<00:57, 1.09s/it]
Loading 0:  86%|████████▌ | 311/363 [04:36<01:07, 1.30s/it]
Loading 0:  86%|████████▌ | 311/363 [04:36<01:07, 1.30s/it]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0:  89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0:  90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.30s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.30s/it]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.76it/s]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.76it/s]
Loading 0:  94%|█████████▎| 340/363 [04:55<00:14, 1.63it/s]
Loading 0:  94%|█████████▎| 340/363 [04:55<00:14, 1.63it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0:  95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0:  95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.30s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.30s/it]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.75it/s]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.75it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.05it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.15it/s]
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmp8huzjr3o' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: quantized model in 323.307s
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_topk_cp312_merged in 409.082s
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:28, 1.34it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:28, 1.34it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:14, 1.21s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:14, 1.21s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:19, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:19, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:17, 1.36it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:17, 1.36it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:35, 1.04it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:35, 1.04it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:16, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:16, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:22<06:27, 1.14s/it]
Loading 0:   6%|▋         | 23.0/363 [00:22<06:27, 1.14s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0:   9%|▉         | 34.0/363 [00:26<03:18, 1.66it/s]
Loading 0:   9%|▉         | 34.0/363 [00:26<03:18, 1.66it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:12, 1.30it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:12, 1.30it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:08, 1.00it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:08, 1.00it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:36, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:36, 1.11it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:33, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:33, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:38, 1.31s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:38, 1.31s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:05, 1.58it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:05, 1.58it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:54, 1.25it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:54, 1.25it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:01<04:52, 1.01s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:01<04:52, 1.01s/it]
Loading 0:  21%|██        | 75.0/363 [01:03<04:21, 1.10it/s]
Loading 0:  21%|██        | 75.0/363 [01:03<04:21, 1.10it/s]
Loading 0:  21%|██        | 76.0/363 [01:05<05:14, 1.10s/it]
Loading 0:  21%|██        | 76.0/363 [01:05<05:14, 1.10s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:14, 1.31s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:14, 1.31s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.72it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.72it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:52, 1.59it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:52, 1.59it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:38, 1.25it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:38, 1.25it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:33, 1.00s/it]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:33, 1.00s/it]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:17, 1.93it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:17, 1.93it/s]
Loading 0:  28%|██▊       | 101/363 [01:20<02:27, 1.77it/s] 
Loading 0:  28%|██▊       | 101/363 [01:20<02:27, 1.77it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:03, 1.07it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:03, 1.07it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:49, 1.12it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:49, 1.12it/s]
Loading 0:  29%|██▉       | 107/363 [01:29<04:36, 1.08s/it]
Loading 0:  29%|██▉       | 107/363 [01:29<04:36, 1.08s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:28, 1.29s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:28, 1.29s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:26, 1.06s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:26, 1.06s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:05, 1.46s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:05, 1.46s/it]
Loading 0:  33%|███▎      | 120/363 [01:39<02:27, 1.65it/s]
Loading 0:  33%|███▎      | 120/363 [01:39<02:27, 1.65it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:34, 1.55it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:34, 1.55it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:14, 1.22it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:14, 1.22it/s]
Loading 0:  35%|███▍      | 126/363 [01:46<04:02, 1.03s/it]
Loading 0:  35%|███▍      | 126/363 [01:46<04:02, 1.03s/it]
Loading 0:  36%|███▌      | 129/363 [01:49<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 129/363 [01:49<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 130/363 [01:51<04:18, 1.11s/it]
Loading 0:  36%|███▌      | 130/363 [01:51<04:18, 1.11s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:07, 1.33s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:07, 1.33s/it]
Loading 0:  38%|███▊      | 138/363 [01:54<02:11, 1.71it/s]
Loading 0:  38%|███▊      | 138/363 [01:54<02:11, 1.71it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:19, 1.58it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:19, 1.58it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:56, 1.25it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:56, 1.25it/s]
Loading 0:  40%|███▉      | 144/363 [02:02<03:39, 1.00s/it]
Loading 0:  40%|███▉      | 144/363 [02:02<03:39, 1.00s/it]
Loading 0:  40%|████      | 147/363 [02:04<03:15, 1.11it/s]
Loading 0:  40%|████      | 147/363 [02:04<03:15, 1.11it/s]
Loading 0:  41%|████      | 148/363 [02:06<03:55, 1.09s/it]
Loading 0:  41%|████      | 148/363 [02:06<03:55, 1.09s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.26it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.26it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:20, 1.00it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:20, 1.00it/s]
Loading 0:  45%|████▌     | 165/363 [02:19<02:57, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:19<02:57, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:21<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 166/363 [02:21<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.73it/s]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.61it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.61it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:25, 1.26it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:25, 1.26it/s]
Loading 0:  50%|████▉     | 180/363 [02:32<03:02, 1.00it/s]
Loading 0:  50%|████▉     | 180/363 [02:32<03:02, 1.00it/s]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.11it/s]
Loading 0:  51%|█████     | 184/363 [02:36<03:14, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:36<03:14, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:14, 1.24it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:14, 1.24it/s]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:47, 1.01s/it]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:47, 1.01s/it]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:27, 1.10it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:27, 1.10it/s]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:57, 1.10s/it]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:57, 1.10s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:31, 1.32s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:31, 1.32s/it]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:29, 1.71it/s]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:29, 1.71it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:34, 1.58it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:34, 1.58it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:58, 1.25it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:58, 1.25it/s]
Loading 0:  60%|█████▉    | 216/363 [03:03<02:27, 1.00s/it]
Loading 0:  60%|█████▉    | 216/363 [03:03<02:27, 1.00s/it]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.10it/s]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.10it/s]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.10s/it]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.10s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 233/363 [03:15<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 233/363 [03:15<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:09, 1.00s/it]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:09, 1.00s/it]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:53, 1.11it/s]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:53, 1.11it/s]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:17, 1.10s/it]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:17, 1.10s/it]
Loading 0:  66%|██████▌   | 239/363 [03:24<02:42, 1.31s/it]
Loading 0:  66%|██████▌   | 239/363 [03:24<02:42, 1.31s/it]
Loading 0:  68%|██████▊   | 246/363 [03:26<01:08, 1.72it/s]
Loading 0:  68%|██████▊   | 246/363 [03:26<01:08, 1.72it/s]
Loading 0:  69%|██████▉   | 250/363 [03:29<01:11, 1.59it/s]
Loading 0:  69%|██████▉   | 250/363 [03:29<01:11, 1.59it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:29, 1.25it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:29, 1.25it/s]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.00s/it]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.00s/it]
Loading 0:  70%|███████   | 255/363 [03:35<01:37, 1.11it/s]
Loading 0:  70%|███████   | 255/363 [03:35<01:37, 1.11it/s]
Loading 0:  71%|███████   | 256/363 [03:37<01:57, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:37<01:57, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:19, 1.31s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:19, 1.31s/it]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:57, 1.72it/s]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:57, 1.72it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.60it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.60it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:32, 1.00it/s]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:32, 1.00it/s]
Loading 0:  75%|███████▌  | 273/363 [04:05<04:01, 2.68s/it]
Loading 0:  75%|███████▌  | 273/363 [04:05<04:01, 2.68s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:51, 2.60s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:51, 2.60s/it]
Loading 0:  76%|███████▌  | 275/363 [04:10<03:45, 2.56s/it]
Loading 0:  76%|███████▌  | 275/363 [04:10<03:45, 2.56s/it]
Loading 0:  78%|███████▊  | 282/363 [04:11<01:23, 1.03s/it]
Loading 0:  78%|███████▊  | 282/363 [04:11<01:23, 1.03s/it]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:10, 1.09it/s]
Loading 0:  79%|███████▉  | 287/363 [04:16<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 287/363 [04:16<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [04:18<01:32, 1.24s/it]
Loading 0:  79%|███████▉  | 288/363 [04:18<01:32, 1.24s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:15, 1.05s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:15, 1.05s/it]
Loading 0:  80%|████████  | 292/363 [04:23<01:27, 1.23s/it]
Loading 0:  80%|████████  | 292/363 [04:23<01:27, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [04:25<01:39, 1.42s/it]
Loading 0:  81%|████████  | 293/363 [04:25<01:39, 1.42s/it]
Loading 0:  83%|████████▎ | 300/363 [04:26<00:38, 1.63it/s]
Loading 0:  83%|████████▎ | 300/363 [04:26<00:38, 1.63it/s]
Loading 0:  84%|████████▎ | 304/363 [04:29<00:37, 1.56it/s]
Loading 0:  84%|████████▎ | 304/363 [04:29<00:37, 1.56it/s]
Loading 0:  84%|████████▍ | 305/363 [04:31<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 305/363 [04:31<00:46, 1.24it/s]
Loading 0:  84%|████████▍ | 306/363 [04:33<00:57, 1.01s/it]
Loading 0:  84%|████████▍ | 306/363 [04:33<00:57, 1.01s/it]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:48, 1.10it/s]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:48, 1.10it/s]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0:  86%|████████▌ | 311/363 [04:40<01:08, 1.31s/it]
Loading 0:  86%|████████▌ | 311/363 [04:40<01:08, 1.31s/it]
Loading 0:  88%|████████▊ | 318/363 [04:41<00:25, 1.75it/s]
Loading 0:  88%|████████▊ | 318/363 [04:41<00:25, 1.75it/s]
Loading 0:  89%|████████▊ | 322/363 [04:44<00:25, 1.63it/s]
Loading 0:  89%|████████▊ | 322/363 [04:44<00:25, 1.63it/s]
Loading 0:  89%|████████▉ | 323/363 [04:46<00:32, 1.23it/s]
Loading 0:  89%|████████▉ | 323/363 [04:46<00:32, 1.23it/s]
Loading 0:  89%|████████▉ | 324/363 [04:48<00:39, 1.01s/it]
Loading 0:  89%|████████▉ | 324/363 [04:48<00:39, 1.01s/it]
Loading 0:  90%|█████████ | 327/363 [04:51<00:32, 1.10it/s]
Loading 0:  90%|█████████ | 327/363 [04:51<00:32, 1.10it/s]
Loading 0:  90%|█████████ | 328/363 [04:53<00:38, 1.10s/it]
Loading 0:  90%|█████████ | 328/363 [04:53<00:38, 1.10s/it]
Loading 0:  91%|█████████ | 329/363 [04:55<00:44, 1.31s/it]
Loading 0:  91%|█████████ | 329/363 [04:55<00:44, 1.31s/it]
Loading 0:  93%|█████████▎| 336/363 [04:56<00:15, 1.75it/s]
Loading 0:  93%|█████████▎| 336/363 [04:56<00:15, 1.75it/s]
Loading 0:  94%|█████████▎| 340/363 [04:59<00:14, 1.62it/s]
Loading 0:  94%|█████████▎| 340/363 [04:59<00:14, 1.62it/s]
Loading 0:  94%|█████████▍| 341/363 [05:01<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 341/363 [05:01<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:18, 1.09s/it]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:18, 1.09s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:20, 1.30s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:20, 1.30s/it]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.76it/s]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.76it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 359/363 [05:14<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.39it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.39it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.14it/s]
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-26775-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpise9ql0c' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: quantized model in 326.905s
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_1_404_v1_cp312_merged in 427.041s
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/config.json
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/tokenizer_config.json
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/tokenizer.json
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-1-404-v4/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-97330-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer completed after 521.33s with status: succeeded
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/flywheel_model.1.safetensors
Stopping job with name chaiml-98p-2ff-chaiml-m-97330-v1-mkmlizer
Pipeline stage MKMLizer completed in 538.84s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.26s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-98p-2ff-chaiml-m-97330-v1
Waiting for inference service chaiml-98p-2ff-chaiml-m-97330-v1 to be ready
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-29442-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer completed after 547.0s with status: succeeded
Stopping job with name chaiml-98p-2ff-chaiml-m-29442-v1-mkmlizer
Pipeline stage MKMLizer completed in 551.50s
run pipeline stage %s
Running pipeline stage MKMLTemplater
chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-26775-v1/nvidia/flywheel_model.0.safetensors
Pipeline stage MKMLTemplater completed in 1.26s
Job chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer completed after 551.56s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-98p-2ff-chaiml-m-26775-v1-mkmlizer
Running pipeline stage MKMLDeployer
Pipeline stage MKMLizer completed in 555.64s
chaiml-mistral-24b-2048-1-404-v4-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-1-404-v4/nvidia/flywheel_model.0.safetensors
Creating inference service chaiml-98p-2ff-chaiml-m-29442-v1
run pipeline stage %s
Running pipeline stage MKMLTemplater
Waiting for inference service chaiml-98p-2ff-chaiml-m-29442-v1 to be ready
Pipeline stage MKMLTemplater completed in 1.53s
chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-5577-v1/nvidia/flywheel_model.0.safetensors
run pipeline stage %s
Job chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer completed after 566.55s with status: succeeded
Running pipeline stage MKMLDeployer
Stopping job with name chaiml-98p-2ff-chaiml-mi-5577-v1-mkmlizer
Creating inference service chaiml-98p-2ff-chaiml-m-26775-v1
Pipeline stage MKMLizer completed in 570.05s
run pipeline stage %s
Waiting for inference service chaiml-98p-2ff-chaiml-m-26775-v1 to be ready
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.28s
Job chaiml-mistral-24b-2048-1-404-v4-mkmlizer completed after 563.82s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-mistral-24b-2048-1-404-v4-mkmlizer
Running pipeline stage MKMLDeployer
Pipeline stage MKMLizer completed in 568.29s
Creating inference service chaiml-98p-2ff-chaiml-mi-5577-v1
run pipeline stage %s
Waiting for inference service chaiml-98p-2ff-chaiml-mi-5577-v1 to be ready
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.28s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-1-404-v4
Waiting for inference service chaiml-mistral-24b-2048-1-404-v4 to be ready
chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-24271-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer completed after 587.01s with status: succeeded
Stopping job with name chaiml-98p-2ff-chaiml-m-24271-v1-mkmlizer
Pipeline stage MKMLizer completed in 590.64s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.85s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-98p-2ff-chaiml-m-24271-v1
Waiting for inference service chaiml-98p-2ff-chaiml-m-24271-v1 to be ready
chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-mi-7904-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer completed after 594.22s with status: succeeded
Stopping job with name chaiml-98p-2ff-chaiml-mi-7904-v1-mkmlizer
Pipeline stage MKMLizer completed in 598.59s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.36s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-98p-2ff-chaiml-mi-7904-v1
Waiting for inference service chaiml-98p-2ff-chaiml-mi-7904-v1 to be ready
Inference service chaiml-98p-2ff-chaiml-m-97330-v1 ready after 162.30547952651978s
Pipeline stage MKMLDeployer completed in 167.21s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.0279693603515625s
Received healthy response to inference request in 3.3125665187835693s
Received healthy response to inference request in 3.5405468940734863s
Inference service chaiml-98p-2ff-chaiml-m-29442-v1 ready after 162.24224281311035s
Pipeline stage MKMLDeployer completed in 169.34s
run pipeline stage %s
Received healthy response to inference request in 2.8764586448669434s
Running pipeline stage StressChecker
Inference service chaiml-98p-2ff-chaiml-m-26775-v1 ready after 162.23782753944397s
Received healthy response to inference request in 3.1069746017456055s
Received healthy response to inference request in 3.2790422439575195s
Pipeline stage MKMLDeployer completed in 168.07s
5 requests
run pipeline stage %s
0 failed requests
Running pipeline stage StressChecker
5th percentile: 2.922561836242676
10th percentile: 2.968665027618408
Received healthy response to inference request in 3.3512439727783203s
Inference service chaiml-98p-2ff-chaiml-mi-5577-v1 ready after 162.43351411819458s
20th percentile: 3.060871410369873
Pipeline stage MKMLDeployer completed in 168.72s
30th percentile: 3.1480929851531982
Received healthy response to inference request in 3.201908826828003s
run pipeline stage %s
40th percentile: 3.230329751968384
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0138161182403564s
50th percentile: 3.3125665187835693
60th percentile: 3.403758668899536
Inference service chaiml-mistral-24b-2048-1-404-v4 ready after 162.2154459953308s
Received healthy response to inference request in 3.229271173477173s
70th percentile: 3.4949508190155028
Pipeline stage MKMLDeployer completed in 167.50s
Received healthy response to inference request in 3.3603248596191406s
Received healthy response to inference request in 3.288726568222046s
80th percentile: 3.6380313873291015
run pipeline stage %s
Inference service chaiml-98p-2ff-chaiml-m-24271-v1 ready after 152.38188934326172s
90th percentile: 3.833000373840332
Running pipeline stage StressChecker
Received healthy response to inference request in 3.278508186340332s
Pipeline stage MKMLDeployer completed in 157.82s
95th percentile: 3.9304848670959474
Received healthy response to inference request in 3.3437111377716064s
run pipeline stage %s
Received healthy response to inference request in 3.336179256439209s
99th percentile: 4.008472461700439
Running pipeline stage StressChecker
5 requests
mean time: 3.3729032039642335
Received healthy response to inference request in 3.3869218826293945s
Received healthy response to inference request in 3.2099225521087646s
0 failed requests
Pipeline stage StressChecker completed in 51.24s
Received healthy response to inference request in 3.474846839904785s
5th percentile: 3.0668613433837892
run pipeline stage %s
Received healthy response to inference request in 3.3269381523132324s
10th percentile: 3.1199065685272216
Received healthy response to inference request in 3.1541669368743896s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Received healthy response to inference request in 3.172478675842285s
20th percentile: 3.2259970188140867
Received healthy response to inference request in 3.1980111598968506s
Inference service chaiml-98p-2ff-chaiml-mi-7904-v1 ready after 152.0316994190216s
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.598950147628784s
5 requests
30th percentile: 3.280979108810425
Pipeline stage MKMLDeployer completed in 159.60s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.3095247745513916s
0 failed requests
40th percentile: 3.2848528385162354
run pipeline stage %s
Received healthy response to inference request in 3.273332118988037s
triggered trigger_guanaco_pipeline args=%s
5th percentile: 3.178364706039429
Received healthy response to inference request in 3.5333213806152344s
50th percentile: 3.288726568222046
Running pipeline stage StressChecker
5 requests
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 11.87s
10th percentile: 3.184250736236572
Received healthy response to inference request in 3.6479368209838867s
60th percentile: 3.307707643508911
0 failed requests
run pipeline stage %s
Received healthy response to inference request in 3.3414437770843506s
20th percentile: 3.196022796630859
70th percentile: 3.3266887187957765
Received healthy response to inference request in 3.697134494781494s
5th percentile: 3.213075351715088
Running pipeline stage TriggerMKMLProfilingPipeline
30th percentile: 3.2035115718841554
80th percentile: 3.339192199707031
Received healthy response to inference request in 2.997227191925049s
10th percentile: 3.228139543533325
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.309713840484619s
40th percentile: 3.20671706199646
90th percentile: 3.3452180862426757
5 requests
20th percentile: 3.2582679271697996
Received healthy response to inference request in 3.4517791271209717s
starting trigger_guanaco_pipeline args=%s
5 requests
50th percentile: 3.2099225521087646
95th percentile: 3.3482310295104982
0 failed requests
30th percentile: 3.287407922744751
triggered trigger_guanaco_pipeline args=%s
0 failed requests
60th percentile: 3.217662000656128
99th percentile: 3.350641384124756
5th percentile: 3.028615140914917
40th percentile: 3.3155595302581786
Received healthy response to inference request in 3.1979072093963623s
Pipeline stage TriggerMKMLProfilingPipeline completed in 13.81s
5th percentile: 3.313158702850342
70th percentile: 3.225401449203491
mean time: 3.25380163192749
10th percentile: 3.060003089904785
50th percentile: 3.3437111377716064
Shutdown handler de-registered
10th percentile: 3.3166035652160644
80th percentile: 3.2391185760498047
Pipeline stage StressChecker completed in 71.44s
20th percentile: 3.1227789878845216
60th percentile: 3.35035662651062
chaiml-98p-2ff-chaiml-m_97330_v1 status is now deployed due to DeploymentManager action
20th percentile: 3.3234932899475096
Received healthy response to inference request in 3.3040225505828857s
90th percentile: 3.2588133811950684
run pipeline stage %s
30th percentile: 3.18523850440979
70th percentile: 3.357002115249634
30th percentile: 3.329839277267456
95th percentile: 3.2686607837677
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
40th percentile: 3.247381639480591
80th percentile: 3.3832292556762695
Received healthy response to inference request in 3.3939321041107178s
40th percentile: 3.3356415271759032
99th percentile: 3.2765387058258058
run_pipeline:run_in_cloud %s
50th percentile: 3.3095247745513916
90th percentile: 3.4290380477905273
5 requests
50th percentile: 3.3414437770843506
mean time: 3.2184178829193115
starting trigger_guanaco_pipeline args=%s
60th percentile: 3.340483617782593
95th percentile: 3.4519424438476562
0 failed requests
60th percentile: 3.418194818496704
Pipeline stage StressChecker completed in 77.77s
70th percentile: 3.371442461013794
triggered trigger_guanaco_pipeline args=%s
99th percentile: 3.4702659606933595
5th percentile: 3.219130277633667
70th percentile: 3.4949458599090577
run pipeline stage %s
80th percentile: 3.439124870300293
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 13.38s
mean time: 3.330045223236084
10th percentile: 3.2403533458709717
80th percentile: 3.5464471340179444
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
90th percentile: 3.5435308456420898
run pipeline stage %s
Pipeline stage StressChecker completed in 79.11s
20th percentile: 3.282799482345581
90th percentile: 3.572698640823364
run_pipeline:run_in_cloud %s
95th percentile: 3.5957338333129885
Running pipeline stage TriggerMKMLProfilingPipeline
run pipeline stage %s
30th percentile: 3.322004461288452
95th percentile: 3.585824394226074
starting trigger_guanaco_pipeline args=%s
99th percentile: 3.6374962234497072
run_pipeline:run_in_cloud %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
40th percentile: 3.357968282699585
99th percentile: 3.5963249969482423
mean time: 3.299155521392822
triggered trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
run_pipeline:run_in_cloud %s
50th percentile: 3.3939321041107178
mean time: 3.4220734596252442
Pipeline stage StressChecker completed in 81.32s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 11.93s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
60th percentile: 3.417070913314819
Pipeline stage StressChecker completed in 78.72s
run pipeline stage %s
run pipeline stage %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 11.51s
triggered trigger_guanaco_pipeline args=%s
70th percentile: 3.440209722518921
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Running pipeline stage TriggerMKMLProfilingPipeline
Shutdown handler de-registered
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 12.03s
80th percentile: 3.500850200653076
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
chaiml-98p-2ff-chaiml-m_29442_v1 status is now deployed due to DeploymentManager action
run pipeline stage %s
90th percentile: 3.598992347717285
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
Running pipeline stage TriggerMKMLProfilingPipeline
95th percentile: 3.6480634212493896
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
run_pipeline:run_in_cloud %s
99th percentile: 3.687320280075073
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 12.93s
Pipeline stage TriggerMKMLProfilingPipeline completed in 12.75s
starting trigger_guanaco_pipeline args=%s
mean time: 3.4089550971984863
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 11.34s
run pipeline stage %s
Shutdown handler de-registered
Pipeline stage StressChecker completed in 81.70s
Pipeline stage StressChecker completed in 81.70s
triggered trigger_guanaco_pipeline args=%s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
chaiml-98p-2ff-chaiml-m_26775_v1 status is now deployed due to DeploymentManager action
run pipeline stage %s
chaiml-98p-2ff-chaiml-m_26775_v1 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of chaiml-98p-2ff-chaiml-m_26775_v1
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLDeleter
Checking if service chaiml-98p-2ff-chaiml-m-26775-v1 is running
Tearing down inference service chaiml-98p-2ff-chaiml-m-26775-v1
Service chaiml-98p-2ff-chaiml-m-26775-v1 has been torndown
Pipeline stage MKMLDeleter completed in 1.09s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
%s, retrying in %s seconds...
Cleaning model data from S3
Cleaning model data from model cache
%s, retrying in %s seconds...
Cleaning model data from S3
Cleaning model data from model cache
clean up pipeline due to error=TeardownError("Got unexpected keyword argument 'request_checksum_calculation'")
Shutdown handler de-registered
chaiml-98p-2ff-chaiml-m_26775_v1 status is now torndown due to DeploymentManager action