chaiml-mistral-24b-2048-_2678

developer_uid: rirv938
submission_id: chaiml-mistral-24b-2048-_2678_v2
model_name: chaiml-mistral-24b-2048-_2678_v2
model_group: ChaiML/mistral_24b_2048_
status: inactive
timestamp: 2026-02-12T20:19:56+00:00
num_battles: 12017
num_wins: 6536
celo_rating: 1331.03
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/mistral_24b_2048_120_max_top_30k_prod_rm_906_merged
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 96
reward_model: default
display_name: chaiml-mistral-24b-2048-_2678_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/mistral_24b_2048_120_max_top_30k_prod_rm_906_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-12
win_ratio: 0.5438961471249064
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['You:', '<|im_end|>', '<|im_start|>', '</s>', '###'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 96}
formatter: {'memory_template': '[SYSTEM_PROMPT]Respond as a high quality storyteller.[/SYSTEM_PROMPT][INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-2678-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-2678-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-2678-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
run pipeline %s
chaiml-mistral-24b-2048-2678-v1-mkmlizer: bash: no job control in this shell
run pipeline stage %s
chaiml-mistral-24b-2048-2678-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-2678-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
Starting job with name chaiml-mistral-24b-2048-52535-v2-mkmlizer
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║                                                                     ║
Waiting for job on chaiml-mistral-24b-2048-52535-v2-mkmlizer to finish
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║                                                                     ║
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-52535-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
run pipeline %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
run pipeline stage %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-52535-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  https://mk1.ai                                                     ║
Starting job with name chaiml-mistral-24b-2048-96216-v1-mkmlizer
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
Waiting for job on chaiml-mistral-24b-2048-96216-v1-mkmlizer to finish
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
run pipeline %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ║                                                                     ║
run pipeline stage %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-2678-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
Starting job with name chaiml-mistral-24b-2048-71780-v1-mkmlizer
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
Waiting for job on chaiml-mistral-24b-2048-71780-v1-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
run pipeline %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-52535-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
run pipeline stage %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║                                                                     ║
Starting job with name chaiml-mistral-24b-2048-96216-v2-mkmlizer
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
Waiting for job on chaiml-mistral-24b-2048-96216-v2-mkmlizer to finish
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
run pipeline %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
run pipeline stage %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-96216-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
Starting job with name chaiml-mistral-24b-2048-71780-v2-mkmlizer
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ║                                                                     ║
Waiting for job on chaiml-mistral-24b-2048-71780-v2-mkmlizer to finish
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║                                                                     ║
run pipeline %s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
run pipeline stage %s
chaiml-mistral-24b-2048-71780-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-71780-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
Starting job with name chaiml-mistral-24b-2048-96633-v1-mkmlizer
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
Waiting for job on chaiml-mistral-24b-2048-96633-v1-mkmlizer to finish
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
run pipeline %s
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
run pipeline stage %s
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
Starting job with name chaiml-mistral-24b-2048-66666-v1-mkmlizer
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
Waiting for job on chaiml-mistral-24b-2048-66666-v1-mkmlizer to finish
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-2678-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-52535-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-71780-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-96633-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-96216-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-71780-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-96216-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-71780-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96633-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-66666-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-2678-v1-mkmlizer: Downloaded to shared memory in 95.339s
chaiml-mistral-24b-2048-2678-v1-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_30k_prod_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-52535-v1-mkmlizer: Downloaded to shared memory in 90.389s
chaiml-mistral-24b-2048-2678-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpqukavtl6, device:0
chaiml-mistral-24b-2048-2678-v2-mkmlizer: Downloaded to shared memory in 86.417s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_30k_new_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-2678-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-2678-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_30k_prod_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-52535-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpyk8oxq54, device:0
chaiml-mistral-24b-2048-2678-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpdilzrv0t, device:0
chaiml-mistral-24b-2048-52535-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-52535-v2-mkmlizer: Downloaded to shared memory in 84.054s
chaiml-mistral-24b-2048-2678-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-52535-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_30k_new_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-52535-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp0_l7xrk0, device:0
chaiml-mistral-24b-2048-52535-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96216-v2-mkmlizer: Downloaded to shared memory in 80.353s
chaiml-mistral-24b-2048-96216-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-96216-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp912g_s5b, device:0
chaiml-mistral-24b-2048-96216-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-71780-v1-mkmlizer: Downloaded to shared memory in 88.371s
chaiml-mistral-24b-2048-96216-v1-mkmlizer: Downloaded to shared memory in 89.603s
chaiml-mistral-24b-2048-71780-v1-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_new_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-96216-v1-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-71780-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp9dyhe_lw, device:0
chaiml-mistral-24b-2048-71780-v2-mkmlizer: Downloaded to shared memory in 78.629s
chaiml-mistral-24b-2048-96216-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp86nbqesn, device:0
chaiml-mistral-24b-2048-71780-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-71780-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_new_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-96216-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-71780-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpap5ljmcb, device:0
chaiml-mistral-24b-2048-71780-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96633-v1-mkmlizer: Downloaded to shared memory in 92.588s
chaiml-mistral-24b-2048-96633-v1-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-96633-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpes0l2auk, device:0
chaiml-mistral-24b-2048-96633-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-66666-v1-mkmlizer: Downloaded to shared memory in 93.155s
chaiml-mistral-24b-2048-66666-v1-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_10k_prod_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-66666-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpjw3dhcj7, device:0
chaiml-mistral-24b-2048-66666-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-52535-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:26, 1.08s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:26, 1.08s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:28, 1.42s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:28, 1.42s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:45, 2.13it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:45, 2.13it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:52, 1.51it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:52, 1.51it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:15, 1.08s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:15, 1.08s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.23it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.23it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.83it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.83it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:47, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:47, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:17, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:17, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<02:00, 2.02it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<02:00, 2.02it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:14, 1.78it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:14, 1.78it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.40it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.40it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:29, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:29, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.07it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.07it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.81it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:01, 1.81it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:36, 1.41it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:36, 1.41it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:14, 1.12it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:14, 1.12it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:52, 1.25it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:52, 1.25it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:27, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:27, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:07, 1.16s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:07, 1.16s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:45, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:45, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:31, 2.06it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:31, 2.06it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.42it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.42it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:42, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:42, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:23, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:23, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.06it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:22, 2.06it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.42it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:56, 1.42it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.13it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.13it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.07it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.07it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:22, 1.81it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:22, 1.81it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:44, 1.42it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:44, 1.42it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.13it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.13it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:43, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:43, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:04, 2.07it/s]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:04, 2.07it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 246/363 [02:59<00:59, 1.97it/s]
Loading 0:  68%|██████▊   | 246/363 [02:59<00:59, 1.97it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.84it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.84it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:17, 1.45it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:17, 1.45it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:36, 1.15it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:36, 1.15it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:24, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:24, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:41, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:41, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:11<02:00, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:11<02:00, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.07it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.13it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.13it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:27, 2.33s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:27, 2.33s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.28s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.28s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.17it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.17it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:02, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:10, 1.08it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:10, 1.08it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:20, 1.08s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:20, 1.08s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:05, 1.09it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:05, 1.09it/s]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.06s/it]
Loading 0:  80%|████████  | 292/363 [03:48<01:15, 1.06s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:32, 1.79it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:32, 1.79it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.41it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.28it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.28it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:50, 1.05it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:50, 1.05it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<00:59, 1.14s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.04it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.04it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.84it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.84it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:31<00:03, 2.10it/s]
Loading 0:  98%|█████████▊| 355/363 [04:31<00:03, 2.10it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-52535-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp0_l7xrk0' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-52535-v2-mkmlizer: quantized model in 283.916s
chaiml-mistral-24b-2048-52535-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_30k_new_rm_906_merged in 367.971s
chaiml-mistral-24b-2048-96216-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:13, 1.42it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:13, 1.42it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:31, 1.09s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:31, 1.09s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:16, 1.39s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:16, 1.39s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:41, 2.17it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:41, 2.17it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:49, 1.52it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:49, 1.52it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:58, 1.17it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:58, 1.17it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:13, 1.07s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:13, 1.07s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:31, 2.19it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:31, 2.19it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.48it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.48it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:11, 1.29it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:11, 1.29it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:04, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:04, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:29, 2.09it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:29, 2.09it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:31, 1.14it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:31, 1.14it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:01, 1.27it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:01, 1.27it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:51, 1.05it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:51, 1.05it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:47, 1.14s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:47, 1.14s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:22, 2.07it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:22, 2.07it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.82it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.82it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:35, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:35, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:58<05:27, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:58<05:27, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:18, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:18, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.07it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:00, 1.07it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:32, 1.08s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:32, 1.08s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.26s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.26s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:14, 1.78it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:14, 1.78it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.40it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.40it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:33, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:33, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:01, 1.82it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:52<01:38, 2.08it/s]
Loading 0:  43%|████▎     | 157/363 [01:52<01:38, 2.08it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:57, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:57, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:36, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:36, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:04<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:04<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.42it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:09, 1.42it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.08it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.08it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:03, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.07it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:13, 2.07it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:22, 1.80it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:22, 1.80it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:44, 1.42it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:44, 1.42it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:10, 1.13it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:10, 1.13it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.15s/it]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.07it/s]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.07it/s]
Loading 0:  64%|██████▍   | 232/363 [02:47<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:47<01:12, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:31, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:22, 1.15s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:22, 1.15s/it]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:56, 2.07it/s]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:56, 2.07it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:02<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:02<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:04<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:04<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:46, 2.09it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:46, 2.09it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:36, 2.41s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:36, 2.41s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:27, 2.33s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:27, 2.33s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.29s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.29s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.17it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:08, 1.17it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:02, 1.23it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:02, 1.23it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:10, 1.08it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:10, 1.08it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:20, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:20, 1.07s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:05, 1.10it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:05, 1.10it/s]
Loading 0:  80%|████████  | 292/363 [03:47<01:15, 1.06s/it]
Loading 0:  80%|████████  | 292/363 [03:47<01:15, 1.06s/it]
Loading 0:  81%|████████  | 293/363 [03:49<01:25, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:49<01:25, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:32, 1.80it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:32, 1.80it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 310/363 [04:00<00:50, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:00<00:50, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:02<00:59, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:02<00:59, 1.14s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.15it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.15it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.11it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.11it/s]
Loading 0:  99%|█████████▉| 359/363 [04:32<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 359/363 [04:32<00:02, 1.90it/s]
Loading 0:  99%|█████████▉| 360/363 [04:34<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 360/363 [04:34<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 361/363 [04:36<00:01, 1.19it/s]
Loading 0:  99%|█████████▉| 361/363 [04:36<00:01, 1.19it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.19it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.31it/s]
chaiml-mistral-24b-2048-71780-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:16, 1.05s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:16, 1.05s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:02, 1.35s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:02, 1.35s/it]
Loading 0:   3%|▎         | 12.0/363 [00:06<02:38, 2.22it/s]
Loading 0:   3%|▎         | 12.0/363 [00:06<02:38, 2.22it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:45, 1.55it/s]
Loading 0:   4%|▎         | 13.0/363 [00:08<03:45, 1.55it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:55, 1.18it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:55, 1.18it/s]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:09, 1.06s/it]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:09, 1.06s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:42, 1.54it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:42, 1.54it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:38, 1.01it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:38, 1.01it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:31, 2.20it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:31, 2.20it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:53, 1.90it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:53, 1.90it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:11, 1.29it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:11, 1.29it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:29, 2.10it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:29, 2.10it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:48, 1.84it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:48, 1.84it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:30, 1.14it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:30, 1.14it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:00, 1.27it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:00, 1.27it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:50, 1.05it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:50, 1.05it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:47, 1.14s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:47, 1.14s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:21, 2.09it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:46<02:21, 2.09it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:48<02:40, 1.83it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:48<02:40, 1.83it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:50<03:23, 1.43it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:50<03:23, 1.43it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:52<04:16, 1.14it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:52<04:16, 1.14it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:47, 1.27it/s]
Loading 0:  21%|██        | 75.0/363 [00:54<03:47, 1.27it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:34, 1.05it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:34, 1.05it/s]
Loading 0:  21%|██        | 77.0/363 [00:58<05:25, 1.14s/it]
Loading 0:  21%|██        | 77.0/363 [00:58<05:25, 1.14s/it]
Loading 0:  23%|██▎       | 84.0/363 [00:59<02:20, 1.98it/s]
Loading 0:  23%|██▎       | 84.0/363 [00:59<02:20, 1.98it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:01<02:28, 1.85it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:01<02:28, 1.85it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:03<03:08, 1.46it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:03<03:08, 1.46it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:05<03:56, 1.15it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:05<03:56, 1.15it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.32it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.32it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:09, 2.03it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:09, 2.03it/s]
Loading 0:  28%|██▊       | 102/363 [01:10<02:47, 1.56it/s]
Loading 0:  28%|██▊       | 102/363 [01:10<02:47, 1.56it/s]
Loading 0:  28%|██▊       | 103/363 [01:12<03:32, 1.22it/s]
Loading 0:  28%|██▊       | 103/363 [01:12<03:32, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:17, 1.30it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:17, 1.30it/s]
Loading 0:  29%|██▉       | 107/363 [01:16<03:58, 1.07it/s]
Loading 0:  29%|██▉       | 107/363 [01:16<03:58, 1.07it/s]
Loading 0:  30%|██▉       | 108/363 [01:18<04:46, 1.12s/it]
Loading 0:  30%|██▉       | 108/363 [01:18<04:46, 1.12s/it]
Loading 0:  31%|███       | 111/363 [01:20<03:50, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:20<03:50, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:22<04:31, 1.08s/it]
Loading 0:  31%|███       | 112/363 [01:22<04:31, 1.08s/it]
Loading 0:  31%|███       | 113/363 [01:24<05:15, 1.26s/it]
Loading 0:  31%|███       | 113/363 [01:24<05:15, 1.26s/it]
Loading 0:  33%|███▎      | 121/363 [01:25<01:59, 2.03it/s]
Loading 0:  33%|███▎      | 121/363 [01:25<01:59, 2.03it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.41it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.41it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:31, 1.12it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:31, 1.12it/s]
Loading 0:  36%|███▌      | 129/363 [01:33<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:33<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:35<03:44, 1.04it/s]
Loading 0:  36%|███▌      | 130/363 [01:35<03:44, 1.04it/s]
Loading 0:  36%|███▌      | 131/363 [01:37<04:26, 1.15s/it]
Loading 0:  36%|███▌      | 131/363 [01:37<04:26, 1.15s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.08it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.08it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:01, 1.81it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:01, 1.81it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:52<01:39, 2.08it/s]
Loading 0:  43%|████▎     | 157/363 [01:52<01:39, 2.08it/s]
Loading 0:  44%|████▍     | 160/363 [01:54<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 160/363 [01:54<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:56, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:56, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:36, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:36, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:04<03:44, 1.14s/it]
Loading 0:  46%|████▌     | 167/363 [02:04<03:44, 1.14s/it]
Loading 0:  48%|████▊     | 175/363 [02:05<01:30, 2.07it/s]
Loading 0:  48%|████▊     | 175/363 [02:05<01:30, 2.07it/s]
Loading 0:  49%|████▉     | 178/363 [02:07<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:07<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:09<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:09<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:11<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:11<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:13<02:22, 1.27it/s]
Loading 0:  50%|█████     | 183/363 [02:13<02:22, 1.27it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:51, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:51, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  53%|█████▎    | 193/363 [02:18<01:21, 2.08it/s]
Loading 0:  53%|█████▎    | 193/363 [02:18<01:21, 2.08it/s]
Loading 0:  54%|█████▍    | 196/363 [02:20<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:20<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:22<01:56, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:22<01:56, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:24<02:25, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:24<02:25, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:26<02:08, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:26<02:08, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:28<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:28<02:34, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:30<03:03, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:30<03:03, 1.14s/it]
Loading 0:  58%|█████▊    | 211/363 [02:31<01:12, 2.09it/s]
Loading 0:  58%|█████▊    | 211/363 [02:31<01:12, 2.09it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:35<01:43, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:35<01:43, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:37<02:08, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:37<02:08, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:39<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:39<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:41<02:16, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:41<02:16, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:43<02:42, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:43<02:42, 1.14s/it]
Loading 0:  63%|██████▎   | 229/363 [02:44<01:04, 2.08it/s]
Loading 0:  63%|██████▎   | 229/363 [02:44<01:04, 2.08it/s]
Loading 0:  64%|██████▍   | 232/363 [02:47<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 232/363 [02:47<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:30, 1.44it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:52, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:52, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:52<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:52<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:54<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:54<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:56<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:56<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 246/363 [02:57<00:59, 1.98it/s]
Loading 0:  68%|██████▊   | 246/363 [02:57<00:59, 1.98it/s]
Loading 0:  69%|██████▉   | 250/363 [03:00<01:01, 1.85it/s]
Loading 0:  69%|██████▉   | 250/363 [03:00<01:01, 1.85it/s]
Loading 0:  69%|██████▉   | 251/363 [03:02<01:17, 1.45it/s]
Loading 0:  69%|██████▉   | 251/363 [03:02<01:17, 1.45it/s]
Loading 0:  69%|██████▉   | 252/363 [03:04<01:35, 1.16it/s]
Loading 0:  69%|██████▉   | 252/363 [03:04<01:35, 1.16it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:24, 1.28it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:24, 1.28it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:41, 1.06it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:41, 1.06it/s]
Loading 0:  71%|███████   | 257/363 [03:10<01:59, 1.13s/it]
Loading 0:  71%|███████   | 257/363 [03:10<01:59, 1.13s/it]
Loading 0:  73%|███████▎  | 265/363 [03:11<00:47, 2.08it/s]
Loading 0:  73%|███████▎  | 265/363 [03:11<00:47, 2.08it/s]
Loading 0:  74%|███████▍  | 268/363 [03:13<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:13<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:15<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 269/363 [03:15<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 270/363 [03:17<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:17<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:32<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 273/363 [03:32<03:34, 2.38s/it]
Loading 0:  75%|███████▌  | 274/363 [03:34<03:25, 2.31s/it]
Loading 0:  75%|███████▌  | 274/363 [03:34<03:25, 2.31s/it]
Loading 0:  76%|███████▌  | 275/363 [03:36<03:19, 2.26s/it]
Loading 0:  76%|███████▌  | 275/363 [03:36<03:19, 2.26s/it]
Loading 0:  78%|███████▊  | 283/363 [03:37<01:08, 1.18it/s]
Loading 0:  78%|███████▊  | 283/363 [03:37<01:08, 1.18it/s]
Loading 0:  79%|███████▉  | 286/363 [03:39<01:02, 1.23it/s]
Loading 0:  79%|███████▉  | 286/363 [03:39<01:02, 1.23it/s]
Loading 0:  79%|███████▉  | 287/363 [03:41<01:09, 1.09it/s]
Loading 0:  79%|███████▉  | 287/363 [03:41<01:09, 1.09it/s]
Loading 0:  79%|███████▉  | 288/363 [03:43<01:19, 1.06s/it]
Loading 0:  79%|███████▉  | 288/363 [03:43<01:19, 1.06s/it]
Loading 0:  80%|████████  | 291/363 [03:45<01:04, 1.12it/s]
Loading 0:  80%|████████  | 291/363 [03:45<01:04, 1.12it/s]
Loading 0:  80%|████████  | 292/363 [03:46<01:12, 1.02s/it]
Loading 0:  80%|████████  | 292/363 [03:46<01:12, 1.02s/it]
Loading 0:  81%|████████  | 293/363 [03:48<01:24, 1.20s/it]
Loading 0:  81%|████████  | 293/363 [03:48<01:24, 1.20s/it]
Loading 0:  83%|████████▎ | 301/363 [03:49<00:30, 2.03it/s]
Loading 0:  83%|████████▎ | 301/363 [03:49<00:30, 2.03it/s]
Loading 0:  84%|████████▎ | 304/363 [03:52<00:32, 1.80it/s]
Loading 0:  84%|████████▎ | 304/363 [03:52<00:32, 1.80it/s]
Loading 0:  84%|████████▍ | 305/363 [03:54<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 305/363 [03:54<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 306/363 [03:56<00:50, 1.13it/s]
Loading 0:  84%|████████▍ | 306/363 [03:56<00:50, 1.13it/s]
Loading 0:  85%|████████▌ | 309/363 [03:57<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 309/363 [03:57<00:42, 1.26it/s]
Loading 0:  85%|████████▌ | 310/363 [03:59<00:50, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [03:59<00:50, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:01<00:59, 1.14s/it]
Loading 0:  86%|████████▌ | 311/363 [04:01<00:59, 1.14s/it]
Loading 0:  88%|████████▊ | 319/363 [04:02<00:20, 2.11it/s]
Loading 0:  88%|████████▊ | 319/363 [04:02<00:20, 2.11it/s]
Loading 0:  89%|████████▊ | 322/363 [04:05<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:05<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:07<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:07<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:09<00:34, 1.15it/s]
Loading 0:  89%|████████▉ | 324/363 [04:09<00:34, 1.15it/s]
Loading 0:  90%|█████████ | 327/363 [04:10<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:10<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:12<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:12<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:14<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:14<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:16<00:12, 2.12it/s]
Loading 0:  93%|█████████▎| 337/363 [04:16<00:12, 2.12it/s]
Loading 0:  94%|█████████▎| 340/363 [04:18<00:12, 1.85it/s]
Loading 0:  94%|█████████▎| 340/363 [04:18<00:12, 1.85it/s]
Loading 0:  94%|█████████▍| 341/363 [04:20<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:20<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:22<00:18, 1.15it/s]
Loading 0:  94%|█████████▍| 342/363 [04:22<00:18, 1.15it/s]
Loading 0:  95%|█████████▌| 345/363 [04:24<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:24<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:25<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:25<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:27<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:27<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:29<00:03, 2.12it/s]
Loading 0:  98%|█████████▊| 355/363 [04:29<00:03, 2.12it/s]
Loading 0:  99%|█████████▉| 359/363 [04:31<00:02, 1.91it/s]
Loading 0:  99%|█████████▉| 359/363 [04:31<00:02, 1.91it/s]
Loading 0:  99%|█████████▉| 360/363 [04:33<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 360/363 [04:33<00:02, 1.50it/s]
Loading 0:  99%|█████████▉| 361/363 [04:35<00:01, 1.19it/s]
Loading 0:  99%|█████████▉| 361/363 [04:35<00:01, 1.19it/s]
Loading 0: 100%|██████████| 363/363 [04:35<00:00, 1.19it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:35<00:00, 1.32it/s]
chaiml-mistral-24b-2048-71780-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 4.00/363 [00:04<06:37, 1.11s/it]
Loading 0:   1%|          | 4.00/363 [00:04<06:37, 1.11s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:22, 1.40s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:22, 1.40s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:42, 2.16it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:42, 2.16it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.17it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:59, 1.17it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:14, 1.08s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:14, 1.08s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:45, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:41, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:41, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.17it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.17it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:40, 1.82it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:40, 1.82it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.14it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.14it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:47, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:47, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:34, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:34, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:27, 1.14s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:27, 1.14s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:00, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.32it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.32it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:09, 2.03it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:09, 2.03it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:47, 1.56it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:47, 1.56it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:33, 1.22it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:33, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:18, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:18, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<03:59, 1.07it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<03:59, 1.07it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:31, 1.08s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:31, 1.08s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:16, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<01:59, 2.02it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:13, 1.79it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.40it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:49, 1.40it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.12it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.12it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:06, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.04it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.04it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:27, 1.15s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:27, 1.15s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.09it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:47, 2.09it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 142/363 [01:41<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:33, 1.43it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:33, 1.43it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:12, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:12, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:50, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:50, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:25, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:25, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:52<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:52<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:56<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [01:58<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:36, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:00<02:36, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:02<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:04<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:04<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:51, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:15<02:51, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:17<03:23, 1.14s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.08it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.08it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:24, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:07, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:33, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:02, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:02, 1.14s/it]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.09it/s]
Loading 0:  58%|█████▊    | 211/363 [02:32<01:12, 2.09it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:21, 1.83it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:16, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:42, 1.14s/it]
Loading 0:  63%|██████▎   | 228/363 [02:45<01:08, 1.98it/s]
Loading 0:  63%|██████▎   | 228/363 [02:45<01:08, 1.98it/s]
Loading 0:  64%|██████▍   | 232/363 [02:47<01:10, 1.85it/s]
Loading 0:  64%|██████▍   | 232/363 [02:47<01:10, 1.85it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:51, 1.16it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:51, 1.16it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:38, 1.28it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:38, 1.28it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:58, 1.06it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:58, 1.06it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:20, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:20, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [03:00<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:00<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:02<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 251/363 [03:02<01:17, 1.44it/s]
Loading 0:  69%|██████▉   | 252/363 [03:04<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:04<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:24, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:24, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:41, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:41, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:01, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:11<00:47, 2.08it/s]
Loading 0:  73%|███████▎  | 265/363 [03:11<00:47, 2.08it/s]
Loading 0:  74%|███████▍  | 268/363 [03:13<00:52, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:13<00:52, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:15<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:15<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:17<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:17<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:32<03:35, 2.39s/it]
Loading 0:  75%|███████▌  | 273/363 [03:32<03:35, 2.39s/it]
Loading 0:  75%|███████▌  | 274/363 [03:34<03:26, 2.32s/it]
Loading 0:  75%|███████▌  | 274/363 [03:34<03:26, 2.32s/it]
Loading 0:  76%|███████▌  | 275/363 [03:36<03:19, 2.27s/it]
Loading 0:  76%|███████▌  | 275/363 [03:36<03:19, 2.27s/it]
Loading 0:  78%|███████▊  | 283/363 [03:37<01:08, 1.17it/s]
Loading 0:  78%|███████▊  | 283/363 [03:37<01:08, 1.17it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.22it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  80%|████████  | 291/363 [03:45<01:06, 1.09it/s]
Loading 0:  80%|████████  | 291/363 [03:45<01:06, 1.09it/s]
Loading 0:  80%|████████  | 292/363 [03:47<01:15, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:47<01:15, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:49<01:26, 1.23s/it]
Loading 0:  81%|████████  | 293/363 [03:49<01:26, 1.23s/it]
Loading 0:  83%|████████▎ | 301/363 [03:50<00:31, 1.99it/s]
Loading 0:  83%|████████▎ | 301/363 [03:50<00:31, 1.99it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [03:58<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [03:58<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:00<00:51, 1.04it/s]
Loading 0:  85%|████████▌ | 310/363 [04:00<00:51, 1.04it/s]
Loading 0:  86%|████████▌ | 311/363 [04:02<00:59, 1.15s/it]
Loading 0:  86%|████████▌ | 311/363 [04:02<00:59, 1.15s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0:  90%|█████████ | 328/363 [04:13<00:33, 1.05it/s]
Loading 0:  90%|█████████ | 328/363 [04:13<00:33, 1.05it/s]
Loading 0:  91%|█████████ | 329/363 [04:15<00:38, 1.14s/it]
Loading 0:  91%|█████████ | 329/363 [04:15<00:38, 1.14s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.10it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.10it/s]
Loading 0:  99%|█████████▉| 359/363 [04:32<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 359/363 [04:32<00:02, 1.89it/s]
Loading 0:  99%|█████████▉| 360/363 [04:34<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 360/363 [04:34<00:02, 1.49it/s]
Loading 0:  99%|█████████▉| 361/363 [04:36<00:01, 1.19it/s]
Loading 0:  99%|█████████▉| 361/363 [04:36<00:01, 1.19it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.19it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.31it/s]
chaiml-mistral-24b-2048-71780-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpap5ljmcb' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96216-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp912g_s5b' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-71780-v2-mkmlizer: quantized model in 283.232s
chaiml-mistral-24b-2048-96216-v2-mkmlizer: quantized model in 283.553s
chaiml-mistral-24b-2048-71780-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_30k_new_rm_906_merged in 361.861s
chaiml-mistral-24b-2048-96216-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_merged in 363.905s
chaiml-mistral-24b-2048-71780-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-96216-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:56, 1.52it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:56, 1.52it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:20, 1.06s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:20, 1.06s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:07, 1.36s/it]
Loading 0:   1%|▏         | 5.00/363 [00:05<08:07, 1.36s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:41, 2.17it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:41, 2.17it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:59, 1.16it/s]
Loading 0:   4%|▍         | 14.0/363 [00:10<04:59, 1.16it/s]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:14, 1.08s/it]
Loading 0:   4%|▍         | 15.0/363 [00:12<06:14, 1.08s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:41, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:41, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.17it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.17it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:45, 1.45it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:45, 1.45it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:44, 1.15it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:44, 1.15it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:14, 1.27it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:14, 1.27it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.82it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.82it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:37, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:03, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:03, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:54, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:54, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:51, 1.16s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:51, 1.16s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.80it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.80it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:49, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:49, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:11, 2.00it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:11, 2.00it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:36, 1.20it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:36, 1.20it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:02, 1.05it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:02, 1.05it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:50, 1.14s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:50, 1.14s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:54, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:54, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:35, 1.10s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:35, 1.10s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:20, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:20, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.00it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.00it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:48, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:31, 1.17s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:31, 1.17s/it]
Loading 0:  38%|███▊      | 139/363 [01:40<01:48, 2.06it/s]
Loading 0:  38%|███▊      | 139/363 [01:40<01:48, 2.06it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:03, 1.80it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:03, 1.80it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:36, 1.40it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:36, 1.40it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:16, 1.11it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:16, 1.11it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:54, 1.24it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:54, 1.24it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:30, 1.02it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:30, 1.02it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:10, 1.17s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:10, 1.17s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.06it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.06it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:52, 1.80it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:23, 1.41it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:23, 1.41it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:59, 1.12it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:59, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:39, 1.24it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:39, 1.24it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:12, 1.02it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:12, 1.02it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:49, 1.17s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:49, 1.17s/it]
Loading 0:  48%|████▊     | 175/363 [02:07<01:31, 2.05it/s]
Loading 0:  48%|████▊     | 175/363 [02:07<01:31, 2.05it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:43, 1.79it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:43, 1.79it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:11, 1.40it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:11, 1.40it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:44, 1.11it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:44, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:25, 1.24it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:25, 1.24it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:55, 1.02it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:55, 1.02it/s]
Loading 0:  51%|█████     | 185/363 [02:19<03:29, 1.18s/it]
Loading 0:  51%|█████     | 185/363 [02:19<03:29, 1.18s/it]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.05it/s]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.05it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:33, 1.79it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:33, 1.79it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:58, 1.40it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:58, 1.40it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:29, 1.11it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:29, 1.11it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:11, 1.23it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:11, 1.23it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:38, 1.01it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:38, 1.01it/s]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:09, 1.18s/it]
Loading 0:  56%|█████▌    | 203/363 [02:33<03:09, 1.18s/it]
Loading 0:  58%|█████▊    | 211/363 [02:34<01:14, 2.03it/s]
Loading 0:  58%|█████▊    | 211/363 [02:34<01:14, 2.03it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:24, 1.77it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:24, 1.77it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:46, 1.39it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:46, 1.39it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:13, 1.10it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:13, 1.10it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:57, 1.23it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:57, 1.23it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:21, 1.01it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:21, 1.01it/s]
Loading 0:  61%|██████    | 221/363 [02:46<02:47, 1.18s/it]
Loading 0:  61%|██████    | 221/363 [02:46<02:47, 1.18s/it]
Loading 0:  63%|██████▎   | 229/363 [02:47<01:05, 2.03it/s]
Loading 0:  63%|██████▎   | 229/363 [02:47<01:05, 2.03it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:13, 1.77it/s]
Loading 0:  64%|██████▍   | 232/363 [02:50<01:13, 1.77it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:33, 1.39it/s]
Loading 0:  64%|██████▍   | 233/363 [02:52<01:33, 1.39it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:57, 1.10it/s]
Loading 0:  64%|██████▍   | 234/363 [02:54<01:57, 1.10it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:43, 1.22it/s]
Loading 0:  65%|██████▌   | 237/363 [02:56<01:43, 1.22it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:03, 1.01it/s]
Loading 0:  66%|██████▌   | 238/363 [02:58<02:03, 1.01it/s]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:26, 1.18s/it]
Loading 0:  66%|██████▌   | 239/363 [03:00<02:26, 1.18s/it]
Loading 0:  68%|██████▊   | 247/363 [03:01<00:57, 2.03it/s]
Loading 0:  68%|██████▊   | 247/363 [03:01<00:57, 2.03it/s]
Loading 0:  69%|██████▉   | 250/363 [03:03<01:04, 1.76it/s]
Loading 0:  69%|██████▉   | 250/363 [03:03<01:04, 1.76it/s]
Loading 0:  69%|██████▉   | 251/363 [03:05<01:21, 1.38it/s]
Loading 0:  69%|██████▉   | 251/363 [03:05<01:21, 1.38it/s]
Loading 0:  69%|██████▉   | 252/363 [03:07<01:41, 1.09it/s]
Loading 0:  69%|██████▉   | 252/363 [03:07<01:41, 1.09it/s]
Loading 0:  70%|███████   | 255/363 [03:09<01:28, 1.22it/s]
Loading 0:  70%|███████   | 255/363 [03:09<01:28, 1.22it/s]
Loading 0:  71%|███████   | 256/363 [03:11<01:46, 1.00it/s]
Loading 0:  71%|███████   | 256/363 [03:11<01:46, 1.00it/s]
Loading 0:  71%|███████   | 257/363 [03:13<02:06, 1.19s/it]
Loading 0:  71%|███████   | 257/363 [03:13<02:06, 1.19s/it]
Loading 0:  73%|███████▎  | 264/363 [03:14<00:51, 1.91it/s]
Loading 0:  73%|███████▎  | 264/363 [03:14<00:51, 1.91it/s]
Loading 0:  74%|███████▍  | 268/363 [03:17<00:53, 1.78it/s]
Loading 0:  74%|███████▍  | 268/363 [03:17<00:53, 1.78it/s]
Loading 0:  74%|███████▍  | 269/363 [03:19<01:07, 1.39it/s]
Loading 0:  74%|███████▍  | 269/363 [03:19<01:07, 1.39it/s]
Loading 0:  74%|███████▍  | 270/363 [03:21<01:24, 1.11it/s]
Loading 0:  74%|███████▍  | 270/363 [03:21<01:24, 1.11it/s]
Loading 0:  75%|███████▌  | 273/363 [03:42<04:39, 3.10s/it]
Loading 0:  75%|███████▌  | 273/363 [03:42<04:39, 3.10s/it]
Loading 0:  75%|███████▌  | 274/363 [03:44<04:20, 2.93s/it]
Loading 0:  75%|███████▌  | 274/363 [03:44<04:20, 2.93s/it]
Loading 0:  76%|███████▌  | 275/363 [03:46<04:05, 2.79s/it]
Loading 0:  76%|███████▌  | 275/363 [03:46<04:05, 2.79s/it]
Loading 0:  78%|███████▊  | 283/363 [03:47<01:22, 1.03s/it]
Loading 0:  78%|███████▊  | 283/363 [03:47<01:22, 1.03s/it]
Loading 0:  79%|███████▉  | 286/363 [03:49<01:13, 1.05it/s]
Loading 0:  79%|███████▉  | 286/363 [03:49<01:13, 1.05it/s]
Loading 0:  79%|███████▉  | 287/363 [03:51<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 287/363 [03:51<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [03:53<01:31, 1.22s/it]
Loading 0:  79%|███████▉  | 288/363 [03:53<01:31, 1.22s/it]
Loading 0:  80%|████████  | 291/363 [03:55<01:13, 1.02s/it]
Loading 0:  80%|████████  | 291/363 [03:55<01:13, 1.02s/it]
Loading 0:  80%|████████  | 292/363 [03:57<01:22, 1.17s/it]
Loading 0:  80%|████████  | 292/363 [03:57<01:22, 1.17s/it]
Loading 0:  81%|████████  | 293/363 [04:00<01:33, 1.34s/it]
Loading 0:  81%|████████  | 293/363 [04:00<01:33, 1.34s/it]
Loading 0:  83%|████████▎ | 301/363 [04:01<00:33, 1.86it/s]
Loading 0:  83%|████████▎ | 301/363 [04:01<00:33, 1.86it/s]
Loading 0:  84%|████████▎ | 304/363 [04:03<00:35, 1.66it/s]
Loading 0:  84%|████████▎ | 304/363 [04:03<00:35, 1.66it/s]
Loading 0:  84%|████████▍ | 305/363 [04:05<00:44, 1.32it/s]
Loading 0:  84%|████████▍ | 305/363 [04:05<00:44, 1.32it/s]
Loading 0:  84%|████████▍ | 306/363 [04:07<00:54, 1.05it/s]
Loading 0:  84%|████████▍ | 306/363 [04:07<00:54, 1.05it/s]
Loading 0:  85%|████████▌ | 309/363 [04:09<00:45, 1.18it/s]
Loading 0:  85%|████████▌ | 309/363 [04:09<00:45, 1.18it/s]
Loading 0:  85%|████████▌ | 310/363 [04:11<00:54, 1.02s/it]
Loading 0:  85%|████████▌ | 310/363 [04:11<00:54, 1.02s/it]
Loading 0:  86%|████████▌ | 311/363 [04:13<01:03, 1.22s/it]
Loading 0:  86%|████████▌ | 311/363 [04:13<01:03, 1.22s/it]
Loading 0:  88%|████████▊ | 319/363 [04:15<00:22, 1.99it/s]
Loading 0:  88%|████████▊ | 319/363 [04:15<00:22, 1.99it/s]
Loading 0:  89%|████████▊ | 322/363 [04:17<00:23, 1.74it/s]
Loading 0:  89%|████████▊ | 322/363 [04:17<00:23, 1.74it/s]
Loading 0:  89%|████████▉ | 323/363 [04:19<00:29, 1.36it/s]
Loading 0:  89%|████████▉ | 323/363 [04:19<00:29, 1.36it/s]
Loading 0:  89%|████████▉ | 324/363 [04:21<00:36, 1.08it/s]
Loading 0:  89%|████████▉ | 324/363 [04:21<00:36, 1.08it/s]
Loading 0:  90%|█████████ | 327/363 [04:23<00:30, 1.19it/s]
Loading 0:  90%|█████████ | 327/363 [04:23<00:30, 1.19it/s]
Loading 0:  90%|█████████ | 328/363 [04:25<00:35, 1.02s/it]
Loading 0:  90%|█████████ | 328/363 [04:25<00:35, 1.02s/it]
Loading 0:  91%|█████████ | 329/363 [04:27<00:41, 1.21s/it]
Loading 0:  91%|█████████ | 329/363 [04:27<00:41, 1.21s/it]
Loading 0:  93%|█████████▎| 337/363 [04:28<00:12, 2.00it/s]
Loading 0:  93%|█████████▎| 337/363 [04:28<00:12, 2.00it/s]
Loading 0:  94%|█████████▎| 340/363 [04:31<00:13, 1.75it/s]
Loading 0:  94%|█████████▎| 340/363 [04:31<00:13, 1.75it/s]
Loading 0:  94%|█████████▍| 341/363 [04:33<00:16, 1.36it/s]
Loading 0:  94%|█████████▍| 341/363 [04:33<00:16, 1.36it/s]
Loading 0:  94%|█████████▍| 342/363 [04:35<00:19, 1.08it/s]
Loading 0:  94%|█████████▍| 342/363 [04:35<00:19, 1.08it/s]
Loading 0:  95%|█████████▌| 345/363 [04:37<00:15, 1.20it/s]
Loading 0:  95%|█████████▌| 345/363 [04:37<00:15, 1.20it/s]
Loading 0:  95%|█████████▌| 346/363 [04:39<00:17, 1.01s/it]
Loading 0:  95%|█████████▌| 346/363 [04:39<00:17, 1.01s/it]
Loading 0:  96%|█████████▌| 347/363 [04:41<00:19, 1.21s/it]
Loading 0:  96%|█████████▌| 347/363 [04:41<00:19, 1.21s/it]
Loading 0:  98%|█████████▊| 355/363 [04:42<00:04, 2.00it/s]
Loading 0:  98%|█████████▊| 355/363 [04:42<00:04, 2.00it/s]
Loading 0:  99%|█████████▉| 359/363 [04:45<00:02, 1.79it/s]
Loading 0:  99%|█████████▉| 359/363 [04:45<00:02, 1.79it/s]
Loading 0:  99%|█████████▉| 360/363 [04:47<00:02, 1.41it/s]
Loading 0:  99%|█████████▉| 360/363 [04:47<00:02, 1.41it/s]
Loading 0:  99%|█████████▉| 361/363 [04:49<00:01, 1.12it/s]
Loading 0:  99%|█████████▉| 361/363 [04:49<00:01, 1.12it/s]
Loading 0: 100%|██████████| 363/363 [04:49<00:00, 1.12it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:49<00:00, 1.25it/s]
chaiml-mistral-24b-2048-71780-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v1/nvidia/config.json
chaiml-mistral-24b-2048-96216-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-71780-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-71780-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-96633-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:25, 1.41s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:25, 1.41s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<02:57, 1.99it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<02:57, 1.99it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:46, 1.55it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:46, 1.55it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:53, 1.19it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<04:53, 1.19it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:07, 1.05s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:07, 1.05s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0:   9%|▉         | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.48it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:42, 1.48it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:40, 1.17it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:40, 1.17it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.29it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:12, 1.29it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:03, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:41<04:03, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:53, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:43<04:53, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:40, 1.82it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:40, 1.82it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:34, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:56<04:34, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:58<05:26, 1.14s/it]
Loading 0:  21%|██        | 77.0/363 [00:58<05:26, 1.14s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:32, 1.80it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:32, 1.80it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:13, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:09<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:33, 1.22it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:33, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:18, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:15<03:18, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<03:59, 1.07it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<03:59, 1.07it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:46, 1.12s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:51, 1.09it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:31, 1.08s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:31, 1.08s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:26<02:02, 1.98it/s]
Loading 0:  33%|███▎      | 121/363 [01:26<02:02, 1.98it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:28<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:30<02:50, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:32<03:32, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 129/363 [01:34<03:07, 1.25it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:36<03:45, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:38<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  38%|███▊      | 139/363 [01:39<01:48, 2.06it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:43<02:34, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:45<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:47<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:49<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:51<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 174/363 [02:06<01:35, 1.97it/s]
Loading 0:  48%|████▊     | 174/363 [02:06<01:35, 1.97it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:40, 1.84it/s]
Loading 0:  49%|████▉     | 178/363 [02:08<01:40, 1.84it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:07, 1.45it/s]
Loading 0:  49%|████▉     | 179/363 [02:10<02:07, 1.45it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:38, 1.15it/s]
Loading 0:  50%|████▉     | 180/363 [02:12<02:38, 1.15it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:21, 1.28it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:21, 1.28it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:49, 1.05it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:49, 1.05it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:22, 1.14s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:22, 1.14s/it]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.08it/s]
Loading 0:  53%|█████▎    | 193/363 [02:19<01:21, 2.08it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 196/363 [02:21<01:31, 1.83it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:23<01:55, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:25<02:25, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.27it/s]
Loading 0:  55%|█████▌    | 201/363 [02:27<02:08, 1.27it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:29<02:34, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:02, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:31<03:02, 1.14s/it]
Loading 0:  58%|█████▊    | 210/363 [02:32<01:17, 1.98it/s]
Loading 0:  58%|█████▊    | 210/363 [02:32<01:17, 1.98it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:20, 1.85it/s]
Loading 0:  59%|█████▉    | 214/363 [02:34<01:20, 1.85it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.45it/s]
Loading 0:  59%|█████▉    | 215/363 [02:36<01:42, 1.45it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:07, 1.15it/s]
Loading 0:  60%|█████▉    | 216/363 [02:38<02:07, 1.15it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:52, 1.28it/s]
Loading 0:  60%|██████    | 219/363 [02:40<01:52, 1.28it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:15, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:42<02:15, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:44<02:41, 1.13s/it]
Loading 0:  61%|██████    | 221/363 [02:44<02:41, 1.13s/it]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.08it/s]
Loading 0:  63%|██████▎   | 229/363 [02:45<01:04, 2.08it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.82it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:49<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:51<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:53<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:55<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:57<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.09it/s]
Loading 0:  68%|██████▊   | 247/363 [02:58<00:55, 2.09it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:01, 1.83it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:06<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 256/363 [03:08<01:42, 1.05it/s]
Loading 0:  71%|███████   | 257/363 [03:10<02:00, 1.14s/it]
Loading 0:  71%|███████   | 257/363 [03:10<02:00, 1.14s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.08it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.08it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:51, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:38, 2.43s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:29, 2.35s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:29, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:22, 2.30s/it]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:09, 1.16it/s]
Loading 0:  78%|███████▊  | 283/363 [03:38<01:09, 1.16it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 286/363 [03:40<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 287/363 [03:42<01:11, 1.07it/s]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  79%|███████▉  | 288/363 [03:44<01:21, 1.09s/it]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 291/363 [03:46<01:06, 1.08it/s]
Loading 0:  80%|████████  | 292/363 [03:48<01:16, 1.08s/it]
Loading 0:  80%|████████  | 292/363 [03:48<01:16, 1.08s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:27, 1.24s/it]
Loading 0:  81%|████████  | 293/363 [03:50<01:27, 1.24s/it]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.97it/s]
Loading 0:  83%|████████▎ | 301/363 [03:51<00:31, 1.97it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.78it/s]
Loading 0:  84%|████████▎ | 304/363 [03:53<00:33, 1.78it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 305/363 [03:55<00:40, 1.42it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  84%|████████▍ | 306/363 [03:57<00:50, 1.13it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.03it/s]
Loading 0:  85%|████████▌ | 310/363 [04:01<00:51, 1.03it/s]
Loading 0:  86%|████████▌ | 311/363 [04:03<01:00, 1.16s/it]
Loading 0:  86%|████████▌ | 311/363 [04:03<01:00, 1.16s/it]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:21, 2.08it/s]
Loading 0:  88%|████████▊ | 319/363 [04:04<00:21, 2.08it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 327/363 [04:12<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.04it/s]
Loading 0:  90%|█████████ | 328/363 [04:14<00:33, 1.04it/s]
Loading 0:  91%|█████████ | 329/363 [04:16<00:39, 1.16s/it]
Loading 0:  91%|█████████ | 329/363 [04:16<00:39, 1.16s/it]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0:  93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.86it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.86it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.11it/s]
Loading 0:  98%|█████████▊| 355/363 [04:30<00:03, 2.11it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.92it/s]
Loading 0:  99%|█████████▉| 359/363 [04:33<00:02, 1.92it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:01, 1.50it/s]
Loading 0:  99%|█████████▉| 360/363 [04:35<00:01, 1.50it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0:  99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-96216-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-71780-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v2/nvidia
chaiml-mistral-24b-2048-71780-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v1/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-96216-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v2/nvidia
chaiml-mistral-24b-2048-71780-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v1/nvidia/tokenizer.json
chaiml-mistral-24b-2048-96216-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v2/nvidia/config.json
chaiml-mistral-24b-2048-96216-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-2678-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:08, 1.53s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:08, 1.53s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:11, 1.39it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:11, 1.39it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:12, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   8%|▊         | 30.0/363 [00:22<03:01, 1.83it/s]
Loading 0:   8%|▊         | 30.0/363 [00:22<03:01, 1.83it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:27<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:52, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:52, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:37<02:59, 1.76it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:37<02:59, 1.76it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:11, 1.63it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:11, 1.63it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:42<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:05, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:05, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:33, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:33, 1.12it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:30, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:30, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:34, 1.30s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:34, 1.30s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:51, 1.74it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:51, 1.74it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<03:03, 1.59it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<03:03, 1.59it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:52, 1.26it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:52, 1.26it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:50, 1.00it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:50, 1.00it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:19, 1.11it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:19, 1.11it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:12, 1.09s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:12, 1.09s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:39, 1.75it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:39, 1.75it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:49, 1.62it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:49, 1.62it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:35, 1.27it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:35, 1.27it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:25, 1.80it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:25, 1.80it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.39it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.39it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:03, 1.07it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:03, 1.07it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:47, 1.13it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:47, 1.13it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:33, 1.07s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:33, 1.07s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:23, 1.05s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:23, 1.05s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<04:02, 1.02s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<04:02, 1.02s/it]
Loading 0:  36%|███▌      | 129/363 [01:48<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 129/363 [01:48<03:34, 1.09it/s]
Loading 0:  36%|███▌      | 130/363 [01:50<04:17, 1.11s/it]
Loading 0:  36%|███▌      | 130/363 [01:50<04:17, 1.11s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:06, 1.32s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:06, 1.32s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:10, 1.72it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:10, 1.72it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:18, 1.60it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:18, 1.60it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:54, 1.26it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:54, 1.26it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:39, 1.00s/it]
Loading 0:  40%|███▉      | 144/363 [02:01<03:39, 1.00s/it]
Loading 0:  40%|████      | 147/363 [02:03<03:15, 1.10it/s]
Loading 0:  40%|████      | 147/363 [02:03<03:15, 1.10it/s]
Loading 0:  41%|████      | 148/363 [02:05<03:55, 1.09s/it]
Loading 0:  41%|████      | 148/363 [02:05<03:55, 1.09s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:39, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:39, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.73it/s]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.73it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:06, 1.60it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:06, 1.60it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:40, 1.26it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:40, 1.26it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:21, 1.00s/it]
Loading 0:  45%|████▍     | 162/363 [02:16<03:21, 1.00s/it]
Loading 0:  45%|████▌     | 165/363 [02:18<02:59, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:59, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:20<03:36, 1.10s/it]
Loading 0:  46%|████▌     | 166/363 [02:20<03:36, 1.10s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:19, 1.32s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:19, 1.32s/it]
Loading 0:  48%|████▊     | 174/363 [02:24<01:50, 1.72it/s]
Loading 0:  48%|████▊     | 174/363 [02:24<01:50, 1.72it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.26it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.26it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:01, 1.01it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:01, 1.01it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.11it/s]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:51, 1.30s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:51, 1.30s/it]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:38, 1.74it/s]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:38, 1.74it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.62it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.62it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:10, 1.27it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:10, 1.27it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:25, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:25, 1.12it/s]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:54, 1.09s/it]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:54, 1.09s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:35, 1.35s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:35, 1.35s/it]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:30, 1.69it/s]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:30, 1.69it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:33, 1.59it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:33, 1.59it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:57, 1.25it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:57, 1.25it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:27, 1.00s/it]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:27, 1.00s/it]
Loading 0:  60%|██████    | 219/363 [03:04<02:09, 1.11it/s]
Loading 0:  60%|██████    | 219/363 [03:04<02:09, 1.11it/s]
Loading 0:  61%|██████    | 220/363 [03:06<02:35, 1.09s/it]
Loading 0:  61%|██████    | 220/363 [03:06<02:35, 1.09s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:04, 1.30s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:04, 1.30s/it]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.75it/s]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.75it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:20, 1.62it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:20, 1.62it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:52, 1.12it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:52, 1.12it/s]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:42, 1.31s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:42, 1.31s/it]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.73it/s]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.73it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.27it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.27it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:50, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:50, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:36, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:36, 1.12it/s]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:17, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:17, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:56, 1.75it/s]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:56, 1.75it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.63it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.63it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:13, 1.27it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:13, 1.27it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:31, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:31, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:48, 2.56s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:48, 2.56s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:41, 2.52s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:41, 2.52s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.02s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.02s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.10it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.10it/s]
Loading 0:  79%|███████▉  | 287/363 [04:14<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:14<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:30, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:30, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:14, 1.04s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:14, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:25, 1.21s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:25, 1.21s/it]
Loading 0:  81%|████████  | 293/363 [04:23<01:37, 1.40s/it]
Loading 0:  81%|████████  | 293/363 [04:23<01:37, 1.40s/it]
Loading 0:  82%|████████▏ | 298/363 [04:24<00:48, 1.34it/s]
Loading 0:  82%|████████▏ | 298/363 [04:24<00:48, 1.34it/s]
Loading 0:  84%|████████▎ | 304/363 [04:27<00:37, 1.58it/s]
Loading 0:  84%|████████▎ | 304/363 [04:27<00:37, 1.58it/s]
Loading 0:  84%|████████▍ | 305/363 [04:29<00:45, 1.26it/s]
Loading 0:  84%|████████▍ | 305/363 [04:29<00:45, 1.26it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:56, 1.01it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:56, 1.01it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 310/363 [04:36<00:57, 1.08s/it]
Loading 0:  85%|████████▌ | 310/363 [04:36<00:57, 1.08s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:08, 1.31s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:08, 1.31s/it]
Loading 0:  88%|████████▊ | 318/363 [04:39<00:26, 1.72it/s]
Loading 0:  88%|████████▊ | 318/363 [04:39<00:26, 1.72it/s]
Loading 0:  89%|████████▊ | 322/363 [04:42<00:25, 1.61it/s]
Loading 0:  89%|████████▊ | 322/363 [04:42<00:25, 1.61it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.01it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.01it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.11it/s]
Loading 0:  90%|█████████ | 328/363 [04:51<00:38, 1.09s/it]
Loading 0:  90%|█████████ | 328/363 [04:51<00:38, 1.09s/it]
Loading 0:  91%|█████████ | 329/363 [04:53<00:44, 1.30s/it]
Loading 0:  91%|█████████ | 329/363 [04:53<00:44, 1.30s/it]
Loading 0:  93%|█████████▎| 336/363 [04:54<00:15, 1.76it/s]
Loading 0:  93%|█████████▎| 336/363 [04:54<00:15, 1.76it/s]
Loading 0:  94%|█████████▎| 340/363 [04:57<00:14, 1.63it/s]
Loading 0:  94%|█████████▎| 340/363 [04:57<00:14, 1.63it/s]
Loading 0:  94%|█████████▍| 341/363 [04:59<00:17, 1.28it/s]
Loading 0:  94%|█████████▍| 341/363 [04:59<00:17, 1.28it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.02it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.02it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 346/363 [05:06<00:18, 1.08s/it]
Loading 0:  95%|█████████▌| 346/363 [05:06<00:18, 1.08s/it]
Loading 0:  96%|█████████▌| 347/363 [05:08<00:20, 1.30s/it]
Loading 0:  96%|█████████▌| 347/363 [05:08<00:20, 1.30s/it]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.76it/s]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.76it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:17<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:17<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:17<00:00, 1.40it/s]
Loading 0: 100%|██████████| 363/363 [05:17<00:00, 1.40it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:17<00:00, 1.14it/s]
chaiml-mistral-24b-2048-96216-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-96216-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-52535-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:27, 1.35it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:27, 1.35it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:13, 1.21s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:13, 1.21s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.37it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:14, 1.37it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:57, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:57, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.84it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.84it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:45, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:45, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:53, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:53, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:11, 1.62it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:11, 1.62it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:05, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:05, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:34, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:34, 1.12it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:31, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:31, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:35, 1.30s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:35, 1.30s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:01, 1.61it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:01, 1.61it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:55, 1.02s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:55, 1.02s/it]
Loading 0:  21%|██        | 75.0/363 [01:02<04:22, 1.10it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:22, 1.10it/s]
Loading 0:  21%|██        | 76.0/363 [01:05<05:15, 1.10s/it]
Loading 0:  21%|██        | 76.0/363 [01:05<05:15, 1.10s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:16, 1.32s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:16, 1.32s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.00it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.00it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.94it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.94it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:00, 1.08it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:00, 1.08it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.06s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.06s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:23, 1.05s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:23, 1.05s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:11, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:11, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<03:59, 1.01s/it]
Loading 0:  36%|███▌      | 129/363 [01:48<03:31, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:48<03:31, 1.10it/s]
Loading 0:  36%|███▌      | 130/363 [01:50<04:15, 1.10s/it]
Loading 0:  36%|███▌      | 130/363 [01:50<04:15, 1.10s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:03, 1.31s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:03, 1.31s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.73it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.73it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:16, 1.62it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:53, 1.27it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:53, 1.27it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:42, 1.02s/it]
Loading 0:  40%|███▉      | 144/363 [02:01<03:42, 1.02s/it]
Loading 0:  40%|████      | 147/363 [02:03<03:17, 1.10it/s]
Loading 0:  40%|████      | 147/363 [02:03<03:17, 1.10it/s]
Loading 0:  41%|████      | 148/363 [02:05<03:56, 1.10s/it]
Loading 0:  41%|████      | 148/363 [02:05<03:56, 1.10s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:40, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:40, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.27it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.27it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:20, 1.00it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:20, 1.00it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:20<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 166/363 [02:20<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 167/363 [02:22<04:14, 1.30s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:14, 1.30s/it]
Loading 0:  48%|████▊     | 174/363 [02:24<01:48, 1.74it/s]
Loading 0:  48%|████▊     | 174/363 [02:24<01:48, 1.74it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.27it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.27it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:08, 1.03s/it]
Loading 0:  50%|████▉     | 180/363 [02:31<03:08, 1.03s/it]
Loading 0:  50%|█████     | 183/363 [02:33<02:46, 1.08it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:46, 1.08it/s]
Loading 0:  51%|█████     | 184/363 [02:36<03:18, 1.11s/it]
Loading 0:  51%|█████     | 184/363 [02:36<03:18, 1.11s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:54, 1.32s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:54, 1.32s/it]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:39, 1.72it/s]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:39, 1.72it/s]
Loading 0:  54%|█████▍    | 196/363 [02:42<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 196/363 [02:42<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:11, 1.26it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:11, 1.26it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:44, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:44, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:25, 1.11it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:25, 1.11it/s]
Loading 0:  56%|█████▌    | 202/363 [02:51<02:54, 1.09s/it]
Loading 0:  56%|█████▌    | 202/363 [02:51<02:54, 1.09s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:28, 1.30s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:28, 1.30s/it]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:28, 1.74it/s]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:28, 1.74it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:32, 1.62it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:32, 1.62it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:56, 1.27it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:56, 1.27it/s]
Loading 0:  60%|█████▉    | 216/363 [03:02<02:28, 1.01s/it]
Loading 0:  60%|█████▉    | 216/363 [03:02<02:28, 1.01s/it]
Loading 0:  60%|██████    | 219/363 [03:04<02:10, 1.10it/s]
Loading 0:  60%|██████    | 219/363 [03:04<02:10, 1.10it/s]
Loading 0:  61%|██████    | 220/363 [03:06<02:36, 1.09s/it]
Loading 0:  61%|██████    | 220/363 [03:06<02:36, 1.09s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:05, 1.30s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:05, 1.30s/it]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.73it/s]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.73it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:21, 1.61it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:21, 1.61it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 234/363 [03:17<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:17<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:52, 1.12it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:52, 1.12it/s]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:15, 1.09s/it]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:15, 1.09s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:40, 1.30s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:40, 1.30s/it]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:06, 1.75it/s]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:06, 1.75it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:09, 1.62it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:09, 1.62it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.27it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.27it/s]
Loading 0:  69%|██████▉   | 252/363 [03:32<01:49, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:32<01:49, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:36, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:36, 1.12it/s]
Loading 0:  71%|███████   | 256/363 [03:36<01:55, 1.08s/it]
Loading 0:  71%|███████   | 256/363 [03:36<01:55, 1.08s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:17, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:17, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.74it/s]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.74it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.62it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.62it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:13, 1.27it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:13, 1.27it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:31, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:31, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:47, 2.56s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:47, 2.56s/it]
Loading 0:  76%|███████▌  | 275/363 [04:08<03:41, 2.52s/it]
Loading 0:  76%|███████▌  | 275/363 [04:08<03:41, 2.52s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.02s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.02s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.12it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.12it/s]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:29, 1.19s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:29, 1.19s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:13, 1.02s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:13, 1.02s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:24, 1.20s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:24, 1.20s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:36, 1.39s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:36, 1.39s/it]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:37, 1.67it/s]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:37, 1.67it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:36, 1.61it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:36, 1.61it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:45, 1.27it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:45, 1.27it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:59, 1.05s/it]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:59, 1.05s/it]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:50, 1.06it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:50, 1.06it/s]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:59, 1.12s/it]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:59, 1.12s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:08, 1.33s/it]
Loading 0:  86%|████████▌ | 311/363 [04:38<01:08, 1.33s/it]
Loading 0:  88%|████████▊ | 318/363 [04:39<00:26, 1.73it/s]
Loading 0:  88%|████████▊ | 318/363 [04:39<00:26, 1.73it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:25, 1.61it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:25, 1.61it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 323/363 [04:44<00:31, 1.27it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.01it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.01it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 328/363 [04:50<00:38, 1.09s/it]
Loading 0:  90%|█████████ | 328/363 [04:50<00:38, 1.09s/it]
Loading 0:  91%|█████████ | 329/363 [04:53<00:44, 1.30s/it]
Loading 0:  91%|█████████ | 329/363 [04:53<00:44, 1.30s/it]
Loading 0:  93%|█████████▎| 336/363 [04:54<00:15, 1.76it/s]
Loading 0:  93%|█████████▎| 336/363 [04:54<00:15, 1.76it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.64it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.64it/s]
Loading 0:  94%|█████████▍| 341/363 [04:59<00:17, 1.28it/s]
Loading 0:  94%|█████████▍| 341/363 [04:59<00:17, 1.28it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.08it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.08it/s]
Loading 0:  95%|█████████▌| 346/363 [05:06<00:18, 1.11s/it]
Loading 0:  95%|█████████▌| 346/363 [05:06<00:18, 1.11s/it]
Loading 0:  96%|█████████▌| 347/363 [05:08<00:21, 1.32s/it]
Loading 0:  96%|█████████▌| 347/363 [05:08<00:21, 1.32s/it]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.73it/s]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.73it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.66it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.66it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:17<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:17<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:17<00:00, 1.05it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:17<00:00, 1.14it/s]
chaiml-mistral-24b-2048-2678-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:27, 1.35it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:27, 1.35it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.21s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.21s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:59, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:59, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:15, 1.34it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:15, 1.34it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:17, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:17, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:22<06:28, 1.14s/it]
Loading 0:   6%|▋         | 23.0/363 [00:22<06:28, 1.14s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:02, 1.82it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:02, 1.82it/s]
Loading 0:   9%|▉         | 34.0/363 [00:26<03:18, 1.66it/s]
Loading 0:   9%|▉         | 34.0/363 [00:26<03:18, 1.66it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:12, 1.30it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:12, 1.30it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:18, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:18, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:47, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:47, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:48, 1.08s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:48, 1.08s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:58, 1.30s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:58, 1.30s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:01, 1.74it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<03:01, 1.74it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:12, 1.61it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:12, 1.61it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:04, 1.27it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:04, 1.27it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:06, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:06, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:35, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:35, 1.11it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:32, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:50<05:32, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:37, 1.31s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:37, 1.31s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:52, 1.73it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:52, 1.73it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:03, 1.60it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:03, 1.60it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:52, 1.25it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:52, 1.25it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:51, 1.00s/it]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:51, 1.00s/it]
Loading 0:  21%|██        | 75.0/363 [01:03<04:20, 1.11it/s]
Loading 0:  21%|██        | 75.0/363 [01:03<04:20, 1.11it/s]
Loading 0:  21%|██        | 76.0/363 [01:05<05:14, 1.10s/it]
Loading 0:  21%|██        | 76.0/363 [01:05<05:14, 1.10s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:15, 1.31s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:15, 1.31s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.72it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.72it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:52, 1.60it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:52, 1.60it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:38, 1.26it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:38, 1.26it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:33, 1.00s/it]
Loading 0:  25%|██▍       | 90.0/363 [01:16<04:33, 1.00s/it]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:18, 1.93it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:17<02:18, 1.93it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:28, 1.77it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:28, 1.77it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 102/363 [01:22<03:10, 1.37it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:02, 1.07it/s]
Loading 0:  28%|██▊       | 103/363 [01:24<04:02, 1.07it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:46, 1.13it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:46, 1.13it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:34, 1.07s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:34, 1.07s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:27, 1.29s/it]
Loading 0:  30%|██▉       | 108/363 [01:31<05:27, 1.29s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:25, 1.05s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:25, 1.05s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:12, 1.24s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:12, 1.24s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:04, 1.46s/it]
Loading 0:  31%|███       | 113/363 [01:38<06:04, 1.46s/it]
Loading 0:  33%|███▎      | 120/363 [01:39<02:26, 1.66it/s]
Loading 0:  33%|███▎      | 120/363 [01:39<02:26, 1.66it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:37, 1.52it/s]
Loading 0:  34%|███▍      | 124/363 [01:42<02:37, 1.52it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:17, 1.21it/s]
Loading 0:  34%|███▍      | 125/363 [01:44<03:17, 1.21it/s]
Loading 0:  35%|███▍      | 126/363 [01:46<04:05, 1.03s/it]
Loading 0:  35%|███▍      | 126/363 [01:46<04:05, 1.03s/it]
Loading 0:  36%|███▌      | 129/363 [01:48<03:36, 1.08it/s]
Loading 0:  36%|███▌      | 129/363 [01:48<03:36, 1.08it/s]
Loading 0:  36%|███▌      | 130/363 [01:51<04:19, 1.11s/it]
Loading 0:  36%|███▌      | 130/363 [01:51<04:19, 1.11s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:07, 1.33s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:07, 1.33s/it]
Loading 0:  38%|███▊      | 138/363 [01:54<02:12, 1.70it/s]
Loading 0:  38%|███▊      | 138/363 [01:54<02:12, 1.70it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:19, 1.59it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:19, 1.59it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:56, 1.25it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:56, 1.25it/s]
Loading 0:  40%|███▉      | 144/363 [02:02<03:40, 1.01s/it]
Loading 0:  40%|███▉      | 144/363 [02:02<03:40, 1.01s/it]
Loading 0:  40%|████      | 147/363 [02:04<03:16, 1.10it/s]
Loading 0:  40%|████      | 147/363 [02:04<03:16, 1.10it/s]
Loading 0:  41%|████      | 148/363 [02:06<03:56, 1.10s/it]
Loading 0:  41%|████      | 148/363 [02:06<03:56, 1.10s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:40, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.27it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.27it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:20, 1.00it/s]
Loading 0:  45%|████▍     | 162/363 [02:17<03:20, 1.00it/s]
Loading 0:  45%|████▌     | 165/363 [02:19<02:58, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:19<02:58, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:21<03:35, 1.09s/it]
Loading 0:  46%|████▌     | 166/363 [02:21<03:35, 1.09s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.31s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.31s/it]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.73it/s]
Loading 0:  48%|████▊     | 174/363 [02:25<01:49, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.60it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:55, 1.60it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:26, 1.25it/s]
Loading 0:  49%|████▉     | 179/363 [02:30<02:26, 1.25it/s]
Loading 0:  50%|████▉     | 180/363 [02:32<03:03, 1.00s/it]
Loading 0:  50%|████▉     | 180/363 [02:32<03:03, 1.00s/it]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.10it/s]
Loading 0:  50%|█████     | 183/363 [02:34<02:42, 1.10it/s]
Loading 0:  51%|█████     | 184/363 [02:36<03:16, 1.10s/it]
Loading 0:  51%|█████     | 184/363 [02:36<03:16, 1.10s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  51%|█████     | 185/363 [02:39<03:53, 1.31s/it]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  53%|█████▎    | 192/363 [02:40<01:39, 1.72it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 196/363 [02:43<01:44, 1.60it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:11, 1.26it/s]
Loading 0:  54%|█████▍    | 197/363 [02:45<02:11, 1.26it/s]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:44, 1.00it/s]
Loading 0:  55%|█████▍    | 198/363 [02:47<02:44, 1.00it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:26, 1.11it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:26, 1.11it/s]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:56, 1.10s/it]
Loading 0:  56%|█████▌    | 202/363 [02:52<02:56, 1.10s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:30, 1.31s/it]
Loading 0:  56%|█████▌    | 203/363 [02:54<03:30, 1.31s/it]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:29, 1.72it/s]
Loading 0:  58%|█████▊    | 210/363 [02:55<01:29, 1.72it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:33, 1.59it/s]
Loading 0:  59%|█████▉    | 214/363 [02:58<01:33, 1.59it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:57, 1.26it/s]
Loading 0:  59%|█████▉    | 215/363 [03:00<01:57, 1.26it/s]
Loading 0:  60%|█████▉    | 216/363 [03:02<02:26, 1.00it/s]
Loading 0:  60%|█████▉    | 216/363 [03:02<02:26, 1.00it/s]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.11it/s]
Loading 0:  60%|██████    | 219/363 [03:05<02:10, 1.11it/s]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.09s/it]
Loading 0:  61%|██████    | 220/363 [03:07<02:36, 1.09s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  61%|██████    | 221/363 [03:09<03:06, 1.31s/it]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  63%|██████▎   | 228/363 [03:10<01:18, 1.72it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 232/363 [03:13<01:21, 1.60it/s]
Loading 0:  64%|██████▍   | 233/363 [03:15<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 233/363 [03:15<01:43, 1.26it/s]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:08, 1.00it/s]
Loading 0:  64%|██████▍   | 234/363 [03:18<02:08, 1.00it/s]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:53, 1.11it/s]
Loading 0:  65%|██████▌   | 237/363 [03:20<01:53, 1.11it/s]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:16, 1.09s/it]
Loading 0:  66%|██████▌   | 238/363 [03:22<02:16, 1.09s/it]
Loading 0:  66%|██████▌   | 239/363 [03:24<02:41, 1.31s/it]
Loading 0:  66%|██████▌   | 239/363 [03:24<02:41, 1.31s/it]
Loading 0:  68%|██████▊   | 246/363 [03:25<01:07, 1.74it/s]
Loading 0:  68%|██████▊   | 246/363 [03:25<01:07, 1.74it/s]
Loading 0:  69%|██████▉   | 250/363 [03:28<01:11, 1.57it/s]
Loading 0:  69%|██████▉   | 250/363 [03:28<01:11, 1.57it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:30, 1.24it/s]
Loading 0:  69%|██████▉   | 251/363 [03:31<01:30, 1.24it/s]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.01s/it]
Loading 0:  69%|██████▉   | 252/363 [03:33<01:51, 1.01s/it]
Loading 0:  70%|███████   | 255/363 [03:35<01:38, 1.10it/s]
Loading 0:  70%|███████   | 255/363 [03:35<01:38, 1.10it/s]
Loading 0:  71%|███████   | 256/363 [03:37<01:57, 1.10s/it]
Loading 0:  71%|███████   | 256/363 [03:37<01:57, 1.10s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:20, 1.33s/it]
Loading 0:  71%|███████   | 257/363 [03:40<02:20, 1.33s/it]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:58, 1.70it/s]
Loading 0:  73%|███████▎  | 264/363 [03:41<00:58, 1.70it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.59it/s]
Loading 0:  74%|███████▍  | 268/363 [03:44<00:59, 1.59it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:15, 1.25it/s]
Loading 0:  74%|███████▍  | 269/363 [03:46<01:15, 1.25it/s]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:33, 1.00s/it]
Loading 0:  74%|███████▍  | 270/363 [03:48<01:33, 1.00s/it]
Loading 0:  75%|███████▌  | 273/363 [04:05<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 273/363 [04:05<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:48, 2.56s/it]
Loading 0:  75%|███████▌  | 274/363 [04:07<03:48, 2.56s/it]
Loading 0:  76%|███████▌  | 275/363 [04:09<03:42, 2.52s/it]
Loading 0:  76%|███████▌  | 275/363 [04:09<03:42, 2.52s/it]
Loading 0:  78%|███████▊  | 282/363 [04:10<01:22, 1.02s/it]
Loading 0:  78%|███████▊  | 282/363 [04:10<01:22, 1.02s/it]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 286/363 [04:13<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 287/363 [04:15<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 287/363 [04:15<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 288/363 [04:17<01:30, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:17<01:30, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:14, 1.04s/it]
Loading 0:  80%|████████  | 291/363 [04:20<01:14, 1.04s/it]
Loading 0:  80%|████████  | 292/363 [04:22<01:25, 1.21s/it]
Loading 0:  80%|████████  | 292/363 [04:22<01:25, 1.21s/it]
Loading 0:  81%|████████  | 293/363 [04:24<01:38, 1.41s/it]
Loading 0:  81%|████████  | 293/363 [04:24<01:38, 1.41s/it]
Loading 0:  83%|████████▎ | 300/363 [04:25<00:38, 1.65it/s]
Loading 0:  83%|████████▎ | 300/363 [04:25<00:38, 1.65it/s]
Loading 0:  84%|████████▎ | 304/363 [04:28<00:39, 1.51it/s]
Loading 0:  84%|████████▎ | 304/363 [04:28<00:39, 1.51it/s]
Loading 0:  84%|████████▍ | 305/363 [04:30<00:48, 1.20it/s]
Loading 0:  84%|████████▍ | 305/363 [04:30<00:48, 1.20it/s]
Loading 0:  84%|████████▍ | 306/363 [04:33<00:58, 1.03s/it]
Loading 0:  84%|████████▍ | 306/363 [04:33<00:58, 1.03s/it]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:49, 1.08it/s]
Loading 0:  85%|████████▌ | 309/363 [04:35<00:49, 1.08it/s]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:59, 1.11s/it]
Loading 0:  85%|████████▌ | 310/363 [04:37<00:59, 1.11s/it]
Loading 0:  86%|████████▌ | 311/363 [04:40<01:11, 1.37s/it]
Loading 0:  86%|████████▌ | 311/363 [04:40<01:11, 1.37s/it]
Loading 0:  88%|████████▊ | 318/363 [04:41<00:26, 1.68it/s]
Loading 0:  88%|████████▊ | 318/363 [04:41<00:26, 1.68it/s]
Loading 0:  89%|████████▊ | 322/363 [04:44<00:25, 1.58it/s]
Loading 0:  89%|████████▊ | 322/363 [04:44<00:25, 1.58it/s]
Loading 0:  89%|████████▉ | 323/363 [04:46<00:32, 1.25it/s]
Loading 0:  89%|████████▉ | 323/363 [04:46<00:32, 1.25it/s]
Loading 0:  89%|████████▉ | 324/363 [04:48<00:39, 1.01s/it]
Loading 0:  89%|████████▉ | 324/363 [04:48<00:39, 1.01s/it]
Loading 0:  90%|█████████ | 327/363 [04:50<00:32, 1.10it/s]
Loading 0:  90%|█████████ | 327/363 [04:50<00:32, 1.10it/s]
Loading 0:  90%|█████████ | 328/363 [04:53<00:38, 1.10s/it]
Loading 0:  90%|█████████ | 328/363 [04:53<00:38, 1.10s/it]
Loading 0:  91%|█████████ | 329/363 [04:55<00:44, 1.31s/it]
Loading 0:  91%|█████████ | 329/363 [04:55<00:44, 1.31s/it]
Loading 0:  93%|█████████▎| 336/363 [04:56<00:15, 1.70it/s]
Loading 0:  93%|█████████▎| 336/363 [04:56<00:15, 1.70it/s]
Loading 0:  94%|█████████▎| 340/363 [04:59<00:14, 1.58it/s]
Loading 0:  94%|█████████▎| 340/363 [04:59<00:14, 1.58it/s]
Loading 0:  94%|█████████▍| 341/363 [05:01<00:17, 1.25it/s]
Loading 0:  94%|█████████▍| 341/363 [05:01<00:17, 1.25it/s]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:21, 1.01s/it]
Loading 0:  94%|█████████▍| 342/363 [05:03<00:21, 1.01s/it]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:16, 1.10it/s]
Loading 0:  95%|█████████▌| 345/363 [05:06<00:16, 1.10it/s]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:18, 1.10s/it]
Loading 0:  95%|█████████▌| 346/363 [05:08<00:18, 1.10s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:21, 1.32s/it]
Loading 0:  96%|█████████▌| 347/363 [05:10<00:21, 1.32s/it]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.72it/s]
Loading 0:  98%|█████████▊| 354/363 [05:11<00:05, 1.72it/s]
Loading 0:  99%|█████████▉| 359/363 [05:15<00:02, 1.65it/s]
Loading 0:  99%|█████████▉| 359/363 [05:15<00:02, 1.65it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 360/363 [05:17<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.04it/s]
Loading 0:  99%|█████████▉| 361/363 [05:19<00:01, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.39it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.39it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.14it/s]
chaiml-mistral-24b-2048-96216-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v1/nvidia
chaiml-mistral-24b-2048-96216-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-96633-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpes0l2auk' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96216-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v1/nvidia/config.json
chaiml-mistral-24b-2048-96633-v1-mkmlizer: quantized model in 283.612s
chaiml-mistral-24b-2048-66666-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:56, 1.52it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:56, 1.52it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:23, 1.07s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:23, 1.07s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:35, 1.44s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:35, 1.44s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:44, 2.13it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:44, 2.13it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:53, 1.50it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:53, 1.50it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:04, 1.15it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:04, 1.15it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:19, 1.09s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:19, 1.09s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:41, 1.21it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:41, 1.21it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:46, 1.02s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:46, 1.02s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:35, 2.14it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:35, 2.14it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:59, 1.83it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:59, 1.83it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:47, 1.44it/s]
Loading 0:  10%|▉         | 35.0/363 [00:25<03:47, 1.44it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:46, 1.14it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:46, 1.14it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:16, 1.26it/s]
Loading 0:  11%|█         | 39.0/363 [00:29<04:16, 1.26it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:09, 1.04it/s]
Loading 0:  11%|█         | 40.0/363 [00:31<05:09, 1.04it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:09, 1.15s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:33<06:09, 1.15s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.07it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.07it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:34, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:34, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:04, 1.25it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:04, 1.25it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:55, 1.03it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:55, 1.03it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:51, 1.16s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:51, 1.16s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:19, 1.12it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:19, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:00<02:22, 1.96it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:30, 1.83it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:03<02:30, 1.83it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:10, 1.44it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:05<03:10, 1.44it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<03:58, 1.14it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:07<03:58, 1.14it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:55, 2.30it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:55, 2.30it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:12<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:34, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:22<03:53, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:22<03:53, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:24<04:34, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:24<04:34, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:19, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:26<05:19, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.98it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.98it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:09, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:47, 1.02it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:30, 1.17s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:30, 1.17s/it]
Loading 0:  38%|███▊      | 139/363 [01:40<01:49, 2.05it/s]
Loading 0:  38%|███▊      | 139/363 [01:40<01:49, 2.05it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 142/363 [01:43<02:02, 1.80it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:35, 1.41it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:35, 1.41it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:15, 1.12it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:15, 1.12it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:53, 1.25it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:53, 1.25it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:28, 1.03it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:28, 1.03it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:08, 1.16s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:08, 1.16s/it]
Loading 0:  43%|████▎     | 156/363 [01:53<01:45, 1.96it/s]
Loading 0:  43%|████▎     | 156/363 [01:53<01:45, 1.96it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 160/363 [01:56<01:51, 1.82it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:21, 1.43it/s]
Loading 0:  44%|████▍     | 161/363 [01:58<02:21, 1.43it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:56, 1.14it/s]
Loading 0:  45%|████▍     | 162/363 [02:00<02:56, 1.14it/s]
Loading 0:  45%|████▌     | 165/363 [02:02<02:37, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:02<02:37, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:04<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:04<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:06<03:45, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:06<03:45, 1.15s/it]
Loading 0:  48%|████▊     | 174/363 [02:07<01:36, 1.96it/s]
Loading 0:  48%|████▊     | 174/363 [02:07<01:36, 1.96it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.83it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:08, 1.44it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:08, 1.44it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:40, 1.14it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:40, 1.14it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:15<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:51, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:17<02:51, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:19<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:19<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.06it/s]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.06it/s]
Loading 0:  54%|█████▍    | 196/363 [02:23<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 196/363 [02:23<01:32, 1.81it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.42it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:26, 1.13it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:26, 1.13it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:35, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:35, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:04, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:04, 1.15s/it]
Loading 0:  58%|█████▊    | 211/363 [02:34<01:13, 2.07it/s]
Loading 0:  58%|█████▊    | 211/363 [02:34<01:13, 2.07it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:22, 1.81it/s]
Loading 0:  59%|█████▉    | 214/363 [02:36<01:22, 1.81it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:44, 1.42it/s]
Loading 0:  59%|█████▉    | 215/363 [02:38<01:44, 1.42it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:10, 1.13it/s]
Loading 0:  60%|█████▉    | 216/363 [02:40<02:10, 1.13it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:54, 1.26it/s]
Loading 0:  60%|██████    | 219/363 [02:42<01:54, 1.26it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:17, 1.04it/s]
Loading 0:  61%|██████    | 220/363 [02:44<02:17, 1.04it/s]
Loading 0:  61%|██████    | 221/363 [02:46<02:44, 1.16s/it]
Loading 0:  61%|██████    | 221/363 [02:46<02:44, 1.16s/it]
Loading 0:  63%|██████▎   | 229/363 [02:47<01:05, 2.06it/s]
Loading 0:  63%|██████▎   | 229/363 [02:47<01:05, 2.06it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 232/363 [02:49<01:12, 1.81it/s]
Loading 0:  64%|██████▍   | 233/363 [02:51<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 233/363 [02:51<01:31, 1.42it/s]
Loading 0:  64%|██████▍   | 234/363 [02:53<01:54, 1.13it/s]
Loading 0:  64%|██████▍   | 234/363 [02:53<01:54, 1.13it/s]
Loading 0:  65%|██████▌   | 237/363 [02:55<01:40, 1.26it/s]
Loading 0:  65%|██████▌   | 237/363 [02:55<01:40, 1.26it/s]
Loading 0:  66%|██████▌   | 238/363 [02:57<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 238/363 [02:57<02:00, 1.04it/s]
Loading 0:  66%|██████▌   | 239/363 [02:59<02:23, 1.16s/it]
Loading 0:  66%|██████▌   | 239/363 [02:59<02:23, 1.16s/it]
Loading 0:  68%|██████▊   | 247/363 [03:00<00:56, 2.05it/s]
Loading 0:  68%|██████▊   | 247/363 [03:00<00:56, 2.05it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.80it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.80it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:19, 1.42it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:19, 1.42it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:38, 1.12it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:38, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:26, 1.25it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:26, 1.25it/s]
Loading 0:  71%|███████   | 256/363 [03:10<01:43, 1.03it/s]
Loading 0:  71%|███████   | 256/363 [03:10<01:43, 1.03it/s]
Loading 0:  71%|███████   | 257/363 [03:12<02:02, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:12<02:02, 1.15s/it]
Loading 0:  73%|███████▎  | 264/363 [03:13<00:50, 1.97it/s]
Loading 0:  73%|███████▎  | 264/363 [03:13<00:50, 1.97it/s]
Loading 0:  74%|███████▍  | 268/363 [03:16<00:52, 1.83it/s]
Loading 0:  74%|███████▍  | 268/363 [03:16<00:52, 1.83it/s]
Loading 0:  74%|███████▍  | 269/363 [03:18<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:18<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:20<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:20<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:35<03:37, 2.42s/it]
Loading 0:  75%|███████▌  | 273/363 [03:35<03:37, 2.42s/it]
Loading 0:  75%|███████▌  | 274/363 [03:37<03:28, 2.35s/it]
Loading 0:  75%|███████▌  | 274/363 [03:37<03:28, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:39<03:22, 2.31s/it]
Loading 0:  76%|███████▌  | 275/363 [03:39<03:22, 2.31s/it]
Loading 0:  78%|███████▊  | 283/363 [03:40<01:09, 1.15it/s]
Loading 0:  78%|███████▊  | 283/363 [03:40<01:09, 1.15it/s]
Loading 0:  79%|███████▉  | 286/363 [03:42<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 286/363 [03:42<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 287/363 [03:44<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 287/363 [03:44<01:12, 1.05it/s]
Loading 0:  79%|███████▉  | 288/363 [03:46<01:22, 1.10s/it]
Loading 0:  79%|███████▉  | 288/363 [03:46<01:22, 1.10s/it]
Loading 0:  80%|████████  | 291/363 [03:48<01:07, 1.07it/s]
Loading 0:  80%|████████  | 291/363 [03:48<01:07, 1.07it/s]
Loading 0:  80%|████████  | 292/363 [03:50<01:17, 1.09s/it]
Loading 0:  80%|████████  | 292/363 [03:50<01:17, 1.09s/it]
Loading 0:  81%|████████  | 293/363 [03:52<01:27, 1.25s/it]
Loading 0:  81%|████████  | 293/363 [03:52<01:27, 1.25s/it]
Loading 0:  83%|████████▎ | 301/363 [03:53<00:31, 1.95it/s]
Loading 0:  83%|████████▎ | 301/363 [03:53<00:31, 1.95it/s]
Loading 0:  84%|████████▎ | 304/363 [03:56<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:56<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [03:57<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 305/363 [03:57<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 306/363 [04:00<00:51, 1.11it/s]
Loading 0:  84%|████████▍ | 306/363 [04:00<00:51, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:02<00:43, 1.23it/s]
Loading 0:  85%|████████▌ | 309/363 [04:02<00:43, 1.23it/s]
Loading 0:  85%|████████▌ | 310/363 [04:03<00:51, 1.02it/s]
Loading 0:  85%|████████▌ | 310/363 [04:03<00:51, 1.02it/s]
Loading 0:  86%|████████▌ | 311/363 [04:06<01:00, 1.17s/it]
Loading 0:  86%|████████▌ | 311/363 [04:06<01:00, 1.17s/it]
Loading 0:  88%|████████▊ | 319/363 [04:07<00:21, 2.07it/s]
Loading 0:  88%|████████▊ | 319/363 [04:07<00:21, 2.07it/s]
Loading 0:  89%|████████▊ | 322/363 [04:09<00:22, 1.80it/s]
Loading 0:  89%|████████▊ | 322/363 [04:09<00:22, 1.80it/s]
Loading 0:  89%|████████▉ | 323/363 [04:11<00:28, 1.41it/s]
Loading 0:  89%|████████▉ | 323/363 [04:11<00:28, 1.41it/s]
Loading 0:  89%|████████▉ | 324/363 [04:13<00:35, 1.11it/s]
Loading 0:  89%|████████▉ | 324/363 [04:13<00:35, 1.11it/s]
Loading 0:  90%|█████████ | 327/363 [04:15<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 327/363 [04:15<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 328/363 [04:17<00:34, 1.02it/s]
Loading 0:  90%|█████████ | 328/363 [04:17<00:34, 1.02it/s]
Loading 0:  91%|█████████ | 329/363 [04:19<00:39, 1.17s/it]
Loading 0:  91%|█████████ | 329/363 [04:19<00:39, 1.17s/it]
Loading 0:  93%|█████████▎| 337/363 [04:20<00:12, 2.08it/s]
Loading 0:  93%|█████████▎| 337/363 [04:20<00:12, 2.08it/s]
Loading 0:  94%|█████████▎| 340/363 [04:22<00:12, 1.81it/s]
Loading 0:  94%|█████████▎| 340/363 [04:22<00:12, 1.81it/s]
Loading 0:  94%|█████████▍| 341/363 [04:24<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 341/363 [04:24<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 342/363 [04:26<00:18, 1.12it/s]
Loading 0:  94%|█████████▍| 342/363 [04:26<00:18, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 346/363 [04:30<00:16, 1.03it/s]
Loading 0:  95%|█████████▌| 346/363 [04:30<00:16, 1.03it/s]
Loading 0:  96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0:  96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0:  98%|█████████▊| 355/363 [04:33<00:03, 2.08it/s]
Loading 0:  98%|█████████▊| 355/363 [04:33<00:03, 2.08it/s]
Loading 0:  99%|█████████▉| 359/363 [04:36<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 359/363 [04:36<00:02, 1.86it/s]
Loading 0:  99%|█████████▉| 360/363 [04:38<00:02, 1.46it/s]
Loading 0:  99%|█████████▉| 360/363 [04:38<00:02, 1.46it/s]
Loading 0:  99%|█████████▉| 361/363 [04:40<00:01, 1.16it/s]
Loading 0:  99%|█████████▉| 361/363 [04:40<00:01, 1.16it/s]
Loading 0: 100%|██████████| 363/363 [04:40<00:00, 1.16it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:40<00:00, 1.29it/s]
chaiml-mistral-24b-2048-96216-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-96633-v1-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged in 376.229s
chaiml-mistral-24b-2048-66666-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpjw3dhcj7' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96216-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v1/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-96633-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-2678-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpqukavtl6' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-66666-v1-mkmlizer: quantized model in 286.965s
chaiml-mistral-24b-2048-96216-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v1/nvidia/tokenizer.json
chaiml-mistral-24b-2048-52535-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-2678-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpdilzrv0t' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96633-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-2678-v1-mkmlizer: quantized model in 324.113s
chaiml-mistral-24b-2048-66666-v1-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_10k_prod_rm_927_merged in 380.121s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-2678-v2-mkmlizer: quantized model in 326.993s
chaiml-mistral-24b-2048-96633-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v1/nvidia
chaiml-mistral-24b-2048-2678-v1-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_30k_prod_rm_906_merged in 419.452s
chaiml-mistral-24b-2048-66666-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-52535-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v1/nvidia
chaiml-mistral-24b-2048-2678-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_30k_prod_rm_906_merged in 413.411s
chaiml-mistral-24b-2048-96633-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v1/nvidia/config.json
chaiml-mistral-24b-2048-2678-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-66666-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-52535-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v1/nvidia/config.json
chaiml-mistral-24b-2048-2678-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-96633-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-2678-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-66666-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-66666-v1/nvidia
chaiml-mistral-24b-2048-52535-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v1/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-2678-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-52535-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-96633-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v1/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-2678-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v1/nvidia
chaiml-mistral-24b-2048-66666-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-66666-v1/nvidia/config.json
chaiml-mistral-24b-2048-52535-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-2678-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v2/nvidia
chaiml-mistral-24b-2048-96633-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v1/nvidia/tokenizer.json
chaiml-mistral-24b-2048-2678-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v1/nvidia/config.json
chaiml-mistral-24b-2048-66666-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-66666-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-52535-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v1/nvidia/tokenizer.json
chaiml-mistral-24b-2048-2678-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v2/nvidia/config.json
chaiml-mistral-24b-2048-2678-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v1/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-66666-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-66666-v1/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-2678-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-2678-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v1/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-2678-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-2678-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-71780-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v1/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-71780-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-96216-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-96216-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v1/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-2678-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v1/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-2678-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-96633-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v1/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-52535-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v1/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-66666-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-66666-v1/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-52535-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v2/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-52535-v2-mkmlizer completed after 610.3s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-52535-v2-mkmlizer
Pipeline stage MKMLizer completed in 615.89s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 2.18s
chaiml-mistral-24b-2048-96216-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v1/nvidia/flywheel_model.0.safetensors
run pipeline stage %s
Job chaiml-mistral-24b-2048-96216-v1-mkmlizer completed after 619.25s with status: succeeded
Running pipeline stage MKMLDeployer
Stopping job with name chaiml-mistral-24b-2048-96216-v1-mkmlizer
Creating inference service chaiml-mistral-24b-2048-52535-v2
Pipeline stage MKMLizer completed in 625.50s
Waiting for inference service chaiml-mistral-24b-2048-52535-v2 to be ready
run pipeline stage %s
chaiml-mistral-24b-2048-71780-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-71780-v2/nvidia/flywheel_model.0.safetensors
Running pipeline stage MKMLTemplater
Job chaiml-mistral-24b-2048-71780-v2-mkmlizer completed after 614.99s with status: succeeded
chaiml-mistral-24b-2048-96633-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v1/nvidia/flywheel_model.0.safetensors
Pipeline stage MKMLTemplater completed in 2.73s
Stopping job with name chaiml-mistral-24b-2048-71780-v2-mkmlizer
Job chaiml-mistral-24b-2048-96633-v1-mkmlizer completed after 614.33s with status: succeeded
run pipeline stage %s
Pipeline stage MKMLizer completed in 624.77s
Job chaiml-mistral-24b-2048-71780-v1-mkmlizer completed after 631.66s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-96633-v1-mkmlizer
chaiml-mistral-24b-2048-96216-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v2/nvidia/flywheel_model.0.safetensors
Running pipeline stage MKMLDeployer
chaiml-mistral-24b-2048-2678-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v2/nvidia/flywheel_model.0.safetensors
run pipeline stage %s
Stopping job with name chaiml-mistral-24b-2048-71780-v1-mkmlizer
Pipeline stage MKMLizer completed in 626.32s
chaiml-mistral-24b-2048-52535-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-52535-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-96216-v2-mkmlizer completed after 634.07s with status: succeeded
chaiml-mistral-24b-2048-66666-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-66666-v1/nvidia/flywheel_model.0.safetensors
Creating inference service chaiml-mistral-24b-2048-96216-v1
chaiml-mistral-24b-2048-2678-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-2678-v1/nvidia/flywheel_model.0.safetensors
Running pipeline stage MKMLTemplater
Pipeline stage MKMLizer completed in 644.24s
run pipeline stage %s
Job chaiml-mistral-24b-2048-52535-v1-mkmlizer completed after 663.02s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-96216-v2-mkmlizer
Job chaiml-mistral-24b-2048-66666-v1-mkmlizer completed after 626.04s with status: succeeded
Waiting for inference service chaiml-mistral-24b-2048-96216-v1 to be ready
Job chaiml-mistral-24b-2048-2678-v1-mkmlizer completed after 671.07s with status: succeeded
Pipeline stage MKMLTemplater completed in 6.89s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Stopping job with name chaiml-mistral-24b-2048-52535-v1-mkmlizer
Job chaiml-mistral-24b-2048-2678-v2-mkmlizer completed after 665.45s with status: succeeded
Pipeline stage MKMLizer completed in 649.38s
Stopping job with name chaiml-mistral-24b-2048-66666-v1-mkmlizer
Stopping job with name chaiml-mistral-24b-2048-2678-v1-mkmlizer
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 7.22s
Pipeline stage MKMLizer completed in 677.73s
Stopping job with name chaiml-mistral-24b-2048-2678-v2-mkmlizer
run pipeline stage %s
Pipeline stage MKMLizer completed in 643.76s
Pipeline stage MKMLizer completed in 686.00s
Running pipeline stage MKMLDeployer
Pipeline stage MKMLTemplater completed in 8.21s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLizer completed in 682.44s
run pipeline stage %s
run pipeline stage %s
Creating inference service chaiml-mistral-24b-2048-71780-v2
run pipeline stage %s
Running pipeline stage MKMLDeployer
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 6.30s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Running pipeline stage MKMLTemplater
Waiting for inference service chaiml-mistral-24b-2048-71780-v2 to be ready
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-96633-v1
Pipeline stage MKMLTemplater completed in 7.19s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 7.71s
Pipeline stage MKMLTemplater completed in 8.55s
Creating inference service chaiml-mistral-24b-2048-71780-v1
Waiting for inference service chaiml-mistral-24b-2048-96633-v1 to be ready
run pipeline stage %s
Running pipeline stage MKMLDeployer
Pipeline stage MKMLTemplater completed in 6.92s
run pipeline stage %s
run pipeline stage %s
Waiting for inference service chaiml-mistral-24b-2048-71780-v1 to be ready
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-96216-v2
run pipeline stage %s
Running pipeline stage MKMLDeployer
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-52535-v1
Waiting for inference service chaiml-mistral-24b-2048-96216-v2 to be ready
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-66666-v1
Creating inference service chaiml-mistral-24b-2048-2678-v1
Waiting for inference service chaiml-mistral-24b-2048-52535-v1 to be ready
Creating inference service chaiml-mistral-24b-2048-2678-v2
Waiting for inference service chaiml-mistral-24b-2048-66666-v1 to be ready
Waiting for inference service chaiml-mistral-24b-2048-2678-v1 to be ready
Waiting for inference service chaiml-mistral-24b-2048-2678-v2 to be ready
Inference service chaiml-mistral-24b-2048-52535-v2 ready after 152.26336407661438s
Pipeline stage MKMLDeployer completed in 162.09s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.03628396987915s
Received healthy response to inference request in 3.336229085922241s
Received healthy response to inference request in 3.3672871589660645s
Inference service chaiml-mistral-24b-2048-96216-v1 ready after 152.65193367004395s
Received healthy response to inference request in 3.0052168369293213s
Pipeline stage MKMLDeployer completed in 175.46s
run pipeline stage %s
Received healthy response to inference request in 3.5354526042938232s
Running pipeline stage StressChecker
5 requests
0 failed requests
Received healthy response to inference request in 3.5236759185791016s
5th percentile: 3.071419286727905
10th percentile: 3.1376217365264893
20th percentile: 3.2700266361236574
Inference service chaiml-mistral-24b-2048-71780-v2 ready after 142.11753106117249s
Received healthy response to inference request in 3.7552707195281982s
30th percentile: 3.342440700531006
Pipeline stage MKMLDeployer completed in 167.50s
40th percentile: 3.354863929748535
run pipeline stage %s
Received healthy response to inference request in 3.41819167137146s
50th percentile: 3.3672871589660645
Running pipeline stage StressChecker
60th percentile: 3.434553337097168
70th percentile: 3.5018195152282714
Received healthy response to inference request in 3.505601644515991s
Received healthy response to inference request in 3.4354257583618164s
80th percentile: 3.635618877410889
Inference service chaiml-mistral-24b-2048-96633-v1 ready after 152.19003009796143s
90th percentile: 3.8359514236450196
Pipeline stage MKMLDeployer completed in 175.72s
Received healthy response to inference request in 3.27248477935791s
Received healthy response to inference request in 3.4686777591705322s
95th percentile: 3.936117696762085
Inference service chaiml-mistral-24b-2048-71780-v1 ready after 152.36302614212036s
run pipeline stage %s
5 requests
99th percentile: 4.016250715255738
Pipeline stage MKMLDeployer completed in 178.84s
Received healthy response to inference request in 3.4373111724853516s
Inference service chaiml-mistral-24b-2048-96216-v2 ready after 152.1759693622589s
Running pipeline stage StressChecker
0 failed requests
mean time: 3.45609393119812
run pipeline stage %s
Inference service chaiml-mistral-24b-2048-52535-v1 ready after 152.1859929561615s
Inference service chaiml-mistral-24b-2048-66666-v1 ready after 152.30383348464966s
Pipeline stage MKMLDeployer completed in 174.27s
Inference service chaiml-mistral-24b-2048-2678-v1 ready after 152.3445930480957s
5th percentile: 3.3016261577606203
Inference service chaiml-mistral-24b-2048-2678-v2 ready after 152.30211877822876s
Received healthy response to inference request in 3.3889613151550293s
Pipeline stage StressChecker completed in 81.71s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7065470218658447s
Pipeline stage MKMLDeployer completed in 174.20s
Pipeline stage MKMLDeployer completed in 172.69s
run pipeline stage %s
Pipeline stage MKMLDeployer completed in 174.75s
10th percentile: 3.33076753616333
Pipeline stage MKMLDeployer completed in 172.49s
run pipeline stage %s
Received healthy response to inference request in 3.460601568222046s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.615509510040283s
run pipeline stage %s
Received healthy response to inference request in 3.8480870723724365s
20th percentile: 3.38905029296875
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
5 requests
Running pipeline stage StressChecker
Running pipeline stage StressChecker
Running pipeline stage StressChecker
30th percentile: 3.4356736660003664
Running pipeline stage StressChecker
Received healthy response to inference request in 3.174781084060669s
run_pipeline:run_in_cloud %s
0 failed requests
Received healthy response to inference request in 3.7993783950805664s
Received healthy response to inference request in 8.619179487228394s
40th percentile: 3.470637655258179
Received healthy response to inference request in 3.6766183376312256s
Received healthy response to inference request in 3.3513383865356445s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.9427876472473145s
5th percentile: 3.3982542037963865
Received healthy response to inference request in 3.4157023429870605s
Received healthy response to inference request in 3.602566957473755s
50th percentile: 3.505601644515991
Received healthy response to inference request in 4.101661443710327s
Received healthy response to inference request in 3.363020896911621s
triggered trigger_guanaco_pipeline args=%s
10th percentile: 3.4075470924377442
Received healthy response to inference request in 3.9832375049591064s
60th percentile: 3.5128313541412353
Received healthy response to inference request in 4.566603422164917s
Received healthy response to inference request in 3.538151979446411s
Received healthy response to inference request in 3.5084431171417236s
Received healthy response to inference request in 3.204493761062622s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 31.96s
Received healthy response to inference request in 3.5292441844940186s
Received healthy response to inference request in 3.671762704849243s
20th percentile: 3.426132869720459
70th percentile: 3.5200610637664793
Received healthy response to inference request in 3.702066421508789s
5 requests
run pipeline stage %s
Received healthy response to inference request in 3.481330394744873s
Received healthy response to inference request in 4.510058164596558s
Received healthy response to inference request in 3.6662821769714355s
30th percentile: 3.4358028411865233
80th percentile: 3.569994878768921
Received healthy response to inference request in 3.6940481662750244s
Received healthy response to inference request in 3.814279794692993s
0 failed requests
Running pipeline stage TriggerMKMLProfilingPipeline
Received healthy response to inference request in 3.8215856552124023s
40th percentile: 3.4365570068359377
90th percentile: 3.6626327991485597
5 requests
Received healthy response to inference request in 4.9721574783325195s
Received healthy response to inference request in 4.2694251537323s
Received healthy response to inference request in 3.5347840785980225s
5th percentile: 3.1807236194610597
run_pipeline:run_in_cloud %s
50th percentile: 3.4373111724853516
Received healthy response to inference request in 4.391667604446411s
95th percentile: 3.7089517593383787
Received healthy response to inference request in 3.7304792404174805s
0 failed requests
10th percentile: 3.18666615486145
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.7857820987701416s
Received healthy response to inference request in 3.8334801197052s
Received healthy response to inference request in 3.4985806941986084s
60th percentile: 3.4466273307800295
5 requests
99th percentile: 3.7460069274902343
5 requests
5th percentile: 3.5622049808502196
20th percentile: 3.1985512256622313
triggered trigger_guanaco_pipeline args=%s
5 requests
5 requests
5 requests
70th percentile: 3.455943489074707
0 failed requests
mean time: 3.4950449466705322
0 failed requests
10th percentile: 3.5951657772064207
30th percentile: 3.2841084003448486
Pipeline stage TriggerMKMLProfilingPipeline completed in 34.27s
0 failed requests
0 failed requests
0 failed requests
80th percentile: 3.4622168064117433
5th percentile: 3.4247692584991456
Pipeline stage StressChecker completed in 155.24s
5th percentile: 3.6817079544067384
20th percentile: 3.6610873699188233
40th percentile: 3.4433376789093018
Shutdown handler de-registered
5th percentile: 3.4926947116851808
5th percentile: 3.447766733169556
5th percentile: 3.43227801322937
90th percentile: 3.465447282791138
10th percentile: 3.48651762008667
run pipeline stage %s
10th percentile: 3.686797571182251
30th percentile: 3.715114212036133
50th percentile: 3.602566957473755
chaiml-mistral-24b-2048_52535_v2 status is now deployed due to DeploymentManager action
10th percentile: 3.5040590286254885
10th percentile: 3.5441950798034667
10th percentile: 3.44885368347168
95th percentile: 3.467062520980835
20th percentile: 3.6100143432617187
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
20th percentile: 3.6969768047332763
40th percentile: 3.7572463035583494
60th percentile: 3.607743978500366
20th percentile: 3.737051773071289
20th percentile: 3.5267876625061034
20th percentile: 3.4820050239562987
99th percentile: 3.4683547115325926
30th percentile: 3.700266122817993
run_pipeline:run_in_cloud %s
30th percentile: 3.7077489852905274
50th percentile: 3.7993783950805664
70th percentile: 3.6129209995269775
30th percentile: 3.92066912651062
30th percentile: 3.587678003311157
30th percentile: 3.5005531787872313
mean time: 3.438195514678955
40th percentile: 3.757272958755493
starting trigger_guanaco_pipeline args=%s
40th percentile: 3.7191141128540037
60th percentile: 3.8188618659973144
80th percentile: 3.6337170124053957
40th percentile: 4.09504714012146
40th percentile: 3.6867300510406493
40th percentile: 3.5044981479644775
Pipeline stage StressChecker completed in 175.36s
50th percentile: 3.814279794692993
triggered trigger_guanaco_pipeline args=%s
50th percentile: 3.7304792404174805
70th percentile: 3.8383453369140623
90th percentile: 3.67013201713562
50th percentile: 4.2694251537323
50th percentile: 3.7857820987701416
50th percentile: 3.5084431171417236
run pipeline stage %s
60th percentile: 4.04523491859436
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 33.02s
60th percentile: 3.766921806335449
80th percentile: 3.8988019466400146
95th percentile: 3.6883395195007322
60th percentile: 4.365678358078003
60th percentile: 3.8485843181610107
60th percentile: 3.5189795017242433
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
70th percentile: 4.2761900424957275
run pipeline stage %s
70th percentile: 3.803364372253418
90th percentile: 4.000231695175171
99th percentile: 3.702905521392822
70th percentile: 4.461931562423706
70th percentile: 3.9113865375518797
70th percentile: 3.5295158863067626
run_pipeline:run_in_cloud %s
80th percentile: 5.2371699810028085
Running pipeline stage TriggerMKMLProfilingPipeline
80th percentile: 3.8539160251617433
95th percentile: 4.050946569442749
mean time: 3.4607796669006348
80th percentile: 4.52136721611023
80th percentile: 4.1486616134643555
80th percentile: 3.561083698272705
starting trigger_guanaco_pipeline args=%s
90th percentile: 6.928174734115601
run_pipeline:run_in_cloud %s
90th percentile: 3.9185767650604246
99th percentile: 4.091518468856812
Pipeline stage StressChecker completed in 192.50s
90th percentile: 4.543985319137573
90th percentile: 4.5604095458984375
90th percentile: 3.6136829376220705
95th percentile: 7.773677110671996
triggered trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
95th percentile: 3.9509071350097655
mean time: 3.794483852386475
run pipeline stage %s
95th percentile: 4.555294370651245
95th percentile: 4.7662835121154785
95th percentile: 3.639982557296753
99th percentile: 8.450079011917115
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 33.45s
triggered trigger_guanaco_pipeline args=%s
99th percentile: 3.9767714309692384
Pipeline stage StressChecker completed in 199.58s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
99th percentile: 4.564341611862183
99th percentile: 4.930982685089111
99th percentile: 3.661022253036499
mean time: 4.771982097625733
run pipeline stage %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 33.88s
mean time: 3.782797431945801
run pipeline stage %s
run_pipeline:run_in_cloud %s
mean time: 4.106181049346924
mean time: 3.944041919708252
mean time: 3.52475848197937
%s, retrying in %s seconds...
Running pipeline stage TriggerMKMLProfilingPipeline
Shutdown handler de-registered
Pipeline stage StressChecker completed in 194.52s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
starting trigger_guanaco_pipeline args=%s
%s, retrying in %s seconds...
Pipeline stage StressChecker completed in 194.98s
Pipeline stage StressChecker completed in 193.30s
run_pipeline:run_in_cloud %s
chaiml-mistral-24b-2048_96216_v1 status is now deployed due to DeploymentManager action
run pipeline stage %s
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 4.488383769989014s
triggered trigger_guanaco_pipeline args=%s
run pipeline stage %s
run pipeline stage %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.703603744506836s
starting trigger_guanaco_pipeline args=%s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 33.87s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Received healthy response to inference request in 3.301547050476074s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
triggered trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
run_pipeline:run_in_cloud %s
run pipeline stage %s
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.752267599105835s
run_pipeline:run_in_cloud %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 28.16s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 27.94s
Received healthy response to inference request in 4.437968730926514s
starting trigger_guanaco_pipeline args=%s
Running pipeline stage TriggerMKMLProfilingPipeline
starting trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
Shutdown handler de-registered
run pipeline stage %s
Received healthy response to inference request in 3.270700693130493s
triggered trigger_guanaco_pipeline args=%s
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.1437628269195557s
triggered trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
chaiml-mistral-24b-2048_71780_v2 status is now deployed due to DeploymentManager action
Running pipeline stage TriggerMKMLProfilingPipeline
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 29.33s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.446263074874878s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 30.47s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 29.85s
Received healthy response to inference request in 3.6894516944885254s
run_pipeline:run_in_cloud %s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
run pipeline stage %s
run pipeline stage %s
5 requests
starting trigger_guanaco_pipeline args=%s
Running pipeline stage TriggerMKMLProfilingPipeline
Received healthy response to inference request in 3.836765766143799s
Pipeline stage TriggerMKMLProfilingPipeline completed in 26.76s
Running pipeline stage TriggerMKMLProfilingPipeline
Running pipeline stage TriggerMKMLProfilingPipeline
0 failed requests
triggered trigger_guanaco_pipeline args=%s
run_pipeline:run_in_cloud %s
5 requests
Shutdown handler de-registered
run_pipeline:run_in_cloud %s
run_pipeline:run_in_cloud %s
5th percentile: 3.1753196716308594
Pipeline stage TriggerMKMLProfilingPipeline completed in 24.95s
starting trigger_guanaco_pipeline args=%s
0 failed requests
chaiml-mistral-24b-2048_96633_v1 status is now deployed due to DeploymentManager action
starting trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
10th percentile: 3.206876516342163
Shutdown handler de-registered
5th percentile: 3.30581316947937
triggered trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
20th percentile: 3.2699902057647705
chaiml-mistral-24b-2048_71780_v1 status is now deployed due to DeploymentManager action
10th percentile: 3.3409256458282472
Pipeline stage TriggerMKMLProfilingPipeline completed in 23.63s
Pipeline stage TriggerMKMLProfilingPipeline completed in 21.90s
Pipeline stage TriggerMKMLProfilingPipeline completed in 22.59s
30th percentile: 3.3791279792785645
20th percentile: 3.411150598526001
Shutdown handler de-registered
Shutdown handler de-registered
Shutdown handler de-registered
30th percentile: 3.4977312088012695
chaiml-mistral-24b-2048_52535_v1 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048-_2678_v1 status is now deployed due to DeploymentManager action
40th percentile: 3.534289836883545
30th percentile: 3.4977312088012695
chaiml-mistral-24b-2048_52535_v1 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048-_2678_v1 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048-_2678_v2 status is now inactive due to auto deactivation removed underperforming models