chaiml-mistral-24b-2048_96216

developer_uid: rirv938
submission_id: chaiml-mistral-24b-2048_96216_v5
model_name: chaiml-mistral-24b-2048_96216_v5
model_group: ChaiML/mistral_24b_2048_
status: torndown
timestamp: 2026-02-16T01:02:03+00:00
num_battles: 10695
num_wins: 5737
celo_rating: 1325.49
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_merged
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 96
reward_model: default
display_name: chaiml-mistral-24b-2048_96216_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-12
win_ratio: 0.5364188873305283
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '<|im_start|>', '###', 'You:', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 96}
formatter: {'memory_template': '[SYSTEM_PROMPT]Respond as a high quality storyteller.[/SYSTEM_PROMPT][INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}
Resubmit model
chaiml-mistral-24b-2048-62542-v3-mkmlizer: bash: no job control in this shell
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-62542-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
run pipeline %s
chaiml-mistral-24b-2048-62542-v3-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
run pipeline stage %s
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║                                                                     ║
Starting job with name chaiml-mistral-24b-2048-96216-v5-mkmlizer
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
Waiting for job on chaiml-mistral-24b-2048-96216-v5-mkmlizer to finish
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-3092-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║                                                                     ║
run pipeline %s
chaiml-mistral-24b-2048-3092-v3-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
run pipeline stage %s
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
Starting job with name chaiml-mistral-24b-2048-54327-v7-mkmlizer
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║                                                                     ║
Waiting for job on chaiml-mistral-24b-2048-54327-v7-mkmlizer to finish
chaiml-mistral-24b-2048-15988-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-62542-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-3092-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-15988-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-96216-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v7-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-3092-v3-mkmlizer: Downloaded to shared memory in 90.134s
chaiml-mistral-24b-2048-3092-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_latest_merged already exists in ChaiML
chaiml-mistral-24b-2048-3092-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpa40cw8ua, device:0
chaiml-mistral-24b-2048-3092-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-15988-v2-mkmlizer: Downloaded to shared memory in 88.531s
chaiml-mistral-24b-2048-15988-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_bo2_merged already exists in ChaiML
chaiml-mistral-24b-2048-15988-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpnvd_jcvs, device:0
chaiml-mistral-24b-2048-15988-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96216-v5-mkmlizer: Downloaded to shared memory in 88.434s
chaiml-mistral-24b-2048-96216-v5-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_merged already exists in ChaiML
chaiml-mistral-24b-2048-96216-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmped94ofph, device:0
chaiml-mistral-24b-2048-96216-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-54327-v7-mkmlizer: Downloaded to shared memory in 87.924s
chaiml-mistral-24b-2048-54327-v7-mkmlizer: Checking if ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged already exists in ChaiML
chaiml-mistral-24b-2048-54327-v7-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpzmjll7co, device:0
chaiml-mistral-24b-2048-54327-v7-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-62542-v3-mkmlizer: Downloaded to shared memory in 120.952s
chaiml-mistral-24b-2048-62542-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_instruct_merged already exists in ChaiML
chaiml-mistral-24b-2048-62542-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpe3niqet0, device:0
chaiml-mistral-24b-2048-62542-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-3092-v3-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:35, 1.10s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:35, 1.10s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:36, 1.44s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:36, 1.44s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.09it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.09it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:55, 1.49it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:55, 1.49it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:03, 1.15it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:03, 1.15it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:17, 1.08s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:17, 1.08s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:40, 1.22it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:40, 1.22it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:57, 1.86it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:57, 1.86it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:45, 1.45it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:45, 1.45it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:42, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:27<04:42, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:06, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:06, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.07it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:31, 2.07it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:37, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:37, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.07it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:49, 1.26it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:49, 1.26it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:36, 1.04it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.28it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:08<01:56, 2.28it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 2.00it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:11, 2.00it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:49, 1.54it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:35, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:14<03:35, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:20, 1.28it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:18<04:02, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:20<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:33, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.27s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.99it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:01, 1.99it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.76it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:34, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:28, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:28, 1.16s/it]
Loading 0:  38%|███▊      | 139/363 [01:40<01:48, 2.07it/s]
Loading 0:  38%|███▊      | 139/363 [01:40<01:48, 2.07it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:02, 1.81it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.42it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:34, 1.42it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:13, 1.13it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:51, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:26, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:06, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:06, 1.15s/it]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  43%|████▎     | 157/363 [01:53<01:39, 2.07it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:52, 1.81it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:22, 1.42it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:22, 1.42it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:57, 1.13it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:37, 1.26it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:09, 1.04it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:44, 1.15s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.07it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:42, 1.81it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:09, 1.42it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:09, 1.42it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:51, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:23, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:23, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:21, 2.08it/s]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:21, 2.08it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:31, 1.82it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.43it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:56, 1.43it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.14it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:25, 1.14it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:08, 1.26it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.05it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:34, 1.05it/s]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:02, 1.14s/it]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:02, 1.14s/it]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:13, 2.07it/s]
Loading 0:  58%|█████▊    | 211/363 [02:33<01:13, 2.07it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:22, 1.82it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:22, 1.82it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:43, 1.43it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.14it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:09, 1.14it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:16, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:16, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:45<02:42, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:45<02:42, 1.14s/it]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:04, 2.09it/s]
Loading 0:  63%|██████▎   | 229/363 [02:46<01:04, 2.09it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.83it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:30, 1.43it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:53, 1.14it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:39, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.08it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:55, 2.08it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 250/363 [03:01<01:02, 1.82it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 251/363 [03:03<01:18, 1.43it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  69%|██████▉   | 252/363 [03:05<01:37, 1.14it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  70%|███████   | 255/363 [03:07<01:25, 1.27it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:11<02:01, 1.15s/it]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.08it/s]
Loading 0:  73%|███████▎  | 265/363 [03:12<00:47, 2.08it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:14<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 269/363 [03:16<01:05, 1.43it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.13it/s]
Loading 0:  74%|███████▍  | 270/363 [03:18<01:21, 1.13it/s]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:37, 2.42s/it]
Loading 0:  75%|███████▌  | 273/363 [03:33<03:37, 2.42s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.34s/it]
Loading 0:  75%|███████▌  | 274/363 [03:35<03:28, 2.34s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.29s/it]
Loading 0:  76%|███████▌  | 275/363 [03:37<03:21, 2.29s/it]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.16it/s]
Loading 0:  78%|███████▊  | 283/363 [03:39<01:08, 1.16it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 286/363 [03:41<01:03, 1.21it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.06it/s]
Loading 0:  79%|███████▉  | 287/363 [03:43<01:12, 1.06it/s]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:22, 1.10s/it]
Loading 0:  79%|███████▉  | 288/363 [03:45<01:22, 1.10s/it]
Loading 0:  80%|████████  | 291/363 [03:47<01:06, 1.08it/s]
Loading 0:  80%|████████  | 291/363 [03:47<01:06, 1.08it/s]
Loading 0:  80%|████████  | 292/363 [03:49<01:16, 1.07s/it]
Loading 0:  80%|████████  | 292/363 [03:49<01:16, 1.07s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:27, 1.24s/it]
Loading 0:  81%|████████  | 293/363 [03:51<01:27, 1.24s/it]
Loading 0:  83%|████████▎ | 301/363 [03:52<00:31, 1.97it/s]
Loading 0:  83%|████████▎ | 301/363 [03:52<00:31, 1.97it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.76it/s]
Loading 0:  84%|████████▎ | 304/363 [03:54<00:33, 1.76it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 305/363 [03:56<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:51, 1.11it/s]
Loading 0:  84%|████████▍ | 306/363 [03:58<00:51, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.24it/s]
Loading 0:  85%|████████▌ | 309/363 [04:00<00:43, 1.24it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.03it/s]
Loading 0:  85%|████████▌ | 310/363 [04:02<00:51, 1.03it/s]
Loading 0:  86%|████████▌ | 311/363 [04:04<01:00, 1.16s/it]
Loading 0:  86%|████████▌ | 311/363 [04:04<01:00, 1.16s/it]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.07it/s]
Loading 0:  88%|████████▊ | 319/363 [04:05<00:21, 2.07it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.82it/s]
Loading 0:  89%|████████▊ | 322/363 [04:07<00:22, 1.82it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:28, 1.42it/s]
Loading 0:  89%|████████▉ | 323/363 [04:09<00:28, 1.42it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.13it/s]
Loading 0:  89%|████████▉ | 324/363 [04:11<00:34, 1.13it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0:  91%|█████████ | 329/363 [04:17<00:39, 1.15s/it]
Loading 0:  91%|█████████ | 329/363 [04:17<00:39, 1.15s/it]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.08it/s]
Loading 0:  93%|█████████▎| 337/363 [04:18<00:12, 2.08it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.82it/s]
Loading 0:  94%|█████████▎| 340/363 [04:20<00:12, 1.82it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.13it/s]
Loading 0:  94%|█████████▍| 342/363 [04:24<00:18, 1.13it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 345/363 [04:26<00:14, 1.26it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0:  98%|█████████▊| 355/363 [04:31<00:03, 2.08it/s]
Loading 0:  98%|█████████▊| 355/363 [04:31<00:03, 2.08it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.87it/s]
Loading 0:  99%|█████████▉| 359/363 [04:34<00:02, 1.87it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.48it/s]
Loading 0:  99%|█████████▉| 360/363 [04:36<00:02, 1.48it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.17it/s]
Loading 0:  99%|█████████▉| 361/363 [04:38<00:01, 1.17it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.17it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.30it/s]
chaiml-mistral-24b-2048-3092-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmpa40cw8ua' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-3092-v3-mkmlizer: quantized model in 285.235s
chaiml-mistral-24b-2048-3092-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_latest_merged in 375.370s
chaiml-mistral-24b-2048-3092-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-3092-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-3092-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-3092-v3/nvidia
chaiml-mistral-24b-2048-3092-v3-mkmlizer: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-mkml-models/chaiml-mistral-24b-2048-3092-v3/nvidia/chat_template.jinja
chaiml-mistral-24b-2048-3092-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-3092-v3/nvidia/config.json
chaiml-mistral-24b-2048-3092-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-3092-v3/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-3092-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-3092-v3/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-54327-v7-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:57, 1.51it/s]
Loading 0:   1%|          | 3.00/363 [00:01<03:57, 1.51it/s]
Loading 0:   1%|          | 4.00/363 [00:03<06:23, 1.07s/it]
Loading 0:   1%|          | 4.00/363 [00:03<06:23, 1.07s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:36, 1.44s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<08:36, 1.44s/it]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.08it/s]
Loading 0:   3%|▎         | 12.0/363 [00:07<02:48, 2.08it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:56, 1.48it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<03:56, 1.48it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:05, 1.14it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:05, 1.14it/s]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:19, 1.09s/it]
Loading 0:   4%|▍         | 15.0/363 [00:13<06:19, 1.09s/it]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:41, 1.21it/s]
Loading 0:   6%|▌         | 22.0/363 [00:17<04:41, 1.21it/s]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:43, 1.01s/it]
Loading 0:   6%|▋         | 23.0/363 [00:19<05:43, 1.01s/it]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0:   9%|▊         | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:   9%|▉         | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  10%|▉         | 36.0/363 [00:26<04:42, 1.16it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█         | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:06, 1.14s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:32<06:06, 1.14s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.08it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:34<02:30, 2.08it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:36<02:51, 1.81it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:37, 1.42it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:38<03:37, 1.42it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:03, 1.26it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:42<04:03, 1.26it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 75.0/363 [00:55<03:50, 1.25it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.03it/s]
Loading 0:  21%|██        | 76.0/363 [00:57<04:37, 1.03it/s]
Loading 0:  21%|██        | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0:  21%|██        | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.31it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:07<01:54, 2.31it/s]
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.01it/s] 
Loading 0:  28%|██▊       | 101/363 [01:10<02:10, 2.01it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 102/363 [01:11<02:48, 1.55it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:35, 1.21it/s]
Loading 0:  28%|██▊       | 103/363 [01:13<03:35, 1.21it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 106/363 [01:16<03:19, 1.29it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  29%|██▉       | 107/363 [01:17<04:01, 1.06it/s]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  30%|██▉       | 108/363 [01:19<04:48, 1.13s/it]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 111/363 [01:21<03:52, 1.08it/s]
Loading 0:  31%|███       | 112/363 [01:23<04:34, 1.09s/it]
Loading 0:  31%|███       | 112/363 [01:23<04:34, 1.09s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.28s/it]
Loading 0:  31%|███       | 113/363 [01:25<05:18, 1.28s/it]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.00it/s]
Loading 0:  33%|███▎      | 121/363 [01:27<02:00, 2.00it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 124/363 [01:29<02:15, 1.77it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  34%|███▍      | 125/363 [01:31<02:51, 1.39it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:33, 1.11it/s]
Loading 0:  35%|███▍      | 126/363 [01:33<03:33, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 129/363 [01:35<03:08, 1.24it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 130/363 [01:37<03:46, 1.03it/s]
Loading 0:  36%|███▌      | 131/363 [01:39<04:29, 1.16s/it]
Loading 0:  36%|███▌      | 131/363 [01:39<04:29, 1.16s/it]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  38%|███▊      | 138/363 [01:40<01:54, 1.96it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 142/363 [01:42<02:00, 1.83it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.44it/s]
Loading 0:  39%|███▉      | 143/363 [01:44<02:33, 1.44it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:11, 1.14it/s]
Loading 0:  40%|███▉      | 144/363 [01:46<03:11, 1.14it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:50, 1.26it/s]
Loading 0:  40%|████      | 147/363 [01:48<02:50, 1.26it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:25, 1.04it/s]
Loading 0:  41%|████      | 148/363 [01:50<03:25, 1.04it/s]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  41%|████      | 149/363 [01:52<04:05, 1.15s/it]
Loading 0:  43%|████▎     | 156/363 [01:53<01:45, 1.97it/s]
Loading 0:  43%|████▎     | 156/363 [01:53<01:45, 1.97it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:50, 1.84it/s]
Loading 0:  44%|████▍     | 160/363 [01:55<01:50, 1.84it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:20, 1.44it/s]
Loading 0:  44%|████▍     | 161/363 [01:57<02:20, 1.44it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:55, 1.15it/s]
Loading 0:  45%|████▍     | 162/363 [01:59<02:55, 1.15it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  45%|████▌     | 165/363 [02:01<02:36, 1.27it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.05it/s]
Loading 0:  46%|████▌     | 166/363 [02:03<03:08, 1.05it/s]
Loading 0:  46%|████▌     | 167/363 [02:05<03:43, 1.14s/it]
Loading 0:  46%|████▌     | 167/363 [02:05<03:43, 1.14s/it]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.08it/s]
Loading 0:  48%|████▊     | 175/363 [02:06<01:30, 2.08it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 178/363 [02:09<01:41, 1.82it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:08, 1.43it/s]
Loading 0:  49%|████▉     | 179/363 [02:11<02:08, 1.43it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:41, 1.13it/s]
Loading 0:  50%|████▉     | 180/363 [02:13<02:41, 1.13it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  50%|█████     | 183/363 [02:14<02:22, 1.26it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:52, 1.04it/s]
Loading 0:  51%|█████     | 184/363 [02:16<02:52, 1.04it/s]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  51%|█████     | 185/363 [02:18<03:24, 1.15s/it]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.06it/s]
Loading 0:  53%|█████▎    | 193/363 [02:20<01:22, 2.06it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:33, 1.79it/s]
Loading 0:  54%|█████▍    | 196/363 [02:22<01:33, 1.79it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:57, 1.41it/s]
Loading 0:  54%|█████▍    | 197/363 [02:24<01:57, 1.41it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:26, 1.12it/s]
Loading 0:  55%|█████▍    | 198/363 [02:26<02:26, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:09, 1.25it/s]
Loading 0:  55%|█████▌    | 201/363 [02:28<02:09, 1.25it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:35, 1.04it/s]
Loading 0:  56%|█████▌    | 202/363 [02:30<02:35, 1.04it/s]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:04, 1.15s/it]
Loading 0:  56%|█████▌    | 203/363 [02:32<03:04, 1.15s/it]
Loading 0:  58%|█████▊    | 210/363 [02:33<01:17, 1.97it/s]
Loading 0:  58%|█████▊    | 210/363 [02:33<01:17, 1.97it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.84it/s]
Loading 0:  59%|█████▉    | 214/363 [02:35<01:21, 1.84it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:42, 1.44it/s]
Loading 0:  59%|█████▉    | 215/363 [02:37<01:42, 1.44it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:08, 1.15it/s]
Loading 0:  60%|█████▉    | 216/363 [02:39<02:08, 1.15it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.27it/s]
Loading 0:  60%|██████    | 219/363 [02:41<01:53, 1.27it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:16, 1.05it/s]
Loading 0:  61%|██████    | 220/363 [02:43<02:16, 1.05it/s]
Loading 0:  61%|██████    | 221/363 [02:45<02:41, 1.14s/it]
Loading 0:  61%|██████    | 221/363 [02:45<02:41, 1.14s/it]
Loading 0:  63%|██████▎   | 228/363 [02:46<01:08, 1.98it/s]
Loading 0:  63%|██████▎   | 228/363 [02:46<01:08, 1.98it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 232/363 [02:48<01:11, 1.84it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 233/363 [02:50<01:29, 1.45it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:52, 1.15it/s]
Loading 0:  64%|██████▍   | 234/363 [02:52<01:52, 1.15it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:38, 1.27it/s]
Loading 0:  65%|██████▌   | 237/363 [02:54<01:38, 1.27it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 238/363 [02:56<01:59, 1.05it/s]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  66%|██████▌   | 239/363 [02:58<02:21, 1.14s/it]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:56, 2.07it/s]
Loading 0:  68%|██████▊   | 247/363 [02:59<00:56, 2.07it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 250/363 [03:02<01:02, 1.81it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.42it/s]
Loading 0:  69%|██████▉   | 251/363 [03:04<01:18, 1.42it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:37, 1.13it/s]
Loading 0:  69%|██████▉   | 252/363 [03:06<01:37, 1.13it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:25, 1.26it/s]
Loading 0:  70%|███████   | 255/363 [03:08<01:25, 1.26it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 256/363 [03:09<01:42, 1.04it/s]
Loading 0:  71%|███████   | 257/363 [03:11<02:02, 1.15s/it]
Loading 0:  71%|███████   | 257/363 [03:11<02:02, 1.15s/it]
Loading 0:  73%|███████▎  | 264/363 [03:12<00:50, 1.97it/s]
Loading 0:  73%|███████▎  | 264/363 [03:12<00:50, 1.97it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 268/363 [03:15<00:52, 1.82it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 269/363 [03:17<01:05, 1.44it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  74%|███████▍  | 270/363 [03:19<01:21, 1.14it/s]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:39, 2.43s/it]
Loading 0:  75%|███████▌  | 273/363 [03:34<03:39, 2.43s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:30, 2.36s/it]
Loading 0:  75%|███████▌  | 274/363 [03:36<03:30, 2.36s/it]
Loading 0:  76%|███████▌  | 275/363 [03:39<03:26, 2.35s/it]
Loading 0:  76%|███████▌  | 275/363 [03:39<03:26, 2.35s/it]
Loading 0:  78%|███████▊  | 283/363 [03:40<01:10, 1.14it/s]
Loading 0:  78%|███████▊  | 283/363 [03:40<01:10, 1.14it/s]
Loading 0:  79%|███████▉  | 286/363 [03:42<01:04, 1.19it/s]
Loading 0:  79%|███████▉  | 286/363 [03:42<01:04, 1.19it/s]
Loading 0:  79%|███████▉  | 287/363 [03:44<01:13, 1.04it/s]
Loading 0:  79%|███████▉  | 287/363 [03:44<01:13, 1.04it/s]
Loading 0:  79%|███████▉  | 288/363 [03:46<01:23, 1.11s/it]
Loading 0:  79%|███████▉  | 288/363 [03:46<01:23, 1.11s/it]
Loading 0:  80%|████████  | 291/363 [03:48<01:06, 1.08it/s]
Loading 0:  80%|████████  | 291/363 [03:48<01:06, 1.08it/s]
Loading 0:  80%|████████  | 292/363 [03:50<01:16, 1.08s/it]
Loading 0:  80%|████████  | 292/363 [03:50<01:16, 1.08s/it]
Loading 0:  81%|████████  | 293/363 [03:52<01:27, 1.25s/it]
Loading 0:  81%|████████  | 293/363 [03:52<01:27, 1.25s/it]
Loading 0:  83%|████████▎ | 301/363 [03:53<00:31, 1.95it/s]
Loading 0:  83%|████████▎ | 301/363 [03:53<00:31, 1.95it/s]
Loading 0:  84%|████████▎ | 304/363 [03:55<00:33, 1.77it/s]
Loading 0:  84%|████████▎ | 304/363 [03:55<00:33, 1.77it/s]
Loading 0:  84%|████████▍ | 305/363 [03:57<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 305/363 [03:57<00:41, 1.39it/s]
Loading 0:  84%|████████▍ | 306/363 [03:59<00:51, 1.11it/s]
Loading 0:  84%|████████▍ | 306/363 [03:59<00:51, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:01<00:43, 1.23it/s]
Loading 0:  85%|████████▌ | 309/363 [04:01<00:43, 1.23it/s]
Loading 0:  85%|████████▌ | 310/363 [04:03<00:52, 1.02it/s]
Loading 0:  85%|████████▌ | 310/363 [04:03<00:52, 1.02it/s]
Loading 0:  86%|████████▌ | 311/363 [04:05<01:00, 1.17s/it]
Loading 0:  86%|████████▌ | 311/363 [04:05<01:00, 1.17s/it]
Loading 0:  88%|████████▊ | 319/363 [04:06<00:21, 2.06it/s]
Loading 0:  88%|████████▊ | 319/363 [04:06<00:21, 2.06it/s]
Loading 0:  89%|████████▊ | 322/363 [04:08<00:22, 1.79it/s]
Loading 0:  89%|████████▊ | 322/363 [04:08<00:22, 1.79it/s]
Loading 0:  89%|████████▉ | 323/363 [04:10<00:28, 1.40it/s]
Loading 0:  89%|████████▉ | 323/363 [04:10<00:28, 1.40it/s]
Loading 0:  89%|████████▉ | 324/363 [04:12<00:35, 1.11it/s]
Loading 0:  89%|████████▉ | 324/363 [04:12<00:35, 1.11it/s]
Loading 0:  90%|█████████ | 327/363 [04:14<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 327/363 [04:14<00:29, 1.24it/s]
Loading 0:  90%|█████████ | 328/363 [04:16<00:34, 1.02it/s]
Loading 0:  90%|█████████ | 328/363 [04:16<00:34, 1.02it/s]
Loading 0:  91%|█████████ | 329/363 [04:18<00:39, 1.17s/it]
Loading 0:  91%|█████████ | 329/363 [04:18<00:39, 1.17s/it]
Loading 0:  93%|█████████▎| 337/363 [04:20<00:12, 2.07it/s]
Loading 0:  93%|█████████▎| 337/363 [04:20<00:12, 2.07it/s]
Loading 0:  94%|█████████▎| 340/363 [04:22<00:12, 1.80it/s]
Loading 0:  94%|█████████▎| 340/363 [04:22<00:12, 1.80it/s]
Loading 0:  94%|█████████▍| 341/363 [04:24<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 341/363 [04:24<00:15, 1.41it/s]
Loading 0:  94%|█████████▍| 342/363 [04:26<00:18, 1.11it/s]
Loading 0:  94%|█████████▍| 342/363 [04:26<00:18, 1.11it/s]
Loading 0:  95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0:  95%|█████████▌| 346/363 [04:30<00:16, 1.02it/s]
Loading 0:  95%|█████████▌| 346/363 [04:30<00:16, 1.02it/s]
Loading 0:  96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0:  96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0:  98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0:  98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0:  99%|█████████▉| 359/363 [04:36<00:02, 1.85it/s]
Loading 0:  99%|█████████▉| 359/363 [04:36<00:02, 1.85it/s]
Loading 0:  99%|█████████▉| 360/363 [04:38<00:02, 1.45it/s]
Loading 0:  99%|█████████▉| 360/363 [04:38<00:02, 1.45it/s]
Loading 0:  99%|█████████▉| 361/363 [04:40<00:01, 1.15it/s]
Loading 0:  99%|█████████▉| 361/363 [04:40<00:01, 1.15it/s]
Loading 0: 100%|██████████| 363/363 [04:40<00:00, 1.15it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:40<00:00, 1.30it/s]
chaiml-mistral-24b-2048-54327-v7-mkmlizer: The tokenizer you are loading from '/tmp/tmpzmjll7co' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-54327-v7-mkmlizer: quantized model in 286.741s
chaiml-mistral-24b-2048-54327-v7-mkmlizer: Processed model ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged in 374.666s
chaiml-mistral-24b-2048-54327-v7-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-54327-v7-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-54327-v7-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v7/nvidia
chaiml-mistral-24b-2048-54327-v7-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v7/nvidia/config.json
chaiml-mistral-24b-2048-54327-v7-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v7/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-54327-v7-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v7/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-15988-v2-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:08, 1.45it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:08, 1.45it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:06, 1.53s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:06, 1.53s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:09, 1.86it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:09, 1.86it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<04:00, 1.45it/s]
Loading 0:   4%|▎         | 13.0/363 [00:09<04:00, 1.45it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:13, 1.11it/s]
Loading 0:   4%|▍         | 14.0/363 [00:11<05:13, 1.11it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:30, 1.12s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:30, 1.12s/it]
Loading 0:   6%|▌         | 21.0/363 [00:16<03:57, 1.44it/s]
Loading 0:   6%|▌         | 21.0/363 [00:16<03:57, 1.44it/s]
Loading 0:   6%|▌         | 22.0/363 [00:18<04:54, 1.16it/s]
Loading 0:   6%|▌         | 22.0/363 [00:18<04:54, 1.16it/s]
Loading 0:   6%|▋         | 23.0/363 [00:20<06:00, 1.06s/it]
Loading 0:   6%|▋         | 23.0/363 [00:20<06:00, 1.06s/it]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:40, 2.06it/s]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:40, 2.06it/s]
Loading 0:   9%|▉         | 34.0/363 [00:24<03:04, 1.78it/s]
Loading 0:   9%|▉         | 34.0/363 [00:24<03:04, 1.78it/s]
Loading 0:  10%|▉         | 35.0/363 [00:26<03:56, 1.39it/s]
Loading 0:  10%|▉         | 35.0/363 [00:26<03:56, 1.39it/s]
Loading 0:  10%|▉         | 36.0/363 [00:28<04:58, 1.10it/s]
Loading 0:  10%|▉         | 36.0/363 [00:28<04:58, 1.10it/s]
Loading 0:  11%|█         | 39.0/363 [00:30<04:28, 1.21it/s]
Loading 0:  11%|█         | 39.0/363 [00:30<04:28, 1.21it/s]
Loading 0:  11%|█         | 40.0/363 [00:32<05:25, 1.01s/it]
Loading 0:  11%|█         | 40.0/363 [00:32<05:25, 1.01s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:34<06:28, 1.21s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:34<06:28, 1.21s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:35<02:48, 1.87it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:35<02:48, 1.87it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:38<02:58, 1.74it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:38<02:58, 1.74it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:40<03:46, 1.37it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:40<03:46, 1.37it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:42<04:45, 1.08it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:42<04:45, 1.08it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:44<04:15, 1.20it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:44<04:15, 1.20it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:46<05:09, 1.01s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:46<05:09, 1.01s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:48<06:08, 1.21s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:48<06:08, 1.21s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:49<02:38, 1.87it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:49<02:38, 1.87it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:52<02:48, 1.74it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:52<02:48, 1.74it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:54<03:34, 1.36it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:54<03:34, 1.36it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:56<04:28, 1.08it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:56<04:28, 1.08it/s]
Loading 0:  21%|██        | 75.0/363 [00:58<04:00, 1.20it/s]
Loading 0:  21%|██        | 75.0/363 [00:58<04:00, 1.20it/s]
Loading 0:  21%|██        | 76.0/363 [01:00<04:50, 1.01s/it]
Loading 0:  21%|██        | 76.0/363 [01:00<04:50, 1.01s/it]
Loading 0:  21%|██        | 77.0/363 [01:02<05:50, 1.23s/it]
Loading 0:  21%|██        | 77.0/363 [01:02<05:50, 1.23s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:04<02:22, 1.96it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:04<02:22, 1.96it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:06<02:40, 1.72it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:06<02:40, 1.72it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:08<03:23, 1.34it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:08<03:23, 1.34it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:10<04:15, 1.07it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:10<04:15, 1.07it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:11<02:08, 2.08it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:11<02:08, 2.08it/s]
Loading 0:  28%|██▊       | 101/363 [01:14<02:17, 1.91it/s] 
Loading 0:  28%|██▊       | 101/363 [01:14<02:17, 1.91it/s]
Loading 0:  28%|██▊       | 102/363 [01:16<02:57, 1.47it/s]
Loading 0:  28%|██▊       | 102/363 [01:16<02:57, 1.47it/s]
Loading 0:  28%|██▊       | 103/363 [01:18<03:45, 1.15it/s]
Loading 0:  28%|██▊       | 103/363 [01:18<03:45, 1.15it/s]
Loading 0:  29%|██▉       | 106/363 [01:20<03:30, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:20<03:30, 1.22it/s]
Loading 0:  29%|██▉       | 107/363 [01:22<04:14, 1.00it/s]
Loading 0:  29%|██▉       | 107/363 [01:22<04:14, 1.00it/s]
Loading 0:  30%|██▉       | 108/363 [01:24<05:04, 1.19s/it]
Loading 0:  30%|██▉       | 108/363 [01:24<05:04, 1.19s/it]
Loading 0:  31%|███       | 111/363 [01:26<04:06, 1.02it/s]
Loading 0:  31%|███       | 111/363 [01:26<04:06, 1.02it/s]
Loading 0:  31%|███       | 112/363 [01:28<04:50, 1.16s/it]
Loading 0:  31%|███       | 112/363 [01:28<04:50, 1.16s/it]
Loading 0:  31%|███       | 113/363 [01:31<05:37, 1.35s/it]
Loading 0:  31%|███       | 113/363 [01:31<05:37, 1.35s/it]
Loading 0:  33%|███▎      | 121/363 [01:32<02:06, 1.92it/s]
Loading 0:  33%|███▎      | 121/363 [01:32<02:06, 1.92it/s]
Loading 0:  34%|███▍      | 124/363 [01:34<02:21, 1.69it/s]
Loading 0:  34%|███▍      | 124/363 [01:34<02:21, 1.69it/s]
Loading 0:  34%|███▍      | 125/363 [01:36<02:59, 1.32it/s]
Loading 0:  34%|███▍      | 125/363 [01:36<02:59, 1.32it/s]
Loading 0:  35%|███▍      | 126/363 [01:38<03:44, 1.05it/s]
Loading 0:  35%|███▍      | 126/363 [01:38<03:44, 1.05it/s]
Loading 0:  36%|███▌      | 129/363 [01:40<03:18, 1.18it/s]
Loading 0:  36%|███▌      | 129/363 [01:40<03:18, 1.18it/s]
Loading 0:  36%|███▌      | 130/363 [01:42<03:59, 1.03s/it]
Loading 0:  36%|███▌      | 130/363 [01:42<03:59, 1.03s/it]
Loading 0:  36%|███▌      | 131/363 [01:44<04:44, 1.23s/it]
Loading 0:  36%|███▌      | 131/363 [01:44<04:44, 1.23s/it]
Loading 0:  38%|███▊      | 138/363 [01:45<02:00, 1.87it/s]
Loading 0:  38%|███▊      | 138/363 [01:45<02:00, 1.87it/s]
Loading 0:  39%|███▉      | 142/363 [01:48<02:06, 1.74it/s]
Loading 0:  39%|███▉      | 142/363 [01:48<02:06, 1.74it/s]
Loading 0:  39%|███▉      | 143/363 [01:50<02:41, 1.36it/s]
Loading 0:  39%|███▉      | 143/363 [01:50<02:41, 1.36it/s]
Loading 0:  40%|███▉      | 144/363 [01:52<03:22, 1.08it/s]
Loading 0:  40%|███▉      | 144/363 [01:52<03:22, 1.08it/s]
Loading 0:  40%|████      | 147/363 [01:54<03:01, 1.19it/s]
Loading 0:  40%|████      | 147/363 [01:54<03:01, 1.19it/s]
Loading 0:  41%|████      | 148/363 [01:56<03:38, 1.02s/it]
Loading 0:  41%|████      | 148/363 [01:56<03:38, 1.02s/it]
Loading 0:  41%|████      | 149/363 [01:59<04:20, 1.22s/it]
Loading 0:  41%|████      | 149/363 [01:59<04:20, 1.22s/it]
Loading 0:  43%|████▎     | 156/363 [02:00<01:51, 1.86it/s]
Loading 0:  43%|████▎     | 156/363 [02:00<01:51, 1.86it/s]
Loading 0:  44%|████▍     | 160/363 [02:02<01:56, 1.74it/s]
Loading 0:  44%|████▍     | 160/363 [02:02<01:56, 1.74it/s]
Loading 0:  44%|████▍     | 161/363 [02:04<02:28, 1.36it/s]
Loading 0:  44%|████▍     | 161/363 [02:04<02:28, 1.36it/s]
Loading 0:  45%|████▍     | 162/363 [02:06<03:06, 1.08it/s]
Loading 0:  45%|████▍     | 162/363 [02:06<03:06, 1.08it/s]
Loading 0:  45%|████▌     | 165/363 [02:08<02:46, 1.19it/s]
Loading 0:  45%|████▌     | 165/363 [02:08<02:46, 1.19it/s]
Loading 0:  46%|████▌     | 166/363 [02:10<03:20, 1.02s/it]
Loading 0:  46%|████▌     | 166/363 [02:10<03:20, 1.02s/it]
Loading 0:  46%|████▌     | 167/363 [02:13<03:59, 1.22s/it]
Loading 0:  46%|████▌     | 167/363 [02:13<03:59, 1.22s/it]
Loading 0:  48%|████▊     | 174/363 [02:14<01:42, 1.85it/s]
Loading 0:  48%|████▊     | 174/363 [02:14<01:42, 1.85it/s]
Loading 0:  49%|████▉     | 178/363 [02:16<01:47, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:16<01:47, 1.73it/s]
Loading 0:  49%|████▉     | 179/363 [02:18<02:15, 1.35it/s]
Loading 0:  49%|████▉     | 179/363 [02:18<02:15, 1.35it/s]
Loading 0:  50%|████▉     | 180/363 [02:21<02:49, 1.08it/s]
Loading 0:  50%|████▉     | 180/363 [02:21<02:49, 1.08it/s]
Loading 0:  50%|█████     | 183/363 [02:23<02:31, 1.19it/s]
Loading 0:  50%|█████     | 183/363 [02:23<02:31, 1.19it/s]
Loading 0:  51%|█████     | 184/363 [02:25<03:02, 1.02s/it]
Loading 0:  51%|█████     | 184/363 [02:25<03:02, 1.02s/it]
Loading 0:  51%|█████     | 185/363 [02:27<03:37, 1.22s/it]
Loading 0:  51%|█████     | 185/363 [02:27<03:37, 1.22s/it]
Loading 0:  53%|█████▎    | 192/363 [02:28<01:32, 1.86it/s]
Loading 0:  53%|█████▎    | 192/363 [02:28<01:32, 1.86it/s]
Loading 0:  54%|█████▍    | 196/363 [02:30<01:36, 1.73it/s]
Loading 0:  54%|█████▍    | 196/363 [02:30<01:36, 1.73it/s]
Loading 0:  54%|█████▍    | 197/363 [02:33<02:02, 1.36it/s]
Loading 0:  54%|█████▍    | 197/363 [02:33<02:02, 1.36it/s]
Loading 0:  55%|█████▍    | 198/363 [02:35<02:33, 1.08it/s]
Loading 0:  55%|█████▍    | 198/363 [02:35<02:33, 1.08it/s]
Loading 0:  55%|█████▌    | 201/363 [02:37<02:16, 1.19it/s]
Loading 0:  55%|█████▌    | 201/363 [02:37<02:16, 1.19it/s]
Loading 0:  56%|█████▌    | 202/363 [02:39<02:44, 1.02s/it]
Loading 0:  56%|█████▌    | 202/363 [02:39<02:44, 1.02s/it]
Loading 0:  56%|█████▌    | 203/363 [02:41<03:15, 1.22s/it]
Loading 0:  56%|█████▌    | 203/363 [02:41<03:15, 1.22s/it]
Loading 0:  58%|█████▊    | 210/363 [02:42<01:22, 1.86it/s]
Loading 0:  58%|█████▊    | 210/363 [02:42<01:22, 1.86it/s]
Loading 0:  59%|█████▉    | 214/363 [02:45<01:25, 1.73it/s]
Loading 0:  59%|█████▉    | 214/363 [02:45<01:25, 1.73it/s]
Loading 0:  59%|█████▉    | 215/363 [02:47<01:49, 1.36it/s]
Loading 0:  59%|█████▉    | 215/363 [02:47<01:49, 1.36it/s]
Loading 0:  60%|█████▉    | 216/363 [02:49<02:16, 1.08it/s]
Loading 0:  60%|█████▉    | 216/363 [02:49<02:16, 1.08it/s]
Loading 0:  60%|██████    | 219/363 [02:51<02:00, 1.19it/s]
Loading 0:  60%|██████    | 219/363 [02:51<02:00, 1.19it/s]
Loading 0:  61%|██████    | 220/363 [02:53<02:25, 1.02s/it]
Loading 0:  61%|██████    | 220/363 [02:53<02:25, 1.02s/it]
Loading 0:  61%|██████    | 221/363 [02:55<02:52, 1.22s/it]
Loading 0:  61%|██████    | 221/363 [02:55<02:52, 1.22s/it]
Loading 0:  63%|██████▎   | 228/363 [02:56<01:12, 1.85it/s]
Loading 0:  63%|██████▎   | 228/363 [02:56<01:12, 1.85it/s]
Loading 0:  64%|██████▍   | 232/363 [02:59<01:15, 1.73it/s]
Loading 0:  64%|██████▍   | 232/363 [02:59<01:15, 1.73it/s]
Loading 0:  64%|██████▍   | 233/363 [03:01<01:35, 1.36it/s]
Loading 0:  64%|██████▍   | 233/363 [03:01<01:35, 1.36it/s]
Loading 0:  64%|██████▍   | 234/363 [03:03<01:59, 1.08it/s]
Loading 0:  64%|██████▍   | 234/363 [03:03<01:59, 1.08it/s]
Loading 0:  65%|██████▌   | 237/363 [03:05<01:45, 1.19it/s]
Loading 0:  65%|██████▌   | 237/363 [03:05<01:45, 1.19it/s]
Loading 0:  66%|██████▌   | 238/363 [03:07<02:07, 1.02s/it]
Loading 0:  66%|██████▌   | 238/363 [03:07<02:07, 1.02s/it]
Loading 0:  66%|██████▌   | 239/363 [03:09<02:30, 1.21s/it]
Loading 0:  66%|██████▌   | 239/363 [03:09<02:30, 1.21s/it]
Loading 0:  68%|██████▊   | 246/363 [03:10<01:02, 1.87it/s]
Loading 0:  68%|██████▊   | 246/363 [03:10<01:02, 1.87it/s]
Loading 0:  69%|██████▉   | 250/363 [03:13<01:04, 1.75it/s]
Loading 0:  69%|██████▉   | 250/363 [03:13<01:04, 1.75it/s]
Loading 0:  69%|██████▉   | 251/363 [03:15<01:22, 1.36it/s]
Loading 0:  69%|██████▉   | 251/363 [03:15<01:22, 1.36it/s]
Loading 0:  69%|██████▉   | 252/363 [03:17<01:42, 1.08it/s]
Loading 0:  69%|██████▉   | 252/363 [03:17<01:42, 1.08it/s]
Loading 0:  70%|███████   | 255/363 [03:19<01:30, 1.20it/s]
Loading 0:  70%|███████   | 255/363 [03:19<01:30, 1.20it/s]
Loading 0:  71%|███████   | 256/363 [03:21<01:48, 1.02s/it]
Loading 0:  71%|███████   | 256/363 [03:21<01:48, 1.02s/it]
Loading 0:  71%|███████   | 257/363 [03:23<02:09, 1.22s/it]
Loading 0:  71%|███████   | 257/363 [03:23<02:09, 1.22s/it]
Loading 0:  73%|███████▎  | 264/363 [03:24<00:53, 1.85it/s]
Loading 0:  73%|███████▎  | 264/363 [03:24<00:53, 1.85it/s]
Loading 0:  74%|███████▍  | 268/363 [03:27<00:54, 1.73it/s]
Loading 0:  74%|███████▍  | 268/363 [03:27<00:54, 1.73it/s]
Loading 0:  74%|███████▍  | 269/363 [03:29<01:09, 1.35it/s]
Loading 0:  74%|███████▍  | 269/363 [03:29<01:09, 1.35it/s]
Loading 0:  74%|███████▍  | 270/363 [03:31<01:26, 1.08it/s]
Loading 0:  74%|███████▍  | 270/363 [03:31<01:26, 1.08it/s]
Loading 0:  75%|███████▌  | 273/363 [03:52<04:37, 3.08s/it]
Loading 0:  75%|███████▌  | 273/363 [03:52<04:37, 3.08s/it]
Loading 0:  75%|███████▌  | 274/363 [03:54<04:20, 2.93s/it]
Loading 0:  75%|███████▌  | 274/363 [03:54<04:20, 2.93s/it]
Loading 0:  76%|███████▌  | 275/363 [03:56<04:07, 2.81s/it]
Loading 0:  76%|███████▌  | 275/363 [03:56<04:07, 2.81s/it]
Loading 0:  78%|███████▊  | 282/363 [03:57<01:30, 1.12s/it]
Loading 0:  78%|███████▊  | 282/363 [03:57<01:30, 1.12s/it]
Loading 0:  79%|███████▉  | 286/363 [03:59<01:13, 1.05it/s]
Loading 0:  79%|███████▉  | 286/363 [03:59<01:13, 1.05it/s]
Loading 0:  79%|███████▉  | 287/363 [04:02<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 287/363 [04:02<01:21, 1.07s/it]
Loading 0:  79%|███████▉  | 288/363 [04:04<01:31, 1.22s/it]
Loading 0:  79%|███████▉  | 288/363 [04:04<01:31, 1.22s/it]
Loading 0:  80%|████████  | 291/363 [04:06<01:13, 1.03s/it]
Loading 0:  80%|████████  | 291/363 [04:06<01:13, 1.03s/it]
Loading 0:  80%|████████  | 292/363 [04:08<01:23, 1.18s/it]
Loading 0:  80%|████████  | 292/363 [04:08<01:23, 1.18s/it]
Loading 0:  81%|████████  | 293/363 [04:10<01:34, 1.35s/it]
Loading 0:  81%|████████  | 293/363 [04:10<01:34, 1.35s/it]
Loading 0:  83%|████████▎ | 301/363 [04:11<00:33, 1.83it/s]
Loading 0:  83%|████████▎ | 301/363 [04:11<00:33, 1.83it/s]
Loading 0:  84%|████████▎ | 304/363 [04:13<00:35, 1.64it/s]
Loading 0:  84%|████████▎ | 304/363 [04:13<00:35, 1.64it/s]
Loading 0:  84%|████████▍ | 305/363 [04:16<00:44, 1.30it/s]
Loading 0:  84%|████████▍ | 305/363 [04:16<00:44, 1.30it/s]
Loading 0:  84%|████████▍ | 306/363 [04:18<00:54, 1.04it/s]
Loading 0:  84%|████████▍ | 306/363 [04:18<00:54, 1.04it/s]
Loading 0:  85%|████████▌ | 309/363 [04:20<00:46, 1.17it/s]
Loading 0:  85%|████████▌ | 309/363 [04:20<00:46, 1.17it/s]
Loading 0:  85%|████████▌ | 310/363 [04:22<00:54, 1.04s/it]
Loading 0:  85%|████████▌ | 310/363 [04:22<00:54, 1.04s/it]
Loading 0:  86%|████████▌ | 311/363 [04:24<01:04, 1.23s/it]
Loading 0:  86%|████████▌ | 311/363 [04:24<01:04, 1.23s/it]
Loading 0:  88%|████████▊ | 319/363 [04:25<00:22, 1.96it/s]
Loading 0:  88%|████████▊ | 319/363 [04:25<00:22, 1.96it/s]
Loading 0:  89%|████████▊ | 322/363 [04:27<00:23, 1.72it/s]
Loading 0:  89%|████████▊ | 322/363 [04:27<00:23, 1.72it/s]
Loading 0:  89%|████████▉ | 323/363 [04:30<00:29, 1.34it/s]
Loading 0:  89%|████████▉ | 323/363 [04:30<00:29, 1.34it/s]
Loading 0:  89%|████████▉ | 324/363 [04:32<00:36, 1.07it/s]
Loading 0:  89%|████████▉ | 324/363 [04:32<00:36, 1.07it/s]
Loading 0:  90%|█████████ | 327/363 [04:34<00:30, 1.18it/s]
Loading 0:  90%|█████████ | 327/363 [04:34<00:30, 1.18it/s]
Loading 0:  90%|█████████ | 328/363 [04:36<00:35, 1.03s/it]
Loading 0:  90%|█████████ | 328/363 [04:36<00:35, 1.03s/it]
Loading 0:  91%|█████████ | 329/363 [04:38<00:41, 1.22s/it]
Loading 0:  91%|█████████ | 329/363 [04:38<00:41, 1.22s/it]
Loading 0:  93%|█████████▎| 337/363 [04:39<00:13, 1.98it/s]
Loading 0:  93%|█████████▎| 337/363 [04:39<00:13, 1.98it/s]
Loading 0:  94%|█████████▎| 340/363 [04:42<00:13, 1.72it/s]
Loading 0:  94%|█████████▎| 340/363 [04:42<00:13, 1.72it/s]
Loading 0:  94%|█████████▍| 341/363 [04:44<00:16, 1.34it/s]
Loading 0:  94%|█████████▍| 341/363 [04:44<00:16, 1.34it/s]
Loading 0:  94%|█████████▍| 342/363 [04:46<00:19, 1.06it/s]
Loading 0:  94%|█████████▍| 342/363 [04:46<00:19, 1.06it/s]
Loading 0:  95%|█████████▌| 345/363 [04:48<00:15, 1.18it/s]
Loading 0:  95%|█████████▌| 345/363 [04:48<00:15, 1.18it/s]
Loading 0:  95%|█████████▌| 346/363 [04:50<00:17, 1.03s/it]
Loading 0:  95%|█████████▌| 346/363 [04:50<00:17, 1.03s/it]
Loading 0:  96%|█████████▌| 347/363 [04:52<00:19, 1.23s/it]
Loading 0:  96%|█████████▌| 347/363 [04:52<00:19, 1.23s/it]
Loading 0:  98%|█████████▊| 355/363 [04:53<00:04, 1.98it/s]
Loading 0:  98%|█████████▊| 355/363 [04:53<00:04, 1.98it/s]
Loading 0:  99%|█████████▉| 359/363 [04:56<00:02, 1.76it/s]
Loading 0:  99%|█████████▉| 359/363 [04:56<00:02, 1.76it/s]
Loading 0:  99%|█████████▉| 360/363 [04:58<00:02, 1.38it/s]
Loading 0:  99%|█████████▉| 360/363 [04:58<00:02, 1.38it/s]
Loading 0:  99%|█████████▉| 361/363 [05:00<00:01, 1.10it/s]
Loading 0:  99%|█████████▉| 361/363 [05:00<00:01, 1.10it/s]
Loading 0: 100%|██████████| 363/363 [05:00<00:00, 1.10it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:00<00:00, 1.21it/s]
chaiml-mistral-24b-2048-96216-v5-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<05:33, 1.08it/s]
Loading 0:   1%|          | 3.00/363 [00:02<05:33, 1.08it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:43, 1.29s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:43, 1.29s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:09, 1.53s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:09, 1.53s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:10, 1.85it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:10, 1.85it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<03:57, 1.48it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<03:57, 1.48it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:04, 1.14it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:04, 1.14it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:20, 1.09s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:20, 1.09s/it]
Loading 0:   6%|▌         | 21.0/363 [00:16<03:49, 1.49it/s]
Loading 0:   6%|▌         | 21.0/363 [00:16<03:49, 1.49it/s]
Loading 0:   6%|▌         | 22.0/363 [00:18<04:43, 1.20it/s]
Loading 0:   6%|▌         | 22.0/363 [00:18<04:43, 1.20it/s]
Loading 0:   6%|▋         | 23.0/363 [00:20<05:47, 1.02s/it]
Loading 0:   6%|▋         | 23.0/363 [00:20<05:47, 1.02s/it]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:35, 2.13it/s]
Loading 0:   9%|▊         | 31.0/363 [00:21<02:35, 2.13it/s]
Loading 0:   9%|▉         | 34.0/363 [00:24<03:00, 1.82it/s]
Loading 0:   9%|▉         | 34.0/363 [00:24<03:00, 1.82it/s]
Loading 0:  10%|▉         | 35.0/363 [00:26<03:49, 1.43it/s]
Loading 0:  10%|▉         | 35.0/363 [00:26<03:49, 1.43it/s]
Loading 0:  10%|▉         | 36.0/363 [00:28<04:48, 1.13it/s]
Loading 0:  10%|▉         | 36.0/363 [00:28<04:48, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:30<04:18, 1.25it/s]
Loading 0:  11%|█         | 39.0/363 [00:30<04:18, 1.25it/s]
Loading 0:  11%|█         | 40.0/363 [00:32<05:13, 1.03it/s]
Loading 0:  11%|█         | 40.0/363 [00:32<05:13, 1.03it/s]
Loading 0:  11%|█▏        | 41.0/363 [00:34<06:14, 1.16s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:34<06:14, 1.16s/it]
Loading 0:  13%|█▎        | 49.0/363 [00:35<02:32, 2.05it/s]
Loading 0:  13%|█▎        | 49.0/363 [00:35<02:32, 2.05it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:37<02:53, 1.79it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:37<02:53, 1.79it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:39<03:41, 1.40it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:39<03:41, 1.40it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:41<04:38, 1.11it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:41<04:38, 1.11it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:43<04:08, 1.23it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:43<04:08, 1.23it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:45<05:00, 1.01it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:45<05:00, 1.01it/s]
Loading 0:  16%|█▋        | 59.0/363 [00:47<05:58, 1.18s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:47<05:58, 1.18s/it]
Loading 0:  18%|█▊        | 67.0/363 [00:48<02:26, 2.03it/s]
Loading 0:  18%|█▊        | 67.0/363 [00:48<02:26, 2.03it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:51<02:45, 1.77it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:51<02:45, 1.77it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:53<03:31, 1.38it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:53<03:31, 1.38it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:55<04:25, 1.10it/s]
Loading 0:  20%|█▉        | 72.0/363 [00:55<04:25, 1.10it/s]
Loading 0:  21%|██        | 75.0/363 [00:57<03:56, 1.22it/s]
Loading 0:  21%|██        | 75.0/363 [00:57<03:56, 1.22it/s]
Loading 0:  21%|██        | 76.0/363 [00:59<04:45, 1.00it/s]
Loading 0:  21%|██        | 76.0/363 [00:59<04:45, 1.00it/s]
Loading 0:  21%|██        | 77.0/363 [01:01<05:41, 1.19s/it]
Loading 0:  21%|██        | 77.0/363 [01:01<05:41, 1.19s/it]
Loading 0:  23%|██▎       | 85.0/363 [01:02<02:18, 2.01it/s]
Loading 0:  23%|██▎       | 85.0/363 [01:02<02:18, 2.01it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:04<02:37, 1.75it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:04<02:37, 1.75it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:06<03:20, 1.37it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:06<03:20, 1.37it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:08<04:11, 1.09it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:08<04:11, 1.09it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:10<01:59, 2.21it/s]
Loading 0:  27%|██▋       | 98.0/363 [01:10<01:59, 2.21it/s]
Loading 0:  28%|██▊       | 101/363 [01:12<02:16, 1.92it/s] 
Loading 0:  28%|██▊       | 101/363 [01:12<02:16, 1.92it/s]
Loading 0:  28%|██▊       | 102/363 [01:14<02:56, 1.48it/s]
Loading 0:  28%|██▊       | 102/363 [01:14<02:56, 1.48it/s]
Loading 0:  28%|██▊       | 103/363 [01:16<03:45, 1.15it/s]
Loading 0:  28%|██▊       | 103/363 [01:16<03:45, 1.15it/s]
Loading 0:  29%|██▉       | 106/363 [01:18<03:30, 1.22it/s]
Loading 0:  29%|██▉       | 106/363 [01:18<03:30, 1.22it/s]
Loading 0:  29%|██▉       | 107/363 [01:20<04:13, 1.01it/s]
Loading 0:  29%|██▉       | 107/363 [01:20<04:13, 1.01it/s]
Loading 0:  30%|██▉       | 108/363 [01:22<05:02, 1.19s/it]
Loading 0:  30%|██▉       | 108/363 [01:22<05:02, 1.19s/it]
Loading 0:  31%|███       | 111/363 [01:24<04:04, 1.03it/s]
Loading 0:  31%|███       | 111/363 [01:24<04:04, 1.03it/s]
Loading 0:  31%|███       | 112/363 [01:26<04:47, 1.15s/it]
Loading 0:  31%|███       | 112/363 [01:26<04:47, 1.15s/it]
Loading 0:  31%|███       | 113/363 [01:29<05:34, 1.34s/it]
Loading 0:  31%|███       | 113/363 [01:29<05:34, 1.34s/it]
Loading 0:  33%|███▎      | 121/363 [01:30<02:05, 1.93it/s]
Loading 0:  33%|███▎      | 121/363 [01:30<02:05, 1.93it/s]
Loading 0:  34%|███▍      | 124/363 [01:32<02:21, 1.69it/s]
Loading 0:  34%|███▍      | 124/363 [01:32<02:21, 1.69it/s]
Loading 0:  34%|███▍      | 125/363 [01:34<02:59, 1.32it/s]
Loading 0:  34%|███▍      | 125/363 [01:34<02:59, 1.32it/s]
Loading 0:  35%|███▍      | 126/363 [01:36<03:45, 1.05it/s]
Loading 0:  35%|███▍      | 126/363 [01:36<03:45, 1.05it/s]
Loading 0:  36%|███▌      | 129/363 [01:38<03:18, 1.18it/s]
Loading 0:  36%|███▌      | 129/363 [01:38<03:18, 1.18it/s]
Loading 0:  36%|███▌      | 130/363 [01:40<03:59, 1.03s/it]
Loading 0:  36%|███▌      | 130/363 [01:40<03:59, 1.03s/it]
Loading 0:  36%|███▌      | 131/363 [01:43<04:45, 1.23s/it]
Loading 0:  36%|███▌      | 131/363 [01:43<04:45, 1.23s/it]
Loading 0:  38%|███▊      | 138/363 [01:44<02:00, 1.87it/s]
Loading 0:  38%|███▊      | 138/363 [01:44<02:00, 1.87it/s]
Loading 0:  39%|███▉      | 142/363 [01:46<02:06, 1.74it/s]
Loading 0:  39%|███▉      | 142/363 [01:46<02:06, 1.74it/s]
Loading 0:  39%|███▉      | 143/363 [01:48<02:41, 1.36it/s]
Loading 0:  39%|███▉      | 143/363 [01:48<02:41, 1.36it/s]
Loading 0:  40%|███▉      | 144/363 [01:50<03:21, 1.08it/s]
Loading 0:  40%|███▉      | 144/363 [01:50<03:21, 1.08it/s]
Loading 0:  40%|████      | 147/363 [01:52<03:00, 1.20it/s]
Loading 0:  40%|████      | 147/363 [01:52<03:00, 1.20it/s]
Loading 0:  41%|████      | 148/363 [01:54<03:37, 1.01s/it]
Loading 0:  41%|████      | 148/363 [01:54<03:37, 1.01s/it]
Loading 0:  41%|████      | 149/363 [01:57<04:19, 1.21s/it]
Loading 0:  41%|████      | 149/363 [01:57<04:19, 1.21s/it]
Loading 0:  43%|████▎     | 156/363 [01:58<01:50, 1.88it/s]
Loading 0:  43%|████▎     | 156/363 [01:58<01:50, 1.88it/s]
Loading 0:  44%|████▍     | 160/363 [02:00<01:56, 1.74it/s]
Loading 0:  44%|████▍     | 160/363 [02:00<01:56, 1.74it/s]
Loading 0:  44%|████▍     | 161/363 [02:02<02:28, 1.36it/s]
Loading 0:  44%|████▍     | 161/363 [02:02<02:28, 1.36it/s]
Loading 0:  45%|████▍     | 162/363 [02:04<03:05, 1.09it/s]
Loading 0:  45%|████▍     | 162/363 [02:04<03:05, 1.09it/s]
Loading 0:  45%|████▌     | 165/363 [02:06<02:45, 1.20it/s]
Loading 0:  45%|████▌     | 165/363 [02:06<02:45, 1.20it/s]
Loading 0:  46%|████▌     | 166/363 [02:08<03:19, 1.01s/it]
Loading 0:  46%|████▌     | 166/363 [02:08<03:19, 1.01s/it]
Loading 0:  46%|████▌     | 167/363 [02:11<03:56, 1.21s/it]
Loading 0:  46%|████▌     | 167/363 [02:11<03:56, 1.21s/it]
Loading 0:  48%|████▊     | 175/363 [02:12<01:35, 1.98it/s]
Loading 0:  48%|████▊     | 175/363 [02:12<01:35, 1.98it/s]
Loading 0:  49%|████▉     | 178/363 [02:14<01:47, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:14<01:47, 1.73it/s]
Loading 0:  49%|████▉     | 179/363 [02:16<02:16, 1.35it/s]
Loading 0:  49%|████▉     | 179/363 [02:16<02:16, 1.35it/s]
Loading 0:  50%|████▉     | 180/363 [02:18<02:50, 1.07it/s]
Loading 0:  50%|████▉     | 180/363 [02:18<02:50, 1.07it/s]
Loading 0:  50%|█████     | 183/363 [02:20<02:31, 1.19it/s]
Loading 0:  50%|█████     | 183/363 [02:20<02:31, 1.19it/s]
Loading 0:  51%|█████     | 184/363 [02:22<03:02, 1.02s/it]
Loading 0:  51%|█████     | 184/363 [02:22<03:02, 1.02s/it]
Loading 0:  51%|█████     | 185/363 [02:25<03:36, 1.22s/it]
Loading 0:  51%|█████     | 185/363 [02:25<03:36, 1.22s/it]
Loading 0:  53%|█████▎    | 193/363 [02:26<01:26, 1.97it/s]
Loading 0:  53%|█████▎    | 193/363 [02:26<01:26, 1.97it/s]
Loading 0:  54%|█████▍    | 196/363 [02:28<01:36, 1.73it/s]
Loading 0:  54%|█████▍    | 196/363 [02:28<01:36, 1.73it/s]
Loading 0:  54%|█████▍    | 197/363 [02:30<02:03, 1.35it/s]
Loading 0:  54%|█████▍    | 197/363 [02:30<02:03, 1.35it/s]
Loading 0:  55%|█████▍    | 198/363 [02:32<02:34, 1.07it/s]
Loading 0:  55%|█████▍    | 198/363 [02:32<02:34, 1.07it/s]
Loading 0:  55%|█████▌    | 201/363 [02:34<02:16, 1.19it/s]
Loading 0:  55%|█████▌    | 201/363 [02:34<02:16, 1.19it/s]
Loading 0:  56%|█████▌    | 202/363 [02:36<02:44, 1.02s/it]
Loading 0:  56%|█████▌    | 202/363 [02:36<02:44, 1.02s/it]
Loading 0:  56%|█████▌    | 203/363 [02:39<03:15, 1.22s/it]
Loading 0:  56%|█████▌    | 203/363 [02:39<03:15, 1.22s/it]
Loading 0:  58%|█████▊    | 210/363 [02:40<01:21, 1.88it/s]
Loading 0:  58%|█████▊    | 210/363 [02:40<01:21, 1.88it/s]
Loading 0:  59%|█████▉    | 214/363 [02:42<01:25, 1.75it/s]
Loading 0:  59%|█████▉    | 214/363 [02:42<01:25, 1.75it/s]
Loading 0:  59%|█████▉    | 215/363 [02:44<01:48, 1.37it/s]
Loading 0:  59%|█████▉    | 215/363 [02:44<01:48, 1.37it/s]
Loading 0:  60%|█████▉    | 216/363 [02:46<02:15, 1.09it/s]
Loading 0:  60%|█████▉    | 216/363 [02:46<02:15, 1.09it/s]
Loading 0:  60%|██████    | 219/363 [02:48<02:00, 1.20it/s]
Loading 0:  60%|██████    | 219/363 [02:48<02:00, 1.20it/s]
Loading 0:  61%|██████    | 220/363 [02:50<02:24, 1.01s/it]
Loading 0:  61%|██████    | 220/363 [02:50<02:24, 1.01s/it]
Loading 0:  61%|██████    | 221/363 [02:53<02:51, 1.21s/it]
Loading 0:  61%|██████    | 221/363 [02:53<02:51, 1.21s/it]
Loading 0:  63%|██████▎   | 229/363 [02:54<01:07, 1.98it/s]
Loading 0:  63%|██████▎   | 229/363 [02:54<01:07, 1.98it/s]
Loading 0:  64%|██████▍   | 232/363 [02:56<01:15, 1.73it/s]
Loading 0:  64%|██████▍   | 232/363 [02:56<01:15, 1.73it/s]
Loading 0:  64%|██████▍   | 233/363 [02:58<01:36, 1.35it/s]
Loading 0:  64%|██████▍   | 233/363 [02:58<01:36, 1.35it/s]
Loading 0:  64%|██████▍   | 234/363 [03:00<02:01, 1.06it/s]
Loading 0:  64%|██████▍   | 234/363 [03:00<02:01, 1.06it/s]
Loading 0:  65%|██████▌   | 237/363 [03:02<01:46, 1.18it/s]
Loading 0:  65%|██████▌   | 237/363 [03:02<01:46, 1.18it/s]
Loading 0:  66%|██████▌   | 238/363 [03:04<02:08, 1.02s/it]
Loading 0:  66%|██████▌   | 238/363 [03:04<02:08, 1.02s/it]
Loading 0:  66%|██████▌   | 239/363 [03:07<02:32, 1.23s/it]
Loading 0:  66%|██████▌   | 239/363 [03:07<02:32, 1.23s/it]
Loading 0:  68%|██████▊   | 246/363 [03:08<01:02, 1.87it/s]
Loading 0:  68%|██████▊   | 246/363 [03:08<01:02, 1.87it/s]
Loading 0:  69%|██████▉   | 250/363 [03:10<01:05, 1.73it/s]
Loading 0:  69%|██████▉   | 250/363 [03:10<01:05, 1.73it/s]
Loading 0:  69%|██████▉   | 251/363 [03:12<01:22, 1.36it/s]
Loading 0:  69%|██████▉   | 251/363 [03:12<01:22, 1.36it/s]
Loading 0:  69%|██████▉   | 252/363 [03:14<01:43, 1.08it/s]
Loading 0:  69%|██████▉   | 252/363 [03:14<01:43, 1.08it/s]
Loading 0:  70%|███████   | 255/363 [03:17<01:30, 1.19it/s]
Loading 0:  70%|███████   | 255/363 [03:17<01:30, 1.19it/s]
Loading 0:  71%|███████   | 256/363 [03:19<01:49, 1.02s/it]
Loading 0:  71%|███████   | 256/363 [03:19<01:49, 1.02s/it]
Loading 0:  71%|███████   | 257/363 [03:21<02:09, 1.22s/it]
Loading 0:  71%|███████   | 257/363 [03:21<02:09, 1.22s/it]
Loading 0:  73%|███████▎  | 265/363 [03:22<00:49, 1.96it/s]
Loading 0:  73%|███████▎  | 265/363 [03:22<00:49, 1.96it/s]
Loading 0:  74%|███████▍  | 268/363 [03:24<00:55, 1.71it/s]
Loading 0:  74%|███████▍  | 268/363 [03:24<00:55, 1.71it/s]
Loading 0:  74%|███████▍  | 269/363 [03:26<01:10, 1.33it/s]
Loading 0:  74%|███████▍  | 269/363 [03:26<01:10, 1.33it/s]
Loading 0:  74%|███████▍  | 270/363 [03:29<01:27, 1.06it/s]
Loading 0:  74%|███████▍  | 270/363 [03:29<01:27, 1.06it/s]
Loading 0:  75%|███████▌  | 273/363 [03:49<04:41, 3.13s/it]
Loading 0:  75%|███████▌  | 273/363 [03:49<04:41, 3.13s/it]
Loading 0:  75%|███████▌  | 274/363 [03:51<04:24, 2.97s/it]
Loading 0:  75%|███████▌  | 274/363 [03:51<04:24, 2.97s/it]
Loading 0:  76%|███████▌  | 275/363 [03:53<04:10, 2.84s/it]
Loading 0:  76%|███████▌  | 275/363 [03:53<04:10, 2.84s/it]
Loading 0:  78%|███████▊  | 283/363 [03:55<01:23, 1.04s/it]
Loading 0:  78%|███████▊  | 283/363 [03:55<01:23, 1.04s/it]
Loading 0:  79%|███████▉  | 286/363 [03:57<01:14, 1.03it/s]
Loading 0:  79%|███████▉  | 286/363 [03:57<01:14, 1.03it/s]
Loading 0:  79%|███████▉  | 287/363 [03:59<01:22, 1.08s/it]
Loading 0:  79%|███████▉  | 287/363 [03:59<01:22, 1.08s/it]
Loading 0:  79%|███████▉  | 288/363 [04:01<01:30, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:01<01:30, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:03<01:11, 1.01it/s]
Loading 0:  80%|████████  | 291/363 [04:03<01:11, 1.01it/s]
Loading 0:  80%|████████  | 292/363 [04:05<01:22, 1.16s/it]
Loading 0:  80%|████████  | 292/363 [04:05<01:22, 1.16s/it]
Loading 0:  81%|████████  | 293/363 [04:07<01:33, 1.34s/it]
Loading 0:  81%|████████  | 293/363 [04:07<01:33, 1.34s/it]
Loading 0:  83%|████████▎ | 301/363 [04:08<00:33, 1.85it/s]
Loading 0:  83%|████████▎ | 301/363 [04:08<00:33, 1.85it/s]
Loading 0:  84%|████████▎ | 304/363 [04:11<00:36, 1.63it/s]
Loading 0:  84%|████████▎ | 304/363 [04:11<00:36, 1.63it/s]
Loading 0:  84%|████████▍ | 305/363 [04:13<00:45, 1.29it/s]
Loading 0:  84%|████████▍ | 305/363 [04:13<00:45, 1.29it/s]
Loading 0:  84%|████████▍ | 306/363 [04:15<00:55, 1.03it/s]
Loading 0:  84%|████████▍ | 306/363 [04:15<00:55, 1.03it/s]
Loading 0:  85%|████████▌ | 309/363 [04:17<00:46, 1.15it/s]
Loading 0:  85%|████████▌ | 309/363 [04:17<00:46, 1.15it/s]
Loading 0:  85%|████████▌ | 310/363 [04:19<00:55, 1.05s/it]
Loading 0:  85%|████████▌ | 310/363 [04:19<00:55, 1.05s/it]
Loading 0:  86%|████████▌ | 311/363 [04:21<01:05, 1.25s/it]
Loading 0:  86%|████████▌ | 311/363 [04:21<01:05, 1.25s/it]
Loading 0:  88%|████████▊ | 319/363 [04:22<00:22, 1.96it/s]
Loading 0:  88%|████████▊ | 319/363 [04:22<00:22, 1.96it/s]
Loading 0:  89%|████████▊ | 322/363 [04:25<00:24, 1.70it/s]
Loading 0:  89%|████████▊ | 322/363 [04:25<00:24, 1.70it/s]
Loading 0:  89%|████████▉ | 323/363 [04:27<00:30, 1.33it/s]
Loading 0:  89%|████████▉ | 323/363 [04:27<00:30, 1.33it/s]
Loading 0:  89%|████████▉ | 324/363 [04:29<00:37, 1.05it/s]
Loading 0:  89%|████████▉ | 324/363 [04:29<00:37, 1.05it/s]
Loading 0:  90%|█████████ | 327/363 [04:31<00:30, 1.16it/s]
Loading 0:  90%|█████████ | 327/363 [04:31<00:30, 1.16it/s]
Loading 0:  90%|█████████ | 328/363 [04:33<00:36, 1.04s/it]
Loading 0:  90%|█████████ | 328/363 [04:33<00:36, 1.04s/it]
Loading 0:  91%|█████████ | 329/363 [04:35<00:42, 1.24s/it]
Loading 0:  91%|█████████ | 329/363 [04:35<00:42, 1.24s/it]
Loading 0:  93%|█████████▎| 337/363 [04:37<00:13, 1.96it/s]
Loading 0:  93%|█████████▎| 337/363 [04:37<00:13, 1.96it/s]
Loading 0:  94%|█████████▎| 340/363 [04:39<00:13, 1.70it/s]
Loading 0:  94%|█████████▎| 340/363 [04:39<00:13, 1.70it/s]
Loading 0:  94%|█████████▍| 341/363 [04:41<00:16, 1.33it/s]
Loading 0:  94%|█████████▍| 341/363 [04:41<00:16, 1.33it/s]
Loading 0:  94%|█████████▍| 342/363 [04:43<00:20, 1.05it/s]
Loading 0:  94%|█████████▍| 342/363 [04:43<00:20, 1.05it/s]
Loading 0:  95%|█████████▌| 345/363 [04:45<00:15, 1.16it/s]
Loading 0:  95%|█████████▌| 345/363 [04:45<00:15, 1.16it/s]
Loading 0:  95%|█████████▌| 346/363 [04:48<00:17, 1.04s/it]
Loading 0:  95%|█████████▌| 346/363 [04:48<00:17, 1.04s/it]
Loading 0:  96%|█████████▌| 347/363 [04:50<00:19, 1.24s/it]
Loading 0:  96%|█████████▌| 347/363 [04:50<00:19, 1.24s/it]
Loading 0:  98%|█████████▊| 355/363 [04:51<00:04, 1.97it/s]
Loading 0:  98%|█████████▊| 355/363 [04:51<00:04, 1.97it/s]
Loading 0:  99%|█████████▉| 359/363 [04:54<00:02, 1.76it/s]
Loading 0:  99%|█████████▉| 359/363 [04:54<00:02, 1.76it/s]
Loading 0:  99%|█████████▉| 360/363 [04:56<00:02, 1.38it/s]
Loading 0:  99%|█████████▉| 360/363 [04:56<00:02, 1.38it/s]
Loading 0:  99%|█████████▉| 361/363 [04:58<00:01, 1.10it/s]
Loading 0:  99%|█████████▉| 361/363 [04:58<00:01, 1.10it/s]
Loading 0: 100%|██████████| 363/363 [04:58<00:00, 1.10it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [04:58<00:00, 1.22it/s]
chaiml-mistral-24b-2048-15988-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-96216-v5-mkmlizer: The tokenizer you are loading from '/tmp/tmped94ofph' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-15988-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-96216-v5-mkmlizer: quantized model in 310.630s
chaiml-mistral-24b-2048-15988-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-15988-v2/nvidia
chaiml-mistral-24b-2048-96216-v5-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_merged in 399.089s
chaiml-mistral-24b-2048-15988-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-15988-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-15988-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-15988-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-15988-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-15988-v2/nvidia/config.json
chaiml-mistral-24b-2048-15988-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-15988-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-62542-v3-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.21s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.21s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:56, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:56, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.85it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.85it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:14, 1.04it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:14, 1.04it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:44, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:44, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:51, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:36<06:51, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:10, 1.63it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:10, 1.63it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:02, 1.28it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:02, 1.28it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:04, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:04, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:33, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:33, 1.12it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:30, 1.08s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:30, 1.08s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:33, 1.30s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:51<06:33, 1.30s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<03:00, 1.62it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:55<03:00, 1.62it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:17, 1.12it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:17, 1.12it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.08s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:11, 1.08s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:10, 1.30s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:10, 1.30s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:42, 1.72it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:42, 1.72it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:04, 1.06it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:04, 1.06it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:47, 1.13it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:47, 1.13it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:33, 1.07s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:33, 1.07s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:26, 1.28s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:26, 1.28s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:23, 1.05s/it]
Loading 0:  31%|███       | 111/363 [01:32<04:23, 1.05s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:09, 1.23s/it]
Loading 0:  31%|███       | 112/363 [01:34<05:09, 1.23s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:00, 1.44s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:24, 1.69it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:24, 1.69it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:30, 1.59it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:30, 1.59it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:10, 1.25it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:10, 1.25it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<03:57, 1.00s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<03:57, 1.00s/it]
Loading 0:  36%|███▌      | 129/363 [01:47<03:31, 1.11it/s]
Loading 0:  36%|███▌      | 129/363 [01:47<03:31, 1.11it/s]
Loading 0:  36%|███▌      | 130/363 [01:49<04:14, 1.09s/it]
Loading 0:  36%|███▌      | 130/363 [01:49<04:14, 1.09s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:02, 1.30s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:02, 1.30s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:09, 1.74it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:18, 1.59it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:18, 1.59it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:55, 1.25it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:55, 1.25it/s]
Loading 0:  40%|███▉      | 144/363 [02:00<03:39, 1.00s/it]
Loading 0:  40%|███▉      | 144/363 [02:00<03:39, 1.00s/it]
Loading 0:  40%|████      | 147/363 [02:02<03:15, 1.11it/s]
Loading 0:  40%|████      | 147/363 [02:02<03:15, 1.11it/s]
Loading 0:  41%|████      | 148/363 [02:05<03:54, 1.09s/it]
Loading 0:  41%|████      | 148/363 [02:05<03:54, 1.09s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:38, 1.30s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:38, 1.30s/it]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.73it/s]
Loading 0:  43%|████▎     | 156/363 [02:08<01:59, 1.73it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:05, 1.62it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:05, 1.62it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:39, 1.27it/s]
Loading 0:  44%|████▍     | 161/363 [02:13<02:39, 1.27it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▍     | 162/363 [02:15<03:19, 1.01it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.12it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:57, 1.12it/s]
Loading 0:  46%|████▌     | 166/363 [02:20<03:33, 1.08s/it]
Loading 0:  46%|████▌     | 166/363 [02:20<03:33, 1.08s/it]
Loading 0:  46%|████▌     | 167/363 [02:22<04:14, 1.30s/it]
Loading 0:  46%|████▌     | 167/363 [02:22<04:14, 1.30s/it]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.74it/s]
Loading 0:  48%|████▊     | 174/363 [02:23<01:48, 1.74it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:56, 1.59it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:56, 1.59it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:26, 1.25it/s]
Loading 0:  49%|████▉     | 179/363 [02:28<02:26, 1.25it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:02, 1.00it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:02, 1.00it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:42, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:42, 1.11it/s]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:51, 1.30s/it]
Loading 0:  51%|█████     | 185/363 [02:37<03:51, 1.30s/it]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:38, 1.73it/s]
Loading 0:  53%|█████▎    | 192/363 [02:38<01:38, 1.73it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 196/363 [02:41<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  54%|█████▍    | 197/363 [02:43<02:10, 1.27it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:25, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:25, 1.12it/s]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:38, 1.37s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:38, 1.37s/it]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:31, 1.67it/s]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:31, 1.67it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:34, 1.58it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:34, 1.58it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:58, 1.25it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:58, 1.25it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:27, 1.00s/it]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:27, 1.00s/it]
Loading 0:  60%|██████    | 219/363 [03:03<02:09, 1.11it/s]
Loading 0:  60%|██████    | 219/363 [03:03<02:09, 1.11it/s]
Loading 0:  61%|██████    | 220/363 [03:05<02:35, 1.09s/it]
Loading 0:  61%|██████    | 220/363 [03:05<02:35, 1.09s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:04, 1.30s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:04, 1.30s/it]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.74it/s]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.74it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:20, 1.62it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:20, 1.62it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.27it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:18<01:52, 1.12it/s]
Loading 0:  65%|██████▌   | 237/363 [03:18<01:52, 1.12it/s]
Loading 0:  66%|██████▌   | 238/363 [03:20<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 238/363 [03:20<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:40, 1.30s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:40, 1.30s/it]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.74it/s]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.74it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:09, 1.62it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:09, 1.62it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:27, 1.27it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:27, 1.27it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:49, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:49, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:33<01:36, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:33<01:36, 1.12it/s]
Loading 0:  71%|███████   | 256/363 [03:35<01:55, 1.08s/it]
Loading 0:  71%|███████   | 256/363 [03:35<01:55, 1.08s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:17, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:17, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:56, 1.74it/s]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:56, 1.74it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.62it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.62it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:13, 1.27it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:13, 1.27it/s]
Loading 0:  74%|███████▍  | 270/363 [03:46<01:32, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:46<01:32, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:56, 2.63s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:47, 2.56s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:47, 2.56s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:41, 2.52s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:41, 2.52s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:22, 1.02s/it]
Loading 0:  78%|███████▊  | 282/363 [04:08<01:22, 1.02s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:19, 1.04s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:30, 1.21s/it]
Loading 0:  79%|███████▉  | 288/363 [04:15<01:30, 1.21s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:14, 1.03s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:14, 1.03s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:25, 1.20s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:25, 1.20s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:37, 1.39s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:37, 1.39s/it]
Loading 0:  82%|████████▏ | 298/363 [04:23<00:47, 1.36it/s]
Loading 0:  82%|████████▏ | 298/363 [04:23<00:47, 1.36it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:36, 1.60it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:36, 1.60it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:45, 1.27it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:45, 1.27it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:55, 1.02it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:55, 1.02it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:56, 1.07s/it]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:56, 1.07s/it]
Loading 0:  86%|████████▌ | 311/363 [04:37<01:06, 1.29s/it]
Loading 0:  86%|████████▌ | 311/363 [04:37<01:06, 1.29s/it]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.76it/s]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.76it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:25, 1.63it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:25, 1.63it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.02it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.02it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 328/363 [04:50<00:37, 1.08s/it]
Loading 0:  90%|█████████ | 328/363 [04:50<00:37, 1.08s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:43, 1.29s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:43, 1.29s/it]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.73it/s]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.73it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.62it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.62it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.08s/it]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.08s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.30s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.30s/it]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.76it/s]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.76it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.68it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.68it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.32it/s]
Loading 0:  99%|█████████▉| 361/363 [05:16<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:16<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.05it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.15it/s]
chaiml-mistral-24b-2048-62542-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmpe3niqet0' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-62542-v3-mkmlizer: quantized model in 323.982s
chaiml-mistral-24b-2048-62542-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_30k_prod_rm_906_instruct_merged in 444.934s
chaiml-mistral-24b-2048-62542-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-62542-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-62542-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-62542-v3/nvidia
chaiml-mistral-24b-2048-62542-v3-mkmlizer: cp /dev/shm/model_cache/chat_template.jinja s3://guanaco-mkml-models/chaiml-mistral-24b-2048-62542-v3/nvidia/chat_template.jinja
chaiml-mistral-24b-2048-62542-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-62542-v3/nvidia/config.json
chaiml-mistral-24b-2048-62542-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-62542-v3/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-3092-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-3092-v3/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-15988-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-15988-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-54327-v7-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v7/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-96216-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v5/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-62542-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-62542-v3/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-3092-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-3092-v3/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-3092-v3-mkmlizer completed after 593.74s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-3092-v3-mkmlizer
Pipeline stage MKMLizer completed in 596.15s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.92s
chaiml-mistral-24b-2048-54327-v7-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v7/nvidia/flywheel_model.0.safetensors
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-3092-v3
Waiting for inference service chaiml-mistral-24b-2048-3092-v3 to be ready
Job chaiml-mistral-24b-2048-54327-v7-mkmlizer completed after 593.63s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-54327-v7-mkmlizer
Pipeline stage MKMLizer completed in 597.07s
chaiml-mistral-24b-2048-96216-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96216-v5/nvidia/flywheel_model.0.safetensors
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.94s
run pipeline stage %s
chaiml-mistral-24b-2048-15988-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-15988-v2/nvidia/flywheel_model.0.safetensors
Running pipeline stage MKMLDeployer
Job chaiml-mistral-24b-2048-15988-v2-mkmlizer completed after 611.01s with status: succeeded
Creating inference service chaiml-mistral-24b-2048-54327-v7
Stopping job with name chaiml-mistral-24b-2048-15988-v2-mkmlizer
Waiting for inference service chaiml-mistral-24b-2048-54327-v7 to be ready
Pipeline stage MKMLizer completed in 614.46s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.25s
Job chaiml-mistral-24b-2048-96216-v5-mkmlizer completed after 613.05s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-mistral-24b-2048-96216-v5-mkmlizer
Running pipeline stage MKMLDeployer
Pipeline stage MKMLizer completed in 616.68s
Creating inference service chaiml-mistral-24b-2048-15988-v2
run pipeline stage %s
Waiting for inference service chaiml-mistral-24b-2048-15988-v2 to be ready
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.25s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-96216-v5
Waiting for inference service chaiml-mistral-24b-2048-96216-v5 to be ready
chaiml-mistral-24b-2048-62542-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-62542-v3/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-62542-v3-mkmlizer completed after 665.95s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-62542-v3-mkmlizer
Pipeline stage MKMLizer completed in 668.78s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.02s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-62542-v3
Waiting for inference service chaiml-mistral-24b-2048-62542-v3 to be ready
Inference service chaiml-mistral-24b-2048-3092-v3 ready after 152.43854594230652s
Pipeline stage MKMLDeployer completed in 156.16s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.045928955078125s
Received healthy response to inference request in 3.4454939365386963s
Received healthy response to inference request in 3.571575403213501s
Received healthy response to inference request in 3.5090737342834473s
Inference service chaiml-mistral-24b-2048-15988-v2 ready after 152.47177910804749s
Pipeline stage MKMLDeployer completed in 156.89s
Received healthy response to inference request in 3.462815999984741s
Inference service chaiml-mistral-24b-2048-54327-v7 ready after 162.77367401123047s
run pipeline stage %s
5 requests
Pipeline stage MKMLDeployer completed in 167.74s
Running pipeline stage StressChecker
0 failed requests
run pipeline stage %s
5th percentile: 3.4489583492279055
Running pipeline stage StressChecker
10th percentile: 3.452422761917114
20th percentile: 3.459351587295532
30th percentile: 3.4720675468444826
40th percentile: 3.490570640563965
Received healthy response to inference request in 3.387519598007202s
50th percentile: 3.5090737342834473
Received healthy response to inference request in 3.3849401473999023s
60th percentile: 3.534074401855469
70th percentile: 3.5590750694274904
80th percentile: 3.6664461135864257
90th percentile: 3.8561875343322756
Received healthy response to inference request in 3.3752334117889404s
95th percentile: 3.9510582447052003
Received healthy response to inference request in 3.3320329189300537s
99th percentile: 4.02695481300354
mean time: 3.606977605819702
Inference service chaiml-mistral-24b-2048-96216-v5 ready after 162.8445920944214s
Pipeline stage StressChecker completed in 38.75s
Pipeline stage MKMLDeployer completed in 166.91s
Received healthy response to inference request in 3.220423936843872s
run pipeline stage %s
run pipeline stage %s
Received healthy response to inference request in 3.0453977584838867s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Running pipeline stage StressChecker
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.28279709815979s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.4185004234313965s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.32s
Received healthy response to inference request in 3.137516975402832s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.595752000808716s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.1694183349609375s
5 requests
Received healthy response to inference request in 3.216071367263794s
5 requests
triggered trigger_guanaco_pipeline args=%s
0 failed requests
0 failed requests
Pipeline stage TriggerMKMLProfilingPipeline completed in 4.11s
5th percentile: 3.2328985691070558
5th percentile: 3.070201873779297
Shutdown handler de-registered
10th percentile: 3.2453732013702394
10th percentile: 3.095005989074707
Received healthy response to inference request in 2.8734474182128906s
20th percentile: 3.2703224658966064
chaiml-mistral-24b-2048-_3092_v3 status is now deployed due to DeploymentManager action
20th percentile: 3.1446142196655273
30th percentile: 3.30128436088562
30th percentile: 3.2019412517547607
40th percentile: 3.33825888633728
40th percentile: 3.2669870853424072
50th percentile: 3.3752334117889404
50th percentile: 3.3320329189300537
Received healthy response to inference request in 3.3258330821990967s
60th percentile: 3.3801478862762453
60th percentile: 3.353195810317993
70th percentile: 3.3850623607635497
70th percentile: 3.3743587017059324
80th percentile: 3.429166078567505
80th percentile: 3.3916522026062013
90th percentile: 3.5124590396881104
90th percentile: 3.4050763130187987
95th percentile: 3.554105520248413
Received healthy response to inference request in 2.852766752243042s
95th percentile: 3.4117883682250976
99th percentile: 3.5874227046966554
5 requests
99th percentile: 3.4171580123901366
mean time: 3.372345209121704
0 failed requests
mean time: 3.2700579166412354
Pipeline stage StressChecker completed in 37.91s
5th percentile: 2.8569028854370115
Pipeline stage StressChecker completed in 36.63s
run pipeline stage %s
10th percentile: 2.8610390186309815
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
20th percentile: 2.869311285018921
Inference service chaiml-mistral-24b-2048-62542-v3 ready after 152.39171624183655s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
30th percentile: 2.926261329650879
Pipeline stage MKMLDeployer completed in 156.63s
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
40th percentile: 3.0318891525268556
run pipeline stage %s
starting trigger_guanaco_pipeline args=%s
50th percentile: 3.137516975402832
Running pipeline stage StressChecker
triggered trigger_guanaco_pipeline args=%s
60th percentile: 3.168938732147217
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.75s
70th percentile: 3.2003604888916017
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.09s
run pipeline stage %s
80th percentile: 3.2380237102508547
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
90th percentile: 3.2819283962249757
Running pipeline stage TriggerMKMLProfilingPipeline
Received healthy response to inference request in 3.446960210800171s
run_pipeline:run_in_cloud %s
95th percentile: 3.303880739212036
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
99th percentile: 3.3214426136016844
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
mean time: 3.0811271190643312
Pipeline stage TriggerMKMLProfilingPipeline completed in 4.81s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage StressChecker completed in 36.56s
Shutdown handler de-registered
Received healthy response to inference request in 3.6278932094573975s
chaiml-mistral-24b-2048_15988_v2 status is now deployed due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
chaiml-mistral-24b-2048_54327_v7 status is now deployed due to DeploymentManager action
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.0258755683898926s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.08s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.242341995239258s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.35s
Shutdown handler de-registered
chaiml-mistral-24b-2048_96216_v5 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048_96216_v5 status is now inactive due to auto deactivation removed underperforming models
chaiml-mistral-24b-2048_96216_v5 status is now torndown due to DeploymentManager action