Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-76177-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-86542-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-43874-v2-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-96633-v3-mkmlizer to finish
chaiml-mistral-24b-2048-76177-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-76177-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Downloaded to shared memory in 87.419s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmptrya8kdx, device:0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Downloaded to shared memory in 88.185s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged already exists in ChaiML
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmprxnhlspj, device:0
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Downloaded to shared memory in 83.519s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged already exists in ChaiML
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp8x96bzps, device:0
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Downloaded to shared memory in 85.670s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp0orit2cp, device:0
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Downloaded to shared memory in 90.956s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged already exists in ChaiML
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp042ru3xu, device:0
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-76177-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:32, 1.32it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:32, 1.32it/s]
Loading 0: 1%| | 4.00/363 [00:04<06:44, 1.13s/it]
Loading 0: 1%| | 4.00/363 [00:04<06:44, 1.13s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:26, 1.41s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:26, 1.41s/it]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:40, 1.00s/it]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0: 9%|▉ | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0: 9%|▉ | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:44, 1.46it/s]
Loading 0: 10%|▉ | 36.0/363 [00:27<04:44, 1.15it/s]
Loading 0: 10%|▉ | 36.0/363 [00:27<04:44, 1.15it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:15, 1.27it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:15, 1.27it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:34<02:31, 2.08it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:34<02:31, 2.08it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:52, 1.81it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:52, 1.81it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:38<03:38, 1.42it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:40<04:33, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:44<04:52, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:44<04:52, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:22, 2.08it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:16, 1.13it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0: 21%|██ | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0: 21%|██ | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:54, 2.31it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:54, 2.31it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:09, 2.02it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:09, 2.02it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:47, 1.55it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:47, 1.55it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:33, 1.22it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:33, 1.22it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:47, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:47, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.09it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.09it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<01:59, 2.02it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<01:59, 2.02it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:14, 1.78it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:14, 1.78it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:50, 1.40it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:50, 1.40it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:32, 1.11it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:32, 1.11it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 38%|███▊ | 139/363 [01:40<01:47, 2.08it/s]
Loading 0: 38%|███▊ | 139/363 [01:40<01:47, 2.08it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.82it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.82it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.43it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.43it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:26, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:26, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:52<04:05, 1.15s/it]
Loading 0: 41%|████ | 149/363 [01:52<04:05, 1.15s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.09it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.09it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.82it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.82it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.26it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.26it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.09it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.09it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.83it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.83it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.05it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.05it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:21, 2.10it/s]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:21, 2.10it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.83it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.83it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.43it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.43it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:24, 1.14it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:24, 1.14it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.15s/it]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.15s/it]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:13, 2.08it/s]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:13, 2.08it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:21, 1.82it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:21, 1.82it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.15s/it]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.15s/it]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:03, 2.10it/s]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:03, 2.10it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:11, 1.84it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:11, 1.84it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.14it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.14it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.09it/s]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.09it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:11<02:01, 1.15s/it]
Loading 0: 71%|███████ | 257/363 [03:11<02:01, 1.15s/it]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.10it/s]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.10it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.84it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.84it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:37, 2.41s/it]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:37, 2.41s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:28, 2.34s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:28, 2.34s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:21, 2.29s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:21, 2.29s/it]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.16it/s]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.16it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:03, 1.21it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:03, 1.21it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:11, 1.06it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:11, 1.06it/s]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:22, 1.10s/it]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:22, 1.10s/it]
Loading 0: 80%|████████ | 291/363 [03:46<01:06, 1.08it/s]
Loading 0: 80%|████████ | 291/363 [03:46<01:06, 1.08it/s]
Loading 0: 80%|████████ | 292/363 [03:48<01:16, 1.07s/it]
Loading 0: 80%|████████ | 292/363 [03:48<01:16, 1.07s/it]
Loading 0: 81%|████████ | 293/363 [03:50<01:26, 1.24s/it]
Loading 0: 81%|████████ | 293/363 [03:50<01:26, 1.24s/it]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:51, 1.12it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:51, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.15s/it]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.15s/it]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0: 94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0: 94%|█████████▎| 340/363 [04:20<00:12, 1.83it/s]
Loading 0: 94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0: 94%|█████████▍| 341/363 [04:22<00:15, 1.43it/s]
Loading 0: 94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0: 94%|█████████▍| 342/363 [04:24<00:18, 1.14it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.26it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.15s/it]
Loading 0: 98%|█████████▊| 355/363 [04:31<00:03, 2.09it/s]
Loading 0: 98%|█████████▊| 355/363 [04:31<00:03, 2.09it/s]
Loading 0: 99%|█████████▉| 359/363 [04:33<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 359/363 [04:33<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 360/363 [04:35<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 360/363 [04:35<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmptrya8kdx' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantized model in 284.265s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged in 371.685s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:20, 1.38it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:20, 1.38it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:03, 1.18s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:03, 1.18s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:05, 1.53s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:05, 1.53s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:10, 1.84it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:10, 1.84it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:07, 1.41it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:07, 1.41it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:25, 1.07it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:25, 1.07it/s]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:49, 1.18s/it]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:49, 1.18s/it]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:09, 1.37it/s]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:09, 1.37it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:10, 1.10it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:10, 1.10it/s]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:20, 1.12s/it]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:20, 1.12s/it]
Loading 0: 8%|▊ | 30.0/363 [00:22<02:58, 1.87it/s]
Loading 0: 8%|▊ | 30.0/363 [00:22<02:58, 1.87it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:28, 1.58it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:28, 1.58it/s]
Loading 0: 10%|▉ | 35.0/363 [00:28<04:20, 1.26it/s]
Loading 0: 10%|▉ | 35.0/363 [00:28<04:20, 1.26it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:22, 1.02it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:22, 1.02it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:47, 1.13it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:47, 1.13it/s]
Loading 0: 11%|█ | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0: 11%|█ | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:35, 1.23s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:35, 1.23s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:37<02:41, 1.94it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:37<02:41, 1.94it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<02:59, 1.73it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<02:59, 1.73it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<03:45, 1.38it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<03:45, 1.38it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:44<04:40, 1.10it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:44<04:40, 1.10it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:46<04:08, 1.23it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:46<04:08, 1.23it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:47<04:58, 1.02it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:47<04:58, 1.02it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:49<05:54, 1.17s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:49<05:54, 1.17s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:51<02:24, 2.05it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:51<02:24, 2.05it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:53<02:43, 1.79it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:53<02:43, 1.79it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:55<03:26, 1.41it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:55<03:26, 1.41it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:57<04:19, 1.12it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:57<04:19, 1.12it/s]
Loading 0: 21%|██ | 75.0/363 [00:59<03:50, 1.25it/s]
Loading 0: 21%|██ | 75.0/363 [00:59<03:50, 1.25it/s]
Loading 0: 21%|██ | 76.0/363 [01:01<04:37, 1.03it/s]
Loading 0: 21%|██ | 76.0/363 [01:01<04:37, 1.03it/s]
Loading 0: 21%|██ | 77.0/363 [01:03<05:30, 1.16s/it]
Loading 0: 21%|██ | 77.0/363 [01:03<05:30, 1.16s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:04<02:14, 2.06it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:04<02:14, 2.06it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:06<02:32, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:06<02:32, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:08<03:13, 1.42it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:08<03:13, 1.42it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:10<04:02, 1.12it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:10<04:02, 1.12it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:11<01:55, 2.30it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:11<01:55, 2.30it/s]
Loading 0: 28%|██▊ | 101/363 [01:13<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 101/363 [01:13<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 102/363 [01:15<02:49, 1.54it/s]
Loading 0: 28%|██▊ | 102/363 [01:15<02:49, 1.54it/s]
Loading 0: 28%|██▊ | 103/363 [01:17<03:35, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:17<03:35, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:19<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 106/363 [01:19<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 107/363 [01:21<04:01, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:21<04:01, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:23<04:48, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:23<04:48, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:25<03:53, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:25<03:53, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:27<04:34, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:27<04:34, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:29<05:19, 1.28s/it]
Loading 0: 31%|███ | 113/363 [01:29<05:19, 1.28s/it]
Loading 0: 33%|███▎ | 120/363 [01:30<02:08, 1.89it/s]
Loading 0: 33%|███▎ | 120/363 [01:30<02:08, 1.89it/s]
Loading 0: 34%|███▍ | 124/363 [01:33<02:13, 1.79it/s]
Loading 0: 34%|███▍ | 124/363 [01:33<02:13, 1.79it/s]
Loading 0: 34%|███▍ | 125/363 [01:35<02:49, 1.41it/s]
Loading 0: 34%|███▍ | 125/363 [01:35<02:49, 1.41it/s]
Loading 0: 35%|███▍ | 126/363 [01:37<03:32, 1.12it/s]
Loading 0: 35%|███▍ | 126/363 [01:37<03:32, 1.12it/s]
Loading 0: 36%|███▌ | 129/363 [01:39<03:08, 1.24it/s]
Loading 0: 36%|███▌ | 129/363 [01:39<03:08, 1.24it/s]
Loading 0: 36%|███▌ | 130/363 [01:41<03:46, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:41<03:46, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:43<04:28, 1.16s/it]
Loading 0: 36%|███▌ | 131/363 [01:43<04:28, 1.16s/it]
Loading 0: 38%|███▊ | 138/363 [01:44<01:55, 1.96it/s]
Loading 0: 38%|███▊ | 138/363 [01:44<01:55, 1.96it/s]
Loading 0: 39%|███▉ | 142/363 [01:46<02:01, 1.83it/s]
Loading 0: 39%|███▉ | 142/363 [01:46<02:01, 1.83it/s]
Loading 0: 39%|███▉ | 143/363 [01:48<02:33, 1.43it/s]
Loading 0: 39%|███▉ | 143/363 [01:48<02:33, 1.43it/s]
Loading 0: 40%|███▉ | 144/363 [01:50<03:12, 1.14it/s]
Loading 0: 40%|███▉ | 144/363 [01:50<03:12, 1.14it/s]
Loading 0: 40%|████ | 147/363 [01:52<02:51, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:52<02:51, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:54<03:26, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:54<03:26, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:56<04:06, 1.15s/it]
Loading 0: 41%|████ | 149/363 [01:56<04:06, 1.15s/it]
Loading 0: 43%|████▎ | 157/363 [01:57<01:40, 2.05it/s]
Loading 0: 43%|████▎ | 157/363 [01:57<01:40, 2.05it/s]
Loading 0: 44%|████▍ | 160/363 [01:59<01:52, 1.80it/s]
Loading 0: 44%|████▍ | 160/363 [01:59<01:52, 1.80it/s]
Loading 0: 44%|████▍ | 161/363 [02:01<02:22, 1.41it/s]
Loading 0: 44%|████▍ | 161/363 [02:01<02:22, 1.41it/s]
Loading 0: 45%|████▍ | 162/363 [02:03<02:58, 1.12it/s]
Loading 0: 45%|████▍ | 162/363 [02:03<02:58, 1.12it/s]
Loading 0: 45%|████▌ | 165/363 [02:05<02:38, 1.25it/s]
Loading 0: 45%|████▌ | 165/363 [02:05<02:38, 1.25it/s]
Loading 0: 46%|████▌ | 166/363 [02:07<03:10, 1.03it/s]
Loading 0: 46%|████▌ | 166/363 [02:07<03:10, 1.03it/s]
Loading 0: 46%|████▌ | 167/363 [02:09<03:46, 1.16s/it]
Loading 0: 46%|████▌ | 167/363 [02:09<03:46, 1.16s/it]
Loading 0: 48%|████▊ | 175/363 [02:11<01:31, 2.05it/s]
Loading 0: 48%|████▊ | 175/363 [02:11<01:31, 2.05it/s]
Loading 0: 49%|████▉ | 178/363 [02:13<01:42, 1.80it/s]
Loading 0: 49%|████▉ | 178/363 [02:13<01:42, 1.80it/s]
Loading 0: 49%|████▉ | 179/363 [02:15<02:10, 1.41it/s]
Loading 0: 49%|████▉ | 179/363 [02:15<02:10, 1.41it/s]
Loading 0: 50%|████▉ | 180/363 [02:17<02:42, 1.12it/s]
Loading 0: 50%|████▉ | 180/363 [02:17<02:42, 1.12it/s]
Loading 0: 50%|█████ | 183/363 [02:19<02:23, 1.25it/s]
Loading 0: 50%|█████ | 183/363 [02:19<02:23, 1.25it/s]
Loading 0: 51%|█████ | 184/363 [02:21<02:53, 1.03it/s]
Loading 0: 51%|█████ | 184/363 [02:21<02:53, 1.03it/s]
Loading 0: 51%|█████ | 185/363 [02:23<03:26, 1.16s/it]
Loading 0: 51%|█████ | 185/363 [02:23<03:26, 1.16s/it]
Loading 0: 53%|█████▎ | 193/363 [02:24<01:22, 2.05it/s]
Loading 0: 53%|█████▎ | 193/363 [02:24<01:22, 2.05it/s]
Loading 0: 54%|█████▍ | 196/363 [02:26<01:32, 1.80it/s]
Loading 0: 54%|█████▍ | 196/363 [02:26<01:32, 1.80it/s]
Loading 0: 54%|█████▍ | 197/363 [02:28<01:57, 1.41it/s]
Loading 0: 54%|█████▍ | 197/363 [02:28<01:57, 1.41it/s]
Loading 0: 55%|█████▍ | 198/363 [02:30<02:26, 1.13it/s]
Loading 0: 55%|█████▍ | 198/363 [02:30<02:26, 1.13it/s]
Loading 0: 55%|█████▌ | 201/363 [02:32<02:09, 1.25it/s]
Loading 0: 55%|█████▌ | 201/363 [02:32<02:09, 1.25it/s]
Loading 0: 56%|█████▌ | 202/363 [02:34<02:35, 1.03it/s]
Loading 0: 56%|█████▌ | 202/363 [02:34<02:35, 1.03it/s]
Loading 0: 56%|█████▌ | 203/363 [02:36<03:04, 1.16s/it]
Loading 0: 56%|█████▌ | 203/363 [02:36<03:04, 1.16s/it]
Loading 0: 58%|█████▊ | 210/363 [02:37<01:18, 1.96it/s]
Loading 0: 58%|█████▊ | 210/363 [02:37<01:18, 1.96it/s]
Loading 0: 59%|█████▉ | 214/363 [02:39<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 214/363 [02:39<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 215/363 [02:41<01:43, 1.44it/s]
Loading 0: 59%|█████▉ | 215/363 [02:41<01:43, 1.44it/s]
Loading 0: 60%|█████▉ | 216/363 [02:43<02:08, 1.14it/s]
Loading 0: 60%|█████▉ | 216/363 [02:43<02:08, 1.14it/s]
Loading 0: 60%|██████ | 219/363 [02:45<01:53, 1.27it/s]
Loading 0: 60%|██████ | 219/363 [02:45<01:53, 1.27it/s]
Loading 0: 61%|██████ | 220/363 [02:47<02:17, 1.04it/s]
Loading 0: 61%|██████ | 220/363 [02:47<02:17, 1.04it/s]
Loading 0: 61%|██████ | 221/363 [02:49<02:43, 1.15s/it]
Loading 0: 61%|██████ | 221/363 [02:49<02:43, 1.15s/it]
Loading 0: 63%|██████▎ | 229/363 [02:51<01:04, 2.07it/s]
Loading 0: 63%|██████▎ | 229/363 [02:51<01:04, 2.07it/s]
Loading 0: 64%|██████▍ | 232/363 [02:53<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 232/363 [02:53<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 233/363 [02:55<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 233/363 [02:55<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 234/363 [02:57<01:53, 1.13it/s]
Loading 0: 64%|██████▍ | 234/363 [02:57<01:53, 1.13it/s]
Loading 0: 65%|██████▌ | 237/363 [02:59<01:40, 1.26it/s]
Loading 0: 65%|██████▌ | 237/363 [02:59<01:40, 1.26it/s]
Loading 0: 66%|██████▌ | 238/363 [03:01<02:00, 1.04it/s]
Loading 0: 66%|██████▌ | 238/363 [03:01<02:00, 1.04it/s]
Loading 0: 66%|██████▌ | 239/363 [03:03<02:22, 1.15s/it]
Loading 0: 66%|██████▌ | 239/363 [03:03<02:22, 1.15s/it]
Loading 0: 68%|██████▊ | 247/363 [03:04<00:56, 2.07it/s]
Loading 0: 68%|██████▊ | 247/363 [03:04<00:56, 2.07it/s]
Loading 0: 69%|██████▉ | 250/363 [03:06<01:02, 1.81it/s]
Loading 0: 69%|██████▉ | 250/363 [03:06<01:02, 1.81it/s]
Loading 0: 69%|██████▉ | 251/363 [03:08<01:19, 1.42it/s]
Loading 0: 69%|██████▉ | 251/363 [03:08<01:19, 1.42it/s]
Loading 0: 69%|██████▉ | 252/363 [03:10<01:38, 1.13it/s]
Loading 0: 69%|██████▉ | 252/363 [03:10<01:38, 1.13it/s]
Loading 0: 70%|███████ | 255/363 [03:12<01:26, 1.25it/s]
Loading 0: 70%|███████ | 255/363 [03:12<01:26, 1.25it/s]
Loading 0: 71%|███████ | 256/363 [03:14<01:43, 1.03it/s]
Loading 0: 71%|███████ | 256/363 [03:14<01:43, 1.03it/s]
Loading 0: 71%|███████ | 257/363 [03:16<02:02, 1.16s/it]
Loading 0: 71%|███████ | 257/363 [03:16<02:02, 1.16s/it]
Loading 0: 73%|███████▎ | 265/363 [03:17<00:47, 2.08it/s]
Loading 0: 73%|███████▎ | 265/363 [03:17<00:47, 2.08it/s]
Loading 0: 74%|███████▍ | 268/363 [03:19<00:52, 1.81it/s]
Loading 0: 74%|███████▍ | 268/363 [03:19<00:52, 1.81it/s]
Loading 0: 74%|███████▍ | 269/363 [03:21<01:06, 1.42it/s]
Loading 0: 74%|███████▍ | 269/363 [03:21<01:06, 1.42it/s]
Loading 0: 74%|███████▍ | 270/363 [03:23<01:22, 1.12it/s]
Loading 0: 74%|███████▍ | 270/363 [03:23<01:22, 1.12it/s]
Loading 0: 75%|███████▌ | 273/363 [03:39<03:43, 2.48s/it]
Loading 0: 75%|███████▌ | 273/363 [03:39<03:43, 2.48s/it]
Loading 0: 75%|███████▌ | 274/363 [03:41<03:33, 2.40s/it]
Loading 0: 75%|███████▌ | 274/363 [03:41<03:33, 2.40s/it]
Loading 0: 76%|███████▌ | 275/363 [03:43<03:26, 2.35s/it]
Loading 0: 76%|███████▌ | 275/363 [03:43<03:26, 2.35s/it]
Loading 0: 78%|███████▊ | 283/363 [03:44<01:10, 1.14it/s]
Loading 0: 78%|███████▊ | 283/363 [03:44<01:10, 1.14it/s]
Loading 0: 79%|███████▉ | 286/363 [03:46<01:04, 1.20it/s]
Loading 0: 79%|███████▉ | 286/363 [03:46<01:04, 1.20it/s]
Loading 0: 79%|███████▉ | 287/363 [03:48<01:11, 1.06it/s]
Loading 0: 79%|███████▉ | 287/363 [03:48<01:11, 1.06it/s]
Loading 0: 79%|███████▉ | 288/363 [03:50<01:22, 1.10s/it]
Loading 0: 79%|███████▉ | 288/363 [03:50<01:22, 1.10s/it]
Loading 0: 80%|████████ | 291/363 [03:52<01:06, 1.09it/s]
Loading 0: 80%|████████ | 291/363 [03:52<01:06, 1.09it/s]
Loading 0: 80%|████████ | 292/363 [03:54<01:16, 1.07s/it]
Loading 0: 80%|████████ | 292/363 [03:54<01:16, 1.07s/it]
Loading 0: 81%|████████ | 293/363 [03:56<01:27, 1.25s/it]
Loading 0: 81%|████████ | 293/363 [03:56<01:27, 1.25s/it]
Loading 0: 83%|████████▎ | 301/363 [03:57<00:31, 1.96it/s]
Loading 0: 83%|████████▎ | 301/363 [03:57<00:31, 1.96it/s]
Loading 0: 84%|████████▎ | 304/363 [03:59<00:33, 1.77it/s]
Loading 0: 84%|████████▎ | 304/363 [03:59<00:33, 1.77it/s]
Loading 0: 84%|████████▍ | 305/363 [04:01<00:41, 1.39it/s]
Loading 0: 84%|████████▍ | 305/363 [04:01<00:41, 1.39it/s]
Loading 0: 84%|████████▍ | 306/363 [04:03<00:51, 1.11it/s]
Loading 0: 84%|████████▍ | 306/363 [04:03<00:51, 1.11it/s]
Loading 0: 85%|████████▌ | 309/363 [04:05<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [04:05<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:07<00:51, 1.03it/s]
Loading 0: 85%|████████▌ | 310/363 [04:07<00:51, 1.03it/s]
Loading 0: 86%|████████▌ | 311/363 [04:09<01:00, 1.16s/it]
Loading 0: 86%|████████▌ | 311/363 [04:09<01:00, 1.16s/it]
Loading 0: 88%|████████▊ | 319/363 [04:10<00:21, 2.07it/s]
Loading 0: 88%|████████▊ | 319/363 [04:10<00:21, 2.07it/s]
Loading 0: 89%|████████▊ | 322/363 [04:13<00:22, 1.81it/s]
Loading 0: 89%|████████▊ | 322/363 [04:13<00:22, 1.81it/s]
Loading 0: 89%|████████▉ | 323/363 [04:14<00:28, 1.41it/s]
Loading 0: 89%|████████▉ | 323/363 [04:14<00:28, 1.41it/s]
Loading 0: 89%|████████▉ | 324/363 [04:17<00:34, 1.12it/s]
Loading 0: 89%|████████▉ | 324/363 [04:17<00:34, 1.12it/s]
Loading 0: 90%|█████████ | 327/363 [04:18<00:29, 1.24it/s]
Loading 0: 90%|█████████ | 327/363 [04:18<00:29, 1.24it/s]
Loading 0: 90%|█████████ | 328/363 [04:20<00:34, 1.02it/s]
Loading 0: 90%|█████████ | 328/363 [04:20<00:34, 1.02it/s]
Loading 0: 91%|█████████ | 329/363 [04:23<00:39, 1.17s/it]
Loading 0: 91%|█████████ | 329/363 [04:23<00:39, 1.17s/it]
Loading 0: 93%|█████████▎| 337/363 [04:24<00:12, 2.07it/s]
Loading 0: 93%|█████████▎| 337/363 [04:24<00:12, 2.07it/s]
Loading 0: 94%|█████████▎| 340/363 [04:26<00:12, 1.80it/s]
Loading 0: 94%|█████████▎| 340/363 [04:26<00:12, 1.80it/s]
Loading 0: 94%|█████████▍| 341/363 [04:28<00:15, 1.41it/s]
Loading 0: 94%|█████████▍| 341/363 [04:28<00:15, 1.41it/s]
Loading 0: 94%|█████████▍| 342/363 [04:30<00:18, 1.12it/s]
Loading 0: 94%|█████████▍| 342/363 [04:30<00:18, 1.12it/s]
Loading 0: 95%|█████████▌| 345/363 [04:32<00:14, 1.24it/s]
Loading 0: 95%|█████████▌| 345/363 [04:32<00:14, 1.24it/s]
Loading 0: 95%|█████████▌| 346/363 [04:34<00:16, 1.02it/s]
Loading 0: 95%|█████████▌| 346/363 [04:34<00:16, 1.02it/s]
Loading 0: 96%|█████████▌| 347/363 [04:36<00:18, 1.17s/it]
Loading 0: 96%|█████████▌| 347/363 [04:36<00:18, 1.17s/it]
Loading 0: 98%|█████████▊| 355/363 [04:37<00:03, 2.06it/s]
Loading 0: 98%|█████████▊| 355/363 [04:37<00:03, 2.06it/s]
Loading 0: 99%|█████████▉| 359/363 [04:40<00:02, 1.84it/s]
Loading 0: 99%|█████████▉| 359/363 [04:40<00:02, 1.84it/s]
Loading 0: 99%|█████████▉| 360/363 [04:42<00:02, 1.45it/s]
Loading 0: 99%|█████████▉| 360/363 [04:42<00:02, 1.45it/s]
Loading 0: 99%|█████████▉| 361/363 [04:44<00:01, 1.16it/s]
Loading 0: 99%|█████████▉| 361/363 [04:44<00:01, 1.16it/s]
Loading 0: 100%|██████████| 363/363 [04:44<00:00, 1.16it/s]
Loading 0: 100%|██████████| 363/363 [04:44<00:00, 1.28it/s]
chaiml-mistral-24b-2048-96633-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmp0orit2cp' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantized model in 285.136s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged in 370.807s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp8x96bzps' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantized model in 291.990s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged in 375.511s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:45, 1.26it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:45, 1.26it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:43, 1.29s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:43, 1.29s/it]
Loading 0: 1%|▏ | 5.00/363 [00:07<09:54, 1.66s/it]
Loading 0: 1%|▏ | 5.00/363 [00:07<09:54, 1.66s/it]
Loading 0: 3%|▎ | 11.0/363 [00:08<03:25, 1.71it/s]
Loading 0: 3%|▎ | 11.0/363 [00:08<03:25, 1.71it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0: 4%|▍ | 14.0/363 [00:13<05:50, 1.00s/it]
Loading 0: 4%|▍ | 14.0/363 [00:13<05:50, 1.00s/it]
Loading 0: 4%|▍ | 15.0/363 [00:15<07:21, 1.27s/it]
Loading 0: 4%|▍ | 15.0/363 [00:15<07:21, 1.27s/it]
Loading 0: 6%|▌ | 21.0/363 [00:18<04:28, 1.27it/s]
Loading 0: 6%|▌ | 21.0/363 [00:18<04:28, 1.27it/s]
Loading 0: 6%|▌ | 22.0/363 [00:20<05:35, 1.02it/s]
Loading 0: 6%|▌ | 22.0/363 [00:20<05:35, 1.02it/s]
Loading 0: 6%|▋ | 23.0/363 [00:23<06:51, 1.21s/it]
Loading 0: 6%|▋ | 23.0/363 [00:23<06:51, 1.21s/it]
Loading 0: 8%|▊ | 30.0/363 [00:24<03:14, 1.72it/s]
Loading 0: 8%|▊ | 30.0/363 [00:24<03:14, 1.72it/s]
Loading 0: 9%|▉ | 34.0/363 [00:27<03:28, 1.57it/s]
Loading 0: 9%|▉ | 34.0/363 [00:27<03:28, 1.57it/s]
Loading 0: 10%|▉ | 35.0/363 [00:29<04:30, 1.21it/s]
Loading 0: 10%|▉ | 35.0/363 [00:29<04:30, 1.21it/s]
Loading 0: 10%|▉ | 36.0/363 [00:32<05:36, 1.03s/it]
Loading 0: 10%|▉ | 36.0/363 [00:32<05:36, 1.03s/it]
Loading 0: 11%|█ | 39.0/363 [00:34<05:01, 1.08it/s]
Loading 0: 11%|█ | 39.0/363 [00:34<05:01, 1.08it/s]
Loading 0: 11%|█ | 40.0/363 [00:36<06:02, 1.12s/it]
Loading 0: 11%|█ | 40.0/363 [00:36<06:02, 1.12s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:39<07:10, 1.34s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:39<07:10, 1.34s/it]
Loading 0: 13%|█▎ | 48.0/363 [00:40<03:06, 1.69it/s]
Loading 0: 13%|█▎ | 48.0/363 [00:40<03:06, 1.69it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:43<03:15, 1.59it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:43<03:15, 1.59it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:45<04:08, 1.25it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:45<04:08, 1.25it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:47<05:11, 1.01s/it]
Loading 0: 15%|█▍ | 54.0/363 [00:47<05:11, 1.01s/it]
Loading 0: 16%|█▌ | 57.0/363 [00:49<04:38, 1.10it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:49<04:38, 1.10it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:52<05:37, 1.11s/it]
Loading 0: 16%|█▌ | 58.0/363 [00:52<05:37, 1.11s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:54<06:42, 1.32s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:54<06:42, 1.32s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:55<02:54, 1.70it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:55<02:54, 1.70it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:58<03:04, 1.59it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:58<03:04, 1.59it/s]
Loading 0: 20%|█▉ | 71.0/363 [01:00<03:54, 1.24it/s]
Loading 0: 20%|█▉ | 71.0/363 [01:00<03:54, 1.24it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:03<04:55, 1.01s/it]
Loading 0: 20%|█▉ | 72.0/363 [01:03<04:55, 1.01s/it]
Loading 0: 21%|██ | 75.0/363 [01:05<04:23, 1.09it/s]
Loading 0: 21%|██ | 75.0/363 [01:05<04:23, 1.09it/s]
Loading 0: 21%|██ | 76.0/363 [01:07<05:17, 1.10s/it]
Loading 0: 21%|██ | 76.0/363 [01:07<05:17, 1.10s/it]
Loading 0: 21%|██ | 77.0/363 [01:09<06:16, 1.32s/it]
Loading 0: 21%|██ | 77.0/363 [01:09<06:16, 1.32s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:10<02:41, 1.73it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:10<02:41, 1.73it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:13<02:50, 1.61it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:13<02:50, 1.61it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:15<03:36, 1.26it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:15<03:36, 1.26it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:18<04:31, 1.00it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:18<04:31, 1.00it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:19<02:16, 1.95it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:19<02:16, 1.95it/s]
Loading 0: 28%|██▊ | 101/363 [01:21<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 101/363 [01:21<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 102/363 [01:24<03:09, 1.38it/s]
Loading 0: 28%|██▊ | 102/363 [01:24<03:09, 1.38it/s]
Loading 0: 28%|██▊ | 103/363 [01:26<04:02, 1.07it/s]
Loading 0: 28%|██▊ | 103/363 [01:26<04:02, 1.07it/s]
Loading 0: 29%|██▉ | 106/363 [01:28<03:47, 1.13it/s]
Loading 0: 29%|██▉ | 106/363 [01:28<03:47, 1.13it/s]
Loading 0: 29%|██▉ | 107/363 [01:31<04:44, 1.11s/it]
Loading 0: 29%|██▉ | 107/363 [01:31<04:44, 1.11s/it]
Loading 0: 30%|██▉ | 108/363 [01:33<05:40, 1.34s/it]
Loading 0: 30%|██▉ | 108/363 [01:33<05:40, 1.34s/it]
Loading 0: 31%|███ | 111/363 [01:36<04:38, 1.11s/it]
Loading 0: 31%|███ | 111/363 [01:36<04:38, 1.11s/it]
Loading 0: 31%|███ | 112/363 [01:38<05:32, 1.32s/it]
Loading 0: 31%|███ | 112/363 [01:38<05:32, 1.32s/it]
Loading 0: 31%|███ | 113/363 [01:40<06:26, 1.55s/it]
Loading 0: 31%|███ | 113/363 [01:40<06:26, 1.55s/it]
Loading 0: 33%|███▎ | 120/363 [01:42<02:35, 1.56it/s]
Loading 0: 33%|███▎ | 120/363 [01:42<02:35, 1.56it/s]
Loading 0: 34%|███▍ | 124/363 [01:45<02:55, 1.36it/s]
Loading 0: 34%|███▍ | 124/363 [01:45<02:55, 1.36it/s]
Loading 0: 34%|███▍ | 125/363 [01:48<03:50, 1.03it/s]
Loading 0: 34%|███▍ | 125/363 [01:48<03:50, 1.03it/s]
Loading 0: 35%|███▍ | 126/363 [01:51<04:35, 1.16s/it]
Loading 0: 35%|███▍ | 126/363 [01:51<04:35, 1.16s/it]
Loading 0: 36%|███▌ | 129/363 [01:53<03:56, 1.01s/it]
Loading 0: 36%|███▌ | 129/363 [01:53<03:56, 1.01s/it]
Loading 0: 36%|███▌ | 130/363 [01:55<04:47, 1.23s/it]
Loading 0: 36%|███▌ | 130/363 [01:55<04:47, 1.23s/it]
Loading 0: 36%|███▌ | 131/363 [01:58<05:47, 1.50s/it]
Loading 0: 36%|███▌ | 131/363 [01:58<05:47, 1.50s/it]
Loading 0: 38%|███▊ | 138/363 [01:59<02:27, 1.52it/s]
Loading 0: 38%|███▊ | 138/363 [01:59<02:27, 1.52it/s]
Loading 0: 39%|███▉ | 142/363 [02:02<02:34, 1.43it/s]
Loading 0: 39%|███▉ | 142/363 [02:02<02:34, 1.43it/s]
Loading 0: 39%|███▉ | 143/363 [02:05<03:13, 1.14it/s]
Loading 0: 39%|███▉ | 143/363 [02:05<03:13, 1.14it/s]
Loading 0: 40%|███▉ | 144/363 [02:07<03:59, 1.09s/it]
Loading 0: 40%|███▉ | 144/363 [02:07<03:59, 1.09s/it]
Loading 0: 40%|████ | 147/363 [02:10<03:31, 1.02it/s]
Loading 0: 40%|████ | 147/363 [02:10<03:31, 1.02it/s]
Loading 0: 41%|████ | 148/363 [02:12<04:14, 1.19s/it]
Loading 0: 41%|████ | 148/363 [02:12<04:14, 1.19s/it]
Loading 0: 41%|████ | 149/363 [02:14<05:02, 1.41s/it]
Loading 0: 41%|████ | 149/363 [02:14<05:02, 1.41s/it]
Loading 0: 43%|████▎ | 156/363 [02:16<02:08, 1.61it/s]
Loading 0: 43%|████▎ | 156/363 [02:16<02:08, 1.61it/s]
Loading 0: 44%|████▍ | 160/363 [02:18<02:12, 1.54it/s]
Loading 0: 44%|████▍ | 160/363 [02:18<02:12, 1.54it/s]
Loading 0: 44%|████▍ | 161/363 [02:21<02:47, 1.20it/s]
Loading 0: 44%|████▍ | 161/363 [02:21<02:47, 1.20it/s]
Loading 0: 45%|████▍ | 162/363 [02:23<03:23, 1.01s/it]
Loading 0: 45%|████▍ | 162/363 [02:23<03:23, 1.01s/it]
Loading 0: 45%|████▌ | 165/363 [02:25<02:57, 1.11it/s]
Loading 0: 45%|████▌ | 165/363 [02:25<02:57, 1.11it/s]
Loading 0: 46%|████▌ | 166/363 [02:27<03:32, 1.08s/it]
Loading 0: 46%|████▌ | 166/363 [02:27<03:32, 1.08s/it]
Loading 0: 46%|████▌ | 167/363 [02:29<04:10, 1.28s/it]
Loading 0: 46%|████▌ | 167/363 [02:29<04:10, 1.28s/it]
Loading 0: 48%|████▊ | 174/363 [02:30<01:45, 1.78it/s]
Loading 0: 48%|████▊ | 174/363 [02:30<01:45, 1.78it/s]
Loading 0: 49%|████▉ | 178/363 [02:33<01:50, 1.68it/s]
Loading 0: 49%|████▉ | 178/363 [02:33<01:50, 1.68it/s]
Loading 0: 49%|████▉ | 179/363 [02:35<02:19, 1.32it/s]
Loading 0: 49%|████▉ | 179/363 [02:35<02:19, 1.32it/s]
Loading 0: 50%|████▉ | 180/363 [02:37<02:53, 1.05it/s]
Loading 0: 50%|████▉ | 180/363 [02:37<02:53, 1.05it/s]
Loading 0: 50%|█████ | 183/363 [02:39<02:34, 1.17it/s]
Loading 0: 50%|█████ | 183/363 [02:39<02:34, 1.17it/s]
Loading 0: 51%|█████ | 184/363 [02:41<03:05, 1.04s/it]
Loading 0: 51%|█████ | 184/363 [02:41<03:05, 1.04s/it]
Loading 0: 51%|█████ | 185/363 [02:44<03:40, 1.24s/it]
Loading 0: 51%|█████ | 185/363 [02:44<03:40, 1.24s/it]
Loading 0: 53%|█████▎ | 192/363 [02:45<01:34, 1.82it/s]
Loading 0: 53%|█████▎ | 192/363 [02:45<01:34, 1.82it/s]
Loading 0: 54%|█████▍ | 196/363 [02:47<01:38, 1.69it/s]
Loading 0: 54%|█████▍ | 196/363 [02:47<01:38, 1.69it/s]
Loading 0: 54%|█████▍ | 197/363 [02:50<02:04, 1.33it/s]
Loading 0: 54%|█████▍ | 197/363 [02:50<02:04, 1.33it/s]
Loading 0: 55%|█████▍ | 198/363 [02:52<02:35, 1.06it/s]
Loading 0: 55%|█████▍ | 198/363 [02:52<02:35, 1.06it/s]
Loading 0: 55%|█████▌ | 201/363 [02:54<02:18, 1.17it/s]
Loading 0: 55%|█████▌ | 201/363 [02:54<02:18, 1.17it/s]
Loading 0: 56%|█████▌ | 202/363 [02:56<02:46, 1.04s/it]
Loading 0: 56%|█████▌ | 202/363 [02:56<02:46, 1.04s/it]
Loading 0: 56%|█████▌ | 203/363 [02:58<03:18, 1.24s/it]
Loading 0: 56%|█████▌ | 203/363 [02:58<03:18, 1.24s/it]
Loading 0: 58%|█████▊ | 210/363 [02:59<01:23, 1.82it/s]
Loading 0: 58%|█████▊ | 210/363 [02:59<01:23, 1.82it/s]
Loading 0: 59%|█████▉ | 214/363 [03:02<01:27, 1.69it/s]
Loading 0: 59%|█████▉ | 214/363 [03:02<01:27, 1.69it/s]
Loading 0: 59%|█████▉ | 215/363 [03:04<01:51, 1.33it/s]
Loading 0: 59%|█████▉ | 215/363 [03:04<01:51, 1.33it/s]
Loading 0: 60%|█████▉ | 216/363 [03:06<02:18, 1.06it/s]
Loading 0: 60%|█████▉ | 216/363 [03:06<02:18, 1.06it/s]
Loading 0: 60%|██████ | 219/363 [03:08<02:02, 1.17it/s]
Loading 0: 60%|██████ | 219/363 [03:08<02:02, 1.17it/s]
Loading 0: 61%|██████ | 220/363 [03:10<02:27, 1.03s/it]
Loading 0: 61%|██████ | 220/363 [03:10<02:27, 1.03s/it]
Loading 0: 61%|██████ | 221/363 [03:12<02:56, 1.24s/it]
Loading 0: 61%|██████ | 221/363 [03:12<02:56, 1.24s/it]
Loading 0: 63%|██████▎ | 228/363 [03:14<01:14, 1.82it/s]
Loading 0: 63%|██████▎ | 228/363 [03:14<01:14, 1.82it/s]
Loading 0: 64%|██████▍ | 232/363 [03:16<01:17, 1.69it/s]
Loading 0: 64%|██████▍ | 232/363 [03:16<01:17, 1.69it/s]
Loading 0: 64%|██████▍ | 233/363 [03:18<01:37, 1.33it/s]
Loading 0: 64%|██████▍ | 233/363 [03:18<01:37, 1.33it/s]
Loading 0: 64%|██████▍ | 234/363 [03:21<02:01, 1.06it/s]
Loading 0: 64%|██████▍ | 234/363 [03:21<02:01, 1.06it/s]
Loading 0: 65%|██████▌ | 237/363 [03:23<01:47, 1.17it/s]
Loading 0: 65%|██████▌ | 237/363 [03:23<01:47, 1.17it/s]
Loading 0: 66%|██████▌ | 238/363 [03:25<02:09, 1.04s/it]
Loading 0: 66%|██████▌ | 238/363 [03:25<02:09, 1.04s/it]
Loading 0: 66%|██████▌ | 239/363 [03:27<02:33, 1.24s/it]
Loading 0: 66%|██████▌ | 239/363 [03:27<02:33, 1.24s/it]
Loading 0: 68%|██████▊ | 246/363 [03:28<01:04, 1.82it/s]
Loading 0: 68%|██████▊ | 246/363 [03:28<01:04, 1.82it/s]
Loading 0: 69%|██████▉ | 250/363 [03:31<01:06, 1.69it/s]
Loading 0: 69%|██████▉ | 250/363 [03:31<01:06, 1.69it/s]
Loading 0: 69%|██████▉ | 251/363 [03:33<01:24, 1.33it/s]
Loading 0: 69%|██████▉ | 251/363 [03:33<01:24, 1.33it/s]
Loading 0: 69%|██████▉ | 252/363 [03:35<01:45, 1.06it/s]
Loading 0: 69%|██████▉ | 252/363 [03:35<01:45, 1.06it/s]
Loading 0: 70%|███████ | 255/363 [03:37<01:32, 1.17it/s]
Loading 0: 70%|███████ | 255/363 [03:37<01:32, 1.17it/s]
Loading 0: 71%|███████ | 256/363 [03:39<01:50, 1.04s/it]
Loading 0: 71%|███████ | 256/363 [03:39<01:50, 1.04s/it]
Loading 0: 71%|███████ | 257/363 [03:41<02:11, 1.24s/it]
Loading 0: 71%|███████ | 257/363 [03:41<02:11, 1.24s/it]
Loading 0: 73%|███████▎ | 264/363 [03:42<00:54, 1.82it/s]
Loading 0: 73%|███████▎ | 264/363 [03:42<00:54, 1.82it/s]
Loading 0: 74%|███████▍ | 268/363 [03:45<00:56, 1.69it/s]
Loading 0: 74%|███████▍ | 268/363 [03:45<00:56, 1.69it/s]
Loading 0: 74%|███████▍ | 269/363 [03:47<01:10, 1.33it/s]
Loading 0: 74%|███████▍ | 269/363 [03:47<01:10, 1.33it/s]
Loading 0: 74%|███████▍ | 270/363 [03:49<01:27, 1.06it/s]
Loading 0: 74%|███████▍ | 270/363 [03:49<01:27, 1.06it/s]
Loading 0: 75%|███████▌ | 273/363 [04:10<04:38, 3.09s/it]
Loading 0: 75%|███████▌ | 273/363 [04:10<04:38, 3.09s/it]
Loading 0: 75%|███████▌ | 274/363 [04:12<04:21, 2.94s/it]
Loading 0: 75%|███████▌ | 274/363 [04:12<04:21, 2.94s/it]
Loading 0: 76%|███████▌ | 275/363 [04:14<04:07, 2.82s/it]
Loading 0: 76%|███████▌ | 275/363 [04:14<04:07, 2.82s/it]
Loading 0: 78%|███████▊ | 283/363 [04:15<01:23, 1.04s/it]
Loading 0: 78%|███████▊ | 283/363 [04:15<01:23, 1.04s/it]
Loading 0: 79%|███████▉ | 286/363 [04:18<01:14, 1.03it/s]
Loading 0: 79%|███████▉ | 286/363 [04:18<01:14, 1.03it/s]
Loading 0: 79%|███████▉ | 287/363 [04:19<01:21, 1.07s/it]
Loading 0: 79%|███████▉ | 287/363 [04:19<01:21, 1.07s/it]
Loading 0: 79%|███████▉ | 288/363 [04:22<01:31, 1.22s/it]
Loading 0: 79%|███████▉ | 288/363 [04:22<01:31, 1.22s/it]
Loading 0: 80%|████████ | 291/363 [04:24<01:13, 1.03s/it]
Loading 0: 80%|████████ | 291/363 [04:24<01:13, 1.03s/it]
Loading 0: 80%|████████ | 292/363 [04:26<01:24, 1.18s/it]
Loading 0: 80%|████████ | 292/363 [04:26<01:24, 1.18s/it]
Loading 0: 81%|████████ | 293/363 [04:28<01:35, 1.36s/it]
Loading 0: 81%|████████ | 293/363 [04:28<01:35, 1.36s/it]
Loading 0: 83%|████████▎ | 301/363 [04:29<00:34, 1.82it/s]
Loading 0: 83%|████████▎ | 301/363 [04:29<00:34, 1.82it/s]
Loading 0: 84%|████████▎ | 304/363 [04:31<00:35, 1.65it/s]
Loading 0: 84%|████████▎ | 304/363 [04:31<00:35, 1.65it/s]
Loading 0: 84%|████████▍ | 305/363 [04:33<00:44, 1.30it/s]
Loading 0: 84%|████████▍ | 305/363 [04:33<00:44, 1.30it/s]
Loading 0: 84%|████████▍ | 306/363 [04:36<00:55, 1.04it/s]
Loading 0: 84%|████████▍ | 306/363 [04:36<00:55, 1.04it/s]
Loading 0: 85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0: 85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0: 85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0: 85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0: 86%|████████▌ | 311/363 [04:42<01:03, 1.23s/it]
Loading 0: 86%|████████▌ | 311/363 [04:42<01:03, 1.23s/it]
Loading 0: 88%|████████▊ | 319/363 [04:43<00:22, 1.98it/s]
Loading 0: 88%|████████▊ | 319/363 [04:43<00:22, 1.98it/s]
Loading 0: 89%|████████▊ | 322/363 [04:45<00:23, 1.71it/s]
Loading 0: 89%|████████▊ | 322/363 [04:45<00:23, 1.71it/s]
Loading 0: 89%|████████▉ | 323/363 [04:47<00:30, 1.33it/s]
Loading 0: 89%|████████▉ | 323/363 [04:47<00:30, 1.33it/s]
Loading 0: 89%|████████▉ | 324/363 [04:50<00:36, 1.05it/s]
Loading 0: 89%|████████▉ | 324/363 [04:50<00:36, 1.05it/s]
Loading 0: 90%|█████████ | 327/363 [04:52<00:30, 1.17it/s]
Loading 0: 90%|█████████ | 327/363 [04:52<00:30, 1.17it/s]
Loading 0: 90%|█████████ | 328/363 [04:54<00:36, 1.04s/it]
Loading 0: 90%|█████████ | 328/363 [04:54<00:36, 1.04s/it]
Loading 0: 91%|█████████ | 329/363 [04:56<00:42, 1.24s/it]
Loading 0: 91%|█████████ | 329/363 [04:56<00:42, 1.24s/it]
Loading 0: 93%|█████████▎| 337/363 [04:57<00:13, 1.96it/s]
Loading 0: 93%|█████████▎| 337/363 [04:57<00:13, 1.96it/s]
Loading 0: 94%|█████████▎| 340/363 [05:00<00:13, 1.70it/s]
Loading 0: 94%|█████████▎| 340/363 [05:00<00:13, 1.70it/s]
Loading 0: 94%|█████████▍| 341/363 [05:02<00:16, 1.33it/s]
Loading 0: 94%|█████████▍| 341/363 [05:02<00:16, 1.33it/s]
Loading 0: 94%|█████████▍| 342/363 [05:04<00:19, 1.05it/s]
Loading 0: 94%|█████████▍| 342/363 [05:04<00:19, 1.05it/s]
Loading 0: 95%|█████████▌| 345/363 [05:06<00:15, 1.16it/s]
Loading 0: 95%|█████████▌| 345/363 [05:06<00:15, 1.16it/s]
Loading 0: 95%|█████████▌| 346/363 [05:08<00:17, 1.04s/it]
Loading 0: 95%|█████████▌| 346/363 [05:08<00:17, 1.04s/it]
Loading 0: 96%|█████████▌| 347/363 [05:10<00:19, 1.24s/it]
Loading 0: 96%|█████████▌| 347/363 [05:10<00:19, 1.24s/it]
Loading 0: 98%|█████████▊| 355/363 [05:11<00:04, 1.95it/s]
Loading 0: 98%|█████████▊| 355/363 [05:11<00:04, 1.95it/s]
Loading 0: 99%|█████████▉| 359/363 [05:14<00:02, 1.75it/s]
Loading 0: 99%|█████████▉| 359/363 [05:14<00:02, 1.75it/s]
Loading 0: 99%|█████████▉| 360/363 [05:16<00:02, 1.37it/s]
Loading 0: 99%|█████████▉| 360/363 [05:16<00:02, 1.37it/s]
Loading 0: 99%|█████████▉| 361/363 [05:18<00:01, 1.09it/s]
Loading 0: 99%|█████████▉| 361/363 [05:18<00:01, 1.09it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.09it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.14it/s]
chaiml-mistral-24b-2048-43874-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:11, 1.20s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:11, 1.20s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:32, 1.05it/s]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:14, 1.34it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0: 8%|▊ | 30.0/363 [00:23<03:00, 1.85it/s]
Loading 0: 8%|▊ | 30.0/363 [00:23<03:00, 1.85it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:16, 1.68it/s]
Loading 0: 10%|▉ | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0: 10%|▉ | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0: 11%|█ | 40.0/363 [00:34<05:44, 1.07s/it]
Loading 0: 11%|█ | 40.0/363 [00:34<05:44, 1.07s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:51, 1.28s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:51, 1.28s/it]
Loading 0: 13%|█▎ | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0: 13%|█▎ | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:10, 1.63it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:10, 1.63it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:43<04:01, 1.28it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:43<04:01, 1.28it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:04, 1.01it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:04, 1.01it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:32, 1.12it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:32, 1.12it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:29, 1.08s/it]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:29, 1.08s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:34, 1.30s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:34, 1.30s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:50, 1.74it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:55<03:01, 1.62it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:55<03:01, 1.62it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0: 21%|██ | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0: 21%|██ | 76.0/363 [01:04<05:11, 1.09s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:40, 1.73it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:40, 1.73it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:15<04:30, 1.01it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0: 28%|██▊ | 101/363 [01:19<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 101/363 [01:19<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 102/363 [01:21<03:08, 1.38it/s]
Loading 0: 28%|██▊ | 102/363 [01:21<03:08, 1.38it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<04:00, 1.08it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<04:00, 1.08it/s]
Loading 0: 29%|██▉ | 106/363 [01:26<03:45, 1.14it/s]
Loading 0: 29%|██▉ | 106/363 [01:26<03:45, 1.14it/s]
Loading 0: 29%|██▉ | 107/363 [01:28<04:32, 1.06s/it]
Loading 0: 29%|██▉ | 107/363 [01:28<04:32, 1.06s/it]
Loading 0: 30%|██▉ | 108/363 [01:30<05:24, 1.27s/it]
Loading 0: 30%|██▉ | 108/363 [01:30<05:24, 1.27s/it]
Loading 0: 31%|███ | 111/363 [01:32<04:22, 1.04s/it]
Loading 0: 31%|███ | 111/363 [01:32<04:22, 1.04s/it]
Loading 0: 31%|███ | 112/363 [01:34<05:08, 1.23s/it]
Loading 0: 31%|███ | 112/363 [01:34<05:08, 1.23s/it]
Loading 0: 31%|███ | 113/363 [01:37<06:02, 1.45s/it]
Loading 0: 31%|███ | 113/363 [01:37<06:02, 1.45s/it]
Loading 0: 33%|███▎ | 120/363 [01:38<02:25, 1.67it/s]
Loading 0: 33%|███▎ | 120/363 [01:38<02:25, 1.67it/s]
Loading 0: 34%|███▍ | 124/363 [01:41<02:32, 1.57it/s]
Loading 0: 34%|███▍ | 124/363 [01:41<02:32, 1.57it/s]
Loading 0: 34%|███▍ | 125/363 [01:43<03:12, 1.24it/s]
Loading 0: 34%|███▍ | 125/363 [01:43<03:12, 1.24it/s]
Loading 0: 35%|███▍ | 126/363 [01:45<04:00, 1.01s/it]
Loading 0: 35%|███▍ | 126/363 [01:45<04:00, 1.01s/it]
Loading 0: 36%|███▌ | 129/363 [01:47<03:32, 1.10it/s]
Loading 0: 36%|███▌ | 129/363 [01:47<03:32, 1.10it/s]
Loading 0: 36%|███▌ | 130/363 [01:50<04:16, 1.10s/it]
Loading 0: 36%|███▌ | 130/363 [01:50<04:16, 1.10s/it]
Loading 0: 36%|███▌ | 131/363 [01:52<05:04, 1.31s/it]
Loading 0: 36%|███▌ | 131/363 [01:52<05:04, 1.31s/it]
Loading 0: 38%|███▊ | 138/363 [01:53<02:09, 1.74it/s]
Loading 0: 38%|███▊ | 138/363 [01:53<02:09, 1.74it/s]
Loading 0: 39%|███▉ | 142/363 [01:56<02:16, 1.62it/s]
Loading 0: 39%|███▉ | 142/363 [01:56<02:16, 1.62it/s]
Loading 0: 39%|███▉ | 143/363 [01:58<02:53, 1.27it/s]
Loading 0: 39%|███▉ | 143/363 [01:58<02:53, 1.27it/s]
Loading 0: 40%|███▉ | 144/363 [02:00<03:37, 1.01it/s]
Loading 0: 40%|███▉ | 144/363 [02:00<03:37, 1.01it/s]
Loading 0: 40%|████ | 147/363 [02:02<03:13, 1.12it/s]
Loading 0: 40%|████ | 147/363 [02:02<03:13, 1.12it/s]
Loading 0: 41%|████ | 148/363 [02:05<03:53, 1.09s/it]
Loading 0: 41%|████ | 148/363 [02:05<03:53, 1.09s/it]
Loading 0: 41%|████ | 149/363 [02:07<04:38, 1.30s/it]
Loading 0: 41%|████ | 149/363 [02:07<04:38, 1.30s/it]
Loading 0: 43%|████▎ | 156/363 [02:08<01:58, 1.75it/s]
Loading 0: 43%|████▎ | 156/363 [02:08<01:58, 1.75it/s]
Loading 0: 44%|████▍ | 160/363 [02:11<02:04, 1.62it/s]
Loading 0: 44%|████▍ | 160/363 [02:11<02:04, 1.62it/s]
Loading 0: 44%|████▍ | 161/363 [02:13<02:38, 1.27it/s]
Loading 0: 44%|████▍ | 161/363 [02:13<02:38, 1.27it/s]
Loading 0: 45%|████▍ | 162/363 [02:15<03:19, 1.01it/s]
Loading 0: 45%|████▍ | 162/363 [02:15<03:19, 1.01it/s]
Loading 0: 45%|████▌ | 165/363 [02:18<02:57, 1.12it/s]
Loading 0: 45%|████▌ | 165/363 [02:18<02:57, 1.12it/s]
Loading 0: 46%|████▌ | 166/363 [02:20<03:36, 1.10s/it]
Loading 0: 46%|████▌ | 166/363 [02:20<03:36, 1.10s/it]
Loading 0: 46%|████▌ | 167/363 [02:22<04:16, 1.31s/it]
Loading 0: 46%|████▌ | 167/363 [02:22<04:16, 1.31s/it]
Loading 0: 48%|████▊ | 174/363 [02:23<01:48, 1.74it/s]
Loading 0: 48%|████▊ | 174/363 [02:23<01:48, 1.74it/s]
Loading 0: 49%|████▉ | 178/363 [02:26<01:54, 1.62it/s]
Loading 0: 49%|████▉ | 178/363 [02:26<01:54, 1.62it/s]
Loading 0: 49%|████▉ | 179/363 [02:28<02:24, 1.27it/s]
Loading 0: 49%|████▉ | 179/363 [02:28<02:24, 1.27it/s]
Loading 0: 50%|████▉ | 180/363 [02:30<03:01, 1.01it/s]
Loading 0: 50%|████▉ | 180/363 [02:30<03:01, 1.01it/s]
Loading 0: 50%|█████ | 183/363 [02:33<02:41, 1.12it/s]
Loading 0: 50%|█████ | 183/363 [02:33<02:41, 1.12it/s]
Loading 0: 51%|█████ | 184/363 [02:35<03:14, 1.09s/it]
Loading 0: 51%|█████ | 184/363 [02:35<03:14, 1.09s/it]
Loading 0: 51%|█████ | 185/363 [02:37<03:51, 1.30s/it]
Loading 0: 51%|█████ | 185/363 [02:37<03:51, 1.30s/it]
Loading 0: 53%|█████▎ | 192/363 [02:38<01:37, 1.76it/s]
Loading 0: 53%|█████▎ | 192/363 [02:38<01:37, 1.76it/s]
Loading 0: 54%|█████▍ | 196/363 [02:41<01:42, 1.63it/s]
Loading 0: 54%|█████▍ | 196/363 [02:41<01:42, 1.63it/s]
Loading 0: 54%|█████▍ | 197/363 [02:43<02:09, 1.28it/s]
Loading 0: 54%|█████▍ | 197/363 [02:43<02:09, 1.28it/s]
Loading 0: 55%|█████▍ | 198/363 [02:45<02:42, 1.02it/s]
Loading 0: 55%|█████▍ | 198/363 [02:45<02:42, 1.02it/s]
Loading 0: 55%|█████▌ | 201/363 [02:48<02:24, 1.12it/s]
Loading 0: 55%|█████▌ | 201/363 [02:48<02:24, 1.12it/s]
Loading 0: 56%|█████▌ | 202/363 [02:50<02:55, 1.09s/it]
Loading 0: 56%|█████▌ | 202/363 [02:50<02:55, 1.09s/it]
Loading 0: 56%|█████▌ | 203/363 [02:52<03:27, 1.30s/it]
Loading 0: 56%|█████▌ | 203/363 [02:52<03:27, 1.30s/it]
Loading 0: 58%|█████▊ | 210/363 [02:53<01:27, 1.75it/s]
Loading 0: 58%|█████▊ | 210/363 [02:53<01:27, 1.75it/s]
Loading 0: 59%|█████▉ | 214/363 [02:56<01:31, 1.63it/s]
Loading 0: 59%|█████▉ | 214/363 [02:56<01:31, 1.63it/s]
Loading 0: 59%|█████▉ | 215/363 [02:58<01:56, 1.27it/s]
Loading 0: 59%|█████▉ | 215/363 [02:58<01:56, 1.27it/s]
Loading 0: 60%|█████▉ | 216/363 [03:00<02:25, 1.01it/s]
Loading 0: 60%|█████▉ | 216/363 [03:00<02:25, 1.01it/s]
Loading 0: 60%|██████ | 219/363 [03:03<02:08, 1.12it/s]
Loading 0: 60%|██████ | 219/363 [03:03<02:08, 1.12it/s]
Loading 0: 61%|██████ | 220/363 [03:05<02:35, 1.08s/it]
Loading 0: 61%|██████ | 220/363 [03:05<02:35, 1.08s/it]
Loading 0: 61%|██████ | 221/363 [03:07<03:04, 1.30s/it]
Loading 0: 61%|██████ | 221/363 [03:07<03:04, 1.30s/it]
Loading 0: 63%|██████▎ | 228/363 [03:08<01:17, 1.75it/s]
Loading 0: 63%|██████▎ | 228/363 [03:08<01:17, 1.75it/s]
Loading 0: 64%|██████▍ | 232/363 [03:11<01:20, 1.62it/s]
Loading 0: 64%|██████▍ | 232/363 [03:11<01:20, 1.62it/s]
Loading 0: 64%|██████▍ | 233/363 [03:13<01:42, 1.27it/s]
Loading 0: 64%|██████▍ | 233/363 [03:13<01:42, 1.27it/s]
Loading 0: 64%|██████▍ | 234/363 [03:16<02:07, 1.01it/s]
Loading 0: 64%|██████▍ | 234/363 [03:16<02:07, 1.01it/s]
Loading 0: 65%|██████▌ | 237/363 [03:18<01:52, 1.12it/s]
Loading 0: 65%|██████▌ | 237/363 [03:18<01:52, 1.12it/s]
Loading 0: 66%|██████▌ | 238/363 [03:20<02:15, 1.08s/it]
Loading 0: 66%|██████▌ | 238/363 [03:20<02:15, 1.08s/it]
Loading 0: 66%|██████▌ | 239/363 [03:22<02:40, 1.30s/it]
Loading 0: 66%|██████▌ | 239/363 [03:22<02:40, 1.30s/it]
Loading 0: 68%|██████▊ | 246/363 [03:23<01:07, 1.74it/s]
Loading 0: 68%|██████▊ | 246/363 [03:23<01:07, 1.74it/s]
Loading 0: 69%|██████▉ | 250/363 [03:26<01:09, 1.62it/s]
Loading 0: 69%|██████▉ | 250/363 [03:26<01:09, 1.62it/s]
Loading 0: 69%|██████▉ | 251/363 [03:28<01:27, 1.27it/s]
Loading 0: 69%|██████▉ | 251/363 [03:28<01:27, 1.27it/s]
Loading 0: 69%|██████▉ | 252/363 [03:31<01:49, 1.01it/s]
Loading 0: 69%|██████▉ | 252/363 [03:31<01:49, 1.01it/s]
Loading 0: 70%|███████ | 255/363 [03:33<01:36, 1.12it/s]
Loading 0: 70%|███████ | 255/363 [03:33<01:36, 1.12it/s]
Loading 0: 71%|███████ | 256/363 [03:35<01:55, 1.08s/it]
Loading 0: 71%|███████ | 256/363 [03:35<01:55, 1.08s/it]
Loading 0: 71%|███████ | 257/363 [03:37<02:17, 1.30s/it]
Loading 0: 71%|███████ | 257/363 [03:37<02:17, 1.30s/it]
Loading 0: 73%|███████▎ | 264/363 [03:38<00:56, 1.75it/s]
Loading 0: 73%|███████▎ | 264/363 [03:38<00:56, 1.75it/s]
Loading 0: 74%|███████▍ | 268/363 [03:41<00:58, 1.63it/s]
Loading 0: 74%|███████▍ | 268/363 [03:41<00:58, 1.63it/s]
Loading 0: 74%|███████▍ | 269/363 [03:43<01:13, 1.28it/s]
Loading 0: 74%|███████▍ | 269/363 [03:43<01:13, 1.28it/s]
Loading 0: 74%|███████▍ | 270/363 [03:46<01:31, 1.01it/s]
Loading 0: 74%|███████▍ | 270/363 [03:46<01:31, 1.01it/s]
Loading 0: 75%|███████▌ | 273/363 [04:02<03:55, 2.62s/it]
Loading 0: 75%|███████▌ | 273/363 [04:02<03:55, 2.62s/it]
Loading 0: 75%|███████▌ | 274/363 [04:04<03:46, 2.55s/it]
Loading 0: 75%|███████▌ | 274/363 [04:04<03:46, 2.55s/it]
Loading 0: 76%|███████▌ | 275/363 [04:06<03:40, 2.51s/it]
Loading 0: 76%|███████▌ | 275/363 [04:06<03:40, 2.51s/it]
Loading 0: 78%|███████▊ | 282/363 [04:08<01:22, 1.01s/it]
Loading 0: 78%|███████▊ | 282/363 [04:08<01:22, 1.01s/it]
Loading 0: 79%|███████▉ | 286/363 [04:10<01:09, 1.11it/s]
Loading 0: 79%|███████▉ | 286/363 [04:10<01:09, 1.11it/s]
Loading 0: 79%|███████▉ | 287/363 [04:12<01:19, 1.04s/it]
Loading 0: 79%|███████▉ | 287/363 [04:12<01:19, 1.04s/it]
Loading 0: 79%|███████▉ | 288/363 [04:15<01:31, 1.21s/it]
Loading 0: 79%|███████▉ | 288/363 [04:15<01:31, 1.21s/it]
Loading 0: 80%|████████ | 291/363 [04:17<01:14, 1.04s/it]
Loading 0: 80%|████████ | 291/363 [04:17<01:14, 1.04s/it]
Loading 0: 80%|████████ | 292/363 [04:19<01:25, 1.21s/it]
Loading 0: 80%|████████ | 292/363 [04:19<01:25, 1.21s/it]
Loading 0: 81%|████████ | 293/363 [04:21<01:37, 1.40s/it]
Loading 0: 81%|████████ | 293/363 [04:21<01:37, 1.40s/it]
Loading 0: 83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0: 83%|████████▎ | 300/363 [04:23<00:38, 1.65it/s]
Loading 0: 84%|████████▎ | 304/363 [04:25<00:37, 1.57it/s]
Loading 0: 84%|████████▎ | 304/363 [04:25<00:37, 1.57it/s]
Loading 0: 84%|████████▍ | 305/363 [04:28<00:46, 1.24it/s]
Loading 0: 84%|████████▍ | 305/363 [04:28<00:46, 1.24it/s]
Loading 0: 84%|████████▍ | 306/363 [04:30<00:57, 1.00s/it]
Loading 0: 84%|████████▍ | 306/363 [04:30<00:57, 1.00s/it]
Loading 0: 85%|████████▌ | 309/363 [04:32<00:48, 1.10it/s]
Loading 0: 85%|████████▌ | 309/363 [04:32<00:48, 1.10it/s]
Loading 0: 85%|████████▌ | 310/363 [04:34<00:58, 1.10s/it]
Loading 0: 85%|████████▌ | 310/363 [04:34<00:58, 1.10s/it]
Loading 0: 86%|████████▌ | 311/363 [04:36<01:07, 1.31s/it]
Loading 0: 86%|████████▌ | 311/363 [04:36<01:07, 1.31s/it]
Loading 0: 88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0: 88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.63it/s]
Loading 0: 89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 323/363 [04:43<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0: 89%|████████▉ | 324/363 [04:45<00:38, 1.01it/s]
Loading 0: 90%|█████████ | 327/363 [04:47<00:32, 1.11it/s]
Loading 0: 90%|█████████ | 327/363 [04:47<00:32, 1.11it/s]
Loading 0: 90%|█████████ | 328/363 [04:49<00:38, 1.09s/it]
Loading 0: 90%|█████████ | 328/363 [04:49<00:38, 1.09s/it]
Loading 0: 91%|█████████ | 329/363 [04:52<00:44, 1.31s/it]
Loading 0: 91%|█████████ | 329/363 [04:52<00:44, 1.31s/it]
Loading 0: 93%|█████████▎| 336/363 [04:53<00:15, 1.74it/s]
Loading 0: 93%|█████████▎| 336/363 [04:53<00:15, 1.74it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0: 94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0: 94%|█████████▍| 341/363 [04:58<00:17, 1.27it/s]
Loading 0: 94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0: 94%|█████████▍| 342/363 [05:00<00:20, 1.01it/s]
Loading 0: 95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0: 95%|█████████▌| 345/363 [05:02<00:16, 1.11it/s]
Loading 0: 95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0: 95%|█████████▌| 346/363 [05:04<00:18, 1.09s/it]
Loading 0: 96%|█████████▌| 347/363 [05:07<00:20, 1.31s/it]
Loading 0: 96%|█████████▌| 347/363 [05:07<00:20, 1.31s/it]
Loading 0: 98%|█████████▊| 354/363 [05:08<00:05, 1.74it/s]
Loading 0: 98%|█████████▊| 354/363 [05:08<00:05, 1.74it/s]
Loading 0: 99%|█████████▉| 359/363 [05:11<00:02, 1.66it/s]
Loading 0: 99%|█████████▉| 359/363 [05:11<00:02, 1.66it/s]
Loading 0: 99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0: 99%|█████████▉| 360/363 [05:13<00:02, 1.32it/s]
Loading 0: 99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0: 99%|█████████▉| 361/363 [05:15<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.40it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.40it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.15it/s]
chaiml-mistral-24b-2048-86542-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmprxnhlspj' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantized model in 329.653s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged in 417.842s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-43874-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp042ru3xu' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantized model in 323.456s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged in 414.413s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: Error parsing xml: syntax error: line 1, column 0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: b'upstream connect error or disconnect/reset before headers. reset reason: connection termination'
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (Service Unavailable))
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Waiting 3 sec...
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: Error parsing xml: syntax error: line 1, column 0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR: b'upstream connect error or disconnect/reset before headers. reset reason: connection timeout'
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (Service Unavailable))
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Waiting 6 sec...
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Retrying failed request: / (503 (SlowDown))
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Waiting 3 sec...
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Retrying failed request: / (503 (SlowDown))
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Waiting 6 sec...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (SlowDown))
chaiml-mistral-24b-2048-86542-v2-mkmlizer: WARNING: Waiting 3 sec...
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Retrying failed request: /?location (503 (SlowDown))
chaiml-mistral-24b-2048-76177-v2-mkmlizer: WARNING: Waiting 12 sec...
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Retrying failed request: / (503 (SlowDown))
chaiml-mistral-24b-2048-44577-v2-mkmlizer: WARNING: Waiting 9 sec...
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-43874-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia
chaiml-mistral-24b-2048-43874-v2-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-43874-v2-mkmlizer: status code: 503, request id: tx000003d302fd6d8699b35-00698ea831-149d0ff886-default, host id:
chaiml-mistral-24b-2048-44577-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/config.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/config.json
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/config.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/config.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/config.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/tokenizer.json
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-44577-v2-mkmlizer: status code: 504, request id: , host id:
chaiml-mistral-24b-2048-43874-v2-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-43874-v2-mkmlizer: status code: 503, request id: , host id:
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-96633-v3-mkmlizer: status code: 503, request id: , host id:
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG retryable error: SlowDown:
chaiml-mistral-24b-2048-96633-v3-mkmlizer: status code: 503, request id: tx00000c3c81122789cf4c8-00698eaa71-14a24de22e-default, host id:
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~k4kjcIkpzSnJomj4iPqL8AQIhffOxLM caused by: SignatureDoesNotMatch: status code: 403, request id: tx00000d5239dbad605b42b-00698eaa6c-14b33dd27d-default, host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-86542-v2-mkmlizer: status code: 504, request id: , host id:
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-76177-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-76177-v2-mkmlizer: status code: 504, request id: , host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/flywheel_model.1.safetensors
Job chaiml-mistral-24b-2048-86542-v2-mkmlizer completed after 1208.72s with status: failed
Job failed chaiml-mistral-24b-2048-86542-v2-mkmlizer:
Stopping job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-86542-v2-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-86542-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: GatewayTimeout: Gateway Timeout
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: status code: 504, request id: , host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~dfjM52EwMr8dt5K7yQJivPxvXy1YuSz caused by: SignatureDoesNotMatch: status code: 403, request id: tx000002607b794f12cfa60-00698eaa74-14a24de22e-default, host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
Job chaiml-mistral-24b-2048-96633-v3-mkmlizer completed after 1241.47s with status: failed
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
Job failed chaiml-mistral-24b-2048-96633-v3-mkmlizer:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~lUPYgZ09IprrDFHql6bC17E1cnur9kV caused by: SignatureDoesNotMatch: status code: 403, request id: tx000008f342f17993101b9-00698eaa81-14a19326cd-default, host id:
Stopping job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
Job chaiml-mistral-24b-2048-76177-v2-mkmlizer completed after 1259.01s with status: failed
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~rVQch-gtjBbQkECUALXxbEFOrUIY3BP caused by: SignatureDoesNotMatch: status code: 403, request id: tx00000051ad2f5b3b4e259-00698eaa6d-14b33dd27d-default, host id:
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
Job failed chaiml-mistral-24b-2048-76177-v2-mkmlizer:
Job chaiml-mistral-24b-2048-43874-v2-mkmlizer completed after 1251.13s with status: failed
Starting job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
Stopping job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
Job failed chaiml-mistral-24b-2048-43874-v2-mkmlizer:
Waiting for job on chaiml-mistral-24b-2048-96633-v3-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
%s, retrying in %s seconds...
Stopping job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
Starting job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/flywheel_model.1.safetensors": MultipartUpload: upload multipart failed upload id: 2~yj537QbuRgJ05ixOsjL6TTnYtr6TjRa caused by: SignatureDoesNotMatch: status code: 403, request id: tx000001bf656bd2398699c-00698eaab0-14a24de22e-default, host id:
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: no job control in this shell
Waiting for job on chaiml-mistral-24b-2048-76177-v2-mkmlizer to finish
Starting job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
Job chaiml-mistral-24b-2048-44577-v2-mkmlizer completed after 1271.05s with status: failed
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
Waiting for job on chaiml-mistral-24b-2048-43874-v2-mkmlizer to finish
Job failed chaiml-mistral-24b-2048-44577-v2-mkmlizer:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ https://mk1.ai ║
Stopping job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ The license key for the current software has been verified as ║
Starting job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
Waiting for job on chaiml-mistral-24b-2048-44577-v2-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-96633-v3-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-43874-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-76177-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Downloaded to shared memory in 85.689s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged already exists in ChaiML
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpfmjv9r1h, device:0
chaiml-mistral-24b-2048-43874-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-96633-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Downloaded to shared memory in 81.489s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Downloaded to shared memory in 83.645s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged already exists in ChaiML
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Downloaded to shared memory in 80.818s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpeud9c_ya, device:0
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpdfxn2f_s, device:0
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged already exists in ChaiML
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp9vlvegk0, device:0
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Downloaded to shared memory in 87.371s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged already exists in ChaiML
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpw4icn4mf, device:0
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-86542-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:37, 1.30it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:37, 1.30it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:28, 1.25s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:28, 1.25s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:36, 1.61s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:36, 1.61s/it]
Loading 0: 3%|▎ | 11.0/363 [00:08<03:20, 1.75it/s]
Loading 0: 3%|▎ | 11.0/363 [00:08<03:20, 1.75it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:24, 1.32it/s]
Loading 0: 4%|▍ | 14.0/363 [00:13<05:53, 1.01s/it]
Loading 0: 4%|▍ | 14.0/363 [00:13<05:53, 1.01s/it]
Loading 0: 4%|▍ | 15.0/363 [00:15<07:24, 1.28s/it]
Loading 0: 4%|▍ | 15.0/363 [00:15<07:24, 1.28s/it]
Loading 0: 6%|▌ | 21.0/363 [00:18<04:31, 1.26it/s]
Loading 0: 6%|▌ | 21.0/363 [00:18<04:31, 1.26it/s]
Loading 0: 6%|▌ | 22.0/363 [00:20<05:38, 1.01it/s]
Loading 0: 6%|▌ | 22.0/363 [00:20<05:38, 1.01it/s]
Loading 0: 6%|▋ | 23.0/363 [00:23<07:02, 1.24s/it]
Loading 0: 6%|▋ | 23.0/363 [00:23<07:02, 1.24s/it]
Loading 0: 8%|▊ | 30.0/363 [00:24<03:19, 1.67it/s]
Loading 0: 8%|▊ | 30.0/363 [00:24<03:19, 1.67it/s]
Loading 0: 9%|▉ | 34.0/363 [00:28<03:47, 1.44it/s]
Loading 0: 9%|▉ | 34.0/363 [00:28<03:47, 1.44it/s]
Loading 0: 10%|▉ | 35.0/363 [00:31<05:06, 1.07it/s]
Loading 0: 10%|▉ | 35.0/363 [00:31<05:06, 1.07it/s]
Loading 0: 10%|▉ | 36.0/363 [00:34<06:42, 1.23s/it]
Loading 0: 10%|▉ | 36.0/363 [00:34<06:42, 1.23s/it]
Loading 0: 11%|█ | 39.0/363 [00:37<06:11, 1.15s/it]
Loading 0: 11%|█ | 39.0/363 [00:37<06:11, 1.15s/it]
Loading 0: 11%|█ | 40.0/363 [00:40<07:39, 1.42s/it]
Loading 0: 11%|█ | 40.0/363 [00:40<07:39, 1.42s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:43<09:15, 1.73s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:43<09:15, 1.73s/it]
Loading 0: 13%|█▎ | 47.0/363 [00:44<04:13, 1.25it/s]
Loading 0: 13%|█▎ | 47.0/363 [00:44<04:13, 1.25it/s]
Loading 0: 14%|█▍ | 51.0/363 [00:45<03:09, 1.65it/s]
Loading 0: 14%|█▍ | 51.0/363 [00:45<03:09, 1.65it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:48<04:28, 1.16it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:48<04:28, 1.16it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:51<05:51, 1.13s/it]
Loading 0: 15%|█▍ | 53.0/363 [00:51<05:51, 1.13s/it]
Loading 0: 15%|█▍ | 54.0/363 [00:54<07:20, 1.43s/it]
Loading 0: 15%|█▍ | 54.0/363 [00:54<07:20, 1.43s/it]
Loading 0: 16%|█▌ | 57.0/363 [00:57<06:16, 1.23s/it]
Loading 0: 16%|█▌ | 57.0/363 [00:57<06:16, 1.23s/it]
Loading 0: 16%|█▌ | 58.0/363 [01:00<07:46, 1.53s/it]
Loading 0: 16%|█▌ | 58.0/363 [01:00<07:46, 1.53s/it]
Loading 0: 16%|█▋ | 59.0/363 [01:03<09:20, 1.84s/it]
Loading 0: 16%|█▋ | 59.0/363 [01:03<09:20, 1.84s/it]
Loading 0: 18%|█▊ | 64.0/363 [01:04<04:28, 1.12it/s]
Loading 0: 18%|█▊ | 64.0/363 [01:04<04:28, 1.12it/s]
Loading 0: 19%|█▊ | 68.0/363 [01:05<03:09, 1.56it/s]
Loading 0: 19%|█▊ | 68.0/363 [01:05<03:09, 1.56it/s]
Loading 0: 19%|█▉ | 70.0/363 [01:08<04:03, 1.20it/s]
Loading 0: 19%|█▉ | 70.0/363 [01:08<04:03, 1.20it/s]
Loading 0: 20%|█▉ | 71.0/363 [01:11<05:15, 1.08s/it]
Loading 0: 20%|█▉ | 71.0/363 [01:11<05:15, 1.08s/it]
Loading 0: 20%|█▉ | 72.0/363 [01:13<06:38, 1.37s/it]
Loading 0: 20%|█▉ | 72.0/363 [01:13<06:38, 1.37s/it]
Loading 0: 21%|██ | 75.0/363 [01:16<05:44, 1.20s/it]
Loading 0: 21%|██ | 75.0/363 [01:16<05:44, 1.20s/it]
Loading 0: 21%|██ | 76.0/363 [01:19<06:37, 1.38s/it]
Loading 0: 21%|██ | 76.0/363 [01:19<06:37, 1.38s/it]
Loading 0: 21%|██ | 77.0/363 [01:21<07:54, 1.66s/it]
Loading 0: 21%|██ | 77.0/363 [01:21<07:54, 1.66s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:23<03:12, 1.45it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:23<03:12, 1.45it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:25<03:09, 1.45it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:25<03:09, 1.45it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:28<03:53, 1.18it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:28<03:53, 1.18it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:30<04:47, 1.05s/it]
Loading 0: 25%|██▍ | 90.0/363 [01:30<04:47, 1.05s/it]
Loading 0: 27%|██▋ | 97.0/363 [01:31<02:21, 1.88it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:31<02:21, 1.88it/s]
Loading 0: 28%|██▊ | 101/363 [01:33<02:27, 1.78it/s]
Loading 0: 28%|██▊ | 101/363 [01:33<02:27, 1.78it/s]
Loading 0: 28%|██▊ | 102/363 [01:36<03:09, 1.38it/s]
Loading 0: 28%|██▊ | 102/363 [01:36<03:09, 1.38it/s]
Loading 0: 28%|██▊ | 103/363 [01:38<03:56, 1.10it/s]
Loading 0: 28%|██▊ | 103/363 [01:38<03:56, 1.10it/s]
Loading 0: 29%|██▉ | 106/363 [01:40<03:37, 1.18it/s]
Loading 0: 29%|██▉ | 106/363 [01:40<03:37, 1.18it/s]
Loading 0: 29%|██▉ | 107/363 [01:42<04:20, 1.02s/it]
Loading 0: 29%|██▉ | 107/363 [01:42<04:20, 1.02s/it]
Loading 0: 30%|██▉ | 108/363 [01:44<05:08, 1.21s/it]
Loading 0: 30%|██▉ | 108/363 [01:44<05:08, 1.21s/it]
Loading 0: 31%|███ | 111/363 [01:46<04:08, 1.01it/s]
Loading 0: 31%|███ | 111/363 [01:46<04:08, 1.01it/s]
Loading 0: 31%|███ | 112/363 [01:48<04:51, 1.16s/it]
Loading 0: 31%|███ | 112/363 [01:48<04:51, 1.16s/it]
Loading 0: 31%|███ | 113/363 [01:50<05:37, 1.35s/it]
Loading 0: 31%|███ | 113/363 [01:50<05:37, 1.35s/it]
Loading 0: 33%|███▎ | 121/363 [01:52<02:07, 1.90it/s]
Loading 0: 33%|███▎ | 121/363 [01:52<02:07, 1.90it/s]
Loading 0: 34%|███▍ | 124/363 [01:54<02:22, 1.68it/s]
Loading 0: 34%|███▍ | 124/363 [01:54<02:22, 1.68it/s]
Loading 0: 34%|███▍ | 125/363 [01:56<03:00, 1.32it/s]
Loading 0: 34%|███▍ | 125/363 [01:56<03:00, 1.32it/s]
Loading 0: 35%|███▍ | 126/363 [01:58<03:45, 1.05it/s]
Loading 0: 35%|███▍ | 126/363 [01:58<03:45, 1.05it/s]
Loading 0: 36%|███▌ | 129/363 [02:00<03:19, 1.17it/s]
Loading 0: 36%|███▌ | 129/363 [02:00<03:19, 1.17it/s]
Loading 0: 36%|███▌ | 130/363 [02:02<04:00, 1.03s/it]
Loading 0: 36%|███▌ | 130/363 [02:02<04:00, 1.03s/it]
Loading 0: 36%|███▌ | 131/363 [02:04<04:45, 1.23s/it]
Loading 0: 36%|███▌ | 131/363 [02:04<04:45, 1.23s/it]
Loading 0: 38%|███▊ | 138/363 [02:05<02:01, 1.86it/s]
Loading 0: 38%|███▊ | 138/363 [02:05<02:01, 1.86it/s]
Loading 0: 39%|███▉ | 142/363 [02:08<02:07, 1.73it/s]
Loading 0: 39%|███▉ | 142/363 [02:08<02:07, 1.73it/s]
Loading 0: 39%|███▉ | 143/363 [02:10<02:42, 1.36it/s]
Loading 0: 39%|███▉ | 143/363 [02:10<02:42, 1.36it/s]
Loading 0: 40%|███▉ | 144/363 [02:12<03:23, 1.08it/s]
Loading 0: 40%|███▉ | 144/363 [02:12<03:23, 1.08it/s]
Loading 0: 40%|████ | 147/363 [02:14<03:01, 1.19it/s]
Loading 0: 40%|████ | 147/363 [02:14<03:01, 1.19it/s]
Loading 0: 41%|████ | 148/363 [02:16<03:38, 1.02s/it]
Loading 0: 41%|████ | 148/363 [02:16<03:38, 1.02s/it]
Loading 0: 41%|████ | 149/363 [02:18<04:20, 1.22s/it]
Loading 0: 41%|████ | 149/363 [02:18<04:20, 1.22s/it]
Loading 0: 43%|████▎ | 156/363 [02:19<01:50, 1.87it/s]
Loading 0: 43%|████▎ | 156/363 [02:19<01:50, 1.87it/s]
Loading 0: 44%|████▍ | 160/363 [02:22<01:56, 1.74it/s]
Loading 0: 44%|████▍ | 160/363 [02:22<01:56, 1.74it/s]
Loading 0: 44%|████▍ | 161/363 [02:24<02:28, 1.36it/s]
Loading 0: 44%|████▍ | 161/363 [02:24<02:28, 1.36it/s]
Loading 0: 45%|████▍ | 162/363 [02:26<03:05, 1.08it/s]
Loading 0: 45%|████▍ | 162/363 [02:26<03:05, 1.08it/s]
Loading 0: 45%|████▌ | 165/363 [02:28<02:45, 1.20it/s]
Loading 0: 45%|████▌ | 165/363 [02:28<02:45, 1.20it/s]
Loading 0: 46%|████▌ | 166/363 [02:30<03:19, 1.01s/it]
Loading 0: 46%|████▌ | 166/363 [02:30<03:19, 1.01s/it]
Loading 0: 46%|████▌ | 167/363 [02:32<03:57, 1.21s/it]
Loading 0: 46%|████▌ | 167/363 [02:32<03:57, 1.21s/it]
Loading 0: 48%|████▊ | 174/363 [02:34<01:41, 1.86it/s]
Loading 0: 48%|████▊ | 174/363 [02:34<01:41, 1.86it/s]
Loading 0: 49%|████▉ | 178/363 [02:36<01:46, 1.73it/s]
Loading 0: 49%|████▉ | 178/363 [02:36<01:46, 1.73it/s]
Loading 0: 49%|████▉ | 179/363 [02:38<02:15, 1.36it/s]
Loading 0: 49%|████▉ | 179/363 [02:38<02:15, 1.36it/s]
Loading 0: 50%|████▉ | 180/363 [02:40<02:49, 1.08it/s]
Loading 0: 50%|████▉ | 180/363 [02:40<02:49, 1.08it/s]
Loading 0: 50%|█████ | 183/363 [02:42<02:30, 1.19it/s]
Loading 0: 50%|█████ | 183/363 [02:42<02:30, 1.19it/s]
Loading 0: 51%|█████ | 184/363 [02:44<03:01, 1.02s/it]
Loading 0: 51%|█████ | 184/363 [02:44<03:01, 1.02s/it]
Loading 0: 51%|█████ | 185/363 [02:47<03:36, 1.21s/it]
Loading 0: 51%|█████ | 185/363 [02:47<03:36, 1.21s/it]
Loading 0: 53%|█████▎ | 192/363 [02:48<01:31, 1.87it/s]
Loading 0: 53%|█████▎ | 192/363 [02:48<01:31, 1.87it/s]
Loading 0: 54%|█████▍ | 196/363 [02:50<01:35, 1.74it/s]
Loading 0: 54%|█████▍ | 196/363 [02:50<01:35, 1.74it/s]
Loading 0: 54%|█████▍ | 197/363 [02:52<02:01, 1.36it/s]
Loading 0: 54%|█████▍ | 197/363 [02:52<02:01, 1.36it/s]
Loading 0: 55%|█████▍ | 198/363 [02:54<02:32, 1.09it/s]
Loading 0: 55%|█████▍ | 198/363 [02:54<02:32, 1.09it/s]
Loading 0: 55%|█████▌ | 201/363 [02:56<02:15, 1.20it/s]
Loading 0: 55%|█████▌ | 201/363 [02:56<02:15, 1.20it/s]
Loading 0: 56%|█████▌ | 202/363 [02:58<02:42, 1.01s/it]
Loading 0: 56%|█████▌ | 202/363 [02:58<02:42, 1.01s/it]
Loading 0: 56%|█████▌ | 203/363 [03:01<03:13, 1.21s/it]
Loading 0: 56%|█████▌ | 203/363 [03:01<03:13, 1.21s/it]
Loading 0: 58%|█████▊ | 210/363 [03:02<01:21, 1.88it/s]
Loading 0: 58%|█████▊ | 210/363 [03:02<01:21, 1.88it/s]
Loading 0: 59%|█████▉ | 214/363 [03:04<01:25, 1.75it/s]
Loading 0: 59%|█████▉ | 214/363 [03:04<01:25, 1.75it/s]
Loading 0: 59%|█████▉ | 215/363 [03:06<01:48, 1.37it/s]
Loading 0: 59%|█████▉ | 215/363 [03:06<01:48, 1.37it/s]
Loading 0: 60%|█████▉ | 216/363 [03:08<02:15, 1.09it/s]
Loading 0: 60%|█████▉ | 216/363 [03:08<02:15, 1.09it/s]
Loading 0: 60%|██████ | 219/363 [03:10<01:59, 1.20it/s]
Loading 0: 60%|██████ | 219/363 [03:10<01:59, 1.20it/s]
Loading 0: 61%|██████ | 220/363 [03:12<02:24, 1.01s/it]
Loading 0: 61%|██████ | 220/363 [03:12<02:24, 1.01s/it]
Loading 0: 61%|██████ | 221/363 [03:15<02:51, 1.21s/it]
Loading 0: 61%|██████ | 221/363 [03:15<02:51, 1.21s/it]
Loading 0: 63%|██████▎ | 229/363 [03:16<01:07, 1.98it/s]
Loading 0: 63%|██████▎ | 229/363 [03:16<01:07, 1.98it/s]
Loading 0: 64%|██████▍ | 232/363 [03:18<01:15, 1.73it/s]
Loading 0: 64%|██████▍ | 232/363 [03:18<01:15, 1.73it/s]
Loading 0: 64%|██████▍ | 233/363 [03:20<01:36, 1.35it/s]
Loading 0: 64%|██████▍ | 233/363 [03:20<01:36, 1.35it/s]
Loading 0: 64%|██████▍ | 234/363 [03:22<02:00, 1.07it/s]
Loading 0: 64%|██████▍ | 234/363 [03:22<02:00, 1.07it/s]
Loading 0: 65%|██████▌ | 237/363 [03:24<01:45, 1.19it/s]
Loading 0: 65%|██████▌ | 237/363 [03:24<01:45, 1.19it/s]
Loading 0: 66%|██████▌ | 238/363 [03:26<02:07, 1.02s/it]
Loading 0: 66%|██████▌ | 238/363 [03:26<02:07, 1.02s/it]
Loading 0: 66%|██████▌ | 239/363 [03:29<02:31, 1.22s/it]
Loading 0: 66%|██████▌ | 239/363 [03:29<02:31, 1.22s/it]
Loading 0: 68%|██████▊ | 246/363 [03:30<01:02, 1.87it/s]
Loading 0: 68%|██████▊ | 246/363 [03:30<01:02, 1.87it/s]
Loading 0: 69%|██████▉ | 250/363 [03:32<01:05, 1.74it/s]
Loading 0: 69%|██████▉ | 250/363 [03:32<01:05, 1.74it/s]
Loading 0: 69%|██████▉ | 251/363 [03:34<01:22, 1.36it/s]
Loading 0: 69%|██████▉ | 251/363 [03:34<01:22, 1.36it/s]
Loading 0: 69%|██████▉ | 252/363 [03:36<01:43, 1.08it/s]
Loading 0: 69%|██████▉ | 252/363 [03:36<01:43, 1.08it/s]
Loading 0: 70%|███████ | 255/363 [03:38<01:30, 1.19it/s]
Loading 0: 70%|███████ | 255/363 [03:38<01:30, 1.19it/s]
Loading 0: 71%|███████ | 256/363 [03:41<01:49, 1.02s/it]
Loading 0: 71%|███████ | 256/363 [03:41<01:49, 1.02s/it]
Loading 0: 71%|███████ | 257/363 [03:43<02:09, 1.22s/it]
Loading 0: 71%|███████ | 257/363 [03:43<02:09, 1.22s/it]
Loading 0: 73%|███████▎ | 264/363 [03:44<00:53, 1.85it/s]
Loading 0: 73%|███████▎ | 264/363 [03:44<00:53, 1.85it/s]
Loading 0: 74%|███████▍ | 268/363 [03:46<00:55, 1.71it/s]
Loading 0: 74%|███████▍ | 268/363 [03:46<00:55, 1.71it/s]
Loading 0: 74%|███████▍ | 269/363 [03:48<01:09, 1.35it/s]
Loading 0: 74%|███████▍ | 269/363 [03:48<01:09, 1.35it/s]
Loading 0: 74%|███████▍ | 270/363 [03:51<01:26, 1.07it/s]
Loading 0: 74%|███████▍ | 270/363 [03:51<01:26, 1.07it/s]
Loading 0: 75%|███████▌ | 273/363 [04:11<04:33, 3.04s/it]
Loading 0: 75%|███████▌ | 273/363 [04:11<04:33, 3.04s/it]
Loading 0: 75%|███████▌ | 274/363 [04:13<04:17, 2.89s/it]
Loading 0: 75%|███████▌ | 274/363 [04:13<04:17, 2.89s/it]
Loading 0: 76%|███████▌ | 275/363 [04:15<04:03, 2.77s/it]
Loading 0: 76%|███████▌ | 275/363 [04:15<04:03, 2.77s/it]
Loading 0: 78%|███████▊ | 282/363 [04:16<01:29, 1.10s/it]
Loading 0: 78%|███████▊ | 282/363 [04:16<01:29, 1.10s/it]
Loading 0: 79%|███████▉ | 286/363 [04:18<01:12, 1.07it/s]
Loading 0: 79%|███████▉ | 286/363 [04:18<01:12, 1.07it/s]
Loading 0: 79%|███████▉ | 287/363 [04:20<01:18, 1.04s/it]
Loading 0: 79%|███████▉ | 287/363 [04:20<01:18, 1.04s/it]
Loading 0: 79%|███████▉ | 288/363 [04:22<01:29, 1.19s/it]
Loading 0: 79%|███████▉ | 288/363 [04:22<01:29, 1.19s/it]
Loading 0: 80%|████████ | 291/363 [04:25<01:12, 1.01s/it]
Loading 0: 80%|████████ | 291/363 [04:25<01:12, 1.01s/it]
Loading 0: 80%|████████ | 292/363 [04:27<01:22, 1.16s/it]
Loading 0: 80%|████████ | 292/363 [04:27<01:22, 1.16s/it]
Loading 0: 81%|████████ | 293/363 [04:29<01:33, 1.33s/it]
Loading 0: 81%|████████ | 293/363 [04:29<01:33, 1.33s/it]
Loading 0: 83%|████████▎ | 301/363 [04:30<00:33, 1.84it/s]
Loading 0: 83%|████████▎ | 301/363 [04:30<00:33, 1.84it/s]
Loading 0: 84%|████████▎ | 304/363 [04:32<00:35, 1.66it/s]
Loading 0: 84%|████████▎ | 304/363 [04:32<00:35, 1.66it/s]
Loading 0: 84%|████████▍ | 305/363 [04:34<00:43, 1.35it/s]
Loading 0: 84%|████████▍ | 305/363 [04:34<00:43, 1.35it/s]
Loading 0: 84%|████████▍ | 306/363 [04:36<00:53, 1.07it/s]
Loading 0: 84%|████████▍ | 306/363 [04:36<00:53, 1.07it/s]
Loading 0: 85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0: 85%|████████▌ | 309/363 [04:38<00:45, 1.19it/s]
Loading 0: 85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0: 85%|████████▌ | 310/363 [04:40<00:54, 1.02s/it]
Loading 0: 86%|████████▌ | 311/363 [04:43<01:03, 1.23s/it]
Loading 0: 86%|████████▌ | 311/363 [04:43<01:03, 1.23s/it]
Loading 0: 88%|████████▊ | 319/363 [04:44<00:22, 1.98it/s]
Loading 0: 88%|████████▊ | 319/363 [04:44<00:22, 1.98it/s]
Loading 0: 89%|████████▊ | 322/363 [04:46<00:23, 1.72it/s]
Loading 0: 89%|████████▊ | 322/363 [04:46<00:23, 1.72it/s]
Loading 0: 89%|████████▉ | 323/363 [04:48<00:29, 1.34it/s]
Loading 0: 89%|████████▉ | 323/363 [04:48<00:29, 1.34it/s]
Loading 0: 89%|████████▉ | 324/363 [04:50<00:36, 1.07it/s]
Loading 0: 89%|████████▉ | 324/363 [04:50<00:36, 1.07it/s]
Loading 0: 90%|█████████ | 327/363 [04:52<00:30, 1.18it/s]
Loading 0: 90%|█████████ | 327/363 [04:52<00:30, 1.18it/s]
Loading 0: 90%|█████████ | 328/363 [04:54<00:35, 1.03s/it]
Loading 0: 90%|█████████ | 328/363 [04:54<00:35, 1.03s/it]
Loading 0: 91%|█████████ | 329/363 [04:57<00:41, 1.23s/it]
Loading 0: 91%|█████████ | 329/363 [04:57<00:41, 1.23s/it]
Loading 0: 93%|█████████▎| 337/363 [04:58<00:13, 1.99it/s]
Loading 0: 93%|█████████▎| 337/363 [04:58<00:13, 1.99it/s]
Loading 0: 94%|█████████▎| 340/363 [05:00<00:13, 1.72it/s]
Loading 0: 94%|█████████▎| 340/363 [05:00<00:13, 1.72it/s]
Loading 0: 94%|█████████▍| 341/363 [05:02<00:16, 1.34it/s]
Loading 0: 94%|█████████▍| 341/363 [05:02<00:16, 1.34it/s]
Loading 0: 94%|█████████▍| 342/363 [05:04<00:19, 1.06it/s]
Loading 0: 94%|█████████▍| 342/363 [05:04<00:19, 1.06it/s]
Loading 0: 95%|█████████▌| 345/363 [05:06<00:15, 1.17it/s]
Loading 0: 95%|█████████▌| 345/363 [05:06<00:15, 1.17it/s]
Loading 0: 95%|█████████▌| 346/363 [05:09<00:17, 1.04s/it]
Loading 0: 95%|█████████▌| 346/363 [05:09<00:17, 1.04s/it]
Loading 0: 96%|█████████▌| 347/363 [05:11<00:19, 1.24s/it]
Loading 0: 96%|█████████▌| 347/363 [05:11<00:19, 1.24s/it]
Loading 0: 98%|█████████▊| 355/363 [05:12<00:04, 1.95it/s]
Loading 0: 98%|█████████▊| 355/363 [05:12<00:04, 1.95it/s]
Loading 0: 99%|█████████▉| 359/363 [05:15<00:02, 1.72it/s]
Loading 0: 99%|█████████▉| 359/363 [05:15<00:02, 1.72it/s]
Loading 0: 99%|█████████▉| 360/363 [05:17<00:02, 1.36it/s]
Loading 0: 99%|█████████▉| 360/363 [05:17<00:02, 1.36it/s]
Loading 0: 99%|█████████▉| 361/363 [05:19<00:01, 1.09it/s]
Loading 0: 99%|█████████▉| 361/363 [05:19<00:01, 1.09it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.09it/s]
Loading 0: 100%|██████████| 363/363 [05:19<00:00, 1.14it/s]
chaiml-mistral-24b-2048-44577-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:29, 1.42s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:29, 1.42s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<02:58, 1.97it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<02:58, 1.97it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:49, 1.53it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:49, 1.53it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<04:56, 1.18it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<04:56, 1.18it/s]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:09, 1.06s/it]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:09, 1.06s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:40, 1.16it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:40, 1.16it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:12, 1.29it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:12, 1.29it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:04, 1.13s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:30, 2.09it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.83it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.83it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:46<02:30, 1.97it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:46<02:30, 1.97it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:39, 1.84it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:39, 1.84it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:22, 1.44it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:22, 1.44it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:13, 1.15it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:13, 1.15it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:46, 1.27it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:46, 1.27it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:33, 1.05it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:33, 1.05it/s]
Loading 0: 21%|██ | 77.0/363 [00:59<05:26, 1.14s/it]
Loading 0: 21%|██ | 77.0/363 [00:59<05:26, 1.14s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:00<02:21, 1.98it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:00<02:21, 1.98it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:29, 1.84it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:29, 1.84it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:56, 2.28it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:56, 2.28it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.07it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.07it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:46, 1.12s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:46, 1.12s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:51, 1.09it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:51, 1.09it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:31, 1.08s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:31, 1.08s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<01:59, 2.02it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<01:59, 2.02it/s]
Loading 0: 34%|███▍ | 124/363 [01:28<02:13, 1.78it/s]
Loading 0: 34%|███▍ | 124/363 [01:28<02:13, 1.78it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:49, 1.40it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:49, 1.40it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:32, 1.12it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:32, 1.12it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 38%|███▊ | 139/363 [01:39<01:48, 2.07it/s]
Loading 0: 38%|███▊ | 139/363 [01:39<01:48, 2.07it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.81it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.81it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.42it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.42it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:51<04:05, 1.15s/it]
Loading 0: 41%|████ | 149/363 [01:51<04:05, 1.15s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.08it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.08it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.83it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.83it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.27it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.27it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.05it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.05it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.07it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.07it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.82it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.82it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.05it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.05it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:23, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:23, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:20, 2.10it/s]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:20, 2.10it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:30, 1.84it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:30, 1.84it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.44it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.44it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:24, 1.14it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:24, 1.14it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.14s/it]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.14s/it]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:13, 2.07it/s]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:13, 2.07it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.82it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.82it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:04, 2.09it/s]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:04, 2.09it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:11, 1.83it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:11, 1.83it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:52, 1.14it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:52, 1.14it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 68%|██████▊ | 247/363 [02:58<00:55, 2.08it/s]
Loading 0: 68%|██████▊ | 247/363 [02:58<00:55, 2.08it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 70%|███████ | 255/363 [03:06<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:06<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:10<02:00, 1.14s/it]
Loading 0: 71%|███████ | 257/363 [03:10<02:00, 1.14s/it]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:47, 2.08it/s]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:47, 2.08it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.83it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.83it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:36, 2.41s/it]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:36, 2.41s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:27, 2.33s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:27, 2.33s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:22, 2.30s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:22, 2.30s/it]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.16it/s]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.16it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.22it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.22it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:10, 1.08it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:10, 1.08it/s]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:20, 1.07s/it]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:20, 1.07s/it]
Loading 0: 80%|████████ | 291/363 [03:46<01:05, 1.10it/s]
Loading 0: 80%|████████ | 291/363 [03:46<01:05, 1.10it/s]
Loading 0: 80%|████████ | 292/363 [03:48<01:16, 1.07s/it]
Loading 0: 80%|████████ | 292/363 [03:48<01:16, 1.07s/it]
Loading 0: 81%|████████ | 293/363 [03:50<01:26, 1.24s/it]
Loading 0: 81%|████████ | 293/363 [03:50<01:26, 1.24s/it]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.98it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:21, 2.09it/s]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:21, 2.09it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.83it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.09it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.83it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0: 99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0: 99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0: 99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0: 99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0: 99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:52, 1.55it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:16, 1.05s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:16, 1.05s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:19, 1.40s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:19, 1.40s/it]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:43, 2.15it/s]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:43, 2.15it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:50, 1.52it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:58, 1.17it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:58, 1.17it/s]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:13, 1.07s/it]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:13, 1.07s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:38, 1.00it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:38, 1.00it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:32, 2.18it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.89it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:41, 1.48it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:39, 1.17it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:10, 1.29it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:03, 1.06it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:01, 1.12s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:01, 1.12s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:29, 2.10it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:29, 2.10it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:49, 1.83it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:35, 1.44it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:31, 1.14it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:31, 1.14it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:46<02:23, 2.06it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:46<02:23, 2.06it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:43, 1.79it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:43, 1.79it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:26, 1.41it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:19, 1.12it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:19, 1.12it/s]
Loading 0: 21%|██ | 75.0/363 [00:54<03:50, 1.25it/s]
Loading 0: 21%|██ | 75.0/363 [00:54<03:50, 1.25it/s]
Loading 0: 21%|██ | 76.0/363 [00:56<04:36, 1.04it/s]
Loading 0: 21%|██ | 76.0/363 [00:56<04:36, 1.04it/s]
Loading 0: 21%|██ | 77.0/363 [00:58<05:29, 1.15s/it]
Loading 0: 21%|██ | 77.0/363 [00:58<05:29, 1.15s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.07it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:32, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:32, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:01, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:01, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:17, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:17, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.01it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.01it/s]
Loading 0: 34%|███▍ | 124/363 [01:28<02:15, 1.77it/s]
Loading 0: 34%|███▍ | 124/363 [01:28<02:15, 1.77it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.39it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.39it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:33, 1.11it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:33, 1.11it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 38%|███▊ | 139/363 [01:39<01:48, 2.06it/s]
Loading 0: 38%|███▊ | 139/363 [01:39<01:48, 2.06it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.80it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.80it/s]
Loading 0: 39%|███▉ | 143/363 [01:43<02:35, 1.42it/s]
Loading 0: 39%|███▉ | 143/363 [01:43<02:35, 1.42it/s]
Loading 0: 40%|███▉ | 144/363 [01:45<03:13, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:45<03:13, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:47<02:51, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:47<02:51, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:51<04:06, 1.15s/it]
Loading 0: 41%|████ | 149/363 [01:51<04:06, 1.15s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.07it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.07it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:52, 1.81it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:52, 1.81it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:22, 1.42it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:22, 1.42it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:57, 1.13it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:57, 1.13it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:37, 1.26it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:37, 1.26it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:09, 1.04it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:09, 1.04it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.07it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.07it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.81it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.81it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.42it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.42it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:41, 1.13it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:41, 1.13it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.26it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.26it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:52, 1.04it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:52, 1.04it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:22, 2.07it/s]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:22, 2.07it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:56, 1.43it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:56, 1.43it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:08, 1.26it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:08, 1.26it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:02, 1.14s/it]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:02, 1.14s/it]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:12, 2.09it/s]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:12, 2.09it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 63%|██████▎ | 228/363 [02:45<01:08, 1.98it/s]
Loading 0: 63%|██████▎ | 228/363 [02:45<01:08, 1.98it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:11, 1.84it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:11, 1.84it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:29, 1.45it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:29, 1.45it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:51, 1.15it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:51, 1.15it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:38, 1.28it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:38, 1.28it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:58, 1.06it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:58, 1.06it/s]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:20, 1.13s/it]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:20, 1.13s/it]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.09it/s]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.09it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:17, 1.44it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:17, 1.44it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:24, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:24, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:41, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:41, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:10<02:00, 1.14s/it]
Loading 0: 71%|███████ | 257/363 [03:10<02:00, 1.14s/it]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.09it/s]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.09it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:52, 1.82it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:52, 1.82it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:34, 2.38s/it]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:34, 2.38s/it]
Loading 0: 75%|███████▌ | 274/363 [03:34<03:25, 2.31s/it]
Loading 0: 75%|███████▌ | 274/363 [03:34<03:25, 2.31s/it]
Loading 0: 76%|███████▌ | 275/363 [03:36<03:19, 2.26s/it]
Loading 0: 76%|███████▌ | 275/363 [03:36<03:19, 2.26s/it]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.18it/s]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.18it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.23it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.23it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:09, 1.09it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:09, 1.09it/s]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:19, 1.07s/it]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:19, 1.07s/it]
Loading 0: 80%|████████ | 291/363 [03:45<01:05, 1.10it/s]
Loading 0: 80%|████████ | 291/363 [03:45<01:05, 1.10it/s]
Loading 0: 80%|████████ | 292/363 [03:47<01:15, 1.06s/it]
Loading 0: 80%|████████ | 292/363 [03:47<01:15, 1.06s/it]
Loading 0: 81%|████████ | 293/363 [03:49<01:26, 1.23s/it]
Loading 0: 81%|████████ | 293/363 [03:49<01:26, 1.23s/it]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.09it/s]
Loading 0: 99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 360/363 [04:34<00:02, 1.49it/s]
Loading 0: 99%|█████████▉| 360/363 [04:34<00:02, 1.49it/s]
Loading 0: 99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0: 99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.31it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpdfxn2f_s' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-43874-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:20, 1.06s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:20, 1.06s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:38, 1.45s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:38, 1.45s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:01, 1.94it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:01, 1.94it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.51it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.51it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<04:59, 1.17it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<04:59, 1.17it/s]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:13, 1.07s/it]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:13, 1.07s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:46, 1.51it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:39, 1.22it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:42, 1.01s/it]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.16it/s]
Loading 0: 9%|▉ | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0: 9%|▉ | 34.0/363 [00:23<02:56, 1.87it/s]
Loading 0: 10%|▉ | 35.0/363 [00:25<03:44, 1.46it/s]
Loading 0: 10%|▉ | 35.0/363 [00:25<03:44, 1.46it/s]
Loading 0: 10%|▉ | 36.0/363 [00:27<04:42, 1.16it/s]
Loading 0: 10%|▉ | 36.0/363 [00:27<04:42, 1.16it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:13, 1.28it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:06, 1.05it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:05, 1.14s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:34<02:30, 2.09it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:34<02:30, 2.09it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:38<03:37, 1.43it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:38<03:37, 1.43it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:40<04:32, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:42<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:44<04:53, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:46<05:49, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:42, 1.81it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:48, 1.26it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:35, 1.04it/s]
Loading 0: 21%|██ | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0: 21%|██ | 77.0/363 [00:59<05:28, 1.15s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:00<02:21, 1.97it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:00<02:21, 1.97it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.82it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:11, 1.43it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<03:59, 1.14it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:08<01:56, 2.28it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:08<01:56, 2.28it/s]
Loading 0: 28%|██▊ | 101/363 [01:10<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 101/363 [01:10<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 102/363 [01:12<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 102/363 [01:12<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 103/363 [01:14<03:34, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:14<03:34, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:16<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 106/363 [01:16<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 107/363 [01:18<04:01, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:18<04:01, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:20<04:48, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:20<04:48, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:22<03:52, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:22<03:52, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:33, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:33, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:27<02:00, 2.00it/s]
Loading 0: 33%|███▎ | 121/363 [01:27<02:00, 2.00it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:15, 1.77it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:15, 1.77it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:51, 1.39it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:51, 1.39it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:34, 1.11it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:34, 1.11it/s]
Loading 0: 36%|███▌ | 129/363 [01:35<03:08, 1.24it/s]
Loading 0: 36%|███▌ | 129/363 [01:35<03:08, 1.24it/s]
Loading 0: 36%|███▌ | 130/363 [01:37<03:46, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:37<03:46, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:39<04:28, 1.16s/it]
Loading 0: 36%|███▌ | 131/363 [01:39<04:28, 1.16s/it]
Loading 0: 38%|███▊ | 138/363 [01:40<01:54, 1.96it/s]
Loading 0: 38%|███▊ | 138/363 [01:40<01:54, 1.96it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:00, 1.83it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:00, 1.83it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:33, 1.44it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:33, 1.44it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:11, 1.14it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:11, 1.14it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:50, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:50, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:25, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:25, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:52<04:04, 1.14s/it]
Loading 0: 41%|████ | 149/363 [01:52<04:04, 1.14s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.07it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.07it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.81it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.81it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.42it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.42it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:57, 1.13it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:57, 1.13it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:37, 1.26it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:37, 1.26it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:09, 1.04it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:09, 1.04it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:45, 1.15s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:45, 1.15s/it]
Loading 0: 48%|████▊ | 175/363 [02:07<01:31, 2.06it/s]
Loading 0: 48%|████▊ | 175/363 [02:07<01:31, 2.06it/s]
Loading 0: 49%|████▉ | 178/363 [02:09<01:42, 1.81it/s]
Loading 0: 49%|████▉ | 178/363 [02:09<01:42, 1.81it/s]
Loading 0: 49%|████▉ | 179/363 [02:11<02:09, 1.42it/s]
Loading 0: 49%|████▉ | 179/363 [02:11<02:09, 1.42it/s]
Loading 0: 50%|████▉ | 180/363 [02:13<02:41, 1.13it/s]
Loading 0: 50%|████▉ | 180/363 [02:13<02:41, 1.13it/s]
Loading 0: 50%|█████ | 183/363 [02:15<02:22, 1.26it/s]
Loading 0: 50%|█████ | 183/363 [02:15<02:22, 1.26it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 185/363 [02:19<03:25, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:19<03:25, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:20<01:22, 2.06it/s]
Loading 0: 53%|█████▎ | 193/363 [02:20<01:22, 2.06it/s]
Loading 0: 54%|█████▍ | 196/363 [02:22<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 196/363 [02:22<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 197/363 [02:24<01:56, 1.42it/s]
Loading 0: 54%|█████▍ | 197/363 [02:24<01:56, 1.42it/s]
Loading 0: 55%|█████▍ | 198/363 [02:26<02:25, 1.13it/s]
Loading 0: 55%|█████▍ | 198/363 [02:26<02:25, 1.13it/s]
Loading 0: 55%|█████▌ | 201/363 [02:28<02:08, 1.26it/s]
Loading 0: 55%|█████▌ | 201/363 [02:28<02:08, 1.26it/s]
Loading 0: 56%|█████▌ | 202/363 [02:30<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 202/363 [02:30<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 203/363 [02:32<03:03, 1.15s/it]
Loading 0: 56%|█████▌ | 203/363 [02:32<03:03, 1.15s/it]
Loading 0: 58%|█████▊ | 211/363 [02:33<01:13, 2.07it/s]
Loading 0: 58%|█████▊ | 211/363 [02:33<01:13, 2.07it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:22, 1.82it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:22, 1.82it/s]
Loading 0: 59%|█████▉ | 215/363 [02:37<01:43, 1.43it/s]
Loading 0: 59%|█████▉ | 215/363 [02:37<01:43, 1.43it/s]
Loading 0: 60%|█████▉ | 216/363 [02:39<02:09, 1.13it/s]
Loading 0: 60%|█████▉ | 216/363 [02:39<02:09, 1.13it/s]
Loading 0: 60%|██████ | 219/363 [02:41<01:54, 1.26it/s]
Loading 0: 60%|██████ | 219/363 [02:41<01:54, 1.26it/s]
Loading 0: 61%|██████ | 220/363 [02:43<02:17, 1.04it/s]
Loading 0: 61%|██████ | 220/363 [02:43<02:17, 1.04it/s]
Loading 0: 61%|██████ | 221/363 [02:45<02:43, 1.15s/it]
Loading 0: 61%|██████ | 221/363 [02:45<02:43, 1.15s/it]
Loading 0: 63%|██████▎ | 229/363 [02:46<01:04, 2.06it/s]
Loading 0: 63%|██████▎ | 229/363 [02:46<01:04, 2.06it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.13it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.13it/s]
Loading 0: 65%|██████▌ | 237/363 [02:54<01:39, 1.26it/s]
Loading 0: 65%|██████▌ | 237/363 [02:54<01:39, 1.26it/s]
Loading 0: 66%|██████▌ | 238/363 [02:56<01:59, 1.04it/s]
Loading 0: 66%|██████▌ | 238/363 [02:56<01:59, 1.04it/s]
Loading 0: 66%|██████▌ | 239/363 [02:58<02:22, 1.15s/it]
Loading 0: 66%|██████▌ | 239/363 [02:58<02:22, 1.15s/it]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.08it/s]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.08it/s]
Loading 0: 69%|██████▉ | 250/363 [03:02<01:02, 1.82it/s]
Loading 0: 69%|██████▉ | 250/363 [03:02<01:02, 1.82it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:09<01:42, 1.04it/s]
Loading 0: 71%|███████ | 256/363 [03:09<01:42, 1.04it/s]
Loading 0: 71%|███████ | 257/363 [03:11<02:01, 1.15s/it]
Loading 0: 71%|███████ | 257/363 [03:11<02:01, 1.15s/it]
Loading 0: 73%|███████▎ | 265/363 [03:13<00:47, 2.08it/s]
Loading 0: 73%|███████▎ | 265/363 [03:13<00:47, 2.08it/s]
Loading 0: 74%|███████▍ | 268/363 [03:15<00:52, 1.82it/s]
Loading 0: 74%|███████▍ | 268/363 [03:15<00:52, 1.82it/s]
Loading 0: 74%|███████▍ | 269/363 [03:17<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 269/363 [03:17<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 270/363 [03:19<01:21, 1.14it/s]
Loading 0: 74%|███████▍ | 270/363 [03:19<01:21, 1.14it/s]
Loading 0: 75%|███████▌ | 273/363 [03:34<03:38, 2.43s/it]
Loading 0: 75%|███████▌ | 273/363 [03:34<03:38, 2.43s/it]
Loading 0: 75%|███████▌ | 274/363 [03:36<03:28, 2.35s/it]
Loading 0: 75%|███████▌ | 274/363 [03:36<03:28, 2.35s/it]
Loading 0: 76%|███████▌ | 275/363 [03:38<03:22, 2.30s/it]
Loading 0: 76%|███████▌ | 275/363 [03:38<03:22, 2.30s/it]
Loading 0: 78%|███████▊ | 283/363 [03:39<01:08, 1.16it/s]
Loading 0: 78%|███████▊ | 283/363 [03:39<01:08, 1.16it/s]
Loading 0: 79%|███████▉ | 286/363 [03:41<01:03, 1.20it/s]
Loading 0: 79%|███████▉ | 286/363 [03:41<01:03, 1.20it/s]
Loading 0: 79%|███████▉ | 287/363 [03:43<01:12, 1.05it/s]
Loading 0: 79%|███████▉ | 287/363 [03:43<01:12, 1.05it/s]
Loading 0: 79%|███████▉ | 288/363 [03:45<01:22, 1.10s/it]
Loading 0: 79%|███████▉ | 288/363 [03:45<01:22, 1.10s/it]
Loading 0: 80%|████████ | 291/363 [03:47<01:06, 1.08it/s]
Loading 0: 80%|████████ | 291/363 [03:47<01:06, 1.08it/s]
Loading 0: 80%|████████ | 292/363 [03:49<01:16, 1.07s/it]
Loading 0: 80%|████████ | 292/363 [03:49<01:16, 1.07s/it]
Loading 0: 81%|████████ | 293/363 [03:51<01:27, 1.24s/it]
Loading 0: 81%|████████ | 293/363 [03:51<01:27, 1.24s/it]
Loading 0: 83%|████████▎ | 301/363 [03:52<00:31, 1.97it/s]
Loading 0: 83%|████████▎ | 301/363 [03:52<00:31, 1.97it/s]
Loading 0: 84%|████████▎ | 304/363 [03:54<00:33, 1.75it/s]
Loading 0: 84%|████████▎ | 304/363 [03:54<00:33, 1.75it/s]
Loading 0: 84%|████████▍ | 305/363 [03:56<00:41, 1.39it/s]
Loading 0: 84%|████████▍ | 305/363 [03:56<00:41, 1.39it/s]
Loading 0: 84%|████████▍ | 306/363 [03:58<00:51, 1.12it/s]
Loading 0: 84%|████████▍ | 306/363 [03:58<00:51, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [04:00<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:02<00:51, 1.03it/s]
Loading 0: 85%|████████▌ | 310/363 [04:02<00:51, 1.03it/s]
Loading 0: 86%|████████▌ | 311/363 [04:04<01:00, 1.16s/it]
Loading 0: 86%|████████▌ | 311/363 [04:04<01:00, 1.16s/it]
Loading 0: 88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0: 88%|████████▊ | 319/363 [04:05<00:21, 2.08it/s]
Loading 0: 89%|████████▊ | 322/363 [04:08<00:22, 1.83it/s]
Loading 0: 89%|████████▊ | 322/363 [04:08<00:22, 1.83it/s]
Loading 0: 89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0: 89%|████████▉ | 323/363 [04:09<00:27, 1.43it/s]
Loading 0: 89%|████████▉ | 324/363 [04:11<00:34, 1.14it/s]
Loading 0: 89%|████████▉ | 324/363 [04:11<00:34, 1.14it/s]
Loading 0: 90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0: 90%|█████████ | 327/363 [04:13<00:28, 1.26it/s]
Loading 0: 90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0: 90%|█████████ | 328/363 [04:15<00:33, 1.04it/s]
Loading 0: 91%|█████████ | 329/363 [04:17<00:39, 1.15s/it]
Loading 0: 91%|█████████ | 329/363 [04:17<00:39, 1.15s/it]
Loading 0: 93%|█████████▎| 337/363 [04:18<00:12, 2.09it/s]
Loading 0: 93%|█████████▎| 337/363 [04:18<00:12, 2.09it/s]
Loading 0: 94%|█████████▎| 340/363 [04:21<00:12, 1.83it/s]
Loading 0: 94%|█████████▎| 340/363 [04:21<00:12, 1.83it/s]
Loading 0: 94%|█████████▍| 341/363 [04:23<00:15, 1.43it/s]
Loading 0: 94%|█████████▍| 341/363 [04:23<00:15, 1.43it/s]
Loading 0: 94%|█████████▍| 342/363 [04:25<00:18, 1.14it/s]
Loading 0: 94%|█████████▍| 342/363 [04:25<00:18, 1.14it/s]
Loading 0: 95%|█████████▌| 345/363 [04:27<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 345/363 [04:27<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0: 95%|█████████▌| 346/363 [04:28<00:16, 1.04it/s]
Loading 0: 96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0: 96%|█████████▌| 347/363 [04:30<00:18, 1.15s/it]
Loading 0: 98%|█████████▊| 355/363 [04:32<00:03, 2.09it/s]
Loading 0: 98%|█████████▊| 355/363 [04:32<00:03, 2.09it/s]
Loading 0: 99%|█████████▉| 359/363 [04:34<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 359/363 [04:34<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 360/363 [04:36<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 360/363 [04:36<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 361/363 [04:38<00:01, 1.18it/s]
Loading 0: 99%|█████████▉| 361/363 [04:38<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.58it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.58it/s]
Loading 0: 100%|██████████| 363/363 [04:38<00:00, 1.30it/s]
chaiml-mistral-24b-2048-76177-v2-mkmlizer: quantized model in 283.433s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp9vlvegk0' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-76177-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_927_merged in 367.078s
chaiml-mistral-24b-2048-43874-v2-mkmlizer: quantized model in 285.402s
chaiml-mistral-24b-2048-76177-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-43874-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_309_merged in 366.220s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpfmjv9r1h' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantized model in 329.190s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged in 414.880s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-86542-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:12, 1.20s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:17, 1.56s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:12, 1.38it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:12, 1.38it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:55, 1.19s/it]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:55, 1.19s/it]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:14, 1.08it/s]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0: 8%|▊ | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0: 8%|▊ | 30.0/363 [00:23<03:01, 1.84it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:16, 1.67it/s]
Loading 0: 10%|▉ | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0: 10%|▉ | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:17, 1.03it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:17, 1.03it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0: 11%|█ | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0: 11%|█ | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:37<06:56, 1.29s/it]
Loading 0: 13%|█▎ | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0: 13%|█▎ | 48.0/363 [00:38<03:00, 1.74it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:41<03:14, 1.60it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:43<04:06, 1.26it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:09, 1.00s/it]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:09, 1.00s/it]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:37, 1.10it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:37, 1.10it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:50<05:34, 1.10s/it]
Loading 0: 16%|█▌ | 58.0/363 [00:50<05:34, 1.10s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:39, 1.31s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:39, 1.31s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:53, 1.72it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:56<03:06, 1.57it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:56<03:06, 1.57it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:55, 1.24it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:55, 1.24it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:54, 1.01s/it]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:54, 1.01s/it]
Loading 0: 21%|██ | 75.0/363 [01:03<04:23, 1.09it/s]
Loading 0: 21%|██ | 75.0/363 [01:03<04:23, 1.09it/s]
Loading 0: 21%|██ | 76.0/363 [01:05<05:17, 1.10s/it]
Loading 0: 21%|██ | 76.0/363 [01:05<05:17, 1.10s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:18, 1.32s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:18, 1.32s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:43, 1.70it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:43, 1.70it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:54, 1.57it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:54, 1.57it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:14<03:40, 1.24it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:14<03:40, 1.24it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:16<04:35, 1.01s/it]
Loading 0: 25%|██▍ | 90.0/363 [01:16<04:35, 1.01s/it]
Loading 0: 27%|██▋ | 97.0/363 [01:17<02:18, 1.92it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:17<02:18, 1.92it/s]
Loading 0: 28%|██▊ | 101/363 [01:20<02:28, 1.77it/s]
Loading 0: 28%|██▊ | 101/363 [01:20<02:28, 1.77it/s]
Loading 0: 28%|██▊ | 102/363 [01:22<03:10, 1.37it/s]
Loading 0: 28%|██▊ | 102/363 [01:22<03:10, 1.37it/s]
Loading 0: 28%|██▊ | 103/363 [01:24<04:03, 1.07it/s]
Loading 0: 28%|██▊ | 103/363 [01:24<04:03, 1.07it/s]
Loading 0: 29%|██▉ | 106/363 [01:27<03:48, 1.12it/s]
Loading 0: 29%|██▉ | 106/363 [01:27<03:48, 1.12it/s]
Loading 0: 29%|██▉ | 107/363 [01:29<04:35, 1.08s/it]
Loading 0: 29%|██▉ | 107/363 [01:29<04:35, 1.08s/it]
Loading 0: 30%|██▉ | 108/363 [01:31<05:29, 1.29s/it]
Loading 0: 30%|██▉ | 108/363 [01:31<05:29, 1.29s/it]
Loading 0: 31%|███ | 111/363 [01:33<04:26, 1.06s/it]
Loading 0: 31%|███ | 111/363 [01:33<04:26, 1.06s/it]
Loading 0: 31%|███ | 112/363 [01:35<05:13, 1.25s/it]
Loading 0: 31%|███ | 112/363 [01:35<05:13, 1.25s/it]
Loading 0: 31%|███ | 113/363 [01:38<06:04, 1.46s/it]
Loading 0: 31%|███ | 113/363 [01:38<06:04, 1.46s/it]
Loading 0: 33%|███▎ | 120/363 [01:39<02:25, 1.67it/s]
Loading 0: 33%|███▎ | 120/363 [01:39<02:25, 1.67it/s]
Loading 0: 34%|███▍ | 124/363 [01:42<02:33, 1.56it/s]
Loading 0: 34%|███▍ | 124/363 [01:42<02:33, 1.56it/s]
Loading 0: 34%|███▍ | 125/363 [01:44<03:13, 1.23it/s]
Loading 0: 34%|███▍ | 125/363 [01:44<03:13, 1.23it/s]
Loading 0: 35%|███▍ | 126/363 [01:46<04:01, 1.02s/it]
Loading 0: 35%|███▍ | 126/363 [01:46<04:01, 1.02s/it]
Loading 0: 36%|███▌ | 129/363 [01:49<03:33, 1.09it/s]
Loading 0: 36%|███▌ | 129/363 [01:49<03:33, 1.09it/s]
Loading 0: 36%|███▌ | 130/363 [01:51<04:17, 1.11s/it]
Loading 0: 36%|███▌ | 130/363 [01:51<04:17, 1.11s/it]
Loading 0: 36%|███▌ | 131/363 [01:53<05:06, 1.32s/it]
Loading 0: 36%|███▌ | 131/363 [01:53<05:06, 1.32s/it]
Loading 0: 38%|███▊ | 138/363 [01:54<02:10, 1.73it/s]
Loading 0: 38%|███▊ | 138/363 [01:54<02:10, 1.73it/s]
Loading 0: 39%|███▉ | 142/363 [01:57<02:17, 1.60it/s]
Loading 0: 39%|███▉ | 142/363 [01:57<02:17, 1.60it/s]
Loading 0: 39%|███▉ | 143/363 [01:59<02:54, 1.26it/s]
Loading 0: 39%|███▉ | 143/363 [01:59<02:54, 1.26it/s]
Loading 0: 40%|███▉ | 144/363 [02:01<03:38, 1.00it/s]
Loading 0: 40%|███▉ | 144/363 [02:01<03:38, 1.00it/s]
Loading 0: 40%|████ | 147/363 [02:04<03:14, 1.11it/s]
Loading 0: 40%|████ | 147/363 [02:04<03:14, 1.11it/s]
Loading 0: 41%|████ | 148/363 [02:06<03:54, 1.09s/it]
Loading 0: 41%|████ | 148/363 [02:06<03:54, 1.09s/it]
Loading 0: 41%|████ | 149/363 [02:08<04:40, 1.31s/it]
Loading 0: 41%|████ | 149/363 [02:08<04:40, 1.31s/it]
Loading 0: 43%|████▎ | 156/363 [02:09<01:59, 1.74it/s]
Loading 0: 43%|████▎ | 156/363 [02:09<01:59, 1.74it/s]
Loading 0: 44%|████▍ | 160/363 [02:12<02:06, 1.60it/s]
Loading 0: 44%|████▍ | 160/363 [02:12<02:06, 1.60it/s]
Loading 0: 44%|████▍ | 161/363 [02:14<02:40, 1.26it/s]
Loading 0: 44%|████▍ | 161/363 [02:14<02:40, 1.26it/s]
Loading 0: 45%|████▍ | 162/363 [02:17<03:21, 1.00s/it]
Loading 0: 45%|████▍ | 162/363 [02:17<03:21, 1.00s/it]
Loading 0: 45%|████▌ | 165/363 [02:19<02:59, 1.11it/s]
Loading 0: 45%|████▌ | 165/363 [02:19<02:59, 1.11it/s]
Loading 0: 46%|████▌ | 166/363 [02:21<03:36, 1.10s/it]
Loading 0: 46%|████▌ | 166/363 [02:21<03:36, 1.10s/it]
Loading 0: 46%|████▌ | 167/363 [02:23<04:17, 1.31s/it]
Loading 0: 46%|████▌ | 167/363 [02:23<04:17, 1.31s/it]
Loading 0: 48%|████▊ | 174/363 [02:25<01:49, 1.72it/s]
Loading 0: 48%|████▊ | 174/363 [02:25<01:49, 1.72it/s]
Loading 0: 49%|████▉ | 178/363 [02:27<01:55, 1.60it/s]
Loading 0: 49%|████▉ | 178/363 [02:27<01:55, 1.60it/s]
Loading 0: 49%|████▉ | 179/363 [02:30<02:26, 1.26it/s]
Loading 0: 49%|████▉ | 179/363 [02:30<02:26, 1.26it/s]
Loading 0: 50%|████▉ | 180/363 [02:32<03:03, 1.00s/it]
Loading 0: 50%|████▉ | 180/363 [02:32<03:03, 1.00s/it]
Loading 0: 50%|█████ | 183/363 [02:34<02:42, 1.11it/s]
Loading 0: 50%|█████ | 183/363 [02:34<02:42, 1.11it/s]
Loading 0: 51%|█████ | 184/363 [02:36<03:15, 1.09s/it]
Loading 0: 51%|█████ | 184/363 [02:36<03:15, 1.09s/it]
Loading 0: 51%|█████ | 185/363 [02:39<03:53, 1.31s/it]
Loading 0: 51%|█████ | 185/363 [02:39<03:53, 1.31s/it]
Loading 0: 53%|█████▎ | 192/363 [02:40<01:39, 1.72it/s]
Loading 0: 53%|█████▎ | 192/363 [02:40<01:39, 1.72it/s]
Loading 0: 54%|█████▍ | 196/363 [02:43<01:44, 1.60it/s]
Loading 0: 54%|█████▍ | 196/363 [02:43<01:44, 1.60it/s]
Loading 0: 54%|█████▍ | 197/363 [02:45<02:12, 1.26it/s]
Loading 0: 54%|█████▍ | 197/363 [02:45<02:12, 1.26it/s]
Loading 0: 55%|█████▍ | 198/363 [02:47<02:44, 1.00it/s]
Loading 0: 55%|█████▍ | 198/363 [02:47<02:44, 1.00it/s]
Loading 0: 55%|█████▌ | 201/363 [02:49<02:26, 1.11it/s]
Loading 0: 55%|█████▌ | 201/363 [02:49<02:26, 1.11it/s]
Loading 0: 56%|█████▌ | 202/363 [02:52<02:55, 1.09s/it]
Loading 0: 56%|█████▌ | 202/363 [02:52<02:55, 1.09s/it]
Loading 0: 56%|█████▌ | 203/363 [02:54<03:29, 1.31s/it]
Loading 0: 56%|█████▌ | 203/363 [02:54<03:29, 1.31s/it]
Loading 0: 58%|█████▊ | 210/363 [02:55<01:28, 1.73it/s]
Loading 0: 58%|█████▊ | 210/363 [02:55<01:28, 1.73it/s]
Loading 0: 59%|█████▉ | 214/363 [02:58<01:33, 1.60it/s]
Loading 0: 59%|█████▉ | 214/363 [02:58<01:33, 1.60it/s]
Loading 0: 59%|█████▉ | 215/363 [03:00<01:57, 1.26it/s]
Loading 0: 59%|█████▉ | 215/363 [03:00<01:57, 1.26it/s]
Loading 0: 60%|█████▉ | 216/363 [03:02<02:26, 1.00it/s]
Loading 0: 60%|█████▉ | 216/363 [03:02<02:26, 1.00it/s]
Loading 0: 60%|██████ | 219/363 [03:05<02:10, 1.10it/s]
Loading 0: 60%|██████ | 219/363 [03:05<02:10, 1.10it/s]
Loading 0: 61%|██████ | 220/363 [03:07<02:36, 1.10s/it]
Loading 0: 61%|██████ | 220/363 [03:07<02:36, 1.10s/it]
Loading 0: 61%|██████ | 221/363 [03:09<03:06, 1.31s/it]
Loading 0: 61%|██████ | 221/363 [03:09<03:06, 1.31s/it]
Loading 0: 63%|██████▎ | 228/363 [03:10<01:18, 1.72it/s]
Loading 0: 63%|██████▎ | 228/363 [03:10<01:18, 1.72it/s]
Loading 0: 64%|██████▍ | 232/363 [03:13<01:21, 1.60it/s]
Loading 0: 64%|██████▍ | 232/363 [03:13<01:21, 1.60it/s]
Loading 0: 64%|██████▍ | 233/363 [03:16<01:48, 1.19it/s]
Loading 0: 64%|██████▍ | 233/363 [03:16<01:48, 1.19it/s]
Loading 0: 64%|██████▍ | 234/363 [03:18<02:13, 1.04s/it]
Loading 0: 64%|██████▍ | 234/363 [03:18<02:13, 1.04s/it]
Loading 0: 65%|██████▌ | 237/363 [03:20<01:56, 1.08it/s]
Loading 0: 65%|██████▌ | 237/363 [03:20<01:56, 1.08it/s]
Loading 0: 66%|██████▌ | 238/363 [03:22<02:19, 1.11s/it]
Loading 0: 66%|██████▌ | 238/363 [03:22<02:19, 1.11s/it]
Loading 0: 66%|██████▌ | 239/363 [03:25<02:44, 1.33s/it]
Loading 0: 66%|██████▌ | 239/363 [03:25<02:44, 1.33s/it]
Loading 0: 68%|██████▊ | 246/363 [03:26<01:08, 1.70it/s]
Loading 0: 68%|██████▊ | 246/363 [03:26<01:08, 1.70it/s]
Loading 0: 69%|██████▉ | 250/363 [03:29<01:11, 1.59it/s]
Loading 0: 69%|██████▉ | 250/363 [03:29<01:11, 1.59it/s]
Loading 0: 69%|██████▉ | 251/363 [03:31<01:29, 1.25it/s]
Loading 0: 69%|██████▉ | 251/363 [03:31<01:29, 1.25it/s]
Loading 0: 69%|██████▉ | 252/363 [03:33<01:51, 1.01s/it]
Loading 0: 69%|██████▉ | 252/363 [03:33<01:51, 1.01s/it]
Loading 0: 70%|███████ | 255/363 [03:35<01:38, 1.10it/s]
Loading 0: 70%|███████ | 255/363 [03:35<01:38, 1.10it/s]
Loading 0: 71%|███████ | 256/363 [03:38<01:57, 1.10s/it]
Loading 0: 71%|███████ | 256/363 [03:38<01:57, 1.10s/it]
Loading 0: 71%|███████ | 257/363 [03:40<02:19, 1.32s/it]
Loading 0: 71%|███████ | 257/363 [03:40<02:19, 1.32s/it]
Loading 0: 73%|███████▎ | 264/363 [03:41<00:57, 1.71it/s]
Loading 0: 73%|███████▎ | 264/363 [03:41<00:57, 1.71it/s]
Loading 0: 74%|███████▍ | 268/363 [03:44<00:59, 1.60it/s]
Loading 0: 74%|███████▍ | 268/363 [03:44<00:59, 1.60it/s]
Loading 0: 74%|███████▍ | 269/363 [03:46<01:14, 1.26it/s]
Loading 0: 74%|███████▍ | 269/363 [03:46<01:14, 1.26it/s]
Loading 0: 74%|███████▍ | 270/363 [03:48<01:33, 1.00s/it]
Loading 0: 74%|███████▍ | 270/363 [03:48<01:33, 1.00s/it]
Loading 0: 75%|███████▌ | 273/363 [04:05<03:57, 2.64s/it]
Loading 0: 75%|███████▌ | 273/363 [04:05<03:57, 2.64s/it]
Loading 0: 75%|███████▌ | 274/363 [04:07<03:49, 2.58s/it]
Loading 0: 75%|███████▌ | 274/363 [04:07<03:49, 2.58s/it]
Loading 0: 76%|███████▌ | 275/363 [04:09<03:42, 2.53s/it]
Loading 0: 76%|███████▌ | 275/363 [04:09<03:42, 2.53s/it]
Loading 0: 78%|███████▊ | 282/363 [04:11<01:22, 1.02s/it]
Loading 0: 78%|███████▊ | 282/363 [04:11<01:22, 1.02s/it]
Loading 0: 79%|███████▉ | 286/363 [04:13<01:09, 1.11it/s]
Loading 0: 79%|███████▉ | 286/363 [04:13<01:09, 1.11it/s]
Loading 0: 79%|███████▉ | 287/363 [04:15<01:19, 1.04s/it]
Loading 0: 79%|███████▉ | 287/363 [04:15<01:19, 1.04s/it]
Loading 0: 79%|███████▉ | 288/363 [04:18<01:31, 1.22s/it]
Loading 0: 79%|███████▉ | 288/363 [04:18<01:31, 1.22s/it]
Loading 0: 80%|████████ | 291/363 [04:20<01:13, 1.02s/it]
Loading 0: 80%|████████ | 291/363 [04:20<01:13, 1.02s/it]
Loading 0: 80%|████████ | 292/363 [04:22<01:24, 1.20s/it]
Loading 0: 80%|████████ | 292/363 [04:22<01:24, 1.20s/it]
Loading 0: 81%|████████ | 293/363 [04:24<01:36, 1.37s/it]
Loading 0: 81%|████████ | 293/363 [04:24<01:36, 1.37s/it]
Loading 0: 83%|████████▎ | 300/363 [04:25<00:37, 1.68it/s]
Loading 0: 83%|████████▎ | 300/363 [04:25<00:37, 1.68it/s]
Loading 0: 84%|████████▎ | 304/363 [04:28<00:36, 1.60it/s]
Loading 0: 84%|████████▎ | 304/363 [04:28<00:36, 1.60it/s]
Loading 0: 84%|████████▍ | 305/363 [04:30<00:45, 1.28it/s]
Loading 0: 84%|████████▍ | 305/363 [04:30<00:45, 1.28it/s]
Loading 0: 84%|████████▍ | 306/363 [04:32<00:56, 1.01it/s]
Loading 0: 84%|████████▍ | 306/363 [04:32<00:56, 1.01it/s]
Loading 0: 85%|████████▌ | 309/363 [04:35<00:48, 1.11it/s]
Loading 0: 85%|████████▌ | 309/363 [04:35<00:48, 1.11it/s]
Loading 0: 85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0: 85%|████████▌ | 310/363 [04:37<00:57, 1.09s/it]
Loading 0: 86%|████████▌ | 311/363 [04:39<01:07, 1.30s/it]
Loading 0: 86%|████████▌ | 311/363 [04:39<01:07, 1.30s/it]
Loading 0: 88%|████████▊ | 318/363 [04:40<00:25, 1.75it/s]
Loading 0: 88%|████████▊ | 318/363 [04:40<00:25, 1.75it/s]
Loading 0: 89%|████████▊ | 322/363 [04:43<00:25, 1.62it/s]
Loading 0: 89%|████████▊ | 322/363 [04:43<00:25, 1.62it/s]
Loading 0: 89%|████████▉ | 323/363 [04:45<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 323/363 [04:45<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 324/363 [04:47<00:38, 1.01it/s]
Loading 0: 89%|████████▉ | 324/363 [04:47<00:38, 1.01it/s]
Loading 0: 90%|█████████ | 327/363 [04:50<00:32, 1.11it/s]
Loading 0: 90%|█████████ | 327/363 [04:50<00:32, 1.11it/s]
Loading 0: 90%|█████████ | 328/363 [04:52<00:38, 1.09s/it]
Loading 0: 90%|█████████ | 328/363 [04:52<00:38, 1.09s/it]
Loading 0: 91%|█████████ | 329/363 [04:54<00:44, 1.31s/it]
Loading 0: 91%|█████████ | 329/363 [04:54<00:44, 1.31s/it]
Loading 0: 93%|█████████▎| 336/363 [04:55<00:15, 1.75it/s]
Loading 0: 93%|█████████▎| 336/363 [04:55<00:15, 1.75it/s]
Loading 0: 94%|█████████▎| 340/363 [04:58<00:14, 1.61it/s]
Loading 0: 94%|█████████▎| 340/363 [04:58<00:14, 1.61it/s]
Loading 0: 94%|█████████▍| 341/363 [05:00<00:17, 1.26it/s]
Loading 0: 94%|█████████▍| 341/363 [05:00<00:17, 1.26it/s]
Loading 0: 94%|█████████▍| 342/363 [05:03<00:20, 1.00it/s]
Loading 0: 94%|█████████▍| 342/363 [05:03<00:20, 1.00it/s]
Loading 0: 95%|█████████▌| 345/363 [05:05<00:16, 1.11it/s]
Loading 0: 95%|█████████▌| 345/363 [05:05<00:16, 1.11it/s]
Loading 0: 95%|█████████▌| 346/363 [05:07<00:18, 1.10s/it]
Loading 0: 95%|█████████▌| 346/363 [05:07<00:18, 1.10s/it]
Loading 0: 96%|█████████▌| 347/363 [05:09<00:21, 1.32s/it]
Loading 0: 96%|█████████▌| 347/363 [05:09<00:21, 1.32s/it]
Loading 0: 98%|█████████▊| 354/363 [05:11<00:05, 1.73it/s]
Loading 0: 98%|█████████▊| 354/363 [05:11<00:05, 1.73it/s]
Loading 0: 99%|█████████▉| 359/363 [05:14<00:02, 1.66it/s]
Loading 0: 99%|█████████▉| 359/363 [05:14<00:02, 1.66it/s]
Loading 0: 99%|█████████▉| 360/363 [05:16<00:02, 1.31it/s]
Loading 0: 99%|█████████▉| 360/363 [05:16<00:02, 1.31it/s]
Loading 0: 99%|█████████▉| 361/363 [05:18<00:01, 1.04it/s]
Loading 0: 99%|█████████▉| 361/363 [05:18<00:01, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:18<00:00, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:18<00:00, 1.14it/s]
chaiml-mistral-24b-2048-96633-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmpw4icn4mf' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-96633-v3-mkmlizer: quantized model in 326.095s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_96_max_top_10k_new_rm_927_merged in 413.466s
chaiml-mistral-24b-2048-96633-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG retryable error: ServiceUnavailable: Service Unavailable
chaiml-mistral-24b-2048-86542-v2-mkmlizer: status code: 503, request id: , host id:
chaiml-mistral-24b-2048-96633-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-96633-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.1.safetensors": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-96633-v3-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~32xfkZ2a49JSJDym0VPaJoGrYiKJLf1 caused by: SignatureDoesNotMatch: status code: 403, request id: tx00000500517ea3cb70050-00698eacb5-14995edef0-default, host id:
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: SlowDown:
Job chaiml-mistral-24b-2048-86542-v2-mkmlizer completed after 623.18s with status: failed
chaiml-mistral-24b-2048-44577-v2-mkmlizer: status code: 503, request id: tx0000095a07a375ef01f90-00698eacf7-14b31daae8-default, host id:
Job failed chaiml-mistral-24b-2048-86542-v2-mkmlizer:
Stopping job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name chaiml-mistral-24b-2048-86542-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-86542-v2-mkmlizer to finish
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG retryable error: SlowDown:
chaiml-mistral-24b-2048-44577-v2-mkmlizer: status code: 503, request id: tx00000be3a9538774ddc25-00698ead1e-14b31daae8-default, host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-86542-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-86542-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/flywheel_model.1.safetensors": MultipartUpload: upload multipart failed upload id: 2~XuuU4uHnsDOcyq7xWehPTfiFdwadpac caused by: SignatureDoesNotMatch: status code: 403, request id: tx00000cd45c3de09689b37-00698ead21-14af544255-default, host id:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
Job chaiml-mistral-24b-2048-44577-v2-mkmlizer completed after 613.16s with status: failed
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
Job failed chaiml-mistral-24b-2048-44577-v2-mkmlizer:
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
Stopping job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
%s, retrying in %s seconds...
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
Starting job with name chaiml-mistral-24b-2048-44577-v2-mkmlizer
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
Waiting for job on chaiml-mistral-24b-2048-44577-v2-mkmlizer to finish
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-86542-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-44577-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-44577-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-44577-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-44577-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Downloaded to shared memory in 95.237s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged already exists in ChaiML
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmppwz7f05g, device:0
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Downloaded to shared memory in 76.733s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged already exists in ChaiML
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp4u7h47yj, device:0
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-86542-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:17, 1.05s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:05, 1.36s/it]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:39, 2.20it/s]
Loading 0: 4%|▎ | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0: 4%|▎ | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:57, 1.17it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:57, 1.17it/s]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:11, 1.07s/it]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:11, 1.07s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:43, 1.53it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:36, 1.23it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:39, 1.00it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:31, 2.19it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:31, 2.19it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:42, 1.47it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:16, 1.26it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:16, 1.26it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:08, 1.05it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:07, 1.14s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:31, 2.08it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:31, 2.08it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:37, 1.43it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:48, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:46<02:22, 2.08it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:46<02:22, 2.08it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.82it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.82it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:24, 1.43it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:17, 1.13it/s]
Loading 0: 21%|██ | 75.0/363 [00:54<03:48, 1.26it/s]
Loading 0: 21%|██ | 75.0/363 [00:54<03:48, 1.26it/s]
Loading 0: 21%|██ | 76.0/363 [00:56<04:35, 1.04it/s]
Loading 0: 21%|██ | 76.0/363 [00:56<04:35, 1.04it/s]
Loading 0: 21%|██ | 77.0/363 [00:58<05:27, 1.15s/it]
Loading 0: 21%|██ | 77.0/363 [00:58<05:27, 1.15s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:13, 2.08it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.43it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.43it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:00, 1.13it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.30it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:35, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:35, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:02, 1.05it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:02, 1.05it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:49, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:49, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:53, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:53, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:33, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:33, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:16, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.01it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.01it/s]
Loading 0: 34%|███▍ | 124/363 [01:28<02:14, 1.77it/s]
Loading 0: 34%|███▍ | 124/363 [01:28<02:14, 1.77it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.39it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.39it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:34, 1.10it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:34, 1.10it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:08, 1.24it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:08, 1.24it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:46, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:46, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:28, 1.16s/it]
Loading 0: 38%|███▊ | 139/363 [01:39<01:48, 2.06it/s]
Loading 0: 38%|███▊ | 139/363 [01:39<01:48, 2.06it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.81it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.81it/s]
Loading 0: 39%|███▉ | 143/363 [01:43<02:34, 1.42it/s]
Loading 0: 39%|███▉ | 143/363 [01:43<02:34, 1.42it/s]
Loading 0: 40%|███▉ | 144/363 [01:45<03:14, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:45<03:14, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:47<02:51, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:47<02:51, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:51<04:06, 1.15s/it]
Loading 0: 41%|████ | 149/363 [01:51<04:06, 1.15s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.07it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.07it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.82it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.82it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:57, 1.13it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:57, 1.13it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.26it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.26it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.07it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:30, 2.07it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.82it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.82it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.43it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.43it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:41, 1.13it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:41, 1.13it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.26it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.26it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:22, 2.07it/s]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:22, 2.07it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.82it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.82it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:56, 1.43it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:56, 1.43it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:08, 1.27it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:08, 1.27it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.14s/it]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.14s/it]
Loading 0: 58%|█████▊ | 210/363 [02:32<01:17, 1.98it/s]
Loading 0: 58%|█████▊ | 210/363 [02:32<01:17, 1.98it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:20, 1.84it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:20, 1.84it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:42, 1.45it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:42, 1.45it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:07, 1.15it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:07, 1.15it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:52, 1.28it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:52, 1.28it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:15, 1.05it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:15, 1.05it/s]
Loading 0: 61%|██████ | 221/363 [02:44<02:41, 1.14s/it]
Loading 0: 61%|██████ | 221/363 [02:44<02:41, 1.14s/it]
Loading 0: 63%|██████▎ | 228/363 [02:45<01:08, 1.98it/s]
Loading 0: 63%|██████▎ | 228/363 [02:45<01:08, 1.98it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:10, 1.85it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:10, 1.85it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:29, 1.45it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:29, 1.45it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:51, 1.16it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:51, 1.16it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:38, 1.28it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:38, 1.28it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:58, 1.06it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:58, 1.06it/s]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:20, 1.14s/it]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:20, 1.14s/it]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.08it/s]
Loading 0: 68%|██████▊ | 247/363 [02:59<00:55, 2.08it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:10<02:01, 1.14s/it]
Loading 0: 71%|███████ | 257/363 [03:10<02:01, 1.14s/it]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:47, 2.07it/s]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:47, 2.07it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:52, 1.82it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:52, 1.82it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.43it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:34, 2.39s/it]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:34, 2.39s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:25, 2.31s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:25, 2.31s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:19, 2.27s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:19, 2.27s/it]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.18it/s]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.18it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:03, 1.22it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:03, 1.22it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:11, 1.06it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:11, 1.06it/s]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:21, 1.09s/it]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:21, 1.09s/it]
Loading 0: 80%|████████ | 291/363 [03:46<01:06, 1.09it/s]
Loading 0: 80%|████████ | 291/363 [03:46<01:06, 1.09it/s]
Loading 0: 80%|████████ | 292/363 [03:48<01:15, 1.07s/it]
Loading 0: 80%|████████ | 292/363 [03:48<01:15, 1.07s/it]
Loading 0: 81%|████████ | 293/363 [03:50<01:26, 1.23s/it]
Loading 0: 81%|████████ | 293/363 [03:50<01:26, 1.23s/it]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0: 83%|████████▎ | 301/363 [03:51<00:31, 1.99it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.77it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 85%|████████▌ | 310/363 [04:01<00:51, 1.04it/s]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 86%|████████▌ | 311/363 [04:03<00:59, 1.15s/it]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.10it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.12it/s]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.12it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.05it/s]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.10it/s]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.10it/s]
Loading 0: 99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0: 99%|█████████▉| 359/363 [04:33<00:02, 1.89it/s]
Loading 0: 99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0: 99%|█████████▉| 360/363 [04:35<00:02, 1.49it/s]
Loading 0: 99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 99%|█████████▉| 361/363 [04:37<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:37<00:00, 1.31it/s]
chaiml-mistral-24b-2048-86542-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmppwz7f05g' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: quantized model in 283.678s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_1236_merged in 378.915s
chaiml-mistral-24b-2048-86542-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-86542-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-86542-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/flywheel_model.1.safetensors": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmp4u7h47yj' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-86542-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-86542-v2/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: quantized model in 284.906s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_120_max_top_10k_new_rm_618_merged in 361.640s
chaiml-mistral-24b-2048-44577-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-44577-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-44577-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/config.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/special_tokens_map.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer.json": object size matches
chaiml-mistral-24b-2048-44577-v2-mkmlizer: DEBUG "sync /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-44577-v2/nvidia/tokenizer_config.json": object size matches
chaiml-mistral-24b-2048-76177-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-76177-v2/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-76177-v2-mkmlizer completed after 1106.6s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-76177-v2-mkmlizer
Pipeline stage MKMLizer completed in 2378.86s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.55s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-76177-v2
Waiting for inference service chaiml-mistral-24b-2048-76177-v2 to be ready
chaiml-mistral-24b-2048-43874-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-43874-v2/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-43874-v2-mkmlizer completed after 1146.31s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-43874-v2-mkmlizer
Pipeline stage MKMLizer completed in 2411.92s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.53s
run pipeline stage %s
Running pipeline stage MKMLDeployer
chaiml-mistral-24b-2048-96633-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-96633-v3/nvidia/flywheel_model.0.safetensors
Creating inference service chaiml-mistral-24b-2048-43874-v2
Job chaiml-mistral-24b-2048-96633-v3-mkmlizer completed after 1167.74s with status: succeeded
Waiting for inference service chaiml-mistral-24b-2048-43874-v2 to be ready
Stopping job with name chaiml-mistral-24b-2048-96633-v3-mkmlizer
Pipeline stage MKMLizer completed in 2421.03s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 1.51s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-96633-v3
Waiting for inference service chaiml-mistral-24b-2048-96633-v3 to be ready
Inference service chaiml-mistral-24b-2048-76177-v2 ready after 304.8912103176117s
Pipeline stage MKMLDeployer completed in 311.30s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.7759127616882324s
Received healthy response to inference request in 2.7835707664489746s
Received healthy response to inference request in 3.0513617992401123s
Received healthy response to inference request in 2.745479106903076s
Received healthy response to inference request in 2.7560651302337646s
5 requests
0 failed requests
5th percentile: 2.7475963115692137
10th percentile: 2.7497135162353517
20th percentile: 2.753947925567627
30th percentile: 2.7615662574768067
40th percentile: 2.7725685119628904
50th percentile: 2.7835707664489746
60th percentile: 2.89068717956543
70th percentile: 2.9978035926818847
80th percentile: 3.1962719917297364
90th percentile: 3.486092376708984
95th percentile: 3.6310025691986083
99th percentile: 3.7469307231903075
mean time: 3.022477912902832
Pipeline stage StressChecker completed in 44.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Inference service chaiml-mistral-24b-2048-43874-v2 ready after 314.2314672470093s
run_pipeline:run_in_cloud %s
Pipeline stage MKMLDeployer completed in 324.39s
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
Running pipeline stage StressChecker
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 9.55s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Received healthy response to inference request in 3.5605883598327637s
Inference service chaiml-mistral-24b-2048-96633-v3 ready after 314.4733934402466s
run_pipeline:run_in_cloud %s
Pipeline stage MKMLDeployer completed in 321.53s
starting trigger_guanaco_pipeline args=%s
run pipeline stage %s
Received healthy response to inference request in 3.297139883041382s
triggered trigger_guanaco_pipeline args=%s
Running pipeline stage StressChecker
Pipeline stage TriggerMKMLProfilingPipeline completed in 9.84s
Shutdown handler de-registered
Received healthy response to inference request in 3.270233154296875s
chaiml-mistral-24b-2048_76177_v2 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048_76177_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-mistral-24b-2048_76177_v2 status is now torndown due to DeploymentManager action