Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-32760-v8-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-32760-v8-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-32760-v9-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-32760-v9-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-4287-v2-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-4287-v2-mkmlizer to finish
chaiml-mistral-24b-2048-32760-v8-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-32760-v8-mkmlizer: bash: no job control in this shell
run pipeline %s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
run pipeline stage %s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
Starting job with name chaiml-mistral-24b-2048-4287-v3-mkmlizer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
Waiting for job on chaiml-mistral-24b-2048-4287-v3-mkmlizer to finish
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Downloaded to shared memory in 95.007s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged already exists in ChaiML
chaiml-mistral-24b-2048-32760-v9-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmptl787y9k, device:0
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Downloaded to shared memory in 99.469s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged already exists in ChaiML
chaiml-mistral-24b-2048-32760-v8-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpcvx3a3c5, device:0
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Downloaded to shared memory in 91.805s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v2_1250_merged already exists in ChaiML
chaiml-mistral-24b-2048-4287-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpwt1vvftx, device:0
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Downloaded to shared memory in 87.866s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v2_1250_merged already exists in ChaiML
chaiml-mistral-24b-2048-4287-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmphu0w_t4i, device:0
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-4287-v3-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:27, 1.42s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:27, 1.42s/it]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:55, 1.87it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:55, 1.87it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:26, 1.42it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:26, 1.42it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:51, 1.24it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:51, 1.24it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:38, 1.03it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:38, 1.03it/s]
Loading 0: 21%|██ | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0: 21%|██ | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:17, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:17, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.02it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.02it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:14, 1.78it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:14, 1.78it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.40it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.40it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:33, 1.11it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:33, 1.11it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:27, 1.15s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:27, 1.15s/it]
Loading 0: 38%|███▊ | 139/363 [01:39<01:47, 2.08it/s]
Loading 0: 38%|███▊ | 139/363 [01:39<01:47, 2.08it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.82it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.82it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.43it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.43it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:51<04:05, 1.15s/it]
Loading 0: 41%|████ | 149/363 [01:51<04:05, 1.15s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.09it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.09it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.83it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.83it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.27it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.27it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:29, 2.10it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:29, 2.10it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.83it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.83it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:21, 2.09it/s]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:21, 2.09it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.83it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.83it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.43it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.43it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.15s/it]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.15s/it]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:12, 2.09it/s]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:12, 2.09it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:03, 2.10it/s]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:03, 2.10it/s]
Loading 0: 64%|██████▍ | 232/363 [02:47<01:11, 1.83it/s]
Loading 0: 64%|██████▍ | 232/363 [02:47<01:11, 1.83it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:53, 1.14it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:53, 1.14it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 68%|██████▊ | 247/363 [02:58<00:55, 2.09it/s]
Loading 0: 68%|██████▊ | 247/363 [02:58<00:55, 2.09it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.82it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.82it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 70%|███████ | 255/363 [03:06<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:06<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:10<02:01, 1.14s/it]
Loading 0: 71%|███████ | 257/363 [03:10<02:01, 1.14s/it]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.10it/s]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.10it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.83it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.83it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:36, 2.40s/it]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:36, 2.40s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:27, 2.33s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:27, 2.33s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:20, 2.28s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:20, 2.28s/it]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.17it/s]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.17it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.23it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.23it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:09, 1.09it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:09, 1.09it/s]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:20, 1.07s/it]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:20, 1.07s/it]
Loading 0: 80%|████████ | 291/363 [03:45<01:04, 1.12it/s]
Loading 0: 80%|████████ | 291/363 [03:45<01:04, 1.12it/s]
Loading 0: 80%|████████ | 292/363 [03:47<01:14, 1.05s/it]
Loading 0: 80%|████████ | 292/363 [03:47<01:14, 1.05s/it]
Loading 0: 81%|████████ | 293/363 [03:49<01:25, 1.22s/it]
Loading 0: 81%|████████ | 293/363 [03:49<01:25, 1.22s/it]
Loading 0: 83%|████████▎ | 301/363 [03:50<00:30, 2.00it/s]
Loading 0: 83%|████████▎ | 301/363 [03:50<00:30, 2.00it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.78it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.78it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:00<00:51, 1.04it/s]
Loading 0: 85%|████████▌ | 310/363 [04:00<00:51, 1.04it/s]
Loading 0: 86%|████████▌ | 311/363 [04:02<00:59, 1.15s/it]
Loading 0: 86%|████████▌ | 311/363 [04:02<00:59, 1.15s/it]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.08it/s]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.08it/s]
Loading 0: 99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 360/363 [04:34<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 360/363 [04:34<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0: 99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.31it/s]
chaiml-mistral-24b-2048-4287-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:19, 1.06s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:19, 1.06s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:08, 1.37s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:08, 1.37s/it]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:38, 2.21it/s]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:38, 2.21it/s]
Loading 0: 4%|▎ | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0: 4%|▎ | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:56, 1.18it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:56, 1.18it/s]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:12, 1.07s/it]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:12, 1.07s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:14, 1.27it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:14, 1.27it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:07, 1.05it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:07, 1.05it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:09, 1.15s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:09, 1.15s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:31, 2.07it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:31, 2.07it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:37, 1.42it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:37, 1.42it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:03, 1.25it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:03, 1.25it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:54, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:54, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:51, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:51, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:49, 1.25it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:49, 1.25it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0: 21%|██ | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0: 21%|██ | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:49, 1.54it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:49, 1.54it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:35, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:35, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:01, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:01, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:53, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:53, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:34, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:34, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:18, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:18, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<02:01, 1.99it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<02:01, 1.99it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:15, 1.76it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:15, 1.76it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:53, 1.38it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:53, 1.38it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:35, 1.10it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:35, 1.10it/s]
Loading 0: 36%|███▌ | 129/363 [01:35<03:09, 1.23it/s]
Loading 0: 36%|███▌ | 129/363 [01:35<03:09, 1.23it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:48, 1.02it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:48, 1.02it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:30, 1.17s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:30, 1.17s/it]
Loading 0: 38%|███▊ | 139/363 [01:40<01:48, 2.06it/s]
Loading 0: 38%|███▊ | 139/363 [01:40<01:48, 2.06it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.81it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.81it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:35, 1.42it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:35, 1.42it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:14, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:14, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:52, 1.25it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:52, 1.25it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:27, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:27, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:52<04:08, 1.16s/it]
Loading 0: 41%|████ | 149/363 [01:52<04:08, 1.16s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.06it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.06it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:52, 1.81it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:52, 1.81it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:22, 1.42it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:22, 1.42it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<03:00, 1.12it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<03:00, 1.12it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:39, 1.24it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:39, 1.24it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:11, 1.03it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:11, 1.03it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:46, 1.16s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:46, 1.16s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:31, 2.05it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:31, 2.05it/s]
Loading 0: 49%|████▉ | 178/363 [02:09<01:42, 1.81it/s]
Loading 0: 49%|████▉ | 178/363 [02:09<01:42, 1.81it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.42it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.42it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:42, 1.13it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:42, 1.13it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:23, 1.26it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:23, 1.26it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:52, 1.04it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:52, 1.04it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:20<01:22, 2.06it/s]
Loading 0: 53%|█████▎ | 193/363 [02:20<01:22, 2.06it/s]
Loading 0: 54%|█████▍ | 196/363 [02:22<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 196/363 [02:22<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 197/363 [02:24<01:56, 1.42it/s]
Loading 0: 54%|█████▍ | 197/363 [02:24<01:56, 1.42it/s]
Loading 0: 55%|█████▍ | 198/363 [02:26<02:26, 1.13it/s]
Loading 0: 55%|█████▍ | 198/363 [02:26<02:26, 1.13it/s]
Loading 0: 55%|█████▌ | 201/363 [02:28<02:08, 1.26it/s]
Loading 0: 55%|█████▌ | 201/363 [02:28<02:08, 1.26it/s]
Loading 0: 56%|█████▌ | 202/363 [02:30<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 202/363 [02:30<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 203/363 [02:32<03:04, 1.15s/it]
Loading 0: 56%|█████▌ | 203/363 [02:32<03:04, 1.15s/it]
Loading 0: 58%|█████▊ | 211/363 [02:33<01:13, 2.06it/s]
Loading 0: 58%|█████▊ | 211/363 [02:33<01:13, 2.06it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:22, 1.81it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:22, 1.81it/s]
Loading 0: 59%|█████▉ | 215/363 [02:37<01:44, 1.42it/s]
Loading 0: 59%|█████▉ | 215/363 [02:37<01:44, 1.42it/s]
Loading 0: 60%|█████▉ | 216/363 [02:39<02:09, 1.13it/s]
Loading 0: 60%|█████▉ | 216/363 [02:39<02:09, 1.13it/s]
Loading 0: 60%|██████ | 219/363 [02:41<01:54, 1.26it/s]
Loading 0: 60%|██████ | 219/363 [02:41<01:54, 1.26it/s]
Loading 0: 61%|██████ | 220/363 [02:43<02:17, 1.04it/s]
Loading 0: 61%|██████ | 220/363 [02:43<02:17, 1.04it/s]
Loading 0: 61%|██████ | 221/363 [02:45<02:43, 1.15s/it]
Loading 0: 61%|██████ | 221/363 [02:45<02:43, 1.15s/it]
Loading 0: 63%|██████▎ | 229/363 [02:46<01:05, 2.06it/s]
Loading 0: 63%|██████▎ | 229/363 [02:46<01:05, 2.06it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.13it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.13it/s]
Loading 0: 65%|██████▌ | 237/363 [02:54<01:39, 1.26it/s]
Loading 0: 65%|██████▌ | 237/363 [02:54<01:39, 1.26it/s]
Loading 0: 66%|██████▌ | 238/363 [02:56<02:00, 1.04it/s]
Loading 0: 66%|██████▌ | 238/363 [02:56<02:00, 1.04it/s]
Loading 0: 66%|██████▌ | 239/363 [02:58<02:22, 1.15s/it]
Loading 0: 66%|██████▌ | 239/363 [02:58<02:22, 1.15s/it]
Loading 0: 68%|██████▊ | 246/363 [02:59<00:59, 1.97it/s]
Loading 0: 68%|██████▊ | 246/363 [02:59<00:59, 1.97it/s]
Loading 0: 69%|██████▉ | 250/363 [03:02<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 250/363 [03:02<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:17, 1.44it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:17, 1.44it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:36, 1.15it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:36, 1.15it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:09<01:42, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:09<01:42, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:11<02:00, 1.14s/it]
Loading 0: 71%|███████ | 257/363 [03:11<02:00, 1.14s/it]
Loading 0: 73%|███████▎ | 264/363 [03:12<00:50, 1.97it/s]
Loading 0: 73%|███████▎ | 264/363 [03:12<00:50, 1.97it/s]
Loading 0: 74%|███████▍ | 268/363 [03:15<00:51, 1.84it/s]
Loading 0: 74%|███████▍ | 268/363 [03:15<00:51, 1.84it/s]
Loading 0: 74%|███████▍ | 269/363 [03:17<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 269/363 [03:17<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 270/363 [03:19<01:21, 1.15it/s]
Loading 0: 74%|███████▍ | 270/363 [03:19<01:21, 1.15it/s]
Loading 0: 75%|███████▌ | 273/363 [03:34<03:37, 2.42s/it]
Loading 0: 75%|███████▌ | 273/363 [03:34<03:37, 2.42s/it]
Loading 0: 75%|███████▌ | 274/363 [03:36<03:28, 2.34s/it]
Loading 0: 75%|███████▌ | 274/363 [03:36<03:28, 2.34s/it]
Loading 0: 76%|███████▌ | 275/363 [03:38<03:22, 2.30s/it]
Loading 0: 76%|███████▌ | 275/363 [03:38<03:22, 2.30s/it]
Loading 0: 78%|███████▊ | 283/363 [03:39<01:09, 1.16it/s]
Loading 0: 78%|███████▊ | 283/363 [03:39<01:09, 1.16it/s]
Loading 0: 79%|███████▉ | 286/363 [03:41<01:03, 1.21it/s]
Loading 0: 79%|███████▉ | 286/363 [03:41<01:03, 1.21it/s]
Loading 0: 79%|███████▉ | 287/363 [03:43<01:12, 1.05it/s]
Loading 0: 79%|███████▉ | 287/363 [03:43<01:12, 1.05it/s]
Loading 0: 79%|███████▉ | 288/363 [03:45<01:22, 1.10s/it]
Loading 0: 79%|███████▉ | 288/363 [03:45<01:22, 1.10s/it]
Loading 0: 80%|████████ | 291/363 [03:47<01:07, 1.07it/s]
Loading 0: 80%|████████ | 291/363 [03:47<01:07, 1.07it/s]
Loading 0: 80%|████████ | 292/363 [03:49<01:16, 1.08s/it]
Loading 0: 80%|████████ | 292/363 [03:49<01:16, 1.08s/it]
Loading 0: 81%|████████ | 293/363 [03:51<01:27, 1.25s/it]
Loading 0: 81%|████████ | 293/363 [03:51<01:27, 1.25s/it]
Loading 0: 83%|████████▎ | 301/363 [03:52<00:31, 1.95it/s]
Loading 0: 83%|████████▎ | 301/363 [03:52<00:31, 1.95it/s]
Loading 0: 84%|████████▎ | 304/363 [03:55<00:34, 1.73it/s]
Loading 0: 84%|████████▎ | 304/363 [03:55<00:34, 1.73it/s]
Loading 0: 84%|████████▍ | 305/363 [03:57<00:42, 1.37it/s]
Loading 0: 84%|████████▍ | 305/363 [03:57<00:42, 1.37it/s]
Loading 0: 84%|████████▍ | 306/363 [03:59<00:51, 1.10it/s]
Loading 0: 84%|████████▍ | 306/363 [03:59<00:51, 1.10it/s]
Loading 0: 85%|████████▌ | 309/363 [04:01<00:43, 1.23it/s]
Loading 0: 85%|████████▌ | 309/363 [04:01<00:43, 1.23it/s]
Loading 0: 85%|████████▌ | 310/363 [04:03<00:51, 1.02it/s]
Loading 0: 85%|████████▌ | 310/363 [04:03<00:51, 1.02it/s]
Loading 0: 86%|████████▌ | 311/363 [04:05<01:01, 1.17s/it]
Loading 0: 86%|████████▌ | 311/363 [04:05<01:01, 1.17s/it]
Loading 0: 88%|████████▊ | 319/363 [04:06<00:21, 2.05it/s]
Loading 0: 88%|████████▊ | 319/363 [04:06<00:21, 2.05it/s]
Loading 0: 89%|████████▊ | 322/363 [04:08<00:23, 1.77it/s]
Loading 0: 89%|████████▊ | 322/363 [04:08<00:23, 1.77it/s]
Loading 0: 89%|████████▉ | 323/363 [04:10<00:28, 1.39it/s]
Loading 0: 89%|████████▉ | 323/363 [04:10<00:28, 1.39it/s]
Loading 0: 89%|████████▉ | 324/363 [04:12<00:35, 1.11it/s]
Loading 0: 89%|████████▉ | 324/363 [04:12<00:35, 1.11it/s]
Loading 0: 90%|█████████ | 327/363 [04:14<00:29, 1.24it/s]
Loading 0: 90%|█████████ | 327/363 [04:14<00:29, 1.24it/s]
Loading 0: 90%|█████████ | 328/363 [04:16<00:34, 1.02it/s]
Loading 0: 90%|█████████ | 328/363 [04:16<00:34, 1.02it/s]
Loading 0: 91%|█████████ | 329/363 [04:18<00:39, 1.17s/it]
Loading 0: 91%|█████████ | 329/363 [04:18<00:39, 1.17s/it]
Loading 0: 93%|█████████▎| 337/363 [04:19<00:12, 2.05it/s]
Loading 0: 93%|█████████▎| 337/363 [04:19<00:12, 2.05it/s]
Loading 0: 94%|█████████▎| 340/363 [04:22<00:12, 1.77it/s]
Loading 0: 94%|█████████▎| 340/363 [04:22<00:12, 1.77it/s]
Loading 0: 94%|█████████▍| 341/363 [04:24<00:15, 1.40it/s]
Loading 0: 94%|█████████▍| 341/363 [04:24<00:15, 1.40it/s]
Loading 0: 94%|█████████▍| 342/363 [04:26<00:18, 1.11it/s]
Loading 0: 94%|█████████▍| 342/363 [04:26<00:18, 1.11it/s]
Loading 0: 95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0: 95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0: 95%|█████████▌| 346/363 [04:29<00:16, 1.03it/s]
Loading 0: 95%|█████████▌| 346/363 [04:29<00:16, 1.03it/s]
Loading 0: 96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0: 96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0: 98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0: 98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0: 99%|█████████▉| 359/363 [04:35<00:02, 1.86it/s]
Loading 0: 99%|█████████▉| 359/363 [04:35<00:02, 1.86it/s]
Loading 0: 99%|█████████▉| 360/363 [04:37<00:02, 1.47it/s]
Loading 0: 99%|█████████▉| 360/363 [04:37<00:02, 1.47it/s]
Loading 0: 99%|█████████▉| 361/363 [04:39<00:01, 1.17it/s]
Loading 0: 99%|█████████▉| 361/363 [04:39<00:01, 1.17it/s]
Loading 0: 100%|██████████| 363/363 [04:39<00:00, 1.17it/s]
Loading 0: 100%|██████████| 363/363 [04:39<00:00, 1.30it/s]
chaiml-mistral-24b-2048-4287-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpwt1vvftx' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-4287-v2-mkmlizer: quantized model in 289.936s
chaiml-mistral-24b-2048-4287-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmphu0w_t4i' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v2_1250_merged in 381.742s
chaiml-mistral-24b-2048-4287-v3-mkmlizer: quantized model in 283.499s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v2_1250_merged in 371.365s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-4287-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-4287-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v2/nvidia
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-4287-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/config.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/tokenizer.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:22, 1.12s/it]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:22, 1.12s/it]
Loading 0: 8%|▊ | 30.0/363 [00:22<02:59, 1.86it/s]
Loading 0: 8%|▊ | 30.0/363 [00:22<02:59, 1.86it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:14, 1.69it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:14, 1.69it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0: 11%|█ | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0: 11%|█ | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:49, 1.27s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:49, 1.27s/it]
Loading 0: 13%|█▎ | 48.0/363 [00:37<02:57, 1.78it/s]
Loading 0: 13%|█▎ | 48.0/363 [00:37<02:57, 1.78it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:44<05:02, 1.02it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:44<05:02, 1.02it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:27, 1.08s/it]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:27, 1.08s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:51<06:31, 1.29s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:51<06:31, 1.29s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:52<02:48, 1.76it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:52<02:48, 1.76it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:57<03:47, 1.28it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:57<03:47, 1.28it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:59<04:47, 1.01it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:59<04:47, 1.01it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0: 21%|██ | 76.0/363 [01:04<05:10, 1.08s/it]
Loading 0: 21%|██ | 76.0/363 [01:04<05:10, 1.08s/it]
Loading 0: 21%|██ | 77.0/363 [01:06<06:09, 1.29s/it]
Loading 0: 21%|██ | 77.0/363 [01:06<06:09, 1.29s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:07<02:40, 1.74it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:07<02:40, 1.74it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:10<02:49, 1.62it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:10<02:49, 1.62it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:12<03:34, 1.28it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:12<03:34, 1.28it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:14<04:29, 1.01it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:14<04:29, 1.01it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:14, 1.97it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:14, 1.97it/s]
Loading 0: 28%|██▊ | 101/363 [01:18<02:24, 1.81it/s]
Loading 0: 28%|██▊ | 101/363 [01:18<02:24, 1.81it/s]
Loading 0: 28%|██▊ | 102/363 [01:20<03:07, 1.39it/s]
Loading 0: 28%|██▊ | 102/363 [01:20<03:07, 1.39it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:58, 1.09it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:58, 1.09it/s]
Loading 0: 29%|██▉ | 106/363 [01:25<03:43, 1.15it/s]
Loading 0: 29%|██▉ | 106/363 [01:25<03:43, 1.15it/s]
Loading 0: 29%|██▉ | 107/363 [01:27<04:29, 1.05s/it]
Loading 0: 29%|██▉ | 107/363 [01:27<04:29, 1.05s/it]
Loading 0: 30%|██▉ | 108/363 [01:29<05:22, 1.26s/it]
Loading 0: 30%|██▉ | 108/363 [01:29<05:22, 1.26s/it]
Loading 0: 31%|███ | 111/363 [01:32<04:21, 1.04s/it]
Loading 0: 31%|███ | 111/363 [01:32<04:21, 1.04s/it]
Loading 0: 31%|███ | 112/363 [01:34<05:07, 1.23s/it]
Loading 0: 31%|███ | 112/363 [01:34<05:07, 1.23s/it]
Loading 0: 31%|███ | 113/363 [01:36<05:58, 1.43s/it]
Loading 0: 31%|███ | 113/363 [01:36<05:58, 1.43s/it]
Loading 0: 33%|███▎ | 120/363 [01:37<02:23, 1.70it/s]
Loading 0: 33%|███▎ | 120/363 [01:37<02:23, 1.70it/s]
Loading 0: 34%|███▍ | 124/363 [01:40<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 124/363 [01:40<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 125/363 [01:42<03:10, 1.25it/s]
Loading 0: 34%|███▍ | 125/363 [01:42<03:10, 1.25it/s]
Loading 0: 35%|███▍ | 126/363 [01:44<03:57, 1.00s/it]
Loading 0: 35%|███▍ | 126/363 [01:44<03:57, 1.00s/it]
Loading 0: 36%|███▌ | 129/363 [01:47<03:30, 1.11it/s]
Loading 0: 36%|███▌ | 129/363 [01:47<03:30, 1.11it/s]
Loading 0: 36%|███▌ | 130/363 [01:49<04:13, 1.09s/it]
Loading 0: 36%|███▌ | 130/363 [01:49<04:13, 1.09s/it]
Loading 0: 36%|███▌ | 131/363 [01:51<05:01, 1.30s/it]
Loading 0: 36%|███▌ | 131/363 [01:51<05:01, 1.30s/it]
Loading 0: 38%|███▊ | 138/363 [01:52<02:08, 1.76it/s]
Loading 0: 38%|███▊ | 138/363 [01:52<02:08, 1.76it/s]
Loading 0: 39%|███▉ | 142/363 [01:55<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 142/363 [01:55<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 143/363 [01:57<02:52, 1.28it/s]
Loading 0: 39%|███▉ | 143/363 [01:57<02:52, 1.28it/s]
Loading 0: 40%|███▉ | 144/363 [01:59<03:35, 1.02it/s]
Loading 0: 40%|███▉ | 144/363 [01:59<03:35, 1.02it/s]
Loading 0: 40%|████ | 147/363 [02:01<03:12, 1.12it/s]
Loading 0: 40%|████ | 147/363 [02:01<03:12, 1.12it/s]
Loading 0: 41%|████ | 148/363 [02:04<03:52, 1.08s/it]
Loading 0: 41%|████ | 148/363 [02:04<03:52, 1.08s/it]
Loading 0: 41%|████ | 149/363 [02:06<04:36, 1.29s/it]
Loading 0: 41%|████ | 149/363 [02:06<04:36, 1.29s/it]
Loading 0: 43%|████▎ | 156/363 [02:07<01:57, 1.76it/s]
Loading 0: 43%|████▎ | 156/363 [02:07<01:57, 1.76it/s]
Loading 0: 44%|████▍ | 160/363 [02:10<02:04, 1.63it/s]
Loading 0: 44%|████▍ | 160/363 [02:10<02:04, 1.63it/s]
Loading 0: 44%|████▍ | 161/363 [02:12<02:38, 1.28it/s]
Loading 0: 44%|████▍ | 161/363 [02:12<02:38, 1.28it/s]
Loading 0: 45%|████▍ | 162/363 [02:14<03:18, 1.01it/s]
Loading 0: 45%|████▍ | 162/363 [02:14<03:18, 1.01it/s]
Loading 0: 45%|████▌ | 165/363 [02:16<02:56, 1.12it/s]
Loading 0: 45%|████▌ | 165/363 [02:16<02:56, 1.12it/s]
Loading 0: 46%|████▌ | 166/363 [02:19<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 166/363 [02:19<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 167/363 [02:21<04:13, 1.29s/it]
Loading 0: 46%|████▌ | 167/363 [02:21<04:13, 1.29s/it]
Loading 0: 48%|████▊ | 174/363 [02:22<01:47, 1.76it/s]
Loading 0: 48%|████▊ | 174/363 [02:22<01:47, 1.76it/s]
Loading 0: 49%|████▉ | 178/363 [02:25<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 178/363 [02:25<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 179/363 [02:27<02:23, 1.28it/s]
Loading 0: 49%|████▉ | 179/363 [02:27<02:23, 1.28it/s]
Loading 0: 50%|████▉ | 180/363 [02:29<03:00, 1.02it/s]
Loading 0: 50%|████▉ | 180/363 [02:29<03:00, 1.02it/s]
Loading 0: 50%|█████ | 183/363 [02:31<02:40, 1.12it/s]
Loading 0: 50%|█████ | 183/363 [02:31<02:40, 1.12it/s]
Loading 0: 51%|█████ | 184/363 [02:34<03:13, 1.08s/it]
Loading 0: 51%|█████ | 184/363 [02:34<03:13, 1.08s/it]
Loading 0: 51%|█████ | 185/363 [02:36<03:49, 1.29s/it]
Loading 0: 51%|█████ | 185/363 [02:36<03:49, 1.29s/it]
Loading 0: 53%|█████▎ | 192/363 [02:37<01:37, 1.76it/s]
Loading 0: 53%|█████▎ | 192/363 [02:37<01:37, 1.76it/s]
Loading 0: 54%|█████▍ | 196/363 [02:40<01:42, 1.64it/s]
Loading 0: 54%|█████▍ | 196/363 [02:40<01:42, 1.64it/s]
Loading 0: 54%|█████▍ | 197/363 [02:42<02:09, 1.28it/s]
Loading 0: 54%|█████▍ | 197/363 [02:42<02:09, 1.28it/s]
Loading 0: 55%|█████▍ | 198/363 [02:44<02:41, 1.02it/s]
Loading 0: 55%|█████▍ | 198/363 [02:44<02:41, 1.02it/s]
Loading 0: 55%|█████▌ | 201/363 [02:46<02:23, 1.13it/s]
Loading 0: 55%|█████▌ | 201/363 [02:46<02:23, 1.13it/s]
Loading 0: 56%|█████▌ | 202/363 [02:49<02:53, 1.08s/it]
Loading 0: 56%|█████▌ | 202/363 [02:49<02:53, 1.08s/it]
Loading 0: 56%|█████▌ | 203/363 [02:51<03:25, 1.29s/it]
Loading 0: 56%|█████▌ | 203/363 [02:51<03:25, 1.29s/it]
Loading 0: 58%|█████▊ | 210/363 [02:52<01:26, 1.77it/s]
Loading 0: 58%|█████▊ | 210/363 [02:52<01:26, 1.77it/s]
Loading 0: 59%|█████▉ | 214/363 [02:55<01:30, 1.64it/s]
Loading 0: 59%|█████▉ | 214/363 [02:55<01:30, 1.64it/s]
Loading 0: 59%|█████▉ | 215/363 [02:57<01:55, 1.29it/s]
Loading 0: 59%|█████▉ | 215/363 [02:57<01:55, 1.29it/s]
Loading 0: 60%|█████▉ | 216/363 [02:59<02:23, 1.02it/s]
Loading 0: 60%|█████▉ | 216/363 [02:59<02:23, 1.02it/s]
Loading 0: 60%|██████ | 219/363 [03:01<02:07, 1.13it/s]
Loading 0: 60%|██████ | 219/363 [03:01<02:07, 1.13it/s]
Loading 0: 61%|██████ | 220/363 [03:03<02:33, 1.08s/it]
Loading 0: 61%|██████ | 220/363 [03:03<02:33, 1.08s/it]
Loading 0: 61%|██████ | 221/363 [03:06<03:03, 1.29s/it]
Loading 0: 61%|██████ | 221/363 [03:06<03:03, 1.29s/it]
Loading 0: 63%|██████▎ | 228/363 [03:07<01:16, 1.76it/s]
Loading 0: 63%|██████▎ | 228/363 [03:07<01:16, 1.76it/s]
Loading 0: 64%|██████▍ | 232/363 [03:10<01:20, 1.63it/s]
Loading 0: 64%|██████▍ | 232/363 [03:10<01:20, 1.63it/s]
Loading 0: 64%|██████▍ | 233/363 [03:12<01:41, 1.28it/s]
Loading 0: 64%|██████▍ | 233/363 [03:12<01:41, 1.28it/s]
Loading 0: 64%|██████▍ | 234/363 [03:14<02:07, 1.01it/s]
Loading 0: 64%|██████▍ | 234/363 [03:14<02:07, 1.01it/s]
Loading 0: 65%|██████▌ | 237/363 [03:16<01:52, 1.12it/s]
Loading 0: 65%|██████▌ | 237/363 [03:16<01:52, 1.12it/s]
Loading 0: 66%|██████▌ | 238/363 [03:18<02:14, 1.08s/it]
Loading 0: 66%|██████▌ | 238/363 [03:18<02:14, 1.08s/it]
Loading 0: 66%|██████▌ | 239/363 [03:21<02:40, 1.29s/it]
Loading 0: 66%|██████▌ | 239/363 [03:21<02:40, 1.29s/it]
Loading 0: 68%|██████▊ | 246/363 [03:22<01:06, 1.76it/s]
Loading 0: 68%|██████▊ | 246/363 [03:22<01:06, 1.76it/s]
Loading 0: 69%|██████▉ | 250/363 [03:25<01:09, 1.63it/s]
Loading 0: 69%|██████▉ | 250/363 [03:25<01:09, 1.63it/s]
Loading 0: 69%|██████▉ | 251/363 [03:27<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 251/363 [03:27<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 252/363 [03:29<01:49, 1.02it/s]
Loading 0: 69%|██████▉ | 252/363 [03:29<01:49, 1.02it/s]
Loading 0: 70%|███████ | 255/363 [03:31<01:36, 1.12it/s]
Loading 0: 70%|███████ | 255/363 [03:31<01:36, 1.12it/s]
Loading 0: 71%|███████ | 256/363 [03:33<01:55, 1.08s/it]
Loading 0: 71%|███████ | 256/363 [03:33<01:55, 1.08s/it]
Loading 0: 71%|███████ | 257/363 [03:36<02:17, 1.29s/it]
Loading 0: 71%|███████ | 257/363 [03:36<02:17, 1.29s/it]
Loading 0: 73%|███████▎ | 264/363 [03:37<00:56, 1.75it/s]
Loading 0: 73%|███████▎ | 264/363 [03:37<00:56, 1.75it/s]
Loading 0: 74%|███████▍ | 268/363 [03:40<00:58, 1.63it/s]
Loading 0: 74%|███████▍ | 268/363 [03:40<00:58, 1.63it/s]
Loading 0: 74%|███████▍ | 269/363 [03:42<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 269/363 [03:42<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 270/363 [03:44<01:31, 1.01it/s]
Loading 0: 74%|███████▍ | 270/363 [03:44<01:31, 1.01it/s]
Loading 0: 75%|███████▌ | 273/363 [04:01<04:00, 2.67s/it]
Loading 0: 75%|███████▌ | 273/363 [04:01<04:00, 2.67s/it]
Loading 0: 75%|███████▌ | 274/363 [04:03<03:50, 2.59s/it]
Loading 0: 75%|███████▌ | 274/363 [04:03<03:50, 2.59s/it]
Loading 0: 76%|███████▌ | 275/363 [04:05<03:43, 2.54s/it]
Loading 0: 76%|███████▌ | 275/363 [04:05<03:43, 2.54s/it]
Loading 0: 78%|███████▊ | 282/363 [04:06<01:22, 1.02s/it]
Loading 0: 78%|███████▊ | 282/363 [04:06<01:22, 1.02s/it]
Loading 0: 79%|███████▉ | 286/363 [04:09<01:10, 1.10it/s]
Loading 0: 79%|███████▉ | 286/363 [04:09<01:10, 1.10it/s]
Loading 0: 79%|███████▉ | 287/363 [04:11<01:19, 1.05s/it]
Loading 0: 79%|███████▉ | 287/363 [04:11<01:19, 1.05s/it]
Loading 0: 79%|███████▉ | 288/363 [04:14<01:31, 1.22s/it]
Loading 0: 79%|███████▉ | 288/363 [04:14<01:31, 1.22s/it]
Loading 0: 80%|████████ | 291/363 [04:16<01:14, 1.04s/it]
Loading 0: 80%|████████ | 291/363 [04:16<01:14, 1.04s/it]
Loading 0: 80%|████████ | 292/363 [04:18<01:25, 1.21s/it]
Loading 0: 80%|████████ | 292/363 [04:18<01:25, 1.21s/it]
Loading 0: 81%|████████ | 293/363 [04:20<01:37, 1.40s/it]
Loading 0: 81%|████████ | 293/363 [04:20<01:37, 1.40s/it]
Loading 0: 83%|████████▎ | 300/363 [04:21<00:38, 1.66it/s]
Loading 0: 83%|████████▎ | 300/363 [04:21<00:38, 1.66it/s]
Loading 0: 84%|████████▎ | 304/363 [04:24<00:37, 1.58it/s]
Loading 0: 84%|████████▎ | 304/363 [04:24<00:37, 1.58it/s]
Loading 0: 84%|████████▍ | 305/363 [04:26<00:46, 1.25it/s]
Loading 0: 84%|████████▍ | 305/363 [04:26<00:46, 1.25it/s]
Loading 0: 84%|████████▍ | 306/363 [04:29<00:59, 1.05s/it]
Loading 0: 84%|████████▍ | 306/363 [04:29<00:59, 1.05s/it]
Loading 0: 85%|████████▌ | 309/363 [04:31<00:50, 1.07it/s]
Loading 0: 85%|████████▌ | 309/363 [04:31<00:50, 1.07it/s]
Loading 0: 85%|████████▌ | 310/363 [04:33<00:59, 1.12s/it]
Loading 0: 85%|████████▌ | 310/363 [04:33<00:59, 1.12s/it]
Loading 0: 86%|████████▌ | 311/363 [04:36<01:09, 1.33s/it]
Loading 0: 86%|████████▌ | 311/363 [04:36<01:09, 1.33s/it]
Loading 0: 88%|████████▊ | 318/363 [04:37<00:26, 1.72it/s]
Loading 0: 88%|████████▊ | 318/363 [04:37<00:26, 1.72it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.61it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.61it/s]
Loading 0: 89%|████████▉ | 323/363 [04:42<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 323/363 [04:42<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 324/363 [04:44<00:38, 1.01it/s]
Loading 0: 89%|████████▉ | 324/363 [04:44<00:38, 1.01it/s]
Loading 0: 90%|█████████ | 327/363 [04:46<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 327/363 [04:46<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 328/363 [04:48<00:37, 1.08s/it]
Loading 0: 90%|█████████ | 328/363 [04:48<00:37, 1.08s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:44, 1.30s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:44, 1.30s/it]
Loading 0: 93%|█████████▎| 336/363 [04:52<00:15, 1.75it/s]
Loading 0: 93%|█████████▎| 336/363 [04:52<00:15, 1.75it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0: 94%|█████████▍| 341/363 [04:57<00:17, 1.27it/s]
Loading 0: 94%|█████████▍| 341/363 [04:57<00:17, 1.27it/s]
Loading 0: 94%|█████████▍| 342/363 [04:59<00:20, 1.01it/s]
Loading 0: 94%|█████████▍| 342/363 [04:59<00:20, 1.01it/s]
Loading 0: 95%|█████████▌| 345/363 [05:01<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 345/363 [05:01<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 346/363 [05:03<00:18, 1.08s/it]
Loading 0: 95%|█████████▌| 346/363 [05:03<00:18, 1.08s/it]
Loading 0: 96%|█████████▌| 347/363 [05:06<00:20, 1.30s/it]
Loading 0: 96%|█████████▌| 347/363 [05:06<00:20, 1.30s/it]
Loading 0: 98%|█████████▊| 354/363 [05:07<00:05, 1.74it/s]
Loading 0: 98%|█████████▊| 354/363 [05:07<00:05, 1.74it/s]
Loading 0: 98%|█████████▊| 357/363 [05:08<00:03, 1.97it/s]
Loading 0: 98%|█████████▊| 357/363 [05:08<00:03, 1.97it/s]
Loading 0: 99%|█████████▉| 359/363 [05:10<00:02, 1.58it/s]
Loading 0: 99%|█████████▉| 359/363 [05:10<00:02, 1.58it/s]
Loading 0: 99%|█████████▉| 360/363 [05:12<00:02, 1.20it/s]
Loading 0: 99%|█████████▉| 360/363 [05:12<00:02, 1.20it/s]
Loading 0: 99%|█████████▉| 361/363 [05:14<00:02, 1.06s/it]
Loading 0: 99%|█████████▉| 361/363 [05:14<00:02, 1.06s/it]
Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.06s/it]
Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.15it/s]
chaiml-mistral-24b-2048-4287-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v2/nvidia/flywheel_model.0.safetensors
chaiml-mistral-24b-2048-32760-v9-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:09, 1.20s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:09, 1.20s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:14, 1.55s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:14, 1.55s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:24, 1.13s/it]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:24, 1.13s/it]
Loading 0: 8%|▊ | 30.0/363 [00:22<03:00, 1.85it/s]
Loading 0: 8%|▊ | 30.0/363 [00:22<03:00, 1.85it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:09, 1.31it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:09, 1.31it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0: 11%|█ | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0: 11%|█ | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:53, 1.29s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:53, 1.29s/it]
Loading 0: 13%|█▎ | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0: 13%|█▎ | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:11, 1.63it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:11, 1.63it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:02, 1.28it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:02, 1.28it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:12, 1.01s/it]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:12, 1.01s/it]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:41, 1.09it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:41, 1.09it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:36, 1.10s/it]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:36, 1.10s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:40, 1.32s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:40, 1.32s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:52, 1.72it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:52, 1.72it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:56<03:02, 1.60it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:56<03:02, 1.60it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:51, 1.26it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:51, 1.26it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:49, 1.00it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:49, 1.00it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0: 21%|██ | 76.0/363 [01:05<05:15, 1.10s/it]
Loading 0: 21%|██ | 76.0/363 [01:05<05:15, 1.10s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:15, 1.31s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:15, 1.31s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0: 28%|██▊ | 101/363 [01:19<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 101/363 [01:19<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 102/363 [01:21<03:08, 1.39it/s]
Loading 0: 28%|██▊ | 102/363 [01:21<03:08, 1.39it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:59, 1.08it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:59, 1.08it/s]
Loading 0: 29%|██▉ | 106/363 [01:26<03:44, 1.14it/s]
Loading 0: 29%|██▉ | 106/363 [01:26<03:44, 1.14it/s]
Loading 0: 29%|██▉ | 107/363 [01:28<04:32, 1.06s/it]
Loading 0: 29%|██▉ | 107/363 [01:28<04:32, 1.06s/it]
Loading 0: 30%|██▉ | 108/363 [01:30<05:24, 1.27s/it]
Loading 0: 30%|██▉ | 108/363 [01:30<05:24, 1.27s/it]
Loading 0: 31%|███ | 111/363 [01:33<04:23, 1.04s/it]
Loading 0: 31%|███ | 111/363 [01:33<04:23, 1.04s/it]
Loading 0: 31%|███ | 112/363 [01:35<05:09, 1.23s/it]
Loading 0: 31%|███ | 112/363 [01:35<05:09, 1.23s/it]
Loading 0: 31%|███ | 113/363 [01:37<05:59, 1.44s/it]
Loading 0: 31%|███ | 113/363 [01:37<05:59, 1.44s/it]
Loading 0: 33%|███▎ | 120/363 [01:38<02:24, 1.68it/s]
Loading 0: 33%|███▎ | 120/363 [01:38<02:24, 1.68it/s]
Loading 0: 34%|███▍ | 124/363 [01:41<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 124/363 [01:41<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 125/363 [01:43<03:10, 1.25it/s]
Loading 0: 34%|███▍ | 125/363 [01:43<03:10, 1.25it/s]
Loading 0: 35%|███▍ | 126/363 [01:45<03:59, 1.01s/it]
Loading 0: 35%|███▍ | 126/363 [01:45<03:59, 1.01s/it]
Loading 0: 36%|███▌ | 129/363 [01:48<03:32, 1.10it/s]
Loading 0: 36%|███▌ | 129/363 [01:48<03:32, 1.10it/s]
Loading 0: 36%|███▌ | 130/363 [01:50<04:15, 1.10s/it]
Loading 0: 36%|███▌ | 130/363 [01:50<04:15, 1.10s/it]
Loading 0: 36%|███▌ | 131/363 [01:52<05:03, 1.31s/it]
Loading 0: 36%|███▌ | 131/363 [01:52<05:03, 1.31s/it]
Loading 0: 38%|███▊ | 138/363 [01:53<02:08, 1.75it/s]
Loading 0: 38%|███▊ | 138/363 [01:53<02:08, 1.75it/s]
Loading 0: 39%|███▉ | 142/363 [01:56<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 142/363 [01:56<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 143/363 [01:58<02:52, 1.28it/s]
Loading 0: 39%|███▉ | 143/363 [01:58<02:52, 1.28it/s]
Loading 0: 40%|███▉ | 144/363 [02:00<03:36, 1.01it/s]
Loading 0: 40%|███▉ | 144/363 [02:00<03:36, 1.01it/s]
Loading 0: 40%|████ | 147/363 [02:03<03:13, 1.12it/s]
Loading 0: 40%|████ | 147/363 [02:03<03:13, 1.12it/s]
Loading 0: 41%|████ | 148/363 [02:05<03:53, 1.08s/it]
Loading 0: 41%|████ | 148/363 [02:05<03:53, 1.08s/it]
Loading 0: 41%|████ | 149/363 [02:07<04:36, 1.29s/it]
Loading 0: 41%|████ | 149/363 [02:07<04:36, 1.29s/it]
Loading 0: 43%|████▎ | 156/363 [02:08<01:58, 1.74it/s]
Loading 0: 43%|████▎ | 156/363 [02:08<01:58, 1.74it/s]
Loading 0: 44%|████▍ | 160/363 [02:11<02:05, 1.62it/s]
Loading 0: 44%|████▍ | 160/363 [02:11<02:05, 1.62it/s]
Loading 0: 44%|████▍ | 161/363 [02:13<02:39, 1.27it/s]
Loading 0: 44%|████▍ | 161/363 [02:13<02:39, 1.27it/s]
Loading 0: 45%|████▍ | 162/363 [02:15<03:19, 1.01it/s]
Loading 0: 45%|████▍ | 162/363 [02:15<03:19, 1.01it/s]
Loading 0: 45%|████▌ | 165/363 [02:18<02:57, 1.11it/s]
Loading 0: 45%|████▌ | 165/363 [02:18<02:57, 1.11it/s]
Loading 0: 46%|████▌ | 166/363 [02:20<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 166/363 [02:20<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 167/363 [02:22<04:14, 1.30s/it]
Loading 0: 46%|████▌ | 167/363 [02:22<04:14, 1.30s/it]
Loading 0: 48%|████▊ | 174/363 [02:23<01:47, 1.75it/s]
Loading 0: 48%|████▊ | 174/363 [02:23<01:47, 1.75it/s]
Loading 0: 49%|████▉ | 178/363 [02:26<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 178/363 [02:26<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 179/363 [02:28<02:23, 1.28it/s]
Loading 0: 49%|████▉ | 179/363 [02:28<02:23, 1.28it/s]
Loading 0: 50%|████▉ | 180/363 [02:30<03:00, 1.02it/s]
Loading 0: 50%|████▉ | 180/363 [02:30<03:00, 1.02it/s]
Loading 0: 50%|█████ | 183/363 [02:33<02:40, 1.12it/s]
Loading 0: 50%|█████ | 183/363 [02:33<02:40, 1.12it/s]
Loading 0: 51%|█████ | 184/363 [02:35<03:13, 1.08s/it]
Loading 0: 51%|█████ | 184/363 [02:35<03:13, 1.08s/it]
Loading 0: 51%|█████ | 185/363 [02:37<03:49, 1.29s/it]
Loading 0: 51%|█████ | 185/363 [02:37<03:49, 1.29s/it]
Loading 0: 53%|█████▎ | 192/363 [02:38<01:37, 1.76it/s]
Loading 0: 53%|█████▎ | 192/363 [02:38<01:37, 1.76it/s]
Loading 0: 54%|█████▍ | 196/363 [02:41<01:42, 1.63it/s]
Loading 0: 54%|█████▍ | 196/363 [02:41<01:42, 1.63it/s]
Loading 0: 54%|█████▍ | 197/363 [02:43<02:09, 1.28it/s]
Loading 0: 54%|█████▍ | 197/363 [02:43<02:09, 1.28it/s]
Loading 0: 55%|█████▍ | 198/363 [02:46<02:52, 1.05s/it]
Loading 0: 55%|█████▍ | 198/363 [02:46<02:52, 1.05s/it]
Loading 0: 55%|█████▌ | 201/363 [02:48<02:32, 1.06it/s]
Loading 0: 55%|█████▌ | 201/363 [02:48<02:32, 1.06it/s]
Loading 0: 56%|█████▌ | 202/363 [02:50<03:00, 1.12s/it]
Loading 0: 56%|█████▌ | 202/363 [02:50<03:00, 1.12s/it]
Loading 0: 56%|█████▌ | 203/363 [02:53<03:32, 1.33s/it]
Loading 0: 56%|█████▌ | 203/363 [02:53<03:32, 1.33s/it]
Loading 0: 58%|█████▊ | 210/363 [02:54<01:29, 1.71it/s]
Loading 0: 58%|█████▊ | 210/363 [02:54<01:29, 1.71it/s]
Loading 0: 59%|█████▉ | 214/363 [02:57<01:32, 1.60it/s]
Loading 0: 59%|█████▉ | 214/363 [02:57<01:32, 1.60it/s]
Loading 0: 59%|█████▉ | 215/363 [02:59<01:56, 1.27it/s]
Loading 0: 59%|█████▉ | 215/363 [02:59<01:56, 1.27it/s]
Loading 0: 60%|█████▉ | 216/363 [03:01<02:31, 1.03s/it]
Loading 0: 60%|█████▉ | 216/363 [03:01<02:31, 1.03s/it]
Loading 0: 60%|██████ | 219/363 [03:04<02:14, 1.07it/s]
Loading 0: 60%|██████ | 219/363 [03:04<02:14, 1.07it/s]
Loading 0: 61%|██████ | 220/363 [03:06<02:39, 1.11s/it]
Loading 0: 61%|██████ | 220/363 [03:06<02:39, 1.11s/it]
Loading 0: 61%|██████ | 221/363 [03:08<03:07, 1.32s/it]
Loading 0: 61%|██████ | 221/363 [03:08<03:07, 1.32s/it]
Loading 0: 63%|██████▎ | 228/363 [03:09<01:18, 1.72it/s]
Loading 0: 63%|██████▎ | 228/363 [03:09<01:18, 1.72it/s]
Loading 0: 64%|██████▍ | 232/363 [03:12<01:21, 1.61it/s]
Loading 0: 64%|██████▍ | 232/363 [03:12<01:21, 1.61it/s]
Loading 0: 64%|██████▍ | 233/363 [03:14<01:42, 1.27it/s]
Loading 0: 64%|██████▍ | 233/363 [03:14<01:42, 1.27it/s]
Loading 0: 64%|██████▍ | 234/363 [03:16<02:07, 1.01it/s]
Loading 0: 64%|██████▍ | 234/363 [03:16<02:07, 1.01it/s]
Loading 0: 65%|██████▌ | 237/363 [03:18<01:52, 1.12it/s]
Loading 0: 65%|██████▌ | 237/363 [03:18<01:52, 1.12it/s]
Loading 0: 66%|██████▌ | 238/363 [03:21<02:15, 1.08s/it]
Loading 0: 66%|██████▌ | 238/363 [03:21<02:15, 1.08s/it]
Loading 0: 66%|██████▌ | 239/363 [03:23<02:40, 1.29s/it]
Loading 0: 66%|██████▌ | 239/363 [03:23<02:40, 1.29s/it]
Loading 0: 68%|██████▊ | 246/363 [03:24<01:07, 1.74it/s]
Loading 0: 68%|██████▊ | 246/363 [03:24<01:07, 1.74it/s]
Loading 0: 69%|██████▉ | 250/363 [03:27<01:09, 1.62it/s]
Loading 0: 69%|██████▉ | 250/363 [03:27<01:09, 1.62it/s]
Loading 0: 69%|██████▉ | 251/363 [03:29<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 251/363 [03:29<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 252/363 [03:31<01:49, 1.02it/s]
Loading 0: 69%|██████▉ | 252/363 [03:31<01:49, 1.02it/s]
Loading 0: 70%|███████ | 255/363 [03:34<01:36, 1.12it/s]
Loading 0: 70%|███████ | 255/363 [03:34<01:36, 1.12it/s]
Loading 0: 71%|███████ | 256/363 [03:36<01:55, 1.08s/it]
Loading 0: 71%|███████ | 256/363 [03:36<01:55, 1.08s/it]
Loading 0: 71%|███████ | 257/363 [03:38<02:18, 1.31s/it]
Loading 0: 71%|███████ | 257/363 [03:38<02:18, 1.31s/it]
Loading 0: 73%|███████▎ | 264/363 [03:39<00:57, 1.73it/s]
Loading 0: 73%|███████▎ | 264/363 [03:39<00:57, 1.73it/s]
Loading 0: 74%|███████▍ | 268/363 [03:42<00:58, 1.62it/s]
Loading 0: 74%|███████▍ | 268/363 [03:42<00:58, 1.62it/s]
Loading 0: 74%|███████▍ | 269/363 [03:44<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 269/363 [03:44<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 270/363 [03:46<01:31, 1.01it/s]
Loading 0: 74%|███████▍ | 270/363 [03:46<01:31, 1.01it/s]
Loading 0: 75%|███████▌ | 273/363 [04:03<03:54, 2.61s/it]
Loading 0: 75%|███████▌ | 273/363 [04:03<03:54, 2.61s/it]
Loading 0: 75%|███████▌ | 274/363 [04:05<03:46, 2.54s/it]
Loading 0: 75%|███████▌ | 274/363 [04:05<03:46, 2.54s/it]
Loading 0: 76%|███████▌ | 275/363 [04:07<03:39, 2.50s/it]
Loading 0: 76%|███████▌ | 275/363 [04:07<03:39, 2.50s/it]
Loading 0: 78%|███████▊ | 282/363 [04:08<01:21, 1.01s/it]
Loading 0: 78%|███████▊ | 282/363 [04:08<01:21, 1.01s/it]
Loading 0: 79%|███████▉ | 286/363 [04:11<01:08, 1.12it/s]
Loading 0: 79%|███████▉ | 286/363 [04:11<01:08, 1.12it/s]
Loading 0: 79%|███████▉ | 287/363 [04:13<01:16, 1.01s/it]
Loading 0: 79%|███████▉ | 287/363 [04:13<01:16, 1.01s/it]
Loading 0: 79%|███████▉ | 288/363 [04:15<01:28, 1.18s/it]
Loading 0: 79%|███████▉ | 288/363 [04:15<01:28, 1.18s/it]
Loading 0: 80%|████████ | 291/363 [04:17<01:13, 1.02s/it]
Loading 0: 80%|████████ | 291/363 [04:17<01:13, 1.02s/it]
Loading 0: 80%|████████ | 292/363 [04:19<01:23, 1.18s/it]
Loading 0: 80%|████████ | 292/363 [04:19<01:23, 1.18s/it]
Loading 0: 81%|████████ | 293/363 [04:22<01:36, 1.37s/it]
Loading 0: 81%|████████ | 293/363 [04:22<01:36, 1.37s/it]
Loading 0: 83%|████████▎ | 300/363 [04:23<00:37, 1.68it/s]
Loading 0: 83%|████████▎ | 300/363 [04:23<00:37, 1.68it/s]
Loading 0: 84%|████████▎ | 304/363 [04:26<00:36, 1.59it/s]
Loading 0: 84%|████████▎ | 304/363 [04:26<00:36, 1.59it/s]
Loading 0: 84%|████████▍ | 305/363 [04:28<00:45, 1.26it/s]
Loading 0: 84%|████████▍ | 305/363 [04:28<00:45, 1.26it/s]
Loading 0: 84%|████████▍ | 306/363 [04:30<00:56, 1.01it/s]
Loading 0: 84%|████████▍ | 306/363 [04:30<00:56, 1.01it/s]
Loading 0: 85%|████████▌ | 309/363 [04:32<00:48, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [04:32<00:48, 1.12it/s]
Loading 0: 85%|████████▌ | 310/363 [04:34<00:57, 1.08s/it]
Loading 0: 85%|████████▌ | 310/363 [04:34<00:57, 1.08s/it]
Loading 0: 86%|████████▌ | 311/363 [04:37<01:07, 1.29s/it]
Loading 0: 86%|████████▌ | 311/363 [04:37<01:07, 1.29s/it]
Loading 0: 88%|████████▊ | 318/363 [04:38<00:25, 1.76it/s]
Loading 0: 88%|████████▊ | 318/363 [04:38<00:25, 1.76it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.64it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.64it/s]
Loading 0: 89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0: 89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0: 89%|████████▉ | 324/363 [04:45<00:38, 1.02it/s]
Loading 0: 89%|████████▉ | 324/363 [04:45<00:38, 1.02it/s]
Loading 0: 90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0: 90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:43, 1.29s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:43, 1.29s/it]
Loading 0: 93%|█████████▎| 336/363 [04:53<00:15, 1.77it/s]
Loading 0: 93%|█████████▎| 336/363 [04:53<00:15, 1.77it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.64it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.64it/s]
Loading 0: 94%|█████████▍| 341/363 [04:58<00:17, 1.28it/s]
Loading 0: 94%|█████████▍| 341/363 [04:58<00:17, 1.28it/s]
Loading 0: 94%|█████████▍| 342/363 [05:00<00:20, 1.02it/s]
Loading 0: 94%|█████████▍| 342/363 [05:00<00:20, 1.02it/s]
Loading 0: 95%|█████████▌| 345/363 [05:02<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 345/363 [05:02<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 346/363 [05:05<00:19, 1.15s/it]
Loading 0: 95%|█████████▌| 346/363 [05:05<00:19, 1.15s/it]
Loading 0: 96%|█████████▌| 347/363 [05:07<00:21, 1.35s/it]
Loading 0: 96%|█████████▌| 347/363 [05:07<00:21, 1.35s/it]
Loading 0: 98%|█████████▊| 354/363 [05:08<00:05, 1.70it/s]
Loading 0: 98%|█████████▊| 354/363 [05:08<00:05, 1.70it/s]
Loading 0: 99%|█████████▉| 359/363 [05:11<00:02, 1.64it/s]
Loading 0: 99%|█████████▉| 359/363 [05:11<00:02, 1.64it/s]
Loading 0: 99%|█████████▉| 360/363 [05:13<00:02, 1.31it/s]
Loading 0: 99%|█████████▉| 360/363 [05:13<00:02, 1.31it/s]
Loading 0: 99%|█████████▉| 361/363 [05:16<00:01, 1.04it/s]
Loading 0: 99%|█████████▉| 361/363 [05:16<00:01, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.15it/s]
Job chaiml-mistral-24b-2048-4287-v2-mkmlizer completed after 426.69s with status: succeeded
chaiml-mistral-24b-2048-32760-v9-mkmlizer: The tokenizer you are loading from '/tmp/tmptl787y9k' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
Stopping job with name chaiml-mistral-24b-2048-4287-v2-mkmlizer
chaiml-mistral-24b-2048-32760-v9-mkmlizer: quantized model in 323.540s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged in 418.548s
Pipeline stage MKMLizer completed in 429.06s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: creating bucket guanaco-mkml-models
run pipeline stage %s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
Running pipeline stage MKMLTemplater
chaiml-mistral-24b-2048-32760-v9-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia
Pipeline stage MKMLTemplater completed in 0.95s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: The tokenizer you are loading from '/tmp/tmpcvx3a3c5' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/config.json
run pipeline stage %s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: quantized model in 322.356s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/special_tokens_map.json
Running pipeline stage MKMLDeployer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged in 421.825s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/tokenizer_config.json
Creating inference service chaiml-mistral-24b-2048-4287-v2
chaiml-mistral-24b-2048-32760-v8-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/tokenizer.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
Waiting for inference service chaiml-mistral-24b-2048-4287-v2 to be ready
chaiml-mistral-24b-2048-32760-v8-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/config.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/tokenizer.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-4287-v3-mkmlizer completed after 498.69s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-4287-v3-mkmlizer
Pipeline stage MKMLizer completed in 501.28s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.64s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-4287-v3
Waiting for inference service chaiml-mistral-24b-2048-4287-v3 to be ready
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-32760-v9-mkmlizer completed after 534.53s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-32760-v9-mkmlizer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/flywheel_model.0.safetensors
Pipeline stage MKMLizer completed in 537.54s
Job chaiml-mistral-24b-2048-32760-v8-mkmlizer completed after 541.32s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-mistral-24b-2048-32760-v8-mkmlizer
Running pipeline stage MKMLTemplater
Pipeline stage MKMLizer completed in 543.50s
Pipeline stage MKMLTemplater completed in 0.77s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Running pipeline stage MKMLDeployer
Pipeline stage MKMLTemplater completed in 0.77s
Creating inference service chaiml-mistral-24b-2048-32760-v9
run pipeline stage %s
Waiting for inference service chaiml-mistral-24b-2048-32760-v9 to be ready
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-32760-v8
Waiting for inference service chaiml-mistral-24b-2048-32760-v8 to be ready
Inference service chaiml-mistral-24b-2048-4287-v2 ready after 162.21051669120789s
Pipeline stage MKMLDeployer completed in 165.37s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3781158924102783s
Received healthy response to inference request in 2.2264010906219482s
Received healthy response to inference request in 3.831117868423462s
Received healthy response to inference request in 2.567014217376709s
Received healthy response to inference request in 2.2992353439331055s
5 requests
0 failed requests
5th percentile: 2.24096794128418
10th percentile: 2.255534791946411
20th percentile: 2.284668493270874
30th percentile: 2.352791118621826
40th percentile: 2.4599026679992675
50th percentile: 2.567014217376709
60th percentile: 2.891454887390137
70th percentile: 3.2158955574035644
80th percentile: 3.468716287612915
90th percentile: 3.6499170780181887
95th percentile: 3.7405174732208253
99th percentile: 3.8129977893829348
mean time: 2.8603768825531004
Pipeline stage StressChecker completed in 29.71s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.80s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.84s
Shutdown handler de-registered
chaiml-mistral-24b-2048-_4287_v2 status is now deployed due to DeploymentManager action
Inference service chaiml-mistral-24b-2048-4287-v3 ready after 162.18438816070557s
Pipeline stage MKMLDeployer completed in 164.86s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4752235412597656s
Received healthy response to inference request in 2.8382105827331543s
Received healthy response to inference request in 3.724775791168213s
Received healthy response to inference request in 2.4645183086395264s
Received healthy response to inference request in 2.984774351119995s
5 requests
0 failed requests
5th percentile: 2.466659355163574
10th percentile: 2.468800401687622
20th percentile: 2.473082494735718
30th percentile: 2.5478209495544433
40th percentile: 2.693015766143799
50th percentile: 2.8382105827331543
60th percentile: 2.8968360900878904
70th percentile: 2.955461597442627
80th percentile: 3.132774639129639
90th percentile: 3.4287752151489257
95th percentile: 3.576775503158569
99th percentile: 3.695175733566284
mean time: 2.897500514984131
Pipeline stage StressChecker completed in 24.71s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
Inference service chaiml-mistral-24b-2048-32760-v9 ready after 162.27653622627258s
starting trigger_guanaco_pipeline args=%s
Pipeline stage MKMLDeployer completed in 166.21s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
Inference service chaiml-mistral-24b-2048-32760-v8 ready after 163.06869435310364s
Running pipeline stage StressChecker
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.04s
Pipeline stage MKMLDeployer completed in 166.45s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Running pipeline stage StressChecker
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 2.8167877197265625s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.61s
Shutdown handler de-registered
chaiml-mistral-24b-2048-_4287_v3 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 3.73433780670166s
Received healthy response to inference request in 3.21212100982666s
Received healthy response to inference request in 2.756060838699341s
Received healthy response to inference request in 3.2760913372039795s
Received healthy response to inference request in 3.408155679702759s
Received healthy response to inference request in 3.0430538654327393s
Received healthy response to inference request in 3.915710687637329s
Received healthy response to inference request in 2.367068290710449s
5 requests
0 failed requests
5th percentile: 2.457012176513672
10th percentile: 2.5469560623168945
20th percentile: 2.72684383392334
30th percentile: 2.862040948867798
40th percentile: 2.9525474071502686
Received healthy response to inference request in 2.8851029872894287s
50th percentile: 3.0430538654327393
5 requests
60th percentile: 3.1106807231903075
0 failed requests
70th percentile: 3.178307580947876
5th percentile: 2.7818692684173585
80th percentile: 3.224915075302124
10th percentile: 2.807677698135376
90th percentile: 3.2505032062530517
20th percentile: 2.859294557571411
95th percentile: 3.263297271728516
30th percentile: 2.989713525772095
99th percentile: 3.273532524108887
40th percentile: 3.1989346027374266
mean time: 2.943024444580078
50th percentile: 3.408155679702759
Pipeline stage StressChecker completed in 26.15s
60th percentile: 3.5386285305023195
run pipeline stage %s
70th percentile: 3.66910138130188
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
80th percentile: 3.770612382888794
run_pipeline:run_in_cloud %s
90th percentile: 3.8431615352630617
starting trigger_guanaco_pipeline args=%s
95th percentile: 3.8794361114501954
99th percentile: 3.9084557723999023
triggered trigger_guanaco_pipeline args=%s
mean time: 3.3398736000061033
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.35s
Pipeline stage StressChecker completed in 27.29s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.44s
triggered trigger_guanaco_pipeline args=%s
Shutdown handler de-registered
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.90s
chaiml-mistral-24b-2048_32760_v9 status is now deployed due to DeploymentManager action
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 1.27s
Shutdown handler de-registered
chaiml-mistral-24b-2048_32760_v8 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048_32760_v8 status is now inactive due to auto deactivation removed underperforming models
chaiml-mistral-24b-2048_32760_v8 status is now torndown due to DeploymentManager action