chaiml-mistral-24b-2048-32760-v8-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
Shutdown handler not registered because Python interpreter is not running in the main thread
chaiml-mistral-24b-2048-32760-v8-mkmlizer: bash: no job control in this shell
run pipeline %s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
run pipeline stage %s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
Running pipeline stage MKMLizer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
Starting job with name chaiml-mistral-24b-2048-4287-v3-mkmlizer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
Waiting for job on chaiml-mistral-24b-2048-4287-v3-mkmlizer to finish
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-32760-v8-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: bash: no job control in this shell
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: __import__('pkg_resources').declare_namespace(__name__)
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ██████ ██████ █████ ████ ████ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░░██████ ██████ ░░███ ███░ ░░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███░█████░███ ░███ ███ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-32760-v9-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███░░███ ░███ ░███████ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███ ░░░ ░███ ░███░░███ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░███ ░███ ░███ ░░███ ░███ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ █████ █████ █████ ░░████ █████ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ░░░░░ ░░░░░ ░░░░░ ░░░░ ░░░░░ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Version: 0.30.6+torch280 ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Features: FLYWHEEL, CUDA ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Copyright 2023-2025 MK ONE TECHNOLOGIES Inc. ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ https://mk1.ai ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ The license key for the current software has been verified as ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ belonging to: ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Chai Research Corp. ║
chaiml-mistral-24b-2048-4287-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ Expiration: 2028-03-31 23:59:59 ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ║ ║
chaiml-mistral-24b-2048-4287-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Downloaded to shared memory in 95.007s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged already exists in ChaiML
chaiml-mistral-24b-2048-32760-v9-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmptl787y9k, device:0
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Downloaded to shared memory in 99.469s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged already exists in ChaiML
chaiml-mistral-24b-2048-32760-v8-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpcvx3a3c5, device:0
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Downloaded to shared memory in 91.805s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v2_1250_merged already exists in ChaiML
chaiml-mistral-24b-2048-4287-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpwt1vvftx, device:0
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Downloaded to shared memory in 87.866s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_opus_v2_1250_merged already exists in ChaiML
chaiml-mistral-24b-2048-4287-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmphu0w_t4i, device:0
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-4287-v3-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:53, 1.54it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:18, 1.05s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:27, 1.42s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<08:27, 1.42s/it]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:45, 2.12it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0: 4%|▎ | 13.0/363 [00:09<03:52, 1.50it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0: 4%|▍ | 14.0/363 [00:11<05:01, 1.16it/s]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0: 4%|▍ | 15.0/363 [00:13<06:16, 1.08s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.52it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:38, 1.22it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:55, 1.87it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:55, 1.87it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:41, 1.16it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:12, 1.28it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:05, 1.06it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:05, 1.13s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:30, 2.08it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:36<02:50, 1.82it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:36, 1.43it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:32, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:02, 1.26it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:52, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:49, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.07it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:26, 1.42it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:26, 1.42it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:51, 1.24it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:51, 1.24it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:38, 1.03it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:38, 1.03it/s]
Loading 0: 21%|██ | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0: 21%|██ | 77.0/363 [00:59<05:30, 1.16s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:01, 1.13it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.01it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:48, 1.55it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:34, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:19, 1.29it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:00, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:52, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:32, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:17, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:17, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.02it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<02:00, 2.02it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:14, 1.78it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:14, 1.78it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.40it/s]
Loading 0: 34%|███▍ | 125/363 [01:30<02:50, 1.40it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:33, 1.11it/s]
Loading 0: 35%|███▍ | 126/363 [01:32<03:33, 1.11it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 129/363 [01:34<03:07, 1.25it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:45, 1.03it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:27, 1.15s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:27, 1.15s/it]
Loading 0: 38%|███▊ | 139/363 [01:39<01:47, 2.08it/s]
Loading 0: 38%|███▊ | 139/363 [01:39<01:47, 2.08it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.82it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:01, 1.82it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.43it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:34, 1.43it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:13, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:51, 1.26it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:49<03:26, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:51<04:05, 1.15s/it]
Loading 0: 41%|████ | 149/363 [01:51<04:05, 1.15s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.09it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:38, 2.09it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.83it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:51, 1.83it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:21, 1.43it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<02:56, 1.14it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.27it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:36, 1.27it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:08, 1.04it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:44, 1.15s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:29, 2.10it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:29, 2.10it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.83it/s]
Loading 0: 49%|████▉ | 178/363 [02:08<01:41, 1.83it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:08, 1.43it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:40, 1.14it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:22, 1.27it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:51, 1.04it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:21, 2.09it/s]
Loading 0: 53%|█████▎ | 193/363 [02:19<01:21, 2.09it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.83it/s]
Loading 0: 54%|█████▍ | 196/363 [02:21<01:31, 1.83it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.43it/s]
Loading 0: 54%|█████▍ | 197/363 [02:23<01:55, 1.43it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▍ | 198/363 [02:25<02:25, 1.14it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 55%|█████▌ | 201/363 [02:27<02:07, 1.27it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 202/363 [02:29<02:33, 1.05it/s]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.15s/it]
Loading 0: 56%|█████▌ | 203/363 [02:31<03:03, 1.15s/it]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:12, 2.09it/s]
Loading 0: 58%|█████▊ | 211/363 [02:32<01:12, 2.09it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 214/363 [02:34<01:21, 1.83it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 59%|█████▉ | 215/363 [02:36<01:43, 1.43it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|█████▉ | 216/363 [02:38<02:09, 1.14it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 60%|██████ | 219/363 [02:40<01:53, 1.27it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 220/363 [02:42<02:16, 1.05it/s]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 61%|██████ | 221/363 [02:44<02:42, 1.14s/it]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:03, 2.10it/s]
Loading 0: 63%|██████▎ | 229/363 [02:45<01:03, 2.10it/s]
Loading 0: 64%|██████▍ | 232/363 [02:47<01:11, 1.83it/s]
Loading 0: 64%|██████▍ | 232/363 [02:47<01:11, 1.83it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 233/363 [02:49<01:30, 1.44it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:53, 1.14it/s]
Loading 0: 64%|██████▍ | 234/363 [02:51<01:53, 1.14it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 65%|██████▌ | 237/363 [02:53<01:39, 1.27it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 238/363 [02:55<01:59, 1.05it/s]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 66%|██████▌ | 239/363 [02:57<02:21, 1.14s/it]
Loading 0: 68%|██████▊ | 247/363 [02:58<00:55, 2.09it/s]
Loading 0: 68%|██████▊ | 247/363 [02:58<00:55, 2.09it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.82it/s]
Loading 0: 69%|██████▉ | 250/363 [03:01<01:01, 1.82it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:18, 1.43it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:37, 1.14it/s]
Loading 0: 70%|███████ | 255/363 [03:06<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:06<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:08<01:42, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:10<02:01, 1.14s/it]
Loading 0: 71%|███████ | 257/363 [03:10<02:01, 1.14s/it]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.10it/s]
Loading 0: 73%|███████▎ | 265/363 [03:12<00:46, 2.10it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.83it/s]
Loading 0: 74%|███████▍ | 268/363 [03:14<00:51, 1.83it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 269/363 [03:16<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 74%|███████▍ | 270/363 [03:18<01:21, 1.14it/s]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:36, 2.40s/it]
Loading 0: 75%|███████▌ | 273/363 [03:33<03:36, 2.40s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:27, 2.33s/it]
Loading 0: 75%|███████▌ | 274/363 [03:35<03:27, 2.33s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:20, 2.28s/it]
Loading 0: 76%|███████▌ | 275/363 [03:37<03:20, 2.28s/it]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.17it/s]
Loading 0: 78%|███████▊ | 283/363 [03:38<01:08, 1.17it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.23it/s]
Loading 0: 79%|███████▉ | 286/363 [03:40<01:02, 1.23it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:09, 1.09it/s]
Loading 0: 79%|███████▉ | 287/363 [03:42<01:09, 1.09it/s]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:20, 1.07s/it]
Loading 0: 79%|███████▉ | 288/363 [03:44<01:20, 1.07s/it]
Loading 0: 80%|████████ | 291/363 [03:45<01:04, 1.12it/s]
Loading 0: 80%|████████ | 291/363 [03:45<01:04, 1.12it/s]
Loading 0: 80%|████████ | 292/363 [03:47<01:14, 1.05s/it]
Loading 0: 80%|████████ | 292/363 [03:47<01:14, 1.05s/it]
Loading 0: 81%|████████ | 293/363 [03:49<01:25, 1.22s/it]
Loading 0: 81%|████████ | 293/363 [03:49<01:25, 1.22s/it]
Loading 0: 83%|████████▎ | 301/363 [03:50<00:30, 2.00it/s]
Loading 0: 83%|████████▎ | 301/363 [03:50<00:30, 2.00it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.78it/s]
Loading 0: 84%|████████▎ | 304/363 [03:53<00:33, 1.78it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 305/363 [03:55<00:41, 1.40it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 84%|████████▍ | 306/363 [03:57<00:50, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 309/363 [03:59<00:43, 1.25it/s]
Loading 0: 85%|████████▌ | 310/363 [04:00<00:51, 1.04it/s]
Loading 0: 85%|████████▌ | 310/363 [04:00<00:51, 1.04it/s]
Loading 0: 86%|████████▌ | 311/363 [04:02<00:59, 1.15s/it]
Loading 0: 86%|████████▌ | 311/363 [04:02<00:59, 1.15s/it]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0: 88%|████████▊ | 319/363 [04:04<00:20, 2.11it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▊ | 322/363 [04:06<00:22, 1.84it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 323/363 [04:08<00:27, 1.44it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 89%|████████▉ | 324/363 [04:10<00:34, 1.14it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 327/363 [04:12<00:28, 1.27it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 90%|█████████ | 328/363 [04:14<00:33, 1.05it/s]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 91%|█████████ | 329/363 [04:16<00:38, 1.14s/it]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0: 93%|█████████▎| 337/363 [04:17<00:12, 2.11it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▎| 340/363 [04:19<00:12, 1.84it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 341/363 [04:21<00:15, 1.44it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 94%|█████████▍| 342/363 [04:23<00:18, 1.14it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 345/363 [04:25<00:14, 1.27it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 95%|█████████▌| 346/363 [04:27<00:16, 1.04it/s]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 96%|█████████▌| 347/363 [04:29<00:18, 1.14s/it]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.08it/s]
Loading 0: 98%|█████████▊| 355/363 [04:30<00:03, 2.08it/s]
Loading 0: 99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 359/363 [04:32<00:02, 1.88it/s]
Loading 0: 99%|█████████▉| 360/363 [04:34<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 360/363 [04:34<00:02, 1.48it/s]
Loading 0: 99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0: 99%|█████████▉| 361/363 [04:36<00:01, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.18it/s]
Loading 0: 100%|██████████| 363/363 [04:36<00:00, 1.31it/s]
chaiml-mistral-24b-2048-4287-v2-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0: 1%| | 3.00/363 [00:01<03:54, 1.53it/s]
Loading 0: 1%| | 4.00/363 [00:03<06:19, 1.06s/it]
Loading 0: 1%| | 4.00/363 [00:03<06:19, 1.06s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:08, 1.37s/it]
Loading 0: 1%|▏ | 5.00/363 [00:05<08:08, 1.37s/it]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:38, 2.21it/s]
Loading 0: 3%|▎ | 12.0/363 [00:07<02:38, 2.21it/s]
Loading 0: 4%|▎ | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0: 4%|▎ | 13.0/363 [00:08<03:47, 1.54it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:56, 1.18it/s]
Loading 0: 4%|▍ | 14.0/363 [00:10<04:56, 1.18it/s]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:12, 1.07s/it]
Loading 0: 4%|▍ | 15.0/363 [00:12<06:12, 1.07s/it]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0: 6%|▌ | 21.0/363 [00:15<03:44, 1.53it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0: 6%|▌ | 22.0/363 [00:17<04:37, 1.23it/s]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 6%|▋ | 23.0/363 [00:19<05:41, 1.00s/it]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▊ | 31.0/363 [00:20<02:33, 2.17it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 9%|▉ | 34.0/363 [00:22<02:54, 1.88it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 35.0/363 [00:24<03:43, 1.47it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0: 10%|▉ | 36.0/363 [00:26<04:43, 1.16it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:14, 1.27it/s]
Loading 0: 11%|█ | 39.0/363 [00:28<04:14, 1.27it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:07, 1.05it/s]
Loading 0: 11%|█ | 40.0/363 [00:30<05:07, 1.05it/s]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:09, 1.15s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:32<06:09, 1.15s/it]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:31, 2.07it/s]
Loading 0: 13%|█▎ | 49.0/363 [00:33<02:31, 2.07it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:35<02:51, 1.82it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:37, 1.42it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:37<03:37, 1.42it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:39<04:33, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:03, 1.25it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:41<04:03, 1.25it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:54, 1.04it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:43<04:54, 1.04it/s]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:51, 1.15s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:45<05:51, 1.15s/it]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0: 18%|█▊ | 67.0/363 [00:47<02:23, 2.06it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:49<02:41, 1.81it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:51<03:25, 1.42it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:53<04:18, 1.13it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:49, 1.25it/s]
Loading 0: 21%|██ | 75.0/363 [00:55<03:49, 1.25it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0: 21%|██ | 76.0/363 [00:57<04:37, 1.04it/s]
Loading 0: 21%|██ | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0: 21%|██ | 77.0/363 [00:59<05:29, 1.15s/it]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 23%|██▎ | 85.0/363 [01:00<02:14, 2.06it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:02<02:31, 1.81it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:04<03:12, 1.42it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:06<04:02, 1.13it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 27%|██▋ | 98.0/363 [01:07<01:55, 2.29it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 101/363 [01:09<02:10, 2.00it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:49, 1.54it/s]
Loading 0: 28%|██▊ | 102/363 [01:11<02:49, 1.54it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:35, 1.21it/s]
Loading 0: 28%|██▊ | 103/363 [01:13<03:35, 1.21it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 106/363 [01:15<03:20, 1.28it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:01, 1.06it/s]
Loading 0: 29%|██▉ | 107/363 [01:17<04:01, 1.06it/s]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 30%|██▉ | 108/363 [01:19<04:48, 1.13s/it]
Loading 0: 31%|███ | 111/363 [01:21<03:53, 1.08it/s]
Loading 0: 31%|███ | 111/363 [01:21<03:53, 1.08it/s]
Loading 0: 31%|███ | 112/363 [01:23<04:34, 1.09s/it]
Loading 0: 31%|███ | 112/363 [01:23<04:34, 1.09s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:18, 1.27s/it]
Loading 0: 31%|███ | 113/363 [01:25<05:18, 1.27s/it]
Loading 0: 33%|███▎ | 121/363 [01:26<02:01, 1.99it/s]
Loading 0: 33%|███▎ | 121/363 [01:26<02:01, 1.99it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:15, 1.76it/s]
Loading 0: 34%|███▍ | 124/363 [01:29<02:15, 1.76it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:53, 1.38it/s]
Loading 0: 34%|███▍ | 125/363 [01:31<02:53, 1.38it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:35, 1.10it/s]
Loading 0: 35%|███▍ | 126/363 [01:33<03:35, 1.10it/s]
Loading 0: 36%|███▌ | 129/363 [01:35<03:09, 1.23it/s]
Loading 0: 36%|███▌ | 129/363 [01:35<03:09, 1.23it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:48, 1.02it/s]
Loading 0: 36%|███▌ | 130/363 [01:36<03:48, 1.02it/s]
Loading 0: 36%|███▌ | 131/363 [01:38<04:30, 1.17s/it]
Loading 0: 36%|███▌ | 131/363 [01:38<04:30, 1.17s/it]
Loading 0: 38%|███▊ | 139/363 [01:40<01:48, 2.06it/s]
Loading 0: 38%|███▊ | 139/363 [01:40<01:48, 2.06it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.81it/s]
Loading 0: 39%|███▉ | 142/363 [01:42<02:02, 1.81it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:35, 1.42it/s]
Loading 0: 39%|███▉ | 143/363 [01:44<02:35, 1.42it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:14, 1.13it/s]
Loading 0: 40%|███▉ | 144/363 [01:46<03:14, 1.13it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:52, 1.25it/s]
Loading 0: 40%|████ | 147/363 [01:48<02:52, 1.25it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:27, 1.04it/s]
Loading 0: 41%|████ | 148/363 [01:50<03:27, 1.04it/s]
Loading 0: 41%|████ | 149/363 [01:52<04:08, 1.16s/it]
Loading 0: 41%|████ | 149/363 [01:52<04:08, 1.16s/it]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.06it/s]
Loading 0: 43%|████▎ | 157/363 [01:53<01:39, 2.06it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:52, 1.81it/s]
Loading 0: 44%|████▍ | 160/363 [01:55<01:52, 1.81it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:22, 1.42it/s]
Loading 0: 44%|████▍ | 161/363 [01:57<02:22, 1.42it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<03:00, 1.12it/s]
Loading 0: 45%|████▍ | 162/363 [01:59<03:00, 1.12it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:39, 1.24it/s]
Loading 0: 45%|████▌ | 165/363 [02:01<02:39, 1.24it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:11, 1.03it/s]
Loading 0: 46%|████▌ | 166/363 [02:03<03:11, 1.03it/s]
Loading 0: 46%|████▌ | 167/363 [02:05<03:46, 1.16s/it]
Loading 0: 46%|████▌ | 167/363 [02:05<03:46, 1.16s/it]
Loading 0: 48%|████▊ | 175/363 [02:06<01:31, 2.05it/s]
Loading 0: 48%|████▊ | 175/363 [02:06<01:31, 2.05it/s]
Loading 0: 49%|████▉ | 178/363 [02:09<01:42, 1.81it/s]
Loading 0: 49%|████▉ | 178/363 [02:09<01:42, 1.81it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.42it/s]
Loading 0: 49%|████▉ | 179/363 [02:10<02:09, 1.42it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:42, 1.13it/s]
Loading 0: 50%|████▉ | 180/363 [02:12<02:42, 1.13it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:23, 1.26it/s]
Loading 0: 50%|█████ | 183/363 [02:14<02:23, 1.26it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:52, 1.04it/s]
Loading 0: 51%|█████ | 184/363 [02:16<02:52, 1.04it/s]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 51%|█████ | 185/363 [02:18<03:24, 1.15s/it]
Loading 0: 53%|█████▎ | 193/363 [02:20<01:22, 2.06it/s]
Loading 0: 53%|█████▎ | 193/363 [02:20<01:22, 2.06it/s]
Loading 0: 54%|█████▍ | 196/363 [02:22<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 196/363 [02:22<01:32, 1.81it/s]
Loading 0: 54%|█████▍ | 197/363 [02:24<01:56, 1.42it/s]
Loading 0: 54%|█████▍ | 197/363 [02:24<01:56, 1.42it/s]
Loading 0: 55%|█████▍ | 198/363 [02:26<02:26, 1.13it/s]
Loading 0: 55%|█████▍ | 198/363 [02:26<02:26, 1.13it/s]
Loading 0: 55%|█████▌ | 201/363 [02:28<02:08, 1.26it/s]
Loading 0: 55%|█████▌ | 201/363 [02:28<02:08, 1.26it/s]
Loading 0: 56%|█████▌ | 202/363 [02:30<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 202/363 [02:30<02:34, 1.04it/s]
Loading 0: 56%|█████▌ | 203/363 [02:32<03:04, 1.15s/it]
Loading 0: 56%|█████▌ | 203/363 [02:32<03:04, 1.15s/it]
Loading 0: 58%|█████▊ | 211/363 [02:33<01:13, 2.06it/s]
Loading 0: 58%|█████▊ | 211/363 [02:33<01:13, 2.06it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:22, 1.81it/s]
Loading 0: 59%|█████▉ | 214/363 [02:35<01:22, 1.81it/s]
Loading 0: 59%|█████▉ | 215/363 [02:37<01:44, 1.42it/s]
Loading 0: 59%|█████▉ | 215/363 [02:37<01:44, 1.42it/s]
Loading 0: 60%|█████▉ | 216/363 [02:39<02:09, 1.13it/s]
Loading 0: 60%|█████▉ | 216/363 [02:39<02:09, 1.13it/s]
Loading 0: 60%|██████ | 219/363 [02:41<01:54, 1.26it/s]
Loading 0: 60%|██████ | 219/363 [02:41<01:54, 1.26it/s]
Loading 0: 61%|██████ | 220/363 [02:43<02:17, 1.04it/s]
Loading 0: 61%|██████ | 220/363 [02:43<02:17, 1.04it/s]
Loading 0: 61%|██████ | 221/363 [02:45<02:43, 1.15s/it]
Loading 0: 61%|██████ | 221/363 [02:45<02:43, 1.15s/it]
Loading 0: 63%|██████▎ | 229/363 [02:46<01:05, 2.06it/s]
Loading 0: 63%|██████▎ | 229/363 [02:46<01:05, 2.06it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 232/363 [02:48<01:12, 1.81it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 233/363 [02:50<01:31, 1.42it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.13it/s]
Loading 0: 64%|██████▍ | 234/363 [02:52<01:53, 1.13it/s]
Loading 0: 65%|██████▌ | 237/363 [02:54<01:39, 1.26it/s]
Loading 0: 65%|██████▌ | 237/363 [02:54<01:39, 1.26it/s]
Loading 0: 66%|██████▌ | 238/363 [02:56<02:00, 1.04it/s]
Loading 0: 66%|██████▌ | 238/363 [02:56<02:00, 1.04it/s]
Loading 0: 66%|██████▌ | 239/363 [02:58<02:22, 1.15s/it]
Loading 0: 66%|██████▌ | 239/363 [02:58<02:22, 1.15s/it]
Loading 0: 68%|██████▊ | 246/363 [02:59<00:59, 1.97it/s]
Loading 0: 68%|██████▊ | 246/363 [02:59<00:59, 1.97it/s]
Loading 0: 69%|██████▉ | 250/363 [03:02<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 250/363 [03:02<01:01, 1.83it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:17, 1.44it/s]
Loading 0: 69%|██████▉ | 251/363 [03:03<01:17, 1.44it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:36, 1.15it/s]
Loading 0: 69%|██████▉ | 252/363 [03:05<01:36, 1.15it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 70%|███████ | 255/363 [03:07<01:25, 1.27it/s]
Loading 0: 71%|███████ | 256/363 [03:09<01:42, 1.05it/s]
Loading 0: 71%|███████ | 256/363 [03:09<01:42, 1.05it/s]
Loading 0: 71%|███████ | 257/363 [03:11<02:00, 1.14s/it]
Loading 0: 71%|███████ | 257/363 [03:11<02:00, 1.14s/it]
Loading 0: 73%|███████▎ | 264/363 [03:12<00:50, 1.97it/s]
Loading 0: 73%|███████▎ | 264/363 [03:12<00:50, 1.97it/s]
Loading 0: 74%|███████▍ | 268/363 [03:15<00:51, 1.84it/s]
Loading 0: 74%|███████▍ | 268/363 [03:15<00:51, 1.84it/s]
Loading 0: 74%|███████▍ | 269/363 [03:17<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 269/363 [03:17<01:05, 1.44it/s]
Loading 0: 74%|███████▍ | 270/363 [03:19<01:21, 1.15it/s]
Loading 0: 74%|███████▍ | 270/363 [03:19<01:21, 1.15it/s]
Loading 0: 75%|███████▌ | 273/363 [03:34<03:37, 2.42s/it]
Loading 0: 75%|███████▌ | 273/363 [03:34<03:37, 2.42s/it]
Loading 0: 75%|███████▌ | 274/363 [03:36<03:28, 2.34s/it]
Loading 0: 75%|███████▌ | 274/363 [03:36<03:28, 2.34s/it]
Loading 0: 76%|███████▌ | 275/363 [03:38<03:22, 2.30s/it]
Loading 0: 76%|███████▌ | 275/363 [03:38<03:22, 2.30s/it]
Loading 0: 78%|███████▊ | 283/363 [03:39<01:09, 1.16it/s]
Loading 0: 78%|███████▊ | 283/363 [03:39<01:09, 1.16it/s]
Loading 0: 79%|███████▉ | 286/363 [03:41<01:03, 1.21it/s]
Loading 0: 79%|███████▉ | 286/363 [03:41<01:03, 1.21it/s]
Loading 0: 79%|███████▉ | 287/363 [03:43<01:12, 1.05it/s]
Loading 0: 79%|███████▉ | 287/363 [03:43<01:12, 1.05it/s]
Loading 0: 79%|███████▉ | 288/363 [03:45<01:22, 1.10s/it]
Loading 0: 79%|███████▉ | 288/363 [03:45<01:22, 1.10s/it]
Loading 0: 80%|████████ | 291/363 [03:47<01:07, 1.07it/s]
Loading 0: 80%|████████ | 291/363 [03:47<01:07, 1.07it/s]
Loading 0: 80%|████████ | 292/363 [03:49<01:16, 1.08s/it]
Loading 0: 80%|████████ | 292/363 [03:49<01:16, 1.08s/it]
Loading 0: 81%|████████ | 293/363 [03:51<01:27, 1.25s/it]
Loading 0: 81%|████████ | 293/363 [03:51<01:27, 1.25s/it]
Loading 0: 83%|████████▎ | 301/363 [03:52<00:31, 1.95it/s]
Loading 0: 83%|████████▎ | 301/363 [03:52<00:31, 1.95it/s]
Loading 0: 84%|████████▎ | 304/363 [03:55<00:34, 1.73it/s]
Loading 0: 84%|████████▎ | 304/363 [03:55<00:34, 1.73it/s]
Loading 0: 84%|████████▍ | 305/363 [03:57<00:42, 1.37it/s]
Loading 0: 84%|████████▍ | 305/363 [03:57<00:42, 1.37it/s]
Loading 0: 84%|████████▍ | 306/363 [03:59<00:51, 1.10it/s]
Loading 0: 84%|████████▍ | 306/363 [03:59<00:51, 1.10it/s]
Loading 0: 85%|████████▌ | 309/363 [04:01<00:43, 1.23it/s]
Loading 0: 85%|████████▌ | 309/363 [04:01<00:43, 1.23it/s]
Loading 0: 85%|████████▌ | 310/363 [04:03<00:51, 1.02it/s]
Loading 0: 85%|████████▌ | 310/363 [04:03<00:51, 1.02it/s]
Loading 0: 86%|████████▌ | 311/363 [04:05<01:01, 1.17s/it]
Loading 0: 86%|████████▌ | 311/363 [04:05<01:01, 1.17s/it]
Loading 0: 88%|████████▊ | 319/363 [04:06<00:21, 2.05it/s]
Loading 0: 88%|████████▊ | 319/363 [04:06<00:21, 2.05it/s]
Loading 0: 89%|████████▊ | 322/363 [04:08<00:23, 1.77it/s]
Loading 0: 89%|████████▊ | 322/363 [04:08<00:23, 1.77it/s]
Loading 0: 89%|████████▉ | 323/363 [04:10<00:28, 1.39it/s]
Loading 0: 89%|████████▉ | 323/363 [04:10<00:28, 1.39it/s]
Loading 0: 89%|████████▉ | 324/363 [04:12<00:35, 1.11it/s]
Loading 0: 89%|████████▉ | 324/363 [04:12<00:35, 1.11it/s]
Loading 0: 90%|█████████ | 327/363 [04:14<00:29, 1.24it/s]
Loading 0: 90%|█████████ | 327/363 [04:14<00:29, 1.24it/s]
Loading 0: 90%|█████████ | 328/363 [04:16<00:34, 1.02it/s]
Loading 0: 90%|█████████ | 328/363 [04:16<00:34, 1.02it/s]
Loading 0: 91%|█████████ | 329/363 [04:18<00:39, 1.17s/it]
Loading 0: 91%|█████████ | 329/363 [04:18<00:39, 1.17s/it]
Loading 0: 93%|█████████▎| 337/363 [04:19<00:12, 2.05it/s]
Loading 0: 93%|█████████▎| 337/363 [04:19<00:12, 2.05it/s]
Loading 0: 94%|█████████▎| 340/363 [04:22<00:12, 1.77it/s]
Loading 0: 94%|█████████▎| 340/363 [04:22<00:12, 1.77it/s]
Loading 0: 94%|█████████▍| 341/363 [04:24<00:15, 1.40it/s]
Loading 0: 94%|█████████▍| 341/363 [04:24<00:15, 1.40it/s]
Loading 0: 94%|█████████▍| 342/363 [04:26<00:18, 1.11it/s]
Loading 0: 94%|█████████▍| 342/363 [04:26<00:18, 1.11it/s]
Loading 0: 95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0: 95%|█████████▌| 345/363 [04:28<00:14, 1.24it/s]
Loading 0: 95%|█████████▌| 346/363 [04:29<00:16, 1.03it/s]
Loading 0: 95%|█████████▌| 346/363 [04:29<00:16, 1.03it/s]
Loading 0: 96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0: 96%|█████████▌| 347/363 [04:32<00:18, 1.17s/it]
Loading 0: 98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0: 98%|█████████▊| 355/363 [04:33<00:03, 2.07it/s]
Loading 0: 99%|█████████▉| 359/363 [04:35<00:02, 1.86it/s]
Loading 0: 99%|█████████▉| 359/363 [04:35<00:02, 1.86it/s]
Loading 0: 99%|█████████▉| 360/363 [04:37<00:02, 1.47it/s]
Loading 0: 99%|█████████▉| 360/363 [04:37<00:02, 1.47it/s]
Loading 0: 99%|█████████▉| 361/363 [04:39<00:01, 1.17it/s]
Loading 0: 99%|█████████▉| 361/363 [04:39<00:01, 1.17it/s]
Loading 0: 100%|██████████| 363/363 [04:39<00:00, 1.17it/s]
Loading 0: 100%|██████████| 363/363 [04:39<00:00, 1.30it/s]
chaiml-mistral-24b-2048-4287-v2-mkmlizer: The tokenizer you are loading from '/tmp/tmpwt1vvftx' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-4287-v2-mkmlizer: quantized model in 289.936s
chaiml-mistral-24b-2048-4287-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmphu0w_t4i' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v2_1250_merged in 381.742s
chaiml-mistral-24b-2048-4287-v3-mkmlizer: quantized model in 283.499s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v2_1250_merged in 371.365s
chaiml-mistral-24b-2048-4287-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-4287-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-4287-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v2/nvidia
chaiml-mistral-24b-2048-4287-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-4287-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/config.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/tokenizer.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:08, 1.19s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:10, 1.54s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:31, 1.05it/s]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:12, 1.09it/s]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:22, 1.12s/it]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:22, 1.12s/it]
Loading 0: 8%|▊ | 30.0/363 [00:22<02:59, 1.86it/s]
Loading 0: 8%|▊ | 30.0/363 [00:22<02:59, 1.86it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:14, 1.69it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:14, 1.69it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:08, 1.32it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:12, 1.05it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:42, 1.15it/s]
Loading 0: 11%|█ | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0: 11%|█ | 40.0/363 [00:34<05:42, 1.06s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:49, 1.27s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:49, 1.27s/it]
Loading 0: 13%|█▎ | 48.0/363 [00:37<02:57, 1.78it/s]
Loading 0: 13%|█▎ | 48.0/363 [00:37<02:57, 1.78it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:09, 1.64it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:00, 1.29it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:44<05:02, 1.02it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:44<05:02, 1.02it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:31, 1.13it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:27, 1.08s/it]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:27, 1.08s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:51<06:31, 1.29s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:51<06:31, 1.29s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:52<02:48, 1.76it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:52<02:48, 1.76it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:55<02:59, 1.63it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:57<03:47, 1.28it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:57<03:47, 1.28it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:59<04:47, 1.01it/s]
Loading 0: 20%|█▉ | 72.0/363 [00:59<04:47, 1.01it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:16, 1.12it/s]
Loading 0: 21%|██ | 76.0/363 [01:04<05:10, 1.08s/it]
Loading 0: 21%|██ | 76.0/363 [01:04<05:10, 1.08s/it]
Loading 0: 21%|██ | 77.0/363 [01:06<06:09, 1.29s/it]
Loading 0: 21%|██ | 77.0/363 [01:06<06:09, 1.29s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:07<02:40, 1.74it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:07<02:40, 1.74it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:10<02:49, 1.62it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:10<02:49, 1.62it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:12<03:34, 1.28it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:12<03:34, 1.28it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:14<04:29, 1.01it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:14<04:29, 1.01it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:14, 1.97it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:14, 1.97it/s]
Loading 0: 28%|██▊ | 101/363 [01:18<02:24, 1.81it/s]
Loading 0: 28%|██▊ | 101/363 [01:18<02:24, 1.81it/s]
Loading 0: 28%|██▊ | 102/363 [01:20<03:07, 1.39it/s]
Loading 0: 28%|██▊ | 102/363 [01:20<03:07, 1.39it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:58, 1.09it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:58, 1.09it/s]
Loading 0: 29%|██▉ | 106/363 [01:25<03:43, 1.15it/s]
Loading 0: 29%|██▉ | 106/363 [01:25<03:43, 1.15it/s]
Loading 0: 29%|██▉ | 107/363 [01:27<04:29, 1.05s/it]
Loading 0: 29%|██▉ | 107/363 [01:27<04:29, 1.05s/it]
Loading 0: 30%|██▉ | 108/363 [01:29<05:22, 1.26s/it]
Loading 0: 30%|██▉ | 108/363 [01:29<05:22, 1.26s/it]
Loading 0: 31%|███ | 111/363 [01:32<04:21, 1.04s/it]
Loading 0: 31%|███ | 111/363 [01:32<04:21, 1.04s/it]
Loading 0: 31%|███ | 112/363 [01:34<05:07, 1.23s/it]
Loading 0: 31%|███ | 112/363 [01:34<05:07, 1.23s/it]
Loading 0: 31%|███ | 113/363 [01:36<05:58, 1.43s/it]
Loading 0: 31%|███ | 113/363 [01:36<05:58, 1.43s/it]
Loading 0: 33%|███▎ | 120/363 [01:37<02:23, 1.70it/s]
Loading 0: 33%|███▎ | 120/363 [01:37<02:23, 1.70it/s]
Loading 0: 34%|███▍ | 124/363 [01:40<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 124/363 [01:40<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 125/363 [01:42<03:10, 1.25it/s]
Loading 0: 34%|███▍ | 125/363 [01:42<03:10, 1.25it/s]
Loading 0: 35%|███▍ | 126/363 [01:44<03:57, 1.00s/it]
Loading 0: 35%|███▍ | 126/363 [01:44<03:57, 1.00s/it]
Loading 0: 36%|███▌ | 129/363 [01:47<03:30, 1.11it/s]
Loading 0: 36%|███▌ | 129/363 [01:47<03:30, 1.11it/s]
Loading 0: 36%|███▌ | 130/363 [01:49<04:13, 1.09s/it]
Loading 0: 36%|███▌ | 130/363 [01:49<04:13, 1.09s/it]
Loading 0: 36%|███▌ | 131/363 [01:51<05:01, 1.30s/it]
Loading 0: 36%|███▌ | 131/363 [01:51<05:01, 1.30s/it]
Loading 0: 38%|███▊ | 138/363 [01:52<02:08, 1.76it/s]
Loading 0: 38%|███▊ | 138/363 [01:52<02:08, 1.76it/s]
Loading 0: 39%|███▉ | 142/363 [01:55<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 142/363 [01:55<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 143/363 [01:57<02:52, 1.28it/s]
Loading 0: 39%|███▉ | 143/363 [01:57<02:52, 1.28it/s]
Loading 0: 40%|███▉ | 144/363 [01:59<03:35, 1.02it/s]
Loading 0: 40%|███▉ | 144/363 [01:59<03:35, 1.02it/s]
Loading 0: 40%|████ | 147/363 [02:01<03:12, 1.12it/s]
Loading 0: 40%|████ | 147/363 [02:01<03:12, 1.12it/s]
Loading 0: 41%|████ | 148/363 [02:04<03:52, 1.08s/it]
Loading 0: 41%|████ | 148/363 [02:04<03:52, 1.08s/it]
Loading 0: 41%|████ | 149/363 [02:06<04:36, 1.29s/it]
Loading 0: 41%|████ | 149/363 [02:06<04:36, 1.29s/it]
Loading 0: 43%|████▎ | 156/363 [02:07<01:57, 1.76it/s]
Loading 0: 43%|████▎ | 156/363 [02:07<01:57, 1.76it/s]
Loading 0: 44%|████▍ | 160/363 [02:10<02:04, 1.63it/s]
Loading 0: 44%|████▍ | 160/363 [02:10<02:04, 1.63it/s]
Loading 0: 44%|████▍ | 161/363 [02:12<02:38, 1.28it/s]
Loading 0: 44%|████▍ | 161/363 [02:12<02:38, 1.28it/s]
Loading 0: 45%|████▍ | 162/363 [02:14<03:18, 1.01it/s]
Loading 0: 45%|████▍ | 162/363 [02:14<03:18, 1.01it/s]
Loading 0: 45%|████▌ | 165/363 [02:16<02:56, 1.12it/s]
Loading 0: 45%|████▌ | 165/363 [02:16<02:56, 1.12it/s]
Loading 0: 46%|████▌ | 166/363 [02:19<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 166/363 [02:19<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 167/363 [02:21<04:13, 1.29s/it]
Loading 0: 46%|████▌ | 167/363 [02:21<04:13, 1.29s/it]
Loading 0: 48%|████▊ | 174/363 [02:22<01:47, 1.76it/s]
Loading 0: 48%|████▊ | 174/363 [02:22<01:47, 1.76it/s]
Loading 0: 49%|████▉ | 178/363 [02:25<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 178/363 [02:25<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 179/363 [02:27<02:23, 1.28it/s]
Loading 0: 49%|████▉ | 179/363 [02:27<02:23, 1.28it/s]
Loading 0: 50%|████▉ | 180/363 [02:29<03:00, 1.02it/s]
Loading 0: 50%|████▉ | 180/363 [02:29<03:00, 1.02it/s]
Loading 0: 50%|█████ | 183/363 [02:31<02:40, 1.12it/s]
Loading 0: 50%|█████ | 183/363 [02:31<02:40, 1.12it/s]
Loading 0: 51%|█████ | 184/363 [02:34<03:13, 1.08s/it]
Loading 0: 51%|█████ | 184/363 [02:34<03:13, 1.08s/it]
Loading 0: 51%|█████ | 185/363 [02:36<03:49, 1.29s/it]
Loading 0: 51%|█████ | 185/363 [02:36<03:49, 1.29s/it]
Loading 0: 53%|█████▎ | 192/363 [02:37<01:37, 1.76it/s]
Loading 0: 53%|█████▎ | 192/363 [02:37<01:37, 1.76it/s]
Loading 0: 54%|█████▍ | 196/363 [02:40<01:42, 1.64it/s]
Loading 0: 54%|█████▍ | 196/363 [02:40<01:42, 1.64it/s]
Loading 0: 54%|█████▍ | 197/363 [02:42<02:09, 1.28it/s]
Loading 0: 54%|█████▍ | 197/363 [02:42<02:09, 1.28it/s]
Loading 0: 55%|█████▍ | 198/363 [02:44<02:41, 1.02it/s]
Loading 0: 55%|█████▍ | 198/363 [02:44<02:41, 1.02it/s]
Loading 0: 55%|█████▌ | 201/363 [02:46<02:23, 1.13it/s]
Loading 0: 55%|█████▌ | 201/363 [02:46<02:23, 1.13it/s]
Loading 0: 56%|█████▌ | 202/363 [02:49<02:53, 1.08s/it]
Loading 0: 56%|█████▌ | 202/363 [02:49<02:53, 1.08s/it]
Loading 0: 56%|█████▌ | 203/363 [02:51<03:25, 1.29s/it]
Loading 0: 56%|█████▌ | 203/363 [02:51<03:25, 1.29s/it]
Loading 0: 58%|█████▊ | 210/363 [02:52<01:26, 1.77it/s]
Loading 0: 58%|█████▊ | 210/363 [02:52<01:26, 1.77it/s]
Loading 0: 59%|█████▉ | 214/363 [02:55<01:30, 1.64it/s]
Loading 0: 59%|█████▉ | 214/363 [02:55<01:30, 1.64it/s]
Loading 0: 59%|█████▉ | 215/363 [02:57<01:55, 1.29it/s]
Loading 0: 59%|█████▉ | 215/363 [02:57<01:55, 1.29it/s]
Loading 0: 60%|█████▉ | 216/363 [02:59<02:23, 1.02it/s]
Loading 0: 60%|█████▉ | 216/363 [02:59<02:23, 1.02it/s]
Loading 0: 60%|██████ | 219/363 [03:01<02:07, 1.13it/s]
Loading 0: 60%|██████ | 219/363 [03:01<02:07, 1.13it/s]
Loading 0: 61%|██████ | 220/363 [03:03<02:33, 1.08s/it]
Loading 0: 61%|██████ | 220/363 [03:03<02:33, 1.08s/it]
Loading 0: 61%|██████ | 221/363 [03:06<03:03, 1.29s/it]
Loading 0: 61%|██████ | 221/363 [03:06<03:03, 1.29s/it]
Loading 0: 63%|██████▎ | 228/363 [03:07<01:16, 1.76it/s]
Loading 0: 63%|██████▎ | 228/363 [03:07<01:16, 1.76it/s]
Loading 0: 64%|██████▍ | 232/363 [03:10<01:20, 1.63it/s]
Loading 0: 64%|██████▍ | 232/363 [03:10<01:20, 1.63it/s]
Loading 0: 64%|██████▍ | 233/363 [03:12<01:41, 1.28it/s]
Loading 0: 64%|██████▍ | 233/363 [03:12<01:41, 1.28it/s]
Loading 0: 64%|██████▍ | 234/363 [03:14<02:07, 1.01it/s]
Loading 0: 64%|██████▍ | 234/363 [03:14<02:07, 1.01it/s]
Loading 0: 65%|██████▌ | 237/363 [03:16<01:52, 1.12it/s]
Loading 0: 65%|██████▌ | 237/363 [03:16<01:52, 1.12it/s]
Loading 0: 66%|██████▌ | 238/363 [03:18<02:14, 1.08s/it]
Loading 0: 66%|██████▌ | 238/363 [03:18<02:14, 1.08s/it]
Loading 0: 66%|██████▌ | 239/363 [03:21<02:40, 1.29s/it]
Loading 0: 66%|██████▌ | 239/363 [03:21<02:40, 1.29s/it]
Loading 0: 68%|██████▊ | 246/363 [03:22<01:06, 1.76it/s]
Loading 0: 68%|██████▊ | 246/363 [03:22<01:06, 1.76it/s]
Loading 0: 69%|██████▉ | 250/363 [03:25<01:09, 1.63it/s]
Loading 0: 69%|██████▉ | 250/363 [03:25<01:09, 1.63it/s]
Loading 0: 69%|██████▉ | 251/363 [03:27<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 251/363 [03:27<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 252/363 [03:29<01:49, 1.02it/s]
Loading 0: 69%|██████▉ | 252/363 [03:29<01:49, 1.02it/s]
Loading 0: 70%|███████ | 255/363 [03:31<01:36, 1.12it/s]
Loading 0: 70%|███████ | 255/363 [03:31<01:36, 1.12it/s]
Loading 0: 71%|███████ | 256/363 [03:33<01:55, 1.08s/it]
Loading 0: 71%|███████ | 256/363 [03:33<01:55, 1.08s/it]
Loading 0: 71%|███████ | 257/363 [03:36<02:17, 1.29s/it]
Loading 0: 71%|███████ | 257/363 [03:36<02:17, 1.29s/it]
Loading 0: 73%|███████▎ | 264/363 [03:37<00:56, 1.75it/s]
Loading 0: 73%|███████▎ | 264/363 [03:37<00:56, 1.75it/s]
Loading 0: 74%|███████▍ | 268/363 [03:40<00:58, 1.63it/s]
Loading 0: 74%|███████▍ | 268/363 [03:40<00:58, 1.63it/s]
Loading 0: 74%|███████▍ | 269/363 [03:42<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 269/363 [03:42<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 270/363 [03:44<01:31, 1.01it/s]
Loading 0: 74%|███████▍ | 270/363 [03:44<01:31, 1.01it/s]
Loading 0: 75%|███████▌ | 273/363 [04:01<04:00, 2.67s/it]
Loading 0: 75%|███████▌ | 273/363 [04:01<04:00, 2.67s/it]
Loading 0: 75%|███████▌ | 274/363 [04:03<03:50, 2.59s/it]
Loading 0: 75%|███████▌ | 274/363 [04:03<03:50, 2.59s/it]
Loading 0: 76%|███████▌ | 275/363 [04:05<03:43, 2.54s/it]
Loading 0: 76%|███████▌ | 275/363 [04:05<03:43, 2.54s/it]
Loading 0: 78%|███████▊ | 282/363 [04:06<01:22, 1.02s/it]
Loading 0: 78%|███████▊ | 282/363 [04:06<01:22, 1.02s/it]
Loading 0: 79%|███████▉ | 286/363 [04:09<01:10, 1.10it/s]
Loading 0: 79%|███████▉ | 286/363 [04:09<01:10, 1.10it/s]
Loading 0: 79%|███████▉ | 287/363 [04:11<01:19, 1.05s/it]
Loading 0: 79%|███████▉ | 287/363 [04:11<01:19, 1.05s/it]
Loading 0: 79%|███████▉ | 288/363 [04:14<01:31, 1.22s/it]
Loading 0: 79%|███████▉ | 288/363 [04:14<01:31, 1.22s/it]
Loading 0: 80%|████████ | 291/363 [04:16<01:14, 1.04s/it]
Loading 0: 80%|████████ | 291/363 [04:16<01:14, 1.04s/it]
Loading 0: 80%|████████ | 292/363 [04:18<01:25, 1.21s/it]
Loading 0: 80%|████████ | 292/363 [04:18<01:25, 1.21s/it]
Loading 0: 81%|████████ | 293/363 [04:20<01:37, 1.40s/it]
Loading 0: 81%|████████ | 293/363 [04:20<01:37, 1.40s/it]
Loading 0: 83%|████████▎ | 300/363 [04:21<00:38, 1.66it/s]
Loading 0: 83%|████████▎ | 300/363 [04:21<00:38, 1.66it/s]
Loading 0: 84%|████████▎ | 304/363 [04:24<00:37, 1.58it/s]
Loading 0: 84%|████████▎ | 304/363 [04:24<00:37, 1.58it/s]
Loading 0: 84%|████████▍ | 305/363 [04:26<00:46, 1.25it/s]
Loading 0: 84%|████████▍ | 305/363 [04:26<00:46, 1.25it/s]
Loading 0: 84%|████████▍ | 306/363 [04:29<00:59, 1.05s/it]
Loading 0: 84%|████████▍ | 306/363 [04:29<00:59, 1.05s/it]
Loading 0: 85%|████████▌ | 309/363 [04:31<00:50, 1.07it/s]
Loading 0: 85%|████████▌ | 309/363 [04:31<00:50, 1.07it/s]
Loading 0: 85%|████████▌ | 310/363 [04:33<00:59, 1.12s/it]
Loading 0: 85%|████████▌ | 310/363 [04:33<00:59, 1.12s/it]
Loading 0: 86%|████████▌ | 311/363 [04:36<01:09, 1.33s/it]
Loading 0: 86%|████████▌ | 311/363 [04:36<01:09, 1.33s/it]
Loading 0: 88%|████████▊ | 318/363 [04:37<00:26, 1.72it/s]
Loading 0: 88%|████████▊ | 318/363 [04:37<00:26, 1.72it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.61it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.61it/s]
Loading 0: 89%|████████▉ | 323/363 [04:42<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 323/363 [04:42<00:31, 1.27it/s]
Loading 0: 89%|████████▉ | 324/363 [04:44<00:38, 1.01it/s]
Loading 0: 89%|████████▉ | 324/363 [04:44<00:38, 1.01it/s]
Loading 0: 90%|█████████ | 327/363 [04:46<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 327/363 [04:46<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 328/363 [04:48<00:37, 1.08s/it]
Loading 0: 90%|█████████ | 328/363 [04:48<00:37, 1.08s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:44, 1.30s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:44, 1.30s/it]
Loading 0: 93%|█████████▎| 336/363 [04:52<00:15, 1.75it/s]
Loading 0: 93%|█████████▎| 336/363 [04:52<00:15, 1.75it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.62it/s]
Loading 0: 94%|█████████▍| 341/363 [04:57<00:17, 1.27it/s]
Loading 0: 94%|█████████▍| 341/363 [04:57<00:17, 1.27it/s]
Loading 0: 94%|█████████▍| 342/363 [04:59<00:20, 1.01it/s]
Loading 0: 94%|█████████▍| 342/363 [04:59<00:20, 1.01it/s]
Loading 0: 95%|█████████▌| 345/363 [05:01<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 345/363 [05:01<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 346/363 [05:03<00:18, 1.08s/it]
Loading 0: 95%|█████████▌| 346/363 [05:03<00:18, 1.08s/it]
Loading 0: 96%|█████████▌| 347/363 [05:06<00:20, 1.30s/it]
Loading 0: 96%|█████████▌| 347/363 [05:06<00:20, 1.30s/it]
Loading 0: 98%|█████████▊| 354/363 [05:07<00:05, 1.74it/s]
Loading 0: 98%|█████████▊| 354/363 [05:07<00:05, 1.74it/s]
Loading 0: 98%|█████████▊| 357/363 [05:08<00:03, 1.97it/s]
Loading 0: 98%|█████████▊| 357/363 [05:08<00:03, 1.97it/s]
Loading 0: 99%|█████████▉| 359/363 [05:10<00:02, 1.58it/s]
Loading 0: 99%|█████████▉| 359/363 [05:10<00:02, 1.58it/s]
Loading 0: 99%|█████████▉| 360/363 [05:12<00:02, 1.20it/s]
Loading 0: 99%|█████████▉| 360/363 [05:12<00:02, 1.20it/s]
Loading 0: 99%|█████████▉| 361/363 [05:14<00:02, 1.06s/it]
Loading 0: 99%|█████████▉| 361/363 [05:14<00:02, 1.06s/it]
Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.06s/it]
Loading 0: 100%|██████████| 363/363 [05:15<00:00, 1.15it/s]
chaiml-mistral-24b-2048-4287-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v2/nvidia/flywheel_model.0.safetensors
chaiml-mistral-24b-2048-32760-v9-mkmlizer:
Loading 0: 0%| | 0.00/363 [00:00<?, ?it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 3.00/363 [00:02<04:24, 1.36it/s]
Loading 0: 1%| | 4.00/363 [00:04<07:09, 1.20s/it]
Loading 0: 1%| | 4.00/363 [00:04<07:09, 1.20s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:14, 1.55s/it]
Loading 0: 1%|▏ | 5.00/363 [00:06<09:14, 1.55s/it]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 3%|▎ | 11.0/363 [00:07<03:14, 1.81it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▎ | 13.0/363 [00:10<04:13, 1.38it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0: 4%|▍ | 14.0/363 [00:12<05:30, 1.06it/s]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 4%|▍ | 15.0/363 [00:14<06:54, 1.19s/it]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 21.0/363 [00:17<04:11, 1.36it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0: 6%|▌ | 22.0/363 [00:19<05:13, 1.09it/s]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:24, 1.13s/it]
Loading 0: 6%|▋ | 23.0/363 [00:21<06:24, 1.13s/it]
Loading 0: 8%|▊ | 30.0/363 [00:22<03:00, 1.85it/s]
Loading 0: 8%|▊ | 30.0/363 [00:22<03:00, 1.85it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0: 9%|▉ | 34.0/363 [00:25<03:15, 1.68it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:09, 1.31it/s]
Loading 0: 10%|▉ | 35.0/363 [00:27<04:09, 1.31it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0: 10%|▉ | 36.0/363 [00:30<05:15, 1.04it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0: 11%|█ | 39.0/363 [00:32<04:44, 1.14it/s]
Loading 0: 11%|█ | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0: 11%|█ | 40.0/363 [00:34<05:47, 1.08s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:53, 1.29s/it]
Loading 0: 11%|█▏ | 41.0/363 [00:36<06:53, 1.29s/it]
Loading 0: 13%|█▎ | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0: 13%|█▎ | 48.0/363 [00:38<03:00, 1.75it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:11, 1.63it/s]
Loading 0: 14%|█▍ | 52.0/363 [00:40<03:11, 1.63it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:02, 1.28it/s]
Loading 0: 15%|█▍ | 53.0/363 [00:42<04:02, 1.28it/s]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:12, 1.01s/it]
Loading 0: 15%|█▍ | 54.0/363 [00:45<05:12, 1.01s/it]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:41, 1.09it/s]
Loading 0: 16%|█▌ | 57.0/363 [00:47<04:41, 1.09it/s]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:36, 1.10s/it]
Loading 0: 16%|█▌ | 58.0/363 [00:49<05:36, 1.10s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:40, 1.32s/it]
Loading 0: 16%|█▋ | 59.0/363 [00:52<06:40, 1.32s/it]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:52, 1.72it/s]
Loading 0: 18%|█▊ | 66.0/363 [00:53<02:52, 1.72it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:56<03:02, 1.60it/s]
Loading 0: 19%|█▉ | 70.0/363 [00:56<03:02, 1.60it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:51, 1.26it/s]
Loading 0: 20%|█▉ | 71.0/363 [00:58<03:51, 1.26it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:49, 1.00it/s]
Loading 0: 20%|█▉ | 72.0/363 [01:00<04:49, 1.00it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0: 21%|██ | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0: 21%|██ | 76.0/363 [01:05<05:15, 1.10s/it]
Loading 0: 21%|██ | 76.0/363 [01:05<05:15, 1.10s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:15, 1.31s/it]
Loading 0: 21%|██ | 77.0/363 [01:07<06:15, 1.31s/it]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0: 23%|██▎ | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0: 24%|██▍ | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0: 25%|██▍ | 89.0/363 [01:13<03:36, 1.27it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0: 25%|██▍ | 90.0/363 [01:15<04:31, 1.01it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0: 27%|██▋ | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0: 28%|██▊ | 101/363 [01:19<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 101/363 [01:19<02:26, 1.79it/s]
Loading 0: 28%|██▊ | 102/363 [01:21<03:08, 1.39it/s]
Loading 0: 28%|██▊ | 102/363 [01:21<03:08, 1.39it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:59, 1.08it/s]
Loading 0: 28%|██▊ | 103/363 [01:23<03:59, 1.08it/s]
Loading 0: 29%|██▉ | 106/363 [01:26<03:44, 1.14it/s]
Loading 0: 29%|██▉ | 106/363 [01:26<03:44, 1.14it/s]
Loading 0: 29%|██▉ | 107/363 [01:28<04:32, 1.06s/it]
Loading 0: 29%|██▉ | 107/363 [01:28<04:32, 1.06s/it]
Loading 0: 30%|██▉ | 108/363 [01:30<05:24, 1.27s/it]
Loading 0: 30%|██▉ | 108/363 [01:30<05:24, 1.27s/it]
Loading 0: 31%|███ | 111/363 [01:33<04:23, 1.04s/it]
Loading 0: 31%|███ | 111/363 [01:33<04:23, 1.04s/it]
Loading 0: 31%|███ | 112/363 [01:35<05:09, 1.23s/it]
Loading 0: 31%|███ | 112/363 [01:35<05:09, 1.23s/it]
Loading 0: 31%|███ | 113/363 [01:37<05:59, 1.44s/it]
Loading 0: 31%|███ | 113/363 [01:37<05:59, 1.44s/it]
Loading 0: 33%|███▎ | 120/363 [01:38<02:24, 1.68it/s]
Loading 0: 33%|███▎ | 120/363 [01:38<02:24, 1.68it/s]
Loading 0: 34%|███▍ | 124/363 [01:41<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 124/363 [01:41<02:30, 1.59it/s]
Loading 0: 34%|███▍ | 125/363 [01:43<03:10, 1.25it/s]
Loading 0: 34%|███▍ | 125/363 [01:43<03:10, 1.25it/s]
Loading 0: 35%|███▍ | 126/363 [01:45<03:59, 1.01s/it]
Loading 0: 35%|███▍ | 126/363 [01:45<03:59, 1.01s/it]
Loading 0: 36%|███▌ | 129/363 [01:48<03:32, 1.10it/s]
Loading 0: 36%|███▌ | 129/363 [01:48<03:32, 1.10it/s]
Loading 0: 36%|███▌ | 130/363 [01:50<04:15, 1.10s/it]
Loading 0: 36%|███▌ | 130/363 [01:50<04:15, 1.10s/it]
Loading 0: 36%|███▌ | 131/363 [01:52<05:03, 1.31s/it]
Loading 0: 36%|███▌ | 131/363 [01:52<05:03, 1.31s/it]
Loading 0: 38%|███▊ | 138/363 [01:53<02:08, 1.75it/s]
Loading 0: 38%|███▊ | 138/363 [01:53<02:08, 1.75it/s]
Loading 0: 39%|███▉ | 142/363 [01:56<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 142/363 [01:56<02:15, 1.63it/s]
Loading 0: 39%|███▉ | 143/363 [01:58<02:52, 1.28it/s]
Loading 0: 39%|███▉ | 143/363 [01:58<02:52, 1.28it/s]
Loading 0: 40%|███▉ | 144/363 [02:00<03:36, 1.01it/s]
Loading 0: 40%|███▉ | 144/363 [02:00<03:36, 1.01it/s]
Loading 0: 40%|████ | 147/363 [02:03<03:13, 1.12it/s]
Loading 0: 40%|████ | 147/363 [02:03<03:13, 1.12it/s]
Loading 0: 41%|████ | 148/363 [02:05<03:53, 1.08s/it]
Loading 0: 41%|████ | 148/363 [02:05<03:53, 1.08s/it]
Loading 0: 41%|████ | 149/363 [02:07<04:36, 1.29s/it]
Loading 0: 41%|████ | 149/363 [02:07<04:36, 1.29s/it]
Loading 0: 43%|████▎ | 156/363 [02:08<01:58, 1.74it/s]
Loading 0: 43%|████▎ | 156/363 [02:08<01:58, 1.74it/s]
Loading 0: 44%|████▍ | 160/363 [02:11<02:05, 1.62it/s]
Loading 0: 44%|████▍ | 160/363 [02:11<02:05, 1.62it/s]
Loading 0: 44%|████▍ | 161/363 [02:13<02:39, 1.27it/s]
Loading 0: 44%|████▍ | 161/363 [02:13<02:39, 1.27it/s]
Loading 0: 45%|████▍ | 162/363 [02:15<03:19, 1.01it/s]
Loading 0: 45%|████▍ | 162/363 [02:15<03:19, 1.01it/s]
Loading 0: 45%|████▌ | 165/363 [02:18<02:57, 1.11it/s]
Loading 0: 45%|████▌ | 165/363 [02:18<02:57, 1.11it/s]
Loading 0: 46%|████▌ | 166/363 [02:20<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 166/363 [02:20<03:33, 1.08s/it]
Loading 0: 46%|████▌ | 167/363 [02:22<04:14, 1.30s/it]
Loading 0: 46%|████▌ | 167/363 [02:22<04:14, 1.30s/it]
Loading 0: 48%|████▊ | 174/363 [02:23<01:47, 1.75it/s]
Loading 0: 48%|████▊ | 174/363 [02:23<01:47, 1.75it/s]
Loading 0: 49%|████▉ | 178/363 [02:26<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 178/363 [02:26<01:53, 1.63it/s]
Loading 0: 49%|████▉ | 179/363 [02:28<02:23, 1.28it/s]
Loading 0: 49%|████▉ | 179/363 [02:28<02:23, 1.28it/s]
Loading 0: 50%|████▉ | 180/363 [02:30<03:00, 1.02it/s]
Loading 0: 50%|████▉ | 180/363 [02:30<03:00, 1.02it/s]
Loading 0: 50%|█████ | 183/363 [02:33<02:40, 1.12it/s]
Loading 0: 50%|█████ | 183/363 [02:33<02:40, 1.12it/s]
Loading 0: 51%|█████ | 184/363 [02:35<03:13, 1.08s/it]
Loading 0: 51%|█████ | 184/363 [02:35<03:13, 1.08s/it]
Loading 0: 51%|█████ | 185/363 [02:37<03:49, 1.29s/it]
Loading 0: 51%|█████ | 185/363 [02:37<03:49, 1.29s/it]
Loading 0: 53%|█████▎ | 192/363 [02:38<01:37, 1.76it/s]
Loading 0: 53%|█████▎ | 192/363 [02:38<01:37, 1.76it/s]
Loading 0: 54%|█████▍ | 196/363 [02:41<01:42, 1.63it/s]
Loading 0: 54%|█████▍ | 196/363 [02:41<01:42, 1.63it/s]
Loading 0: 54%|█████▍ | 197/363 [02:43<02:09, 1.28it/s]
Loading 0: 54%|█████▍ | 197/363 [02:43<02:09, 1.28it/s]
Loading 0: 55%|█████▍ | 198/363 [02:46<02:52, 1.05s/it]
Loading 0: 55%|█████▍ | 198/363 [02:46<02:52, 1.05s/it]
Loading 0: 55%|█████▌ | 201/363 [02:48<02:32, 1.06it/s]
Loading 0: 55%|█████▌ | 201/363 [02:48<02:32, 1.06it/s]
Loading 0: 56%|█████▌ | 202/363 [02:50<03:00, 1.12s/it]
Loading 0: 56%|█████▌ | 202/363 [02:50<03:00, 1.12s/it]
Loading 0: 56%|█████▌ | 203/363 [02:53<03:32, 1.33s/it]
Loading 0: 56%|█████▌ | 203/363 [02:53<03:32, 1.33s/it]
Loading 0: 58%|█████▊ | 210/363 [02:54<01:29, 1.71it/s]
Loading 0: 58%|█████▊ | 210/363 [02:54<01:29, 1.71it/s]
Loading 0: 59%|█████▉ | 214/363 [02:57<01:32, 1.60it/s]
Loading 0: 59%|█████▉ | 214/363 [02:57<01:32, 1.60it/s]
Loading 0: 59%|█████▉ | 215/363 [02:59<01:56, 1.27it/s]
Loading 0: 59%|█████▉ | 215/363 [02:59<01:56, 1.27it/s]
Loading 0: 60%|█████▉ | 216/363 [03:01<02:31, 1.03s/it]
Loading 0: 60%|█████▉ | 216/363 [03:01<02:31, 1.03s/it]
Loading 0: 60%|██████ | 219/363 [03:04<02:14, 1.07it/s]
Loading 0: 60%|██████ | 219/363 [03:04<02:14, 1.07it/s]
Loading 0: 61%|██████ | 220/363 [03:06<02:39, 1.11s/it]
Loading 0: 61%|██████ | 220/363 [03:06<02:39, 1.11s/it]
Loading 0: 61%|██████ | 221/363 [03:08<03:07, 1.32s/it]
Loading 0: 61%|██████ | 221/363 [03:08<03:07, 1.32s/it]
Loading 0: 63%|██████▎ | 228/363 [03:09<01:18, 1.72it/s]
Loading 0: 63%|██████▎ | 228/363 [03:09<01:18, 1.72it/s]
Loading 0: 64%|██████▍ | 232/363 [03:12<01:21, 1.61it/s]
Loading 0: 64%|██████▍ | 232/363 [03:12<01:21, 1.61it/s]
Loading 0: 64%|██████▍ | 233/363 [03:14<01:42, 1.27it/s]
Loading 0: 64%|██████▍ | 233/363 [03:14<01:42, 1.27it/s]
Loading 0: 64%|██████▍ | 234/363 [03:16<02:07, 1.01it/s]
Loading 0: 64%|██████▍ | 234/363 [03:16<02:07, 1.01it/s]
Loading 0: 65%|██████▌ | 237/363 [03:18<01:52, 1.12it/s]
Loading 0: 65%|██████▌ | 237/363 [03:18<01:52, 1.12it/s]
Loading 0: 66%|██████▌ | 238/363 [03:21<02:15, 1.08s/it]
Loading 0: 66%|██████▌ | 238/363 [03:21<02:15, 1.08s/it]
Loading 0: 66%|██████▌ | 239/363 [03:23<02:40, 1.29s/it]
Loading 0: 66%|██████▌ | 239/363 [03:23<02:40, 1.29s/it]
Loading 0: 68%|██████▊ | 246/363 [03:24<01:07, 1.74it/s]
Loading 0: 68%|██████▊ | 246/363 [03:24<01:07, 1.74it/s]
Loading 0: 69%|██████▉ | 250/363 [03:27<01:09, 1.62it/s]
Loading 0: 69%|██████▉ | 250/363 [03:27<01:09, 1.62it/s]
Loading 0: 69%|██████▉ | 251/363 [03:29<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 251/363 [03:29<01:27, 1.28it/s]
Loading 0: 69%|██████▉ | 252/363 [03:31<01:49, 1.02it/s]
Loading 0: 69%|██████▉ | 252/363 [03:31<01:49, 1.02it/s]
Loading 0: 70%|███████ | 255/363 [03:34<01:36, 1.12it/s]
Loading 0: 70%|███████ | 255/363 [03:34<01:36, 1.12it/s]
Loading 0: 71%|███████ | 256/363 [03:36<01:55, 1.08s/it]
Loading 0: 71%|███████ | 256/363 [03:36<01:55, 1.08s/it]
Loading 0: 71%|███████ | 257/363 [03:38<02:18, 1.31s/it]
Loading 0: 71%|███████ | 257/363 [03:38<02:18, 1.31s/it]
Loading 0: 73%|███████▎ | 264/363 [03:39<00:57, 1.73it/s]
Loading 0: 73%|███████▎ | 264/363 [03:39<00:57, 1.73it/s]
Loading 0: 74%|███████▍ | 268/363 [03:42<00:58, 1.62it/s]
Loading 0: 74%|███████▍ | 268/363 [03:42<00:58, 1.62it/s]
Loading 0: 74%|███████▍ | 269/363 [03:44<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 269/363 [03:44<01:13, 1.27it/s]
Loading 0: 74%|███████▍ | 270/363 [03:46<01:31, 1.01it/s]
Loading 0: 74%|███████▍ | 270/363 [03:46<01:31, 1.01it/s]
Loading 0: 75%|███████▌ | 273/363 [04:03<03:54, 2.61s/it]
Loading 0: 75%|███████▌ | 273/363 [04:03<03:54, 2.61s/it]
Loading 0: 75%|███████▌ | 274/363 [04:05<03:46, 2.54s/it]
Loading 0: 75%|███████▌ | 274/363 [04:05<03:46, 2.54s/it]
Loading 0: 76%|███████▌ | 275/363 [04:07<03:39, 2.50s/it]
Loading 0: 76%|███████▌ | 275/363 [04:07<03:39, 2.50s/it]
Loading 0: 78%|███████▊ | 282/363 [04:08<01:21, 1.01s/it]
Loading 0: 78%|███████▊ | 282/363 [04:08<01:21, 1.01s/it]
Loading 0: 79%|███████▉ | 286/363 [04:11<01:08, 1.12it/s]
Loading 0: 79%|███████▉ | 286/363 [04:11<01:08, 1.12it/s]
Loading 0: 79%|███████▉ | 287/363 [04:13<01:16, 1.01s/it]
Loading 0: 79%|███████▉ | 287/363 [04:13<01:16, 1.01s/it]
Loading 0: 79%|███████▉ | 288/363 [04:15<01:28, 1.18s/it]
Loading 0: 79%|███████▉ | 288/363 [04:15<01:28, 1.18s/it]
Loading 0: 80%|████████ | 291/363 [04:17<01:13, 1.02s/it]
Loading 0: 80%|████████ | 291/363 [04:17<01:13, 1.02s/it]
Loading 0: 80%|████████ | 292/363 [04:19<01:23, 1.18s/it]
Loading 0: 80%|████████ | 292/363 [04:19<01:23, 1.18s/it]
Loading 0: 81%|████████ | 293/363 [04:22<01:36, 1.37s/it]
Loading 0: 81%|████████ | 293/363 [04:22<01:36, 1.37s/it]
Loading 0: 83%|████████▎ | 300/363 [04:23<00:37, 1.68it/s]
Loading 0: 83%|████████▎ | 300/363 [04:23<00:37, 1.68it/s]
Loading 0: 84%|████████▎ | 304/363 [04:26<00:36, 1.59it/s]
Loading 0: 84%|████████▎ | 304/363 [04:26<00:36, 1.59it/s]
Loading 0: 84%|████████▍ | 305/363 [04:28<00:45, 1.26it/s]
Loading 0: 84%|████████▍ | 305/363 [04:28<00:45, 1.26it/s]
Loading 0: 84%|████████▍ | 306/363 [04:30<00:56, 1.01it/s]
Loading 0: 84%|████████▍ | 306/363 [04:30<00:56, 1.01it/s]
Loading 0: 85%|████████▌ | 309/363 [04:32<00:48, 1.12it/s]
Loading 0: 85%|████████▌ | 309/363 [04:32<00:48, 1.12it/s]
Loading 0: 85%|████████▌ | 310/363 [04:34<00:57, 1.08s/it]
Loading 0: 85%|████████▌ | 310/363 [04:34<00:57, 1.08s/it]
Loading 0: 86%|████████▌ | 311/363 [04:37<01:07, 1.29s/it]
Loading 0: 86%|████████▌ | 311/363 [04:37<01:07, 1.29s/it]
Loading 0: 88%|████████▊ | 318/363 [04:38<00:25, 1.76it/s]
Loading 0: 88%|████████▊ | 318/363 [04:38<00:25, 1.76it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.64it/s]
Loading 0: 89%|████████▊ | 322/363 [04:40<00:25, 1.64it/s]
Loading 0: 89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0: 89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0: 89%|████████▉ | 324/363 [04:45<00:38, 1.02it/s]
Loading 0: 89%|████████▉ | 324/363 [04:45<00:38, 1.02it/s]
Loading 0: 90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0: 90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0: 90%|█████████ | 328/363 [04:49<00:37, 1.08s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:43, 1.29s/it]
Loading 0: 91%|█████████ | 329/363 [04:51<00:43, 1.29s/it]
Loading 0: 93%|█████████▎| 336/363 [04:53<00:15, 1.77it/s]
Loading 0: 93%|█████████▎| 336/363 [04:53<00:15, 1.77it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.64it/s]
Loading 0: 94%|█████████▎| 340/363 [04:55<00:14, 1.64it/s]
Loading 0: 94%|█████████▍| 341/363 [04:58<00:17, 1.28it/s]
Loading 0: 94%|█████████▍| 341/363 [04:58<00:17, 1.28it/s]
Loading 0: 94%|█████████▍| 342/363 [05:00<00:20, 1.02it/s]
Loading 0: 94%|█████████▍| 342/363 [05:00<00:20, 1.02it/s]
Loading 0: 95%|█████████▌| 345/363 [05:02<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 345/363 [05:02<00:16, 1.12it/s]
Loading 0: 95%|█████████▌| 346/363 [05:05<00:19, 1.15s/it]
Loading 0: 95%|█████████▌| 346/363 [05:05<00:19, 1.15s/it]
Loading 0: 96%|█████████▌| 347/363 [05:07<00:21, 1.35s/it]
Loading 0: 96%|█████████▌| 347/363 [05:07<00:21, 1.35s/it]
Loading 0: 98%|█████████▊| 354/363 [05:08<00:05, 1.70it/s]
Loading 0: 98%|█████████▊| 354/363 [05:08<00:05, 1.70it/s]
Loading 0: 99%|█████████▉| 359/363 [05:11<00:02, 1.64it/s]
Loading 0: 99%|█████████▉| 359/363 [05:11<00:02, 1.64it/s]
Loading 0: 99%|█████████▉| 360/363 [05:13<00:02, 1.31it/s]
Loading 0: 99%|█████████▉| 360/363 [05:13<00:02, 1.31it/s]
Loading 0: 99%|█████████▉| 361/363 [05:16<00:01, 1.04it/s]
Loading 0: 99%|█████████▉| 361/363 [05:16<00:01, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.04it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.15it/s]
Job chaiml-mistral-24b-2048-4287-v2-mkmlizer completed after 426.69s with status: succeeded
chaiml-mistral-24b-2048-32760-v9-mkmlizer: The tokenizer you are loading from '/tmp/tmptl787y9k' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
Stopping job with name chaiml-mistral-24b-2048-4287-v2-mkmlizer
chaiml-mistral-24b-2048-32760-v9-mkmlizer: quantized model in 323.540s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged in 418.548s
Pipeline stage MKMLizer completed in 429.06s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: creating bucket guanaco-mkml-models
run pipeline stage %s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
Running pipeline stage MKMLTemplater
chaiml-mistral-24b-2048-32760-v9-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia
Pipeline stage MKMLTemplater completed in 0.95s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: The tokenizer you are loading from '/tmp/tmpcvx3a3c5' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/config.json
run pipeline stage %s
chaiml-mistral-24b-2048-32760-v8-mkmlizer: quantized model in 322.356s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/special_tokens_map.json
Running pipeline stage MKMLDeployer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Processed model ChaiML/mistral_24b_2048_opus_v1_1250_20k_merged in 421.825s
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/tokenizer_config.json
Creating inference service chaiml-mistral-24b-2048-4287-v2
chaiml-mistral-24b-2048-32760-v8-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/tokenizer.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
Waiting for inference service chaiml-mistral-24b-2048-4287-v2 to be ready
chaiml-mistral-24b-2048-32760-v8-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/config.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/special_tokens_map.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/tokenizer.json
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/flywheel_model.1.safetensors
chaiml-mistral-24b-2048-4287-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-4287-v3/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-4287-v3-mkmlizer completed after 498.69s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-4287-v3-mkmlizer
Pipeline stage MKMLizer completed in 501.28s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.64s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-4287-v3
Waiting for inference service chaiml-mistral-24b-2048-4287-v3 to be ready
chaiml-mistral-24b-2048-32760-v9-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v9/nvidia/flywheel_model.0.safetensors
Job chaiml-mistral-24b-2048-32760-v9-mkmlizer completed after 534.53s with status: succeeded
Stopping job with name chaiml-mistral-24b-2048-32760-v9-mkmlizer
chaiml-mistral-24b-2048-32760-v8-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-32760-v8/nvidia/flywheel_model.0.safetensors
Pipeline stage MKMLizer completed in 537.54s
Job chaiml-mistral-24b-2048-32760-v8-mkmlizer completed after 541.32s with status: succeeded
run pipeline stage %s
Stopping job with name chaiml-mistral-24b-2048-32760-v8-mkmlizer
Running pipeline stage MKMLTemplater
Pipeline stage MKMLizer completed in 543.50s
Pipeline stage MKMLTemplater completed in 0.77s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Running pipeline stage MKMLDeployer
Pipeline stage MKMLTemplater completed in 0.77s
Creating inference service chaiml-mistral-24b-2048-32760-v9
run pipeline stage %s
Waiting for inference service chaiml-mistral-24b-2048-32760-v9 to be ready
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-32760-v8
Waiting for inference service chaiml-mistral-24b-2048-32760-v8 to be ready
Inference service chaiml-mistral-24b-2048-4287-v2 ready after 162.21051669120789s
Pipeline stage MKMLDeployer completed in 165.37s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3781158924102783s
Received healthy response to inference request in 2.2264010906219482s
Received healthy response to inference request in 3.831117868423462s
Received healthy response to inference request in 2.567014217376709s
Received healthy response to inference request in 2.2992353439331055s
5 requests
0 failed requests
5th percentile: 2.24096794128418
10th percentile: 2.255534791946411
20th percentile: 2.284668493270874
30th percentile: 2.352791118621826
40th percentile: 2.4599026679992675
50th percentile: 2.567014217376709
60th percentile: 2.891454887390137
70th percentile: 3.2158955574035644
80th percentile: 3.468716287612915
90th percentile: 3.6499170780181887
95th percentile: 3.7405174732208253
99th percentile: 3.8129977893829348
mean time: 2.8603768825531004
Pipeline stage StressChecker completed in 29.71s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.80s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.84s
Shutdown handler de-registered
chaiml-mistral-24b-2048-_4287_v2 status is now deployed due to DeploymentManager action
Inference service chaiml-mistral-24b-2048-4287-v3 ready after 162.18438816070557s
Pipeline stage MKMLDeployer completed in 164.86s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4752235412597656s
Received healthy response to inference request in 2.8382105827331543s
Received healthy response to inference request in 3.724775791168213s
Received healthy response to inference request in 2.4645183086395264s
Received healthy response to inference request in 2.984774351119995s
5 requests
0 failed requests
5th percentile: 2.466659355163574
10th percentile: 2.468800401687622
20th percentile: 2.473082494735718
30th percentile: 2.5478209495544433
40th percentile: 2.693015766143799
50th percentile: 2.8382105827331543
60th percentile: 2.8968360900878904
70th percentile: 2.955461597442627
80th percentile: 3.132774639129639
90th percentile: 3.4287752151489257
95th percentile: 3.576775503158569
99th percentile: 3.695175733566284
mean time: 2.897500514984131
Pipeline stage StressChecker completed in 24.71s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
Inference service chaiml-mistral-24b-2048-32760-v9 ready after 162.27653622627258s
starting trigger_guanaco_pipeline args=%s
Pipeline stage MKMLDeployer completed in 166.21s
run pipeline stage %s
triggered trigger_guanaco_pipeline args=%s
Inference service chaiml-mistral-24b-2048-32760-v8 ready after 163.06869435310364s
Running pipeline stage StressChecker
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.04s
Pipeline stage MKMLDeployer completed in 166.45s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Running pipeline stage StressChecker
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 2.8167877197265625s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.61s
Shutdown handler de-registered
chaiml-mistral-24b-2048-_4287_v3 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048-_4287_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-mistral-24b-2048-_4287_v3 status is now torndown due to DeploymentManager action