developer_uid: chai_backend_admin
submission_id: qwen-qwen3-235b-a22b-i_47730_v23
model_name: qwen-qwen3-235b-a22b-i_47730_v23
model_group: Qwen/Qwen3-235B-A22B-Ins
status: torndown
timestamp: 2026-02-06T01:42:42+00:00
num_battles: 3750
num_wins: 1907
celo_rating: 1321.31
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: Qwen/Qwen3-235B-A22B-Instruct-2507
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 4
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: qwen-qwen3-235b-a22b-i_47730_v23
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: Qwen/Qwen3-235B-A22B-Instruct-2507
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-05
win_ratio: 0.5085333333333333
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|im_end|>', '<|user|>', '</think>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name qwen-qwen3-235b-a22b-i-47730-v23-uploader
Waiting for job on qwen-qwen3-235b-a22b-i-47730-v23-uploader to finish
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Using quantization_mode: w4a16
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Checking if ChaiML/Qwen3-235B-A22B-Instruct-2507-W4A16 already exists in ChaiML
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Downloading snapshot of Qwen/Qwen3-235B-A22B-Instruct-2507...
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Fetching 129 files: 0%| | 0/129 [00:00<?, ?it/s] Fetching 129 files: 1%| | 1/129 [00:00<00:38, 3.36it/s] Fetching 129 files: 6%|▌ | 8/129 [00:11<03:04, 1.53s/it] Fetching 129 files: 12%|█▏ | 16/129 [00:16<01:48, 1.04it/s] Fetching 129 files: 13%|█▎ | 17/129 [00:19<02:12, 1.18s/it] Fetching 129 files: 14%|█▍ | 18/129 [00:20<02:07, 1.15s/it] Fetching 129 files: 15%|█▍ | 19/129 [00:21<02:05, 1.14s/it] Fetching 129 files: 18%|█▊ | 23/129 [00:22<01:10, 1.50it/s] Fetching 129 files: 19%|█▊ | 24/129 [00:23<01:20, 1.30it/s] Fetching 129 files: 19%|█▉ | 25/129 [00:26<01:54, 1.11s/it] Fetching 129 files: 20%|██ | 26/129 [00:29<02:33, 1.49s/it] Fetching 129 files: 21%|██ | 27/129 [00:30<02:29, 1.46s/it] Fetching 129 files: 22%|██▏ | 28/129 [00:31<02:09, 1.28s/it] Fetching 129 files: 22%|██▏ | 29/129 [00:32<01:57, 1.18s/it] Fetching 129 files: 25%|██▍ | 32/129 [00:33<01:08, 1.41it/s] Fetching 129 files: 26%|██▌ | 33/129 [00:35<01:30, 1.06it/s] Fetching 129 files: 26%|██▋ | 34/129 [00:36<01:43, 1.09s/it] Fetching 129 files: 27%|██▋ | 35/129 [00:38<02:07, 1.36s/it] Fetching 129 files: 28%|██▊ | 36/129 [00:40<02:11, 1.42s/it] Fetching 129 files: 29%|██▊ | 37/129 [00:41<02:09, 1.40s/it] Fetching 129 files: 29%|██▉ | 38/129 [00:43<02:02, 1.34s/it] Fetching 129 files: 32%|███▏ | 41/129 [00:44<01:19, 1.11it/s] Fetching 129 files: 33%|███▎ | 42/129 [00:47<01:52, 1.29s/it] Fetching 129 files: 33%|███▎ | 43/129 [00:50<02:28, 1.72s/it] Fetching 129 files: 34%|███▍ | 44/129 [00:50<01:54, 1.35s/it] Fetching 129 files: 35%|███▍ | 45/129 [00:52<02:10, 1.55s/it] Fetching 129 files: 36%|███▌ | 46/129 [00:53<01:46, 1.29s/it] Fetching 129 files: 36%|███▋ | 47/129 [00:55<02:04, 1.51s/it] Fetching 129 files: 39%|███▉ | 50/129 [00:57<01:19, 1.01s/it] Fetching 129 files: 40%|███▉ | 51/129 [00:59<01:40, 1.29s/it] Fetching 129 files: 41%|████ | 53/129 [01:01<01:31, 1.20s/it] Fetching 129 files: 42%|████▏ | 54/129 [01:02<01:25, 1.14s/it] Fetching 129 files: 43%|████▎ | 55/129 [01:04<01:36, 1.30s/it] Fetching 129 files: 44%|████▍ | 57/129 [01:05<01:05, 1.10it/s] Fetching 129 files: 45%|████▍ | 58/129 [01:06<01:12, 1.02s/it] Fetching 129 files: 46%|████▌ | 59/129 [01:08<01:32, 1.32s/it] Fetching 129 files: 47%|████▋ | 60/129 [01:09<01:15, 1.09s/it] Fetching 129 files: 47%|████▋ | 61/129 [01:10<01:18, 1.15s/it] Fetching 129 files: 48%|████▊ | 62/129 [01:11<01:17, 1.16s/it] Fetching 129 files: 49%|████▉ | 63/129 [01:13<01:26, 1.31s/it] Fetching 129 files: 50%|████▉ | 64/129 [01:14<01:11, 1.11s/it] Fetching 129 files: 50%|█████ | 65/129 [01:14<01:02, 1.02it/s] Fetching 129 files: 51%|█████ | 66/129 [01:16<01:09, 1.10s/it] Fetching 129 files: 52%|█████▏ | 67/129 [01:18<01:34, 1.53s/it] Fetching 129 files: 53%|█████▎ | 68/129 [01:19<01:15, 1.24s/it] Fetching 129 files: 53%|█████▎ | 69/129 [01:21<01:31, 1.52s/it] Fetching 129 files: 54%|█████▍ | 70/129 [01:22<01:26, 1.46s/it] Fetching 129 files: 55%|█████▌ | 71/129 [01:24<01:29, 1.55s/it] Fetching 129 files: 56%|█████▌ | 72/129 [01:25<01:18, 1.38s/it] Fetching 129 files: 57%|█████▋ | 73/129 [01:26<01:03, 1.14s/it] Fetching 129 files: 57%|█████▋ | 74/129 [01:27<01:13, 1.34s/it] Fetching 129 files: 58%|█████▊ | 75/129 [01:29<01:20, 1.49s/it] Fetching 129 files: 59%|█████▉ | 76/129 [01:30<01:02, 1.18s/it] Fetching 129 files: 60%|█████▉ | 77/129 [01:31<01:03, 1.23s/it] Fetching 129 files: 60%|██████ | 78/129 [01:33<01:14, 1.47s/it] Fetching 129 files: 61%|██████ | 79/129 [01:34<01:03, 1.26s/it] Fetching 129 files: 62%|██████▏ | 80/129 [01:34<00:49, 1.01s/it] Fetching 129 files: 63%|██████▎ | 81/129 [01:35<00:47, 1.01it/s] Fetching 129 files: 64%|██████▎ | 82/129 [01:37<00:54, 1.16s/it] Fetching 129 files: 64%|██████▍ | 83/129 [01:40<01:16, 1.67s/it] Fetching 129 files: 66%|██████▌ | 85/129 [01:40<00:46, 1.06s/it] Fetching 129 files: 67%|██████▋ | 86/129 [01:41<00:45, 1.07s/it] Fetching 129 files: 67%|██████▋ | 87/129 [01:43<00:50, 1.21s/it] Fetching 129 files: 68%|██████▊ | 88/129 [01:44<00:42, 1.03s/it] Fetching 129 files: 69%|██████▉ | 89/129 [01:44<00:31, 1.26it/s] Fetching 129 files: 70%|██████▉ | 90/129 [01:47<00:54, 1.41s/it] Fetching 129 files: 71%|███████ | 91/129 [01:48<00:57, 1.52s/it] Fetching 129 files: 72%|███████▏ | 93/129 [01:51<00:48, 1.36s/it] Fetching 129 files: 74%|███████▎ | 95/129 [01:54<00:48, 1.43s/it] Fetching 129 files: 74%|███████▍ | 96/129 [01:54<00:40, 1.23s/it] Fetching 129 files: 76%|███████▌ | 98/129 [01:56<00:31, 1.02s/it] Fetching 129 files: 77%|███████▋ | 99/129 [01:58<00:38, 1.30s/it] Fetching 129 files: 78%|███████▊ | 101/129 [02:01<00:36, 1.31s/it] Fetching 129 files: 80%|███████▉ | 103/129 [02:05<00:42, 1.63s/it] Fetching 129 files: 81%|████████ | 104/129 [02:05<00:33, 1.35s/it] Fetching 129 files: 81%|████████▏ | 105/129 [02:06<00:27, 1.15s/it] Fetching 129 files: 82%|████████▏ | 106/129 [02:07<00:26, 1.13s/it] Fetching 129 files: 83%|████████▎ | 107/129 [02:09<00:31, 1.42s/it] Fetching 129 files: 84%|████████▍ | 109/129 [02:10<00:19, 1.05it/s] Fetching 129 files: 85%|████████▌ | 110/129 [02:10<00:15, 1.25it/s] Fetching 129 files: 86%|████████▌ | 111/129 [02:14<00:29, 1.62s/it] Fetching 129 files: 88%|████████▊ | 113/129 [02:16<00:20, 1.28s/it] Fetching 129 files: 88%|████████▊ | 114/129 [02:17<00:18, 1.21s/it] Fetching 129 files: 89%|████████▉ | 115/129 [02:19<00:20, 1.45s/it] Fetching 129 files: 91%|█████████ | 117/129 [02:20<00:12, 1.01s/it] Fetching 129 files: 91%|█████████▏| 118/129 [02:20<00:10, 1.09it/s] Fetching 129 files: 92%|█████████▏| 119/129 [02:23<00:14, 1.41s/it] Fetching 129 files: 94%|█████████▍| 121/129 [02:24<00:07, 1.03it/s] Fetching 129 files: 95%|█████████▍| 122/129 [02:25<00:07, 1.01s/it] Fetching 129 files: 95%|█████████▌| 123/129 [02:26<00:05, 1.14it/s] Fetching 129 files: 96%|█████████▌| 124/129 [02:27<00:04, 1.07it/s] Fetching 129 files: 100%|██████████| 129/129 [02:27<00:00, 1.14s/it]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Downloaded in 147.342s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Applying quantization...
qwen-qwen3-235b-a22b-i-47730-v23-uploader: 2026-02-05 15:07:16 WARNING modeling_utils.py L4670: `torch_dtype` is deprecated! Use `dtype` instead!
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Loading checkpoint shards: 0%| | 0/118 [00:00<?, ?it/s] Loading checkpoint shards: 1%| | 1/118 [00:00<00:18, 6.47it/s] Loading checkpoint shards: 2%|▏ | 2/118 [00:00<00:34, 3.41it/s] Loading checkpoint shards: 3%|▎ | 3/118 [00:02<01:46, 1.08it/s] Loading checkpoint shards: 3%|▎ | 4/118 [00:02<01:33, 1.22it/s] Loading checkpoint shards: 4%|▍ | 5/118 [00:03<01:25, 1.32it/s] Loading checkpoint shards: 5%|▌ | 6/118 [00:03<01:13, 1.53it/s] Loading checkpoint shards: 6%|▌ | 7/118 [00:04<00:55, 1.98it/s] Loading checkpoint shards: 7%|▋ | 8/118 [00:04<00:46, 2.35it/s] Loading checkpoint shards: 8%|▊ | 9/118 [00:04<00:38, 2.85it/s] Loading checkpoint shards: 8%|▊ | 10/118 [00:04<00:33, 3.27it/s] Loading checkpoint shards: 9%|▉ | 11/118 [00:05<00:29, 3.67it/s] Loading checkpoint shards: 10%|█ | 12/118 [00:05<00:28, 3.67it/s] Loading checkpoint shards: 11%|█ | 13/118 [00:05<00:28, 3.64it/s] Loading checkpoint shards: 12%|█▏ | 14/118 [00:05<00:28, 3.60it/s] Loading checkpoint shards: 13%|█▎ | 15/118 [00:06<00:28, 3.66it/s] Loading checkpoint shards: 14%|█▎ | 16/118 [00:06<00:25, 3.93it/s] Loading checkpoint shards: 14%|█▍ | 17/118 [00:06<00:26, 3.79it/s] Loading checkpoint shards: 15%|█▌ | 18/118 [00:06<00:27, 3.65it/s] Loading checkpoint shards: 16%|█▌ | 19/118 [00:07<00:27, 3.59it/s] Loading checkpoint shards: 17%|█▋ | 20/118 [00:08<00:46, 2.11it/s] Loading checkpoint shards: 18%|█▊ | 21/118 [00:11<02:06, 1.30s/it] Loading checkpoint shards: 19%|█▊ | 22/118 [00:12<01:45, 1.10s/it] Loading checkpoint shards: 19%|█▉ | 23/118 [00:12<01:34, 1.00it/s] Loading checkpoint shards: 20%|██ | 24/118 [00:13<01:27, 1.08it/s] Loading checkpoint shards: 21%|██ | 25/118 [00:14<01:18, 1.19it/s] Loading checkpoint shards: 22%|██▏ | 26/118 [00:14<01:03, 1.46it/s] Loading checkpoint shards: 23%|██▎ | 27/118 [00:14<00:49, 1.85it/s] Loading checkpoint shards: 24%|██▎ | 28/118 [00:14<00:38, 2.31it/s] Loading checkpoint shards: 25%|██▍ | 29/118 [00:15<00:32, 2.75it/s] Loading checkpoint shards: 25%|██▌ | 30/118 [00:15<00:26, 3.32it/s] Loading checkpoint shards: 26%|██▋ | 31/118 [00:15<00:21, 4.12it/s] Loading checkpoint shards: 27%|██▋ | 32/118 [00:15<00:17, 4.94it/s] Loading checkpoint shards: 29%|██▉ | 34/118 [00:15<00:11, 7.00it/s] Loading checkpoint shards: 35%|███▍ | 41/118 [00:15<00:04, 18.28it/s] Loading checkpoint shards: 41%|████ | 48/118 [00:15<00:02, 28.08it/s] Loading checkpoint shards: 47%|████▋ | 55/118 [00:15<00:01, 36.06it/s] Loading checkpoint shards: 52%|█████▏ | 61/118 [00:16<00:01, 41.59it/s] Loading checkpoint shards: 56%|█████▌ | 66/118 [00:16<00:01, 43.03it/s] Loading checkpoint shards: 61%|██████ | 72/118 [00:16<00:01, 42.76it/s] Loading checkpoint shards: 65%|██████▌ | 77/118 [00:16<00:01, 37.49it/s] Loading checkpoint shards: 69%|██████▉ | 82/118 [00:16<00:01, 32.81it/s] Loading checkpoint shards: 73%|███████▎ | 86/118 [00:16<00:01, 28.82it/s] Loading checkpoint shards: 76%|███████▋ | 90/118 [00:16<00:00, 29.66it/s] Loading checkpoint shards: 80%|███████▉ | 94/118 [00:17<00:00, 26.21it/s] Loading checkpoint shards: 82%|████████▏ | 97/118 [00:17<00:00, 26.49it/s] Loading checkpoint shards: 85%|████████▍ | 100/118 [00:17<00:00, 24.49it/s] Loading checkpoint shards: 87%|████████▋ | 103/118 [00:17<00:00, 23.10it/s] Loading checkpoint shards: 90%|████████▉ | 106/118 [00:17<00:00, 22.19it/s] Loading checkpoint shards: 92%|█████████▏| 109/118 [00:17<00:00, 21.59it/s] Loading checkpoint shards: 95%|█████████▍| 112/118 [00:18<00:00, 21.19it/s] Loading checkpoint shards: 97%|█████████▋| 115/118 [00:18<00:00, 20.82it/s] Loading checkpoint shards: 100%|██████████| 118/118 [00:18<00:00, 21.74it/s] Loading checkpoint shards: 100%|██████████| 118/118 [00:18<00:00, 6.44it/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: 2026-02-05 15:07:42 INFO base.py L366: using torch.bfloat16 for quantization tuning
qwen-qwen3-235b-a22b-i-47730-v23-uploader: 2026-02-05 15:07:46 INFO base.py L1145: start to compute imatrix
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Generating train split: 0%| | 0/10000 [00:00<?, ? examples/s] Generating train split: 100%|██████████| 10000/10000 [00:00<00:00, 57421.77 examples/s] Generating train split: 100%|██████████| 10000/10000 [00:00<00:00, 56783.38 examples/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Map: 0%| | 0/10000 [00:00<?, ? examples/s] Map: 10%|█ | 1000/10000 [00:00<00:04, 2069.53 examples/s] Map: 20%|██ | 2000/10000 [00:01<00:04, 1791.64 examples/s] Map: 30%|███ | 3000/10000 [00:03<00:10, 654.77 examples/s] Map: 40%|████ | 4000/10000 [00:04<00:06, 905.57 examples/s] Map: 50%|█████ | 5000/10000 [00:04<00:04, 1122.52 examples/s] Map: 60%|██████ | 6000/10000 [00:05<00:02, 1352.21 examples/s] Map: 70%|███████ | 7000/10000 [00:06<00:02, 1180.82 examples/s] Map: 80%|████████ | 8000/10000 [00:06<00:01, 1296.49 examples/s] Map: 90%|█████████ | 9000/10000 [00:07<00:00, 1398.66 examples/s] Map: 100%|██████████| 10000/10000 [00:08<00:00, 1396.38 examples/s] Map: 100%|██████████| 10000/10000 [00:08<00:00, 1221.73 examples/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Filter: 0%| | 0/10000 [00:00<?, ? examples/s] Filter: 10%|█ | 1000/10000 [00:00<00:03, 2861.38 examples/s] Filter: 20%|██ | 2000/10000 [00:00<00:02, 2968.45 examples/s] Filter: 30%|███ | 3000/10000 [00:01<00:02, 2896.82 examples/s] Filter: 40%|████ | 4000/10000 [00:01<00:02, 2927.13 examples/s] Filter: 50%|█████ | 5000/10000 [00:01<00:01, 2901.48 examples/s] Filter: 60%|██████ | 6000/10000 [00:02<00:01, 2908.67 examples/s] Filter: 70%|███████ | 7000/10000 [00:02<00:01, 2910.33 examples/s] Filter: 80%|████████ | 8000/10000 [00:02<00:00, 2910.23 examples/s] Filter: 90%|█████████ | 9000/10000 [00:03<00:00, 2930.95 examples/s] Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2977.77 examples/s] Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2933.64 examples/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Casting the dataset: 0%| | 0/1216 [00:00<?, ? examples/s] Casting the dataset: 82%|████████▏ | 1000/1216 [00:01<00:00, 524.10 examples/s] Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 525.36 examples/s] Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 524.52 examples/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Map: 0%| | 0/10000 [00:00<?, ? examples/s] Map: 10%|█ | 1000/10000 [00:00<00:05, 1541.66 examples/s] Map: 20%|██ | 2000/10000 [00:01<00:04, 1624.27 examples/s] Map: 30%|███ | 3000/10000 [00:03<00:11, 634.51 examples/s] Map: 40%|████ | 4000/10000 [00:04<00:06, 889.97 examples/s] Map: 50%|█████ | 5000/10000 [00:04<00:04, 1111.93 examples/s] Map: 60%|██████ | 6000/10000 [00:05<00:02, 1333.35 examples/s] Map: 70%|███████ | 7000/10000 [00:06<00:02, 1230.85 examples/s] Map: 80%|████████ | 8000/10000 [00:06<00:01, 1326.37 examples/s] Map: 90%|█████████ | 9000/10000 [00:07<00:00, 1432.29 examples/s] Map: 100%|██████████| 10000/10000 [00:08<00:00, 1385.29 examples/s] Map: 100%|██████████| 10000/10000 [00:08<00:00, 1207.50 examples/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Filter: 0%| | 0/10000 [00:00<?, ? examples/s] Filter: 10%|█ | 1000/10000 [00:00<00:03, 2900.68 examples/s] Filter: 20%|██ | 2000/10000 [00:00<00:02, 2998.02 examples/s] Filter: 30%|███ | 3000/10000 [00:01<00:02, 2915.14 examples/s] Filter: 40%|████ | 4000/10000 [00:01<00:02, 2948.01 examples/s] Filter: 50%|█████ | 5000/10000 [00:01<00:01, 2927.83 examples/s] Filter: 60%|██████ | 6000/10000 [00:02<00:01, 2931.16 examples/s] Filter: 70%|███████ | 7000/10000 [00:02<00:01, 2928.35 examples/s] Filter: 80%|████████ | 8000/10000 [00:02<00:00, 2933.28 examples/s] Filter: 90%|█████████ | 9000/10000 [00:03<00:00, 2956.05 examples/s] Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2989.80 examples/s] Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2953.28 examples/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Casting the dataset: 0%| | 0/1216 [00:00<?, ? examples/s] Casting the dataset: 82%|████████▏ | 1000/1216 [00:01<00:00, 535.29 examples/s] Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 538.19 examples/s] Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 536.96 examples/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: 0%| | 0/94 [00:00<?, ?it/s] Quantizing model.layers.0: 0%| | 0/94 [00:00<?, ?it/s]/usr/local/lib/python3.12/dist-packages/torch/backends/cuda/__init__.py:131: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
qwen-qwen3-235b-a22b-i-47730-v23-uploader: return torch._C._get_cublas_allow_tf32()
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:48.062000 7 torch/_dynamo/convert_frame.py:1358] [6/8] torch._dynamo hit config.recompile_limit (8)
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:48.062000 7 torch/_dynamo/convert_frame.py:1358] [6/8] function: 'forward' (/usr/local/lib/python3.12/dist-packages/transformers/models/qwen3_moe/modeling_qwen3_moe.py:208)
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:48.062000 7 torch/_dynamo/convert_frame.py:1358] [6/8] last reason: 6/7: self._modules['up_proj'].imatrix_cnt == 1349 # module.imatrix_cnt += input.shape[0] # auto_round/compressors/base.py:1179 in get_imatrix_hook (HINT: torch.compile considers integer attributes of the nn.Module to be static. If you are observing recompilation, you might want to make this integer dynamic using torch._dynamo.config.allow_unspec_int_on_nn_module = True, or convert this integer into a tensor.)
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:48.062000 7 torch/_dynamo/convert_frame.py:1358] [6/8] To log all recompilation reasons, use TORCH_LOGS="recompiles".
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:48.062000 7 torch/_dynamo/convert_frame.py:1358] [6/8] To diagnose recompilation issues, see https://pytorch.org/docs/main/torch.compiler_troubleshooting.html
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:51.000000 7 torch/_dynamo/convert_frame.py:1358] [3/8] torch._dynamo hit config.recompile_limit (8)
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:51.000000 7 torch/_dynamo/convert_frame.py:1358] [3/8] function: 'forward' (/usr/local/lib/python3.12/dist-packages/transformers/models/qwen3_moe/modeling_qwen3_moe.py:305)
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:51.000000 7 torch/_dynamo/convert_frame.py:1358] [3/8] last reason: 3/7: self._modules['self_attn']._modules['k_proj'].imatrix_cnt == 56 # module.imatrix_cnt += input.shape[0] # auto_round/compressors/base.py:1179 in get_imatrix_hook (HINT: torch.compile considers integer attributes of the nn.Module to be static. If you are observing recompilation, you might want to make this integer dynamic using torch._dynamo.config.allow_unspec_int_on_nn_module = True, or convert this integer into a tensor.)
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:51.000000 7 torch/_dynamo/convert_frame.py:1358] [3/8] To log all recompilation reasons, use TORCH_LOGS="recompiles".
qwen-qwen3-235b-a22b-i-47730-v23-uploader: W0205 15:08:51.000000 7 torch/_dynamo/convert_frame.py:1358] [3/8] To diagnose recompilation issues, see https://pytorch.org/docs/main/torch.compiler_troubleshooting.html
qwen-qwen3-235b-a22b-i-47730-v23-uploader: 2026-02-05 15:09:09 WARNING gguf.py L297: please use more data via setting `nsamples` to improve accuracy as calibration activations contain 0
Failed to get response for submission chaiml-mistral-24b-2048_74727_v3: ('http://chaiml-mistral-24b-2048-74727-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:35386->127.0.0.1:8080: read: connection reset by peer\n')
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
%s, retrying in %s seconds...
HTTP Request: %s %s "%s %d %s"
%s, retrying in %s seconds...
HTTP Request: %s %s "%s %d %s"
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Quantizing model.layers.0: 1%| | 1/94 [01:38<2:32:31, 98.40s/it] Quantizing model.layers.1: 1%| | 1/94 [01:38<2:32:31, 98.40s/it] Quantizing model.layers.1: 2%|▏ | 2/94 [02:28<1:47:23, 70.04s/it] Quantizing model.layers.2: 2%|▏ | 2/94 [02:28<1:47:23, 70.04s/it] Quantizing model.layers.2: 3%|▎ | 3/94 [03:20<1:33:54, 61.91s/it] Quantizing model.layers.3: 3%|▎ | 3/94 [03:20<1:33:54, 61.91s/it] Quantizing model.layers.3: 4%|▍ | 4/94 [04:13<1:27:07, 58.08s/it] Quantizing model.layers.4: 4%|▍ | 4/94 [04:13<1:27:07, 58.08s/it] Quantizing model.layers.4: 5%|▌ | 5/94 [05:05<1:22:56, 55.92s/it] Quantizing model.layers.5: 5%|▌ | 5/94 [05:05<1:22:56, 55.92s/it] Quantizing model.layers.5: 6%|▋ | 6/94 [05:55<1:19:13, 54.01s/it] Quantizing model.layers.6: 6%|▋ | 6/94 [05:55<1:19:13, 54.01s/it] Quantizing model.layers.6: 7%|▋ | 7/94 [06:45<1:16:28, 52.74s/it] Quantizing model.layers.7: 7%|▋ | 7/94 [06:45<1:16:28, 52.74s/it] Quantizing model.layers.7: 9%|▊ | 8/94 [07:37<1:15:21, 52.57s/it] Quantizing model.layers.8: 9%|▊ | 8/94 [07:37<1:15:21, 52.57s/it] Quantizing model.layers.8: 10%|▉ | 9/94 [08:28<1:13:49, 52.12s/it] Quantizing model.layers.9: 10%|▉ | 9/94 [08:28<1:13:49, 52.12s/it] Quantizing model.layers.9: 11%|█ | 10/94 [09:18<1:11:44, 51.25s/it] Quantizing model.layers.10: 11%|█ | 10/94 [09:18<1:11:44, 51.25s/it] Quantizing model.layers.10: 12%|█▏ | 11/94 [10:08<1:10:18, 50.82s/it] Quantizing model.layers.11: 12%|█▏ | 11/94 [10:08<1:10:18, 50.82s/it] Quantizing model.layers.11: 13%|█▎ | 12/94 [10:57<1:09:01, 50.51s/it] Quantizing model.layers.12: 13%|█▎ | 12/94 [10:57<1:09:01, 50.51s/it] Quantizing model.layers.12: 14%|█▍ | 13/94 [11:47<1:07:57, 50.34s/it] Quantizing model.layers.13: 14%|█▍ | 13/94 [11:47<1:07:57, 50.34s/it] Quantizing model.layers.13: 15%|█▍ | 14/94 [12:37<1:06:45, 50.06s/it] Quantizing model.layers.14: 15%|█▍ | 14/94 [12:37<1:06:45, 50.06s/it] Quantizing model.layers.14: 16%|█▌ | 15/94 [13:27<1:05:59, 50.12s/it] Quantizing model.layers.15: 16%|█▌ | 15/94 [13:27<1:05:59, 50.12s/it] Quantizing model.layers.15: 17%|█▋ | 16/94 [14:17<1:04:58, 49.98s/it] Quantizing model.layers.16: 17%|█▋ | 16/94 [14:17<1:04:58, 49.98s/it] Quantizing model.layers.16: 18%|█▊ | 17/94 [15:06<1:03:54, 49.80s/it] Quantizing model.layers.17: 18%|█▊ | 17/94 [15:06<1:03:54, 49.80s/it] Quantizing model.layers.17: 19%|█▉ | 18/94 [15:56<1:02:58, 49.71s/it] Quantizing model.layers.18: 19%|█▉ | 18/94 [15:56<1:02:58, 49.71s/it] Quantizing model.layers.18: 20%|██ | 19/94 [16:45<1:02:03, 49.64s/it] Quantizing model.layers.19: 20%|██ | 19/94 [16:45<1:02:03, 49.64s/it] Quantizing model.layers.19: 21%|██▏ | 20/94 [17:34<1:01:09, 49.59s/it] Quantizing model.layers.20: 21%|██▏ | 20/94 [17:34<1:01:09, 49.59s/it] Quantizing model.layers.20: 22%|██▏ | 21/94 [18:24<1:00:25, 49.67s/it] Quantizing model.layers.21: 22%|██▏ | 21/94 [18:24<1:00:25, 49.67s/it] Quantizing model.layers.21: 23%|██▎ | 22/94 [19:14<59:32, 49.61s/it] Quantizing model.layers.22: 23%|██▎ | 22/94 [19:14<59:32, 49.61s/it] Quantizing model.layers.22: 24%|██▍ | 23/94 [20:02<58:19, 49.29s/it] Quantizing model.layers.23: 24%|██▍ | 23/94 [20:02<58:19, 49.29s/it] Quantizing model.layers.23: 26%|██▌ | 24/94 [20:51<57:19, 49.14s/it] Quantizing model.layers.24: 26%|██▌ | 24/94 [20:51<57:19, 49.14s/it] Quantizing model.layers.24: 27%|██▋ | 25/94 [21:40<56:15, 48.92s/it] Quantizing model.layers.25: 27%|██▋ | 25/94 [21:40<56:15, 48.92s/it] Quantizing model.layers.25: 28%|██▊ | 26/94 [22:28<55:09, 48.67s/it] Quantizing model.layers.26: 28%|██▊ | 26/94 [22:28<55:09, 48.67s/it] Quantizing model.layers.26: 29%|██▊ | 27/94 [23:13<53:18, 47.74s/it] Quantizing model.layers.27: 29%|██▊ | 27/94 [23:13<53:18, 47.74s/it] Quantizing model.layers.27: 30%|██▉ | 28/94 [23:58<51:38, 46.95s/it] Quantizing model.layers.28: 30%|██▉ | 28/94 [23:58<51:38, 46.95s/it] Quantizing model.layers.28: 31%|███ | 29/94 [24:43<49:58, 46.14s/it] Quantizing model.layers.29: 31%|███ | 29/94 [24:43<49:58, 46.14s/it] Quantizing model.layers.29: 32%|███▏ | 30/94 [25:27<48:38, 45.60s/it] Quantizing model.layers.30: 32%|███▏ | 30/94 [25:27<48:38, 45.60s/it] Quantizing model.layers.30: 33%|███▎ | 31/94 [26:11<47:29, 45.23s/it] Quantizing model.layers.31: 33%|███▎ | 31/94 [26:11<47:29, 45.23s/it] Quantizing model.layers.31: 34%|███▍ | 32/94 [26:55<46:25, 44.93s/it] Quantizing model.layers.32: 34%|███▍ | 32/94 [26:55<46:25, 44.93s/it] Quantizing model.layers.32: 35%|███▌ | 33/94 [27:40<45:30, 44.76s/it] Quantizing model.layers.33: 35%|███▌ | 33/94 [27:40<45:30, 44.76s/it] Quantizing model.layers.33: 36%|███▌ | 34/94 [28:24<44:35, 44.60s/it] Quantizing model.layers.34: 36%|███▌ | 34/94 [28:24<44:35, 44.60s/it] Quantizing model.layers.34: 37%|███▋ | 35/94 [29:08<43:47, 44.53s/it] Quantizing model.layers.35: 37%|███▋ | 35/94 [29:08<43:47, 44.53s/it] Quantizing model.layers.35: 38%|███▊ | 36/94 [29:53<43:01, 44.51s/it] Quantizing model.layers.36: 38%|███▊ | 36/94 [29:53<43:01, 44.51s/it] Quantizing model.layers.36: 39%|███▉ | 37/94 [30:39<42:43, 44.97s/it] Quantizing model.layers.37: 39%|███▉ | 37/94 [30:39<42:43, 44.97s/it] Quantizing model.layers.37: 40%|████ | 38/94 [31:23<41:46, 44.76s/it] Quantizing model.layers.38: 40%|████ | 38/94 [31:23<41:46, 44.76s/it] Quantizing model.layers.38: 41%|████▏ | 39/94 [32:08<40:56, 44.66s/it] Quantizing model.layers.39: 41%|████▏ | 39/94 [32:08<40:56, 44.66s/it] Quantizing model.layers.39: 43%|████▎ | 40/94 [32:52<40:08, 44.60s/it] Quantizing model.layers.40: 43%|████▎ | 40/94 [32:52<40:08, 44.60s/it] Quantizing model.layers.40: 44%|████▎ | 41/94 [33:36<39:19, 44.52s/it] Quantizing model.layers.41: 44%|████▎ | 41/94 [33:36<39:19, 44.52s/it] Quantizing model.layers.41: 45%|████▍ | 42/94 [34:21<38:34, 44.51s/it] Quantizing model.layers.42: 45%|████▍ | 42/94 [34:21<38:34, 44.51s/it] Quantizing model.layers.42: 46%|████▌ | 43/94 [35:05<37:48, 44.48s/it] Quantizing model.layers.43: 46%|████▌ | 43/94 [35:05<37:48, 44.48s/it] Quantizing model.layers.43: 47%|████▋ | 44/94 [35:50<37:04, 44.49s/it] Quantizing model.layers.44: 47%|████▋ | 44/94 [35:50<37:04, 44.49s/it] Quantizing model.layers.44: 48%|████▊ | 45/94 [36:34<36:19, 44.48s/it] Quantizing model.layers.45: 48%|████▊ | 45/94 [36:34<36:19, 44.48s/it] Quantizing model.layers.45: 49%|████▉ | 46/94 [37:19<35:31, 44.41s/it] Quantizing model.layers.46: 49%|████▉ | 46/94 [37:19<35:31, 44.41s/it] Quantizing model.layers.46: 50%|█████ | 47/94 [38:02<34:35, 44.16s/it] Quantizing model.layers.47: 50%|█████ | 47/94 [38:02<34:35, 44.16s/it] Quantizing model.layers.47: 51%|█████ | 48/94 [38:46<33:43, 44.00s/it] Quantizing model.layers.48: 51%|█████ | 48/94 [38:46<33:43, 44.00s/it] Quantizing model.layers.48: 52%|█████▏ | 49/94 [39:29<32:53, 43.85s/it] Quantizing model.layers.49: 52%|█████▏ | 49/94 [39:29<32:53, 43.85s/it] Quantizing model.layers.49: 53%|█████▎ | 50/94 [40:13<32:04, 43.74s/it] Quantizing model.layers.50: 53%|█████▎ | 50/94 [40:13<32:04, 43.74s/it] Quantizing model.layers.50: 54%|█████▍ | 51/94 [40:56<31:19, 43.70s/it] Quantizing model.layers.51: 54%|█████▍ | 51/94 [40:56<31:19, 43.70s/it] Quantizing model.layers.51: 55%|█████▌ | 52/94 [41:40<30:35, 43.70s/it] Quantizing model.layers.52: 55%|█████▌ | 52/94 [41:40<30:35, 43.70s/it] Quantizing model.layers.52: 56%|█████▋ | 53/94 [42:24<29:50, 43.68s/it] Quantizing model.layers.53: 56%|█████▋ | 53/94 [42:24<29:50, 43.68s/it] Quantizing model.layers.53: 57%|█████▋ | 54/94 [43:07<29:06, 43.65s/it] Quantizing model.layers.54: 57%|█████▋ | 54/94 [43:07<29:06, 43.65s/it] Quantizing model.layers.54: 59%|█████▊ | 55/94 [43:51<28:23, 43.68s/it] Quantizing model.layers.55: 59%|█████▊ | 55/94 [43:51<28:23, 43.68s/it] Quantizing model.layers.55: 60%|█████▉ | 56/94 [44:36<27:49, 43.94s/it] Quantizing model.layers.56: 60%|█████▉ | 56/94 [44:36<27:49, 43.94s/it] Quantizing model.layers.56: 61%|██████ | 57/94 [45:19<26:59, 43.78s/it] Quantizing model.layers.57: 61%|██████ | 57/94 [45:19<26:59, 43.78s/it] Quantizing model.layers.57: 62%|██████▏ | 58/94 [46:03<26:16, 43.80s/it] Quantizing model.layers.58: 62%|██████▏ | 58/94 [46:03<26:16, 43.80s/it] Quantizing model.layers.58: 63%|██████▎ | 59/94 [46:47<25:39, 43.98s/it] Quantizing model.layers.59: 63%|██████▎ | 59/94 [46:47<25:39, 43.98s/it] Quantizing model.layers.59: 64%|██████▍ | 60/94 [47:32<25:01, 44.16s/it] Quantizing model.layers.60: 64%|██████▍ | 60/94 [47:32<25:01, 44.16s/it] Quantizing model.layers.60: 65%|██████▍ | 61/94 [48:16<24:20, 44.25s/it] Quantizing model.layers.61: 65%|██████▍ | 61/94 [48:16<24:20, 44.25s/it] Quantizing model.layers.61: 66%|██████▌ | 62/94 [49:01<23:36, 44.28s/it] Quantizing model.layers.62: 66%|██████▌ | 62/94 [49:01<23:36, 44.28s/it] Quantizing model.layers.62: 67%|██████▋ | 63/94 [49:45<22:54, 44.33s/it] Quantizing model.layers.63: 67%|██████▋ | 63/94 [49:45<22:54, 44.33s/it] Quantizing model.layers.63: 68%|██████▊ | 64/94 [50:30<22:11, 44.39s/it] Quantizing model.layers.64: 68%|██████▊ | 64/94 [50:30<22:11, 44.39s/it] Quantizing model.layers.64: 69%|██████▉ | 65/94 [51:14<21:27, 44.41s/it] Quantizing model.layers.65: 69%|██████▉ | 65/94 [51:14<21:27, 44.41s/it] Quantizing model.layers.65: 70%|███████ | 66/94 [51:58<20:42, 44.39s/it] Quantizing model.layers.66: 70%|███████ | 66/94 [51:58<20:42, 44.39s/it] Quantizing model.layers.66: 71%|███████▏ | 67/94 [52:43<19:59, 44.41s/it] Quantizing model.layers.67: 71%|███████▏ | 67/94 [52:43<19:59, 44.41s/it] Quantizing model.layers.67: 72%|███████▏ | 68/94 [53:27<19:15, 44.45s/it] Quantizing model.layers.68: 72%|███████▏ | 68/94 [53:27<19:15, 44.45s/it] Quantizing model.layers.68: 73%|███████▎ | 69/94 [54:12<18:31, 44.48s/it] Quantizing model.layers.69: 73%|███████▎ | 69/94 [54:12<18:31, 44.48s/it] Quantizing model.layers.69: 74%|███████▍ | 70/94 [54:56<17:47, 44.49s/it] Quantizing model.layers.70: 74%|███████▍ | 70/94 [54:56<17:47, 44.49s/it] Quantizing model.layers.70: 76%|███████▌ | 71/94 [55:40<16:58, 44.26s/it] Quantizing model.layers.71: 76%|███████▌ | 71/94 [55:40<16:58, 44.26s/it] Quantizing model.layers.71: 77%|███████▋ | 72/94 [56:24<16:10, 44.12s/it] Quantizing model.layers.72: 77%|███████▋ | 72/94 [56:24<16:10, 44.12s/it] Quantizing model.layers.72: 78%|███████▊ | 73/94 [57:08<15:23, 43.96s/it] Quantizing model.layers.73: 78%|███████▊ | 73/94 [57:08<15:23, 43.96s/it] Quantizing model.layers.73: 79%|███████▊ | 74/94 [57:51<14:36, 43.80s/it] Quantizing model.layers.74: 79%|███████▊ | 74/94 [57:51<14:36, 43.80s/it] Quantizing model.layers.74: 80%|███████▉ | 75/94 [58:35<13:51, 43.75s/it] Quantizing model.layers.75: 80%|███████▉ | 75/94 [58:35<13:51, 43.75s/it] Quantizing model.layers.75: 81%|████████ | 76/94 [59:18<13:06, 43.72s/it] Quantizing model.layers.76: 81%|████████ | 76/94 [59:18<13:06, 43.72s/it] Quantizing model.layers.76: 82%|████████▏ | 77/94 [1:00:02<12:22, 43.67s/it] Quantizing model.layers.77: 82%|████████▏ | 77/94 [1:00:02<12:22, 43.67s/it] Quantizing model.layers.77: 83%|████████▎ | 78/94 [1:00:45<11:38, 43.64s/it] Quantizing model.layers.78: 83%|████████▎ | 78/94 [1:00:45<11:38, 43.64s/it] Quantizing model.layers.78: 84%|████████▍ | 79/94 [1:01:29<10:55, 43.70s/it] Quantizing model.layers.79: 84%|████████▍ | 79/94 [1:01:29<10:55, 43.70s/it] Quantizing model.layers.79: 85%|████████▌ | 80/94 [1:02:13<10:13, 43.85s/it] Quantizing model.layers.80: 85%|████████▌ | 80/94 [1:02:13<10:13, 43.85s/it] Quantizing model.layers.80: 86%|████████▌ | 81/94 [1:02:57<09:30, 43.88s/it] Quantizing model.layers.81: 86%|████████▌ | 81/94 [1:02:57<09:30, 43.88s/it] Quantizing model.layers.81: 87%|████████▋ | 82/94 [1:03:42<08:48, 44.07s/it] Quantizing model.layers.82: 87%|████████▋ | 82/94 [1:03:42<08:48, 44.07s/it] Quantizing model.layers.82: 88%|████████▊ | 83/94 [1:04:26<08:06, 44.23s/it] Quantizing model.layers.83: 88%|████████▊ | 83/94 [1:04:26<08:06, 44.23s/it] Quantizing model.layers.83: 89%|████████▉ | 84/94 [1:05:11<07:23, 44.35s/it] Quantizing model.layers.84: 89%|████████▉ | 84/94 [1:05:11<07:23, 44.35s/it] Quantizing model.layers.84: 90%|█████████ | 85/94 [1:05:56<06:39, 44.43s/it] Quantizing model.layers.85: 90%|█████████ | 85/94 [1:05:56<06:39, 44.43s/it] Quantizing model.layers.85: 91%|█████████▏| 86/94 [1:06:40<05:55, 44.47s/it] Quantizing model.layers.86: 91%|█████████▏| 86/94 [1:06:40<05:55, 44.47s/it] Quantizing model.layers.86: 93%|█████████▎| 87/94 [1:07:25<05:11, 44.48s/it] Quantizing model.layers.87: 93%|█████████▎| 87/94 [1:07:25<05:11, 44.48s/it] Quantizing model.layers.87: 94%|█████████▎| 88/94 [1:08:09<04:26, 44.43s/it] Quantizing model.layers.88: 94%|█████████▎| 88/94 [1:08:09<04:26, 44.43s/it] Quantizing model.layers.88: 95%|█████████▍| 89/94 [1:08:53<03:41, 44.28s/it] Quantizing model.layers.89: 95%|█████████▍| 89/94 [1:08:53<03:41, 44.28s/it] Quantizing model.layers.89: 96%|█████████▌| 90/94 [1:09:37<02:57, 44.26s/it] Quantizing model.layers.90: 96%|█████████▌| 90/94 [1:09:37<02:57, 44.26s/it] Quantizing model.layers.90: 97%|█████████▋| 91/94 [1:10:22<02:13, 44.40s/it] Quantizing model.layers.91: 97%|█████████▋| 91/94 [1:10:22<02:13, 44.40s/it] Quantizing model.layers.91: 98%|█████████▊| 92/94 [1:11:07<01:28, 44.48s/it] Quantizing model.layers.92: 98%|█████████▊| 92/94 [1:11:07<01:28, 44.48s/it] Quantizing model.layers.92: 99%|█████████▉| 93/94 [1:11:51<00:44, 44.59s/it] Quantizing model.layers.93: 99%|█████████▉| 93/94 [1:11:51<00:44, 44.59s/it] Quantizing model.layers.93: 100%|██████████| 94/94 [1:12:36<00:00, 44.65s/it] Quantizing model.layers.93: 100%|██████████| 94/94 [1:12:36<00:00, 46.35s/it]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: 0%| | 0/36566 [00:00<?, ?it/s] packing model.layers.0.mlp.gate: 0%| | 0/36566 [00:00<?, ?it/s] packing model.layers.0.mlp.gate: 0%| | 1/36566 [00:01<11:00:57, 1.08s/it] packing model.layers.1.mlp.gate: 0%| | 1/36566 [00:01<11:00:57, 1.08s/it] packing model.layers.2.mlp.gate: 0%| | 2/36566 [00:01<11:00:56, 1.08s/it] packing model.layers.3.mlp.gate: 0%| | 3/36566 [00:01<11:00:55, 1.08s/it] packing model.layers.4.mlp.gate: 0%| | 4/36566 [00:01<11:00:54, 1.08s/it] packing model.layers.5.mlp.gate: 0%| | 5/36566 [00:01<11:00:53, 1.08s/it] packing model.layers.6.mlp.gate: 0%| | 6/36566 [00:01<11:00:52, 1.08s/it] packing model.layers.7.mlp.gate: 0%| | 7/36566 [00:01<11:00:51, 1.08s/it] packing model.layers.8.mlp.gate: 0%| | 8/36566 [00:01<11:00:50, 1.08s/it] packing model.layers.9.mlp.gate: 0%| | 9/36566 [00:01<11:00:49, 1.08s/it] packing model.layers.10.mlp.gate: 0%| | 10/36566 [00:01<11:00:48, 1.08s/it] packing model.layers.11.mlp.gate: 0%| | 11/36566 [00:01<11:00:47, 1.08s/it] packing model.layers.12.mlp.gate: 0%| | 12/36566 [00:01<11:00:45, 1.08s/it] packing model.layers.13.mlp.gate: 0%| | 13/36566 [00:01<11:00:44, 1.08s/it] packing model.layers.14.mlp.gate: 0%| | 14/36566 [00:01<11:00:43, 1.08s/it] packing model.layers.15.mlp.gate: 0%| | 15/36566 [00:01<11:00:42, 1.08s/it] packing model.layers.16.mlp.gate: 0%| | 16/36566 [00:01<11:00:41, 1.08s/it] packing model.layers.17.mlp.gate: 0%| | 17/36566 [00:01<11:00:40, 1.08s/it] packing model.layers.18.mlp.gate: 0%| | 18/36566 [00:01<11:00:39, 1.08s/it] packing model.layers.19.mlp.gate: 0%| | 19/36566 [00:01<11:00:38, 1.08s/it] packing model.layers.20.mlp.gate: 0%| | 20/36566 [00:01<11:00:37, 1.08s/it] packing model.layers.21.mlp.gate: 0%| | 21/36566 [00:01<11:00:36, 1.08s/it] packing model.layers.22.mlp.gate: 0%| | 22/36566 [00:01<11:00:35, 1.08s/it] packing model.layers.23.mlp.gate: 0%| | 23/36566 [00:01<11:00:33, 1.08s/it] packing model.layers.24.mlp.gate: 0%| | 24/36566 [00:01<11:00:32, 1.08s/it] packing model.layers.25.mlp.gate: 0%| | 25/36566 [00:01<11:00:31, 1.08s/it] packing model.layers.26.mlp.gate: 0%| | 26/36566 [00:01<11:00:30, 1.08s/it] packing model.layers.27.mlp.gate: 0%| | 27/36566 [00:01<11:00:29, 1.08s/it] packing model.layers.28.mlp.gate: 0%| | 28/36566 [00:01<11:00:28, 1.08s/it] packing model.layers.29.mlp.gate: 0%| | 29/36566 [00:01<11:00:27, 1.08s/it] packing model.layers.30.mlp.gate: 0%| | 30/36566 [00:01<11:00:26, 1.08s/it] packing model.layers.31.mlp.gate: 0%| | 31/36566 [00:01<11:00:25, 1.08s/it] packing model.layers.32.mlp.gate: 0%| | 32/36566 [00:01<11:00:24, 1.08s/it] packing model.layers.33.mlp.gate: 0%| | 33/36566 [00:01<11:00:23, 1.08s/it] packing model.layers.34.mlp.gate: 0%| | 34/36566 [00:01<11:00:22, 1.08s/it] packing model.layers.35.mlp.gate: 0%| | 35/36566 [00:01<11:00:20, 1.08s/it] packing model.layers.36.mlp.gate: 0%| | 36/36566 [00:01<11:00:19, 1.08s/it] packing model.layers.37.mlp.gate: 0%| | 37/36566 [00:01<11:00:18, 1.08s/it] packing model.layers.38.mlp.gate: 0%| | 38/36566 [00:01<11:00:17, 1.08s/it] packing model.layers.39.mlp.gate: 0%| | 39/36566 [00:01<11:00:16, 1.08s/it] packing model.layers.40.mlp.gate: 0%| | 40/36566 [00:01<11:00:15, 1.08s/it] packing model.layers.41.mlp.gate: 0%| | 41/36566 [00:01<11:00:14, 1.08s/it] packing model.layers.42.mlp.gate: 0%| | 42/36566 [00:01<11:00:13, 1.08s/it] packing model.layers.43.mlp.gate: 0%| | 43/36566 [00:01<11:00:12, 1.08s/it] packing model.layers.44.mlp.gate: 0%| | 44/36566 [00:01<11:00:11, 1.08s/it] packing model.layers.45.mlp.gate: 0%| | 45/36566 [00:01<11:00:10, 1.08s/it] packing model.layers.46.mlp.gate: 0%| | 46/36566 [00:01<11:00:09, 1.08s/it] packing model.layers.47.mlp.gate: 0%| | 47/36566 [00:01<11:00:07, 1.08s/it] packing model.layers.48.mlp.gate: 0%| | 48/36566 [00:01<11:00:06, 1.08s/it] packing model.layers.49.mlp.gate: 0%| | 49/36566 [00:01<11:00:05, 1.08s/it] packing model.layers.50.mlp.gate: 0%| | 50/36566 [00:01<11:00:04, 1.08s/it] packing model.layers.51.mlp.gate: 0%| | 51/36566 [00:01<11:00:03, 1.08s/it] packing model.layers.52.mlp.gate: 0%| | 52/36566 [00:01<11:00:02, 1.08s/it] packing model.layers.53.mlp.gate: 0%| | 53/36566 [00:01<11:00:01, 1.08s/it] packing model.layers.54.mlp.gate: 0%| | 54/36566 [00:01<11:00:00, 1.08s/it] packing model.layers.55.mlp.gate: 0%| | 55/36566 [00:01<10:59:59, 1.08s/it] packing model.layers.56.mlp.gate: 0%| | 56/36566 [00:01<10:59:58, 1.08s/it] packing model.layers.57.mlp.gate: 0%| | 57/36566 [00:01<10:59:57, 1.08s/it] packing model.layers.58.mlp.gate: 0%| | 58/36566 [00:01<10:59:56, 1.08s/it] packing model.layers.59.mlp.gate: 0%| | 59/36566 [00:01<10:59:54, 1.08s/it] packing model.layers.60.mlp.gate: 0%| | 60/36566 [00:01<10:59:53, 1.08s/it] packing model.layers.61.mlp.gate: 0%| | 61/36566 [00:01<10:59:52, 1.08s/it] packing model.layers.62.mlp.gate: 0%| | 62/36566 [00:01<10:59:51, 1.08s/it] packing model.layers.63.mlp.gate: 0%| | 63/36566 [00:01<10:59:50, 1.08s/it] packing model.layers.64.mlp.gate: 0%| | 64/36566 [00:01<10:59:49, 1.08s/it] packing model.layers.65.mlp.gate: 0%| | 65/36566 [00:01<10:59:48, 1.08s/it] packing model.layers.66.mlp.gate: 0%| | 66/36566 [00:01<10:59:47, 1.08s/it] packing model.layers.67.mlp.gate: 0%| | 67/36566 [00:01<10:59:46, 1.08s/it] packing model.layers.68.mlp.gate: 0%| | 68/36566 [00:01<10:59:45, 1.08s/it] packing model.layers.69.mlp.gate: 0%| | 69/36566 [00:01<10:59:44, 1.08s/it] packing model.layers.70.mlp.gate: 0%| | 70/36566 [00:01<10:59:43, 1.08s/it] packing model.layers.71.mlp.gate: 0%| | 71/36566 [00:01<10:59:41, 1.08s/it] packing model.layers.72.mlp.gate: 0%| | 72/36566 [00:01<10:59:40, 1.08s/it] packing model.layers.73.mlp.gate: 0%| | 73/36566 [00:01<10:59:39, 1.08s/it] packing model.layers.74.mlp.gate: 0%| | 74/36566 [00:01<10:59:38, 1.08s/it] packing model.layers.75.mlp.gate: 0%| | 75/36566 [00:01<10:59:37, 1.08s/it] packing model.layers.76.mlp.gate: 0%| | 76/36566 [00:01<10:59:36, 1.08s/it] packing model.layers.77.mlp.gate: 0%| | 77/36566 [00:01<10:59:35, 1.08s/it] packing model.layers.78.mlp.gate: 0%| | 78/36566 [00:01<10:59:34, 1.08s/it] packing model.layers.79.mlp.gate: 0%| | 79/36566 [00:01<10:59:33, 1.08s/it] packing model.layers.80.mlp.gate: 0%| | 80/36566 [00:01<10:59:32, 1.08s/it] packing model.layers.81.mlp.gate: 0%| | 81/36566 [00:01<10:59:31, 1.08s/it] packing model.layers.82.mlp.gate: 0%| | 82/36566 [00:01<10:59:29, 1.08s/it] packing model.layers.83.mlp.gate: 0%| | 83/36566 [00:01<10:59:28, 1.08s/it] packing model.layers.84.mlp.gate: 0%| | 84/36566 [00:01<10:59:27, 1.08s/it] packing model.layers.85.mlp.gate: 0%| | 85/36566 [00:01<10:59:26, 1.08s/it] packing model.layers.86.mlp.gate: 0%| | 86/36566 [00:01<10:59:25, 1.08s/it] packing model.layers.87.mlp.gate: 0%| | 87/36566 [00:01<10:59:24, 1.08s/it] packing model.layers.88.mlp.gate: 0%| | 88/36566 [00:01<10:59:23, 1.08s/it] packing model.layers.89.mlp.gate: 0%| | 89/36566 [00:01<10:59:22, 1.08s/it] packing model.layers.90.mlp.gate: 0%| | 90/36566 [00:01<10:59:21, 1.08s/it] packing model.layers.91.mlp.gate: 0%| | 91/36566 [00:01<10:59:20, 1.08s/it] packing model.layers.92.mlp.gate: 0%| | 92/36566 [00:01<10:59:19, 1.08s/it] packing model.layers.93.mlp.gate: 0%| | 93/36566 [00:01<10:59:18, 1.08s/it] packing model.layers.0.self_attn.k_proj: 0%| | 94/36566 [00:01<10:59:16, 1.08s/it] packing model.layers.1.self_attn.k_proj: 0%| | 95/36566 [00:01<10:59:15, 1.08s/it] packing model.layers.2.self_attn.k_proj: 0%| | 96/36566 [00:01<10:59:14, 1.08s/it] packing model.layers.3.self_attn.k_proj: 0%| | 97/36566 [00:01<10:59:13, 1.08s/it] packing model.layers.4.self_attn.k_proj: 0%| | 98/36566 [00:01<10:59:12, 1.08s/it] packing model.layers.5.self_attn.k_proj: 0%| | 99/36566 [00:01<10:59:11, 1.08s/it] packing model.layers.6.self_attn.k_proj: 0%| | 100/36566 [00:01<10:59:10, 1.08s/it] packing model.layers.7.self_attn.k_proj: 0%| | 101/36566 [00:01<10:59:09, 1.08s/it] packing model.layers.8.self_attn.k_proj: 0%| | 102/36566 [00:01<10:59:08, 1.08s/it] packing model.layers.9.self_attn.k_proj: 0%| | 103/36566 [00:01<10:59:07, 1.08s/it] packing model.layers.10.self_attn.k_proj: 0%| | 104/36566 [00:01<10:59:06, 1.08s/it] packing model.layers.11.self_attn.k_proj: 0%| | 105/36566 [00:01<10:59:05, 1.08s/it] packing model.layers.12.self_attn.k_proj: 0%| | 106/36566 [00:01<10:59:03, 1.08s/it] packing model.layers.13.self_attn.k_proj: 0%| | 107/36566 [00:01<10:59:02, 1.08s/it] packing model.layers.14.self_attn.k_proj: 0%| | 108/36566 [00:01<10:59:01, 1.08s/it] packing model.layers.15.self_attn.k_proj: 0%| | 109/36566 [00:01<10:59:00, 1.08s/it] packing model.layers.16.self_attn.k_proj: 0%| | 110/36566 [00:01<10:58:59, 1.08s/it] packing model.layers.17.self_attn.k_proj: 0%| | 111/36566 [00:01<10:58:58, 1.08s/it] packing model.layers.18.self_attn.k_proj: 0%| | 112/36566 [00:01<10:58:57, 1.08s/it] packing model.layers.19.self_attn.k_proj: 0%| | 113/36566 [00:01<10:58:56, 1.08s/it] packing model.layers.20.self_attn.k_proj: 0%| | 114/36566 [00:01<10:58:55, 1.08s/it] packing model.layers.20.self_attn.k_proj: 0%| | 115/36566 [00:01<04:33, 133.49it/s] packing model.layers.21.self_attn.k_proj: 0%| | 115/36566 [00:01<04:33, 133.49it/s] packing model.layers.22.self_attn.k_proj: 0%| | 116/36566 [00:01<04:33, 133.49it/s] packing model.layers.23.self_attn.k_proj: 0%| | 117/36566 [00:01<04:33, 133.49it/s] packing model.layers.24.self_attn.k_proj: 0%| | 118/36566 [00:01<04:33, 133.49it/s] packing model.layers.25.self_attn.k_proj: 0%| | 119/36566 [00:01<04:33, 133.49it/s] packing model.layers.26.self_attn.k_proj: 0%| | 120/36566 [00:01<04:33, 133.49it/s] packing model.layers.27.self_attn.k_proj: 0%| | 121/36566 [00:01<04:33, 133.49it/s] packing model.layers.28.self_attn.k_proj: 0%| | 122/36566 [00:01<04:33, 133.49it/s] packing model.layers.29.self_attn.k_proj: 0%| | 123/36566 [00:01<04:33, 133.49it/s] packing model.layers.30.self_attn.k_proj: 0%| | 124/36566 [00:01<04:32, 133.49it/s] packing model.layers.31.self_attn.k_proj: 0%| | 125/36566 [00:01<04:32, 133.49it/s] packing model.layers.32.self_attn.k_proj: 0%| | 126/36566 [00:01<04:32, 133.49it/s] packing model.layers.33.self_attn.k_proj: 0%| | 127/36566 [00:01<04:32, 133.49it/s] packing model.layers.34.self_attn.k_proj: 0%| | 128/36566 [00:01<04:32, 133.49it/s] packing model.layers.35.self_attn.k_proj: 0%| | 129/36566 [00:01<04:32, 133.49it/s] packing model.layers.36.self_attn.k_proj: 0%| | 130/36566 [00:01<04:32, 133.49it/s] packing model.layers.37.self_attn.k_proj: 0%| | 131/36566 [00:01<04:32, 133.49it/s] packing model.layers.38.self_attn.k_proj: 0%| | 132/36566 [00:01<04:32, 133.49it/s] packing model.layers.39.self_attn.k_proj: 0%| | 133/36566 [00:01<04:32, 133.49it/s] packing model.layers.40.self_attn.k_proj: 0%| | 134/36566 [00:01<04:32, 133.49it/s] packing model.layers.41.self_attn.k_proj: 0%| | 135/36566 [00:01<04:32, 133.49it/s] packing model.layers.42.self_attn.k_proj: 0%| | 136/36566 [00:01<04:32, 133.49it/s] packing model.layers.43.self_attn.k_proj: 0%| | 137/36566 [00:01<04:32, 133.49it/s] packing model.layers.44.self_attn.k_proj: 0%| | 138/36566 [00:01<04:32, 133.49it/s] packing model.layers.45.self_attn.k_proj: 0%| | 139/36566 [00:01<04:32, 133.49it/s] packing model.layers.46.self_attn.k_proj: 0%| | 140/36566 [00:01<04:32, 133.49it/s] packing model.layers.47.self_attn.k_proj: 0%| | 141/36566 [00:01<04:32, 133.49it/s] packing model.layers.48.self_attn.k_proj: 0%| | 142/36566 [00:01<04:32, 133.49it/s] packing model.layers.49.self_attn.k_proj: 0%| | 143/36566 [00:01<04:32, 133.49it/s] packing model.layers.50.self_attn.k_proj: 0%| | 144/36566 [00:01<04:32, 133.49it/s] packing model.layers.51.self_attn.k_proj: 0%| | 145/36566 [00:01<04:32, 133.49it/s] packing model.layers.52.self_attn.k_proj: 0%| | 146/36566 [00:01<04:32, 133.49it/s] packing model.layers.53.self_attn.k_proj: 0%| | 147/36566 [00:01<04:32, 133.49it/s] packing model.layers.54.self_attn.k_proj: 0%| | 148/36566 [00:01<04:32, 133.49it/s] packing model.layers.55.self_attn.k_proj: 0%| | 149/36566 [00:01<04:32, 133.49it/s] packing model.layers.56.self_attn.k_proj: 0%| | 150/36566 [00:01<04:32, 133.49it/s] packing model.layers.57.self_attn.k_proj: 0%| | 151/36566 [00:01<04:32, 133.49it/s] packing model.layers.58.self_attn.k_proj: 0%| | 152/36566 [00:01<04:32, 133.49it/s] packing model.layers.59.self_attn.k_proj: 0%| | 153/36566 [00:01<04:32, 133.49it/s] packing model.layers.60.self_attn.k_proj: 0%| | 154/36566 [00:01<04:32, 133.49it/s] packing model.layers.61.self_attn.k_proj: 0%| | 155/36566 [00:01<04:32, 133.49it/s] packing model.layers.62.self_attn.k_proj: 0%| | 156/36566 [00:01<04:32, 133.49it/s] packing model.layers.63.self_attn.k_proj: 0%| | 157/36566 [00:01<04:32, 133.49it/s] packing model.layers.64.self_attn.k_proj: 0%| | 158/36566 [00:01<04:32, 133.49it/s] packing model.layers.65.self_attn.k_proj: 0%| | 159/36566 [00:01<04:32, 133.49it/s] packing model.layers.66.self_attn.k_proj: 0%| | 160/36566 [00:01<04:32, 133.49it/s] packing model.layers.67.self_attn.k_proj: 0%| | 161/36566 [00:01<04:32, 133.49it/s] packing model.layers.68.self_attn.k_proj: 0%| | 162/36566 [00:01<04:32, 133.49it/s] packing model.layers.69.self_attn.k_proj: 0%| | 163/36566 [00:01<04:32, 133.49it/s] packing model.layers.70.self_attn.k_proj: 0%| | 164/36566 [00:01<04:32, 133.49it/s] packing model.layers.71.self_attn.k_proj: 0%| | 165/36566 [00:01<04:32, 133.49it/s] packing model.layers.72.self_attn.k_proj: 0%| | 166/36566 [00:01<04:32, 133.49it/s] packing model.layers.73.self_attn.k_proj: 0%| | 167/36566 [00:01<04:32, 133.49it/s] packing model.layers.74.self_attn.k_proj: 0%| | 168/36566 [00:01<04:32, 133.49it/s] packing model.layers.75.self_attn.k_proj: 0%| | 169/36566 [00:01<04:32, 133.49it/s] packing model.layers.76.self_attn.k_proj: 0%| | 170/36566 [00:01<04:32, 133.49it/s] packing model.layers.77.self_attn.k_proj: 0%| | 171/36566 [00:01<04:32, 133.49it/s] packing model.layers.78.self_attn.k_proj: 0%| | 172/36566 [00:01<04:32, 133.49it/s] packing model.layers.79.self_attn.k_proj: 0%| | 173/36566 [00:01<04:32, 133.49it/s] packing model.layers.80.self_attn.k_proj: 0%| | 174/36566 [00:01<04:32, 133.49it/s] packing model.layers.81.self_attn.k_proj: 0%| | 175/36566 [00:01<04:32, 133.49it/s] packing model.layers.82.self_attn.k_proj: 0%| | 176/36566 [00:01<04:32, 133.49it/s] packing model.layers.83.self_attn.k_proj: 0%| | 177/36566 [00:01<04:32, 133.49it/s] packing model.layers.84.self_attn.k_proj: 0%| | 178/36566 [00:01<04:32, 133.49it/s] packing model.layers.85.self_attn.k_proj: 0%| | 179/36566 [00:01<04:32, 133.49it/s] packing model.layers.86.self_attn.k_proj: 0%| | 180/36566 [00:01<04:32, 133.49it/s] packing model.layers.87.self_attn.k_proj: 0%| | 181/36566 [00:01<04:32, 133.49it/s] packing model.layers.88.self_attn.k_proj: 0%| | 182/36566 [00:01<04:32, 133.49it/s] packing model.layers.89.self_attn.k_proj: 1%| | 183/36566 [00:01<04:32, 133.49it/s] packing model.layers.90.self_attn.k_proj: 1%| | 184/36566 [00:01<04:32, 133.49it/s] packing model.layers.91.self_attn.k_proj: 1%| | 185/36566 [00:01<04:32, 133.49it/s] packing model.layers.92.self_attn.k_proj: 1%| | 186/36566 [00:01<04:32, 133.49it/s] packing model.layers.93.self_attn.k_proj: 1%| | 187/36566 [00:01<04:32, 133.49it/s] packing model.layers.0.self_attn.o_proj: 1%| | 188/36566 [00:01<04:32, 133.49it/s] packing model.layers.1.self_attn.o_proj: 1%| | 189/36566 [00:01<04:32, 133.49it/s] packing model.layers.2.self_attn.o_proj: 1%| | 190/36566 [00:01<04:32, 133.49it/s] packing model.layers.3.self_attn.o_proj: 1%| | 191/36566 [00:01<04:32, 133.49it/s] packing model.layers.4.self_attn.o_proj: 1%| | 192/36566 [00:01<04:32, 133.49it/s] packing model.layers.5.self_attn.o_proj: 1%| | 193/36566 [00:01<04:32, 133.49it/s] packing model.layers.6.self_attn.o_proj: 1%| | 194/36566 [00:01<04:32, 133.49it/s] packing model.layers.7.self_attn.o_proj: 1%| | 195/36566 [00:01<04:32, 133.49it/s] packing model.layers.8.self_attn.o_proj: 1%| | 196/36566 [00:01<04:32, 133.49it/s] packing model.layers.9.self_attn.o_proj: 1%| | 197/36566 [00:01<04:32, 133.49it/s] packing model.layers.10.self_attn.o_proj: 1%| | 198/36566 [00:01<04:32, 133.49it/s] packing model.layers.11.self_attn.o_proj: 1%| | 199/36566 [00:01<04:32, 133.49it/s] packing model.layers.12.self_attn.o_proj: 1%| | 200/36566 [00:01<04:32, 133.49it/s] packing model.layers.13.self_attn.o_proj: 1%| | 201/36566 [00:01<04:32, 133.49it/s] packing model.layers.14.self_attn.o_proj: 1%| | 202/36566 [00:01<04:32, 133.49it/s] packing model.layers.15.self_attn.o_proj: 1%| | 203/36566 [00:01<04:32, 133.49it/s] packing model.layers.16.self_attn.o_proj: 1%| | 204/36566 [00:01<04:32, 133.49it/s] packing model.layers.17.self_attn.o_proj: 1%| | 205/36566 [00:01<04:32, 133.49it/s] packing model.layers.18.self_attn.o_proj: 1%| | 206/36566 [00:01<04:32, 133.49it/s] packing model.layers.19.self_attn.o_proj: 1%| | 207/36566 [00:01<04:32, 133.49it/s] packing model.layers.20.self_attn.o_proj: 1%| | 208/36566 [00:01<04:32, 133.49it/s] packing model.layers.21.self_attn.o_proj: 1%| | 209/36566 [00:01<04:32, 133.49it/s] packing model.layers.22.self_attn.o_proj: 1%| | 210/36566 [00:01<04:32, 133.49it/s] packing model.layers.23.self_attn.o_proj: 1%| | 211/36566 [00:01<04:32, 133.49it/s] packing model.layers.24.self_attn.o_proj: 1%| | 212/36566 [00:01<04:32, 133.49it/s] packing model.layers.25.self_attn.o_proj: 1%| | 213/36566 [00:01<04:32, 133.49it/s] packing model.layers.26.self_attn.o_proj: 1%| | 214/36566 [00:01<04:32, 133.49it/s] packing model.layers.27.self_attn.o_proj: 1%| | 215/36566 [00:01<04:32, 133.49it/s] packing model.layers.28.self_attn.o_proj: 1%| | 216/36566 [00:01<04:32, 133.49it/s] packing model.layers.29.self_attn.o_proj: 1%| | 217/36566 [00:01<04:32, 133.49it/s] packing model.layers.30.self_attn.o_proj: 1%| | 218/36566 [00:01<04:32, 133.49it/s] packing model.layers.31.self_attn.o_proj: 1%| | 219/36566 [00:01<04:32, 133.49it/s] packing model.layers.32.self_attn.o_proj: 1%| | 220/36566 [00:01<04:32, 133.49it/s] packing model.layers.33.self_attn.o_proj: 1%| | 221/36566 [00:01<04:32, 133.49it/s] packing model.layers.34.self_attn.o_proj: 1%| | 222/36566 [00:01<04:32, 133.49it/s] packing model.layers.35.self_attn.o_proj: 1%| | 223/36566 [00:01<04:32, 133.49it/s] packing model.layers.36.self_attn.o_proj: 1%| | 224/36566 [00:01<04:32, 133.49it/s] packing model.layers.37.self_attn.o_proj: 1%| | 225/36566 [00:01<04:32, 133.49it/s] packing model.layers.38.self_attn.o_proj: 1%| | 226/36566 [00:01<04:32, 133.49it/s] packing model.layers.39.self_attn.o_proj: 1%| | 227/36566 [00:01<04:32, 133.49it/s] packing model.layers.40.self_attn.o_proj: 1%| | 228/36566 [00:01<04:32, 133.49it/s] packing model.layers.41.self_attn.o_proj: 1%| | 229/36566 [00:01<04:32, 133.49it/s] packing model.layers.42.self_attn.o_proj: 1%| | 230/36566 [00:01<04:32, 133.49it/s] packing model.layers.43.self_attn.o_proj: 1%| | 231/36566 [00:01<04:32, 133.49it/s] packing model.layers.43.self_attn.o_proj: 1%| | 232/36566 [00:01<02:09, 281.11it/s] packing model.layers.44.self_attn.o_proj: 1%| | 232/36566 [00:01<02:09, 281.11it/s] packing model.layers.45.self_attn.o_proj: 1%| | 233/36566 [00:01<02:09, 281.11it/s] packing model.layers.46.self_attn.o_proj: 1%| | 234/36566 [00:01<02:09, 281.11it/s] packing model.layers.47.self_attn.o_proj: 1%| | 235/36566 [00:01<02:09, 281.11it/s] packing model.layers.48.self_attn.o_proj: 1%| | 236/36566 [00:01<02:09, 281.11it/s] packing model.layers.49.self_attn.o_proj: 1%| | 237/36566 [00:01<02:09, 281.11it/s] packing model.layers.50.self_attn.o_proj: 1%| | 238/36566 [00:01<02:09, 281.11it/s] packing model.layers.51.self_attn.o_proj: 1%| | 239/36566 [00:01<02:09, 281.11it/s] packing model.layers.52.self_attn.o_proj: 1%| | 240/36566 [00:01<02:09, 281.11it/s] packing model.layers.53.self_attn.o_proj: 1%| | 241/36566 [00:01<02:09, 281.11it/s] packing model.layers.54.self_attn.o_proj: 1%| | 242/36566 [00:01<02:09, 281.11it/s] packing model.layers.55.self_attn.o_proj: 1%| | 243/36566 [00:01<02:09, 281.11it/s] packing model.layers.56.self_attn.o_proj: 1%| | 244/36566 [00:01<02:09, 281.11it/s] packing model.layers.57.self_attn.o_proj: 1%| | 245/36566 [00:01<02:09, 281.11it/s] packing model.layers.58.self_attn.o_proj: 1%| | 246/36566 [00:01<02:09, 281.11it/s] packing model.layers.59.self_attn.o_proj: 1%| | 247/36566 [00:01<02:09, 281.11it/s] packing model.layers.60.self_attn.o_proj: 1%| | 248/36566 [00:01<02:09, 281.11it/s] packing model.layers.61.self_attn.o_proj: 1%| | 249/36566 [00:01<02:09, 281.11it/s] packing model.layers.62.self_attn.o_proj: 1%| | 250/36566 [00:01<02:09, 281.11it/s] packing model.layers.63.self_attn.o_proj: 1%| | 251/36566 [00:01<02:09, 281.11it/s] packing model.layers.64.self_attn.o_proj: 1%| | 252/36566 [00:01<02:09, 281.11it/s] packing model.layers.65.self_attn.o_proj: 1%| | 253/36566 [00:01<02:09, 281.11it/s] packing model.layers.66.self_attn.o_proj: 1%| | 254/36566 [00:01<02:09, 281.11it/s] packing model.layers.67.self_attn.o_proj: 1%| | 255/36566 [00:01<02:09, 281.11it/s] packing model.layers.68.self_attn.o_proj: 1%| | 256/36566 [00:01<02:09, 281.11it/s] packing model.layers.69.self_attn.o_proj: 1%| | 257/36566 [00:01<02:09, 281.11it/s] packing model.layers.70.self_attn.o_proj: 1%| | 258/36566 [00:01<02:09, 281.11it/s] packing model.layers.71.self_attn.o_proj: 1%| | 259/36566 [00:01<02:09, 281.11it/s] packing model.layers.72.self_attn.o_proj: 1%| | 260/36566 [00:01<02:09, 281.11it/s] packing model.layers.73.self_attn.o_proj: 1%| | 261/36566 [00:01<02:09, 281.11it/s] packing model.layers.74.self_attn.o_proj: 1%| | 262/36566 [00:01<02:09, 281.11it/s] packing model.layers.75.self_attn.o_proj: 1%| | 263/36566 [00:01<02:09, 281.11it/s] packing model.layers.76.self_attn.o_proj: 1%| | 264/36566 [00:01<02:09, 281.11it/s] packing model.layers.77.self_attn.o_proj: 1%| | 265/36566 [00:01<02:09, 281.11it/s] packing model.layers.78.self_attn.o_proj: 1%| | 266/36566 [00:01<02:09, 281.11it/s] packing model.layers.79.self_attn.o_proj: 1%| | 267/36566 [00:01<02:09, 281.11it/s] packing model.layers.80.self_attn.o_proj: 1%| | 268/36566 [00:01<02:09, 281.11it/s] packing model.layers.81.self_attn.o_proj: 1%| | 269/36566 [00:01<02:09, 281.11it/s] packing model.layers.82.self_attn.o_proj: 1%| | 270/36566 [00:01<02:09, 281.11it/s] packing model.layers.83.self_attn.o_proj: 1%| | 271/36566 [00:01<02:09, 281.11it/s] packing model.layers.84.self_attn.o_proj: 1%| | 272/36566 [00:01<02:09, 281.11it/s] packing model.layers.85.self_attn.o_proj: 1%| | 273/36566 [00:01<02:09, 281.11it/s] packing model.layers.86.self_attn.o_proj: 1%| | 274/36566 [00:01<02:09, 281.11it/s] packing model.layers.87.self_attn.o_proj: 1%| | 275/36566 [00:01<02:09, 281.11it/s] packing model.layers.88.self_attn.o_proj: 1%| | 276/36566 [00:01<02:09, 281.11it/s] packing model.layers.89.self_attn.o_proj: 1%| | 277/36566 [00:01<02:09, 281.11it/s] packing model.layers.90.self_attn.o_proj: 1%| | 278/36566 [00:01<02:09, 281.11it/s] packing model.layers.91.self_attn.o_proj: 1%| | 279/36566 [00:01<02:09, 281.11it/s] packing model.layers.92.self_attn.o_proj: 1%| | 280/36566 [00:01<02:09, 281.11it/s] packing model.layers.93.self_attn.o_proj: 1%| | 281/36566 [00:01<02:09, 281.11it/s] packing model.layers.0.self_attn.q_proj: 1%| | 282/36566 [00:01<02:09, 281.11it/s] packing model.layers.1.self_attn.q_proj: 1%| | 283/36566 [00:01<02:09, 281.11it/s] packing model.layers.2.self_attn.q_proj: 1%| | 284/36566 [00:01<02:09, 281.11it/s] packing model.layers.3.self_attn.q_proj: 1%| | 285/36566 [00:01<02:09, 281.11it/s] packing model.layers.4.self_attn.q_proj: 1%| | 286/36566 [00:01<02:09, 281.11it/s] packing model.layers.5.self_attn.q_proj: 1%| | 287/36566 [00:01<02:09, 281.11it/s] packing model.layers.6.self_attn.q_proj: 1%| | 288/36566 [00:01<02:09, 281.11it/s] packing model.layers.7.self_attn.q_proj: 1%| | 289/36566 [00:01<02:09, 281.11it/s] packing model.layers.8.self_attn.q_proj: 1%| | 290/36566 [00:01<02:09, 281.11it/s] packing model.layers.9.self_attn.q_proj: 1%| | 291/36566 [00:01<02:09, 281.11it/s] packing model.layers.10.self_attn.q_proj: 1%| | 292/36566 [00:01<02:09, 281.11it/s] packing model.layers.11.self_attn.q_proj: 1%| | 293/36566 [00:01<02:09, 281.11it/s] packing model.layers.12.self_attn.q_proj: 1%| | 294/36566 [00:01<02:09, 281.11it/s] packing model.layers.13.self_attn.q_proj: 1%| | 295/36566 [00:01<02:09, 281.11it/s] packing model.layers.14.self_attn.q_proj: 1%| | 296/36566 [00:01<02:09, 281.11it/s] packing model.layers.15.self_attn.q_proj: 1%| | 297/36566 [00:01<02:09, 281.11it/s] packing model.layers.16.self_attn.q_proj: 1%| | 298/36566 [00:01<02:09, 281.11it/s] packing model.layers.17.self_attn.q_proj: 1%| | 299/36566 [00:01<02:09, 281.11it/s] packing model.layers.18.self_attn.q_proj: 1%| | 300/36566 [00:01<02:09, 281.11it/s] packing model.layers.19.self_attn.q_proj: 1%| | 301/36566 [00:01<02:09, 281.11it/s] packing model.layers.20.self_attn.q_proj: 1%| | 302/36566 [00:01<02:09, 281.11it/s] packing model.layers.21.self_attn.q_proj: 1%| | 303/36566 [00:01<02:08, 281.11it/s] packing model.layers.22.self_attn.q_proj: 1%| | 304/36566 [00:01<02:08, 281.11it/s] packing model.layers.23.self_attn.q_proj: 1%| | 305/36566 [00:01<02:08, 281.11it/s] packing model.layers.24.self_attn.q_proj: 1%| | 306/36566 [00:01<02:08, 281.11it/s] packing model.layers.25.self_attn.q_proj: 1%| | 307/36566 [00:01<02:08, 281.11it/s] packing model.layers.26.self_attn.q_proj: 1%| | 308/36566 [00:01<02:08, 281.11it/s] packing model.layers.27.self_attn.q_proj: 1%| | 309/36566 [00:01<02:08, 281.11it/s] packing model.layers.28.self_attn.q_proj: 1%| | 310/36566 [00:01<02:08, 281.11it/s] packing model.layers.29.self_attn.q_proj: 1%| | 311/36566 [00:01<02:08, 281.11it/s] packing model.layers.30.self_attn.q_proj: 1%| | 312/36566 [00:01<02:08, 281.11it/s] packing model.layers.31.self_attn.q_proj: 1%| | 313/36566 [00:01<02:08, 281.11it/s] packing model.layers.32.self_attn.q_proj: 1%| | 314/36566 [00:01<02:08, 281.11it/s] packing model.layers.33.self_attn.q_proj: 1%| | 315/36566 [00:01<02:08, 281.11it/s] packing model.layers.34.self_attn.q_proj: 1%| | 316/36566 [00:01<02:08, 281.11it/s] packing model.layers.35.self_attn.q_proj: 1%| | 317/36566 [00:01<02:08, 281.11it/s] packing model.layers.36.self_attn.q_proj: 1%| | 318/36566 [00:01<02:08, 281.11it/s] packing model.layers.37.self_attn.q_proj: 1%| | 319/36566 [00:01<02:08, 281.11it/s] packing model.layers.38.self_attn.q_proj: 1%| | 320/36566 [00:01<02:08, 281.11it/s] packing model.layers.39.self_attn.q_proj: 1%| | 321/36566 [00:01<02:08, 281.11it/s] packing model.layers.40.self_attn.q_proj: 1%| | 322/36566 [00:01<02:08, 281.11it/s] packing model.layers.41.self_attn.q_proj: 1%| | 323/36566 [00:01<02:08, 281.11it/s] packing model.layers.42.self_attn.q_proj: 1%| | 324/36566 [00:01<02:08, 281.11it/s] packing model.layers.43.self_attn.q_proj: 1%| | 325/36566 [00:01<02:08, 281.11it/s] packing model.layers.44.self_attn.q_proj: 1%| | 326/36566 [00:01<02:08, 281.11it/s] packing model.layers.45.self_attn.q_proj: 1%| | 327/36566 [00:01<02:08, 281.11it/s] packing model.layers.46.self_attn.q_proj: 1%| | 328/36566 [00:01<02:08, 281.11it/s] packing model.layers.47.self_attn.q_proj: 1%| | 329/36566 [00:01<02:08, 281.11it/s] packing model.layers.48.self_attn.q_proj: 1%| | 330/36566 [00:01<02:08, 281.11it/s] packing model.layers.49.self_attn.q_proj: 1%| | 331/36566 [00:01<02:08, 281.11it/s] packing model.layers.50.self_attn.q_proj: 1%| | 332/36566 [00:01<02:08, 281.11it/s] packing model.layers.51.self_attn.q_proj: 1%| | 333/36566 [00:01<02:08, 281.11it/s] packing model.layers.52.self_attn.q_proj: 1%| | 334/36566 [00:01<02:08, 281.11it/s] packing model.layers.53.self_attn.q_proj: 1%| | 335/36566 [00:01<02:08, 281.11it/s] packing model.layers.54.self_attn.q_proj: 1%| | 336/36566 [00:01<02:08, 281.11it/s] packing model.layers.55.self_attn.q_proj: 1%| | 337/36566 [00:01<02:08, 281.11it/s] packing model.layers.56.self_attn.q_proj: 1%| | 338/36566 [00:01<02:08, 281.11it/s] packing model.layers.57.self_attn.q_proj: 1%| | 339/36566 [00:01<02:08, 281.11it/s] packing model.layers.58.self_attn.q_proj: 1%| | 340/36566 [00:01<02:08, 281.11it/s] packing model.layers.59.self_attn.q_proj: 1%| | 341/36566 [00:01<02:08, 281.11it/s] packing model.layers.60.self_attn.q_proj: 1%| | 342/36566 [00:01<02:08, 281.11it/s] packing model.layers.61.self_attn.q_proj: 1%| | 343/36566 [00:01<02:08, 281.11it/s] packing model.layers.62.self_attn.q_proj: 1%| | 344/36566 [00:01<02:08, 281.11it/s] packing model.layers.63.self_attn.q_proj: 1%| | 345/36566 [00:01<02:08, 281.11it/s] packing model.layers.64.self_attn.q_proj: 1%| | 346/36566 [00:01<02:08, 281.11it/s] packing model.layers.65.self_attn.q_proj: 1%| | 347/36566 [00:01<02:08, 281.11it/s] packing model.layers.66.self_attn.q_proj: 1%| | 348/36566 [00:01<02:08, 281.11it/s] packing model.layers.66.self_attn.q_proj: 1%| | 349/36566 [00:01<01:24, 431.10it/s] packing model.layers.67.self_attn.q_proj: 1%| | 349/36566 [00:01<01:24, 431.10it/s] packing model.layers.68.self_attn.q_proj: 1%| | 350/36566 [00:01<01:24, 431.10it/s] packing model.layers.69.self_attn.q_proj: 1%| | 351/36566 [00:01<01:24, 431.10it/s] packing model.layers.70.self_attn.q_proj: 1%| | 352/36566 [00:01<01:24, 431.10it/s] packing model.layers.71.self_attn.q_proj: 1%| | 353/36566 [00:01<01:24, 431.10it/s] packing model.layers.72.self_attn.q_proj: 1%| | 354/36566 [00:01<01:23, 431.10it/s] packing model.layers.73.self_attn.q_proj: 1%| | 355/36566 [00:01<01:23, 431.10it/s] packing model.layers.74.self_attn.q_proj: 1%| | 356/36566 [00:01<01:23, 431.10it/s] packing model.layers.75.self_attn.q_proj: 1%| | 357/36566 [00:01<01:23, 431.10it/s] packing model.layers.76.self_attn.q_proj: 1%| | 358/36566 [00:01<01:23, 431.10it/s] packing model.layers.77.self_attn.q_proj: 1%| | 359/36566 [00:01<01:23, 431.10it/s] packing model.layers.78.self_attn.q_proj: 1%| | 360/36566 [00:01<01:23, 431.10it/s] packing model.layers.79.self_attn.q_proj: 1%| | 361/36566 [00:01<01:23, 431.10it/s] packing model.layers.80.self_attn.q_proj: 1%| | 362/36566 [00:01<01:23, 431.10it/s] packing model.layers.81.self_attn.q_proj: 1%| | 363/36566 [00:01<01:23, 431.10it/s] packing model.layers.82.self_attn.q_proj: 1%| | 364/36566 [00:01<01:23, 431.10it/s] packing model.layers.83.self_attn.q_proj: 1%| | 365/36566 [00:01<01:23, 431.10it/s] packing model.layers.84.self_attn.q_proj: 1%| | 366/36566 [00:01<01:23, 431.10it/s] packing model.layers.85.self_attn.q_proj: 1%| | 367/36566 [00:01<01:23, 431.10it/s] packing model.layers.86.self_attn.q_proj: 1%| | 368/36566 [00:01<01:23, 431.10it/s] packing model.layers.87.self_attn.q_proj: 1%| | 369/36566 [00:01<01:23, 431.10it/s] packing model.layers.88.self_attn.q_proj: 1%| | 370/36566 [00:01<01:23, 431.10it/s] packing model.layers.89.self_attn.q_proj: 1%| | 371/36566 [00:01<01:23, 431.10it/s] packing model.layers.90.self_attn.q_proj: 1%| | 372/36566 [00:01<01:23, 431.10it/s] packing model.layers.91.self_attn.q_proj: 1%| | 373/36566 [00:01<01:23, 431.10it/s] packing model.layers.92.self_attn.q_proj: 1%| | 374/36566 [00:01<01:23, 431.10it/s] packing model.layers.93.self_attn.q_proj: 1%| | 375/36566 [00:01<01:23, 431.10it/s] packing model.layers.0.self_attn.v_proj: 1%| | 376/36566 [00:01<01:23, 431.10it/s] packing model.layers.1.self_attn.v_proj: 1%| | 377/36566 [00:01<01:23, 431.10it/s] packing model.layers.2.self_attn.v_proj: 1%| | 378/36566 [00:01<01:23, 431.10it/s] packing model.layers.3.self_attn.v_proj: 1%| | 379/36566 [00:01<01:23, 431.10it/s] packing model.layers.4.self_attn.v_proj: 1%| | 380/36566 [00:01<01:23, 431.10it/s] packing model.layers.5.self_attn.v_proj: 1%| | 381/36566 [00:01<01:23, 431.10it/s] packing model.layers.6.self_attn.v_proj: 1%| | 382/36566 [00:01<01:23, 431.10it/s] packing model.layers.7.self_attn.v_proj: 1%| | 383/36566 [00:01<01:23, 431.10it/s] packing model.layers.8.self_attn.v_proj: 1%| | 384/36566 [00:01<01:23, 431.10it/s] packing model.layers.9.self_attn.v_proj: 1%| | 385/36566 [00:01<01:23, 431.10it/s] packing model.layers.10.self_attn.v_proj: 1%| | 386/36566 [00:01<01:23, 431.10it/s] packing model.layers.11.self_attn.v_proj: 1%| | 387/36566 [00:01<01:23, 431.10it/s] packing model.layers.12.self_attn.v_proj: 1%| | 388/36566 [00:01<01:23, 431.10it/s] packing model.layers.13.self_attn.v_proj: 1%| | 389/36566 [00:01<01:23, 431.10it/s] packing model.layers.14.self_attn.v_proj: 1%| | 390/36566 [00:01<01:23, 431.10it/s] packing model.layers.15.self_attn.v_proj: 1%| | 391/36566 [00:01<01:23, 431.10it/s] packing model.layers.16.self_attn.v_proj: 1%| | 392/36566 [00:01<01:23, 431.10it/s] packing model.layers.17.self_attn.v_proj: 1%| | 393/36566 [00:01<01:23, 431.10it/s] packing model.layers.18.self_attn.v_proj: 1%| | 394/36566 [00:01<01:23, 431.10it/s] packing model.layers.19.self_attn.v_proj: 1%| | 395/36566 [00:01<01:23, 431.10it/s] packing model.layers.20.self_attn.v_proj: 1%| | 396/36566 [00:01<01:23, 431.10it/s] packing model.layers.21.self_attn.v_proj: 1%| | 397/36566 [00:01<01:23, 431.10it/s] packing model.layers.22.self_attn.v_proj: 1%| | 398/36566 [00:01<01:23, 431.10it/s] packing model.layers.23.self_attn.v_proj: 1%| | 399/36566 [00:01<01:23, 431.10it/s] packing model.layers.24.self_attn.v_proj: 1%| | 400/36566 [00:01<01:23, 431.10it/s] packing model.layers.25.self_attn.v_proj: 1%| | 401/36566 [00:01<01:23, 431.10it/s] packing model.layers.26.self_attn.v_proj: 1%| | 402/36566 [00:01<01:23, 431.10it/s] packing model.layers.27.self_attn.v_proj: 1%| | 403/36566 [00:01<01:23, 431.10it/s] packing model.layers.28.self_attn.v_proj: 1%| | 404/36566 [00:01<01:23, 431.10it/s] packing model.layers.29.self_attn.v_proj: 1%| | 405/36566 [00:01<01:23, 431.10it/s] packing model.layers.30.self_attn.v_proj: 1%| | 406/36566 [00:01<01:23, 431.10it/s] packing model.layers.31.self_attn.v_proj: 1%| | 407/36566 [00:01<01:23, 431.10it/s] packing model.layers.32.self_attn.v_proj: 1%| | 408/36566 [00:01<01:23, 431.10it/s] packing model.layers.33.self_attn.v_proj: 1%| | 409/36566 [00:01<01:23, 431.10it/s] packing model.layers.34.self_attn.v_proj: 1%| | 410/36566 [00:01<01:23, 431.10it/s] packing model.layers.35.self_attn.v_proj: 1%| | 411/36566 [00:01<01:23, 431.10it/s] packing model.layers.36.self_attn.v_proj: 1%| | 412/36566 [00:01<01:23, 431.10it/s] packing model.layers.37.self_attn.v_proj: 1%| | 413/36566 [00:01<01:23, 431.10it/s] packing model.layers.38.self_attn.v_proj: 1%| | 414/36566 [00:01<01:23, 431.10it/s] packing model.layers.39.self_attn.v_proj: 1%| | 415/36566 [00:01<01:23, 431.10it/s] packing model.layers.40.self_attn.v_proj: 1%| | 416/36566 [00:01<01:23, 431.10it/s] packing model.layers.41.self_attn.v_proj: 1%| | 417/36566 [00:01<01:23, 431.10it/s] packing model.layers.42.self_attn.v_proj: 1%| | 418/36566 [00:01<01:23, 431.10it/s] packing model.layers.43.self_attn.v_proj: 1%| | 419/36566 [00:01<01:23, 431.10it/s] packing model.layers.44.self_attn.v_proj: 1%| | 420/36566 [00:01<01:23, 431.10it/s] packing model.layers.45.self_attn.v_proj: 1%| | 421/36566 [00:01<01:23, 431.10it/s] packing model.layers.46.self_attn.v_proj: 1%| | 422/36566 [00:01<01:23, 431.10it/s] packing model.layers.47.self_attn.v_proj: 1%| | 423/36566 [00:01<01:23, 431.10it/s] packing model.layers.48.self_attn.v_proj: 1%| | 424/36566 [00:01<01:23, 431.10it/s] packing model.layers.49.self_attn.v_proj: 1%| | 425/36566 [00:01<01:23, 431.10it/s] packing model.layers.50.self_attn.v_proj: 1%| | 426/36566 [00:01<01:23, 431.10it/s] packing model.layers.51.self_attn.v_proj: 1%| | 427/36566 [00:01<01:23, 431.10it/s] packing model.layers.52.self_attn.v_proj: 1%| | 428/36566 [00:01<01:23, 431.10it/s] packing model.layers.53.self_attn.v_proj: 1%| | 429/36566 [00:01<01:23, 431.10it/s] packing model.layers.54.self_attn.v_proj: 1%| | 430/36566 [00:01<01:23, 431.10it/s] packing model.layers.55.self_attn.v_proj: 1%| | 431/36566 [00:01<01:23, 431.10it/s] packing model.layers.56.self_attn.v_proj: 1%| | 432/36566 [00:01<01:23, 431.10it/s] packing model.layers.57.self_attn.v_proj: 1%| | 433/36566 [00:01<01:23, 431.10it/s] packing model.layers.58.self_attn.v_proj: 1%| | 434/36566 [00:01<01:23, 431.10it/s] packing model.layers.59.self_attn.v_proj: 1%| | 435/36566 [00:01<01:23, 431.10it/s] packing model.layers.60.self_attn.v_proj: 1%| | 436/36566 [00:01<01:23, 431.10it/s] packing model.layers.61.self_attn.v_proj: 1%| | 437/36566 [00:01<01:23, 431.10it/s] packing model.layers.62.self_attn.v_proj: 1%| | 438/36566 [00:01<01:23, 431.10it/s] packing model.layers.63.self_attn.v_proj: 1%| | 439/36566 [00:01<01:23, 431.10it/s] packing model.layers.64.self_attn.v_proj: 1%| | 440/36566 [00:01<01:23, 431.10it/s] packing model.layers.65.self_attn.v_proj: 1%| | 441/36566 [00:01<01:23, 431.10it/s] packing model.layers.66.self_attn.v_proj: 1%| | 442/36566 [00:01<01:23, 431.10it/s] packing model.layers.67.self_attn.v_proj: 1%| | 443/36566 [00:01<01:23, 431.10it/s] packing model.layers.68.self_attn.v_proj: 1%| | 444/36566 [00:01<01:23, 431.10it/s] packing model.layers.69.self_attn.v_proj: 1%| | 445/36566 [00:01<01:23, 431.10it/s] packing model.layers.70.self_attn.v_proj: 1%| | 446/36566 [00:01<01:23, 431.10it/s] packing model.layers.71.self_attn.v_proj: 1%| | 447/36566 [00:01<01:23, 431.10it/s] packing model.layers.72.self_attn.v_proj: 1%| | 448/36566 [00:01<01:23, 431.10it/s] packing model.layers.73.self_attn.v_proj: 1%| | 449/36566 [00:01<01:23, 431.10it/s] packing model.layers.74.self_attn.v_proj: 1%| | 450/36566 [00:01<01:23, 431.10it/s] packing model.layers.75.self_attn.v_proj: 1%| | 451/36566 [00:01<01:23, 431.10it/s] packing model.layers.76.self_attn.v_proj: 1%| | 452/36566 [00:01<01:23, 431.10it/s] packing model.layers.77.self_attn.v_proj: 1%| | 453/36566 [00:01<01:23, 431.10it/s] packing model.layers.78.self_attn.v_proj: 1%| | 454/36566 [00:01<01:23, 431.10it/s] packing model.layers.79.self_attn.v_proj: 1%| | 455/36566 [00:01<01:23, 431.10it/s] packing model.layers.80.self_attn.v_proj: 1%| | 456/36566 [00:01<01:23, 431.10it/s] packing model.layers.81.self_attn.v_proj: 1%| | 457/36566 [00:01<01:23, 431.10it/s] packing model.layers.82.self_attn.v_proj: 1%|▏ | 458/36566 [00:01<01:23, 431.10it/s] packing model.layers.83.self_attn.v_proj: 1%|▏ | 459/36566 [00:01<01:23, 431.10it/s] packing model.layers.84.self_attn.v_proj: 1%|▏ | 460/36566 [00:01<01:23, 431.10it/s] packing model.layers.85.self_attn.v_proj: 1%|▏ | 461/36566 [00:01<01:23, 431.10it/s] packing model.layers.86.self_attn.v_proj: 1%|▏ | 462/36566 [00:01<01:23, 431.10it/s] packing model.layers.87.self_attn.v_proj: 1%|▏ | 463/36566 [00:01<01:23, 431.10it/s] packing model.layers.88.self_attn.v_proj: 1%|▏ | 464/36566 [00:01<01:23, 431.10it/s] packing model.layers.89.self_attn.v_proj: 1%|▏ | 465/36566 [00:01<01:23, 431.10it/s] packing model.layers.89.self_attn.v_proj: 1%|▏ | 466/36566 [00:01<01:02, 573.88it/s] packing model.layers.90.self_attn.v_proj: 1%|▏ | 466/36566 [00:01<01:02, 573.88it/s] packing model.layers.91.self_attn.v_proj: 1%|▏ | 467/36566 [00:01<01:02, 573.88it/s] packing model.layers.92.self_attn.v_proj: 1%|▏ | 468/36566 [00:01<01:02, 573.88it/s] packing model.layers.93.self_attn.v_proj: 1%|▏ | 469/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.0.gate_proj: 1%|▏ | 470/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.0.up_proj: 1%|▏ | 471/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.0.down_proj: 1%|▏ | 472/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.1.gate_proj: 1%|▏ | 473/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.1.up_proj: 1%|▏ | 474/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.1.down_proj: 1%|▏ | 475/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.2.gate_proj: 1%|▏ | 476/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.2.up_proj: 1%|▏ | 477/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.2.down_proj: 1%|▏ | 478/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.3.gate_proj: 1%|▏ | 479/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.3.up_proj: 1%|▏ | 480/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.3.down_proj: 1%|▏ | 481/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.4.gate_proj: 1%|▏ | 482/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.4.up_proj: 1%|▏ | 483/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.4.down_proj: 1%|▏ | 484/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.5.gate_proj: 1%|▏ | 485/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.5.up_proj: 1%|▏ | 486/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.5.down_proj: 1%|▏ | 487/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.6.gate_proj: 1%|▏ | 488/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.6.up_proj: 1%|▏ | 489/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.6.down_proj: 1%|▏ | 490/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.7.gate_proj: 1%|▏ | 491/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.7.up_proj: 1%|▏ | 492/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.7.down_proj: 1%|▏ | 493/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.8.gate_proj: 1%|▏ | 494/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.8.up_proj: 1%|▏ | 495/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.8.down_proj: 1%|▏ | 496/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.9.gate_proj: 1%|▏ | 497/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.9.up_proj: 1%|▏ | 498/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.9.down_proj: 1%|▏ | 499/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.10.gate_proj: 1%|▏ | 500/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.10.up_proj: 1%|▏ | 501/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.10.down_proj: 1%|▏ | 502/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.11.gate_proj: 1%|▏ | 503/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.11.up_proj: 1%|▏ | 504/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.11.down_proj: 1%|▏ | 505/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.12.gate_proj: 1%|▏ | 506/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.12.up_proj: 1%|▏ | 507/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.12.down_proj: 1%|▏ | 508/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.13.gate_proj: 1%|▏ | 509/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.13.up_proj: 1%|▏ | 510/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.13.down_proj: 1%|▏ | 511/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.14.gate_proj: 1%|▏ | 512/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.14.up_proj: 1%|▏ | 513/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.14.down_proj: 1%|▏ | 514/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.15.gate_proj: 1%|▏ | 515/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.15.up_proj: 1%|▏ | 516/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.15.down_proj: 1%|▏ | 517/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.16.gate_proj: 1%|▏ | 518/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.16.up_proj: 1%|▏ | 519/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.16.down_proj: 1%|▏ | 520/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.17.gate_proj: 1%|▏ | 521/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.17.up_proj: 1%|▏ | 522/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.17.down_proj: 1%|▏ | 523/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.18.gate_proj: 1%|▏ | 524/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.18.up_proj: 1%|▏ | 525/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.18.down_proj: 1%|▏ | 526/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.19.gate_proj: 1%|▏ | 527/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.19.up_proj: 1%|▏ | 528/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.19.down_proj: 1%|▏ | 529/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.20.gate_proj: 1%|▏ | 530/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.20.up_proj: 1%|▏ | 531/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.20.down_proj: 1%|▏ | 532/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.21.gate_proj: 1%|▏ | 533/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.21.up_proj: 1%|▏ | 534/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.21.down_proj: 1%|▏ | 535/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.22.gate_proj: 1%|▏ | 536/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.22.up_proj: 1%|▏ | 537/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.22.down_proj: 1%|▏ | 538/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.23.gate_proj: 1%|▏ | 539/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.23.up_proj: 1%|▏ | 540/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.23.down_proj: 1%|▏ | 541/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.24.gate_proj: 1%|▏ | 542/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.24.up_proj: 1%|▏ | 543/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.24.down_proj: 1%|▏ | 544/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.25.gate_proj: 1%|▏ | 545/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.25.up_proj: 1%|▏ | 546/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.25.down_proj: 1%|▏ | 547/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.26.gate_proj: 1%|▏ | 548/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.26.up_proj: 2%|▏ | 549/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.26.down_proj: 2%|▏ | 550/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.27.gate_proj: 2%|▏ | 551/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.27.up_proj: 2%|▏ | 552/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.27.down_proj: 2%|▏ | 553/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.28.gate_proj: 2%|▏ | 554/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.28.up_proj: 2%|▏ | 555/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.28.down_proj: 2%|▏ | 556/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.29.gate_proj: 2%|▏ | 557/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.29.up_proj: 2%|▏ | 558/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.29.down_proj: 2%|▏ | 559/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.30.gate_proj: 2%|▏ | 560/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.30.up_proj: 2%|▏ | 561/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.30.down_proj: 2%|▏ | 562/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.31.gate_proj: 2%|▏ | 563/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.31.up_proj: 2%|▏ | 564/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.31.down_proj: 2%|▏ | 565/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.32.gate_proj: 2%|▏ | 566/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.32.up_proj: 2%|▏ | 567/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.32.down_proj: 2%|▏ | 568/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.33.gate_proj: 2%|▏ | 569/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.33.up_proj: 2%|▏ | 570/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.33.down_proj: 2%|▏ | 571/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.34.gate_proj: 2%|▏ | 572/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.34.up_proj: 2%|▏ | 573/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.34.down_proj: 2%|▏ | 574/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.35.gate_proj: 2%|▏ | 575/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.35.up_proj: 2%|▏ | 576/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.35.down_proj: 2%|▏ | 577/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.36.gate_proj: 2%|▏ | 578/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.36.up_proj: 2%|▏ | 579/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.36.down_proj: 2%|▏ | 580/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.37.gate_proj: 2%|▏ | 581/36566 [00:01<01:02, 573.88it/s] packing model.layers.0.mlp.experts.37.gate_proj: 2%|▏ | 582/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.37.up_proj: 2%|▏ | 582/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.37.down_proj: 2%|▏ | 583/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.38.gate_proj: 2%|▏ | 584/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.38.up_proj: 2%|▏ | 585/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.38.down_proj: 2%|▏ | 586/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.39.gate_proj: 2%|▏ | 587/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.39.up_proj: 2%|▏ | 588/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.39.down_proj: 2%|▏ | 589/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.40.gate_proj: 2%|▏ | 590/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.40.up_proj: 2%|▏ | 591/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.40.down_proj: 2%|▏ | 592/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.41.gate_proj: 2%|▏ | 593/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.41.up_proj: 2%|▏ | 594/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.41.down_proj: 2%|▏ | 595/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.42.gate_proj: 2%|▏ | 596/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.42.up_proj: 2%|▏ | 597/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.42.down_proj: 2%|▏ | 598/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.43.gate_proj: 2%|▏ | 599/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.43.up_proj: 2%|▏ | 600/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.43.down_proj: 2%|▏ | 601/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.44.gate_proj: 2%|▏ | 602/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.44.up_proj: 2%|▏ | 603/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.44.down_proj: 2%|▏ | 604/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.45.gate_proj: 2%|▏ | 605/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.45.up_proj: 2%|▏ | 606/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.45.down_proj: 2%|▏ | 607/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.46.gate_proj: 2%|▏ | 608/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.46.up_proj: 2%|▏ | 609/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.46.down_proj: 2%|▏ | 610/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.47.gate_proj: 2%|▏ | 611/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.47.up_proj: 2%|▏ | 612/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.47.down_proj: 2%|▏ | 613/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.48.gate_proj: 2%|▏ | 614/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.48.up_proj: 2%|▏ | 615/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.48.down_proj: 2%|▏ | 616/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.49.gate_proj: 2%|▏ | 617/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.49.up_proj: 2%|▏ | 618/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.49.down_proj: 2%|▏ | 619/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.50.gate_proj: 2%|▏ | 620/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.50.up_proj: 2%|▏ | 621/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.50.down_proj: 2%|▏ | 622/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.51.gate_proj: 2%|▏ | 623/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.51.up_proj: 2%|▏ | 624/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.51.down_proj: 2%|▏ | 625/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.52.gate_proj: 2%|▏ | 626/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.52.up_proj: 2%|▏ | 627/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.52.down_proj: 2%|▏ | 628/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.53.gate_proj: 2%|▏ | 629/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.53.up_proj: 2%|▏ | 630/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.53.down_proj: 2%|▏ | 631/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.54.gate_proj: 2%|▏ | 632/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.54.up_proj: 2%|▏ | 633/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.54.down_proj: 2%|▏ | 634/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.55.gate_proj: 2%|▏ | 635/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.55.up_proj: 2%|▏ | 636/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.55.down_proj: 2%|▏ | 637/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.56.gate_proj: 2%|▏ | 638/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.56.up_proj: 2%|▏ | 639/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.56.down_proj: 2%|▏ | 640/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.57.gate_proj: 2%|▏ | 641/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.57.up_proj: 2%|▏ | 642/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.57.down_proj: 2%|▏ | 643/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.58.gate_proj: 2%|▏ | 644/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.58.up_proj: 2%|▏ | 645/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.58.down_proj: 2%|▏ | 646/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.59.gate_proj: 2%|▏ | 647/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.59.up_proj: 2%|▏ | 648/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.59.down_proj: 2%|▏ | 649/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.60.gate_proj: 2%|▏ | 650/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.60.up_proj: 2%|▏ | 651/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.60.down_proj: 2%|▏ | 652/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.61.gate_proj: 2%|▏ | 653/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.61.up_proj: 2%|▏ | 654/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.61.down_proj: 2%|▏ | 655/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.62.gate_proj: 2%|▏ | 656/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.62.up_proj: 2%|▏ | 657/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.62.down_proj: 2%|▏ | 658/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.63.gate_proj: 2%|▏ | 659/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.63.up_proj: 2%|▏ | 660/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.63.down_proj: 2%|▏ | 661/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.64.gate_proj: 2%|▏ | 662/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.64.up_proj: 2%|▏ | 663/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.64.down_proj: 2%|▏ | 664/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.65.gate_proj: 2%|▏ | 665/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.65.up_proj: 2%|▏ | 666/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.65.down_proj: 2%|▏ | 667/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.66.gate_proj: 2%|▏ | 668/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.66.up_proj: 2%|▏ | 669/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.66.down_proj: 2%|▏ | 670/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.67.gate_proj: 2%|▏ | 671/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.67.up_proj: 2%|▏ | 672/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.67.down_proj: 2%|▏ | 673/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.68.gate_proj: 2%|▏ | 674/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.68.up_proj: 2%|▏ | 675/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.68.down_proj: 2%|▏ | 676/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.69.gate_proj: 2%|▏ | 677/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.69.up_proj: 2%|▏ | 678/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.69.down_proj: 2%|▏ | 679/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.70.gate_proj: 2%|▏ | 680/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.70.up_proj: 2%|▏ | 681/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.70.down_proj: 2%|▏ | 682/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.71.gate_proj: 2%|▏ | 683/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.71.up_proj: 2%|▏ | 684/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.71.down_proj: 2%|▏ | 685/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.72.gate_proj: 2%|▏ | 686/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.72.up_proj: 2%|▏ | 687/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.72.down_proj: 2%|▏ | 688/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.73.gate_proj: 2%|▏ | 689/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.73.up_proj: 2%|▏ | 690/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.73.down_proj: 2%|▏ | 691/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.74.gate_proj: 2%|▏ | 692/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.74.up_proj: 2%|▏ | 693/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.74.down_proj: 2%|▏ | 694/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.75.gate_proj: 2%|▏ | 695/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.75.up_proj: 2%|▏ | 696/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.75.down_proj: 2%|▏ | 697/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.76.gate_proj: 2%|▏ | 698/36566 [00:01<00:51, 701.13it/s] packing model.layers.0.mlp.experts.76.gate_proj: 2%|▏ | 699/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.76.up_proj: 2%|▏ | 699/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.76.down_proj: 2%|▏ | 700/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.77.gate_proj: 2%|▏ | 701/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.77.up_proj: 2%|▏ | 702/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.77.down_proj: 2%|▏ | 703/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.78.gate_proj: 2%|▏ | 704/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.78.up_proj: 2%|▏ | 705/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.78.down_proj: 2%|▏ | 706/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.79.gate_proj: 2%|▏ | 707/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.79.up_proj: 2%|▏ | 708/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.79.down_proj: 2%|▏ | 709/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.80.gate_proj: 2%|▏ | 710/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.80.up_proj: 2%|▏ | 711/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.80.down_proj: 2%|▏ | 712/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.81.gate_proj: 2%|▏ | 713/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.81.up_proj: 2%|▏ | 714/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.81.down_proj: 2%|▏ | 715/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.82.gate_proj: 2%|▏ | 716/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.82.up_proj: 2%|▏ | 717/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.82.down_proj: 2%|▏ | 718/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.83.gate_proj: 2%|▏ | 719/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.83.up_proj: 2%|▏ | 720/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.83.down_proj: 2%|▏ | 721/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.84.gate_proj: 2%|▏ | 722/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.84.up_proj: 2%|▏ | 723/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.84.down_proj: 2%|▏ | 724/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.85.gate_proj: 2%|▏ | 725/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.85.up_proj: 2%|▏ | 726/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.85.down_proj: 2%|▏ | 727/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.86.gate_proj: 2%|▏ | 728/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.86.up_proj: 2%|▏ | 729/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.86.down_proj: 2%|▏ | 730/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.87.gate_proj: 2%|▏ | 731/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.87.up_proj: 2%|▏ | 732/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.87.down_proj: 2%|▏ | 733/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.88.gate_proj: 2%|▏ | 734/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.88.up_proj: 2%|▏ | 735/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.88.down_proj: 2%|▏ | 736/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.89.gate_proj: 2%|▏ | 737/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.89.up_proj: 2%|▏ | 738/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.89.down_proj: 2%|▏ | 739/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.90.gate_proj: 2%|▏ | 740/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.90.up_proj: 2%|▏ | 741/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.90.down_proj: 2%|▏ | 742/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.91.gate_proj: 2%|▏ | 743/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.91.up_proj: 2%|▏ | 744/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.91.down_proj: 2%|▏ | 745/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.92.gate_proj: 2%|▏ | 746/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.92.up_proj: 2%|▏ | 747/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.92.down_proj: 2%|▏ | 748/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.93.gate_proj: 2%|▏ | 749/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.93.up_proj: 2%|▏ | 750/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.93.down_proj: 2%|▏ | 751/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.94.gate_proj: 2%|▏ | 752/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.94.up_proj: 2%|▏ | 753/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.94.down_proj: 2%|▏ | 754/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.95.gate_proj: 2%|▏ | 755/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.95.up_proj: 2%|▏ | 756/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.95.down_proj: 2%|▏ | 757/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.96.gate_proj: 2%|▏ | 758/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.96.up_proj: 2%|▏ | 759/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.96.down_proj: 2%|▏ | 760/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.97.gate_proj: 2%|▏ | 761/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.97.up_proj: 2%|▏ | 762/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.97.down_proj: 2%|▏ | 763/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.98.gate_proj: 2%|▏ | 764/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.98.up_proj: 2%|▏ | 765/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.98.down_proj: 2%|▏ | 766/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.99.gate_proj: 2%|▏ | 767/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.99.up_proj: 2%|▏ | 768/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.99.down_proj: 2%|▏ | 769/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.100.gate_proj: 2%|▏ | 770/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.100.up_proj: 2%|▏ | 771/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.100.down_proj: 2%|▏ | 772/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.101.gate_proj: 2%|▏ | 773/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.101.up_proj: 2%|▏ | 774/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.101.down_proj: 2%|▏ | 775/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.102.gate_proj: 2%|▏ | 776/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.102.up_proj: 2%|▏ | 777/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.102.down_proj: 2%|▏ | 778/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.103.gate_proj: 2%|▏ | 779/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.103.up_proj: 2%|▏ | 780/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.103.down_proj: 2%|▏ | 781/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.104.gate_proj: 2%|▏ | 782/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.104.up_proj: 2%|▏ | 783/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.104.down_proj: 2%|▏ | 784/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.105.gate_proj: 2%|▏ | 785/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.105.up_proj: 2%|▏ | 786/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.105.down_proj: 2%|▏ | 787/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.106.gate_proj: 2%|▏ | 788/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.106.up_proj: 2%|▏ | 789/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.106.down_proj: 2%|▏ | 790/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.107.gate_proj: 2%|▏ | 791/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.107.up_proj: 2%|▏ | 792/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.107.down_proj: 2%|▏ | 793/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.108.gate_proj: 2%|▏ | 794/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.108.up_proj: 2%|▏ | 795/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.108.down_proj: 2%|▏ | 796/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.109.gate_proj: 2%|▏ | 797/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.109.up_proj: 2%|▏ | 798/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.109.down_proj: 2%|▏ | 799/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.110.gate_proj: 2%|▏ | 800/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.110.up_proj: 2%|▏ | 801/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.110.down_proj: 2%|▏ | 802/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.111.gate_proj: 2%|▏ | 803/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.111.up_proj: 2%|▏ | 804/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.111.down_proj: 2%|▏ | 805/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.112.gate_proj: 2%|▏ | 806/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.112.up_proj: 2%|▏ | 807/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.112.down_proj: 2%|▏ | 808/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.113.gate_proj: 2%|▏ | 809/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.113.up_proj: 2%|▏ | 810/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.113.down_proj: 2%|▏ | 811/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.114.gate_proj: 2%|▏ | 812/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.114.up_proj: 2%|▏ | 813/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.114.down_proj: 2%|▏ | 814/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.115.gate_proj: 2%|▏ | 815/36566 [00:01<00:44, 811.26it/s] packing model.layers.0.mlp.experts.115.gate_proj: 2%|▏ | 816/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.115.up_proj: 2%|▏ | 816/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.115.down_proj: 2%|▏ | 817/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.116.gate_proj: 2%|▏ | 818/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.116.up_proj: 2%|▏ | 819/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.116.down_proj: 2%|▏ | 820/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.117.gate_proj: 2%|▏ | 821/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.117.up_proj: 2%|▏ | 822/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.117.down_proj: 2%|▏ | 823/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.118.gate_proj: 2%|▏ | 824/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.118.up_proj: 2%|▏ | 825/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.118.down_proj: 2%|▏ | 826/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.119.gate_proj: 2%|▏ | 827/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.119.up_proj: 2%|▏ | 828/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.119.down_proj: 2%|▏ | 829/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.120.gate_proj: 2%|▏ | 830/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.120.up_proj: 2%|▏ | 831/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.120.down_proj: 2%|▏ | 832/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.121.gate_proj: 2%|▏ | 833/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.121.up_proj: 2%|▏ | 834/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.121.down_proj: 2%|▏ | 835/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.122.gate_proj: 2%|▏ | 836/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.122.up_proj: 2%|▏ | 837/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.122.down_proj: 2%|▏ | 838/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.123.gate_proj: 2%|▏ | 839/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.123.up_proj: 2%|▏ | 840/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.123.down_proj: 2%|▏ | 841/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.124.gate_proj: 2%|▏ | 842/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.124.up_proj: 2%|▏ | 843/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.124.down_proj: 2%|▏ | 844/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.125.gate_proj: 2%|▏ | 845/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.125.up_proj: 2%|▏ | 846/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.125.down_proj: 2%|▏ | 847/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.126.gate_proj: 2%|▏ | 848/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.126.up_proj: 2%|▏ | 849/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.126.down_proj: 2%|▏ | 850/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.127.gate_proj: 2%|▏ | 851/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.127.up_proj: 2%|▏ | 852/36566 [00:01<00:39, 900.36it/s] packing model.layers.0.mlp.experts.127.down_proj: 2%|▏ | 853/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.0.gate_proj: 2%|▏ | 854/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.0.up_proj: 2%|▏ | 855/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.0.down_proj: 2%|▏ | 856/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.1.gate_proj: 2%|▏ | 857/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.1.up_proj: 2%|▏ | 858/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.1.down_proj: 2%|▏ | 859/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.2.gate_proj: 2%|▏ | 860/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.2.up_proj: 2%|▏ | 861/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.2.down_proj: 2%|▏ | 862/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.3.gate_proj: 2%|▏ | 863/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.3.up_proj: 2%|▏ | 864/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.3.down_proj: 2%|▏ | 865/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.4.gate_proj: 2%|▏ | 866/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.4.up_proj: 2%|▏ | 867/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.4.down_proj: 2%|▏ | 868/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.5.gate_proj: 2%|▏ | 869/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.5.up_proj: 2%|▏ | 870/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.5.down_proj: 2%|▏ | 871/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.6.gate_proj: 2%|▏ | 872/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.6.up_proj: 2%|▏ | 873/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.6.down_proj: 2%|▏ | 874/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.7.gate_proj: 2%|▏ | 875/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.7.up_proj: 2%|▏ | 876/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.7.down_proj: 2%|▏ | 877/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.8.gate_proj: 2%|▏ | 878/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.8.up_proj: 2%|▏ | 879/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.8.down_proj: 2%|▏ | 880/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.9.gate_proj: 2%|▏ | 881/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.9.up_proj: 2%|▏ | 882/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.9.down_proj: 2%|▏ | 883/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.10.gate_proj: 2%|▏ | 884/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.10.up_proj: 2%|▏ | 885/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.10.down_proj: 2%|▏ | 886/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.11.gate_proj: 2%|▏ | 887/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.11.up_proj: 2%|▏ | 888/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.11.down_proj: 2%|▏ | 889/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.12.gate_proj: 2%|▏ | 890/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.12.up_proj: 2%|▏ | 891/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.12.down_proj: 2%|▏ | 892/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.13.gate_proj: 2%|▏ | 893/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.13.up_proj: 2%|▏ | 894/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.13.down_proj: 2%|▏ | 895/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.14.gate_proj: 2%|▏ | 896/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.14.up_proj: 2%|▏ | 897/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.14.down_proj: 2%|▏ | 898/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.15.gate_proj: 2%|▏ | 899/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.15.up_proj: 2%|▏ | 900/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.15.down_proj: 2%|▏ | 901/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.16.gate_proj: 2%|▏ | 902/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.16.up_proj: 2%|▏ | 903/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.16.down_proj: 2%|▏ | 904/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.17.gate_proj: 2%|▏ | 905/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.17.up_proj: 2%|▏ | 906/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.17.down_proj: 2%|▏ | 907/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.18.gate_proj: 2%|▏ | 908/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.18.up_proj: 2%|▏ | 909/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.18.down_proj: 2%|▏ | 910/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.19.gate_proj: 2%|▏ | 911/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.19.up_proj: 2%|▏ | 912/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.19.down_proj: 2%|▏ | 913/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.20.gate_proj: 2%|▏ | 914/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.20.up_proj: 3%|▎ | 915/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.20.down_proj: 3%|▎ | 916/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.21.gate_proj: 3%|▎ | 917/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.21.up_proj: 3%|▎ | 918/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.21.down_proj: 3%|▎ | 919/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.22.gate_proj: 3%|▎ | 920/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.22.up_proj: 3%|▎ | 921/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.22.down_proj: 3%|▎ | 922/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.23.gate_proj: 3%|▎ | 923/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.23.up_proj: 3%|▎ | 924/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.23.down_proj: 3%|▎ | 925/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.24.gate_proj: 3%|▎ | 926/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.24.up_proj: 3%|▎ | 927/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.24.down_proj: 3%|▎ | 928/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.25.gate_proj: 3%|▎ | 929/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.25.up_proj: 3%|▎ | 930/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.25.down_proj: 3%|▎ | 931/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.26.gate_proj: 3%|▎ | 932/36566 [00:01<00:39, 900.36it/s] packing model.layers.1.mlp.experts.26.gate_proj: 3%|▎ | 933/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.26.up_proj: 3%|▎ | 933/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.26.down_proj: 3%|▎ | 934/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.27.gate_proj: 3%|▎ | 935/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.27.up_proj: 3%|▎ | 936/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.27.down_proj: 3%|▎ | 937/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.28.gate_proj: 3%|▎ | 938/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.28.up_proj: 3%|▎ | 939/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.28.down_proj: 3%|▎ | 940/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.29.gate_proj: 3%|▎ | 941/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.29.up_proj: 3%|▎ | 942/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.29.down_proj: 3%|▎ | 943/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.30.gate_proj: 3%|▎ | 944/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.30.up_proj: 3%|▎ | 945/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.30.down_proj: 3%|▎ | 946/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.31.gate_proj: 3%|▎ | 947/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.31.up_proj: 3%|▎ | 948/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.31.down_proj: 3%|▎ | 949/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.32.gate_proj: 3%|▎ | 950/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.32.up_proj: 3%|▎ | 951/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.32.down_proj: 3%|▎ | 952/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.33.gate_proj: 3%|▎ | 953/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.33.up_proj: 3%|▎ | 954/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.33.down_proj: 3%|▎ | 955/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.34.gate_proj: 3%|▎ | 956/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.34.up_proj: 3%|▎ | 957/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.34.down_proj: 3%|▎ | 958/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.35.gate_proj: 3%|▎ | 959/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.35.up_proj: 3%|▎ | 960/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.35.down_proj: 3%|▎ | 961/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.36.gate_proj: 3%|▎ | 962/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.36.up_proj: 3%|▎ | 963/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.36.down_proj: 3%|▎ | 964/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.37.gate_proj: 3%|▎ | 965/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.37.up_proj: 3%|▎ | 966/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.37.down_proj: 3%|▎ | 967/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.38.gate_proj: 3%|▎ | 968/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.38.up_proj: 3%|▎ | 969/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.38.down_proj: 3%|▎ | 970/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.39.gate_proj: 3%|▎ | 971/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.39.up_proj: 3%|▎ | 972/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.39.down_proj: 3%|▎ | 973/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.40.gate_proj: 3%|▎ | 974/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.40.up_proj: 3%|▎ | 975/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.40.down_proj: 3%|▎ | 976/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.41.gate_proj: 3%|▎ | 977/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.41.up_proj: 3%|▎ | 978/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.41.down_proj: 3%|▎ | 979/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.42.gate_proj: 3%|▎ | 980/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.42.up_proj: 3%|▎ | 981/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.42.down_proj: 3%|▎ | 982/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.43.gate_proj: 3%|▎ | 983/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.43.up_proj: 3%|▎ | 984/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.43.down_proj: 3%|▎ | 985/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.44.gate_proj: 3%|▎ | 986/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.44.up_proj: 3%|▎ | 987/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.44.down_proj: 3%|▎ | 988/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.45.gate_proj: 3%|▎ | 989/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.45.up_proj: 3%|▎ | 990/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.45.down_proj: 3%|▎ | 991/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.46.gate_proj: 3%|▎ | 992/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.46.up_proj: 3%|▎ | 993/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.46.down_proj: 3%|▎ | 994/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.47.gate_proj: 3%|▎ | 995/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.47.up_proj: 3%|▎ | 996/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.47.down_proj: 3%|▎ | 997/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.48.gate_proj: 3%|▎ | 998/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.48.up_proj: 3%|▎ | 999/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.48.down_proj: 3%|▎ | 1000/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.49.gate_proj: 3%|▎ | 1001/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.49.up_proj: 3%|▎ | 1002/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.49.down_proj: 3%|▎ | 1003/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.50.gate_proj: 3%|▎ | 1004/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.50.up_proj: 3%|▎ | 1005/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.50.down_proj: 3%|▎ | 1006/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.51.gate_proj: 3%|▎ | 1007/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.51.up_proj: 3%|▎ | 1008/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.51.down_proj: 3%|▎ | 1009/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.52.gate_proj: 3%|▎ | 1010/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.52.up_proj: 3%|▎ | 1011/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.52.down_proj: 3%|▎ | 1012/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.53.gate_proj: 3%|▎ | 1013/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.53.up_proj: 3%|▎ | 1014/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.53.down_proj: 3%|▎ | 1015/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.54.gate_proj: 3%|▎ | 1016/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.54.up_proj: 3%|▎ | 1017/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.54.down_proj: 3%|▎ | 1018/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.55.gate_proj: 3%|▎ | 1019/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.55.up_proj: 3%|▎ | 1020/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.55.down_proj: 3%|▎ | 1021/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.56.gate_proj: 3%|▎ | 1022/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.56.up_proj: 3%|▎ | 1023/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.56.down_proj: 3%|▎ | 1024/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.57.gate_proj: 3%|▎ | 1025/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.57.up_proj: 3%|▎ | 1026/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.57.down_proj: 3%|▎ | 1027/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.58.gate_proj: 3%|▎ | 1028/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.58.up_proj: 3%|▎ | 1029/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.58.down_proj: 3%|▎ | 1030/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.59.gate_proj: 3%|▎ | 1031/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.59.up_proj: 3%|▎ | 1032/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.59.down_proj: 3%|▎ | 1033/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.60.gate_proj: 3%|▎ | 1034/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.60.up_proj: 3%|▎ | 1035/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.60.down_proj: 3%|▎ | 1036/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.61.gate_proj: 3%|▎ | 1037/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.61.up_proj: 3%|▎ | 1038/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.61.down_proj: 3%|▎ | 1039/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.62.gate_proj: 3%|▎ | 1040/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.62.up_proj: 3%|▎ | 1041/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.62.down_proj: 3%|▎ | 1042/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.63.gate_proj: 3%|▎ | 1043/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.63.up_proj: 3%|▎ | 1044/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.63.down_proj: 3%|▎ | 1045/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.64.gate_proj: 3%|▎ | 1046/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.64.up_proj: 3%|▎ | 1047/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.64.down_proj: 3%|▎ | 1048/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.65.gate_proj: 3%|▎ | 1049/36566 [00:01<00:36, 970.70it/s] packing model.layers.1.mlp.experts.65.gate_proj: 3%|▎ | 1050/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.65.up_proj: 3%|▎ | 1050/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.65.down_proj: 3%|▎ | 1051/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.66.gate_proj: 3%|▎ | 1052/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.66.up_proj: 3%|▎ | 1053/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.66.down_proj: 3%|▎ | 1054/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.67.gate_proj: 3%|▎ | 1055/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.67.up_proj: 3%|▎ | 1056/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.67.down_proj: 3%|▎ | 1057/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.68.gate_proj: 3%|▎ | 1058/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.68.up_proj: 3%|▎ | 1059/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.68.down_proj: 3%|▎ | 1060/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.69.gate_proj: 3%|▎ | 1061/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.69.up_proj: 3%|▎ | 1062/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.69.down_proj: 3%|▎ | 1063/36566 [00:01<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.70.gate_proj: 3%|▎ | 1064/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.70.up_proj: 3%|▎ | 1065/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.70.down_proj: 3%|▎ | 1066/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.71.gate_proj: 3%|▎ | 1067/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.71.up_proj: 3%|▎ | 1068/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.71.down_proj: 3%|▎ | 1069/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.72.gate_proj: 3%|▎ | 1070/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.72.up_proj: 3%|▎ | 1071/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.72.down_proj: 3%|▎ | 1072/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.73.gate_proj: 3%|▎ | 1073/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.73.up_proj: 3%|▎ | 1074/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.73.down_proj: 3%|▎ | 1075/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.74.gate_proj: 3%|▎ | 1076/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.74.up_proj: 3%|▎ | 1077/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.74.down_proj: 3%|▎ | 1078/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.75.gate_proj: 3%|▎ | 1079/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.75.up_proj: 3%|▎ | 1080/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.75.down_proj: 3%|▎ | 1081/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.76.gate_proj: 3%|▎ | 1082/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.76.up_proj: 3%|▎ | 1083/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.76.down_proj: 3%|▎ | 1084/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.77.gate_proj: 3%|▎ | 1085/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.77.up_proj: 3%|▎ | 1086/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.77.down_proj: 3%|▎ | 1087/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.78.gate_proj: 3%|▎ | 1088/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.78.up_proj: 3%|▎ | 1089/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.78.down_proj: 3%|▎ | 1090/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.79.gate_proj: 3%|▎ | 1091/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.79.up_proj: 3%|▎ | 1092/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.79.down_proj: 3%|▎ | 1093/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.80.gate_proj: 3%|▎ | 1094/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.80.up_proj: 3%|▎ | 1095/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.80.down_proj: 3%|▎ | 1096/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.81.gate_proj: 3%|▎ | 1097/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.81.up_proj: 3%|▎ | 1098/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.81.down_proj: 3%|▎ | 1099/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.82.gate_proj: 3%|▎ | 1100/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.82.up_proj: 3%|▎ | 1101/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.82.down_proj: 3%|▎ | 1102/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.83.gate_proj: 3%|▎ | 1103/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.83.up_proj: 3%|▎ | 1104/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.83.down_proj: 3%|▎ | 1105/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.84.gate_proj: 3%|▎ | 1106/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.84.up_proj: 3%|▎ | 1107/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.84.down_proj: 3%|▎ | 1108/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.85.gate_proj: 3%|▎ | 1109/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.85.up_proj: 3%|▎ | 1110/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.85.down_proj: 3%|▎ | 1111/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.86.gate_proj: 3%|▎ | 1112/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.86.up_proj: 3%|▎ | 1113/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.86.down_proj: 3%|▎ | 1114/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.87.gate_proj: 3%|▎ | 1115/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.87.up_proj: 3%|▎ | 1116/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.87.down_proj: 3%|▎ | 1117/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.88.gate_proj: 3%|▎ | 1118/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.88.up_proj: 3%|▎ | 1119/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.88.down_proj: 3%|▎ | 1120/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.89.gate_proj: 3%|▎ | 1121/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.89.up_proj: 3%|▎ | 1122/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.89.down_proj: 3%|▎ | 1123/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.90.gate_proj: 3%|▎ | 1124/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.90.up_proj: 3%|▎ | 1125/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.90.down_proj: 3%|▎ | 1126/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.91.gate_proj: 3%|▎ | 1127/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.91.up_proj: 3%|▎ | 1128/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.91.down_proj: 3%|▎ | 1129/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.92.gate_proj: 3%|▎ | 1130/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.92.up_proj: 3%|▎ | 1131/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.92.down_proj: 3%|▎ | 1132/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.93.gate_proj: 3%|▎ | 1133/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.93.up_proj: 3%|▎ | 1134/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.93.down_proj: 3%|▎ | 1135/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.94.gate_proj: 3%|▎ | 1136/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.94.up_proj: 3%|▎ | 1137/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.94.down_proj: 3%|▎ | 1138/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.95.gate_proj: 3%|▎ | 1139/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.95.up_proj: 3%|▎ | 1140/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.95.down_proj: 3%|▎ | 1141/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.96.gate_proj: 3%|▎ | 1142/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.96.up_proj: 3%|▎ | 1143/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.96.down_proj: 3%|▎ | 1144/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.97.gate_proj: 3%|▎ | 1145/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.97.up_proj: 3%|▎ | 1146/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.97.down_proj: 3%|▎ | 1147/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.98.gate_proj: 3%|▎ | 1148/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.98.up_proj: 3%|▎ | 1149/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.98.down_proj: 3%|▎ | 1150/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.99.gate_proj: 3%|▎ | 1151/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.99.up_proj: 3%|▎ | 1152/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.99.down_proj: 3%|▎ | 1153/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.100.gate_proj: 3%|▎ | 1154/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.100.up_proj: 3%|▎ | 1155/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.100.down_proj: 3%|▎ | 1156/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.101.gate_proj: 3%|▎ | 1157/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.101.up_proj: 3%|▎ | 1158/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.101.down_proj: 3%|▎ | 1159/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.102.gate_proj: 3%|▎ | 1160/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.102.up_proj: 3%|▎ | 1161/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.102.down_proj: 3%|▎ | 1162/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.103.gate_proj: 3%|▎ | 1163/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.103.up_proj: 3%|▎ | 1164/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.103.down_proj: 3%|▎ | 1165/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.104.gate_proj: 3%|▎ | 1166/36566 [00:02<00:34, 1025.05it/s] packing model.layers.1.mlp.experts.104.gate_proj: 3%|▎ | 1167/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.104.up_proj: 3%|▎ | 1167/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.104.down_proj: 3%|▎ | 1168/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.105.gate_proj: 3%|▎ | 1169/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.105.up_proj: 3%|▎ | 1170/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.105.down_proj: 3%|▎ | 1171/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.106.gate_proj: 3%|▎ | 1172/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.106.up_proj: 3%|▎ | 1173/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.106.down_proj: 3%|▎ | 1174/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.107.gate_proj: 3%|▎ | 1175/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.107.up_proj: 3%|▎ | 1176/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.107.down_proj: 3%|▎ | 1177/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.108.gate_proj: 3%|▎ | 1178/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.108.up_proj: 3%|▎ | 1179/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.108.down_proj: 3%|▎ | 1180/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.109.gate_proj: 3%|▎ | 1181/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.109.up_proj: 3%|▎ | 1182/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.109.down_proj: 3%|▎ | 1183/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.110.gate_proj: 3%|▎ | 1184/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.110.up_proj: 3%|▎ | 1185/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.110.down_proj: 3%|▎ | 1186/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.111.gate_proj: 3%|▎ | 1187/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.111.up_proj: 3%|▎ | 1188/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.111.down_proj: 3%|▎ | 1189/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.112.gate_proj: 3%|▎ | 1190/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.112.up_proj: 3%|▎ | 1191/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.112.down_proj: 3%|▎ | 1192/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.113.gate_proj: 3%|▎ | 1193/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.113.up_proj: 3%|▎ | 1194/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.113.down_proj: 3%|▎ | 1195/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.114.gate_proj: 3%|▎ | 1196/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.114.up_proj: 3%|▎ | 1197/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.114.down_proj: 3%|▎ | 1198/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.115.gate_proj: 3%|▎ | 1199/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.115.up_proj: 3%|▎ | 1200/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.115.down_proj: 3%|▎ | 1201/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.116.gate_proj: 3%|▎ | 1202/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.116.up_proj: 3%|▎ | 1203/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.116.down_proj: 3%|▎ | 1204/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.117.gate_proj: 3%|▎ | 1205/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.117.up_proj: 3%|▎ | 1206/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.117.down_proj: 3%|▎ | 1207/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.118.gate_proj: 3%|▎ | 1208/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.118.up_proj: 3%|▎ | 1209/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.118.down_proj: 3%|▎ | 1210/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.119.gate_proj: 3%|▎ | 1211/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.119.up_proj: 3%|▎ | 1212/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.119.down_proj: 3%|▎ | 1213/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.120.gate_proj: 3%|▎ | 1214/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.120.up_proj: 3%|▎ | 1215/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.120.down_proj: 3%|▎ | 1216/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.121.gate_proj: 3%|▎ | 1217/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.121.up_proj: 3%|▎ | 1218/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.121.down_proj: 3%|▎ | 1219/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.122.gate_proj: 3%|▎ | 1220/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.122.up_proj: 3%|▎ | 1221/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.122.down_proj: 3%|▎ | 1222/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.123.gate_proj: 3%|▎ | 1223/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.123.up_proj: 3%|▎ | 1224/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.123.down_proj: 3%|▎ | 1225/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.124.gate_proj: 3%|▎ | 1226/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.124.up_proj: 3%|▎ | 1227/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.124.down_proj: 3%|▎ | 1228/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.125.gate_proj: 3%|▎ | 1229/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.125.up_proj: 3%|▎ | 1230/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.125.down_proj: 3%|▎ | 1231/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.126.gate_proj: 3%|▎ | 1232/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.126.up_proj: 3%|▎ | 1233/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.126.down_proj: 3%|▎ | 1234/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.127.gate_proj: 3%|▎ | 1235/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.127.up_proj: 3%|▎ | 1236/36566 [00:02<00:33, 1064.72it/s] packing model.layers.1.mlp.experts.127.down_proj: 3%|▎ | 1237/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.0.gate_proj: 3%|▎ | 1238/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.0.up_proj: 3%|▎ | 1239/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.0.down_proj: 3%|▎ | 1240/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.1.gate_proj: 3%|▎ | 1241/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.1.up_proj: 3%|▎ | 1242/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.1.down_proj: 3%|▎ | 1243/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.2.gate_proj: 3%|▎ | 1244/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.2.up_proj: 3%|▎ | 1245/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.2.down_proj: 3%|▎ | 1246/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.3.gate_proj: 3%|▎ | 1247/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.3.up_proj: 3%|▎ | 1248/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.3.down_proj: 3%|▎ | 1249/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.4.gate_proj: 3%|▎ | 1250/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.4.up_proj: 3%|▎ | 1251/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.4.down_proj: 3%|▎ | 1252/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.5.gate_proj: 3%|▎ | 1253/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.5.up_proj: 3%|▎ | 1254/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.5.down_proj: 3%|▎ | 1255/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.6.gate_proj: 3%|▎ | 1256/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.6.up_proj: 3%|▎ | 1257/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.6.down_proj: 3%|▎ | 1258/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.7.gate_proj: 3%|▎ | 1259/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.7.up_proj: 3%|▎ | 1260/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.7.down_proj: 3%|▎ | 1261/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.8.gate_proj: 3%|▎ | 1262/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.8.up_proj: 3%|▎ | 1263/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.8.down_proj: 3%|▎ | 1264/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.9.gate_proj: 3%|▎ | 1265/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.9.up_proj: 3%|▎ | 1266/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.9.down_proj: 3%|▎ | 1267/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.10.gate_proj: 3%|▎ | 1268/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.10.up_proj: 3%|▎ | 1269/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.10.down_proj: 3%|▎ | 1270/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.11.gate_proj: 3%|▎ | 1271/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.11.up_proj: 3%|▎ | 1272/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.11.down_proj: 3%|▎ | 1273/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.12.gate_proj: 3%|▎ | 1274/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.12.up_proj: 3%|▎ | 1275/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.12.down_proj: 3%|▎ | 1276/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.13.gate_proj: 3%|▎ | 1277/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.13.up_proj: 3%|▎ | 1278/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.13.down_proj: 3%|▎ | 1279/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.14.gate_proj: 4%|▎ | 1280/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.14.up_proj: 4%|▎ | 1281/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.14.down_proj: 4%|▎ | 1282/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.15.gate_proj: 4%|▎ | 1283/36566 [00:02<00:33, 1064.72it/s] packing model.layers.2.mlp.experts.15.gate_proj: 4%|▎ | 1284/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.15.up_proj: 4%|▎ | 1284/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.15.down_proj: 4%|▎ | 1285/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.16.gate_proj: 4%|▎ | 1286/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.16.up_proj: 4%|▎ | 1287/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.16.down_proj: 4%|▎ | 1288/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.17.gate_proj: 4%|▎ | 1289/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.17.up_proj: 4%|▎ | 1290/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.17.down_proj: 4%|▎ | 1291/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.18.gate_proj: 4%|▎ | 1292/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.18.up_proj: 4%|▎ | 1293/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.18.down_proj: 4%|▎ | 1294/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.19.gate_proj: 4%|▎ | 1295/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.19.up_proj: 4%|▎ | 1296/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.19.down_proj: 4%|▎ | 1297/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.20.gate_proj: 4%|▎ | 1298/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.20.up_proj: 4%|▎ | 1299/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.20.down_proj: 4%|▎ | 1300/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.21.gate_proj: 4%|▎ | 1301/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.21.up_proj: 4%|▎ | 1302/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.21.down_proj: 4%|▎ | 1303/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.22.gate_proj: 4%|▎ | 1304/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.22.up_proj: 4%|▎ | 1305/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.22.down_proj: 4%|▎ | 1306/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.23.gate_proj: 4%|▎ | 1307/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.23.up_proj: 4%|▎ | 1308/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.23.down_proj: 4%|▎ | 1309/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.24.gate_proj: 4%|▎ | 1310/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.24.up_proj: 4%|▎ | 1311/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.24.down_proj: 4%|▎ | 1312/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.25.gate_proj: 4%|▎ | 1313/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.25.up_proj: 4%|▎ | 1314/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.25.down_proj: 4%|▎ | 1315/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.26.gate_proj: 4%|▎ | 1316/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.26.up_proj: 4%|▎ | 1317/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.26.down_proj: 4%|▎ | 1318/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.27.gate_proj: 4%|▎ | 1319/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.27.up_proj: 4%|▎ | 1320/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.27.down_proj: 4%|▎ | 1321/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.28.gate_proj: 4%|▎ | 1322/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.28.up_proj: 4%|▎ | 1323/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.28.down_proj: 4%|▎ | 1324/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.29.gate_proj: 4%|▎ | 1325/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.29.up_proj: 4%|▎ | 1326/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.29.down_proj: 4%|▎ | 1327/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.30.gate_proj: 4%|▎ | 1328/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.30.up_proj: 4%|▎ | 1329/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.30.down_proj: 4%|▎ | 1330/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.31.gate_proj: 4%|▎ | 1331/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.31.up_proj: 4%|▎ | 1332/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.31.down_proj: 4%|▎ | 1333/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.32.gate_proj: 4%|▎ | 1334/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.32.up_proj: 4%|▎ | 1335/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.32.down_proj: 4%|▎ | 1336/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.33.gate_proj: 4%|▎ | 1337/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.33.up_proj: 4%|▎ | 1338/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.33.down_proj: 4%|▎ | 1339/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.34.gate_proj: 4%|▎ | 1340/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.34.up_proj: 4%|▎ | 1341/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.34.down_proj: 4%|▎ | 1342/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.35.gate_proj: 4%|▎ | 1343/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.35.up_proj: 4%|▎ | 1344/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.35.down_proj: 4%|▎ | 1345/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.36.gate_proj: 4%|▎ | 1346/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.36.up_proj: 4%|▎ | 1347/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.36.down_proj: 4%|▎ | 1348/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.37.gate_proj: 4%|▎ | 1349/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.37.up_proj: 4%|▎ | 1350/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.37.down_proj: 4%|▎ | 1351/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.38.gate_proj: 4%|▎ | 1352/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.38.up_proj: 4%|▎ | 1353/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.38.down_proj: 4%|▎ | 1354/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.39.gate_proj: 4%|▎ | 1355/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.39.up_proj: 4%|▎ | 1356/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.39.down_proj: 4%|▎ | 1357/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.40.gate_proj: 4%|▎ | 1358/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.40.up_proj: 4%|▎ | 1359/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.40.down_proj: 4%|▎ | 1360/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.41.gate_proj: 4%|▎ | 1361/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.41.up_proj: 4%|▎ | 1362/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.41.down_proj: 4%|▎ | 1363/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.42.gate_proj: 4%|▎ | 1364/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.42.up_proj: 4%|▎ | 1365/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.42.down_proj: 4%|▎ | 1366/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.43.gate_proj: 4%|▎ | 1367/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.43.up_proj: 4%|▎ | 1368/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.43.down_proj: 4%|▎ | 1369/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.44.gate_proj: 4%|▎ | 1370/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.44.up_proj: 4%|▎ | 1371/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.44.down_proj: 4%|▍ | 1372/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.45.gate_proj: 4%|▍ | 1373/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.45.up_proj: 4%|▍ | 1374/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.45.down_proj: 4%|▍ | 1375/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.46.gate_proj: 4%|▍ | 1376/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.46.up_proj: 4%|▍ | 1377/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.46.down_proj: 4%|▍ | 1378/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.47.gate_proj: 4%|▍ | 1379/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.47.up_proj: 4%|▍ | 1380/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.47.down_proj: 4%|▍ | 1381/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.48.gate_proj: 4%|▍ | 1382/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.48.up_proj: 4%|▍ | 1383/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.48.down_proj: 4%|▍ | 1384/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.49.gate_proj: 4%|▍ | 1385/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.49.up_proj: 4%|▍ | 1386/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.49.down_proj: 4%|▍ | 1387/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.50.gate_proj: 4%|▍ | 1388/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.50.up_proj: 4%|▍ | 1389/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.50.down_proj: 4%|▍ | 1390/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.51.gate_proj: 4%|▍ | 1391/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.51.up_proj: 4%|▍ | 1392/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.51.down_proj: 4%|▍ | 1393/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.52.gate_proj: 4%|▍ | 1394/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.52.up_proj: 4%|▍ | 1395/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.52.down_proj: 4%|▍ | 1396/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.53.gate_proj: 4%|▍ | 1397/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.53.up_proj: 4%|▍ | 1398/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.53.down_proj: 4%|▍ | 1399/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.54.gate_proj: 4%|▍ | 1400/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.54.up_proj: 4%|▍ | 1401/36566 [00:02<00:32, 1094.42it/s] packing model.layers.2.mlp.experts.54.up_proj: 4%|▍ | 1402/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.54.down_proj: 4%|▍ | 1402/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.55.gate_proj: 4%|▍ | 1403/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.55.up_proj: 4%|▍ | 1404/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.55.down_proj: 4%|▍ | 1405/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.56.gate_proj: 4%|▍ | 1406/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.56.up_proj: 4%|▍ | 1407/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.56.down_proj: 4%|▍ | 1408/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.57.gate_proj: 4%|▍ | 1409/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.57.up_proj: 4%|▍ | 1410/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.57.down_proj: 4%|▍ | 1411/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.58.gate_proj: 4%|▍ | 1412/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.58.up_proj: 4%|▍ | 1413/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.58.down_proj: 4%|▍ | 1414/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.59.gate_proj: 4%|▍ | 1415/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.59.up_proj: 4%|▍ | 1416/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.59.down_proj: 4%|▍ | 1417/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.60.gate_proj: 4%|▍ | 1418/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.60.up_proj: 4%|▍ | 1419/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.60.down_proj: 4%|▍ | 1420/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.61.gate_proj: 4%|▍ | 1421/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.61.up_proj: 4%|▍ | 1422/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.61.down_proj: 4%|▍ | 1423/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.62.gate_proj: 4%|▍ | 1424/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.62.up_proj: 4%|▍ | 1425/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.62.down_proj: 4%|▍ | 1426/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.63.gate_proj: 4%|▍ | 1427/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.63.up_proj: 4%|▍ | 1428/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.63.down_proj: 4%|▍ | 1429/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.64.gate_proj: 4%|▍ | 1430/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.64.up_proj: 4%|▍ | 1431/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.64.down_proj: 4%|▍ | 1432/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.65.gate_proj: 4%|▍ | 1433/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.65.up_proj: 4%|▍ | 1434/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.65.down_proj: 4%|▍ | 1435/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.66.gate_proj: 4%|▍ | 1436/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.66.up_proj: 4%|▍ | 1437/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.66.down_proj: 4%|▍ | 1438/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.67.gate_proj: 4%|▍ | 1439/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.67.up_proj: 4%|▍ | 1440/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.67.down_proj: 4%|▍ | 1441/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.68.gate_proj: 4%|▍ | 1442/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.68.up_proj: 4%|▍ | 1443/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.68.down_proj: 4%|▍ | 1444/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.69.gate_proj: 4%|▍ | 1445/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.69.up_proj: 4%|▍ | 1446/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.69.down_proj: 4%|▍ | 1447/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.70.gate_proj: 4%|▍ | 1448/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.70.up_proj: 4%|▍ | 1449/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.70.down_proj: 4%|▍ | 1450/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.71.gate_proj: 4%|▍ | 1451/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.71.up_proj: 4%|▍ | 1452/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.71.down_proj: 4%|▍ | 1453/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.72.gate_proj: 4%|▍ | 1454/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.72.up_proj: 4%|▍ | 1455/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.72.down_proj: 4%|▍ | 1456/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.73.gate_proj: 4%|▍ | 1457/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.73.up_proj: 4%|▍ | 1458/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.73.down_proj: 4%|▍ | 1459/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.74.gate_proj: 4%|▍ | 1460/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.74.up_proj: 4%|▍ | 1461/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.74.down_proj: 4%|▍ | 1462/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.75.gate_proj: 4%|▍ | 1463/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.75.up_proj: 4%|▍ | 1464/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.75.down_proj: 4%|▍ | 1465/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.76.gate_proj: 4%|▍ | 1466/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.76.up_proj: 4%|▍ | 1467/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.76.down_proj: 4%|▍ | 1468/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.77.gate_proj: 4%|▍ | 1469/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.77.up_proj: 4%|▍ | 1470/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.77.down_proj: 4%|▍ | 1471/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.78.gate_proj: 4%|▍ | 1472/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.78.up_proj: 4%|▍ | 1473/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.78.down_proj: 4%|▍ | 1474/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.79.gate_proj: 4%|▍ | 1475/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.79.up_proj: 4%|▍ | 1476/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.79.down_proj: 4%|▍ | 1477/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.80.gate_proj: 4%|▍ | 1478/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.80.up_proj: 4%|▍ | 1479/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.80.down_proj: 4%|▍ | 1480/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.81.gate_proj: 4%|▍ | 1481/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.81.up_proj: 4%|▍ | 1482/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.81.down_proj: 4%|▍ | 1483/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.82.gate_proj: 4%|▍ | 1484/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.82.up_proj: 4%|▍ | 1485/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.82.down_proj: 4%|▍ | 1486/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.83.gate_proj: 4%|▍ | 1487/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.83.up_proj: 4%|▍ | 1488/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.83.down_proj: 4%|▍ | 1489/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.84.gate_proj: 4%|▍ | 1490/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.84.up_proj: 4%|▍ | 1491/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.84.down_proj: 4%|▍ | 1492/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.85.gate_proj: 4%|▍ | 1493/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.85.up_proj: 4%|▍ | 1494/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.85.down_proj: 4%|▍ | 1495/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.86.gate_proj: 4%|▍ | 1496/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.86.up_proj: 4%|▍ | 1497/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.86.down_proj: 4%|▍ | 1498/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.87.gate_proj: 4%|▍ | 1499/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.87.up_proj: 4%|▍ | 1500/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.87.down_proj: 4%|▍ | 1501/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.88.gate_proj: 4%|▍ | 1502/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.88.up_proj: 4%|▍ | 1503/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.88.down_proj: 4%|▍ | 1504/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.89.gate_proj: 4%|▍ | 1505/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.89.up_proj: 4%|▍ | 1506/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.89.down_proj: 4%|▍ | 1507/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.90.gate_proj: 4%|▍ | 1508/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.90.up_proj: 4%|▍ | 1509/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.90.down_proj: 4%|▍ | 1510/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.91.gate_proj: 4%|▍ | 1511/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.91.up_proj: 4%|▍ | 1512/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.91.down_proj: 4%|▍ | 1513/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.92.gate_proj: 4%|▍ | 1514/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.92.up_proj: 4%|▍ | 1515/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.92.down_proj: 4%|▍ | 1516/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.93.gate_proj: 4%|▍ | 1517/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.93.up_proj: 4%|▍ | 1518/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.93.down_proj: 4%|▍ | 1519/36566 [00:02<00:31, 1117.21it/s] packing model.layers.2.mlp.experts.93.down_proj: 4%|▍ | 1520/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.94.gate_proj: 4%|▍ | 1520/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.94.up_proj: 4%|▍ | 1521/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.94.down_proj: 4%|▍ | 1522/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.95.gate_proj: 4%|▍ | 1523/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.95.up_proj: 4%|▍ | 1524/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.95.down_proj: 4%|▍ | 1525/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.96.gate_proj: 4%|▍ | 1526/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.96.up_proj: 4%|▍ | 1527/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.96.down_proj: 4%|▍ | 1528/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.97.gate_proj: 4%|▍ | 1529/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.97.up_proj: 4%|▍ | 1530/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.97.down_proj: 4%|▍ | 1531/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.98.gate_proj: 4%|▍ | 1532/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.98.up_proj: 4%|▍ | 1533/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.98.down_proj: 4%|▍ | 1534/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.99.gate_proj: 4%|▍ | 1535/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.99.up_proj: 4%|▍ | 1536/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.99.down_proj: 4%|▍ | 1537/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.100.gate_proj: 4%|▍ | 1538/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.100.up_proj: 4%|▍ | 1539/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.100.down_proj: 4%|▍ | 1540/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.101.gate_proj: 4%|▍ | 1541/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.101.up_proj: 4%|▍ | 1542/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.101.down_proj: 4%|▍ | 1543/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.102.gate_proj: 4%|▍ | 1544/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.102.up_proj: 4%|▍ | 1545/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.102.down_proj: 4%|▍ | 1546/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.103.gate_proj: 4%|▍ | 1547/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.103.up_proj: 4%|▍ | 1548/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.103.down_proj: 4%|▍ | 1549/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.104.gate_proj: 4%|▍ | 1550/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.104.up_proj: 4%|▍ | 1551/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.104.down_proj: 4%|▍ | 1552/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.105.gate_proj: 4%|▍ | 1553/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.105.up_proj: 4%|▍ | 1554/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.105.down_proj: 4%|▍ | 1555/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.106.gate_proj: 4%|▍ | 1556/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.106.up_proj: 4%|▍ | 1557/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.106.down_proj: 4%|▍ | 1558/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.107.gate_proj: 4%|▍ | 1559/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.107.up_proj: 4%|▍ | 1560/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.107.down_proj: 4%|▍ | 1561/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.108.gate_proj: 4%|▍ | 1562/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.108.up_proj: 4%|▍ | 1563/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.108.down_proj: 4%|▍ | 1564/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.109.gate_proj: 4%|▍ | 1565/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.109.up_proj: 4%|▍ | 1566/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.109.down_proj: 4%|▍ | 1567/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.110.gate_proj: 4%|▍ | 1568/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.110.up_proj: 4%|▍ | 1569/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.110.down_proj: 4%|▍ | 1570/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.111.gate_proj: 4%|▍ | 1571/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.111.up_proj: 4%|▍ | 1572/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.111.down_proj: 4%|▍ | 1573/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.112.gate_proj: 4%|▍ | 1574/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.112.up_proj: 4%|▍ | 1575/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.112.down_proj: 4%|▍ | 1576/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.113.gate_proj: 4%|▍ | 1577/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.113.up_proj: 4%|▍ | 1578/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.113.down_proj: 4%|▍ | 1579/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.114.gate_proj: 4%|▍ | 1580/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.114.up_proj: 4%|▍ | 1581/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.114.down_proj: 4%|▍ | 1582/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.115.gate_proj: 4%|▍ | 1583/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.115.up_proj: 4%|▍ | 1584/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.115.down_proj: 4%|▍ | 1585/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.116.gate_proj: 4%|▍ | 1586/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.116.up_proj: 4%|▍ | 1587/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.116.down_proj: 4%|▍ | 1588/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.117.gate_proj: 4%|▍ | 1589/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.117.up_proj: 4%|▍ | 1590/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.117.down_proj: 4%|▍ | 1591/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.118.gate_proj: 4%|▍ | 1592/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.118.up_proj: 4%|▍ | 1593/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.118.down_proj: 4%|▍ | 1594/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.119.gate_proj: 4%|▍ | 1595/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.119.up_proj: 4%|▍ | 1596/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.119.down_proj: 4%|▍ | 1597/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.120.gate_proj: 4%|▍ | 1598/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.120.up_proj: 4%|▍ | 1599/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.120.down_proj: 4%|▍ | 1600/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.121.gate_proj: 4%|▍ | 1601/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.121.up_proj: 4%|▍ | 1602/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.121.down_proj: 4%|▍ | 1603/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.122.gate_proj: 4%|▍ | 1604/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.122.up_proj: 4%|▍ | 1605/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.122.down_proj: 4%|▍ | 1606/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.123.gate_proj: 4%|▍ | 1607/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.123.up_proj: 4%|▍ | 1608/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.123.down_proj: 4%|▍ | 1609/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.124.gate_proj: 4%|▍ | 1610/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.124.up_proj: 4%|▍ | 1611/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.124.down_proj: 4%|▍ | 1612/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.125.gate_proj: 4%|▍ | 1613/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.125.up_proj: 4%|▍ | 1614/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.125.down_proj: 4%|▍ | 1615/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.126.gate_proj: 4%|▍ | 1616/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.126.up_proj: 4%|▍ | 1617/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.126.down_proj: 4%|▍ | 1618/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.127.gate_proj: 4%|▍ | 1619/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.127.up_proj: 4%|▍ | 1620/36566 [00:02<00:30, 1134.26it/s] packing model.layers.2.mlp.experts.127.down_proj: 4%|▍ | 1621/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.0.gate_proj: 4%|▍ | 1622/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.0.up_proj: 4%|▍ | 1623/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.0.down_proj: 4%|▍ | 1624/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.1.gate_proj: 4%|▍ | 1625/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.1.up_proj: 4%|▍ | 1626/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.1.down_proj: 4%|▍ | 1627/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.2.gate_proj: 4%|▍ | 1628/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.2.up_proj: 4%|▍ | 1629/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.2.down_proj: 4%|▍ | 1630/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.3.gate_proj: 4%|▍ | 1631/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.3.up_proj: 4%|▍ | 1632/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.3.down_proj: 4%|▍ | 1633/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.4.gate_proj: 4%|▍ | 1634/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.4.up_proj: 4%|▍ | 1635/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.4.down_proj: 4%|▍ | 1636/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.5.gate_proj: 4%|▍ | 1637/36566 [00:02<00:30, 1134.26it/s] packing model.layers.3.mlp.experts.5.gate_proj: 4%|▍ | 1638/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.5.up_proj: 4%|▍ | 1638/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.5.down_proj: 4%|▍ | 1639/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.6.gate_proj: 4%|▍ | 1640/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.6.up_proj: 4%|▍ | 1641/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.6.down_proj: 4%|▍ | 1642/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.7.gate_proj: 4%|▍ | 1643/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.7.up_proj: 4%|▍ | 1644/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.7.down_proj: 4%|▍ | 1645/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.8.gate_proj: 5%|▍ | 1646/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.8.up_proj: 5%|▍ | 1647/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.8.down_proj: 5%|▍ | 1648/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.9.gate_proj: 5%|▍ | 1649/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.9.up_proj: 5%|▍ | 1650/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.9.down_proj: 5%|▍ | 1651/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.10.gate_proj: 5%|▍ | 1652/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.10.up_proj: 5%|▍ | 1653/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.10.down_proj: 5%|▍ | 1654/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.11.gate_proj: 5%|▍ | 1655/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.11.up_proj: 5%|▍ | 1656/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.11.down_proj: 5%|▍ | 1657/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.12.gate_proj: 5%|▍ | 1658/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.12.up_proj: 5%|▍ | 1659/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.12.down_proj: 5%|▍ | 1660/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.13.gate_proj: 5%|▍ | 1661/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.13.up_proj: 5%|▍ | 1662/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.13.down_proj: 5%|▍ | 1663/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.14.gate_proj: 5%|▍ | 1664/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.14.up_proj: 5%|▍ | 1665/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.14.down_proj: 5%|▍ | 1666/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.15.gate_proj: 5%|▍ | 1667/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.15.up_proj: 5%|▍ | 1668/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.15.down_proj: 5%|▍ | 1669/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.16.gate_proj: 5%|▍ | 1670/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.16.up_proj: 5%|▍ | 1671/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.16.down_proj: 5%|▍ | 1672/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.17.gate_proj: 5%|▍ | 1673/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.17.up_proj: 5%|▍ | 1674/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.17.down_proj: 5%|▍ | 1675/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.18.gate_proj: 5%|▍ | 1676/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.18.up_proj: 5%|▍ | 1677/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.18.down_proj: 5%|▍ | 1678/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.19.gate_proj: 5%|▍ | 1679/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.19.up_proj: 5%|▍ | 1680/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.19.down_proj: 5%|▍ | 1681/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.20.gate_proj: 5%|▍ | 1682/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.20.up_proj: 5%|▍ | 1683/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.20.down_proj: 5%|▍ | 1684/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.21.gate_proj: 5%|▍ | 1685/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.21.up_proj: 5%|▍ | 1686/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.21.down_proj: 5%|▍ | 1687/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.22.gate_proj: 5%|▍ | 1688/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.22.up_proj: 5%|▍ | 1689/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.22.down_proj: 5%|▍ | 1690/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.23.gate_proj: 5%|▍ | 1691/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.23.up_proj: 5%|▍ | 1692/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.23.down_proj: 5%|▍ | 1693/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.24.gate_proj: 5%|▍ | 1694/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.24.up_proj: 5%|▍ | 1695/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.24.down_proj: 5%|▍ | 1696/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.25.gate_proj: 5%|▍ | 1697/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.25.up_proj: 5%|▍ | 1698/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.25.down_proj: 5%|▍ | 1699/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.26.gate_proj: 5%|▍ | 1700/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.26.up_proj: 5%|▍ | 1701/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.26.down_proj: 5%|▍ | 1702/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.27.gate_proj: 5%|▍ | 1703/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.27.up_proj: 5%|▍ | 1704/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.27.down_proj: 5%|▍ | 1705/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.28.gate_proj: 5%|▍ | 1706/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.28.up_proj: 5%|▍ | 1707/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.28.down_proj: 5%|▍ | 1708/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.29.gate_proj: 5%|▍ | 1709/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.29.up_proj: 5%|▍ | 1710/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.29.down_proj: 5%|▍ | 1711/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.30.gate_proj: 5%|▍ | 1712/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.30.up_proj: 5%|▍ | 1713/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.30.down_proj: 5%|▍ | 1714/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.31.gate_proj: 5%|▍ | 1715/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.31.up_proj: 5%|▍ | 1716/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.31.down_proj: 5%|▍ | 1717/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.32.gate_proj: 5%|▍ | 1718/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.32.up_proj: 5%|▍ | 1719/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.32.down_proj: 5%|▍ | 1720/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.33.gate_proj: 5%|▍ | 1721/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.33.up_proj: 5%|▍ | 1722/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.33.down_proj: 5%|▍ | 1723/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.34.gate_proj: 5%|▍ | 1724/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.34.up_proj: 5%|▍ | 1725/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.34.down_proj: 5%|▍ | 1726/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.35.gate_proj: 5%|▍ | 1727/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.35.up_proj: 5%|▍ | 1728/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.35.down_proj: 5%|▍ | 1729/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.36.gate_proj: 5%|▍ | 1730/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.36.up_proj: 5%|▍ | 1731/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.36.down_proj: 5%|▍ | 1732/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.37.gate_proj: 5%|▍ | 1733/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.37.up_proj: 5%|▍ | 1734/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.37.down_proj: 5%|▍ | 1735/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.38.gate_proj: 5%|▍ | 1736/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.38.up_proj: 5%|▍ | 1737/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.38.down_proj: 5%|▍ | 1738/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.39.gate_proj: 5%|▍ | 1739/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.39.up_proj: 5%|▍ | 1740/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.39.down_proj: 5%|▍ | 1741/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.40.gate_proj: 5%|▍ | 1742/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.40.up_proj: 5%|▍ | 1743/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.40.down_proj: 5%|▍ | 1744/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.41.gate_proj: 5%|▍ | 1745/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.41.up_proj: 5%|▍ | 1746/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.41.down_proj: 5%|▍ | 1747/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.42.gate_proj: 5%|▍ | 1748/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.42.up_proj: 5%|▍ | 1749/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.42.down_proj: 5%|▍ | 1750/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.43.gate_proj: 5%|▍ | 1751/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.43.up_proj: 5%|▍ | 1752/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.43.down_proj: 5%|▍ | 1753/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.44.gate_proj: 5%|▍ | 1754/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.44.up_proj: 5%|▍ | 1755/36566 [00:02<00:30, 1145.78it/s] packing model.layers.3.mlp.experts.44.up_proj: 5%|▍ | 1756/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.44.down_proj: 5%|▍ | 1756/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.45.gate_proj: 5%|▍ | 1757/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.45.up_proj: 5%|▍ | 1758/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.45.down_proj: 5%|▍ | 1759/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.46.gate_proj: 5%|▍ | 1760/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.46.up_proj: 5%|▍ | 1761/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.46.down_proj: 5%|▍ | 1762/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.47.gate_proj: 5%|▍ | 1763/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.47.up_proj: 5%|▍ | 1764/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.47.down_proj: 5%|▍ | 1765/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.48.gate_proj: 5%|▍ | 1766/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.48.up_proj: 5%|▍ | 1767/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.48.down_proj: 5%|▍ | 1768/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.49.gate_proj: 5%|▍ | 1769/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.49.up_proj: 5%|▍ | 1770/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.49.down_proj: 5%|▍ | 1771/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.50.gate_proj: 5%|▍ | 1772/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.50.up_proj: 5%|▍ | 1773/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.50.down_proj: 5%|▍ | 1774/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.51.gate_proj: 5%|▍ | 1775/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.51.up_proj: 5%|▍ | 1776/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.51.down_proj: 5%|▍ | 1777/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.52.gate_proj: 5%|▍ | 1778/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.52.up_proj: 5%|▍ | 1779/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.52.down_proj: 5%|▍ | 1780/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.53.gate_proj: 5%|▍ | 1781/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.53.up_proj: 5%|▍ | 1782/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.53.down_proj: 5%|▍ | 1783/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.54.gate_proj: 5%|▍ | 1784/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.54.up_proj: 5%|▍ | 1785/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.54.down_proj: 5%|▍ | 1786/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.55.gate_proj: 5%|▍ | 1787/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.55.up_proj: 5%|▍ | 1788/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.55.down_proj: 5%|▍ | 1789/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.56.gate_proj: 5%|▍ | 1790/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.56.up_proj: 5%|▍ | 1791/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.56.down_proj: 5%|▍ | 1792/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.57.gate_proj: 5%|▍ | 1793/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.57.up_proj: 5%|▍ | 1794/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.57.down_proj: 5%|▍ | 1795/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.58.gate_proj: 5%|▍ | 1796/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.58.up_proj: 5%|▍ | 1797/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.58.down_proj: 5%|▍ | 1798/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.59.gate_proj: 5%|▍ | 1799/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.59.up_proj: 5%|▍ | 1800/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.59.down_proj: 5%|▍ | 1801/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.60.gate_proj: 5%|▍ | 1802/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.60.up_proj: 5%|▍ | 1803/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.60.down_proj: 5%|▍ | 1804/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.61.gate_proj: 5%|▍ | 1805/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.61.up_proj: 5%|▍ | 1806/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.61.down_proj: 5%|▍ | 1807/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.62.gate_proj: 5%|▍ | 1808/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.62.up_proj: 5%|▍ | 1809/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.62.down_proj: 5%|▍ | 1810/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.63.gate_proj: 5%|▍ | 1811/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.63.up_proj: 5%|▍ | 1812/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.63.down_proj: 5%|▍ | 1813/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.64.gate_proj: 5%|▍ | 1814/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.64.up_proj: 5%|▍ | 1815/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.64.down_proj: 5%|▍ | 1816/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.65.gate_proj: 5%|▍ | 1817/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.65.up_proj: 5%|▍ | 1818/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.65.down_proj: 5%|▍ | 1819/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.66.gate_proj: 5%|▍ | 1820/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.66.up_proj: 5%|▍ | 1821/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.66.down_proj: 5%|▍ | 1822/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.67.gate_proj: 5%|▍ | 1823/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.67.up_proj: 5%|▍ | 1824/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.67.down_proj: 5%|▍ | 1825/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.68.gate_proj: 5%|▍ | 1826/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.68.up_proj: 5%|▍ | 1827/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.68.down_proj: 5%|▍ | 1828/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.69.gate_proj: 5%|▌ | 1829/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.69.up_proj: 5%|▌ | 1830/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.69.down_proj: 5%|▌ | 1831/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.70.gate_proj: 5%|▌ | 1832/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.70.up_proj: 5%|▌ | 1833/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.70.down_proj: 5%|▌ | 1834/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.71.gate_proj: 5%|▌ | 1835/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.71.up_proj: 5%|▌ | 1836/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.71.down_proj: 5%|▌ | 1837/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.72.gate_proj: 5%|▌ | 1838/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.72.up_proj: 5%|▌ | 1839/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.72.down_proj: 5%|▌ | 1840/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.73.gate_proj: 5%|▌ | 1841/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.73.up_proj: 5%|▌ | 1842/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.73.down_proj: 5%|▌ | 1843/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.74.gate_proj: 5%|▌ | 1844/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.74.up_proj: 5%|▌ | 1845/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.74.down_proj: 5%|▌ | 1846/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.75.gate_proj: 5%|▌ | 1847/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.75.up_proj: 5%|▌ | 1848/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.75.down_proj: 5%|▌ | 1849/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.76.gate_proj: 5%|▌ | 1850/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.76.up_proj: 5%|▌ | 1851/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.76.down_proj: 5%|▌ | 1852/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.77.gate_proj: 5%|▌ | 1853/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.77.up_proj: 5%|▌ | 1854/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.77.down_proj: 5%|▌ | 1855/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.78.gate_proj: 5%|▌ | 1856/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.78.up_proj: 5%|▌ | 1857/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.78.down_proj: 5%|▌ | 1858/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.79.gate_proj: 5%|▌ | 1859/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.79.up_proj: 5%|▌ | 1860/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.79.down_proj: 5%|▌ | 1861/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.80.gate_proj: 5%|▌ | 1862/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.80.up_proj: 5%|▌ | 1863/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.80.down_proj: 5%|▌ | 1864/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.81.gate_proj: 5%|▌ | 1865/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.81.up_proj: 5%|▌ | 1866/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.81.down_proj: 5%|▌ | 1867/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.82.gate_proj: 5%|▌ | 1868/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.82.up_proj: 5%|▌ | 1869/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.82.down_proj: 5%|▌ | 1870/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.83.gate_proj: 5%|▌ | 1871/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.83.up_proj: 5%|▌ | 1872/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.83.down_proj: 5%|▌ | 1873/36566 [00:02<00:30, 1155.07it/s] packing model.layers.3.mlp.experts.83.down_proj: 5%|▌ | 1874/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.84.gate_proj: 5%|▌ | 1874/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.84.up_proj: 5%|▌ | 1875/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.84.down_proj: 5%|▌ | 1876/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.85.gate_proj: 5%|▌ | 1877/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.85.up_proj: 5%|▌ | 1878/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.85.down_proj: 5%|▌ | 1879/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.86.gate_proj: 5%|▌ | 1880/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.86.up_proj: 5%|▌ | 1881/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.86.down_proj: 5%|▌ | 1882/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.87.gate_proj: 5%|▌ | 1883/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.87.up_proj: 5%|▌ | 1884/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.87.down_proj: 5%|▌ | 1885/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.88.gate_proj: 5%|▌ | 1886/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.88.up_proj: 5%|▌ | 1887/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.88.down_proj: 5%|▌ | 1888/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.89.gate_proj: 5%|▌ | 1889/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.89.up_proj: 5%|▌ | 1890/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.89.down_proj: 5%|▌ | 1891/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.90.gate_proj: 5%|▌ | 1892/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.90.up_proj: 5%|▌ | 1893/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.90.down_proj: 5%|▌ | 1894/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.91.gate_proj: 5%|▌ | 1895/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.91.up_proj: 5%|▌ | 1896/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.91.down_proj: 5%|▌ | 1897/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.92.gate_proj: 5%|▌ | 1898/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.92.up_proj: 5%|▌ | 1899/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.92.down_proj: 5%|▌ | 1900/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.93.gate_proj: 5%|▌ | 1901/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.93.up_proj: 5%|▌ | 1902/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.93.down_proj: 5%|▌ | 1903/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.94.gate_proj: 5%|▌ | 1904/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.94.up_proj: 5%|▌ | 1905/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.94.down_proj: 5%|▌ | 1906/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.95.gate_proj: 5%|▌ | 1907/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.95.up_proj: 5%|▌ | 1908/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.95.down_proj: 5%|▌ | 1909/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.96.gate_proj: 5%|▌ | 1910/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.96.up_proj: 5%|▌ | 1911/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.96.down_proj: 5%|▌ | 1912/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.97.gate_proj: 5%|▌ | 1913/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.97.up_proj: 5%|▌ | 1914/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.97.down_proj: 5%|▌ | 1915/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.98.gate_proj: 5%|▌ | 1916/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.98.up_proj: 5%|▌ | 1917/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.98.down_proj: 5%|▌ | 1918/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.99.gate_proj: 5%|▌ | 1919/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.99.up_proj: 5%|▌ | 1920/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.99.down_proj: 5%|▌ | 1921/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.100.gate_proj: 5%|▌ | 1922/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.100.up_proj: 5%|▌ | 1923/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.100.down_proj: 5%|▌ | 1924/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.101.gate_proj: 5%|▌ | 1925/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.101.up_proj: 5%|▌ | 1926/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.101.down_proj: 5%|▌ | 1927/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.102.gate_proj: 5%|▌ | 1928/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.102.up_proj: 5%|▌ | 1929/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.102.down_proj: 5%|▌ | 1930/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.103.gate_proj: 5%|▌ | 1931/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.103.up_proj: 5%|▌ | 1932/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.103.down_proj: 5%|▌ | 1933/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.104.gate_proj: 5%|▌ | 1934/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.104.up_proj: 5%|▌ | 1935/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.104.down_proj: 5%|▌ | 1936/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.105.gate_proj: 5%|▌ | 1937/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.105.up_proj: 5%|▌ | 1938/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.105.down_proj: 5%|▌ | 1939/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.106.gate_proj: 5%|▌ | 1940/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.106.up_proj: 5%|▌ | 1941/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.106.down_proj: 5%|▌ | 1942/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.107.gate_proj: 5%|▌ | 1943/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.107.up_proj: 5%|▌ | 1944/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.107.down_proj: 5%|▌ | 1945/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.108.gate_proj: 5%|▌ | 1946/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.108.up_proj: 5%|▌ | 1947/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.108.down_proj: 5%|▌ | 1948/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.109.gate_proj: 5%|▌ | 1949/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.109.up_proj: 5%|▌ | 1950/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.109.down_proj: 5%|▌ | 1951/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.110.gate_proj: 5%|▌ | 1952/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.110.up_proj: 5%|▌ | 1953/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.110.down_proj: 5%|▌ | 1954/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.111.gate_proj: 5%|▌ | 1955/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.111.up_proj: 5%|▌ | 1956/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.111.down_proj: 5%|▌ | 1957/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.112.gate_proj: 5%|▌ | 1958/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.112.up_proj: 5%|▌ | 1959/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.112.down_proj: 5%|▌ | 1960/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.113.gate_proj: 5%|▌ | 1961/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.113.up_proj: 5%|▌ | 1962/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.113.down_proj: 5%|▌ | 1963/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.114.gate_proj: 5%|▌ | 1964/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.114.up_proj: 5%|▌ | 1965/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.114.down_proj: 5%|▌ | 1966/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.115.gate_proj: 5%|▌ | 1967/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.115.up_proj: 5%|▌ | 1968/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.115.down_proj: 5%|▌ | 1969/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.116.gate_proj: 5%|▌ | 1970/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.116.up_proj: 5%|▌ | 1971/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.116.down_proj: 5%|▌ | 1972/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.117.gate_proj: 5%|▌ | 1973/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.117.up_proj: 5%|▌ | 1974/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.117.down_proj: 5%|▌ | 1975/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.118.gate_proj: 5%|▌ | 1976/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.118.up_proj: 5%|▌ | 1977/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.118.down_proj: 5%|▌ | 1978/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.119.gate_proj: 5%|▌ | 1979/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.119.up_proj: 5%|▌ | 1980/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.119.down_proj: 5%|▌ | 1981/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.120.gate_proj: 5%|▌ | 1982/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.120.up_proj: 5%|▌ | 1983/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.120.down_proj: 5%|▌ | 1984/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.121.gate_proj: 5%|▌ | 1985/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.121.up_proj: 5%|▌ | 1986/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.121.down_proj: 5%|▌ | 1987/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.122.gate_proj: 5%|▌ | 1988/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.122.up_proj: 5%|▌ | 1989/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.122.down_proj: 5%|▌ | 1990/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.123.gate_proj: 5%|▌ | 1991/36566 [00:02<00:29, 1159.52it/s] packing model.layers.3.mlp.experts.123.gate_proj: 5%|▌ | 1992/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.123.up_proj: 5%|▌ | 1992/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.123.down_proj: 5%|▌ | 1993/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.124.gate_proj: 5%|▌ | 1994/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.124.up_proj: 5%|▌ | 1995/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.124.down_proj: 5%|▌ | 1996/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.125.gate_proj: 5%|▌ | 1997/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.125.up_proj: 5%|▌ | 1998/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.125.down_proj: 5%|▌ | 1999/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.126.gate_proj: 5%|▌ | 2000/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.126.up_proj: 5%|▌ | 2001/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.126.down_proj: 5%|▌ | 2002/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.127.gate_proj: 5%|▌ | 2003/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.127.up_proj: 5%|▌ | 2004/36566 [00:02<00:29, 1162.61it/s] packing model.layers.3.mlp.experts.127.down_proj: 5%|▌ | 2005/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.0.gate_proj: 5%|▌ | 2006/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.0.up_proj: 5%|▌ | 2007/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.0.down_proj: 5%|▌ | 2008/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.1.gate_proj: 5%|▌ | 2009/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.1.up_proj: 5%|▌ | 2010/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.1.down_proj: 5%|▌ | 2011/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.2.gate_proj: 6%|▌ | 2012/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.2.up_proj: 6%|▌ | 2013/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.2.down_proj: 6%|▌ | 2014/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.3.gate_proj: 6%|▌ | 2015/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.3.up_proj: 6%|▌ | 2016/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.3.down_proj: 6%|▌ | 2017/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.4.gate_proj: 6%|▌ | 2018/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.4.up_proj: 6%|▌ | 2019/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.4.down_proj: 6%|▌ | 2020/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.5.gate_proj: 6%|▌ | 2021/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.5.up_proj: 6%|▌ | 2022/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.5.down_proj: 6%|▌ | 2023/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.6.gate_proj: 6%|▌ | 2024/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.6.up_proj: 6%|▌ | 2025/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.6.down_proj: 6%|▌ | 2026/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.7.gate_proj: 6%|▌ | 2027/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.7.up_proj: 6%|▌ | 2028/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.7.down_proj: 6%|▌ | 2029/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.8.gate_proj: 6%|▌ | 2030/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.8.up_proj: 6%|▌ | 2031/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.8.down_proj: 6%|▌ | 2032/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.9.gate_proj: 6%|▌ | 2033/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.9.up_proj: 6%|▌ | 2034/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.9.down_proj: 6%|▌ | 2035/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.10.gate_proj: 6%|▌ | 2036/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.10.up_proj: 6%|▌ | 2037/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.10.down_proj: 6%|▌ | 2038/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.11.gate_proj: 6%|▌ | 2039/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.11.up_proj: 6%|▌ | 2040/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.11.down_proj: 6%|▌ | 2041/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.12.gate_proj: 6%|▌ | 2042/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.12.up_proj: 6%|▌ | 2043/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.12.down_proj: 6%|▌ | 2044/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.13.gate_proj: 6%|▌ | 2045/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.13.up_proj: 6%|▌ | 2046/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.13.down_proj: 6%|▌ | 2047/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.14.gate_proj: 6%|▌ | 2048/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.14.up_proj: 6%|▌ | 2049/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.14.down_proj: 6%|▌ | 2050/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.15.gate_proj: 6%|▌ | 2051/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.15.up_proj: 6%|▌ | 2052/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.15.down_proj: 6%|▌ | 2053/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.16.gate_proj: 6%|▌ | 2054/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.16.up_proj: 6%|▌ | 2055/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.16.down_proj: 6%|▌ | 2056/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.17.gate_proj: 6%|▌ | 2057/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.17.up_proj: 6%|▌ | 2058/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.17.down_proj: 6%|▌ | 2059/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.18.gate_proj: 6%|▌ | 2060/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.18.up_proj: 6%|▌ | 2061/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.18.down_proj: 6%|▌ | 2062/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.19.gate_proj: 6%|▌ | 2063/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.19.up_proj: 6%|▌ | 2064/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.19.down_proj: 6%|▌ | 2065/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.20.gate_proj: 6%|▌ | 2066/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.20.up_proj: 6%|▌ | 2067/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.20.down_proj: 6%|▌ | 2068/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.21.gate_proj: 6%|▌ | 2069/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.21.up_proj: 6%|▌ | 2070/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.21.down_proj: 6%|▌ | 2071/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.22.gate_proj: 6%|▌ | 2072/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.22.up_proj: 6%|▌ | 2073/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.22.down_proj: 6%|▌ | 2074/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.23.gate_proj: 6%|▌ | 2075/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.23.up_proj: 6%|▌ | 2076/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.23.down_proj: 6%|▌ | 2077/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.24.gate_proj: 6%|▌ | 2078/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.24.up_proj: 6%|▌ | 2079/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.24.down_proj: 6%|▌ | 2080/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.25.gate_proj: 6%|▌ | 2081/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.25.up_proj: 6%|▌ | 2082/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.25.down_proj: 6%|▌ | 2083/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.26.gate_proj: 6%|▌ | 2084/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.26.up_proj: 6%|▌ | 2085/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.26.down_proj: 6%|▌ | 2086/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.27.gate_proj: 6%|▌ | 2087/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.27.up_proj: 6%|▌ | 2088/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.27.down_proj: 6%|▌ | 2089/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.28.gate_proj: 6%|▌ | 2090/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.28.up_proj: 6%|▌ | 2091/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.28.down_proj: 6%|▌ | 2092/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.29.gate_proj: 6%|▌ | 2093/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.29.up_proj: 6%|▌ | 2094/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.29.down_proj: 6%|▌ | 2095/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.30.gate_proj: 6%|▌ | 2096/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.30.up_proj: 6%|▌ | 2097/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.30.down_proj: 6%|▌ | 2098/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.31.gate_proj: 6%|▌ | 2099/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.31.up_proj: 6%|▌ | 2100/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.31.down_proj: 6%|▌ | 2101/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.32.gate_proj: 6%|▌ | 2102/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.32.up_proj: 6%|▌ | 2103/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.32.down_proj: 6%|▌ | 2104/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.33.gate_proj: 6%|▌ | 2105/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.33.up_proj: 6%|▌ | 2106/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.33.down_proj: 6%|▌ | 2107/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.34.gate_proj: 6%|▌ | 2108/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.34.up_proj: 6%|▌ | 2109/36566 [00:02<00:29, 1162.61it/s] packing model.layers.4.mlp.experts.34.up_proj: 6%|▌ | 2110/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.34.down_proj: 6%|▌ | 2110/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.35.gate_proj: 6%|▌ | 2111/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.35.up_proj: 6%|▌ | 2112/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.35.down_proj: 6%|▌ | 2113/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.36.gate_proj: 6%|▌ | 2114/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.36.up_proj: 6%|▌ | 2115/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.36.down_proj: 6%|▌ | 2116/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.37.gate_proj: 6%|▌ | 2117/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.37.up_proj: 6%|▌ | 2118/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.37.down_proj: 6%|▌ | 2119/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.38.gate_proj: 6%|▌ | 2120/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.38.up_proj: 6%|▌ | 2121/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.38.down_proj: 6%|▌ | 2122/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.39.gate_proj: 6%|▌ | 2123/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.39.up_proj: 6%|▌ | 2124/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.39.down_proj: 6%|▌ | 2125/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.40.gate_proj: 6%|▌ | 2126/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.40.up_proj: 6%|▌ | 2127/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.40.down_proj: 6%|▌ | 2128/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.41.gate_proj: 6%|▌ | 2129/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.41.up_proj: 6%|▌ | 2130/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.41.down_proj: 6%|▌ | 2131/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.42.gate_proj: 6%|▌ | 2132/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.42.up_proj: 6%|▌ | 2133/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.42.down_proj: 6%|▌ | 2134/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.43.gate_proj: 6%|▌ | 2135/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.43.up_proj: 6%|▌ | 2136/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.43.down_proj: 6%|▌ | 2137/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.44.gate_proj: 6%|▌ | 2138/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.44.up_proj: 6%|▌ | 2139/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.44.down_proj: 6%|▌ | 2140/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.45.gate_proj: 6%|▌ | 2141/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.45.up_proj: 6%|▌ | 2142/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.45.down_proj: 6%|▌ | 2143/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.46.gate_proj: 6%|▌ | 2144/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.46.up_proj: 6%|▌ | 2145/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.46.down_proj: 6%|▌ | 2146/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.47.gate_proj: 6%|▌ | 2147/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.47.up_proj: 6%|▌ | 2148/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.47.down_proj: 6%|▌ | 2149/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.48.gate_proj: 6%|▌ | 2150/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.48.up_proj: 6%|▌ | 2151/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.48.down_proj: 6%|▌ | 2152/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.49.gate_proj: 6%|▌ | 2153/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.49.up_proj: 6%|▌ | 2154/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.49.down_proj: 6%|▌ | 2155/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.50.gate_proj: 6%|▌ | 2156/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.50.up_proj: 6%|▌ | 2157/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.50.down_proj: 6%|▌ | 2158/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.51.gate_proj: 6%|▌ | 2159/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.51.up_proj: 6%|▌ | 2160/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.51.down_proj: 6%|▌ | 2161/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.52.gate_proj: 6%|▌ | 2162/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.52.up_proj: 6%|▌ | 2163/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.52.down_proj: 6%|▌ | 2164/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.53.gate_proj: 6%|▌ | 2165/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.53.up_proj: 6%|▌ | 2166/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.53.down_proj: 6%|▌ | 2167/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.54.gate_proj: 6%|▌ | 2168/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.54.up_proj: 6%|▌ | 2169/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.54.down_proj: 6%|▌ | 2170/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.55.gate_proj: 6%|▌ | 2171/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.55.up_proj: 6%|▌ | 2172/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.55.down_proj: 6%|▌ | 2173/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.56.gate_proj: 6%|▌ | 2174/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.56.up_proj: 6%|▌ | 2175/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.56.down_proj: 6%|▌ | 2176/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.57.gate_proj: 6%|▌ | 2177/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.57.up_proj: 6%|▌ | 2178/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.57.down_proj: 6%|▌ | 2179/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.58.gate_proj: 6%|▌ | 2180/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.58.up_proj: 6%|▌ | 2181/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.58.down_proj: 6%|▌ | 2182/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.59.gate_proj: 6%|▌ | 2183/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.59.up_proj: 6%|▌ | 2184/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.59.down_proj: 6%|▌ | 2185/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.60.gate_proj: 6%|▌ | 2186/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.60.up_proj: 6%|▌ | 2187/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.60.down_proj: 6%|▌ | 2188/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.61.gate_proj: 6%|▌ | 2189/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.61.up_proj: 6%|▌ | 2190/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.61.down_proj: 6%|▌ | 2191/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.62.gate_proj: 6%|▌ | 2192/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.62.up_proj: 6%|▌ | 2193/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.62.down_proj: 6%|▌ | 2194/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.63.gate_proj: 6%|▌ | 2195/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.63.up_proj: 6%|▌ | 2196/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.63.down_proj: 6%|▌ | 2197/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.64.gate_proj: 6%|▌ | 2198/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.64.up_proj: 6%|▌ | 2199/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.64.down_proj: 6%|▌ | 2200/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.65.gate_proj: 6%|▌ | 2201/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.65.up_proj: 6%|▌ | 2202/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.65.down_proj: 6%|▌ | 2203/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.66.gate_proj: 6%|▌ | 2204/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.66.up_proj: 6%|▌ | 2205/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.66.down_proj: 6%|▌ | 2206/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.67.gate_proj: 6%|▌ | 2207/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.67.up_proj: 6%|▌ | 2208/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.67.down_proj: 6%|▌ | 2209/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.68.gate_proj: 6%|▌ | 2210/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.68.up_proj: 6%|▌ | 2211/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.68.down_proj: 6%|▌ | 2212/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.69.gate_proj: 6%|▌ | 2213/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.69.up_proj: 6%|▌ | 2214/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.69.down_proj: 6%|▌ | 2215/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.70.gate_proj: 6%|▌ | 2216/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.70.up_proj: 6%|▌ | 2217/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.70.down_proj: 6%|▌ | 2218/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.71.gate_proj: 6%|▌ | 2219/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.71.up_proj: 6%|▌ | 2220/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.71.down_proj: 6%|▌ | 2221/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.72.gate_proj: 6%|▌ | 2222/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.72.up_proj: 6%|▌ | 2223/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.72.down_proj: 6%|▌ | 2224/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.73.gate_proj: 6%|▌ | 2225/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.73.up_proj: 6%|▌ | 2226/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.73.down_proj: 6%|▌ | 2227/36566 [00:02<00:29, 1163.98it/s] packing model.layers.4.mlp.experts.73.down_proj: 6%|▌ | 2228/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.74.gate_proj: 6%|▌ | 2228/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.74.up_proj: 6%|▌ | 2229/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.74.down_proj: 6%|▌ | 2230/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.75.gate_proj: 6%|▌ | 2231/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.75.up_proj: 6%|▌ | 2232/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.75.down_proj: 6%|▌ | 2233/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.76.gate_proj: 6%|▌ | 2234/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.76.up_proj: 6%|▌ | 2235/36566 [00:02<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.76.down_proj: 6%|▌ | 2236/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.77.gate_proj: 6%|▌ | 2237/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.77.up_proj: 6%|▌ | 2238/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.77.down_proj: 6%|▌ | 2239/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.78.gate_proj: 6%|▌ | 2240/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.78.up_proj: 6%|▌ | 2241/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.78.down_proj: 6%|▌ | 2242/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.79.gate_proj: 6%|▌ | 2243/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.79.up_proj: 6%|▌ | 2244/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.79.down_proj: 6%|▌ | 2245/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.80.gate_proj: 6%|▌ | 2246/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.80.up_proj: 6%|▌ | 2247/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.80.down_proj: 6%|▌ | 2248/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.81.gate_proj: 6%|▌ | 2249/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.81.up_proj: 6%|▌ | 2250/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.81.down_proj: 6%|▌ | 2251/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.82.gate_proj: 6%|▌ | 2252/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.82.up_proj: 6%|▌ | 2253/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.82.down_proj: 6%|▌ | 2254/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.83.gate_proj: 6%|▌ | 2255/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.83.up_proj: 6%|▌ | 2256/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.83.down_proj: 6%|▌ | 2257/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.84.gate_proj: 6%|▌ | 2258/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.84.up_proj: 6%|▌ | 2259/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.84.down_proj: 6%|▌ | 2260/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.85.gate_proj: 6%|▌ | 2261/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.85.up_proj: 6%|▌ | 2262/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.85.down_proj: 6%|▌ | 2263/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.86.gate_proj: 6%|▌ | 2264/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.86.up_proj: 6%|▌ | 2265/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.86.down_proj: 6%|▌ | 2266/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.87.gate_proj: 6%|▌ | 2267/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.87.up_proj: 6%|▌ | 2268/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.87.down_proj: 6%|▌ | 2269/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.88.gate_proj: 6%|▌ | 2270/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.88.up_proj: 6%|▌ | 2271/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.88.down_proj: 6%|▌ | 2272/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.89.gate_proj: 6%|▌ | 2273/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.89.up_proj: 6%|▌ | 2274/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.89.down_proj: 6%|▌ | 2275/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.90.gate_proj: 6%|▌ | 2276/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.90.up_proj: 6%|▌ | 2277/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.90.down_proj: 6%|▌ | 2278/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.91.gate_proj: 6%|▌ | 2279/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.91.up_proj: 6%|▌ | 2280/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.91.down_proj: 6%|▌ | 2281/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.92.gate_proj: 6%|▌ | 2282/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.92.up_proj: 6%|▌ | 2283/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.92.down_proj: 6%|▌ | 2284/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.93.gate_proj: 6%|▌ | 2285/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.93.up_proj: 6%|▋ | 2286/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.93.down_proj: 6%|▋ | 2287/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.94.gate_proj: 6%|▋ | 2288/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.94.up_proj: 6%|▋ | 2289/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.94.down_proj: 6%|▋ | 2290/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.95.gate_proj: 6%|▋ | 2291/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.95.up_proj: 6%|▋ | 2292/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.95.down_proj: 6%|▋ | 2293/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.96.gate_proj: 6%|▋ | 2294/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.96.up_proj: 6%|▋ | 2295/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.96.down_proj: 6%|▋ | 2296/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.97.gate_proj: 6%|▋ | 2297/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.97.up_proj: 6%|▋ | 2298/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.97.down_proj: 6%|▋ | 2299/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.98.gate_proj: 6%|▋ | 2300/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.98.up_proj: 6%|▋ | 2301/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.98.down_proj: 6%|▋ | 2302/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.99.gate_proj: 6%|▋ | 2303/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.99.up_proj: 6%|▋ | 2304/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.99.down_proj: 6%|▋ | 2305/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.100.gate_proj: 6%|▋ | 2306/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.100.up_proj: 6%|▋ | 2307/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.100.down_proj: 6%|▋ | 2308/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.101.gate_proj: 6%|▋ | 2309/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.101.up_proj: 6%|▋ | 2310/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.101.down_proj: 6%|▋ | 2311/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.102.gate_proj: 6%|▋ | 2312/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.102.up_proj: 6%|▋ | 2313/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.102.down_proj: 6%|▋ | 2314/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.103.gate_proj: 6%|▋ | 2315/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.103.up_proj: 6%|▋ | 2316/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.103.down_proj: 6%|▋ | 2317/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.104.gate_proj: 6%|▋ | 2318/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.104.up_proj: 6%|▋ | 2319/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.104.down_proj: 6%|▋ | 2320/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.105.gate_proj: 6%|▋ | 2321/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.105.up_proj: 6%|▋ | 2322/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.105.down_proj: 6%|▋ | 2323/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.106.gate_proj: 6%|▋ | 2324/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.106.up_proj: 6%|▋ | 2325/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.106.down_proj: 6%|▋ | 2326/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.107.gate_proj: 6%|▋ | 2327/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.107.up_proj: 6%|▋ | 2328/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.107.down_proj: 6%|▋ | 2329/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.108.gate_proj: 6%|▋ | 2330/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.108.up_proj: 6%|▋ | 2331/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.108.down_proj: 6%|▋ | 2332/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.109.gate_proj: 6%|▋ | 2333/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.109.up_proj: 6%|▋ | 2334/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.109.down_proj: 6%|▋ | 2335/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.110.gate_proj: 6%|▋ | 2336/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.110.up_proj: 6%|▋ | 2337/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.110.down_proj: 6%|▋ | 2338/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.111.gate_proj: 6%|▋ | 2339/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.111.up_proj: 6%|▋ | 2340/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.111.down_proj: 6%|▋ | 2341/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.112.gate_proj: 6%|▋ | 2342/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.112.up_proj: 6%|▋ | 2343/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.112.down_proj: 6%|▋ | 2344/36566 [00:03<00:29, 1165.87it/s] packing model.layers.4.mlp.experts.112.down_proj: 6%|▋ | 2345/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.113.gate_proj: 6%|▋ | 2345/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.113.up_proj: 6%|▋ | 2346/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.113.down_proj: 6%|▋ | 2347/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.114.gate_proj: 6%|▋ | 2348/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.114.up_proj: 6%|▋ | 2349/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.114.down_proj: 6%|▋ | 2350/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.115.gate_proj: 6%|▋ | 2351/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.115.up_proj: 6%|▋ | 2352/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.115.down_proj: 6%|▋ | 2353/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.116.gate_proj: 6%|▋ | 2354/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.116.up_proj: 6%|▋ | 2355/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.116.down_proj: 6%|▋ | 2356/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.117.gate_proj: 6%|▋ | 2357/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.117.up_proj: 6%|▋ | 2358/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.117.down_proj: 6%|▋ | 2359/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.118.gate_proj: 6%|▋ | 2360/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.118.up_proj: 6%|▋ | 2361/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.118.down_proj: 6%|▋ | 2362/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.119.gate_proj: 6%|▋ | 2363/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.119.up_proj: 6%|▋ | 2364/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.119.down_proj: 6%|▋ | 2365/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.120.gate_proj: 6%|▋ | 2366/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.120.up_proj: 6%|▋ | 2367/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.120.down_proj: 6%|▋ | 2368/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.121.gate_proj: 6%|▋ | 2369/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.121.up_proj: 6%|▋ | 2370/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.121.down_proj: 6%|▋ | 2371/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.122.gate_proj: 6%|▋ | 2372/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.122.up_proj: 6%|▋ | 2373/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.122.down_proj: 6%|▋ | 2374/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.123.gate_proj: 6%|▋ | 2375/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.123.up_proj: 6%|▋ | 2376/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.123.down_proj: 7%|▋ | 2377/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.124.gate_proj: 7%|▋ | 2378/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.124.up_proj: 7%|▋ | 2379/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.124.down_proj: 7%|▋ | 2380/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.125.gate_proj: 7%|▋ | 2381/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.125.up_proj: 7%|▋ | 2382/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.125.down_proj: 7%|▋ | 2383/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.126.gate_proj: 7%|▋ | 2384/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.126.up_proj: 7%|▋ | 2385/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.126.down_proj: 7%|▋ | 2386/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.127.gate_proj: 7%|▋ | 2387/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.127.up_proj: 7%|▋ | 2388/36566 [00:03<00:29, 1166.28it/s] packing model.layers.4.mlp.experts.127.down_proj: 7%|▋ | 2389/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.0.gate_proj: 7%|▋ | 2390/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.0.up_proj: 7%|▋ | 2391/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.0.down_proj: 7%|▋ | 2392/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.1.gate_proj: 7%|▋ | 2393/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.1.up_proj: 7%|▋ | 2394/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.1.down_proj: 7%|▋ | 2395/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.2.gate_proj: 7%|▋ | 2396/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.2.up_proj: 7%|▋ | 2397/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.2.down_proj: 7%|▋ | 2398/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.3.gate_proj: 7%|▋ | 2399/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.3.up_proj: 7%|▋ | 2400/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.3.down_proj: 7%|▋ | 2401/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.4.gate_proj: 7%|▋ | 2402/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.4.up_proj: 7%|▋ | 2403/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.4.down_proj: 7%|▋ | 2404/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.5.gate_proj: 7%|▋ | 2405/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.5.up_proj: 7%|▋ | 2406/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.5.down_proj: 7%|▋ | 2407/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.6.gate_proj: 7%|▋ | 2408/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.6.up_proj: 7%|▋ | 2409/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.6.down_proj: 7%|▋ | 2410/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.7.gate_proj: 7%|▋ | 2411/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.7.up_proj: 7%|▋ | 2412/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.7.down_proj: 7%|▋ | 2413/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.8.gate_proj: 7%|▋ | 2414/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.8.up_proj: 7%|▋ | 2415/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.8.down_proj: 7%|▋ | 2416/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.9.gate_proj: 7%|▋ | 2417/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.9.up_proj: 7%|▋ | 2418/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.9.down_proj: 7%|▋ | 2419/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.10.gate_proj: 7%|▋ | 2420/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.10.up_proj: 7%|▋ | 2421/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.10.down_proj: 7%|▋ | 2422/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.11.gate_proj: 7%|▋ | 2423/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.11.up_proj: 7%|▋ | 2424/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.11.down_proj: 7%|▋ | 2425/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.12.gate_proj: 7%|▋ | 2426/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.12.up_proj: 7%|▋ | 2427/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.12.down_proj: 7%|▋ | 2428/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.13.gate_proj: 7%|▋ | 2429/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.13.up_proj: 7%|▋ | 2430/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.13.down_proj: 7%|▋ | 2431/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.14.gate_proj: 7%|▋ | 2432/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.14.up_proj: 7%|▋ | 2433/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.14.down_proj: 7%|▋ | 2434/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.15.gate_proj: 7%|▋ | 2435/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.15.up_proj: 7%|▋ | 2436/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.15.down_proj: 7%|▋ | 2437/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.16.gate_proj: 7%|▋ | 2438/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.16.up_proj: 7%|▋ | 2439/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.16.down_proj: 7%|▋ | 2440/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.17.gate_proj: 7%|▋ | 2441/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.17.up_proj: 7%|▋ | 2442/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.17.down_proj: 7%|▋ | 2443/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.18.gate_proj: 7%|▋ | 2444/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.18.up_proj: 7%|▋ | 2445/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.18.down_proj: 7%|▋ | 2446/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.19.gate_proj: 7%|▋ | 2447/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.19.up_proj: 7%|▋ | 2448/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.19.down_proj: 7%|▋ | 2449/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.20.gate_proj: 7%|▋ | 2450/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.20.up_proj: 7%|▋ | 2451/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.20.down_proj: 7%|▋ | 2452/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.21.gate_proj: 7%|▋ | 2453/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.21.up_proj: 7%|▋ | 2454/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.21.down_proj: 7%|▋ | 2455/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.22.gate_proj: 7%|▋ | 2456/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.22.up_proj: 7%|▋ | 2457/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.22.down_proj: 7%|▋ | 2458/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.23.gate_proj: 7%|▋ | 2459/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.23.up_proj: 7%|▋ | 2460/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.23.down_proj: 7%|▋ | 2461/36566 [00:03<00:29, 1166.28it/s] packing model.layers.5.mlp.experts.23.down_proj: 7%|▋ | 2462/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.24.gate_proj: 7%|▋ | 2462/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.24.up_proj: 7%|▋ | 2463/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.24.down_proj: 7%|▋ | 2464/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.25.gate_proj: 7%|▋ | 2465/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.25.up_proj: 7%|▋ | 2466/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.25.down_proj: 7%|▋ | 2467/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.26.gate_proj: 7%|▋ | 2468/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.26.up_proj: 7%|▋ | 2469/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.26.down_proj: 7%|▋ | 2470/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.27.gate_proj: 7%|▋ | 2471/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.27.up_proj: 7%|▋ | 2472/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.27.down_proj: 7%|▋ | 2473/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.28.gate_proj: 7%|▋ | 2474/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.28.up_proj: 7%|▋ | 2475/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.28.down_proj: 7%|▋ | 2476/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.29.gate_proj: 7%|▋ | 2477/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.29.up_proj: 7%|▋ | 2478/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.29.down_proj: 7%|▋ | 2479/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.30.gate_proj: 7%|▋ | 2480/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.30.up_proj: 7%|▋ | 2481/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.30.down_proj: 7%|▋ | 2482/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.31.gate_proj: 7%|▋ | 2483/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.31.up_proj: 7%|▋ | 2484/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.31.down_proj: 7%|▋ | 2485/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.32.gate_proj: 7%|▋ | 2486/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.32.up_proj: 7%|▋ | 2487/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.32.down_proj: 7%|▋ | 2488/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.33.gate_proj: 7%|▋ | 2489/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.33.up_proj: 7%|▋ | 2490/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.33.down_proj: 7%|▋ | 2491/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.34.gate_proj: 7%|▋ | 2492/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.34.up_proj: 7%|▋ | 2493/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.34.down_proj: 7%|▋ | 2494/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.35.gate_proj: 7%|▋ | 2495/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.35.up_proj: 7%|▋ | 2496/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.35.down_proj: 7%|▋ | 2497/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.36.gate_proj: 7%|▋ | 2498/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.36.up_proj: 7%|▋ | 2499/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.36.down_proj: 7%|▋ | 2500/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.37.gate_proj: 7%|▋ | 2501/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.37.up_proj: 7%|▋ | 2502/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.37.down_proj: 7%|▋ | 2503/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.38.gate_proj: 7%|▋ | 2504/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.38.up_proj: 7%|▋ | 2505/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.38.down_proj: 7%|▋ | 2506/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.39.gate_proj: 7%|▋ | 2507/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.39.up_proj: 7%|▋ | 2508/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.39.down_proj: 7%|▋ | 2509/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.40.gate_proj: 7%|▋ | 2510/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.40.up_proj: 7%|▋ | 2511/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.40.down_proj: 7%|▋ | 2512/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.41.gate_proj: 7%|▋ | 2513/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.41.up_proj: 7%|▋ | 2514/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.41.down_proj: 7%|▋ | 2515/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.42.gate_proj: 7%|▋ | 2516/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.42.up_proj: 7%|▋ | 2517/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.42.down_proj: 7%|▋ | 2518/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.43.gate_proj: 7%|▋ | 2519/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.43.up_proj: 7%|▋ | 2520/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.43.down_proj: 7%|▋ | 2521/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.44.gate_proj: 7%|▋ | 2522/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.44.up_proj: 7%|▋ | 2523/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.44.down_proj: 7%|▋ | 2524/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.45.gate_proj: 7%|▋ | 2525/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.45.up_proj: 7%|▋ | 2526/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.45.down_proj: 7%|▋ | 2527/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.46.gate_proj: 7%|▋ | 2528/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.46.up_proj: 7%|▋ | 2529/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.46.down_proj: 7%|▋ | 2530/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.47.gate_proj: 7%|▋ | 2531/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.47.up_proj: 7%|▋ | 2532/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.47.down_proj: 7%|▋ | 2533/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.48.gate_proj: 7%|▋ | 2534/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.48.up_proj: 7%|▋ | 2535/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.48.down_proj: 7%|▋ | 2536/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.49.gate_proj: 7%|▋ | 2537/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.49.up_proj: 7%|▋ | 2538/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.49.down_proj: 7%|▋ | 2539/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.50.gate_proj: 7%|▋ | 2540/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.50.up_proj: 7%|▋ | 2541/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.50.down_proj: 7%|▋ | 2542/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.51.gate_proj: 7%|▋ | 2543/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.51.up_proj: 7%|▋ | 2544/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.51.down_proj: 7%|▋ | 2545/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.52.gate_proj: 7%|▋ | 2546/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.52.up_proj: 7%|▋ | 2547/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.52.down_proj: 7%|▋ | 2548/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.53.gate_proj: 7%|▋ | 2549/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.53.up_proj: 7%|▋ | 2550/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.53.down_proj: 7%|▋ | 2551/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.54.gate_proj: 7%|▋ | 2552/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.54.up_proj: 7%|▋ | 2553/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.54.down_proj: 7%|▋ | 2554/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.55.gate_proj: 7%|▋ | 2555/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.55.up_proj: 7%|▋ | 2556/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.55.down_proj: 7%|▋ | 2557/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.56.gate_proj: 7%|▋ | 2558/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.56.up_proj: 7%|▋ | 2559/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.56.down_proj: 7%|▋ | 2560/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.57.gate_proj: 7%|▋ | 2561/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.57.up_proj: 7%|▋ | 2562/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.57.down_proj: 7%|▋ | 2563/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.58.gate_proj: 7%|▋ | 2564/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.58.up_proj: 7%|▋ | 2565/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.58.down_proj: 7%|▋ | 2566/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.59.gate_proj: 7%|▋ | 2567/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.59.up_proj: 7%|▋ | 2568/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.59.down_proj: 7%|▋ | 2569/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.60.gate_proj: 7%|▋ | 2570/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.60.up_proj: 7%|▋ | 2571/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.60.down_proj: 7%|▋ | 2572/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.61.gate_proj: 7%|▋ | 2573/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.61.up_proj: 7%|▋ | 2574/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.61.down_proj: 7%|▋ | 2575/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.62.gate_proj: 7%|▋ | 2576/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.62.up_proj: 7%|▋ | 2577/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.62.down_proj: 7%|▋ | 2578/36566 [00:03<00:29, 1166.69it/s] packing model.layers.5.mlp.experts.62.down_proj: 7%|▋ | 2579/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.63.gate_proj: 7%|▋ | 2579/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.63.up_proj: 7%|▋ | 2580/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.63.down_proj: 7%|▋ | 2581/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.64.gate_proj: 7%|▋ | 2582/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.64.up_proj: 7%|▋ | 2583/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.64.down_proj: 7%|▋ | 2584/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.65.gate_proj: 7%|▋ | 2585/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.65.up_proj: 7%|▋ | 2586/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.65.down_proj: 7%|▋ | 2587/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.66.gate_proj: 7%|▋ | 2588/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.66.up_proj: 7%|▋ | 2589/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.66.down_proj: 7%|▋ | 2590/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.67.gate_proj: 7%|▋ | 2591/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.67.up_proj: 7%|▋ | 2592/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.67.down_proj: 7%|▋ | 2593/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.68.gate_proj: 7%|▋ | 2594/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.68.up_proj: 7%|▋ | 2595/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.68.down_proj: 7%|▋ | 2596/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.69.gate_proj: 7%|▋ | 2597/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.69.up_proj: 7%|▋ | 2598/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.69.down_proj: 7%|▋ | 2599/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.70.gate_proj: 7%|▋ | 2600/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.70.up_proj: 7%|▋ | 2601/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.70.down_proj: 7%|▋ | 2602/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.71.gate_proj: 7%|▋ | 2603/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.71.up_proj: 7%|▋ | 2604/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.71.down_proj: 7%|▋ | 2605/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.72.gate_proj: 7%|▋ | 2606/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.72.up_proj: 7%|▋ | 2607/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.72.down_proj: 7%|▋ | 2608/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.73.gate_proj: 7%|▋ | 2609/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.73.up_proj: 7%|▋ | 2610/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.73.down_proj: 7%|▋ | 2611/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.74.gate_proj: 7%|▋ | 2612/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.74.up_proj: 7%|▋ | 2613/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.74.down_proj: 7%|▋ | 2614/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.75.gate_proj: 7%|▋ | 2615/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.75.up_proj: 7%|▋ | 2616/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.75.down_proj: 7%|▋ | 2617/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.76.gate_proj: 7%|▋ | 2618/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.76.up_proj: 7%|▋ | 2619/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.76.down_proj: 7%|▋ | 2620/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.77.gate_proj: 7%|▋ | 2621/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.77.up_proj: 7%|▋ | 2622/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.77.down_proj: 7%|▋ | 2623/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.78.gate_proj: 7%|▋ | 2624/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.78.up_proj: 7%|▋ | 2625/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.78.down_proj: 7%|▋ | 2626/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.79.gate_proj: 7%|▋ | 2627/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.79.up_proj: 7%|▋ | 2628/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.79.down_proj: 7%|▋ | 2629/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.80.gate_proj: 7%|▋ | 2630/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.80.up_proj: 7%|▋ | 2631/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.80.down_proj: 7%|▋ | 2632/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.81.gate_proj: 7%|▋ | 2633/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.81.up_proj: 7%|▋ | 2634/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.81.down_proj: 7%|▋ | 2635/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.82.gate_proj: 7%|▋ | 2636/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.82.up_proj: 7%|▋ | 2637/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.82.down_proj: 7%|▋ | 2638/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.83.gate_proj: 7%|▋ | 2639/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.83.up_proj: 7%|▋ | 2640/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.83.down_proj: 7%|▋ | 2641/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.84.gate_proj: 7%|▋ | 2642/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.84.up_proj: 7%|▋ | 2643/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.84.down_proj: 7%|▋ | 2644/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.85.gate_proj: 7%|▋ | 2645/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.85.up_proj: 7%|▋ | 2646/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.85.down_proj: 7%|▋ | 2647/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.86.gate_proj: 7%|▋ | 2648/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.86.up_proj: 7%|▋ | 2649/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.86.down_proj: 7%|▋ | 2650/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.87.gate_proj: 7%|▋ | 2651/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.87.up_proj: 7%|▋ | 2652/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.87.down_proj: 7%|▋ | 2653/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.88.gate_proj: 7%|▋ | 2654/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.88.up_proj: 7%|▋ | 2655/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.88.down_proj: 7%|▋ | 2656/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.89.gate_proj: 7%|▋ | 2657/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.89.up_proj: 7%|▋ | 2658/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.89.down_proj: 7%|▋ | 2659/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.90.gate_proj: 7%|▋ | 2660/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.90.up_proj: 7%|▋ | 2661/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.90.down_proj: 7%|▋ | 2662/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.91.gate_proj: 7%|▋ | 2663/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.91.up_proj: 7%|▋ | 2664/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.91.down_proj: 7%|▋ | 2665/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.92.gate_proj: 7%|▋ | 2666/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.92.up_proj: 7%|▋ | 2667/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.92.down_proj: 7%|▋ | 2668/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.93.gate_proj: 7%|▋ | 2669/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.93.up_proj: 7%|▋ | 2670/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.93.down_proj: 7%|▋ | 2671/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.94.gate_proj: 7%|▋ | 2672/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.94.up_proj: 7%|▋ | 2673/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.94.down_proj: 7%|▋ | 2674/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.95.gate_proj: 7%|▋ | 2675/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.95.up_proj: 7%|▋ | 2676/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.95.down_proj: 7%|▋ | 2677/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.96.gate_proj: 7%|▋ | 2678/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.96.up_proj: 7%|▋ | 2679/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.96.down_proj: 7%|▋ | 2680/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.97.gate_proj: 7%|▋ | 2681/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.97.up_proj: 7%|▋ | 2682/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.97.down_proj: 7%|▋ | 2683/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.98.gate_proj: 7%|▋ | 2684/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.98.up_proj: 7%|▋ | 2685/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.98.down_proj: 7%|▋ | 2686/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.99.gate_proj: 7%|▋ | 2687/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.99.up_proj: 7%|▋ | 2688/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.99.down_proj: 7%|▋ | 2689/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.100.gate_proj: 7%|▋ | 2690/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.100.up_proj: 7%|▋ | 2691/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.100.down_proj: 7%|▋ | 2692/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.101.gate_proj: 7%|▋ | 2693/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.101.up_proj: 7%|▋ | 2694/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.101.down_proj: 7%|▋ | 2695/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.102.gate_proj: 7%|▋ | 2696/36566 [00:03<00:29, 1167.54it/s] packing model.layers.5.mlp.experts.102.gate_proj: 7%|▋ | 2697/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.102.up_proj: 7%|▋ | 2697/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.102.down_proj: 7%|▋ | 2698/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.103.gate_proj: 7%|▋ | 2699/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.103.up_proj: 7%|▋ | 2700/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.103.down_proj: 7%|▋ | 2701/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.104.gate_proj: 7%|▋ | 2702/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.104.up_proj: 7%|▋ | 2703/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.104.down_proj: 7%|▋ | 2704/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.105.gate_proj: 7%|▋ | 2705/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.105.up_proj: 7%|▋ | 2706/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.105.down_proj: 7%|▋ | 2707/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.106.gate_proj: 7%|▋ | 2708/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.106.up_proj: 7%|▋ | 2709/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.106.down_proj: 7%|▋ | 2710/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.107.gate_proj: 7%|▋ | 2711/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.107.up_proj: 7%|▋ | 2712/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.107.down_proj: 7%|▋ | 2713/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.108.gate_proj: 7%|▋ | 2714/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.108.up_proj: 7%|▋ | 2715/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.108.down_proj: 7%|▋ | 2716/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.109.gate_proj: 7%|▋ | 2717/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.109.up_proj: 7%|▋ | 2718/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.109.down_proj: 7%|▋ | 2719/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.110.gate_proj: 7%|▋ | 2720/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.110.up_proj: 7%|▋ | 2721/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.110.down_proj: 7%|▋ | 2722/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.111.gate_proj: 7%|▋ | 2723/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.111.up_proj: 7%|▋ | 2724/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.111.down_proj: 7%|▋ | 2725/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.112.gate_proj: 7%|▋ | 2726/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.112.up_proj: 7%|▋ | 2727/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.112.down_proj: 7%|▋ | 2728/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.113.gate_proj: 7%|▋ | 2729/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.113.up_proj: 7%|▋ | 2730/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.113.down_proj: 7%|▋ | 2731/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.114.gate_proj: 7%|▋ | 2732/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.114.up_proj: 7%|▋ | 2733/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.114.down_proj: 7%|▋ | 2734/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.115.gate_proj: 7%|▋ | 2735/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.115.up_proj: 7%|▋ | 2736/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.115.down_proj: 7%|▋ | 2737/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.116.gate_proj: 7%|▋ | 2738/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.116.up_proj: 7%|▋ | 2739/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.116.down_proj: 7%|▋ | 2740/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.117.gate_proj: 7%|▋ | 2741/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.117.up_proj: 7%|▋ | 2742/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.117.down_proj: 8%|▊ | 2743/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.118.gate_proj: 8%|▊ | 2744/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.118.up_proj: 8%|▊ | 2745/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.118.down_proj: 8%|▊ | 2746/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.119.gate_proj: 8%|▊ | 2747/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.119.up_proj: 8%|▊ | 2748/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.119.down_proj: 8%|▊ | 2749/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.120.gate_proj: 8%|▊ | 2750/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.120.up_proj: 8%|▊ | 2751/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.120.down_proj: 8%|▊ | 2752/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.121.gate_proj: 8%|▊ | 2753/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.121.up_proj: 8%|▊ | 2754/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.121.down_proj: 8%|▊ | 2755/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.122.gate_proj: 8%|▊ | 2756/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.122.up_proj: 8%|▊ | 2757/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.122.down_proj: 8%|▊ | 2758/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.123.gate_proj: 8%|▊ | 2759/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.123.up_proj: 8%|▊ | 2760/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.123.down_proj: 8%|▊ | 2761/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.124.gate_proj: 8%|▊ | 2762/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.124.up_proj: 8%|▊ | 2763/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.124.down_proj: 8%|▊ | 2764/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.125.gate_proj: 8%|▊ | 2765/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.125.up_proj: 8%|▊ | 2766/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.125.down_proj: 8%|▊ | 2767/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.126.gate_proj: 8%|▊ | 2768/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.126.up_proj: 8%|▊ | 2769/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.126.down_proj: 8%|▊ | 2770/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.127.gate_proj: 8%|▊ | 2771/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.127.up_proj: 8%|▊ | 2772/36566 [00:03<00:28, 1168.81it/s] packing model.layers.5.mlp.experts.127.down_proj: 8%|▊ | 2773/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.0.gate_proj: 8%|▊ | 2774/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.0.up_proj: 8%|▊ | 2775/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.0.down_proj: 8%|▊ | 2776/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.1.gate_proj: 8%|▊ | 2777/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.1.up_proj: 8%|▊ | 2778/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.1.down_proj: 8%|▊ | 2779/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.2.gate_proj: 8%|▊ | 2780/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.2.up_proj: 8%|▊ | 2781/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.2.down_proj: 8%|▊ | 2782/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.3.gate_proj: 8%|▊ | 2783/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.3.up_proj: 8%|▊ | 2784/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.3.down_proj: 8%|▊ | 2785/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.4.gate_proj: 8%|▊ | 2786/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.4.up_proj: 8%|▊ | 2787/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.4.down_proj: 8%|▊ | 2788/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.5.gate_proj: 8%|▊ | 2789/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.5.up_proj: 8%|▊ | 2790/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.5.down_proj: 8%|▊ | 2791/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.6.gate_proj: 8%|▊ | 2792/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.6.up_proj: 8%|▊ | 2793/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.6.down_proj: 8%|▊ | 2794/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.7.gate_proj: 8%|▊ | 2795/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.7.up_proj: 8%|▊ | 2796/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.7.down_proj: 8%|▊ | 2797/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.8.gate_proj: 8%|▊ | 2798/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.8.up_proj: 8%|▊ | 2799/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.8.down_proj: 8%|▊ | 2800/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.9.gate_proj: 8%|▊ | 2801/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.9.up_proj: 8%|▊ | 2802/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.9.down_proj: 8%|▊ | 2803/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.10.gate_proj: 8%|▊ | 2804/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.10.up_proj: 8%|▊ | 2805/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.10.down_proj: 8%|▊ | 2806/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.11.gate_proj: 8%|▊ | 2807/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.11.up_proj: 8%|▊ | 2808/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.11.down_proj: 8%|▊ | 2809/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.12.gate_proj: 8%|▊ | 2810/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.12.up_proj: 8%|▊ | 2811/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.12.down_proj: 8%|▊ | 2812/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.13.gate_proj: 8%|▊ | 2813/36566 [00:03<00:28, 1168.81it/s] packing model.layers.6.mlp.experts.13.gate_proj: 8%|▊ | 2814/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.13.up_proj: 8%|▊ | 2814/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.13.down_proj: 8%|▊ | 2815/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.14.gate_proj: 8%|▊ | 2816/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.14.up_proj: 8%|▊ | 2817/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.14.down_proj: 8%|▊ | 2818/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.15.gate_proj: 8%|▊ | 2819/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.15.up_proj: 8%|▊ | 2820/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.15.down_proj: 8%|▊ | 2821/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.16.gate_proj: 8%|▊ | 2822/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.16.up_proj: 8%|▊ | 2823/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.16.down_proj: 8%|▊ | 2824/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.17.gate_proj: 8%|▊ | 2825/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.17.up_proj: 8%|▊ | 2826/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.17.down_proj: 8%|▊ | 2827/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.18.gate_proj: 8%|▊ | 2828/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.18.up_proj: 8%|▊ | 2829/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.18.down_proj: 8%|▊ | 2830/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.19.gate_proj: 8%|▊ | 2831/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.19.up_proj: 8%|▊ | 2832/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.19.down_proj: 8%|▊ | 2833/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.20.gate_proj: 8%|▊ | 2834/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.20.up_proj: 8%|▊ | 2835/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.20.down_proj: 8%|▊ | 2836/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.21.gate_proj: 8%|▊ | 2837/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.21.up_proj: 8%|▊ | 2838/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.21.down_proj: 8%|▊ | 2839/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.22.gate_proj: 8%|▊ | 2840/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.22.up_proj: 8%|▊ | 2841/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.22.down_proj: 8%|▊ | 2842/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.23.gate_proj: 8%|▊ | 2843/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.23.up_proj: 8%|▊ | 2844/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.23.down_proj: 8%|▊ | 2845/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.24.gate_proj: 8%|▊ | 2846/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.24.up_proj: 8%|▊ | 2847/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.24.down_proj: 8%|▊ | 2848/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.25.gate_proj: 8%|▊ | 2849/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.25.up_proj: 8%|▊ | 2850/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.25.down_proj: 8%|▊ | 2851/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.26.gate_proj: 8%|▊ | 2852/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.26.up_proj: 8%|▊ | 2853/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.26.down_proj: 8%|▊ | 2854/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.27.gate_proj: 8%|▊ | 2855/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.27.up_proj: 8%|▊ | 2856/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.27.down_proj: 8%|▊ | 2857/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.28.gate_proj: 8%|▊ | 2858/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.28.up_proj: 8%|▊ | 2859/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.28.down_proj: 8%|▊ | 2860/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.29.gate_proj: 8%|▊ | 2861/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.29.up_proj: 8%|▊ | 2862/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.29.down_proj: 8%|▊ | 2863/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.30.gate_proj: 8%|▊ | 2864/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.30.up_proj: 8%|▊ | 2865/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.30.down_proj: 8%|▊ | 2866/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.31.gate_proj: 8%|▊ | 2867/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.31.up_proj: 8%|▊ | 2868/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.31.down_proj: 8%|▊ | 2869/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.32.gate_proj: 8%|▊ | 2870/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.32.up_proj: 8%|▊ | 2871/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.32.down_proj: 8%|▊ | 2872/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.33.gate_proj: 8%|▊ | 2873/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.33.up_proj: 8%|▊ | 2874/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.33.down_proj: 8%|▊ | 2875/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.34.gate_proj: 8%|▊ | 2876/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.34.up_proj: 8%|▊ | 2877/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.34.down_proj: 8%|▊ | 2878/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.35.gate_proj: 8%|▊ | 2879/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.35.up_proj: 8%|▊ | 2880/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.35.down_proj: 8%|▊ | 2881/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.36.gate_proj: 8%|▊ | 2882/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.36.up_proj: 8%|▊ | 2883/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.36.down_proj: 8%|▊ | 2884/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.37.gate_proj: 8%|▊ | 2885/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.37.up_proj: 8%|▊ | 2886/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.37.down_proj: 8%|▊ | 2887/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.38.gate_proj: 8%|▊ | 2888/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.38.up_proj: 8%|▊ | 2889/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.38.down_proj: 8%|▊ | 2890/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.39.gate_proj: 8%|▊ | 2891/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.39.up_proj: 8%|▊ | 2892/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.39.down_proj: 8%|▊ | 2893/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.40.gate_proj: 8%|▊ | 2894/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.40.up_proj: 8%|▊ | 2895/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.40.down_proj: 8%|▊ | 2896/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.41.gate_proj: 8%|▊ | 2897/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.41.up_proj: 8%|▊ | 2898/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.41.down_proj: 8%|▊ | 2899/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.42.gate_proj: 8%|▊ | 2900/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.42.up_proj: 8%|▊ | 2901/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.42.down_proj: 8%|▊ | 2902/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.43.gate_proj: 8%|▊ | 2903/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.43.up_proj: 8%|▊ | 2904/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.43.down_proj: 8%|▊ | 2905/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.44.gate_proj: 8%|▊ | 2906/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.44.up_proj: 8%|▊ | 2907/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.44.down_proj: 8%|▊ | 2908/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.45.gate_proj: 8%|▊ | 2909/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.45.up_proj: 8%|▊ | 2910/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.45.down_proj: 8%|▊ | 2911/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.46.gate_proj: 8%|▊ | 2912/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.46.up_proj: 8%|▊ | 2913/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.46.down_proj: 8%|▊ | 2914/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.47.gate_proj: 8%|▊ | 2915/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.47.up_proj: 8%|▊ | 2916/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.47.down_proj: 8%|▊ | 2917/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.48.gate_proj: 8%|▊ | 2918/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.48.up_proj: 8%|▊ | 2919/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.48.down_proj: 8%|▊ | 2920/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.49.gate_proj: 8%|▊ | 2921/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.49.up_proj: 8%|▊ | 2922/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.49.down_proj: 8%|▊ | 2923/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.50.gate_proj: 8%|▊ | 2924/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.50.up_proj: 8%|▊ | 2925/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.50.down_proj: 8%|▊ | 2926/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.51.gate_proj: 8%|▊ | 2927/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.51.up_proj: 8%|▊ | 2928/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.51.down_proj: 8%|▊ | 2929/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.52.gate_proj: 8%|▊ | 2930/36566 [00:03<00:28, 1168.31it/s] packing model.layers.6.mlp.experts.52.gate_proj: 8%|▊ | 2931/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.52.up_proj: 8%|▊ | 2931/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.52.down_proj: 8%|▊ | 2932/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.53.gate_proj: 8%|▊ | 2933/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.53.up_proj: 8%|▊ | 2934/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.53.down_proj: 8%|▊ | 2935/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.54.gate_proj: 8%|▊ | 2936/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.54.up_proj: 8%|▊ | 2937/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.54.down_proj: 8%|▊ | 2938/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.55.gate_proj: 8%|▊ | 2939/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.55.up_proj: 8%|▊ | 2940/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.55.down_proj: 8%|▊ | 2941/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.56.gate_proj: 8%|▊ | 2942/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.56.up_proj: 8%|▊ | 2943/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.56.down_proj: 8%|▊ | 2944/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.57.gate_proj: 8%|▊ | 2945/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.57.up_proj: 8%|▊ | 2946/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.57.down_proj: 8%|▊ | 2947/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.58.gate_proj: 8%|▊ | 2948/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.58.up_proj: 8%|▊ | 2949/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.58.down_proj: 8%|▊ | 2950/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.59.gate_proj: 8%|▊ | 2951/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.59.up_proj: 8%|▊ | 2952/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.59.down_proj: 8%|▊ | 2953/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.60.gate_proj: 8%|▊ | 2954/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.60.up_proj: 8%|▊ | 2955/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.60.down_proj: 8%|▊ | 2956/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.61.gate_proj: 8%|▊ | 2957/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.61.up_proj: 8%|▊ | 2958/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.61.down_proj: 8%|▊ | 2959/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.62.gate_proj: 8%|▊ | 2960/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.62.up_proj: 8%|▊ | 2961/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.62.down_proj: 8%|▊ | 2962/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.63.gate_proj: 8%|▊ | 2963/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.63.up_proj: 8%|▊ | 2964/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.63.down_proj: 8%|▊ | 2965/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.64.gate_proj: 8%|▊ | 2966/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.64.up_proj: 8%|▊ | 2967/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.64.down_proj: 8%|▊ | 2968/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.65.gate_proj: 8%|▊ | 2969/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.65.up_proj: 8%|▊ | 2970/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.65.down_proj: 8%|▊ | 2971/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.66.gate_proj: 8%|▊ | 2972/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.66.up_proj: 8%|▊ | 2973/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.66.down_proj: 8%|▊ | 2974/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.67.gate_proj: 8%|▊ | 2975/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.67.up_proj: 8%|▊ | 2976/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.67.down_proj: 8%|▊ | 2977/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.68.gate_proj: 8%|▊ | 2978/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.68.up_proj: 8%|▊ | 2979/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.68.down_proj: 8%|▊ | 2980/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.69.gate_proj: 8%|▊ | 2981/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.69.up_proj: 8%|▊ | 2982/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.69.down_proj: 8%|▊ | 2983/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.70.gate_proj: 8%|▊ | 2984/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.70.up_proj: 8%|▊ | 2985/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.70.down_proj: 8%|▊ | 2986/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.71.gate_proj: 8%|▊ | 2987/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.71.up_proj: 8%|▊ | 2988/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.71.down_proj: 8%|▊ | 2989/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.72.gate_proj: 8%|▊ | 2990/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.72.up_proj: 8%|▊ | 2991/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.72.down_proj: 8%|▊ | 2992/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.73.gate_proj: 8%|▊ | 2993/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.73.up_proj: 8%|▊ | 2994/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.73.down_proj: 8%|▊ | 2995/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.74.gate_proj: 8%|▊ | 2996/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.74.up_proj: 8%|▊ | 2997/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.74.down_proj: 8%|▊ | 2998/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.75.gate_proj: 8%|▊ | 2999/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.75.up_proj: 8%|▊ | 3000/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.75.down_proj: 8%|▊ | 3001/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.76.gate_proj: 8%|▊ | 3002/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.76.up_proj: 8%|▊ | 3003/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.76.down_proj: 8%|▊ | 3004/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.77.gate_proj: 8%|▊ | 3005/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.77.up_proj: 8%|▊ | 3006/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.77.down_proj: 8%|▊ | 3007/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.78.gate_proj: 8%|▊ | 3008/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.78.up_proj: 8%|▊ | 3009/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.78.down_proj: 8%|▊ | 3010/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.79.gate_proj: 8%|▊ | 3011/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.79.up_proj: 8%|▊ | 3012/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.79.down_proj: 8%|▊ | 3013/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.80.gate_proj: 8%|▊ | 3014/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.80.up_proj: 8%|▊ | 3015/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.80.down_proj: 8%|▊ | 3016/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.81.gate_proj: 8%|▊ | 3017/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.81.up_proj: 8%|▊ | 3018/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.81.down_proj: 8%|▊ | 3019/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.82.gate_proj: 8%|▊ | 3020/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.82.up_proj: 8%|▊ | 3021/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.82.down_proj: 8%|▊ | 3022/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.83.gate_proj: 8%|▊ | 3023/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.83.up_proj: 8%|▊ | 3024/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.83.down_proj: 8%|▊ | 3025/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.84.gate_proj: 8%|▊ | 3026/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.84.up_proj: 8%|▊ | 3027/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.84.down_proj: 8%|▊ | 3028/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.85.gate_proj: 8%|▊ | 3029/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.85.up_proj: 8%|▊ | 3030/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.85.down_proj: 8%|▊ | 3031/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.86.gate_proj: 8%|▊ | 3032/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.86.up_proj: 8%|▊ | 3033/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.86.down_proj: 8%|▊ | 3034/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.87.gate_proj: 8%|▊ | 3035/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.87.up_proj: 8%|▊ | 3036/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.87.down_proj: 8%|▊ | 3037/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.88.gate_proj: 8%|▊ | 3038/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.88.up_proj: 8%|▊ | 3039/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.88.down_proj: 8%|▊ | 3040/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.89.gate_proj: 8%|▊ | 3041/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.89.up_proj: 8%|▊ | 3042/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.89.down_proj: 8%|▊ | 3043/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.90.gate_proj: 8%|▊ | 3044/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.90.up_proj: 8%|▊ | 3045/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.90.down_proj: 8%|▊ | 3046/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.91.gate_proj: 8%|▊ | 3047/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.91.up_proj: 8%|▊ | 3048/36566 [00:03<00:28, 1167.30it/s] packing model.layers.6.mlp.experts.91.up_proj: 8%|▊ | 3049/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.91.down_proj: 8%|▊ | 3049/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.92.gate_proj: 8%|▊ | 3050/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.92.up_proj: 8%|▊ | 3051/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.92.down_proj: 8%|▊ | 3052/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.93.gate_proj: 8%|▊ | 3053/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.93.up_proj: 8%|▊ | 3054/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.93.down_proj: 8%|▊ | 3055/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.94.gate_proj: 8%|▊ | 3056/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.94.up_proj: 8%|▊ | 3057/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.94.down_proj: 8%|▊ | 3058/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.95.gate_proj: 8%|▊ | 3059/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.95.up_proj: 8%|▊ | 3060/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.95.down_proj: 8%|▊ | 3061/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.96.gate_proj: 8%|▊ | 3062/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.96.up_proj: 8%|▊ | 3063/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.96.down_proj: 8%|▊ | 3064/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.97.gate_proj: 8%|▊ | 3065/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.97.up_proj: 8%|▊ | 3066/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.97.down_proj: 8%|▊ | 3067/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.98.gate_proj: 8%|▊ | 3068/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.98.up_proj: 8%|▊ | 3069/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.98.down_proj: 8%|▊ | 3070/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.99.gate_proj: 8%|▊ | 3071/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.99.up_proj: 8%|▊ | 3072/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.99.down_proj: 8%|▊ | 3073/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.100.gate_proj: 8%|▊ | 3074/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.100.up_proj: 8%|▊ | 3075/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.100.down_proj: 8%|▊ | 3076/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.101.gate_proj: 8%|▊ | 3077/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.101.up_proj: 8%|▊ | 3078/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.101.down_proj: 8%|▊ | 3079/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.102.gate_proj: 8%|▊ | 3080/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.102.up_proj: 8%|▊ | 3081/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.102.down_proj: 8%|▊ | 3082/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.103.gate_proj: 8%|▊ | 3083/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.103.up_proj: 8%|▊ | 3084/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.103.down_proj: 8%|▊ | 3085/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.104.gate_proj: 8%|▊ | 3086/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.104.up_proj: 8%|▊ | 3087/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.104.down_proj: 8%|▊ | 3088/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.105.gate_proj: 8%|▊ | 3089/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.105.up_proj: 8%|▊ | 3090/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.105.down_proj: 8%|▊ | 3091/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.106.gate_proj: 8%|▊ | 3092/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.106.up_proj: 8%|▊ | 3093/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.106.down_proj: 8%|▊ | 3094/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.107.gate_proj: 8%|▊ | 3095/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.107.up_proj: 8%|▊ | 3096/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.107.down_proj: 8%|▊ | 3097/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.108.gate_proj: 8%|▊ | 3098/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.108.up_proj: 8%|▊ | 3099/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.108.down_proj: 8%|▊ | 3100/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.109.gate_proj: 8%|▊ | 3101/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.109.up_proj: 8%|▊ | 3102/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.109.down_proj: 8%|▊ | 3103/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.110.gate_proj: 8%|▊ | 3104/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.110.up_proj: 8%|▊ | 3105/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.110.down_proj: 8%|▊ | 3106/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.111.gate_proj: 8%|▊ | 3107/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.111.up_proj: 8%|▊ | 3108/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.111.down_proj: 9%|▊ | 3109/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.112.gate_proj: 9%|▊ | 3110/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.112.up_proj: 9%|▊ | 3111/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.112.down_proj: 9%|▊ | 3112/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.113.gate_proj: 9%|▊ | 3113/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.113.up_proj: 9%|▊ | 3114/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.113.down_proj: 9%|▊ | 3115/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.114.gate_proj: 9%|▊ | 3116/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.114.up_proj: 9%|▊ | 3117/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.114.down_proj: 9%|▊ | 3118/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.115.gate_proj: 9%|▊ | 3119/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.115.up_proj: 9%|▊ | 3120/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.115.down_proj: 9%|▊ | 3121/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.116.gate_proj: 9%|▊ | 3122/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.116.up_proj: 9%|▊ | 3123/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.116.down_proj: 9%|▊ | 3124/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.117.gate_proj: 9%|▊ | 3125/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.117.up_proj: 9%|▊ | 3126/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.117.down_proj: 9%|▊ | 3127/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.118.gate_proj: 9%|▊ | 3128/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.118.up_proj: 9%|▊ | 3129/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.118.down_proj: 9%|▊ | 3130/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.119.gate_proj: 9%|▊ | 3131/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.119.up_proj: 9%|▊ | 3132/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.119.down_proj: 9%|▊ | 3133/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.120.gate_proj: 9%|▊ | 3134/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.120.up_proj: 9%|▊ | 3135/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.120.down_proj: 9%|▊ | 3136/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.121.gate_proj: 9%|▊ | 3137/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.121.up_proj: 9%|▊ | 3138/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.121.down_proj: 9%|▊ | 3139/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.122.gate_proj: 9%|▊ | 3140/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.122.up_proj: 9%|▊ | 3141/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.122.down_proj: 9%|▊ | 3142/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.123.gate_proj: 9%|▊ | 3143/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.123.up_proj: 9%|▊ | 3144/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.123.down_proj: 9%|▊ | 3145/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.124.gate_proj: 9%|▊ | 3146/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.124.up_proj: 9%|▊ | 3147/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.124.down_proj: 9%|▊ | 3148/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.125.gate_proj: 9%|▊ | 3149/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.125.up_proj: 9%|▊ | 3150/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.125.down_proj: 9%|▊ | 3151/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.126.gate_proj: 9%|▊ | 3152/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.126.up_proj: 9%|▊ | 3153/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.126.down_proj: 9%|▊ | 3154/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.127.gate_proj: 9%|▊ | 3155/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.127.up_proj: 9%|▊ | 3156/36566 [00:03<00:28, 1169.20it/s] packing model.layers.6.mlp.experts.127.down_proj: 9%|▊ | 3157/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.0.gate_proj: 9%|▊ | 3158/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.0.up_proj: 9%|▊ | 3159/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.0.down_proj: 9%|▊ | 3160/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.1.gate_proj: 9%|▊ | 3161/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.1.up_proj: 9%|▊ | 3162/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.1.down_proj: 9%|▊ | 3163/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.2.gate_proj: 9%|▊ | 3164/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.2.up_proj: 9%|▊ | 3165/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.2.down_proj: 9%|▊ | 3166/36566 [00:03<00:28, 1169.20it/s] packing model.layers.7.mlp.experts.2.down_proj: 9%|▊ | 3167/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.3.gate_proj: 9%|▊ | 3167/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.3.up_proj: 9%|▊ | 3168/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.3.down_proj: 9%|▊ | 3169/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.4.gate_proj: 9%|▊ | 3170/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.4.up_proj: 9%|▊ | 3171/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.4.down_proj: 9%|▊ | 3172/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.5.gate_proj: 9%|▊ | 3173/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.5.up_proj: 9%|▊ | 3174/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.5.down_proj: 9%|▊ | 3175/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.6.gate_proj: 9%|▊ | 3176/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.6.up_proj: 9%|▊ | 3177/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.6.down_proj: 9%|▊ | 3178/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.7.gate_proj: 9%|▊ | 3179/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.7.up_proj: 9%|▊ | 3180/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.7.down_proj: 9%|▊ | 3181/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.8.gate_proj: 9%|▊ | 3182/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.8.up_proj: 9%|▊ | 3183/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.8.down_proj: 9%|▊ | 3184/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.9.gate_proj: 9%|▊ | 3185/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.9.up_proj: 9%|▊ | 3186/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.9.down_proj: 9%|▊ | 3187/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.10.gate_proj: 9%|▊ | 3188/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.10.up_proj: 9%|▊ | 3189/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.10.down_proj: 9%|▊ | 3190/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.11.gate_proj: 9%|▊ | 3191/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.11.up_proj: 9%|▊ | 3192/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.11.down_proj: 9%|▊ | 3193/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.12.gate_proj: 9%|▊ | 3194/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.12.up_proj: 9%|▊ | 3195/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.12.down_proj: 9%|▊ | 3196/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.13.gate_proj: 9%|▊ | 3197/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.13.up_proj: 9%|▊ | 3198/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.13.down_proj: 9%|▊ | 3199/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.14.gate_proj: 9%|▉ | 3200/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.14.up_proj: 9%|▉ | 3201/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.14.down_proj: 9%|▉ | 3202/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.15.gate_proj: 9%|▉ | 3203/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.15.up_proj: 9%|▉ | 3204/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.15.down_proj: 9%|▉ | 3205/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.16.gate_proj: 9%|▉ | 3206/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.16.up_proj: 9%|▉ | 3207/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.16.down_proj: 9%|▉ | 3208/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.17.gate_proj: 9%|▉ | 3209/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.17.up_proj: 9%|▉ | 3210/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.17.down_proj: 9%|▉ | 3211/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.18.gate_proj: 9%|▉ | 3212/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.18.up_proj: 9%|▉ | 3213/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.18.down_proj: 9%|▉ | 3214/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.19.gate_proj: 9%|▉ | 3215/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.19.up_proj: 9%|▉ | 3216/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.19.down_proj: 9%|▉ | 3217/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.20.gate_proj: 9%|▉ | 3218/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.20.up_proj: 9%|▉ | 3219/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.20.down_proj: 9%|▉ | 3220/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.21.gate_proj: 9%|▉ | 3221/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.21.up_proj: 9%|▉ | 3222/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.21.down_proj: 9%|▉ | 3223/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.22.gate_proj: 9%|▉ | 3224/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.22.up_proj: 9%|▉ | 3225/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.22.down_proj: 9%|▉ | 3226/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.23.gate_proj: 9%|▉ | 3227/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.23.up_proj: 9%|▉ | 3228/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.23.down_proj: 9%|▉ | 3229/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.24.gate_proj: 9%|▉ | 3230/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.24.up_proj: 9%|▉ | 3231/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.24.down_proj: 9%|▉ | 3232/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.25.gate_proj: 9%|▉ | 3233/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.25.up_proj: 9%|▉ | 3234/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.25.down_proj: 9%|▉ | 3235/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.26.gate_proj: 9%|▉ | 3236/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.26.up_proj: 9%|▉ | 3237/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.26.down_proj: 9%|▉ | 3238/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.27.gate_proj: 9%|▉ | 3239/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.27.up_proj: 9%|▉ | 3240/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.27.down_proj: 9%|▉ | 3241/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.28.gate_proj: 9%|▉ | 3242/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.28.up_proj: 9%|▉ | 3243/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.28.down_proj: 9%|▉ | 3244/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.29.gate_proj: 9%|▉ | 3245/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.29.up_proj: 9%|▉ | 3246/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.29.down_proj: 9%|▉ | 3247/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.30.gate_proj: 9%|▉ | 3248/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.30.up_proj: 9%|▉ | 3249/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.30.down_proj: 9%|▉ | 3250/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.31.gate_proj: 9%|▉ | 3251/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.31.up_proj: 9%|▉ | 3252/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.31.down_proj: 9%|▉ | 3253/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.32.gate_proj: 9%|▉ | 3254/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.32.up_proj: 9%|▉ | 3255/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.32.down_proj: 9%|▉ | 3256/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.33.gate_proj: 9%|▉ | 3257/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.33.up_proj: 9%|▉ | 3258/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.33.down_proj: 9%|▉ | 3259/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.34.gate_proj: 9%|▉ | 3260/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.34.up_proj: 9%|▉ | 3261/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.34.down_proj: 9%|▉ | 3262/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.35.gate_proj: 9%|▉ | 3263/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.35.up_proj: 9%|▉ | 3264/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.35.down_proj: 9%|▉ | 3265/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.36.gate_proj: 9%|▉ | 3266/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.36.up_proj: 9%|▉ | 3267/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.36.down_proj: 9%|▉ | 3268/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.37.gate_proj: 9%|▉ | 3269/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.37.up_proj: 9%|▉ | 3270/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.37.down_proj: 9%|▉ | 3271/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.38.gate_proj: 9%|▉ | 3272/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.38.up_proj: 9%|▉ | 3273/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.38.down_proj: 9%|▉ | 3274/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.39.gate_proj: 9%|▉ | 3275/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.39.up_proj: 9%|▉ | 3276/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.39.down_proj: 9%|▉ | 3277/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.40.gate_proj: 9%|▉ | 3278/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.40.up_proj: 9%|▉ | 3279/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.40.down_proj: 9%|▉ | 3280/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.41.gate_proj: 9%|▉ | 3281/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.41.up_proj: 9%|▉ | 3282/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.41.down_proj: 9%|▉ | 3283/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.42.gate_proj: 9%|▉ | 3284/36566 [00:03<00:28, 1170.97it/s] packing model.layers.7.mlp.experts.42.gate_proj: 9%|▉ | 3285/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.42.up_proj: 9%|▉ | 3285/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.42.down_proj: 9%|▉ | 3286/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.43.gate_proj: 9%|▉ | 3287/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.43.up_proj: 9%|▉ | 3288/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.43.down_proj: 9%|▉ | 3289/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.44.gate_proj: 9%|▉ | 3290/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.44.up_proj: 9%|▉ | 3291/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.44.down_proj: 9%|▉ | 3292/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.45.gate_proj: 9%|▉ | 3293/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.45.up_proj: 9%|▉ | 3294/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.45.down_proj: 9%|▉ | 3295/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.46.gate_proj: 9%|▉ | 3296/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.46.up_proj: 9%|▉ | 3297/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.46.down_proj: 9%|▉ | 3298/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.47.gate_proj: 9%|▉ | 3299/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.47.up_proj: 9%|▉ | 3300/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.47.down_proj: 9%|▉ | 3301/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.48.gate_proj: 9%|▉ | 3302/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.48.up_proj: 9%|▉ | 3303/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.48.down_proj: 9%|▉ | 3304/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.49.gate_proj: 9%|▉ | 3305/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.49.up_proj: 9%|▉ | 3306/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.49.down_proj: 9%|▉ | 3307/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.50.gate_proj: 9%|▉ | 3308/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.50.up_proj: 9%|▉ | 3309/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.50.down_proj: 9%|▉ | 3310/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.51.gate_proj: 9%|▉ | 3311/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.51.up_proj: 9%|▉ | 3312/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.51.down_proj: 9%|▉ | 3313/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.52.gate_proj: 9%|▉ | 3314/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.52.up_proj: 9%|▉ | 3315/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.52.down_proj: 9%|▉ | 3316/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.53.gate_proj: 9%|▉ | 3317/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.53.up_proj: 9%|▉ | 3318/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.53.down_proj: 9%|▉ | 3319/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.54.gate_proj: 9%|▉ | 3320/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.54.up_proj: 9%|▉ | 3321/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.54.down_proj: 9%|▉ | 3322/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.55.gate_proj: 9%|▉ | 3323/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.55.up_proj: 9%|▉ | 3324/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.55.down_proj: 9%|▉ | 3325/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.56.gate_proj: 9%|▉ | 3326/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.56.up_proj: 9%|▉ | 3327/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.56.down_proj: 9%|▉ | 3328/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.57.gate_proj: 9%|▉ | 3329/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.57.up_proj: 9%|▉ | 3330/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.57.down_proj: 9%|▉ | 3331/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.58.gate_proj: 9%|▉ | 3332/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.58.up_proj: 9%|▉ | 3333/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.58.down_proj: 9%|▉ | 3334/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.59.gate_proj: 9%|▉ | 3335/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.59.up_proj: 9%|▉ | 3336/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.59.down_proj: 9%|▉ | 3337/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.60.gate_proj: 9%|▉ | 3338/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.60.up_proj: 9%|▉ | 3339/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.60.down_proj: 9%|▉ | 3340/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.61.gate_proj: 9%|▉ | 3341/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.61.up_proj: 9%|▉ | 3342/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.61.down_proj: 9%|▉ | 3343/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.62.gate_proj: 9%|▉ | 3344/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.62.up_proj: 9%|▉ | 3345/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.62.down_proj: 9%|▉ | 3346/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.63.gate_proj: 9%|▉ | 3347/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.63.up_proj: 9%|▉ | 3348/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.63.down_proj: 9%|▉ | 3349/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.64.gate_proj: 9%|▉ | 3350/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.64.up_proj: 9%|▉ | 3351/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.64.down_proj: 9%|▉ | 3352/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.65.gate_proj: 9%|▉ | 3353/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.65.up_proj: 9%|▉ | 3354/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.65.down_proj: 9%|▉ | 3355/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.66.gate_proj: 9%|▉ | 3356/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.66.up_proj: 9%|▉ | 3357/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.66.down_proj: 9%|▉ | 3358/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.67.gate_proj: 9%|▉ | 3359/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.67.up_proj: 9%|▉ | 3360/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.67.down_proj: 9%|▉ | 3361/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.68.gate_proj: 9%|▉ | 3362/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.68.up_proj: 9%|▉ | 3363/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.68.down_proj: 9%|▉ | 3364/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.69.gate_proj: 9%|▉ | 3365/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.69.up_proj: 9%|▉ | 3366/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.69.down_proj: 9%|▉ | 3367/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.70.gate_proj: 9%|▉ | 3368/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.70.up_proj: 9%|▉ | 3369/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.70.down_proj: 9%|▉ | 3370/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.71.gate_proj: 9%|▉ | 3371/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.71.up_proj: 9%|▉ | 3372/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.71.down_proj: 9%|▉ | 3373/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.72.gate_proj: 9%|▉ | 3374/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.72.up_proj: 9%|▉ | 3375/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.72.down_proj: 9%|▉ | 3376/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.73.gate_proj: 9%|▉ | 3377/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.73.up_proj: 9%|▉ | 3378/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.73.down_proj: 9%|▉ | 3379/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.74.gate_proj: 9%|▉ | 3380/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.74.up_proj: 9%|▉ | 3381/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.74.down_proj: 9%|▉ | 3382/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.75.gate_proj: 9%|▉ | 3383/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.75.up_proj: 9%|▉ | 3384/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.75.down_proj: 9%|▉ | 3385/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.76.gate_proj: 9%|▉ | 3386/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.76.up_proj: 9%|▉ | 3387/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.76.down_proj: 9%|▉ | 3388/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.77.gate_proj: 9%|▉ | 3389/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.77.up_proj: 9%|▉ | 3390/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.77.down_proj: 9%|▉ | 3391/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.78.gate_proj: 9%|▉ | 3392/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.78.up_proj: 9%|▉ | 3393/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.78.down_proj: 9%|▉ | 3394/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.79.gate_proj: 9%|▉ | 3395/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.79.up_proj: 9%|▉ | 3396/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.79.down_proj: 9%|▉ | 3397/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.80.gate_proj: 9%|▉ | 3398/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.80.up_proj: 9%|▉ | 3399/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.80.down_proj: 9%|▉ | 3400/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.81.gate_proj: 9%|▉ | 3401/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.81.up_proj: 9%|▉ | 3402/36566 [00:03<00:28, 1172.48it/s] packing model.layers.7.mlp.experts.81.up_proj: 9%|▉ | 3403/36566 [00:03<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.81.down_proj: 9%|▉ | 3403/36566 [00:03<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.82.gate_proj: 9%|▉ | 3404/36566 [00:03<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.82.up_proj: 9%|▉ | 3405/36566 [00:03<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.82.down_proj: 9%|▉ | 3406/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.83.gate_proj: 9%|▉ | 3407/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.83.up_proj: 9%|▉ | 3408/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.83.down_proj: 9%|▉ | 3409/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.84.gate_proj: 9%|▉ | 3410/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.84.up_proj: 9%|▉ | 3411/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.84.down_proj: 9%|▉ | 3412/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.85.gate_proj: 9%|▉ | 3413/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.85.up_proj: 9%|▉ | 3414/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.85.down_proj: 9%|▉ | 3415/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.86.gate_proj: 9%|▉ | 3416/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.86.up_proj: 9%|▉ | 3417/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.86.down_proj: 9%|▉ | 3418/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.87.gate_proj: 9%|▉ | 3419/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.87.up_proj: 9%|▉ | 3420/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.87.down_proj: 9%|▉ | 3421/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.88.gate_proj: 9%|▉ | 3422/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.88.up_proj: 9%|▉ | 3423/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.88.down_proj: 9%|▉ | 3424/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.89.gate_proj: 9%|▉ | 3425/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.89.up_proj: 9%|▉ | 3426/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.89.down_proj: 9%|▉ | 3427/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.90.gate_proj: 9%|▉ | 3428/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.90.up_proj: 9%|▉ | 3429/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.90.down_proj: 9%|▉ | 3430/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.91.gate_proj: 9%|▉ | 3431/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.91.up_proj: 9%|▉ | 3432/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.91.down_proj: 9%|▉ | 3433/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.92.gate_proj: 9%|▉ | 3434/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.92.up_proj: 9%|▉ | 3435/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.92.down_proj: 9%|▉ | 3436/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.93.gate_proj: 9%|▉ | 3437/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.93.up_proj: 9%|▉ | 3438/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.93.down_proj: 9%|▉ | 3439/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.94.gate_proj: 9%|▉ | 3440/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.94.up_proj: 9%|▉ | 3441/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.94.down_proj: 9%|▉ | 3442/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.95.gate_proj: 9%|▉ | 3443/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.95.up_proj: 9%|▉ | 3444/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.95.down_proj: 9%|▉ | 3445/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.96.gate_proj: 9%|▉ | 3446/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.96.up_proj: 9%|▉ | 3447/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.96.down_proj: 9%|▉ | 3448/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.97.gate_proj: 9%|▉ | 3449/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.97.up_proj: 9%|▉ | 3450/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.97.down_proj: 9%|▉ | 3451/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.98.gate_proj: 9%|▉ | 3452/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.98.up_proj: 9%|▉ | 3453/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.98.down_proj: 9%|▉ | 3454/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.99.gate_proj: 9%|▉ | 3455/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.99.up_proj: 9%|▉ | 3456/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.99.down_proj: 9%|▉ | 3457/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.100.gate_proj: 9%|▉ | 3458/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.100.up_proj: 9%|▉ | 3459/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.100.down_proj: 9%|▉ | 3460/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.101.gate_proj: 9%|▉ | 3461/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.101.up_proj: 9%|▉ | 3462/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.101.down_proj: 9%|▉ | 3463/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.102.gate_proj: 9%|▉ | 3464/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.102.up_proj: 9%|▉ | 3465/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.102.down_proj: 9%|▉ | 3466/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.103.gate_proj: 9%|▉ | 3467/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.103.up_proj: 9%|▉ | 3468/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.103.down_proj: 9%|▉ | 3469/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.104.gate_proj: 9%|▉ | 3470/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.104.up_proj: 9%|▉ | 3471/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.104.down_proj: 9%|▉ | 3472/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.105.gate_proj: 9%|▉ | 3473/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.105.up_proj: 10%|▉ | 3474/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.105.down_proj: 10%|▉ | 3475/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.106.gate_proj: 10%|▉ | 3476/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.106.up_proj: 10%|▉ | 3477/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.106.down_proj: 10%|▉ | 3478/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.107.gate_proj: 10%|▉ | 3479/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.107.up_proj: 10%|▉ | 3480/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.107.down_proj: 10%|▉ | 3481/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.108.gate_proj: 10%|▉ | 3482/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.108.up_proj: 10%|▉ | 3483/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.108.down_proj: 10%|▉ | 3484/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.109.gate_proj: 10%|▉ | 3485/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.109.up_proj: 10%|▉ | 3486/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.109.down_proj: 10%|▉ | 3487/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.110.gate_proj: 10%|▉ | 3488/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.110.up_proj: 10%|▉ | 3489/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.110.down_proj: 10%|▉ | 3490/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.111.gate_proj: 10%|▉ | 3491/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.111.up_proj: 10%|▉ | 3492/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.111.down_proj: 10%|▉ | 3493/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.112.gate_proj: 10%|▉ | 3494/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.112.up_proj: 10%|▉ | 3495/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.112.down_proj: 10%|▉ | 3496/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.113.gate_proj: 10%|▉ | 3497/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.113.up_proj: 10%|▉ | 3498/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.113.down_proj: 10%|▉ | 3499/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.114.gate_proj: 10%|▉ | 3500/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.114.up_proj: 10%|▉ | 3501/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.114.down_proj: 10%|▉ | 3502/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.115.gate_proj: 10%|▉ | 3503/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.115.up_proj: 10%|▉ | 3504/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.115.down_proj: 10%|▉ | 3505/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.116.gate_proj: 10%|▉ | 3506/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.116.up_proj: 10%|▉ | 3507/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.116.down_proj: 10%|▉ | 3508/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.117.gate_proj: 10%|▉ | 3509/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.117.up_proj: 10%|▉ | 3510/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.117.down_proj: 10%|▉ | 3511/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.118.gate_proj: 10%|▉ | 3512/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.118.up_proj: 10%|▉ | 3513/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.118.down_proj: 10%|▉ | 3514/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.119.gate_proj: 10%|▉ | 3515/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.119.up_proj: 10%|▉ | 3516/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.119.down_proj: 10%|▉ | 3517/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.120.gate_proj: 10%|▉ | 3518/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.120.up_proj: 10%|▉ | 3519/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.120.down_proj: 10%|▉ | 3520/36566 [00:04<00:28, 1173.53it/s] packing model.layers.7.mlp.experts.120.down_proj: 10%|▉ | 3521/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.121.gate_proj: 10%|▉ | 3521/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.121.up_proj: 10%|▉ | 3522/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.121.down_proj: 10%|▉ | 3523/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.122.gate_proj: 10%|▉ | 3524/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.122.up_proj: 10%|▉ | 3525/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.122.down_proj: 10%|▉ | 3526/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.123.gate_proj: 10%|▉ | 3527/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.123.up_proj: 10%|▉ | 3528/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.123.down_proj: 10%|▉ | 3529/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.124.gate_proj: 10%|▉ | 3530/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.124.up_proj: 10%|▉ | 3531/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.124.down_proj: 10%|▉ | 3532/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.125.gate_proj: 10%|▉ | 3533/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.125.up_proj: 10%|▉ | 3534/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.125.down_proj: 10%|▉ | 3535/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.126.gate_proj: 10%|▉ | 3536/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.126.up_proj: 10%|▉ | 3537/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.126.down_proj: 10%|▉ | 3538/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.127.gate_proj: 10%|▉ | 3539/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.127.up_proj: 10%|▉ | 3540/36566 [00:04<00:28, 1172.72it/s] packing model.layers.7.mlp.experts.127.down_proj: 10%|▉ | 3541/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.0.gate_proj: 10%|▉ | 3542/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.0.up_proj: 10%|▉ | 3543/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.0.down_proj: 10%|▉ | 3544/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.1.gate_proj: 10%|▉ | 3545/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.1.up_proj: 10%|▉ | 3546/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.1.down_proj: 10%|▉ | 3547/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.2.gate_proj: 10%|▉ | 3548/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.2.up_proj: 10%|▉ | 3549/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.2.down_proj: 10%|▉ | 3550/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.3.gate_proj: 10%|▉ | 3551/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.3.up_proj: 10%|▉ | 3552/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.3.down_proj: 10%|▉ | 3553/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.4.gate_proj: 10%|▉ | 3554/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.4.up_proj: 10%|▉ | 3555/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.4.down_proj: 10%|▉ | 3556/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.5.gate_proj: 10%|▉ | 3557/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.5.up_proj: 10%|▉ | 3558/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.5.down_proj: 10%|▉ | 3559/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.6.gate_proj: 10%|▉ | 3560/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.6.up_proj: 10%|▉ | 3561/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.6.down_proj: 10%|▉ | 3562/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.7.gate_proj: 10%|▉ | 3563/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.7.up_proj: 10%|▉ | 3564/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.7.down_proj: 10%|▉ | 3565/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.8.gate_proj: 10%|▉ | 3566/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.8.up_proj: 10%|▉ | 3567/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.8.down_proj: 10%|▉ | 3568/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.9.gate_proj: 10%|▉ | 3569/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.9.up_proj: 10%|▉ | 3570/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.9.down_proj: 10%|▉ | 3571/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.10.gate_proj: 10%|▉ | 3572/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.10.up_proj: 10%|▉ | 3573/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.10.down_proj: 10%|▉ | 3574/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.11.gate_proj: 10%|▉ | 3575/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.11.up_proj: 10%|▉ | 3576/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.11.down_proj: 10%|▉ | 3577/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.12.gate_proj: 10%|▉ | 3578/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.12.up_proj: 10%|▉ | 3579/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.12.down_proj: 10%|▉ | 3580/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.13.gate_proj: 10%|▉ | 3581/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.13.up_proj: 10%|▉ | 3582/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.13.down_proj: 10%|▉ | 3583/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.14.gate_proj: 10%|▉ | 3584/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.14.up_proj: 10%|▉ | 3585/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.14.down_proj: 10%|▉ | 3586/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.15.gate_proj: 10%|▉ | 3587/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.15.up_proj: 10%|▉ | 3588/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.15.down_proj: 10%|▉ | 3589/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.16.gate_proj: 10%|▉ | 3590/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.16.up_proj: 10%|▉ | 3591/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.16.down_proj: 10%|▉ | 3592/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.17.gate_proj: 10%|▉ | 3593/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.17.up_proj: 10%|▉ | 3594/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.17.down_proj: 10%|▉ | 3595/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.18.gate_proj: 10%|▉ | 3596/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.18.up_proj: 10%|▉ | 3597/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.18.down_proj: 10%|▉ | 3598/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.19.gate_proj: 10%|▉ | 3599/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.19.up_proj: 10%|▉ | 3600/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.19.down_proj: 10%|▉ | 3601/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.20.gate_proj: 10%|▉ | 3602/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.20.up_proj: 10%|▉ | 3603/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.20.down_proj: 10%|▉ | 3604/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.21.gate_proj: 10%|▉ | 3605/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.21.up_proj: 10%|▉ | 3606/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.21.down_proj: 10%|▉ | 3607/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.22.gate_proj: 10%|▉ | 3608/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.22.up_proj: 10%|▉ | 3609/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.22.down_proj: 10%|▉ | 3610/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.23.gate_proj: 10%|▉ | 3611/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.23.up_proj: 10%|▉ | 3612/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.23.down_proj: 10%|▉ | 3613/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.24.gate_proj: 10%|▉ | 3614/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.24.up_proj: 10%|▉ | 3615/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.24.down_proj: 10%|▉ | 3616/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.25.gate_proj: 10%|▉ | 3617/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.25.up_proj: 10%|▉ | 3618/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.25.down_proj: 10%|▉ | 3619/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.26.gate_proj: 10%|▉ | 3620/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.26.up_proj: 10%|▉ | 3621/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.26.down_proj: 10%|▉ | 3622/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.27.gate_proj: 10%|▉ | 3623/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.27.up_proj: 10%|▉ | 3624/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.27.down_proj: 10%|▉ | 3625/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.28.gate_proj: 10%|▉ | 3626/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.28.up_proj: 10%|▉ | 3627/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.28.down_proj: 10%|▉ | 3628/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.29.gate_proj: 10%|▉ | 3629/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.29.up_proj: 10%|▉ | 3630/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.29.down_proj: 10%|▉ | 3631/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.30.gate_proj: 10%|▉ | 3632/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.30.up_proj: 10%|▉ | 3633/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.30.down_proj: 10%|▉ | 3634/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.31.gate_proj: 10%|▉ | 3635/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.31.up_proj: 10%|▉ | 3636/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.31.down_proj: 10%|▉ | 3637/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.32.gate_proj: 10%|▉ | 3638/36566 [00:04<00:28, 1172.72it/s] packing model.layers.8.mlp.experts.32.gate_proj: 10%|▉ | 3639/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.32.up_proj: 10%|▉ | 3639/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.32.down_proj: 10%|▉ | 3640/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.33.gate_proj: 10%|▉ | 3641/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.33.up_proj: 10%|▉ | 3642/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.33.down_proj: 10%|▉ | 3643/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.34.gate_proj: 10%|▉ | 3644/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.34.up_proj: 10%|▉ | 3645/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.34.down_proj: 10%|▉ | 3646/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.35.gate_proj: 10%|▉ | 3647/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.35.up_proj: 10%|▉ | 3648/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.35.down_proj: 10%|▉ | 3649/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.36.gate_proj: 10%|▉ | 3650/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.36.up_proj: 10%|▉ | 3651/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.36.down_proj: 10%|▉ | 3652/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.37.gate_proj: 10%|▉ | 3653/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.37.up_proj: 10%|▉ | 3654/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.37.down_proj: 10%|▉ | 3655/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.38.gate_proj: 10%|▉ | 3656/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.38.up_proj: 10%|█ | 3657/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.38.down_proj: 10%|█ | 3658/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.39.gate_proj: 10%|█ | 3659/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.39.up_proj: 10%|█ | 3660/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.39.down_proj: 10%|█ | 3661/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.40.gate_proj: 10%|█ | 3662/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.40.up_proj: 10%|█ | 3663/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.40.down_proj: 10%|█ | 3664/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.41.gate_proj: 10%|█ | 3665/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.41.up_proj: 10%|█ | 3666/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.41.down_proj: 10%|█ | 3667/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.42.gate_proj: 10%|█ | 3668/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.42.up_proj: 10%|█ | 3669/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.42.down_proj: 10%|█ | 3670/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.43.gate_proj: 10%|█ | 3671/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.43.up_proj: 10%|█ | 3672/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.43.down_proj: 10%|█ | 3673/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.44.gate_proj: 10%|█ | 3674/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.44.up_proj: 10%|█ | 3675/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.44.down_proj: 10%|█ | 3676/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.45.gate_proj: 10%|█ | 3677/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.45.up_proj: 10%|█ | 3678/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.45.down_proj: 10%|█ | 3679/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.46.gate_proj: 10%|█ | 3680/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.46.up_proj: 10%|█ | 3681/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.46.down_proj: 10%|█ | 3682/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.47.gate_proj: 10%|█ | 3683/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.47.up_proj: 10%|█ | 3684/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.47.down_proj: 10%|█ | 3685/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.48.gate_proj: 10%|█ | 3686/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.48.up_proj: 10%|█ | 3687/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.48.down_proj: 10%|█ | 3688/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.49.gate_proj: 10%|█ | 3689/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.49.up_proj: 10%|█ | 3690/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.49.down_proj: 10%|█ | 3691/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.50.gate_proj: 10%|█ | 3692/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.50.up_proj: 10%|█ | 3693/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.50.down_proj: 10%|█ | 3694/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.51.gate_proj: 10%|█ | 3695/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.51.up_proj: 10%|█ | 3696/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.51.down_proj: 10%|█ | 3697/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.52.gate_proj: 10%|█ | 3698/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.52.up_proj: 10%|█ | 3699/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.52.down_proj: 10%|█ | 3700/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.53.gate_proj: 10%|█ | 3701/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.53.up_proj: 10%|█ | 3702/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.53.down_proj: 10%|█ | 3703/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.54.gate_proj: 10%|█ | 3704/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.54.up_proj: 10%|█ | 3705/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.54.down_proj: 10%|█ | 3706/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.55.gate_proj: 10%|█ | 3707/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.55.up_proj: 10%|█ | 3708/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.55.down_proj: 10%|█ | 3709/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.56.gate_proj: 10%|█ | 3710/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.56.up_proj: 10%|█ | 3711/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.56.down_proj: 10%|█ | 3712/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.57.gate_proj: 10%|█ | 3713/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.57.up_proj: 10%|█ | 3714/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.57.down_proj: 10%|█ | 3715/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.58.gate_proj: 10%|█ | 3716/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.58.up_proj: 10%|█ | 3717/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.58.down_proj: 10%|█ | 3718/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.59.gate_proj: 10%|█ | 3719/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.59.up_proj: 10%|█ | 3720/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.59.down_proj: 10%|█ | 3721/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.60.gate_proj: 10%|█ | 3722/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.60.up_proj: 10%|█ | 3723/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.60.down_proj: 10%|█ | 3724/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.61.gate_proj: 10%|█ | 3725/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.61.up_proj: 10%|█ | 3726/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.61.down_proj: 10%|█ | 3727/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.62.gate_proj: 10%|█ | 3728/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.62.up_proj: 10%|█ | 3729/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.62.down_proj: 10%|█ | 3730/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.63.gate_proj: 10%|█ | 3731/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.63.up_proj: 10%|█ | 3732/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.63.down_proj: 10%|█ | 3733/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.64.gate_proj: 10%|█ | 3734/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.64.up_proj: 10%|█ | 3735/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.64.down_proj: 10%|█ | 3736/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.65.gate_proj: 10%|█ | 3737/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.65.up_proj: 10%|█ | 3738/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.65.down_proj: 10%|█ | 3739/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.66.gate_proj: 10%|█ | 3740/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.66.up_proj: 10%|█ | 3741/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.66.down_proj: 10%|█ | 3742/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.67.gate_proj: 10%|█ | 3743/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.67.up_proj: 10%|█ | 3744/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.67.down_proj: 10%|█ | 3745/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.68.gate_proj: 10%|█ | 3746/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.68.up_proj: 10%|█ | 3747/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.68.down_proj: 10%|█ | 3748/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.69.gate_proj: 10%|█ | 3749/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.69.up_proj: 10%|█ | 3750/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.69.down_proj: 10%|█ | 3751/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.70.gate_proj: 10%|█ | 3752/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.70.up_proj: 10%|█ | 3753/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.70.down_proj: 10%|█ | 3754/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.71.gate_proj: 10%|█ | 3755/36566 [00:04<00:28, 1169.87it/s] packing model.layers.8.mlp.experts.71.gate_proj: 10%|█ | 3756/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.71.up_proj: 10%|█ | 3756/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.71.down_proj: 10%|█ | 3757/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.72.gate_proj: 10%|█ | 3758/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.72.up_proj: 10%|█ | 3759/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.72.down_proj: 10%|█ | 3760/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.73.gate_proj: 10%|█ | 3761/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.73.up_proj: 10%|█ | 3762/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.73.down_proj: 10%|█ | 3763/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.74.gate_proj: 10%|█ | 3764/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.74.up_proj: 10%|█ | 3765/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.74.down_proj: 10%|█ | 3766/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.75.gate_proj: 10%|█ | 3767/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.75.up_proj: 10%|█ | 3768/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.75.down_proj: 10%|█ | 3769/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.76.gate_proj: 10%|█ | 3770/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.76.up_proj: 10%|█ | 3771/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.76.down_proj: 10%|█ | 3772/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.77.gate_proj: 10%|█ | 3773/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.77.up_proj: 10%|█ | 3774/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.77.down_proj: 10%|█ | 3775/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.78.gate_proj: 10%|█ | 3776/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.78.up_proj: 10%|█ | 3777/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.78.down_proj: 10%|█ | 3778/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.79.gate_proj: 10%|█ | 3779/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.79.up_proj: 10%|█ | 3780/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.79.down_proj: 10%|█ | 3781/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.80.gate_proj: 10%|█ | 3782/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.80.up_proj: 10%|█ | 3783/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.80.down_proj: 10%|█ | 3784/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.81.gate_proj: 10%|█ | 3785/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.81.up_proj: 10%|█ | 3786/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.81.down_proj: 10%|█ | 3787/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.82.gate_proj: 10%|█ | 3788/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.82.up_proj: 10%|█ | 3789/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.82.down_proj: 10%|█ | 3790/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.83.gate_proj: 10%|█ | 3791/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.83.up_proj: 10%|█ | 3792/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.83.down_proj: 10%|█ | 3793/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.84.gate_proj: 10%|█ | 3794/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.84.up_proj: 10%|█ | 3795/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.84.down_proj: 10%|█ | 3796/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.85.gate_proj: 10%|█ | 3797/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.85.up_proj: 10%|█ | 3798/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.85.down_proj: 10%|█ | 3799/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.86.gate_proj: 10%|█ | 3800/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.86.up_proj: 10%|█ | 3801/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.86.down_proj: 10%|█ | 3802/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.87.gate_proj: 10%|█ | 3803/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.87.up_proj: 10%|█ | 3804/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.87.down_proj: 10%|█ | 3805/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.88.gate_proj: 10%|█ | 3806/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.88.up_proj: 10%|█ | 3807/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.88.down_proj: 10%|█ | 3808/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.89.gate_proj: 10%|█ | 3809/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.89.up_proj: 10%|█ | 3810/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.89.down_proj: 10%|█ | 3811/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.90.gate_proj: 10%|█ | 3812/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.90.up_proj: 10%|█ | 3813/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.90.down_proj: 10%|█ | 3814/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.91.gate_proj: 10%|█ | 3815/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.91.up_proj: 10%|█ | 3816/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.91.down_proj: 10%|█ | 3817/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.92.gate_proj: 10%|█ | 3818/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.92.up_proj: 10%|█ | 3819/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.92.down_proj: 10%|█ | 3820/36566 [00:04<00:28, 1169.49it/s] packing model.layers.8.mlp.experts.93.gate_proj: 10%|█ | 3821/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.93.up_proj: 10%|█ | 3822/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.93.down_proj: 10%|█ | 3823/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.94.gate_proj: 10%|█ | 3824/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.94.up_proj: 10%|█ | 3825/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.94.down_proj: 10%|█ | 3826/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.95.gate_proj: 10%|█ | 3827/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.95.up_proj: 10%|█ | 3828/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.95.down_proj: 10%|█ | 3829/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.96.gate_proj: 10%|█ | 3830/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.96.up_proj: 10%|█ | 3831/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.96.down_proj: 10%|█ | 3832/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.97.gate_proj: 10%|█ | 3833/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.97.up_proj: 10%|█ | 3834/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.97.down_proj: 10%|█ | 3835/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.98.gate_proj: 10%|█ | 3836/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.98.up_proj: 10%|█ | 3837/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.98.down_proj: 10%|█ | 3838/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.99.gate_proj: 10%|█ | 3839/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.99.up_proj: 11%|█ | 3840/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.99.down_proj: 11%|█ | 3841/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.100.gate_proj: 11%|█ | 3842/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.100.up_proj: 11%|█ | 3843/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.100.down_proj: 11%|█ | 3844/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.101.gate_proj: 11%|█ | 3845/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.101.up_proj: 11%|█ | 3846/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.101.down_proj: 11%|█ | 3847/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.102.gate_proj: 11%|█ | 3848/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.102.up_proj: 11%|█ | 3849/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.102.down_proj: 11%|█ | 3850/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.103.gate_proj: 11%|█ | 3851/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.103.up_proj: 11%|█ | 3852/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.103.down_proj: 11%|█ | 3853/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.104.gate_proj: 11%|█ | 3854/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.104.up_proj: 11%|█ | 3855/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.104.down_proj: 11%|█ | 3856/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.105.gate_proj: 11%|█ | 3857/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.105.up_proj: 11%|█ | 3858/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.105.down_proj: 11%|█ | 3859/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.106.gate_proj: 11%|█ | 3860/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.106.up_proj: 11%|█ | 3861/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.106.down_proj: 11%|█ | 3862/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.107.gate_proj: 11%|█ | 3863/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.107.up_proj: 11%|█ | 3864/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.107.down_proj: 11%|█ | 3865/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.108.gate_proj: 11%|█ | 3866/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.108.up_proj: 11%|█ | 3867/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.108.down_proj: 11%|█ | 3868/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.109.gate_proj: 11%|█ | 3869/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.109.up_proj: 11%|█ | 3870/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.109.down_proj: 11%|█ | 3871/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.110.gate_proj: 11%|█ | 3872/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.110.up_proj: 11%|█ | 3873/36566 [00:04<00:27, 1169.49it/s] packing model.layers.8.mlp.experts.110.up_proj: 11%|█ | 3874/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.110.down_proj: 11%|█ | 3874/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.111.gate_proj: 11%|█ | 3875/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.111.up_proj: 11%|█ | 3876/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.111.down_proj: 11%|█ | 3877/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.112.gate_proj: 11%|█ | 3878/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.112.up_proj: 11%|█ | 3879/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.112.down_proj: 11%|█ | 3880/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.113.gate_proj: 11%|█ | 3881/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.113.up_proj: 11%|█ | 3882/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.113.down_proj: 11%|█ | 3883/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.114.gate_proj: 11%|█ | 3884/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.114.up_proj: 11%|█ | 3885/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.114.down_proj: 11%|█ | 3886/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.115.gate_proj: 11%|█ | 3887/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.115.up_proj: 11%|█ | 3888/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.115.down_proj: 11%|█ | 3889/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.116.gate_proj: 11%|█ | 3890/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.116.up_proj: 11%|█ | 3891/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.116.down_proj: 11%|█ | 3892/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.117.gate_proj: 11%|█ | 3893/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.117.up_proj: 11%|█ | 3894/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.117.down_proj: 11%|█ | 3895/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.118.gate_proj: 11%|█ | 3896/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.118.up_proj: 11%|█ | 3897/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.118.down_proj: 11%|█ | 3898/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.119.gate_proj: 11%|█ | 3899/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.119.up_proj: 11%|█ | 3900/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.119.down_proj: 11%|█ | 3901/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.120.gate_proj: 11%|█ | 3902/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.120.up_proj: 11%|█ | 3903/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.120.down_proj: 11%|█ | 3904/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.121.gate_proj: 11%|█ | 3905/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.121.up_proj: 11%|█ | 3906/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.121.down_proj: 11%|█ | 3907/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.122.gate_proj: 11%|█ | 3908/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.122.up_proj: 11%|█ | 3909/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.122.down_proj: 11%|█ | 3910/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.123.gate_proj: 11%|█ | 3911/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.123.up_proj: 11%|█ | 3912/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.123.down_proj: 11%|█ | 3913/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.124.gate_proj: 11%|█ | 3914/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.124.up_proj: 11%|█ | 3915/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.124.down_proj: 11%|█ | 3916/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.125.gate_proj: 11%|█ | 3917/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.125.up_proj: 11%|█ | 3918/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.125.down_proj: 11%|█ | 3919/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.126.gate_proj: 11%|█ | 3920/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.126.up_proj: 11%|█ | 3921/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.126.down_proj: 11%|█ | 3922/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.127.gate_proj: 11%|█ | 3923/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.127.up_proj: 11%|█ | 3924/36566 [00:04<00:27, 1170.55it/s] packing model.layers.8.mlp.experts.127.down_proj: 11%|█ | 3925/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.0.gate_proj: 11%|█ | 3926/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.0.up_proj: 11%|█ | 3927/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.0.down_proj: 11%|█ | 3928/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.1.gate_proj: 11%|█ | 3929/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.1.up_proj: 11%|█ | 3930/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.1.down_proj: 11%|█ | 3931/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.2.gate_proj: 11%|█ | 3932/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.2.up_proj: 11%|█ | 3933/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.2.down_proj: 11%|█ | 3934/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.3.gate_proj: 11%|█ | 3935/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.3.up_proj: 11%|█ | 3936/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.3.down_proj: 11%|█ | 3937/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.4.gate_proj: 11%|█ | 3938/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.4.up_proj: 11%|█ | 3939/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.4.down_proj: 11%|█ | 3940/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.5.gate_proj: 11%|█ | 3941/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.5.up_proj: 11%|█ | 3942/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.5.down_proj: 11%|█ | 3943/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.6.gate_proj: 11%|█ | 3944/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.6.up_proj: 11%|█ | 3945/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.6.down_proj: 11%|█ | 3946/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.7.gate_proj: 11%|█ | 3947/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.7.up_proj: 11%|█ | 3948/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.7.down_proj: 11%|█ | 3949/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.8.gate_proj: 11%|█ | 3950/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.8.up_proj: 11%|█ | 3951/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.8.down_proj: 11%|█ | 3952/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.9.gate_proj: 11%|█ | 3953/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.9.up_proj: 11%|█ | 3954/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.9.down_proj: 11%|█ | 3955/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.10.gate_proj: 11%|█ | 3956/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.10.up_proj: 11%|█ | 3957/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.10.down_proj: 11%|█ | 3958/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.11.gate_proj: 11%|█ | 3959/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.11.up_proj: 11%|█ | 3960/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.11.down_proj: 11%|█ | 3961/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.12.gate_proj: 11%|█ | 3962/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.12.up_proj: 11%|█ | 3963/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.12.down_proj: 11%|█ | 3964/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.13.gate_proj: 11%|█ | 3965/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.13.up_proj: 11%|█ | 3966/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.13.down_proj: 11%|█ | 3967/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.14.gate_proj: 11%|█ | 3968/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.14.up_proj: 11%|█ | 3969/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.14.down_proj: 11%|█ | 3970/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.15.gate_proj: 11%|█ | 3971/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.15.up_proj: 11%|█ | 3972/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.15.down_proj: 11%|█ | 3973/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.16.gate_proj: 11%|█ | 3974/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.16.up_proj: 11%|█ | 3975/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.16.down_proj: 11%|█ | 3976/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.17.gate_proj: 11%|█ | 3977/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.17.up_proj: 11%|█ | 3978/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.17.down_proj: 11%|█ | 3979/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.18.gate_proj: 11%|█ | 3980/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.18.up_proj: 11%|█ | 3981/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.18.down_proj: 11%|█ | 3982/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.19.gate_proj: 11%|█ | 3983/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.19.up_proj: 11%|█ | 3984/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.19.down_proj: 11%|█ | 3985/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.20.gate_proj: 11%|█ | 3986/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.20.up_proj: 11%|█ | 3987/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.20.down_proj: 11%|█ | 3988/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.21.gate_proj: 11%|█ | 3989/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.21.up_proj: 11%|█ | 3990/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.21.down_proj: 11%|█ | 3991/36566 [00:04<00:27, 1170.55it/s] packing model.layers.9.mlp.experts.21.down_proj: 11%|█ | 3992/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.22.gate_proj: 11%|█ | 3992/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.22.up_proj: 11%|█ | 3993/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.22.down_proj: 11%|█ | 3994/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.23.gate_proj: 11%|█ | 3995/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.23.up_proj: 11%|█ | 3996/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.23.down_proj: 11%|█ | 3997/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.24.gate_proj: 11%|█ | 3998/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.24.up_proj: 11%|█ | 3999/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.24.down_proj: 11%|█ | 4000/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.25.gate_proj: 11%|█ | 4001/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.25.up_proj: 11%|█ | 4002/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.25.down_proj: 11%|█ | 4003/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.26.gate_proj: 11%|█ | 4004/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.26.up_proj: 11%|█ | 4005/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.26.down_proj: 11%|█ | 4006/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.27.gate_proj: 11%|█ | 4007/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.27.up_proj: 11%|█ | 4008/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.27.down_proj: 11%|█ | 4009/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.28.gate_proj: 11%|█ | 4010/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.28.up_proj: 11%|█ | 4011/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.28.down_proj: 11%|█ | 4012/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.29.gate_proj: 11%|█ | 4013/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.29.up_proj: 11%|█ | 4014/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.29.down_proj: 11%|█ | 4015/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.30.gate_proj: 11%|█ | 4016/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.30.up_proj: 11%|█ | 4017/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.30.down_proj: 11%|█ | 4018/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.31.gate_proj: 11%|█ | 4019/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.31.up_proj: 11%|█ | 4020/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.31.down_proj: 11%|█ | 4021/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.32.gate_proj: 11%|█ | 4022/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.32.up_proj: 11%|█ | 4023/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.32.down_proj: 11%|█ | 4024/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.33.gate_proj: 11%|█ | 4025/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.33.up_proj: 11%|█ | 4026/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.33.down_proj: 11%|█ | 4027/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.34.gate_proj: 11%|█ | 4028/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.34.up_proj: 11%|█ | 4029/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.34.down_proj: 11%|█ | 4030/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.35.gate_proj: 11%|█ | 4031/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.35.up_proj: 11%|█ | 4032/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.35.down_proj: 11%|█ | 4033/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.36.gate_proj: 11%|█ | 4034/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.36.up_proj: 11%|█ | 4035/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.36.down_proj: 11%|█ | 4036/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.37.gate_proj: 11%|█ | 4037/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.37.up_proj: 11%|█ | 4038/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.37.down_proj: 11%|█ | 4039/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.38.gate_proj: 11%|█ | 4040/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.38.up_proj: 11%|█ | 4041/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.38.down_proj: 11%|█ | 4042/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.39.gate_proj: 11%|█ | 4043/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.39.up_proj: 11%|█ | 4044/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.39.down_proj: 11%|█ | 4045/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.40.gate_proj: 11%|█ | 4046/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.40.up_proj: 11%|█ | 4047/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.40.down_proj: 11%|█ | 4048/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.41.gate_proj: 11%|█ | 4049/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.41.up_proj: 11%|█ | 4050/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.41.down_proj: 11%|█ | 4051/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.42.gate_proj: 11%|█ | 4052/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.42.up_proj: 11%|█ | 4053/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.42.down_proj: 11%|█ | 4054/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.43.gate_proj: 11%|█ | 4055/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.43.up_proj: 11%|█ | 4056/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.43.down_proj: 11%|█ | 4057/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.44.gate_proj: 11%|█ | 4058/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.44.up_proj: 11%|█ | 4059/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.44.down_proj: 11%|█ | 4060/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.45.gate_proj: 11%|█ | 4061/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.45.up_proj: 11%|█ | 4062/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.45.down_proj: 11%|█ | 4063/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.46.gate_proj: 11%|█ | 4064/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.46.up_proj: 11%|█ | 4065/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.46.down_proj: 11%|█ | 4066/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.47.gate_proj: 11%|█ | 4067/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.47.up_proj: 11%|█ | 4068/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.47.down_proj: 11%|█ | 4069/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.48.gate_proj: 11%|█ | 4070/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.48.up_proj: 11%|█ | 4071/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.48.down_proj: 11%|█ | 4072/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.49.gate_proj: 11%|█ | 4073/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.49.up_proj: 11%|█ | 4074/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.49.down_proj: 11%|█ | 4075/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.50.gate_proj: 11%|█ | 4076/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.50.up_proj: 11%|█ | 4077/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.50.down_proj: 11%|█ | 4078/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.51.gate_proj: 11%|█ | 4079/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.51.up_proj: 11%|█ | 4080/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.51.down_proj: 11%|█ | 4081/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.52.gate_proj: 11%|█ | 4082/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.52.up_proj: 11%|█ | 4083/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.52.down_proj: 11%|█ | 4084/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.53.gate_proj: 11%|█ | 4085/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.53.up_proj: 11%|█ | 4086/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.53.down_proj: 11%|█ | 4087/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.54.gate_proj: 11%|█ | 4088/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.54.up_proj: 11%|█ | 4089/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.54.down_proj: 11%|█ | 4090/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.55.gate_proj: 11%|█ | 4091/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.55.up_proj: 11%|█ | 4092/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.55.down_proj: 11%|█ | 4093/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.56.gate_proj: 11%|█ | 4094/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.56.up_proj: 11%|█ | 4095/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.56.down_proj: 11%|█ | 4096/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.57.gate_proj: 11%|█ | 4097/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.57.up_proj: 11%|█ | 4098/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.57.down_proj: 11%|█ | 4099/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.58.gate_proj: 11%|█ | 4100/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.58.up_proj: 11%|█ | 4101/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.58.down_proj: 11%|█ | 4102/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.59.gate_proj: 11%|█ | 4103/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.59.up_proj: 11%|█ | 4104/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.59.down_proj: 11%|█ | 4105/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.60.gate_proj: 11%|█ | 4106/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.60.up_proj: 11%|█ | 4107/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.60.down_proj: 11%|█ | 4108/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.61.gate_proj: 11%|█ | 4109/36566 [00:04<00:27, 1170.33it/s] packing model.layers.9.mlp.experts.61.gate_proj: 11%|█ | 4110/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.61.up_proj: 11%|█ | 4110/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.61.down_proj: 11%|█ | 4111/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.62.gate_proj: 11%|█ | 4112/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.62.up_proj: 11%|█ | 4113/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.62.down_proj: 11%|█▏ | 4114/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.63.gate_proj: 11%|█▏ | 4115/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.63.up_proj: 11%|█▏ | 4116/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.63.down_proj: 11%|█▏ | 4117/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.64.gate_proj: 11%|█▏ | 4118/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.64.up_proj: 11%|█▏ | 4119/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.64.down_proj: 11%|█▏ | 4120/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.65.gate_proj: 11%|█▏ | 4121/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.65.up_proj: 11%|█▏ | 4122/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.65.down_proj: 11%|█▏ | 4123/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.66.gate_proj: 11%|█▏ | 4124/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.66.up_proj: 11%|█▏ | 4125/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.66.down_proj: 11%|█▏ | 4126/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.67.gate_proj: 11%|█▏ | 4127/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.67.up_proj: 11%|█▏ | 4128/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.67.down_proj: 11%|█▏ | 4129/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.68.gate_proj: 11%|█▏ | 4130/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.68.up_proj: 11%|█▏ | 4131/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.68.down_proj: 11%|█▏ | 4132/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.69.gate_proj: 11%|█▏ | 4133/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.69.up_proj: 11%|█▏ | 4134/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.69.down_proj: 11%|█▏ | 4135/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.70.gate_proj: 11%|█▏ | 4136/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.70.up_proj: 11%|█▏ | 4137/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.70.down_proj: 11%|█▏ | 4138/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.71.gate_proj: 11%|█▏ | 4139/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.71.up_proj: 11%|█▏ | 4140/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.71.down_proj: 11%|█▏ | 4141/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.72.gate_proj: 11%|█▏ | 4142/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.72.up_proj: 11%|█▏ | 4143/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.72.down_proj: 11%|█▏ | 4144/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.73.gate_proj: 11%|█▏ | 4145/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.73.up_proj: 11%|█▏ | 4146/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.73.down_proj: 11%|█▏ | 4147/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.74.gate_proj: 11%|█▏ | 4148/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.74.up_proj: 11%|█▏ | 4149/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.74.down_proj: 11%|█▏ | 4150/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.75.gate_proj: 11%|█▏ | 4151/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.75.up_proj: 11%|█▏ | 4152/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.75.down_proj: 11%|█▏ | 4153/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.76.gate_proj: 11%|█▏ | 4154/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.76.up_proj: 11%|█▏ | 4155/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.76.down_proj: 11%|█▏ | 4156/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.77.gate_proj: 11%|█▏ | 4157/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.77.up_proj: 11%|█▏ | 4158/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.77.down_proj: 11%|█▏ | 4159/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.78.gate_proj: 11%|█▏ | 4160/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.78.up_proj: 11%|█▏ | 4161/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.78.down_proj: 11%|█▏ | 4162/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.79.gate_proj: 11%|█▏ | 4163/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.79.up_proj: 11%|█▏ | 4164/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.79.down_proj: 11%|█▏ | 4165/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.80.gate_proj: 11%|█▏ | 4166/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.80.up_proj: 11%|█▏ | 4167/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.80.down_proj: 11%|█▏ | 4168/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.81.gate_proj: 11%|█▏ | 4169/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.81.up_proj: 11%|█▏ | 4170/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.81.down_proj: 11%|█▏ | 4171/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.82.gate_proj: 11%|█▏ | 4172/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.82.up_proj: 11%|█▏ | 4173/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.82.down_proj: 11%|█▏ | 4174/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.83.gate_proj: 11%|█▏ | 4175/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.83.up_proj: 11%|█▏ | 4176/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.83.down_proj: 11%|█▏ | 4177/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.84.gate_proj: 11%|█▏ | 4178/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.84.up_proj: 11%|█▏ | 4179/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.84.down_proj: 11%|█▏ | 4180/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.85.gate_proj: 11%|█▏ | 4181/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.85.up_proj: 11%|█▏ | 4182/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.85.down_proj: 11%|█▏ | 4183/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.86.gate_proj: 11%|█▏ | 4184/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.86.up_proj: 11%|█▏ | 4185/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.86.down_proj: 11%|█▏ | 4186/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.87.gate_proj: 11%|█▏ | 4187/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.87.up_proj: 11%|█▏ | 4188/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.87.down_proj: 11%|█▏ | 4189/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.88.gate_proj: 11%|█▏ | 4190/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.88.up_proj: 11%|█▏ | 4191/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.88.down_proj: 11%|█▏ | 4192/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.89.gate_proj: 11%|█▏ | 4193/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.89.up_proj: 11%|█▏ | 4194/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.89.down_proj: 11%|█▏ | 4195/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.90.gate_proj: 11%|█▏ | 4196/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.90.up_proj: 11%|█▏ | 4197/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.90.down_proj: 11%|█▏ | 4198/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.91.gate_proj: 11%|█▏ | 4199/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.91.up_proj: 11%|█▏ | 4200/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.91.down_proj: 11%|█▏ | 4201/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.92.gate_proj: 11%|█▏ | 4202/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.92.up_proj: 11%|█▏ | 4203/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.92.down_proj: 11%|█▏ | 4204/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.93.gate_proj: 11%|█▏ | 4205/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.93.up_proj: 12%|█▏ | 4206/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.93.down_proj: 12%|█▏ | 4207/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.94.gate_proj: 12%|█▏ | 4208/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.94.up_proj: 12%|█▏ | 4209/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.94.down_proj: 12%|█▏ | 4210/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.95.gate_proj: 12%|█▏ | 4211/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.95.up_proj: 12%|█▏ | 4212/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.95.down_proj: 12%|█▏ | 4213/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.96.gate_proj: 12%|█▏ | 4214/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.96.up_proj: 12%|█▏ | 4215/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.96.down_proj: 12%|█▏ | 4216/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.97.gate_proj: 12%|█▏ | 4217/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.97.up_proj: 12%|█▏ | 4218/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.97.down_proj: 12%|█▏ | 4219/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.98.gate_proj: 12%|█▏ | 4220/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.98.up_proj: 12%|█▏ | 4221/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.98.down_proj: 12%|█▏ | 4222/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.99.gate_proj: 12%|█▏ | 4223/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.99.up_proj: 12%|█▏ | 4224/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.99.down_proj: 12%|█▏ | 4225/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.100.gate_proj: 12%|█▏ | 4226/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.100.up_proj: 12%|█▏ | 4227/36566 [00:04<00:27, 1170.51it/s] packing model.layers.9.mlp.experts.100.up_proj: 12%|█▏ | 4228/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.100.down_proj: 12%|█▏ | 4228/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.101.gate_proj: 12%|█▏ | 4229/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.101.up_proj: 12%|█▏ | 4230/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.101.down_proj: 12%|█▏ | 4231/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.102.gate_proj: 12%|█▏ | 4232/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.102.up_proj: 12%|█▏ | 4233/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.102.down_proj: 12%|█▏ | 4234/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.103.gate_proj: 12%|█▏ | 4235/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.103.up_proj: 12%|█▏ | 4236/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.103.down_proj: 12%|█▏ | 4237/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.104.gate_proj: 12%|█▏ | 4238/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.104.up_proj: 12%|█▏ | 4239/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.104.down_proj: 12%|█▏ | 4240/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.105.gate_proj: 12%|█▏ | 4241/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.105.up_proj: 12%|█▏ | 4242/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.105.down_proj: 12%|█▏ | 4243/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.106.gate_proj: 12%|█▏ | 4244/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.106.up_proj: 12%|█▏ | 4245/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.106.down_proj: 12%|█▏ | 4246/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.107.gate_proj: 12%|█▏ | 4247/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.107.up_proj: 12%|█▏ | 4248/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.107.down_proj: 12%|█▏ | 4249/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.108.gate_proj: 12%|█▏ | 4250/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.108.up_proj: 12%|█▏ | 4251/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.108.down_proj: 12%|█▏ | 4252/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.109.gate_proj: 12%|█▏ | 4253/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.109.up_proj: 12%|█▏ | 4254/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.109.down_proj: 12%|█▏ | 4255/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.110.gate_proj: 12%|█▏ | 4256/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.110.up_proj: 12%|█▏ | 4257/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.110.down_proj: 12%|█▏ | 4258/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.111.gate_proj: 12%|█▏ | 4259/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.111.up_proj: 12%|█▏ | 4260/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.111.down_proj: 12%|█▏ | 4261/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.112.gate_proj: 12%|█▏ | 4262/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.112.up_proj: 12%|█▏ | 4263/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.112.down_proj: 12%|█▏ | 4264/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.113.gate_proj: 12%|█▏ | 4265/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.113.up_proj: 12%|█▏ | 4266/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.113.down_proj: 12%|█▏ | 4267/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.114.gate_proj: 12%|█▏ | 4268/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.114.up_proj: 12%|█▏ | 4269/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.114.down_proj: 12%|█▏ | 4270/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.115.gate_proj: 12%|█▏ | 4271/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.115.up_proj: 12%|█▏ | 4272/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.115.down_proj: 12%|█▏ | 4273/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.116.gate_proj: 12%|█▏ | 4274/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.116.up_proj: 12%|█▏ | 4275/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.116.down_proj: 12%|█▏ | 4276/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.117.gate_proj: 12%|█▏ | 4277/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.117.up_proj: 12%|█▏ | 4278/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.117.down_proj: 12%|█▏ | 4279/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.118.gate_proj: 12%|█▏ | 4280/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.118.up_proj: 12%|█▏ | 4281/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.118.down_proj: 12%|█▏ | 4282/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.119.gate_proj: 12%|█▏ | 4283/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.119.up_proj: 12%|█▏ | 4284/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.119.down_proj: 12%|█▏ | 4285/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.120.gate_proj: 12%|█▏ | 4286/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.120.up_proj: 12%|█▏ | 4287/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.120.down_proj: 12%|█▏ | 4288/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.121.gate_proj: 12%|█▏ | 4289/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.121.up_proj: 12%|█▏ | 4290/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.121.down_proj: 12%|█▏ | 4291/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.122.gate_proj: 12%|█▏ | 4292/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.122.up_proj: 12%|█▏ | 4293/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.122.down_proj: 12%|█▏ | 4294/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.123.gate_proj: 12%|█▏ | 4295/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.123.up_proj: 12%|█▏ | 4296/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.123.down_proj: 12%|█▏ | 4297/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.124.gate_proj: 12%|█▏ | 4298/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.124.up_proj: 12%|█▏ | 4299/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.124.down_proj: 12%|█▏ | 4300/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.125.gate_proj: 12%|█▏ | 4301/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.125.up_proj: 12%|█▏ | 4302/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.125.down_proj: 12%|█▏ | 4303/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.126.gate_proj: 12%|█▏ | 4304/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.126.up_proj: 12%|█▏ | 4305/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.126.down_proj: 12%|█▏ | 4306/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.127.gate_proj: 12%|█▏ | 4307/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.127.up_proj: 12%|█▏ | 4308/36566 [00:04<00:27, 1169.82it/s] packing model.layers.9.mlp.experts.127.down_proj: 12%|█▏ | 4309/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.0.gate_proj: 12%|█▏ | 4310/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.0.up_proj: 12%|█▏ | 4311/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.0.down_proj: 12%|█▏ | 4312/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.1.gate_proj: 12%|█▏ | 4313/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.1.up_proj: 12%|█▏ | 4314/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.1.down_proj: 12%|█▏ | 4315/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.2.gate_proj: 12%|█▏ | 4316/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.2.up_proj: 12%|█▏ | 4317/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.2.down_proj: 12%|█▏ | 4318/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.3.gate_proj: 12%|█▏ | 4319/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.3.up_proj: 12%|█▏ | 4320/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.3.down_proj: 12%|█▏ | 4321/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.4.gate_proj: 12%|█▏ | 4322/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.4.up_proj: 12%|█▏ | 4323/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.4.down_proj: 12%|█▏ | 4324/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.5.gate_proj: 12%|█▏ | 4325/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.5.up_proj: 12%|█▏ | 4326/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.5.down_proj: 12%|█▏ | 4327/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.6.gate_proj: 12%|█▏ | 4328/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.6.up_proj: 12%|█▏ | 4329/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.6.down_proj: 12%|█▏ | 4330/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.7.gate_proj: 12%|█▏ | 4331/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.7.up_proj: 12%|█▏ | 4332/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.7.down_proj: 12%|█▏ | 4333/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.8.gate_proj: 12%|█▏ | 4334/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.8.up_proj: 12%|█▏ | 4335/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.8.down_proj: 12%|█▏ | 4336/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.9.gate_proj: 12%|█▏ | 4337/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.9.up_proj: 12%|█▏ | 4338/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.9.down_proj: 12%|█▏ | 4339/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.10.gate_proj: 12%|█▏ | 4340/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.10.up_proj: 12%|█▏ | 4341/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.10.down_proj: 12%|█▏ | 4342/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.11.gate_proj: 12%|█▏ | 4343/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.11.up_proj: 12%|█▏ | 4344/36566 [00:04<00:27, 1169.82it/s] packing model.layers.10.mlp.experts.11.up_proj: 12%|█▏ | 4345/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.11.down_proj: 12%|█▏ | 4345/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.12.gate_proj: 12%|█▏ | 4346/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.12.up_proj: 12%|█▏ | 4347/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.12.down_proj: 12%|█▏ | 4348/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.13.gate_proj: 12%|█▏ | 4349/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.13.up_proj: 12%|█▏ | 4350/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.13.down_proj: 12%|█▏ | 4351/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.14.gate_proj: 12%|█▏ | 4352/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.14.up_proj: 12%|█▏ | 4353/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.14.down_proj: 12%|█▏ | 4354/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.15.gate_proj: 12%|█▏ | 4355/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.15.up_proj: 12%|█▏ | 4356/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.15.down_proj: 12%|█▏ | 4357/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.16.gate_proj: 12%|█▏ | 4358/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.16.up_proj: 12%|█▏ | 4359/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.16.down_proj: 12%|█▏ | 4360/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.17.gate_proj: 12%|█▏ | 4361/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.17.up_proj: 12%|█▏ | 4362/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.17.down_proj: 12%|█▏ | 4363/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.18.gate_proj: 12%|█▏ | 4364/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.18.up_proj: 12%|█▏ | 4365/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.18.down_proj: 12%|█▏ | 4366/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.19.gate_proj: 12%|█▏ | 4367/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.19.up_proj: 12%|█▏ | 4368/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.19.down_proj: 12%|█▏ | 4369/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.20.gate_proj: 12%|█▏ | 4370/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.20.up_proj: 12%|█▏ | 4371/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.20.down_proj: 12%|█▏ | 4372/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.21.gate_proj: 12%|█▏ | 4373/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.21.up_proj: 12%|█▏ | 4374/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.21.down_proj: 12%|█▏ | 4375/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.22.gate_proj: 12%|█▏ | 4376/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.22.up_proj: 12%|█▏ | 4377/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.22.down_proj: 12%|█▏ | 4378/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.23.gate_proj: 12%|█▏ | 4379/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.23.up_proj: 12%|█▏ | 4380/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.23.down_proj: 12%|█▏ | 4381/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.24.gate_proj: 12%|█▏ | 4382/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.24.up_proj: 12%|█▏ | 4383/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.24.down_proj: 12%|█▏ | 4384/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.25.gate_proj: 12%|█▏ | 4385/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.25.up_proj: 12%|█▏ | 4386/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.25.down_proj: 12%|█▏ | 4387/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.26.gate_proj: 12%|█▏ | 4388/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.26.up_proj: 12%|█▏ | 4389/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.26.down_proj: 12%|█▏ | 4390/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.27.gate_proj: 12%|█▏ | 4391/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.27.up_proj: 12%|█▏ | 4392/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.27.down_proj: 12%|█▏ | 4393/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.28.gate_proj: 12%|█▏ | 4394/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.28.up_proj: 12%|█▏ | 4395/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.28.down_proj: 12%|█▏ | 4396/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.29.gate_proj: 12%|█▏ | 4397/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.29.up_proj: 12%|█▏ | 4398/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.29.down_proj: 12%|█▏ | 4399/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.30.gate_proj: 12%|█▏ | 4400/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.30.up_proj: 12%|█▏ | 4401/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.30.down_proj: 12%|█▏ | 4402/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.31.gate_proj: 12%|█▏ | 4403/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.31.up_proj: 12%|█▏ | 4404/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.31.down_proj: 12%|█▏ | 4405/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.32.gate_proj: 12%|█▏ | 4406/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.32.up_proj: 12%|█▏ | 4407/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.32.down_proj: 12%|█▏ | 4408/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.33.gate_proj: 12%|█▏ | 4409/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.33.up_proj: 12%|█▏ | 4410/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.33.down_proj: 12%|█▏ | 4411/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.34.gate_proj: 12%|█▏ | 4412/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.34.up_proj: 12%|█▏ | 4413/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.34.down_proj: 12%|█▏ | 4414/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.35.gate_proj: 12%|█▏ | 4415/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.35.up_proj: 12%|█▏ | 4416/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.35.down_proj: 12%|█▏ | 4417/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.36.gate_proj: 12%|█▏ | 4418/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.36.up_proj: 12%|█▏ | 4419/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.36.down_proj: 12%|█▏ | 4420/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.37.gate_proj: 12%|█▏ | 4421/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.37.up_proj: 12%|█▏ | 4422/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.37.down_proj: 12%|█▏ | 4423/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.38.gate_proj: 12%|█▏ | 4424/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.38.up_proj: 12%|█▏ | 4425/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.38.down_proj: 12%|█▏ | 4426/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.39.gate_proj: 12%|█▏ | 4427/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.39.up_proj: 12%|█▏ | 4428/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.39.down_proj: 12%|█▏ | 4429/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.40.gate_proj: 12%|█▏ | 4430/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.40.up_proj: 12%|█▏ | 4431/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.40.down_proj: 12%|█▏ | 4432/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.41.gate_proj: 12%|█▏ | 4433/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.41.up_proj: 12%|█▏ | 4434/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.41.down_proj: 12%|█▏ | 4435/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.42.gate_proj: 12%|█▏ | 4436/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.42.up_proj: 12%|█▏ | 4437/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.42.down_proj: 12%|█▏ | 4438/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.43.gate_proj: 12%|█▏ | 4439/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.43.up_proj: 12%|█▏ | 4440/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.43.down_proj: 12%|█▏ | 4441/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.44.gate_proj: 12%|█▏ | 4442/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.44.up_proj: 12%|█▏ | 4443/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.44.down_proj: 12%|█▏ | 4444/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.45.gate_proj: 12%|█▏ | 4445/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.45.up_proj: 12%|█▏ | 4446/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.45.down_proj: 12%|█▏ | 4447/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.46.gate_proj: 12%|█▏ | 4448/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.46.up_proj: 12%|█▏ | 4449/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.46.down_proj: 12%|█▏ | 4450/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.47.gate_proj: 12%|█▏ | 4451/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.47.up_proj: 12%|█▏ | 4452/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.47.down_proj: 12%|█▏ | 4453/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.48.gate_proj: 12%|█▏ | 4454/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.48.up_proj: 12%|█▏ | 4455/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.48.down_proj: 12%|█▏ | 4456/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.49.gate_proj: 12%|█▏ | 4457/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.49.up_proj: 12%|█▏ | 4458/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.49.down_proj: 12%|█▏ | 4459/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.50.gate_proj: 12%|█▏ | 4460/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.50.up_proj: 12%|█▏ | 4461/36566 [00:04<00:27, 1169.20it/s] packing model.layers.10.mlp.experts.50.up_proj: 12%|█▏ | 4462/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.50.down_proj: 12%|█▏ | 4462/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.51.gate_proj: 12%|█▏ | 4463/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.51.up_proj: 12%|█▏ | 4464/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.51.down_proj: 12%|█▏ | 4465/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.52.gate_proj: 12%|█▏ | 4466/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.52.up_proj: 12%|█▏ | 4467/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.52.down_proj: 12%|█▏ | 4468/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.53.gate_proj: 12%|█▏ | 4469/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.53.up_proj: 12%|█▏ | 4470/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.53.down_proj: 12%|█▏ | 4471/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.54.gate_proj: 12%|█▏ | 4472/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.54.up_proj: 12%|█▏ | 4473/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.54.down_proj: 12%|█▏ | 4474/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.55.gate_proj: 12%|█▏ | 4475/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.55.up_proj: 12%|█▏ | 4476/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.55.down_proj: 12%|█▏ | 4477/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.56.gate_proj: 12%|█▏ | 4478/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.56.up_proj: 12%|█▏ | 4479/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.56.down_proj: 12%|█▏ | 4480/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.57.gate_proj: 12%|█▏ | 4481/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.57.up_proj: 12%|█▏ | 4482/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.57.down_proj: 12%|█▏ | 4483/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.58.gate_proj: 12%|█▏ | 4484/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.58.up_proj: 12%|█▏ | 4485/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.58.down_proj: 12%|█▏ | 4486/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.59.gate_proj: 12%|█▏ | 4487/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.59.up_proj: 12%|█▏ | 4488/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.59.down_proj: 12%|█▏ | 4489/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.60.gate_proj: 12%|█▏ | 4490/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.60.up_proj: 12%|█▏ | 4491/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.60.down_proj: 12%|█▏ | 4492/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.61.gate_proj: 12%|█▏ | 4493/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.61.up_proj: 12%|█▏ | 4494/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.61.down_proj: 12%|█▏ | 4495/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.62.gate_proj: 12%|█▏ | 4496/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.62.up_proj: 12%|█▏ | 4497/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.62.down_proj: 12%|█▏ | 4498/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.63.gate_proj: 12%|█▏ | 4499/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.63.up_proj: 12%|█▏ | 4500/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.63.down_proj: 12%|█▏ | 4501/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.64.gate_proj: 12%|█▏ | 4502/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.64.up_proj: 12%|█▏ | 4503/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.64.down_proj: 12%|█▏ | 4504/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.65.gate_proj: 12%|█▏ | 4505/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.65.up_proj: 12%|█▏ | 4506/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.65.down_proj: 12%|█▏ | 4507/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.66.gate_proj: 12%|█▏ | 4508/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.66.up_proj: 12%|█▏ | 4509/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.66.down_proj: 12%|█▏ | 4510/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.67.gate_proj: 12%|█▏ | 4511/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.67.up_proj: 12%|█▏ | 4512/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.67.down_proj: 12%|█▏ | 4513/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.68.gate_proj: 12%|█▏ | 4514/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.68.up_proj: 12%|█▏ | 4515/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.68.down_proj: 12%|█▏ | 4516/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.69.gate_proj: 12%|█▏ | 4517/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.69.up_proj: 12%|█▏ | 4518/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.69.down_proj: 12%|█▏ | 4519/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.70.gate_proj: 12%|█▏ | 4520/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.70.up_proj: 12%|█▏ | 4521/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.70.down_proj: 12%|█▏ | 4522/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.71.gate_proj: 12%|█▏ | 4523/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.71.up_proj: 12%|█▏ | 4524/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.71.down_proj: 12%|█▏ | 4525/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.72.gate_proj: 12%|█▏ | 4526/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.72.up_proj: 12%|█▏ | 4527/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.72.down_proj: 12%|█▏ | 4528/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.73.gate_proj: 12%|█▏ | 4529/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.73.up_proj: 12%|█▏ | 4530/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.73.down_proj: 12%|█▏ | 4531/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.74.gate_proj: 12%|█▏ | 4532/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.74.up_proj: 12%|█▏ | 4533/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.74.down_proj: 12%|█▏ | 4534/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.75.gate_proj: 12%|█▏ | 4535/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.75.up_proj: 12%|█▏ | 4536/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.75.down_proj: 12%|█▏ | 4537/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.76.gate_proj: 12%|█▏ | 4538/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.76.up_proj: 12%|█▏ | 4539/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.76.down_proj: 12%|█▏ | 4540/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.77.gate_proj: 12%|█▏ | 4541/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.77.up_proj: 12%|█▏ | 4542/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.77.down_proj: 12%|█▏ | 4543/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.78.gate_proj: 12%|█▏ | 4544/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.78.up_proj: 12%|█▏ | 4545/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.78.down_proj: 12%|█▏ | 4546/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.79.gate_proj: 12%|█▏ | 4547/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.79.up_proj: 12%|█▏ | 4548/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.79.down_proj: 12%|█▏ | 4549/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.80.gate_proj: 12%|█▏ | 4550/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.80.up_proj: 12%|█▏ | 4551/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.80.down_proj: 12%|█▏ | 4552/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.81.gate_proj: 12%|█▏ | 4553/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.81.up_proj: 12%|█▏ | 4554/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.81.down_proj: 12%|█▏ | 4555/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.82.gate_proj: 12%|█▏ | 4556/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.82.up_proj: 12%|█▏ | 4557/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.82.down_proj: 12%|█▏ | 4558/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.83.gate_proj: 12%|█▏ | 4559/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.83.up_proj: 12%|█▏ | 4560/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.83.down_proj: 12%|█▏ | 4561/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.84.gate_proj: 12%|█▏ | 4562/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.84.up_proj: 12%|█▏ | 4563/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.84.down_proj: 12%|█▏ | 4564/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.85.gate_proj: 12%|█▏ | 4565/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.85.up_proj: 12%|█▏ | 4566/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.85.down_proj: 12%|█▏ | 4567/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.86.gate_proj: 12%|█▏ | 4568/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.86.up_proj: 12%|█▏ | 4569/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.86.down_proj: 12%|█▏ | 4570/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.87.gate_proj: 13%|█▎ | 4571/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.87.up_proj: 13%|█▎ | 4572/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.87.down_proj: 13%|█▎ | 4573/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.88.gate_proj: 13%|█▎ | 4574/36566 [00:04<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.88.up_proj: 13%|█▎ | 4575/36566 [00:05<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.88.down_proj: 13%|█▎ | 4576/36566 [00:05<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.89.gate_proj: 13%|█▎ | 4577/36566 [00:05<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.89.up_proj: 13%|█▎ | 4578/36566 [00:05<00:27, 1169.39it/s] packing model.layers.10.mlp.experts.89.up_proj: 13%|█▎ | 4579/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.89.down_proj: 13%|█▎ | 4579/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.90.gate_proj: 13%|█▎ | 4580/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.90.up_proj: 13%|█▎ | 4581/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.90.down_proj: 13%|█▎ | 4582/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.91.gate_proj: 13%|█▎ | 4583/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.91.up_proj: 13%|█▎ | 4584/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.91.down_proj: 13%|█▎ | 4585/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.92.gate_proj: 13%|█▎ | 4586/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.92.up_proj: 13%|█▎ | 4587/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.92.down_proj: 13%|█▎ | 4588/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.93.gate_proj: 13%|█▎ | 4589/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.93.up_proj: 13%|█▎ | 4590/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.93.down_proj: 13%|█▎ | 4591/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.94.gate_proj: 13%|█▎ | 4592/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.94.up_proj: 13%|█▎ | 4593/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.94.down_proj: 13%|█▎ | 4594/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.95.gate_proj: 13%|█▎ | 4595/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.95.up_proj: 13%|█▎ | 4596/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.95.down_proj: 13%|█▎ | 4597/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.96.gate_proj: 13%|█▎ | 4598/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.96.up_proj: 13%|█▎ | 4599/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.96.down_proj: 13%|█▎ | 4600/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.97.gate_proj: 13%|█▎ | 4601/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.97.up_proj: 13%|█▎ | 4602/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.97.down_proj: 13%|█▎ | 4603/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.98.gate_proj: 13%|█▎ | 4604/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.98.up_proj: 13%|█▎ | 4605/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.98.down_proj: 13%|█▎ | 4606/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.99.gate_proj: 13%|█▎ | 4607/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.99.up_proj: 13%|█▎ | 4608/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.99.down_proj: 13%|█▎ | 4609/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.100.gate_proj: 13%|█▎ | 4610/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.100.up_proj: 13%|█▎ | 4611/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.100.down_proj: 13%|█▎ | 4612/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.101.gate_proj: 13%|█▎ | 4613/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.101.up_proj: 13%|█▎ | 4614/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.101.down_proj: 13%|█▎ | 4615/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.102.gate_proj: 13%|█▎ | 4616/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.102.up_proj: 13%|█▎ | 4617/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.102.down_proj: 13%|█▎ | 4618/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.103.gate_proj: 13%|█▎ | 4619/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.103.up_proj: 13%|█▎ | 4620/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.103.down_proj: 13%|█▎ | 4621/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.104.gate_proj: 13%|█▎ | 4622/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.104.up_proj: 13%|█▎ | 4623/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.104.down_proj: 13%|█▎ | 4624/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.105.gate_proj: 13%|█▎ | 4625/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.105.up_proj: 13%|█▎ | 4626/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.105.down_proj: 13%|█▎ | 4627/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.106.gate_proj: 13%|█▎ | 4628/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.106.up_proj: 13%|█▎ | 4629/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.106.down_proj: 13%|█▎ | 4630/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.107.gate_proj: 13%|█▎ | 4631/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.107.up_proj: 13%|█▎ | 4632/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.107.down_proj: 13%|█▎ | 4633/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.108.gate_proj: 13%|█▎ | 4634/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.108.up_proj: 13%|█▎ | 4635/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.108.down_proj: 13%|█▎ | 4636/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.109.gate_proj: 13%|█▎ | 4637/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.109.up_proj: 13%|█▎ | 4638/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.109.down_proj: 13%|█▎ | 4639/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.110.gate_proj: 13%|█▎ | 4640/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.110.up_proj: 13%|█▎ | 4641/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.110.down_proj: 13%|█▎ | 4642/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.111.gate_proj: 13%|█▎ | 4643/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.111.up_proj: 13%|█▎ | 4644/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.111.down_proj: 13%|█▎ | 4645/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.112.gate_proj: 13%|█▎ | 4646/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.112.up_proj: 13%|█▎ | 4647/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.112.down_proj: 13%|█▎ | 4648/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.113.gate_proj: 13%|█▎ | 4649/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.113.up_proj: 13%|█▎ | 4650/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.113.down_proj: 13%|█▎ | 4651/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.114.gate_proj: 13%|█▎ | 4652/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.114.up_proj: 13%|█▎ | 4653/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.114.down_proj: 13%|█▎ | 4654/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.115.gate_proj: 13%|█▎ | 4655/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.115.up_proj: 13%|█▎ | 4656/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.115.down_proj: 13%|█▎ | 4657/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.116.gate_proj: 13%|█▎ | 4658/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.116.up_proj: 13%|█▎ | 4659/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.116.down_proj: 13%|█▎ | 4660/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.117.gate_proj: 13%|█▎ | 4661/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.117.up_proj: 13%|█▎ | 4662/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.117.down_proj: 13%|█▎ | 4663/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.118.gate_proj: 13%|█▎ | 4664/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.118.up_proj: 13%|█▎ | 4665/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.118.down_proj: 13%|█▎ | 4666/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.119.gate_proj: 13%|█▎ | 4667/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.119.up_proj: 13%|█▎ | 4668/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.119.down_proj: 13%|█▎ | 4669/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.120.gate_proj: 13%|█▎ | 4670/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.120.up_proj: 13%|█▎ | 4671/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.120.down_proj: 13%|█▎ | 4672/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.121.gate_proj: 13%|█▎ | 4673/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.121.up_proj: 13%|█▎ | 4674/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.121.down_proj: 13%|█▎ | 4675/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.122.gate_proj: 13%|█▎ | 4676/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.122.up_proj: 13%|█▎ | 4677/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.122.down_proj: 13%|█▎ | 4678/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.123.gate_proj: 13%|█▎ | 4679/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.123.up_proj: 13%|█▎ | 4680/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.123.down_proj: 13%|█▎ | 4681/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.124.gate_proj: 13%|█▎ | 4682/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.124.up_proj: 13%|█▎ | 4683/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.124.down_proj: 13%|█▎ | 4684/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.125.gate_proj: 13%|█▎ | 4685/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.125.up_proj: 13%|█▎ | 4686/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.125.down_proj: 13%|█▎ | 4687/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.126.gate_proj: 13%|█▎ | 4688/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.126.up_proj: 13%|█▎ | 4689/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.126.down_proj: 13%|█▎ | 4690/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.127.gate_proj: 13%|█▎ | 4691/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.127.up_proj: 13%|█▎ | 4692/36566 [00:05<00:27, 1168.50it/s] packing model.layers.10.mlp.experts.127.down_proj: 13%|█▎ | 4693/36566 [00:05<00:27, 1168.50it/s] packing model.layers.11.mlp.experts.0.gate_proj: 13%|█▎ | 4694/36566 [00:05<00:27, 1168.50it/s] packing model.layers.11.mlp.experts.0.up_proj: 13%|█▎ | 4695/36566 [00:05<00:27, 1168.50it/s] packing model.layers.11.mlp.experts.0.up_proj: 13%|█▎ | 4696/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.0.down_proj: 13%|█▎ | 4696/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.1.gate_proj: 13%|█▎ | 4697/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.1.up_proj: 13%|█▎ | 4698/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.1.down_proj: 13%|█▎ | 4699/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.2.gate_proj: 13%|█▎ | 4700/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.2.up_proj: 13%|█▎ | 4701/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.2.down_proj: 13%|█▎ | 4702/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.3.gate_proj: 13%|█▎ | 4703/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.3.up_proj: 13%|█▎ | 4704/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.3.down_proj: 13%|█▎ | 4705/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.4.gate_proj: 13%|█▎ | 4706/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.4.up_proj: 13%|█▎ | 4707/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.4.down_proj: 13%|█▎ | 4708/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.5.gate_proj: 13%|█▎ | 4709/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.5.up_proj: 13%|█▎ | 4710/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.5.down_proj: 13%|█▎ | 4711/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.6.gate_proj: 13%|█▎ | 4712/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.6.up_proj: 13%|█▎ | 4713/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.6.down_proj: 13%|█▎ | 4714/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.7.gate_proj: 13%|█▎ | 4715/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.7.up_proj: 13%|█▎ | 4716/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.7.down_proj: 13%|█▎ | 4717/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.8.gate_proj: 13%|█▎ | 4718/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.8.up_proj: 13%|█▎ | 4719/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.8.down_proj: 13%|█▎ | 4720/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.9.gate_proj: 13%|█▎ | 4721/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.9.up_proj: 13%|█▎ | 4722/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.9.down_proj: 13%|█▎ | 4723/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.10.gate_proj: 13%|█▎ | 4724/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.10.up_proj: 13%|█▎ | 4725/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.10.down_proj: 13%|█▎ | 4726/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.11.gate_proj: 13%|█▎ | 4727/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.11.up_proj: 13%|█▎ | 4728/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.11.down_proj: 13%|█▎ | 4729/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.12.gate_proj: 13%|█▎ | 4730/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.12.up_proj: 13%|█▎ | 4731/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.12.down_proj: 13%|█▎ | 4732/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.13.gate_proj: 13%|█▎ | 4733/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.13.up_proj: 13%|█▎ | 4734/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.13.down_proj: 13%|█▎ | 4735/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.14.gate_proj: 13%|█▎ | 4736/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.14.up_proj: 13%|█▎ | 4737/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.14.down_proj: 13%|█▎ | 4738/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.15.gate_proj: 13%|█▎ | 4739/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.15.up_proj: 13%|█▎ | 4740/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.15.down_proj: 13%|█▎ | 4741/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.16.gate_proj: 13%|█▎ | 4742/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.16.up_proj: 13%|█▎ | 4743/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.16.down_proj: 13%|█▎ | 4744/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.17.gate_proj: 13%|█▎ | 4745/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.17.up_proj: 13%|█▎ | 4746/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.17.down_proj: 13%|█▎ | 4747/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.18.gate_proj: 13%|█▎ | 4748/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.18.up_proj: 13%|█▎ | 4749/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.18.down_proj: 13%|█▎ | 4750/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.19.gate_proj: 13%|█▎ | 4751/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.19.up_proj: 13%|█▎ | 4752/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.19.down_proj: 13%|█▎ | 4753/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.20.gate_proj: 13%|█▎ | 4754/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.20.up_proj: 13%|█▎ | 4755/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.20.down_proj: 13%|█▎ | 4756/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.21.gate_proj: 13%|█▎ | 4757/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.21.up_proj: 13%|█▎ | 4758/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.21.down_proj: 13%|█▎ | 4759/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.22.gate_proj: 13%|█▎ | 4760/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.22.up_proj: 13%|█▎ | 4761/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.22.down_proj: 13%|█▎ | 4762/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.23.gate_proj: 13%|█▎ | 4763/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.23.up_proj: 13%|█▎ | 4764/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.23.down_proj: 13%|█▎ | 4765/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.24.gate_proj: 13%|█▎ | 4766/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.24.up_proj: 13%|█▎ | 4767/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.24.down_proj: 13%|█▎ | 4768/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.25.gate_proj: 13%|█▎ | 4769/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.25.up_proj: 13%|█▎ | 4770/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.25.down_proj: 13%|█▎ | 4771/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.26.gate_proj: 13%|█▎ | 4772/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.26.up_proj: 13%|█▎ | 4773/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.26.down_proj: 13%|█▎ | 4774/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.27.gate_proj: 13%|█▎ | 4775/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.27.up_proj: 13%|█▎ | 4776/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.27.down_proj: 13%|█▎ | 4777/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.28.gate_proj: 13%|█▎ | 4778/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.28.up_proj: 13%|█▎ | 4779/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.28.down_proj: 13%|█▎ | 4780/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.29.gate_proj: 13%|█▎ | 4781/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.29.up_proj: 13%|█▎ | 4782/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.29.down_proj: 13%|█▎ | 4783/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.30.gate_proj: 13%|█▎ | 4784/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.30.up_proj: 13%|█▎ | 4785/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.30.down_proj: 13%|█▎ | 4786/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.31.gate_proj: 13%|█▎ | 4787/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.31.up_proj: 13%|█▎ | 4788/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.31.down_proj: 13%|█▎ | 4789/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.32.gate_proj: 13%|█▎ | 4790/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.32.up_proj: 13%|█▎ | 4791/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.32.down_proj: 13%|█▎ | 4792/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.33.gate_proj: 13%|█▎ | 4793/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.33.up_proj: 13%|█▎ | 4794/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.33.down_proj: 13%|█▎ | 4795/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.34.gate_proj: 13%|█▎ | 4796/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.34.up_proj: 13%|█▎ | 4797/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.34.down_proj: 13%|█▎ | 4798/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.35.gate_proj: 13%|█▎ | 4799/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.35.up_proj: 13%|█▎ | 4800/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.35.down_proj: 13%|█▎ | 4801/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.36.gate_proj: 13%|█▎ | 4802/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.36.up_proj: 13%|█▎ | 4803/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.36.down_proj: 13%|█▎ | 4804/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.37.gate_proj: 13%|█▎ | 4805/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.37.up_proj: 13%|█▎ | 4806/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.37.down_proj: 13%|█▎ | 4807/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.38.gate_proj: 13%|█▎ | 4808/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.38.up_proj: 13%|█▎ | 4809/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.38.down_proj: 13%|█▎ | 4810/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.39.gate_proj: 13%|█▎ | 4811/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.39.up_proj: 13%|█▎ | 4812/36566 [00:05<00:27, 1168.81it/s] packing model.layers.11.mlp.experts.39.up_proj: 13%|█▎ | 4813/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.39.down_proj: 13%|█▎ | 4813/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.40.gate_proj: 13%|█▎ | 4814/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.40.up_proj: 13%|█▎ | 4815/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.40.down_proj: 13%|█▎ | 4816/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.41.gate_proj: 13%|█▎ | 4817/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.41.up_proj: 13%|█▎ | 4818/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.41.down_proj: 13%|█▎ | 4819/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.42.gate_proj: 13%|█▎ | 4820/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.42.up_proj: 13%|█▎ | 4821/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.42.down_proj: 13%|█▎ | 4822/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.43.gate_proj: 13%|█▎ | 4823/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.43.up_proj: 13%|█▎ | 4824/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.43.down_proj: 13%|█▎ | 4825/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.44.gate_proj: 13%|█▎ | 4826/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.44.up_proj: 13%|█▎ | 4827/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.44.down_proj: 13%|█▎ | 4828/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.45.gate_proj: 13%|█▎ | 4829/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.45.up_proj: 13%|█▎ | 4830/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.45.down_proj: 13%|█▎ | 4831/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.46.gate_proj: 13%|█▎ | 4832/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.46.up_proj: 13%|█▎ | 4833/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.46.down_proj: 13%|█▎ | 4834/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.47.gate_proj: 13%|█▎ | 4835/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.47.up_proj: 13%|█▎ | 4836/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.47.down_proj: 13%|█▎ | 4837/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.48.gate_proj: 13%|█▎ | 4838/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.48.up_proj: 13%|█▎ | 4839/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.48.down_proj: 13%|█▎ | 4840/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.49.gate_proj: 13%|█▎ | 4841/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.49.up_proj: 13%|█▎ | 4842/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.49.down_proj: 13%|█▎ | 4843/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.50.gate_proj: 13%|█▎ | 4844/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.50.up_proj: 13%|█▎ | 4845/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.50.down_proj: 13%|█▎ | 4846/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.51.gate_proj: 13%|█▎ | 4847/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.51.up_proj: 13%|█▎ | 4848/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.51.down_proj: 13%|█▎ | 4849/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.52.gate_proj: 13%|█▎ | 4850/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.52.up_proj: 13%|█▎ | 4851/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.52.down_proj: 13%|█▎ | 4852/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.53.gate_proj: 13%|█▎ | 4853/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.53.up_proj: 13%|█▎ | 4854/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.53.down_proj: 13%|█▎ | 4855/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.54.gate_proj: 13%|█▎ | 4856/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.54.up_proj: 13%|█▎ | 4857/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.54.down_proj: 13%|█▎ | 4858/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.55.gate_proj: 13%|█▎ | 4859/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.55.up_proj: 13%|█▎ | 4860/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.55.down_proj: 13%|█▎ | 4861/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.56.gate_proj: 13%|█▎ | 4862/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.56.up_proj: 13%|█▎ | 4863/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.56.down_proj: 13%|█▎ | 4864/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.57.gate_proj: 13%|█▎ | 4865/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.57.up_proj: 13%|█▎ | 4866/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.57.down_proj: 13%|█▎ | 4867/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.58.gate_proj: 13%|█▎ | 4868/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.58.up_proj: 13%|█▎ | 4869/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.58.down_proj: 13%|█▎ | 4870/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.59.gate_proj: 13%|█▎ | 4871/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.59.up_proj: 13%|█▎ | 4872/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.59.down_proj: 13%|█▎ | 4873/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.60.gate_proj: 13%|█▎ | 4874/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.60.up_proj: 13%|█▎ | 4875/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.60.down_proj: 13%|█▎ | 4876/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.61.gate_proj: 13%|█▎ | 4877/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.61.up_proj: 13%|█▎ | 4878/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.61.down_proj: 13%|█▎ | 4879/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.62.gate_proj: 13%|█▎ | 4880/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.62.up_proj: 13%|█▎ | 4881/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.62.down_proj: 13%|█▎ | 4882/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.63.gate_proj: 13%|█▎ | 4883/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.63.up_proj: 13%|█▎ | 4884/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.63.down_proj: 13%|█▎ | 4885/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.64.gate_proj: 13%|█▎ | 4886/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.64.up_proj: 13%|█▎ | 4887/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.64.down_proj: 13%|█▎ | 4888/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.65.gate_proj: 13%|█▎ | 4889/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.65.up_proj: 13%|█▎ | 4890/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.65.down_proj: 13%|█▎ | 4891/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.66.gate_proj: 13%|█▎ | 4892/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.66.up_proj: 13%|█▎ | 4893/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.66.down_proj: 13%|█▎ | 4894/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.67.gate_proj: 13%|█▎ | 4895/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.67.up_proj: 13%|█▎ | 4896/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.67.down_proj: 13%|█▎ | 4897/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.68.gate_proj: 13%|█▎ | 4898/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.68.up_proj: 13%|█▎ | 4899/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.68.down_proj: 13%|█▎ | 4900/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.69.gate_proj: 13%|█▎ | 4901/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.69.up_proj: 13%|█▎ | 4902/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.69.down_proj: 13%|█▎ | 4903/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.70.gate_proj: 13%|█▎ | 4904/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.70.up_proj: 13%|█▎ | 4905/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.70.down_proj: 13%|█▎ | 4906/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.71.gate_proj: 13%|█▎ | 4907/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.71.up_proj: 13%|█▎ | 4908/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.71.down_proj: 13%|█▎ | 4909/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.72.gate_proj: 13%|█▎ | 4910/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.72.up_proj: 13%|█▎ | 4911/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.72.down_proj: 13%|█▎ | 4912/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.73.gate_proj: 13%|█▎ | 4913/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.73.up_proj: 13%|█▎ | 4914/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.73.down_proj: 13%|█▎ | 4915/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.74.gate_proj: 13%|█▎ | 4916/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.74.up_proj: 13%|█▎ | 4917/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.74.down_proj: 13%|█▎ | 4918/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.75.gate_proj: 13%|█▎ | 4919/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.75.up_proj: 13%|█▎ | 4920/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.75.down_proj: 13%|█▎ | 4921/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.76.gate_proj: 13%|█▎ | 4922/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.76.up_proj: 13%|█▎ | 4923/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.76.down_proj: 13%|█▎ | 4924/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.77.gate_proj: 13%|█▎ | 4925/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.77.up_proj: 13%|█▎ | 4926/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.77.down_proj: 13%|█▎ | 4927/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.78.gate_proj: 13%|█▎ | 4928/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.78.up_proj: 13%|█▎ | 4929/36566 [00:05<00:27, 1167.79it/s] packing model.layers.11.mlp.experts.78.up_proj: 13%|█▎ | 4930/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.78.down_proj: 13%|█▎ | 4930/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.79.gate_proj: 13%|█▎ | 4931/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.79.up_proj: 13%|█▎ | 4932/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.79.down_proj: 13%|█▎ | 4933/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.80.gate_proj: 13%|█▎ | 4934/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.80.up_proj: 13%|█▎ | 4935/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.80.down_proj: 13%|█▎ | 4936/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.81.gate_proj: 14%|█▎ | 4937/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.81.up_proj: 14%|█▎ | 4938/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.81.down_proj: 14%|█▎ | 4939/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.82.gate_proj: 14%|█▎ | 4940/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.82.up_proj: 14%|█▎ | 4941/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.82.down_proj: 14%|█▎ | 4942/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.83.gate_proj: 14%|█▎ | 4943/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.83.up_proj: 14%|█▎ | 4944/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.83.down_proj: 14%|█▎ | 4945/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.84.gate_proj: 14%|█▎ | 4946/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.84.up_proj: 14%|█▎ | 4947/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.84.down_proj: 14%|█▎ | 4948/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.85.gate_proj: 14%|█▎ | 4949/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.85.up_proj: 14%|█▎ | 4950/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.85.down_proj: 14%|█▎ | 4951/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.86.gate_proj: 14%|█▎ | 4952/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.86.up_proj: 14%|█▎ | 4953/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.86.down_proj: 14%|█▎ | 4954/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.87.gate_proj: 14%|█▎ | 4955/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.87.up_proj: 14%|█▎ | 4956/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.87.down_proj: 14%|█▎ | 4957/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.88.gate_proj: 14%|█▎ | 4958/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.88.up_proj: 14%|█▎ | 4959/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.88.down_proj: 14%|█▎ | 4960/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.89.gate_proj: 14%|█▎ | 4961/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.89.up_proj: 14%|█▎ | 4962/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.89.down_proj: 14%|█▎ | 4963/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.90.gate_proj: 14%|█▎ | 4964/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.90.up_proj: 14%|█▎ | 4965/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.90.down_proj: 14%|█▎ | 4966/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.91.gate_proj: 14%|█▎ | 4967/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.91.up_proj: 14%|█▎ | 4968/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.91.down_proj: 14%|█▎ | 4969/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.92.gate_proj: 14%|█▎ | 4970/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.92.up_proj: 14%|█▎ | 4971/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.92.down_proj: 14%|█▎ | 4972/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.93.gate_proj: 14%|█▎ | 4973/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.93.up_proj: 14%|█▎ | 4974/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.93.down_proj: 14%|█▎ | 4975/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.94.gate_proj: 14%|█▎ | 4976/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.94.up_proj: 14%|█▎ | 4977/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.94.down_proj: 14%|█▎ | 4978/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.95.gate_proj: 14%|█▎ | 4979/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.95.up_proj: 14%|█▎ | 4980/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.95.down_proj: 14%|█▎ | 4981/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.96.gate_proj: 14%|█▎ | 4982/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.96.up_proj: 14%|█▎ | 4983/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.96.down_proj: 14%|█▎ | 4984/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.97.gate_proj: 14%|█▎ | 4985/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.97.up_proj: 14%|█▎ | 4986/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.97.down_proj: 14%|█▎ | 4987/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.98.gate_proj: 14%|█▎ | 4988/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.98.up_proj: 14%|█▎ | 4989/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.98.down_proj: 14%|█▎ | 4990/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.99.gate_proj: 14%|█▎ | 4991/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.99.up_proj: 14%|█▎ | 4992/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.99.down_proj: 14%|█▎ | 4993/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.100.gate_proj: 14%|█▎ | 4994/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.100.up_proj: 14%|█▎ | 4995/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.100.down_proj: 14%|█▎ | 4996/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.101.gate_proj: 14%|█▎ | 4997/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.101.up_proj: 14%|█▎ | 4998/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.101.down_proj: 14%|█▎ | 4999/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.102.gate_proj: 14%|█▎ | 5000/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.102.up_proj: 14%|█▎ | 5001/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.102.down_proj: 14%|█▎ | 5002/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.103.gate_proj: 14%|█▎ | 5003/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.103.up_proj: 14%|█▎ | 5004/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.103.down_proj: 14%|█▎ | 5005/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.104.gate_proj: 14%|█▎ | 5006/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.104.up_proj: 14%|█▎ | 5007/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.104.down_proj: 14%|█▎ | 5008/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.105.gate_proj: 14%|█▎ | 5009/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.105.up_proj: 14%|█▎ | 5010/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.105.down_proj: 14%|█▎ | 5011/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.106.gate_proj: 14%|█▎ | 5012/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.106.up_proj: 14%|█▎ | 5013/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.106.down_proj: 14%|█▎ | 5014/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.107.gate_proj: 14%|█▎ | 5015/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.107.up_proj: 14%|█▎ | 5016/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.107.down_proj: 14%|█▎ | 5017/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.108.gate_proj: 14%|█▎ | 5018/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.108.up_proj: 14%|█▎ | 5019/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.108.down_proj: 14%|█▎ | 5020/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.109.gate_proj: 14%|█▎ | 5021/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.109.up_proj: 14%|█▎ | 5022/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.109.down_proj: 14%|█▎ | 5023/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.110.gate_proj: 14%|█▎ | 5024/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.110.up_proj: 14%|█▎ | 5025/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.110.down_proj: 14%|█▎ | 5026/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.111.gate_proj: 14%|█▎ | 5027/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.111.up_proj: 14%|█▍ | 5028/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.111.down_proj: 14%|█▍ | 5029/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.112.gate_proj: 14%|█▍ | 5030/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.112.up_proj: 14%|█▍ | 5031/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.112.down_proj: 14%|█▍ | 5032/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.113.gate_proj: 14%|█▍ | 5033/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.113.up_proj: 14%|█▍ | 5034/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.113.down_proj: 14%|█▍ | 5035/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.114.gate_proj: 14%|█▍ | 5036/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.114.up_proj: 14%|█▍ | 5037/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.114.down_proj: 14%|█▍ | 5038/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.115.gate_proj: 14%|█▍ | 5039/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.115.up_proj: 14%|█▍ | 5040/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.115.down_proj: 14%|█▍ | 5041/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.116.gate_proj: 14%|█▍ | 5042/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.116.up_proj: 14%|█▍ | 5043/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.116.down_proj: 14%|█▍ | 5044/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.117.gate_proj: 14%|█▍ | 5045/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.117.up_proj: 14%|█▍ | 5046/36566 [00:05<00:27, 1167.14it/s] packing model.layers.11.mlp.experts.117.up_proj: 14%|█▍ | 5047/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.117.down_proj: 14%|█▍ | 5047/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.118.gate_proj: 14%|█▍ | 5048/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.118.up_proj: 14%|█▍ | 5049/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.118.down_proj: 14%|█▍ | 5050/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.119.gate_proj: 14%|█▍ | 5051/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.119.up_proj: 14%|█▍ | 5052/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.119.down_proj: 14%|█▍ | 5053/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.120.gate_proj: 14%|█▍ | 5054/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.120.up_proj: 14%|█▍ | 5055/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.120.down_proj: 14%|█▍ | 5056/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.121.gate_proj: 14%|█▍ | 5057/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.121.up_proj: 14%|█▍ | 5058/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.121.down_proj: 14%|█▍ | 5059/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.122.gate_proj: 14%|█▍ | 5060/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.122.up_proj: 14%|█▍ | 5061/36566 [00:05<00:27, 1166.84it/s] packing model.layers.11.mlp.experts.122.down_proj: 14%|█▍ | 5062/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.123.gate_proj: 14%|█▍ | 5063/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.123.up_proj: 14%|█▍ | 5064/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.123.down_proj: 14%|█▍ | 5065/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.124.gate_proj: 14%|█▍ | 5066/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.124.up_proj: 14%|█▍ | 5067/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.124.down_proj: 14%|█▍ | 5068/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.125.gate_proj: 14%|█▍ | 5069/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.125.up_proj: 14%|█▍ | 5070/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.125.down_proj: 14%|█▍ | 5071/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.126.gate_proj: 14%|█▍ | 5072/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.126.up_proj: 14%|█▍ | 5073/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.126.down_proj: 14%|█▍ | 5074/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.127.gate_proj: 14%|█▍ | 5075/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.127.up_proj: 14%|█▍ | 5076/36566 [00:05<00:26, 1166.84it/s] packing model.layers.11.mlp.experts.127.down_proj: 14%|█▍ | 5077/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.0.gate_proj: 14%|█▍ | 5078/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.0.up_proj: 14%|█▍ | 5079/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.0.down_proj: 14%|█▍ | 5080/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.1.gate_proj: 14%|█▍ | 5081/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.1.up_proj: 14%|█▍ | 5082/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.1.down_proj: 14%|█▍ | 5083/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.2.gate_proj: 14%|█▍ | 5084/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.2.up_proj: 14%|█▍ | 5085/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.2.down_proj: 14%|█▍ | 5086/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.3.gate_proj: 14%|█▍ | 5087/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.3.up_proj: 14%|█▍ | 5088/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.3.down_proj: 14%|█▍ | 5089/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.4.gate_proj: 14%|█▍ | 5090/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.4.up_proj: 14%|█▍ | 5091/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.4.down_proj: 14%|█▍ | 5092/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.5.gate_proj: 14%|█▍ | 5093/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.5.up_proj: 14%|█▍ | 5094/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.5.down_proj: 14%|█▍ | 5095/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.6.gate_proj: 14%|█▍ | 5096/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.6.up_proj: 14%|█▍ | 5097/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.6.down_proj: 14%|█▍ | 5098/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.7.gate_proj: 14%|█▍ | 5099/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.7.up_proj: 14%|█▍ | 5100/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.7.down_proj: 14%|█▍ | 5101/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.8.gate_proj: 14%|█▍ | 5102/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.8.up_proj: 14%|█▍ | 5103/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.8.down_proj: 14%|█▍ | 5104/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.9.gate_proj: 14%|█▍ | 5105/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.9.up_proj: 14%|█▍ | 5106/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.9.down_proj: 14%|█▍ | 5107/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.10.gate_proj: 14%|█▍ | 5108/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.10.up_proj: 14%|█▍ | 5109/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.10.down_proj: 14%|█▍ | 5110/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.11.gate_proj: 14%|█▍ | 5111/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.11.up_proj: 14%|█▍ | 5112/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.11.down_proj: 14%|█▍ | 5113/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.12.gate_proj: 14%|█▍ | 5114/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.12.up_proj: 14%|█▍ | 5115/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.12.down_proj: 14%|█▍ | 5116/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.13.gate_proj: 14%|█▍ | 5117/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.13.up_proj: 14%|█▍ | 5118/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.13.down_proj: 14%|█▍ | 5119/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.14.gate_proj: 14%|█▍ | 5120/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.14.up_proj: 14%|█▍ | 5121/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.14.down_proj: 14%|█▍ | 5122/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.15.gate_proj: 14%|█▍ | 5123/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.15.up_proj: 14%|█▍ | 5124/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.15.down_proj: 14%|█▍ | 5125/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.16.gate_proj: 14%|█▍ | 5126/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.16.up_proj: 14%|█▍ | 5127/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.16.down_proj: 14%|█▍ | 5128/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.17.gate_proj: 14%|█▍ | 5129/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.17.up_proj: 14%|█▍ | 5130/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.17.down_proj: 14%|█▍ | 5131/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.18.gate_proj: 14%|█▍ | 5132/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.18.up_proj: 14%|█▍ | 5133/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.18.down_proj: 14%|█▍ | 5134/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.19.gate_proj: 14%|█▍ | 5135/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.19.up_proj: 14%|█▍ | 5136/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.19.down_proj: 14%|█▍ | 5137/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.20.gate_proj: 14%|█▍ | 5138/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.20.up_proj: 14%|█▍ | 5139/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.20.down_proj: 14%|█▍ | 5140/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.21.gate_proj: 14%|█▍ | 5141/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.21.up_proj: 14%|█▍ | 5142/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.21.down_proj: 14%|█▍ | 5143/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.22.gate_proj: 14%|█▍ | 5144/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.22.up_proj: 14%|█▍ | 5145/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.22.down_proj: 14%|█▍ | 5146/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.23.gate_proj: 14%|█▍ | 5147/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.23.up_proj: 14%|█▍ | 5148/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.23.down_proj: 14%|█▍ | 5149/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.24.gate_proj: 14%|█▍ | 5150/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.24.up_proj: 14%|█▍ | 5151/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.24.down_proj: 14%|█▍ | 5152/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.25.gate_proj: 14%|█▍ | 5153/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.25.up_proj: 14%|█▍ | 5154/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.25.down_proj: 14%|█▍ | 5155/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.26.gate_proj: 14%|█▍ | 5156/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.26.up_proj: 14%|█▍ | 5157/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.26.down_proj: 14%|█▍ | 5158/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.27.gate_proj: 14%|█▍ | 5159/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.27.up_proj: 14%|█▍ | 5160/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.27.down_proj: 14%|█▍ | 5161/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.28.gate_proj: 14%|█▍ | 5162/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.28.up_proj: 14%|█▍ | 5163/36566 [00:05<00:26, 1166.84it/s] packing model.layers.12.mlp.experts.28.up_proj: 14%|█▍ | 5164/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.28.down_proj: 14%|█▍ | 5164/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.29.gate_proj: 14%|█▍ | 5165/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.29.up_proj: 14%|█▍ | 5166/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.29.down_proj: 14%|█▍ | 5167/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.30.gate_proj: 14%|█▍ | 5168/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.30.up_proj: 14%|█▍ | 5169/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.30.down_proj: 14%|█▍ | 5170/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.31.gate_proj: 14%|█▍ | 5171/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.31.up_proj: 14%|█▍ | 5172/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.31.down_proj: 14%|█▍ | 5173/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.32.gate_proj: 14%|█▍ | 5174/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.32.up_proj: 14%|█▍ | 5175/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.32.down_proj: 14%|█▍ | 5176/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.33.gate_proj: 14%|█▍ | 5177/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.33.up_proj: 14%|█▍ | 5178/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.33.down_proj: 14%|█▍ | 5179/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.34.gate_proj: 14%|█▍ | 5180/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.34.up_proj: 14%|█▍ | 5181/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.34.down_proj: 14%|█▍ | 5182/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.35.gate_proj: 14%|█▍ | 5183/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.35.up_proj: 14%|█▍ | 5184/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.35.down_proj: 14%|█▍ | 5185/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.36.gate_proj: 14%|█▍ | 5186/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.36.up_proj: 14%|█▍ | 5187/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.36.down_proj: 14%|█▍ | 5188/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.37.gate_proj: 14%|█▍ | 5189/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.37.up_proj: 14%|█▍ | 5190/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.37.down_proj: 14%|█▍ | 5191/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.38.gate_proj: 14%|█▍ | 5192/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.38.up_proj: 14%|█▍ | 5193/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.38.down_proj: 14%|█▍ | 5194/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.39.gate_proj: 14%|█▍ | 5195/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.39.up_proj: 14%|█▍ | 5196/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.39.down_proj: 14%|█▍ | 5197/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.40.gate_proj: 14%|█▍ | 5198/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.40.up_proj: 14%|█▍ | 5199/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.40.down_proj: 14%|█▍ | 5200/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.41.gate_proj: 14%|█▍ | 5201/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.41.up_proj: 14%|█▍ | 5202/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.41.down_proj: 14%|█▍ | 5203/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.42.gate_proj: 14%|█▍ | 5204/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.42.up_proj: 14%|█▍ | 5205/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.42.down_proj: 14%|█▍ | 5206/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.43.gate_proj: 14%|█▍ | 5207/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.43.up_proj: 14%|█▍ | 5208/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.43.down_proj: 14%|█▍ | 5209/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.44.gate_proj: 14%|█▍ | 5210/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.44.up_proj: 14%|█▍ | 5211/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.44.down_proj: 14%|█▍ | 5212/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.45.gate_proj: 14%|█▍ | 5213/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.45.up_proj: 14%|█▍ | 5214/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.45.down_proj: 14%|█▍ | 5215/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.46.gate_proj: 14%|█▍ | 5216/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.46.up_proj: 14%|█▍ | 5217/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.46.down_proj: 14%|█▍ | 5218/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.47.gate_proj: 14%|█▍ | 5219/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.47.up_proj: 14%|█▍ | 5220/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.47.down_proj: 14%|█▍ | 5221/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.48.gate_proj: 14%|█▍ | 5222/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.48.up_proj: 14%|█▍ | 5223/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.48.down_proj: 14%|█▍ | 5224/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.49.gate_proj: 14%|█▍ | 5225/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.49.up_proj: 14%|█▍ | 5226/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.49.down_proj: 14%|█▍ | 5227/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.50.gate_proj: 14%|█▍ | 5228/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.50.up_proj: 14%|█▍ | 5229/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.50.down_proj: 14%|█▍ | 5230/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.51.gate_proj: 14%|█▍ | 5231/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.51.up_proj: 14%|█▍ | 5232/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.51.down_proj: 14%|█▍ | 5233/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.52.gate_proj: 14%|█▍ | 5234/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.52.up_proj: 14%|█▍ | 5235/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.52.down_proj: 14%|█▍ | 5236/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.53.gate_proj: 14%|█▍ | 5237/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.53.up_proj: 14%|█▍ | 5238/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.53.down_proj: 14%|█▍ | 5239/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.54.gate_proj: 14%|█▍ | 5240/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.54.up_proj: 14%|█▍ | 5241/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.54.down_proj: 14%|█▍ | 5242/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.55.gate_proj: 14%|█▍ | 5243/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.55.up_proj: 14%|█▍ | 5244/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.55.down_proj: 14%|█▍ | 5245/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.56.gate_proj: 14%|█▍ | 5246/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.56.up_proj: 14%|█▍ | 5247/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.56.down_proj: 14%|█▍ | 5248/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.57.gate_proj: 14%|█▍ | 5249/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.57.up_proj: 14%|█▍ | 5250/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.57.down_proj: 14%|█▍ | 5251/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.58.gate_proj: 14%|█▍ | 5252/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.58.up_proj: 14%|█▍ | 5253/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.58.down_proj: 14%|█▍ | 5254/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.59.gate_proj: 14%|█▍ | 5255/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.59.up_proj: 14%|█▍ | 5256/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.59.down_proj: 14%|█▍ | 5257/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.60.gate_proj: 14%|█▍ | 5258/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.60.up_proj: 14%|█▍ | 5259/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.60.down_proj: 14%|█▍ | 5260/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.61.gate_proj: 14%|█▍ | 5261/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.61.up_proj: 14%|█▍ | 5262/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.61.down_proj: 14%|█▍ | 5263/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.62.gate_proj: 14%|█▍ | 5264/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.62.up_proj: 14%|█▍ | 5265/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.62.down_proj: 14%|█▍ | 5266/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.63.gate_proj: 14%|█▍ | 5267/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.63.up_proj: 14%|█▍ | 5268/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.63.down_proj: 14%|█▍ | 5269/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.64.gate_proj: 14%|█▍ | 5270/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.64.up_proj: 14%|█▍ | 5271/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.64.down_proj: 14%|█▍ | 5272/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.65.gate_proj: 14%|█▍ | 5273/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.65.up_proj: 14%|█▍ | 5274/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.65.down_proj: 14%|█▍ | 5275/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.66.gate_proj: 14%|█▍ | 5276/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.66.up_proj: 14%|█▍ | 5277/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.66.down_proj: 14%|█▍ | 5278/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.67.gate_proj: 14%|█▍ | 5279/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.67.up_proj: 14%|█▍ | 5280/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.67.down_proj: 14%|█▍ | 5281/36566 [00:05<00:26, 1165.67it/s] packing model.layers.12.mlp.experts.67.down_proj: 14%|█▍ | 5282/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.68.gate_proj: 14%|█▍ | 5282/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.68.up_proj: 14%|█▍ | 5283/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.68.down_proj: 14%|█▍ | 5284/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.69.gate_proj: 14%|█▍ | 5285/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.69.up_proj: 14%|█▍ | 5286/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.69.down_proj: 14%|█▍ | 5287/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.70.gate_proj: 14%|█▍ | 5288/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.70.up_proj: 14%|█▍ | 5289/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.70.down_proj: 14%|█▍ | 5290/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.71.gate_proj: 14%|█▍ | 5291/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.71.up_proj: 14%|█▍ | 5292/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.71.down_proj: 14%|█▍ | 5293/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.72.gate_proj: 14%|█▍ | 5294/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.72.up_proj: 14%|█▍ | 5295/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.72.down_proj: 14%|█▍ | 5296/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.73.gate_proj: 14%|█▍ | 5297/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.73.up_proj: 14%|█▍ | 5298/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.73.down_proj: 14%|█▍ | 5299/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.74.gate_proj: 14%|█▍ | 5300/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.74.up_proj: 14%|█▍ | 5301/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.74.down_proj: 14%|█▍ | 5302/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.75.gate_proj: 15%|█▍ | 5303/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.75.up_proj: 15%|█▍ | 5304/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.75.down_proj: 15%|█▍ | 5305/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.76.gate_proj: 15%|█▍ | 5306/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.76.up_proj: 15%|█▍ | 5307/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.76.down_proj: 15%|█▍ | 5308/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.77.gate_proj: 15%|█▍ | 5309/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.77.up_proj: 15%|█▍ | 5310/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.77.down_proj: 15%|█▍ | 5311/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.78.gate_proj: 15%|█▍ | 5312/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.78.up_proj: 15%|█▍ | 5313/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.78.down_proj: 15%|█▍ | 5314/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.79.gate_proj: 15%|█▍ | 5315/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.79.up_proj: 15%|█▍ | 5316/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.79.down_proj: 15%|█▍ | 5317/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.80.gate_proj: 15%|█▍ | 5318/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.80.up_proj: 15%|█▍ | 5319/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.80.down_proj: 15%|█▍ | 5320/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.81.gate_proj: 15%|█▍ | 5321/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.81.up_proj: 15%|█▍ | 5322/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.81.down_proj: 15%|█▍ | 5323/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.82.gate_proj: 15%|█▍ | 5324/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.82.up_proj: 15%|█▍ | 5325/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.82.down_proj: 15%|█▍ | 5326/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.83.gate_proj: 15%|█▍ | 5327/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.83.up_proj: 15%|█▍ | 5328/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.83.down_proj: 15%|█▍ | 5329/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.84.gate_proj: 15%|█▍ | 5330/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.84.up_proj: 15%|█▍ | 5331/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.84.down_proj: 15%|█▍ | 5332/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.85.gate_proj: 15%|█▍ | 5333/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.85.up_proj: 15%|█▍ | 5334/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.85.down_proj: 15%|█▍ | 5335/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.86.gate_proj: 15%|█▍ | 5336/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.86.up_proj: 15%|█▍ | 5337/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.86.down_proj: 15%|█▍ | 5338/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.87.gate_proj: 15%|█▍ | 5339/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.87.up_proj: 15%|█▍ | 5340/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.87.down_proj: 15%|█▍ | 5341/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.88.gate_proj: 15%|█▍ | 5342/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.88.up_proj: 15%|█▍ | 5343/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.88.down_proj: 15%|█▍ | 5344/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.89.gate_proj: 15%|█▍ | 5345/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.89.up_proj: 15%|█▍ | 5346/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.89.down_proj: 15%|█▍ | 5347/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.90.gate_proj: 15%|█▍ | 5348/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.90.up_proj: 15%|█▍ | 5349/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.90.down_proj: 15%|█▍ | 5350/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.91.gate_proj: 15%|█▍ | 5351/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.91.up_proj: 15%|█▍ | 5352/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.91.down_proj: 15%|█▍ | 5353/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.92.gate_proj: 15%|█▍ | 5354/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.92.up_proj: 15%|█▍ | 5355/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.92.down_proj: 15%|█▍ | 5356/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.93.gate_proj: 15%|█▍ | 5357/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.93.up_proj: 15%|█▍ | 5358/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.93.down_proj: 15%|█▍ | 5359/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.94.gate_proj: 15%|█▍ | 5360/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.94.up_proj: 15%|█▍ | 5361/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.94.down_proj: 15%|█▍ | 5362/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.95.gate_proj: 15%|█▍ | 5363/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.95.up_proj: 15%|█▍ | 5364/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.95.down_proj: 15%|█▍ | 5365/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.96.gate_proj: 15%|█▍ | 5366/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.96.up_proj: 15%|█▍ | 5367/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.96.down_proj: 15%|█▍ | 5368/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.97.gate_proj: 15%|█▍ | 5369/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.97.up_proj: 15%|█▍ | 5370/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.97.down_proj: 15%|█▍ | 5371/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.98.gate_proj: 15%|█▍ | 5372/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.98.up_proj: 15%|█▍ | 5373/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.98.down_proj: 15%|█▍ | 5374/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.99.gate_proj: 15%|█▍ | 5375/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.99.up_proj: 15%|█▍ | 5376/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.99.down_proj: 15%|█▍ | 5377/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.100.gate_proj: 15%|█▍ | 5378/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.100.up_proj: 15%|█▍ | 5379/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.100.down_proj: 15%|█▍ | 5380/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.101.gate_proj: 15%|█▍ | 5381/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.101.up_proj: 15%|█▍ | 5382/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.101.down_proj: 15%|█▍ | 5383/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.102.gate_proj: 15%|█▍ | 5384/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.102.up_proj: 15%|█▍ | 5385/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.102.down_proj: 15%|█▍ | 5386/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.103.gate_proj: 15%|█▍ | 5387/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.103.up_proj: 15%|█▍ | 5388/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.103.down_proj: 15%|█▍ | 5389/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.104.gate_proj: 15%|█▍ | 5390/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.104.up_proj: 15%|█▍ | 5391/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.104.down_proj: 15%|█▍ | 5392/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.105.gate_proj: 15%|█▍ | 5393/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.105.up_proj: 15%|█▍ | 5394/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.105.down_proj: 15%|█▍ | 5395/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.106.gate_proj: 15%|█▍ | 5396/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.106.up_proj: 15%|█▍ | 5397/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.106.down_proj: 15%|█▍ | 5398/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.107.gate_proj: 15%|█▍ | 5399/36566 [00:05<00:26, 1167.18it/s] packing model.layers.12.mlp.experts.107.gate_proj: 15%|█▍ | 5400/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.107.up_proj: 15%|█▍ | 5400/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.107.down_proj: 15%|█▍ | 5401/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.108.gate_proj: 15%|█▍ | 5402/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.108.up_proj: 15%|█▍ | 5403/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.108.down_proj: 15%|█▍ | 5404/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.109.gate_proj: 15%|█▍ | 5405/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.109.up_proj: 15%|█▍ | 5406/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.109.down_proj: 15%|█▍ | 5407/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.110.gate_proj: 15%|█▍ | 5408/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.110.up_proj: 15%|█▍ | 5409/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.110.down_proj: 15%|█▍ | 5410/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.111.gate_proj: 15%|█▍ | 5411/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.111.up_proj: 15%|█▍ | 5412/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.111.down_proj: 15%|█▍ | 5413/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.112.gate_proj: 15%|█▍ | 5414/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.112.up_proj: 15%|█▍ | 5415/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.112.down_proj: 15%|█▍ | 5416/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.113.gate_proj: 15%|█▍ | 5417/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.113.up_proj: 15%|█▍ | 5418/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.113.down_proj: 15%|█▍ | 5419/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.114.gate_proj: 15%|█▍ | 5420/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.114.up_proj: 15%|█▍ | 5421/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.114.down_proj: 15%|█▍ | 5422/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.115.gate_proj: 15%|█▍ | 5423/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.115.up_proj: 15%|█▍ | 5424/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.115.down_proj: 15%|█▍ | 5425/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.116.gate_proj: 15%|█▍ | 5426/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.116.up_proj: 15%|█▍ | 5427/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.116.down_proj: 15%|█▍ | 5428/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.117.gate_proj: 15%|█▍ | 5429/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.117.up_proj: 15%|█▍ | 5430/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.117.down_proj: 15%|█▍ | 5431/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.118.gate_proj: 15%|█▍ | 5432/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.118.up_proj: 15%|█▍ | 5433/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.118.down_proj: 15%|█▍ | 5434/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.119.gate_proj: 15%|█▍ | 5435/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.119.up_proj: 15%|█▍ | 5436/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.119.down_proj: 15%|█▍ | 5437/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.120.gate_proj: 15%|█▍ | 5438/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.120.up_proj: 15%|█▍ | 5439/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.120.down_proj: 15%|█▍ | 5440/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.121.gate_proj: 15%|█▍ | 5441/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.121.up_proj: 15%|█▍ | 5442/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.121.down_proj: 15%|█▍ | 5443/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.122.gate_proj: 15%|█▍ | 5444/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.122.up_proj: 15%|█▍ | 5445/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.122.down_proj: 15%|█▍ | 5446/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.123.gate_proj: 15%|█▍ | 5447/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.123.up_proj: 15%|█▍ | 5448/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.123.down_proj: 15%|█▍ | 5449/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.124.gate_proj: 15%|█▍ | 5450/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.124.up_proj: 15%|█▍ | 5451/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.124.down_proj: 15%|█▍ | 5452/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.125.gate_proj: 15%|█▍ | 5453/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.125.up_proj: 15%|█▍ | 5454/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.125.down_proj: 15%|█▍ | 5455/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.126.gate_proj: 15%|█▍ | 5456/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.126.up_proj: 15%|█▍ | 5457/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.126.down_proj: 15%|█▍ | 5458/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.127.gate_proj: 15%|█▍ | 5459/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.127.up_proj: 15%|█▍ | 5460/36566 [00:05<00:26, 1168.46it/s] packing model.layers.12.mlp.experts.127.down_proj: 15%|█▍ | 5461/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.0.gate_proj: 15%|█▍ | 5462/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.0.up_proj: 15%|█▍ | 5463/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.0.down_proj: 15%|█▍ | 5464/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.1.gate_proj: 15%|█▍ | 5465/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.1.up_proj: 15%|█▍ | 5466/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.1.down_proj: 15%|█▍ | 5467/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.2.gate_proj: 15%|█▍ | 5468/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.2.up_proj: 15%|█▍ | 5469/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.2.down_proj: 15%|█▍ | 5470/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.3.gate_proj: 15%|█▍ | 5471/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.3.up_proj: 15%|█▍ | 5472/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.3.down_proj: 15%|█▍ | 5473/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.4.gate_proj: 15%|█▍ | 5474/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.4.up_proj: 15%|█▍ | 5475/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.4.down_proj: 15%|█▍ | 5476/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.5.gate_proj: 15%|█▍ | 5477/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.5.up_proj: 15%|█▍ | 5478/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.5.down_proj: 15%|█▍ | 5479/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.6.gate_proj: 15%|█▍ | 5480/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.6.up_proj: 15%|█▍ | 5481/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.6.down_proj: 15%|█▍ | 5482/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.7.gate_proj: 15%|█▍ | 5483/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.7.up_proj: 15%|█▍ | 5484/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.7.down_proj: 15%|█▌ | 5485/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.8.gate_proj: 15%|█▌ | 5486/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.8.up_proj: 15%|█▌ | 5487/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.8.down_proj: 15%|█▌ | 5488/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.9.gate_proj: 15%|█▌ | 5489/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.9.up_proj: 15%|█▌ | 5490/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.9.down_proj: 15%|█▌ | 5491/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.10.gate_proj: 15%|█▌ | 5492/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.10.up_proj: 15%|█▌ | 5493/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.10.down_proj: 15%|█▌ | 5494/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.11.gate_proj: 15%|█▌ | 5495/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.11.up_proj: 15%|█▌ | 5496/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.11.down_proj: 15%|█▌ | 5497/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.12.gate_proj: 15%|█▌ | 5498/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.12.up_proj: 15%|█▌ | 5499/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.12.down_proj: 15%|█▌ | 5500/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.13.gate_proj: 15%|█▌ | 5501/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.13.up_proj: 15%|█▌ | 5502/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.13.down_proj: 15%|█▌ | 5503/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.14.gate_proj: 15%|█▌ | 5504/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.14.up_proj: 15%|█▌ | 5505/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.14.down_proj: 15%|█▌ | 5506/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.15.gate_proj: 15%|█▌ | 5507/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.15.up_proj: 15%|█▌ | 5508/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.15.down_proj: 15%|█▌ | 5509/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.16.gate_proj: 15%|█▌ | 5510/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.16.up_proj: 15%|█▌ | 5511/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.16.down_proj: 15%|█▌ | 5512/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.17.gate_proj: 15%|█▌ | 5513/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.17.up_proj: 15%|█▌ | 5514/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.17.down_proj: 15%|█▌ | 5515/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.18.gate_proj: 15%|█▌ | 5516/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.18.up_proj: 15%|█▌ | 5517/36566 [00:05<00:26, 1168.46it/s] packing model.layers.13.mlp.experts.18.up_proj: 15%|█▌ | 5518/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.18.down_proj: 15%|█▌ | 5518/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.19.gate_proj: 15%|█▌ | 5519/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.19.up_proj: 15%|█▌ | 5520/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.19.down_proj: 15%|█▌ | 5521/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.20.gate_proj: 15%|█▌ | 5522/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.20.up_proj: 15%|█▌ | 5523/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.20.down_proj: 15%|█▌ | 5524/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.21.gate_proj: 15%|█▌ | 5525/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.21.up_proj: 15%|█▌ | 5526/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.21.down_proj: 15%|█▌ | 5527/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.22.gate_proj: 15%|█▌ | 5528/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.22.up_proj: 15%|█▌ | 5529/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.22.down_proj: 15%|█▌ | 5530/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.23.gate_proj: 15%|█▌ | 5531/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.23.up_proj: 15%|█▌ | 5532/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.23.down_proj: 15%|█▌ | 5533/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.24.gate_proj: 15%|█▌ | 5534/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.24.up_proj: 15%|█▌ | 5535/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.24.down_proj: 15%|█▌ | 5536/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.25.gate_proj: 15%|█▌ | 5537/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.25.up_proj: 15%|█▌ | 5538/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.25.down_proj: 15%|█▌ | 5539/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.26.gate_proj: 15%|█▌ | 5540/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.26.up_proj: 15%|█▌ | 5541/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.26.down_proj: 15%|█▌ | 5542/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.27.gate_proj: 15%|█▌ | 5543/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.27.up_proj: 15%|█▌ | 5544/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.27.down_proj: 15%|█▌ | 5545/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.28.gate_proj: 15%|█▌ | 5546/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.28.up_proj: 15%|█▌ | 5547/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.28.down_proj: 15%|█▌ | 5548/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.29.gate_proj: 15%|█▌ | 5549/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.29.up_proj: 15%|█▌ | 5550/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.29.down_proj: 15%|█▌ | 5551/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.30.gate_proj: 15%|█▌ | 5552/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.30.up_proj: 15%|█▌ | 5553/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.30.down_proj: 15%|█▌ | 5554/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.31.gate_proj: 15%|█▌ | 5555/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.31.up_proj: 15%|█▌ | 5556/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.31.down_proj: 15%|█▌ | 5557/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.32.gate_proj: 15%|█▌ | 5558/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.32.up_proj: 15%|█▌ | 5559/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.32.down_proj: 15%|█▌ | 5560/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.33.gate_proj: 15%|█▌ | 5561/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.33.up_proj: 15%|█▌ | 5562/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.33.down_proj: 15%|█▌ | 5563/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.34.gate_proj: 15%|█▌ | 5564/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.34.up_proj: 15%|█▌ | 5565/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.34.down_proj: 15%|█▌ | 5566/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.35.gate_proj: 15%|█▌ | 5567/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.35.up_proj: 15%|█▌ | 5568/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.35.down_proj: 15%|█▌ | 5569/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.36.gate_proj: 15%|█▌ | 5570/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.36.up_proj: 15%|█▌ | 5571/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.36.down_proj: 15%|█▌ | 5572/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.37.gate_proj: 15%|█▌ | 5573/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.37.up_proj: 15%|█▌ | 5574/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.37.down_proj: 15%|█▌ | 5575/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.38.gate_proj: 15%|█▌ | 5576/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.38.up_proj: 15%|█▌ | 5577/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.38.down_proj: 15%|█▌ | 5578/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.39.gate_proj: 15%|█▌ | 5579/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.39.up_proj: 15%|█▌ | 5580/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.39.down_proj: 15%|█▌ | 5581/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.40.gate_proj: 15%|█▌ | 5582/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.40.up_proj: 15%|█▌ | 5583/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.40.down_proj: 15%|█▌ | 5584/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.41.gate_proj: 15%|█▌ | 5585/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.41.up_proj: 15%|█▌ | 5586/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.41.down_proj: 15%|█▌ | 5587/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.42.gate_proj: 15%|█▌ | 5588/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.42.up_proj: 15%|█▌ | 5589/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.42.down_proj: 15%|█▌ | 5590/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.43.gate_proj: 15%|█▌ | 5591/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.43.up_proj: 15%|█▌ | 5592/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.43.down_proj: 15%|█▌ | 5593/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.44.gate_proj: 15%|█▌ | 5594/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.44.up_proj: 15%|█▌ | 5595/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.44.down_proj: 15%|█▌ | 5596/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.45.gate_proj: 15%|█▌ | 5597/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.45.up_proj: 15%|█▌ | 5598/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.45.down_proj: 15%|█▌ | 5599/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.46.gate_proj: 15%|█▌ | 5600/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.46.up_proj: 15%|█▌ | 5601/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.46.down_proj: 15%|█▌ | 5602/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.47.gate_proj: 15%|█▌ | 5603/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.47.up_proj: 15%|█▌ | 5604/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.47.down_proj: 15%|█▌ | 5605/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.48.gate_proj: 15%|█▌ | 5606/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.48.up_proj: 15%|█▌ | 5607/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.48.down_proj: 15%|█▌ | 5608/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.49.gate_proj: 15%|█▌ | 5609/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.49.up_proj: 15%|█▌ | 5610/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.49.down_proj: 15%|█▌ | 5611/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.50.gate_proj: 15%|█▌ | 5612/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.50.up_proj: 15%|█▌ | 5613/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.50.down_proj: 15%|█▌ | 5614/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.51.gate_proj: 15%|█▌ | 5615/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.51.up_proj: 15%|█▌ | 5616/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.51.down_proj: 15%|█▌ | 5617/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.52.gate_proj: 15%|█▌ | 5618/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.52.up_proj: 15%|█▌ | 5619/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.52.down_proj: 15%|█▌ | 5620/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.53.gate_proj: 15%|█▌ | 5621/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.53.up_proj: 15%|█▌ | 5622/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.53.down_proj: 15%|█▌ | 5623/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.54.gate_proj: 15%|█▌ | 5624/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.54.up_proj: 15%|█▌ | 5625/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.54.down_proj: 15%|█▌ | 5626/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.55.gate_proj: 15%|█▌ | 5627/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.55.up_proj: 15%|█▌ | 5628/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.55.down_proj: 15%|█▌ | 5629/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.56.gate_proj: 15%|█▌ | 5630/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.56.up_proj: 15%|█▌ | 5631/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.56.down_proj: 15%|█▌ | 5632/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.57.gate_proj: 15%|█▌ | 5633/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.57.up_proj: 15%|█▌ | 5634/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.57.down_proj: 15%|█▌ | 5635/36566 [00:05<00:26, 1169.30it/s] packing model.layers.13.mlp.experts.57.down_proj: 15%|█▌ | 5636/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.58.gate_proj: 15%|█▌ | 5636/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.58.up_proj: 15%|█▌ | 5637/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.58.down_proj: 15%|█▌ | 5638/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.59.gate_proj: 15%|█▌ | 5639/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.59.up_proj: 15%|█▌ | 5640/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.59.down_proj: 15%|█▌ | 5641/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.60.gate_proj: 15%|█▌ | 5642/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.60.up_proj: 15%|█▌ | 5643/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.60.down_proj: 15%|█▌ | 5644/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.61.gate_proj: 15%|█▌ | 5645/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.61.up_proj: 15%|█▌ | 5646/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.61.down_proj: 15%|█▌ | 5647/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.62.gate_proj: 15%|█▌ | 5648/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.62.up_proj: 15%|█▌ | 5649/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.62.down_proj: 15%|█▌ | 5650/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.63.gate_proj: 15%|█▌ | 5651/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.63.up_proj: 15%|█▌ | 5652/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.63.down_proj: 15%|█▌ | 5653/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.64.gate_proj: 15%|█▌ | 5654/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.64.up_proj: 15%|█▌ | 5655/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.64.down_proj: 15%|█▌ | 5656/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.65.gate_proj: 15%|█▌ | 5657/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.65.up_proj: 15%|█▌ | 5658/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.65.down_proj: 15%|█▌ | 5659/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.66.gate_proj: 15%|█▌ | 5660/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.66.up_proj: 15%|█▌ | 5661/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.66.down_proj: 15%|█▌ | 5662/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.67.gate_proj: 15%|█▌ | 5663/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.67.up_proj: 15%|█▌ | 5664/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.67.down_proj: 15%|█▌ | 5665/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.68.gate_proj: 15%|█▌ | 5666/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.68.up_proj: 15%|█▌ | 5667/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.68.down_proj: 16%|█▌ | 5668/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.69.gate_proj: 16%|█▌ | 5669/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.69.up_proj: 16%|█▌ | 5670/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.69.down_proj: 16%|█▌ | 5671/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.70.gate_proj: 16%|█▌ | 5672/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.70.up_proj: 16%|█▌ | 5673/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.70.down_proj: 16%|█▌ | 5674/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.71.gate_proj: 16%|█▌ | 5675/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.71.up_proj: 16%|█▌ | 5676/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.71.down_proj: 16%|█▌ | 5677/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.72.gate_proj: 16%|█▌ | 5678/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.72.up_proj: 16%|█▌ | 5679/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.72.down_proj: 16%|█▌ | 5680/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.73.gate_proj: 16%|█▌ | 5681/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.73.up_proj: 16%|█▌ | 5682/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.73.down_proj: 16%|█▌ | 5683/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.74.gate_proj: 16%|█▌ | 5684/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.74.up_proj: 16%|█▌ | 5685/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.74.down_proj: 16%|█▌ | 5686/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.75.gate_proj: 16%|█▌ | 5687/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.75.up_proj: 16%|█▌ | 5688/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.75.down_proj: 16%|█▌ | 5689/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.76.gate_proj: 16%|█▌ | 5690/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.76.up_proj: 16%|█▌ | 5691/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.76.down_proj: 16%|█▌ | 5692/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.77.gate_proj: 16%|█▌ | 5693/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.77.up_proj: 16%|█▌ | 5694/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.77.down_proj: 16%|█▌ | 5695/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.78.gate_proj: 16%|█▌ | 5696/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.78.up_proj: 16%|█▌ | 5697/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.78.down_proj: 16%|█▌ | 5698/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.79.gate_proj: 16%|█▌ | 5699/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.79.up_proj: 16%|█▌ | 5700/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.79.down_proj: 16%|█▌ | 5701/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.80.gate_proj: 16%|█▌ | 5702/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.80.up_proj: 16%|█▌ | 5703/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.80.down_proj: 16%|█▌ | 5704/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.81.gate_proj: 16%|█▌ | 5705/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.81.up_proj: 16%|█▌ | 5706/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.81.down_proj: 16%|█▌ | 5707/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.82.gate_proj: 16%|█▌ | 5708/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.82.up_proj: 16%|█▌ | 5709/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.82.down_proj: 16%|█▌ | 5710/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.83.gate_proj: 16%|█▌ | 5711/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.83.up_proj: 16%|█▌ | 5712/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.83.down_proj: 16%|█▌ | 5713/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.84.gate_proj: 16%|█▌ | 5714/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.84.up_proj: 16%|█▌ | 5715/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.84.down_proj: 16%|█▌ | 5716/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.85.gate_proj: 16%|█▌ | 5717/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.85.up_proj: 16%|█▌ | 5718/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.85.down_proj: 16%|█▌ | 5719/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.86.gate_proj: 16%|█▌ | 5720/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.86.up_proj: 16%|█▌ | 5721/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.86.down_proj: 16%|█▌ | 5722/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.87.gate_proj: 16%|█▌ | 5723/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.87.up_proj: 16%|█▌ | 5724/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.87.down_proj: 16%|█▌ | 5725/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.88.gate_proj: 16%|█▌ | 5726/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.88.up_proj: 16%|█▌ | 5727/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.88.down_proj: 16%|█▌ | 5728/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.89.gate_proj: 16%|█▌ | 5729/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.89.up_proj: 16%|█▌ | 5730/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.89.down_proj: 16%|█▌ | 5731/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.90.gate_proj: 16%|█▌ | 5732/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.90.up_proj: 16%|█▌ | 5733/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.90.down_proj: 16%|█▌ | 5734/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.91.gate_proj: 16%|█▌ | 5735/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.91.up_proj: 16%|█▌ | 5736/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.91.down_proj: 16%|█▌ | 5737/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.92.gate_proj: 16%|█▌ | 5738/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.92.up_proj: 16%|█▌ | 5739/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.92.down_proj: 16%|█▌ | 5740/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.93.gate_proj: 16%|█▌ | 5741/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.93.up_proj: 16%|█▌ | 5742/36566 [00:05<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.93.down_proj: 16%|█▌ | 5743/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.94.gate_proj: 16%|█▌ | 5744/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.94.up_proj: 16%|█▌ | 5745/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.94.down_proj: 16%|█▌ | 5746/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.95.gate_proj: 16%|█▌ | 5747/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.95.up_proj: 16%|█▌ | 5748/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.95.down_proj: 16%|█▌ | 5749/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.96.gate_proj: 16%|█▌ | 5750/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.96.up_proj: 16%|█▌ | 5751/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.96.down_proj: 16%|█▌ | 5752/36566 [00:06<00:26, 1169.62it/s] packing model.layers.13.mlp.experts.96.down_proj: 16%|█▌ | 5753/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.97.gate_proj: 16%|█▌ | 5753/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.97.up_proj: 16%|█▌ | 5754/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.97.down_proj: 16%|█▌ | 5755/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.98.gate_proj: 16%|█▌ | 5756/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.98.up_proj: 16%|█▌ | 5757/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.98.down_proj: 16%|█▌ | 5758/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.99.gate_proj: 16%|█▌ | 5759/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.99.up_proj: 16%|█▌ | 5760/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.99.down_proj: 16%|█▌ | 5761/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.100.gate_proj: 16%|█▌ | 5762/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.100.up_proj: 16%|█▌ | 5763/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.100.down_proj: 16%|█▌ | 5764/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.101.gate_proj: 16%|█▌ | 5765/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.101.up_proj: 16%|█▌ | 5766/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.101.down_proj: 16%|█▌ | 5767/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.102.gate_proj: 16%|█▌ | 5768/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.102.up_proj: 16%|█▌ | 5769/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.102.down_proj: 16%|█▌ | 5770/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.103.gate_proj: 16%|█▌ | 5771/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.103.up_proj: 16%|█▌ | 5772/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.103.down_proj: 16%|█▌ | 5773/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.104.gate_proj: 16%|█▌ | 5774/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.104.up_proj: 16%|█▌ | 5775/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.104.down_proj: 16%|█▌ | 5776/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.105.gate_proj: 16%|█▌ | 5777/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.105.up_proj: 16%|█▌ | 5778/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.105.down_proj: 16%|█▌ | 5779/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.106.gate_proj: 16%|█▌ | 5780/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.106.up_proj: 16%|█▌ | 5781/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.106.down_proj: 16%|█▌ | 5782/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.107.gate_proj: 16%|█▌ | 5783/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.107.up_proj: 16%|█▌ | 5784/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.107.down_proj: 16%|█▌ | 5785/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.108.gate_proj: 16%|█▌ | 5786/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.108.up_proj: 16%|█▌ | 5787/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.108.down_proj: 16%|█▌ | 5788/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.109.gate_proj: 16%|█▌ | 5789/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.109.up_proj: 16%|█▌ | 5790/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.109.down_proj: 16%|█▌ | 5791/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.110.gate_proj: 16%|█▌ | 5792/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.110.up_proj: 16%|█▌ | 5793/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.110.down_proj: 16%|█▌ | 5794/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.111.gate_proj: 16%|█▌ | 5795/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.111.up_proj: 16%|█▌ | 5796/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.111.down_proj: 16%|█▌ | 5797/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.112.gate_proj: 16%|█▌ | 5798/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.112.up_proj: 16%|█▌ | 5799/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.112.down_proj: 16%|█▌ | 5800/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.113.gate_proj: 16%|█▌ | 5801/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.113.up_proj: 16%|█▌ | 5802/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.113.down_proj: 16%|█▌ | 5803/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.114.gate_proj: 16%|█▌ | 5804/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.114.up_proj: 16%|█▌ | 5805/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.114.down_proj: 16%|█▌ | 5806/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.115.gate_proj: 16%|█▌ | 5807/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.115.up_proj: 16%|█▌ | 5808/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.115.down_proj: 16%|█▌ | 5809/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.116.gate_proj: 16%|█▌ | 5810/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.116.up_proj: 16%|█▌ | 5811/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.116.down_proj: 16%|█▌ | 5812/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.117.gate_proj: 16%|█▌ | 5813/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.117.up_proj: 16%|█▌ | 5814/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.117.down_proj: 16%|█▌ | 5815/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.118.gate_proj: 16%|█▌ | 5816/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.118.up_proj: 16%|█▌ | 5817/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.118.down_proj: 16%|█▌ | 5818/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.119.gate_proj: 16%|█▌ | 5819/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.119.up_proj: 16%|█▌ | 5820/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.119.down_proj: 16%|█▌ | 5821/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.120.gate_proj: 16%|█▌ | 5822/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.120.up_proj: 16%|█▌ | 5823/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.120.down_proj: 16%|█▌ | 5824/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.121.gate_proj: 16%|█▌ | 5825/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.121.up_proj: 16%|█▌ | 5826/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.121.down_proj: 16%|█▌ | 5827/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.122.gate_proj: 16%|█▌ | 5828/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.122.up_proj: 16%|█▌ | 5829/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.122.down_proj: 16%|█▌ | 5830/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.123.gate_proj: 16%|█▌ | 5831/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.123.up_proj: 16%|█▌ | 5832/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.123.down_proj: 16%|█▌ | 5833/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.124.gate_proj: 16%|█▌ | 5834/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.124.up_proj: 16%|█▌ | 5835/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.124.down_proj: 16%|█▌ | 5836/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.125.gate_proj: 16%|█▌ | 5837/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.125.up_proj: 16%|█▌ | 5838/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.125.down_proj: 16%|█▌ | 5839/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.126.gate_proj: 16%|█▌ | 5840/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.126.up_proj: 16%|█▌ | 5841/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.126.down_proj: 16%|█▌ | 5842/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.127.gate_proj: 16%|█▌ | 5843/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.127.up_proj: 16%|█▌ | 5844/36566 [00:06<00:26, 1169.34it/s] packing model.layers.13.mlp.experts.127.down_proj: 16%|█▌ | 5845/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.0.gate_proj: 16%|█▌ | 5846/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.0.up_proj: 16%|█▌ | 5847/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.0.down_proj: 16%|█▌ | 5848/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.1.gate_proj: 16%|█▌ | 5849/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.1.up_proj: 16%|█▌ | 5850/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.1.down_proj: 16%|█▌ | 5851/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.2.gate_proj: 16%|█▌ | 5852/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.2.up_proj: 16%|█▌ | 5853/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.2.down_proj: 16%|█▌ | 5854/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.3.gate_proj: 16%|█▌ | 5855/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.3.up_proj: 16%|█▌ | 5856/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.3.down_proj: 16%|█▌ | 5857/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.4.gate_proj: 16%|█▌ | 5858/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.4.up_proj: 16%|█▌ | 5859/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.4.down_proj: 16%|█▌ | 5860/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.5.gate_proj: 16%|█▌ | 5861/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.5.up_proj: 16%|█▌ | 5862/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.5.down_proj: 16%|█▌ | 5863/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.6.gate_proj: 16%|█▌ | 5864/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.6.up_proj: 16%|█▌ | 5865/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.6.down_proj: 16%|█▌ | 5866/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.7.gate_proj: 16%|█▌ | 5867/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.7.up_proj: 16%|█▌ | 5868/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.7.down_proj: 16%|█▌ | 5869/36566 [00:06<00:26, 1169.34it/s] packing model.layers.14.mlp.experts.7.down_proj: 16%|█▌ | 5870/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.8.gate_proj: 16%|█▌ | 5870/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.8.up_proj: 16%|█▌ | 5871/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.8.down_proj: 16%|█▌ | 5872/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.9.gate_proj: 16%|█▌ | 5873/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.9.up_proj: 16%|█▌ | 5874/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.9.down_proj: 16%|█▌ | 5875/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.10.gate_proj: 16%|█▌ | 5876/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.10.up_proj: 16%|█▌ | 5877/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.10.down_proj: 16%|█▌ | 5878/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.11.gate_proj: 16%|█▌ | 5879/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.11.up_proj: 16%|█▌ | 5880/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.11.down_proj: 16%|█▌ | 5881/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.12.gate_proj: 16%|█▌ | 5882/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.12.up_proj: 16%|█▌ | 5883/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.12.down_proj: 16%|█▌ | 5884/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.13.gate_proj: 16%|█▌ | 5885/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.13.up_proj: 16%|█▌ | 5886/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.13.down_proj: 16%|█▌ | 5887/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.14.gate_proj: 16%|█▌ | 5888/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.14.up_proj: 16%|█▌ | 5889/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.14.down_proj: 16%|█▌ | 5890/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.15.gate_proj: 16%|█▌ | 5891/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.15.up_proj: 16%|█▌ | 5892/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.15.down_proj: 16%|█▌ | 5893/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.16.gate_proj: 16%|█▌ | 5894/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.16.up_proj: 16%|█▌ | 5895/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.16.down_proj: 16%|█▌ | 5896/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.17.gate_proj: 16%|█▌ | 5897/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.17.up_proj: 16%|█▌ | 5898/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.17.down_proj: 16%|█▌ | 5899/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.18.gate_proj: 16%|█▌ | 5900/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.18.up_proj: 16%|█▌ | 5901/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.18.down_proj: 16%|█▌ | 5902/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.19.gate_proj: 16%|█▌ | 5903/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.19.up_proj: 16%|█▌ | 5904/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.19.down_proj: 16%|█▌ | 5905/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.20.gate_proj: 16%|█▌ | 5906/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.20.up_proj: 16%|█▌ | 5907/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.20.down_proj: 16%|█▌ | 5908/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.21.gate_proj: 16%|█▌ | 5909/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.21.up_proj: 16%|█▌ | 5910/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.21.down_proj: 16%|█▌ | 5911/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.22.gate_proj: 16%|█▌ | 5912/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.22.up_proj: 16%|█▌ | 5913/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.22.down_proj: 16%|█▌ | 5914/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.23.gate_proj: 16%|█▌ | 5915/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.23.up_proj: 16%|█▌ | 5916/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.23.down_proj: 16%|█▌ | 5917/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.24.gate_proj: 16%|█▌ | 5918/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.24.up_proj: 16%|█▌ | 5919/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.24.down_proj: 16%|█▌ | 5920/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.25.gate_proj: 16%|█▌ | 5921/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.25.up_proj: 16%|█▌ | 5922/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.25.down_proj: 16%|█▌ | 5923/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.26.gate_proj: 16%|█▌ | 5924/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.26.up_proj: 16%|█▌ | 5925/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.26.down_proj: 16%|█▌ | 5926/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.27.gate_proj: 16%|█▌ | 5927/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.27.up_proj: 16%|█▌ | 5928/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.27.down_proj: 16%|█▌ | 5929/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.28.gate_proj: 16%|█▌ | 5930/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.28.up_proj: 16%|█▌ | 5931/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.28.down_proj: 16%|█▌ | 5932/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.29.gate_proj: 16%|█▌ | 5933/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.29.up_proj: 16%|█▌ | 5934/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.29.down_proj: 16%|█▌ | 5935/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.30.gate_proj: 16%|█▌ | 5936/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.30.up_proj: 16%|█▌ | 5937/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.30.down_proj: 16%|█▌ | 5938/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.31.gate_proj: 16%|█▌ | 5939/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.31.up_proj: 16%|█▌ | 5940/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.31.down_proj: 16%|█▌ | 5941/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.32.gate_proj: 16%|█▋ | 5942/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.32.up_proj: 16%|█▋ | 5943/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.32.down_proj: 16%|█▋ | 5944/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.33.gate_proj: 16%|█▋ | 5945/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.33.up_proj: 16%|█▋ | 5946/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.33.down_proj: 16%|█▋ | 5947/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.34.gate_proj: 16%|█▋ | 5948/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.34.up_proj: 16%|█▋ | 5949/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.34.down_proj: 16%|█▋ | 5950/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.35.gate_proj: 16%|█▋ | 5951/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.35.up_proj: 16%|█▋ | 5952/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.35.down_proj: 16%|█▋ | 5953/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.36.gate_proj: 16%|█▋ | 5954/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.36.up_proj: 16%|█▋ | 5955/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.36.down_proj: 16%|█▋ | 5956/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.37.gate_proj: 16%|█▋ | 5957/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.37.up_proj: 16%|█▋ | 5958/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.37.down_proj: 16%|█▋ | 5959/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.38.gate_proj: 16%|█▋ | 5960/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.38.up_proj: 16%|█▋ | 5961/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.38.down_proj: 16%|█▋ | 5962/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.39.gate_proj: 16%|█▋ | 5963/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.39.up_proj: 16%|█▋ | 5964/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.39.down_proj: 16%|█▋ | 5965/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.40.gate_proj: 16%|█▋ | 5966/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.40.up_proj: 16%|█▋ | 5967/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.40.down_proj: 16%|█▋ | 5968/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.41.gate_proj: 16%|█▋ | 5969/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.41.up_proj: 16%|█▋ | 5970/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.41.down_proj: 16%|█▋ | 5971/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.42.gate_proj: 16%|█▋ | 5972/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.42.up_proj: 16%|█▋ | 5973/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.42.down_proj: 16%|█▋ | 5974/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.43.gate_proj: 16%|█▋ | 5975/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.43.up_proj: 16%|█▋ | 5976/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.43.down_proj: 16%|█▋ | 5977/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.44.gate_proj: 16%|█▋ | 5978/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.44.up_proj: 16%|█▋ | 5979/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.44.down_proj: 16%|█▋ | 5980/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.45.gate_proj: 16%|█▋ | 5981/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.45.up_proj: 16%|█▋ | 5982/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.45.down_proj: 16%|█▋ | 5983/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.46.gate_proj: 16%|█▋ | 5984/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.46.up_proj: 16%|█▋ | 5985/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.46.down_proj: 16%|█▋ | 5986/36566 [00:06<00:26, 1168.02it/s] packing model.layers.14.mlp.experts.46.down_proj: 16%|█▋ | 5987/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.47.gate_proj: 16%|█▋ | 5987/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.47.up_proj: 16%|█▋ | 5988/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.47.down_proj: 16%|█▋ | 5989/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.48.gate_proj: 16%|█▋ | 5990/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.48.up_proj: 16%|█▋ | 5991/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.48.down_proj: 16%|█▋ | 5992/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.49.gate_proj: 16%|█▋ | 5993/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.49.up_proj: 16%|█▋ | 5994/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.49.down_proj: 16%|█▋ | 5995/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.50.gate_proj: 16%|█▋ | 5996/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.50.up_proj: 16%|█▋ | 5997/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.50.down_proj: 16%|█▋ | 5998/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.51.gate_proj: 16%|█▋ | 5999/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.51.up_proj: 16%|█▋ | 6000/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.51.down_proj: 16%|█▋ | 6001/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.52.gate_proj: 16%|█▋ | 6002/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.52.up_proj: 16%|█▋ | 6003/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.52.down_proj: 16%|█▋ | 6004/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.53.gate_proj: 16%|█▋ | 6005/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.53.up_proj: 16%|█▋ | 6006/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.53.down_proj: 16%|█▋ | 6007/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.54.gate_proj: 16%|█▋ | 6008/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.54.up_proj: 16%|█▋ | 6009/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.54.down_proj: 16%|█▋ | 6010/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.55.gate_proj: 16%|█▋ | 6011/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.55.up_proj: 16%|█▋ | 6012/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.55.down_proj: 16%|█▋ | 6013/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.56.gate_proj: 16%|█▋ | 6014/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.56.up_proj: 16%|█▋ | 6015/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.56.down_proj: 16%|█▋ | 6016/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.57.gate_proj: 16%|█▋ | 6017/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.57.up_proj: 16%|█▋ | 6018/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.57.down_proj: 16%|█▋ | 6019/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.58.gate_proj: 16%|█▋ | 6020/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.58.up_proj: 16%|█▋ | 6021/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.58.down_proj: 16%|█▋ | 6022/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.59.gate_proj: 16%|█▋ | 6023/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.59.up_proj: 16%|█▋ | 6024/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.59.down_proj: 16%|█▋ | 6025/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.60.gate_proj: 16%|█▋ | 6026/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.60.up_proj: 16%|█▋ | 6027/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.60.down_proj: 16%|█▋ | 6028/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.61.gate_proj: 16%|█▋ | 6029/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.61.up_proj: 16%|█▋ | 6030/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.61.down_proj: 16%|█▋ | 6031/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.62.gate_proj: 16%|█▋ | 6032/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.62.up_proj: 16%|█▋ | 6033/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.62.down_proj: 17%|█▋ | 6034/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.63.gate_proj: 17%|█▋ | 6035/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.63.up_proj: 17%|█▋ | 6036/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.63.down_proj: 17%|█▋ | 6037/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.64.gate_proj: 17%|█▋ | 6038/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.64.up_proj: 17%|█▋ | 6039/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.64.down_proj: 17%|█▋ | 6040/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.65.gate_proj: 17%|█▋ | 6041/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.65.up_proj: 17%|█▋ | 6042/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.65.down_proj: 17%|█▋ | 6043/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.66.gate_proj: 17%|█▋ | 6044/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.66.up_proj: 17%|█▋ | 6045/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.66.down_proj: 17%|█▋ | 6046/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.67.gate_proj: 17%|█▋ | 6047/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.67.up_proj: 17%|█▋ | 6048/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.67.down_proj: 17%|█▋ | 6049/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.68.gate_proj: 17%|█▋ | 6050/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.68.up_proj: 17%|█▋ | 6051/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.68.down_proj: 17%|█▋ | 6052/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.69.gate_proj: 17%|█▋ | 6053/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.69.up_proj: 17%|█▋ | 6054/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.69.down_proj: 17%|█▋ | 6055/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.70.gate_proj: 17%|█▋ | 6056/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.70.up_proj: 17%|█▋ | 6057/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.70.down_proj: 17%|█▋ | 6058/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.71.gate_proj: 17%|█▋ | 6059/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.71.up_proj: 17%|█▋ | 6060/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.71.down_proj: 17%|█▋ | 6061/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.72.gate_proj: 17%|█▋ | 6062/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.72.up_proj: 17%|█▋ | 6063/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.72.down_proj: 17%|█▋ | 6064/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.73.gate_proj: 17%|█▋ | 6065/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.73.up_proj: 17%|█▋ | 6066/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.73.down_proj: 17%|█▋ | 6067/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.74.gate_proj: 17%|█▋ | 6068/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.74.up_proj: 17%|█▋ | 6069/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.74.down_proj: 17%|█▋ | 6070/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.75.gate_proj: 17%|█▋ | 6071/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.75.up_proj: 17%|█▋ | 6072/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.75.down_proj: 17%|█▋ | 6073/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.76.gate_proj: 17%|█▋ | 6074/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.76.up_proj: 17%|█▋ | 6075/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.76.down_proj: 17%|█▋ | 6076/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.77.gate_proj: 17%|█▋ | 6077/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.77.up_proj: 17%|█▋ | 6078/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.77.down_proj: 17%|█▋ | 6079/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.78.gate_proj: 17%|█▋ | 6080/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.78.up_proj: 17%|█▋ | 6081/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.78.down_proj: 17%|█▋ | 6082/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.79.gate_proj: 17%|█▋ | 6083/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.79.up_proj: 17%|█▋ | 6084/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.79.down_proj: 17%|█▋ | 6085/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.80.gate_proj: 17%|█▋ | 6086/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.80.up_proj: 17%|█▋ | 6087/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.80.down_proj: 17%|█▋ | 6088/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.81.gate_proj: 17%|█▋ | 6089/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.81.up_proj: 17%|█▋ | 6090/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.81.down_proj: 17%|█▋ | 6091/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.82.gate_proj: 17%|█▋ | 6092/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.82.up_proj: 17%|█▋ | 6093/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.82.down_proj: 17%|█▋ | 6094/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.83.gate_proj: 17%|█▋ | 6095/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.83.up_proj: 17%|█▋ | 6096/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.83.down_proj: 17%|█▋ | 6097/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.84.gate_proj: 17%|█▋ | 6098/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.84.up_proj: 17%|█▋ | 6099/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.84.down_proj: 17%|█▋ | 6100/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.85.gate_proj: 17%|█▋ | 6101/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.85.up_proj: 17%|█▋ | 6102/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.85.down_proj: 17%|█▋ | 6103/36566 [00:06<00:26, 1167.65it/s] packing model.layers.14.mlp.experts.85.down_proj: 17%|█▋ | 6104/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.86.gate_proj: 17%|█▋ | 6104/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.86.up_proj: 17%|█▋ | 6105/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.86.down_proj: 17%|█▋ | 6106/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.87.gate_proj: 17%|█▋ | 6107/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.87.up_proj: 17%|█▋ | 6108/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.87.down_proj: 17%|█▋ | 6109/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.88.gate_proj: 17%|█▋ | 6110/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.88.up_proj: 17%|█▋ | 6111/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.88.down_proj: 17%|█▋ | 6112/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.89.gate_proj: 17%|█▋ | 6113/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.89.up_proj: 17%|█▋ | 6114/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.89.down_proj: 17%|█▋ | 6115/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.90.gate_proj: 17%|█▋ | 6116/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.90.up_proj: 17%|█▋ | 6117/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.90.down_proj: 17%|█▋ | 6118/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.91.gate_proj: 17%|█▋ | 6119/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.91.up_proj: 17%|█▋ | 6120/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.91.down_proj: 17%|█▋ | 6121/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.92.gate_proj: 17%|█▋ | 6122/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.92.up_proj: 17%|█▋ | 6123/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.92.down_proj: 17%|█▋ | 6124/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.93.gate_proj: 17%|█▋ | 6125/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.93.up_proj: 17%|█▋ | 6126/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.93.down_proj: 17%|█▋ | 6127/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.94.gate_proj: 17%|█▋ | 6128/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.94.up_proj: 17%|█▋ | 6129/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.94.down_proj: 17%|█▋ | 6130/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.95.gate_proj: 17%|█▋ | 6131/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.95.up_proj: 17%|█▋ | 6132/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.95.down_proj: 17%|█▋ | 6133/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.96.gate_proj: 17%|█▋ | 6134/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.96.up_proj: 17%|█▋ | 6135/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.96.down_proj: 17%|█▋ | 6136/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.97.gate_proj: 17%|█▋ | 6137/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.97.up_proj: 17%|█▋ | 6138/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.97.down_proj: 17%|█▋ | 6139/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.98.gate_proj: 17%|█▋ | 6140/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.98.up_proj: 17%|█▋ | 6141/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.98.down_proj: 17%|█▋ | 6142/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.99.gate_proj: 17%|█▋ | 6143/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.99.up_proj: 17%|█▋ | 6144/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.99.down_proj: 17%|█▋ | 6145/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.100.gate_proj: 17%|█▋ | 6146/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.100.up_proj: 17%|█▋ | 6147/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.100.down_proj: 17%|█▋ | 6148/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.101.gate_proj: 17%|█▋ | 6149/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.101.up_proj: 17%|█▋ | 6150/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.101.down_proj: 17%|█▋ | 6151/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.102.gate_proj: 17%|█▋ | 6152/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.102.up_proj: 17%|█▋ | 6153/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.102.down_proj: 17%|█▋ | 6154/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.103.gate_proj: 17%|█▋ | 6155/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.103.up_proj: 17%|█▋ | 6156/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.103.down_proj: 17%|█▋ | 6157/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.104.gate_proj: 17%|█▋ | 6158/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.104.up_proj: 17%|█▋ | 6159/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.104.down_proj: 17%|█▋ | 6160/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.105.gate_proj: 17%|█▋ | 6161/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.105.up_proj: 17%|█▋ | 6162/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.105.down_proj: 17%|█▋ | 6163/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.106.gate_proj: 17%|█▋ | 6164/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.106.up_proj: 17%|█▋ | 6165/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.106.down_proj: 17%|█▋ | 6166/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.107.gate_proj: 17%|█▋ | 6167/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.107.up_proj: 17%|█▋ | 6168/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.107.down_proj: 17%|█▋ | 6169/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.108.gate_proj: 17%|█▋ | 6170/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.108.up_proj: 17%|█▋ | 6171/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.108.down_proj: 17%|█▋ | 6172/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.109.gate_proj: 17%|█▋ | 6173/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.109.up_proj: 17%|█▋ | 6174/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.109.down_proj: 17%|█▋ | 6175/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.110.gate_proj: 17%|█▋ | 6176/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.110.up_proj: 17%|█▋ | 6177/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.110.down_proj: 17%|█▋ | 6178/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.111.gate_proj: 17%|█▋ | 6179/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.111.up_proj: 17%|█▋ | 6180/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.111.down_proj: 17%|█▋ | 6181/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.112.gate_proj: 17%|█▋ | 6182/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.112.up_proj: 17%|█▋ | 6183/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.112.down_proj: 17%|█▋ | 6184/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.113.gate_proj: 17%|█▋ | 6185/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.113.up_proj: 17%|█▋ | 6186/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.113.down_proj: 17%|█▋ | 6187/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.114.gate_proj: 17%|█▋ | 6188/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.114.up_proj: 17%|█▋ | 6189/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.114.down_proj: 17%|█▋ | 6190/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.115.gate_proj: 17%|█▋ | 6191/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.115.up_proj: 17%|█▋ | 6192/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.115.down_proj: 17%|█▋ | 6193/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.116.gate_proj: 17%|█▋ | 6194/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.116.up_proj: 17%|█▋ | 6195/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.116.down_proj: 17%|█▋ | 6196/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.117.gate_proj: 17%|█▋ | 6197/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.117.up_proj: 17%|█▋ | 6198/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.117.down_proj: 17%|█▋ | 6199/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.118.gate_proj: 17%|█▋ | 6200/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.118.up_proj: 17%|█▋ | 6201/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.118.down_proj: 17%|█▋ | 6202/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.119.gate_proj: 17%|█▋ | 6203/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.119.up_proj: 17%|█▋ | 6204/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.119.down_proj: 17%|█▋ | 6205/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.120.gate_proj: 17%|█▋ | 6206/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.120.up_proj: 17%|█▋ | 6207/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.120.down_proj: 17%|█▋ | 6208/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.121.gate_proj: 17%|█▋ | 6209/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.121.up_proj: 17%|█▋ | 6210/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.121.down_proj: 17%|█▋ | 6211/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.122.gate_proj: 17%|█▋ | 6212/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.122.up_proj: 17%|█▋ | 6213/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.122.down_proj: 17%|█▋ | 6214/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.123.gate_proj: 17%|█▋ | 6215/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.123.up_proj: 17%|█▋ | 6216/36566 [00:06<00:26, 1167.30it/s] packing model.layers.14.mlp.experts.123.down_proj: 17%|█▋ | 6217/36566 [00:06<00:25, 1167.30it/s] packing model.layers.14.mlp.experts.124.gate_proj: 17%|█▋ | 6218/36566 [00:06<00:25, 1167.30it/s] packing model.layers.14.mlp.experts.124.up_proj: 17%|█▋ | 6219/36566 [00:06<00:25, 1167.30it/s] packing model.layers.14.mlp.experts.124.down_proj: 17%|█▋ | 6220/36566 [00:06<00:25, 1167.30it/s] packing model.layers.14.mlp.experts.125.gate_proj: 17%|█▋ | 6221/36566 [00:06<00:25, 1167.30it/s] packing model.layers.14.mlp.experts.125.gate_proj: 17%|█▋ | 6222/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.125.up_proj: 17%|█▋ | 6222/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.125.down_proj: 17%|█▋ | 6223/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.126.gate_proj: 17%|█▋ | 6224/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.126.up_proj: 17%|█▋ | 6225/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.126.down_proj: 17%|█▋ | 6226/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.127.gate_proj: 17%|█▋ | 6227/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.127.up_proj: 17%|█▋ | 6228/36566 [00:06<00:25, 1169.50it/s] packing model.layers.14.mlp.experts.127.down_proj: 17%|█▋ | 6229/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.0.gate_proj: 17%|█▋ | 6230/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.0.up_proj: 17%|█▋ | 6231/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.0.down_proj: 17%|█▋ | 6232/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.1.gate_proj: 17%|█▋ | 6233/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.1.up_proj: 17%|█▋ | 6234/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.1.down_proj: 17%|█▋ | 6235/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.2.gate_proj: 17%|█▋ | 6236/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.2.up_proj: 17%|█▋ | 6237/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.2.down_proj: 17%|█▋ | 6238/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.3.gate_proj: 17%|█▋ | 6239/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.3.up_proj: 17%|█▋ | 6240/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.3.down_proj: 17%|█▋ | 6241/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.4.gate_proj: 17%|█▋ | 6242/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.4.up_proj: 17%|█▋ | 6243/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.4.down_proj: 17%|█▋ | 6244/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.5.gate_proj: 17%|█▋ | 6245/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.5.up_proj: 17%|█▋ | 6246/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.5.down_proj: 17%|█▋ | 6247/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.6.gate_proj: 17%|█▋ | 6248/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.6.up_proj: 17%|█▋ | 6249/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.6.down_proj: 17%|█▋ | 6250/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.7.gate_proj: 17%|█▋ | 6251/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.7.up_proj: 17%|█▋ | 6252/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.7.down_proj: 17%|█▋ | 6253/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.8.gate_proj: 17%|█▋ | 6254/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.8.up_proj: 17%|█▋ | 6255/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.8.down_proj: 17%|█▋ | 6256/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.9.gate_proj: 17%|█▋ | 6257/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.9.up_proj: 17%|█▋ | 6258/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.9.down_proj: 17%|█▋ | 6259/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.10.gate_proj: 17%|█▋ | 6260/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.10.up_proj: 17%|█▋ | 6261/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.10.down_proj: 17%|█▋ | 6262/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.11.gate_proj: 17%|█▋ | 6263/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.11.up_proj: 17%|█▋ | 6264/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.11.down_proj: 17%|█▋ | 6265/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.12.gate_proj: 17%|█▋ | 6266/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.12.up_proj: 17%|█▋ | 6267/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.12.down_proj: 17%|█▋ | 6268/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.13.gate_proj: 17%|█▋ | 6269/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.13.up_proj: 17%|█▋ | 6270/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.13.down_proj: 17%|█▋ | 6271/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.14.gate_proj: 17%|█▋ | 6272/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.14.up_proj: 17%|█▋ | 6273/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.14.down_proj: 17%|█▋ | 6274/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.15.gate_proj: 17%|█▋ | 6275/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.15.up_proj: 17%|█▋ | 6276/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.15.down_proj: 17%|█▋ | 6277/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.16.gate_proj: 17%|█▋ | 6278/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.16.up_proj: 17%|█▋ | 6279/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.16.down_proj: 17%|█▋ | 6280/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.17.gate_proj: 17%|█▋ | 6281/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.17.up_proj: 17%|█▋ | 6282/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.17.down_proj: 17%|█▋ | 6283/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.18.gate_proj: 17%|█▋ | 6284/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.18.up_proj: 17%|█▋ | 6285/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.18.down_proj: 17%|█▋ | 6286/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.19.gate_proj: 17%|█▋ | 6287/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.19.up_proj: 17%|█▋ | 6288/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.19.down_proj: 17%|█▋ | 6289/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.20.gate_proj: 17%|█▋ | 6290/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.20.up_proj: 17%|█▋ | 6291/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.20.down_proj: 17%|█▋ | 6292/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.21.gate_proj: 17%|█▋ | 6293/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.21.up_proj: 17%|█▋ | 6294/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.21.down_proj: 17%|█▋ | 6295/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.22.gate_proj: 17%|█▋ | 6296/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.22.up_proj: 17%|█▋ | 6297/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.22.down_proj: 17%|█▋ | 6298/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.23.gate_proj: 17%|█▋ | 6299/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.23.up_proj: 17%|█▋ | 6300/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.23.down_proj: 17%|█▋ | 6301/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.24.gate_proj: 17%|█▋ | 6302/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.24.up_proj: 17%|█▋ | 6303/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.24.down_proj: 17%|█▋ | 6304/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.25.gate_proj: 17%|█▋ | 6305/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.25.up_proj: 17%|█▋ | 6306/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.25.down_proj: 17%|█▋ | 6307/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.26.gate_proj: 17%|█▋ | 6308/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.26.up_proj: 17%|█▋ | 6309/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.26.down_proj: 17%|█▋ | 6310/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.27.gate_proj: 17%|█▋ | 6311/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.27.up_proj: 17%|█▋ | 6312/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.27.down_proj: 17%|█▋ | 6313/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.28.gate_proj: 17%|█▋ | 6314/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.28.up_proj: 17%|█▋ | 6315/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.28.down_proj: 17%|█▋ | 6316/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.29.gate_proj: 17%|█▋ | 6317/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.29.up_proj: 17%|█▋ | 6318/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.29.down_proj: 17%|█▋ | 6319/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.30.gate_proj: 17%|█▋ | 6320/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.30.up_proj: 17%|█▋ | 6321/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.30.down_proj: 17%|█▋ | 6322/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.31.gate_proj: 17%|█▋ | 6323/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.31.up_proj: 17%|█▋ | 6324/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.31.down_proj: 17%|█▋ | 6325/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.32.gate_proj: 17%|█▋ | 6326/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.32.up_proj: 17%|█▋ | 6327/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.32.down_proj: 17%|█▋ | 6328/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.33.gate_proj: 17%|█▋ | 6329/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.33.up_proj: 17%|█▋ | 6330/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.33.down_proj: 17%|█▋ | 6331/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.34.gate_proj: 17%|█▋ | 6332/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.34.up_proj: 17%|█▋ | 6333/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.34.down_proj: 17%|█▋ | 6334/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.35.gate_proj: 17%|█▋ | 6335/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.35.up_proj: 17%|█▋ | 6336/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.35.down_proj: 17%|█▋ | 6337/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.36.gate_proj: 17%|█▋ | 6338/36566 [00:06<00:25, 1169.50it/s] packing model.layers.15.mlp.experts.36.gate_proj: 17%|█▋ | 6339/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.36.up_proj: 17%|█▋ | 6339/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.36.down_proj: 17%|█▋ | 6340/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.37.gate_proj: 17%|█▋ | 6341/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.37.up_proj: 17%|█▋ | 6342/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.37.down_proj: 17%|█▋ | 6343/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.38.gate_proj: 17%|█▋ | 6344/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.38.up_proj: 17%|█▋ | 6345/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.38.down_proj: 17%|█▋ | 6346/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.39.gate_proj: 17%|█▋ | 6347/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.39.up_proj: 17%|█▋ | 6348/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.39.down_proj: 17%|█▋ | 6349/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.40.gate_proj: 17%|█▋ | 6350/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.40.up_proj: 17%|█▋ | 6351/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.40.down_proj: 17%|█▋ | 6352/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.41.gate_proj: 17%|█▋ | 6353/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.41.up_proj: 17%|█▋ | 6354/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.41.down_proj: 17%|█▋ | 6355/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.42.gate_proj: 17%|█▋ | 6356/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.42.up_proj: 17%|█▋ | 6357/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.42.down_proj: 17%|█▋ | 6358/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.43.gate_proj: 17%|█▋ | 6359/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.43.up_proj: 17%|█▋ | 6360/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.43.down_proj: 17%|█▋ | 6361/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.44.gate_proj: 17%|█▋ | 6362/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.44.up_proj: 17%|█▋ | 6363/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.44.down_proj: 17%|█▋ | 6364/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.45.gate_proj: 17%|█▋ | 6365/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.45.up_proj: 17%|█▋ | 6366/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.45.down_proj: 17%|█▋ | 6367/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.46.gate_proj: 17%|█▋ | 6368/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.46.up_proj: 17%|█▋ | 6369/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.46.down_proj: 17%|█▋ | 6370/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.47.gate_proj: 17%|█▋ | 6371/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.47.up_proj: 17%|█▋ | 6372/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.47.down_proj: 17%|█▋ | 6373/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.48.gate_proj: 17%|█▋ | 6374/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.48.up_proj: 17%|█▋ | 6375/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.48.down_proj: 17%|█▋ | 6376/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.49.gate_proj: 17%|█▋ | 6377/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.49.up_proj: 17%|█▋ | 6378/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.49.down_proj: 17%|█▋ | 6379/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.50.gate_proj: 17%|█▋ | 6380/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.50.up_proj: 17%|█▋ | 6381/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.50.down_proj: 17%|█▋ | 6382/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.51.gate_proj: 17%|█▋ | 6383/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.51.up_proj: 17%|█▋ | 6384/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.51.down_proj: 17%|█▋ | 6385/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.52.gate_proj: 17%|█▋ | 6386/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.52.up_proj: 17%|█▋ | 6387/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.52.down_proj: 17%|█▋ | 6388/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.53.gate_proj: 17%|█▋ | 6389/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.53.up_proj: 17%|█▋ | 6390/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.53.down_proj: 17%|█▋ | 6391/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.54.gate_proj: 17%|█▋ | 6392/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.54.up_proj: 17%|█▋ | 6393/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.54.down_proj: 17%|█▋ | 6394/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.55.gate_proj: 17%|█▋ | 6395/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.55.up_proj: 17%|█▋ | 6396/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.55.down_proj: 17%|█▋ | 6397/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.56.gate_proj: 17%|█▋ | 6398/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.56.up_proj: 17%|█▋ | 6399/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.56.down_proj: 18%|█▊ | 6400/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.57.gate_proj: 18%|█▊ | 6401/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.57.up_proj: 18%|█▊ | 6402/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.57.down_proj: 18%|█▊ | 6403/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.58.gate_proj: 18%|█▊ | 6404/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.58.up_proj: 18%|█▊ | 6405/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.58.down_proj: 18%|█▊ | 6406/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.59.gate_proj: 18%|█▊ | 6407/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.59.up_proj: 18%|█▊ | 6408/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.59.down_proj: 18%|█▊ | 6409/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.60.gate_proj: 18%|█▊ | 6410/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.60.up_proj: 18%|█▊ | 6411/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.60.down_proj: 18%|█▊ | 6412/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.61.gate_proj: 18%|█▊ | 6413/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.61.up_proj: 18%|█▊ | 6414/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.61.down_proj: 18%|█▊ | 6415/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.62.gate_proj: 18%|█▊ | 6416/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.62.up_proj: 18%|█▊ | 6417/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.62.down_proj: 18%|█▊ | 6418/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.63.gate_proj: 18%|█▊ | 6419/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.63.up_proj: 18%|█▊ | 6420/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.63.down_proj: 18%|█▊ | 6421/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.64.gate_proj: 18%|█▊ | 6422/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.64.up_proj: 18%|█▊ | 6423/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.64.down_proj: 18%|█▊ | 6424/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.65.gate_proj: 18%|█▊ | 6425/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.65.up_proj: 18%|█▊ | 6426/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.65.down_proj: 18%|█▊ | 6427/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.66.gate_proj: 18%|█▊ | 6428/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.66.up_proj: 18%|█▊ | 6429/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.66.down_proj: 18%|█▊ | 6430/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.67.gate_proj: 18%|█▊ | 6431/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.67.up_proj: 18%|█▊ | 6432/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.67.down_proj: 18%|█▊ | 6433/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.68.gate_proj: 18%|█▊ | 6434/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.68.up_proj: 18%|█▊ | 6435/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.68.down_proj: 18%|█▊ | 6436/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.69.gate_proj: 18%|█▊ | 6437/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.69.up_proj: 18%|█▊ | 6438/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.69.down_proj: 18%|█▊ | 6439/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.70.gate_proj: 18%|█▊ | 6440/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.70.up_proj: 18%|█▊ | 6441/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.70.down_proj: 18%|█▊ | 6442/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.71.gate_proj: 18%|█▊ | 6443/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.71.up_proj: 18%|█▊ | 6444/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.71.down_proj: 18%|█▊ | 6445/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.72.gate_proj: 18%|█▊ | 6446/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.72.up_proj: 18%|█▊ | 6447/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.72.down_proj: 18%|█▊ | 6448/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.73.gate_proj: 18%|█▊ | 6449/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.73.up_proj: 18%|█▊ | 6450/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.73.down_proj: 18%|█▊ | 6451/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.74.gate_proj: 18%|█▊ | 6452/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.74.up_proj: 18%|█▊ | 6453/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.74.down_proj: 18%|█▊ | 6454/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.75.gate_proj: 18%|█▊ | 6455/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.75.up_proj: 18%|█▊ | 6456/36566 [00:06<00:25, 1169.18it/s] packing model.layers.15.mlp.experts.75.up_proj: 18%|█▊ | 6457/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.75.down_proj: 18%|█▊ | 6457/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.76.gate_proj: 18%|█▊ | 6458/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.76.up_proj: 18%|█▊ | 6459/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.76.down_proj: 18%|█▊ | 6460/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.77.gate_proj: 18%|█▊ | 6461/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.77.up_proj: 18%|█▊ | 6462/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.77.down_proj: 18%|█▊ | 6463/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.78.gate_proj: 18%|█▊ | 6464/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.78.up_proj: 18%|█▊ | 6465/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.78.down_proj: 18%|█▊ | 6466/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.79.gate_proj: 18%|█▊ | 6467/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.79.up_proj: 18%|█▊ | 6468/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.79.down_proj: 18%|█▊ | 6469/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.80.gate_proj: 18%|█▊ | 6470/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.80.up_proj: 18%|█▊ | 6471/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.80.down_proj: 18%|█▊ | 6472/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.81.gate_proj: 18%|█▊ | 6473/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.81.up_proj: 18%|█▊ | 6474/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.81.down_proj: 18%|█▊ | 6475/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.82.gate_proj: 18%|█▊ | 6476/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.82.up_proj: 18%|█▊ | 6477/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.82.down_proj: 18%|█▊ | 6478/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.83.gate_proj: 18%|█▊ | 6479/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.83.up_proj: 18%|█▊ | 6480/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.83.down_proj: 18%|█▊ | 6481/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.84.gate_proj: 18%|█▊ | 6482/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.84.up_proj: 18%|█▊ | 6483/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.84.down_proj: 18%|█▊ | 6484/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.85.gate_proj: 18%|█▊ | 6485/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.85.up_proj: 18%|█▊ | 6486/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.85.down_proj: 18%|█▊ | 6487/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.86.gate_proj: 18%|█▊ | 6488/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.86.up_proj: 18%|█▊ | 6489/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.86.down_proj: 18%|█▊ | 6490/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.87.gate_proj: 18%|█▊ | 6491/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.87.up_proj: 18%|█▊ | 6492/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.87.down_proj: 18%|█▊ | 6493/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.88.gate_proj: 18%|█▊ | 6494/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.88.up_proj: 18%|█▊ | 6495/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.88.down_proj: 18%|█▊ | 6496/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.89.gate_proj: 18%|█▊ | 6497/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.89.up_proj: 18%|█▊ | 6498/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.89.down_proj: 18%|█▊ | 6499/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.90.gate_proj: 18%|█▊ | 6500/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.90.up_proj: 18%|█▊ | 6501/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.90.down_proj: 18%|█▊ | 6502/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.91.gate_proj: 18%|█▊ | 6503/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.91.up_proj: 18%|█▊ | 6504/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.91.down_proj: 18%|█▊ | 6505/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.92.gate_proj: 18%|█▊ | 6506/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.92.up_proj: 18%|█▊ | 6507/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.92.down_proj: 18%|█▊ | 6508/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.93.gate_proj: 18%|█▊ | 6509/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.93.up_proj: 18%|█▊ | 6510/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.93.down_proj: 18%|█▊ | 6511/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.94.gate_proj: 18%|█▊ | 6512/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.94.up_proj: 18%|█▊ | 6513/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.94.down_proj: 18%|█▊ | 6514/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.95.gate_proj: 18%|█▊ | 6515/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.95.up_proj: 18%|█▊ | 6516/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.95.down_proj: 18%|█▊ | 6517/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.96.gate_proj: 18%|█▊ | 6518/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.96.up_proj: 18%|█▊ | 6519/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.96.down_proj: 18%|█▊ | 6520/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.97.gate_proj: 18%|█▊ | 6521/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.97.up_proj: 18%|█▊ | 6522/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.97.down_proj: 18%|█▊ | 6523/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.98.gate_proj: 18%|█▊ | 6524/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.98.up_proj: 18%|█▊ | 6525/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.98.down_proj: 18%|█▊ | 6526/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.99.gate_proj: 18%|█▊ | 6527/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.99.up_proj: 18%|█▊ | 6528/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.99.down_proj: 18%|█▊ | 6529/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.100.gate_proj: 18%|█▊ | 6530/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.100.up_proj: 18%|█▊ | 6531/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.100.down_proj: 18%|█▊ | 6532/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.101.gate_proj: 18%|█▊ | 6533/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.101.up_proj: 18%|█▊ | 6534/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.101.down_proj: 18%|█▊ | 6535/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.102.gate_proj: 18%|█▊ | 6536/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.102.up_proj: 18%|█▊ | 6537/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.102.down_proj: 18%|█▊ | 6538/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.103.gate_proj: 18%|█▊ | 6539/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.103.up_proj: 18%|█▊ | 6540/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.103.down_proj: 18%|█▊ | 6541/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.104.gate_proj: 18%|█▊ | 6542/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.104.up_proj: 18%|█▊ | 6543/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.104.down_proj: 18%|█▊ | 6544/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.105.gate_proj: 18%|█▊ | 6545/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.105.up_proj: 18%|█▊ | 6546/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.105.down_proj: 18%|█▊ | 6547/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.106.gate_proj: 18%|█▊ | 6548/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.106.up_proj: 18%|█▊ | 6549/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.106.down_proj: 18%|█▊ | 6550/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.107.gate_proj: 18%|█▊ | 6551/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.107.up_proj: 18%|█▊ | 6552/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.107.down_proj: 18%|█▊ | 6553/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.108.gate_proj: 18%|█▊ | 6554/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.108.up_proj: 18%|█▊ | 6555/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.108.down_proj: 18%|█▊ | 6556/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.109.gate_proj: 18%|█▊ | 6557/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.109.up_proj: 18%|█▊ | 6558/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.109.down_proj: 18%|█▊ | 6559/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.110.gate_proj: 18%|█▊ | 6560/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.110.up_proj: 18%|█▊ | 6561/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.110.down_proj: 18%|█▊ | 6562/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.111.gate_proj: 18%|█▊ | 6563/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.111.up_proj: 18%|█▊ | 6564/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.111.down_proj: 18%|█▊ | 6565/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.112.gate_proj: 18%|█▊ | 6566/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.112.up_proj: 18%|█▊ | 6567/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.112.down_proj: 18%|█▊ | 6568/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.113.gate_proj: 18%|█▊ | 6569/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.113.up_proj: 18%|█▊ | 6570/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.113.down_proj: 18%|█▊ | 6571/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.114.gate_proj: 18%|█▊ | 6572/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.114.up_proj: 18%|█▊ | 6573/36566 [00:06<00:25, 1169.44it/s] packing model.layers.15.mlp.experts.114.up_proj: 18%|█▊ | 6574/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.114.down_proj: 18%|█▊ | 6574/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.115.gate_proj: 18%|█▊ | 6575/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.115.up_proj: 18%|█▊ | 6576/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.115.down_proj: 18%|█▊ | 6577/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.116.gate_proj: 18%|█▊ | 6578/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.116.up_proj: 18%|█▊ | 6579/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.116.down_proj: 18%|█▊ | 6580/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.117.gate_proj: 18%|█▊ | 6581/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.117.up_proj: 18%|█▊ | 6582/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.117.down_proj: 18%|█▊ | 6583/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.118.gate_proj: 18%|█▊ | 6584/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.118.up_proj: 18%|█▊ | 6585/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.118.down_proj: 18%|█▊ | 6586/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.119.gate_proj: 18%|█▊ | 6587/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.119.up_proj: 18%|█▊ | 6588/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.119.down_proj: 18%|█▊ | 6589/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.120.gate_proj: 18%|█▊ | 6590/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.120.up_proj: 18%|█▊ | 6591/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.120.down_proj: 18%|█▊ | 6592/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.121.gate_proj: 18%|█▊ | 6593/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.121.up_proj: 18%|█▊ | 6594/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.121.down_proj: 18%|█▊ | 6595/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.122.gate_proj: 18%|█▊ | 6596/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.122.up_proj: 18%|█▊ | 6597/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.122.down_proj: 18%|█▊ | 6598/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.123.gate_proj: 18%|█▊ | 6599/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.123.up_proj: 18%|█▊ | 6600/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.123.down_proj: 18%|█▊ | 6601/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.124.gate_proj: 18%|█▊ | 6602/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.124.up_proj: 18%|█▊ | 6603/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.124.down_proj: 18%|█▊ | 6604/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.125.gate_proj: 18%|█▊ | 6605/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.125.up_proj: 18%|█▊ | 6606/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.125.down_proj: 18%|█▊ | 6607/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.126.gate_proj: 18%|█▊ | 6608/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.126.up_proj: 18%|█▊ | 6609/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.126.down_proj: 18%|█▊ | 6610/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.127.gate_proj: 18%|█▊ | 6611/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.127.up_proj: 18%|█▊ | 6612/36566 [00:06<00:25, 1168.79it/s] packing model.layers.15.mlp.experts.127.down_proj: 18%|█▊ | 6613/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.0.gate_proj: 18%|█▊ | 6614/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.0.up_proj: 18%|█▊ | 6615/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.0.down_proj: 18%|█▊ | 6616/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.1.gate_proj: 18%|█▊ | 6617/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.1.up_proj: 18%|█▊ | 6618/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.1.down_proj: 18%|█▊ | 6619/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.2.gate_proj: 18%|█▊ | 6620/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.2.up_proj: 18%|█▊ | 6621/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.2.down_proj: 18%|█▊ | 6622/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.3.gate_proj: 18%|█▊ | 6623/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.3.up_proj: 18%|█▊ | 6624/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.3.down_proj: 18%|█▊ | 6625/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.4.gate_proj: 18%|█▊ | 6626/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.4.up_proj: 18%|█▊ | 6627/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.4.down_proj: 18%|█▊ | 6628/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.5.gate_proj: 18%|█▊ | 6629/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.5.up_proj: 18%|█▊ | 6630/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.5.down_proj: 18%|█▊ | 6631/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.6.gate_proj: 18%|█▊ | 6632/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.6.up_proj: 18%|█▊ | 6633/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.6.down_proj: 18%|█▊ | 6634/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.7.gate_proj: 18%|█▊ | 6635/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.7.up_proj: 18%|█▊ | 6636/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.7.down_proj: 18%|█▊ | 6637/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.8.gate_proj: 18%|█▊ | 6638/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.8.up_proj: 18%|█▊ | 6639/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.8.down_proj: 18%|█▊ | 6640/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.9.gate_proj: 18%|█▊ | 6641/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.9.up_proj: 18%|█▊ | 6642/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.9.down_proj: 18%|█▊ | 6643/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.10.gate_proj: 18%|█▊ | 6644/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.10.up_proj: 18%|█▊ | 6645/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.10.down_proj: 18%|█▊ | 6646/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.11.gate_proj: 18%|█▊ | 6647/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.11.up_proj: 18%|█▊ | 6648/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.11.down_proj: 18%|█▊ | 6649/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.12.gate_proj: 18%|█▊ | 6650/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.12.up_proj: 18%|█▊ | 6651/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.12.down_proj: 18%|█▊ | 6652/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.13.gate_proj: 18%|█▊ | 6653/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.13.up_proj: 18%|█▊ | 6654/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.13.down_proj: 18%|█▊ | 6655/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.14.gate_proj: 18%|█▊ | 6656/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.14.up_proj: 18%|█▊ | 6657/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.14.down_proj: 18%|█▊ | 6658/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.15.gate_proj: 18%|█▊ | 6659/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.15.up_proj: 18%|█▊ | 6660/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.15.down_proj: 18%|█▊ | 6661/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.16.gate_proj: 18%|█▊ | 6662/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.16.up_proj: 18%|█▊ | 6663/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.16.down_proj: 18%|█▊ | 6664/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.17.gate_proj: 18%|█▊ | 6665/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.17.up_proj: 18%|█▊ | 6666/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.17.down_proj: 18%|█▊ | 6667/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.18.gate_proj: 18%|█▊ | 6668/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.18.up_proj: 18%|█▊ | 6669/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.18.down_proj: 18%|█▊ | 6670/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.19.gate_proj: 18%|█▊ | 6671/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.19.up_proj: 18%|█▊ | 6672/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.19.down_proj: 18%|█▊ | 6673/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.20.gate_proj: 18%|█▊ | 6674/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.20.up_proj: 18%|█▊ | 6675/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.20.down_proj: 18%|█▊ | 6676/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.21.gate_proj: 18%|█▊ | 6677/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.21.up_proj: 18%|█▊ | 6678/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.21.down_proj: 18%|█▊ | 6679/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.22.gate_proj: 18%|█▊ | 6680/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.22.up_proj: 18%|█▊ | 6681/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.22.down_proj: 18%|█▊ | 6682/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.23.gate_proj: 18%|█▊ | 6683/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.23.up_proj: 18%|█▊ | 6684/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.23.down_proj: 18%|█▊ | 6685/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.24.gate_proj: 18%|█▊ | 6686/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.24.up_proj: 18%|█▊ | 6687/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.24.down_proj: 18%|█▊ | 6688/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.25.gate_proj: 18%|█▊ | 6689/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.25.up_proj: 18%|█▊ | 6690/36566 [00:06<00:25, 1168.79it/s] packing model.layers.16.mlp.experts.25.up_proj: 18%|█▊ | 6691/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.25.down_proj: 18%|█▊ | 6691/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.26.gate_proj: 18%|█▊ | 6692/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.26.up_proj: 18%|█▊ | 6693/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.26.down_proj: 18%|█▊ | 6694/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.27.gate_proj: 18%|█▊ | 6695/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.27.up_proj: 18%|█▊ | 6696/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.27.down_proj: 18%|█▊ | 6697/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.28.gate_proj: 18%|█▊ | 6698/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.28.up_proj: 18%|█▊ | 6699/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.28.down_proj: 18%|█▊ | 6700/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.29.gate_proj: 18%|█▊ | 6701/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.29.up_proj: 18%|█▊ | 6702/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.29.down_proj: 18%|█▊ | 6703/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.30.gate_proj: 18%|█▊ | 6704/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.30.up_proj: 18%|█▊ | 6705/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.30.down_proj: 18%|█▊ | 6706/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.31.gate_proj: 18%|█▊ | 6707/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.31.up_proj: 18%|█▊ | 6708/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.31.down_proj: 18%|█▊ | 6709/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.32.gate_proj: 18%|█▊ | 6710/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.32.up_proj: 18%|█▊ | 6711/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.32.down_proj: 18%|█▊ | 6712/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.33.gate_proj: 18%|█▊ | 6713/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.33.up_proj: 18%|█▊ | 6714/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.33.down_proj: 18%|█▊ | 6715/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.34.gate_proj: 18%|█▊ | 6716/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.34.up_proj: 18%|█▊ | 6717/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.34.down_proj: 18%|█▊ | 6718/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.35.gate_proj: 18%|█▊ | 6719/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.35.up_proj: 18%|█▊ | 6720/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.35.down_proj: 18%|█▊ | 6721/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.36.gate_proj: 18%|█▊ | 6722/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.36.up_proj: 18%|█▊ | 6723/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.36.down_proj: 18%|█▊ | 6724/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.37.gate_proj: 18%|█▊ | 6725/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.37.up_proj: 18%|█▊ | 6726/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.37.down_proj: 18%|█▊ | 6727/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.38.gate_proj: 18%|█▊ | 6728/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.38.up_proj: 18%|█▊ | 6729/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.38.down_proj: 18%|█▊ | 6730/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.39.gate_proj: 18%|█▊ | 6731/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.39.up_proj: 18%|█▊ | 6732/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.39.down_proj: 18%|█▊ | 6733/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.40.gate_proj: 18%|█▊ | 6734/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.40.up_proj: 18%|█▊ | 6735/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.40.down_proj: 18%|█▊ | 6736/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.41.gate_proj: 18%|█▊ | 6737/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.41.up_proj: 18%|█▊ | 6738/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.41.down_proj: 18%|█▊ | 6739/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.42.gate_proj: 18%|█▊ | 6740/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.42.up_proj: 18%|█▊ | 6741/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.42.down_proj: 18%|█▊ | 6742/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.43.gate_proj: 18%|█▊ | 6743/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.43.up_proj: 18%|█▊ | 6744/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.43.down_proj: 18%|█▊ | 6745/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.44.gate_proj: 18%|█▊ | 6746/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.44.up_proj: 18%|█▊ | 6747/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.44.down_proj: 18%|█▊ | 6748/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.45.gate_proj: 18%|█▊ | 6749/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.45.up_proj: 18%|█▊ | 6750/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.45.down_proj: 18%|█▊ | 6751/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.46.gate_proj: 18%|█▊ | 6752/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.46.up_proj: 18%|█▊ | 6753/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.46.down_proj: 18%|█▊ | 6754/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.47.gate_proj: 18%|█▊ | 6755/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.47.up_proj: 18%|█▊ | 6756/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.47.down_proj: 18%|█▊ | 6757/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.48.gate_proj: 18%|█▊ | 6758/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.48.up_proj: 18%|█▊ | 6759/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.48.down_proj: 18%|█▊ | 6760/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.49.gate_proj: 18%|█▊ | 6761/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.49.up_proj: 18%|█▊ | 6762/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.49.down_proj: 18%|█▊ | 6763/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.50.gate_proj: 18%|█▊ | 6764/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.50.up_proj: 19%|█▊ | 6765/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.50.down_proj: 19%|█▊ | 6766/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.51.gate_proj: 19%|█▊ | 6767/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.51.up_proj: 19%|█▊ | 6768/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.51.down_proj: 19%|█▊ | 6769/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.52.gate_proj: 19%|█▊ | 6770/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.52.up_proj: 19%|█▊ | 6771/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.52.down_proj: 19%|█▊ | 6772/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.53.gate_proj: 19%|█▊ | 6773/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.53.up_proj: 19%|█▊ | 6774/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.53.down_proj: 19%|█▊ | 6775/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.54.gate_proj: 19%|█▊ | 6776/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.54.up_proj: 19%|█▊ | 6777/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.54.down_proj: 19%|█▊ | 6778/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.55.gate_proj: 19%|█▊ | 6779/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.55.up_proj: 19%|█▊ | 6780/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.55.down_proj: 19%|█▊ | 6781/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.56.gate_proj: 19%|█▊ | 6782/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.56.up_proj: 19%|█▊ | 6783/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.56.down_proj: 19%|█▊ | 6784/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.57.gate_proj: 19%|█▊ | 6785/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.57.up_proj: 19%|█▊ | 6786/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.57.down_proj: 19%|█▊ | 6787/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.58.gate_proj: 19%|█▊ | 6788/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.58.up_proj: 19%|█▊ | 6789/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.58.down_proj: 19%|█▊ | 6790/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.59.gate_proj: 19%|█▊ | 6791/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.59.up_proj: 19%|█▊ | 6792/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.59.down_proj: 19%|█▊ | 6793/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.60.gate_proj: 19%|█▊ | 6794/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.60.up_proj: 19%|█▊ | 6795/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.60.down_proj: 19%|█▊ | 6796/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.61.gate_proj: 19%|█▊ | 6797/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.61.up_proj: 19%|█▊ | 6798/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.61.down_proj: 19%|█▊ | 6799/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.62.gate_proj: 19%|█▊ | 6800/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.62.up_proj: 19%|█▊ | 6801/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.62.down_proj: 19%|█▊ | 6802/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.63.gate_proj: 19%|█▊ | 6803/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.63.up_proj: 19%|█▊ | 6804/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.63.down_proj: 19%|█▊ | 6805/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.64.gate_proj: 19%|█▊ | 6806/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.64.up_proj: 19%|█▊ | 6807/36566 [00:06<00:25, 1167.22it/s] packing model.layers.16.mlp.experts.64.up_proj: 19%|█▊ | 6808/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.64.down_proj: 19%|█▊ | 6808/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.65.gate_proj: 19%|█▊ | 6809/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.65.up_proj: 19%|█▊ | 6810/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.65.down_proj: 19%|█▊ | 6811/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.66.gate_proj: 19%|█▊ | 6812/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.66.up_proj: 19%|█▊ | 6813/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.66.down_proj: 19%|█▊ | 6814/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.67.gate_proj: 19%|█▊ | 6815/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.67.up_proj: 19%|█▊ | 6816/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.67.down_proj: 19%|█▊ | 6817/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.68.gate_proj: 19%|█▊ | 6818/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.68.up_proj: 19%|█▊ | 6819/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.68.down_proj: 19%|█▊ | 6820/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.69.gate_proj: 19%|█▊ | 6821/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.69.up_proj: 19%|█▊ | 6822/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.69.down_proj: 19%|█▊ | 6823/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.70.gate_proj: 19%|█▊ | 6824/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.70.up_proj: 19%|█▊ | 6825/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.70.down_proj: 19%|█▊ | 6826/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.71.gate_proj: 19%|█▊ | 6827/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.71.up_proj: 19%|█▊ | 6828/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.71.down_proj: 19%|█▊ | 6829/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.72.gate_proj: 19%|█▊ | 6830/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.72.up_proj: 19%|█▊ | 6831/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.72.down_proj: 19%|█▊ | 6832/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.73.gate_proj: 19%|█▊ | 6833/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.73.up_proj: 19%|█▊ | 6834/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.73.down_proj: 19%|█▊ | 6835/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.74.gate_proj: 19%|█▊ | 6836/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.74.up_proj: 19%|█▊ | 6837/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.74.down_proj: 19%|█▊ | 6838/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.75.gate_proj: 19%|█▊ | 6839/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.75.up_proj: 19%|█▊ | 6840/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.75.down_proj: 19%|█▊ | 6841/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.76.gate_proj: 19%|█▊ | 6842/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.76.up_proj: 19%|█▊ | 6843/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.76.down_proj: 19%|█▊ | 6844/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.77.gate_proj: 19%|█▊ | 6845/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.77.up_proj: 19%|█▊ | 6846/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.77.down_proj: 19%|█▊ | 6847/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.78.gate_proj: 19%|█▊ | 6848/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.78.up_proj: 19%|█▊ | 6849/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.78.down_proj: 19%|█▊ | 6850/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.79.gate_proj: 19%|█▊ | 6851/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.79.up_proj: 19%|█▊ | 6852/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.79.down_proj: 19%|█▊ | 6853/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.80.gate_proj: 19%|█▊ | 6854/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.80.up_proj: 19%|█▊ | 6855/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.80.down_proj: 19%|█▊ | 6856/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.81.gate_proj: 19%|█▉ | 6857/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.81.up_proj: 19%|█▉ | 6858/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.81.down_proj: 19%|█▉ | 6859/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.82.gate_proj: 19%|█▉ | 6860/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.82.up_proj: 19%|█▉ | 6861/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.82.down_proj: 19%|█▉ | 6862/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.83.gate_proj: 19%|█▉ | 6863/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.83.up_proj: 19%|█▉ | 6864/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.83.down_proj: 19%|█▉ | 6865/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.84.gate_proj: 19%|█▉ | 6866/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.84.up_proj: 19%|█▉ | 6867/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.84.down_proj: 19%|█▉ | 6868/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.85.gate_proj: 19%|█▉ | 6869/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.85.up_proj: 19%|█▉ | 6870/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.85.down_proj: 19%|█▉ | 6871/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.86.gate_proj: 19%|█▉ | 6872/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.86.up_proj: 19%|█▉ | 6873/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.86.down_proj: 19%|█▉ | 6874/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.87.gate_proj: 19%|█▉ | 6875/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.87.up_proj: 19%|█▉ | 6876/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.87.down_proj: 19%|█▉ | 6877/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.88.gate_proj: 19%|█▉ | 6878/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.88.up_proj: 19%|█▉ | 6879/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.88.down_proj: 19%|█▉ | 6880/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.89.gate_proj: 19%|█▉ | 6881/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.89.up_proj: 19%|█▉ | 6882/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.89.down_proj: 19%|█▉ | 6883/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.90.gate_proj: 19%|█▉ | 6884/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.90.up_proj: 19%|█▉ | 6885/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.90.down_proj: 19%|█▉ | 6886/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.91.gate_proj: 19%|█▉ | 6887/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.91.up_proj: 19%|█▉ | 6888/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.91.down_proj: 19%|█▉ | 6889/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.92.gate_proj: 19%|█▉ | 6890/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.92.up_proj: 19%|█▉ | 6891/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.92.down_proj: 19%|█▉ | 6892/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.93.gate_proj: 19%|█▉ | 6893/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.93.up_proj: 19%|█▉ | 6894/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.93.down_proj: 19%|█▉ | 6895/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.94.gate_proj: 19%|█▉ | 6896/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.94.up_proj: 19%|█▉ | 6897/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.94.down_proj: 19%|█▉ | 6898/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.95.gate_proj: 19%|█▉ | 6899/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.95.up_proj: 19%|█▉ | 6900/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.95.down_proj: 19%|█▉ | 6901/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.96.gate_proj: 19%|█▉ | 6902/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.96.up_proj: 19%|█▉ | 6903/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.96.down_proj: 19%|█▉ | 6904/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.97.gate_proj: 19%|█▉ | 6905/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.97.up_proj: 19%|█▉ | 6906/36566 [00:06<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.97.down_proj: 19%|█▉ | 6907/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.98.gate_proj: 19%|█▉ | 6908/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.98.up_proj: 19%|█▉ | 6909/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.98.down_proj: 19%|█▉ | 6910/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.99.gate_proj: 19%|█▉ | 6911/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.99.up_proj: 19%|█▉ | 6912/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.99.down_proj: 19%|█▉ | 6913/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.100.gate_proj: 19%|█▉ | 6914/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.100.up_proj: 19%|█▉ | 6915/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.100.down_proj: 19%|█▉ | 6916/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.101.gate_proj: 19%|█▉ | 6917/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.101.up_proj: 19%|█▉ | 6918/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.101.down_proj: 19%|█▉ | 6919/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.102.gate_proj: 19%|█▉ | 6920/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.102.up_proj: 19%|█▉ | 6921/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.102.down_proj: 19%|█▉ | 6922/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.103.gate_proj: 19%|█▉ | 6923/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.103.up_proj: 19%|█▉ | 6924/36566 [00:07<00:25, 1161.79it/s] packing model.layers.16.mlp.experts.103.up_proj: 19%|█▉ | 6925/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.103.down_proj: 19%|█▉ | 6925/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.104.gate_proj: 19%|█▉ | 6926/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.104.up_proj: 19%|█▉ | 6927/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.104.down_proj: 19%|█▉ | 6928/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.105.gate_proj: 19%|█▉ | 6929/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.105.up_proj: 19%|█▉ | 6930/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.105.down_proj: 19%|█▉ | 6931/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.106.gate_proj: 19%|█▉ | 6932/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.106.up_proj: 19%|█▉ | 6933/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.106.down_proj: 19%|█▉ | 6934/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.107.gate_proj: 19%|█▉ | 6935/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.107.up_proj: 19%|█▉ | 6936/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.107.down_proj: 19%|█▉ | 6937/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.108.gate_proj: 19%|█▉ | 6938/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.108.up_proj: 19%|█▉ | 6939/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.108.down_proj: 19%|█▉ | 6940/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.109.gate_proj: 19%|█▉ | 6941/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.109.up_proj: 19%|█▉ | 6942/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.109.down_proj: 19%|█▉ | 6943/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.110.gate_proj: 19%|█▉ | 6944/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.110.up_proj: 19%|█▉ | 6945/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.110.down_proj: 19%|█▉ | 6946/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.111.gate_proj: 19%|█▉ | 6947/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.111.up_proj: 19%|█▉ | 6948/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.111.down_proj: 19%|█▉ | 6949/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.112.gate_proj: 19%|█▉ | 6950/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.112.up_proj: 19%|█▉ | 6951/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.112.down_proj: 19%|█▉ | 6952/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.113.gate_proj: 19%|█▉ | 6953/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.113.up_proj: 19%|█▉ | 6954/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.113.down_proj: 19%|█▉ | 6955/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.114.gate_proj: 19%|█▉ | 6956/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.114.up_proj: 19%|█▉ | 6957/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.114.down_proj: 19%|█▉ | 6958/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.115.gate_proj: 19%|█▉ | 6959/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.115.up_proj: 19%|█▉ | 6960/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.115.down_proj: 19%|█▉ | 6961/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.116.gate_proj: 19%|█▉ | 6962/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.116.up_proj: 19%|█▉ | 6963/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.116.down_proj: 19%|█▉ | 6964/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.117.gate_proj: 19%|█▉ | 6965/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.117.up_proj: 19%|█▉ | 6966/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.117.down_proj: 19%|█▉ | 6967/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.118.gate_proj: 19%|█▉ | 6968/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.118.up_proj: 19%|█▉ | 6969/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.118.down_proj: 19%|█▉ | 6970/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.119.gate_proj: 19%|█▉ | 6971/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.119.up_proj: 19%|█▉ | 6972/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.119.down_proj: 19%|█▉ | 6973/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.120.gate_proj: 19%|█▉ | 6974/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.120.up_proj: 19%|█▉ | 6975/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.120.down_proj: 19%|█▉ | 6976/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.121.gate_proj: 19%|█▉ | 6977/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.121.up_proj: 19%|█▉ | 6978/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.121.down_proj: 19%|█▉ | 6979/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.122.gate_proj: 19%|█▉ | 6980/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.122.up_proj: 19%|█▉ | 6981/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.122.down_proj: 19%|█▉ | 6982/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.123.gate_proj: 19%|█▉ | 6983/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.123.up_proj: 19%|█▉ | 6984/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.123.down_proj: 19%|█▉ | 6985/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.124.gate_proj: 19%|█▉ | 6986/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.124.up_proj: 19%|█▉ | 6987/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.124.down_proj: 19%|█▉ | 6988/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.125.gate_proj: 19%|█▉ | 6989/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.125.up_proj: 19%|█▉ | 6990/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.125.down_proj: 19%|█▉ | 6991/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.126.gate_proj: 19%|█▉ | 6992/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.126.up_proj: 19%|█▉ | 6993/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.126.down_proj: 19%|█▉ | 6994/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.127.gate_proj: 19%|█▉ | 6995/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.127.up_proj: 19%|█▉ | 6996/36566 [00:07<00:25, 1155.51it/s] packing model.layers.16.mlp.experts.127.down_proj: 19%|█▉ | 6997/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.0.gate_proj: 19%|█▉ | 6998/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.0.up_proj: 19%|█▉ | 6999/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.0.down_proj: 19%|█▉ | 7000/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.1.gate_proj: 19%|█▉ | 7001/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.1.up_proj: 19%|█▉ | 7002/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.1.down_proj: 19%|█▉ | 7003/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.2.gate_proj: 19%|█▉ | 7004/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.2.up_proj: 19%|█▉ | 7005/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.2.down_proj: 19%|█▉ | 7006/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.3.gate_proj: 19%|█▉ | 7007/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.3.up_proj: 19%|█▉ | 7008/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.3.down_proj: 19%|█▉ | 7009/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.4.gate_proj: 19%|█▉ | 7010/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.4.up_proj: 19%|█▉ | 7011/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.4.down_proj: 19%|█▉ | 7012/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.5.gate_proj: 19%|█▉ | 7013/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.5.up_proj: 19%|█▉ | 7014/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.5.down_proj: 19%|█▉ | 7015/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.6.gate_proj: 19%|█▉ | 7016/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.6.up_proj: 19%|█▉ | 7017/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.6.down_proj: 19%|█▉ | 7018/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.7.gate_proj: 19%|█▉ | 7019/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.7.up_proj: 19%|█▉ | 7020/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.7.down_proj: 19%|█▉ | 7021/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.8.gate_proj: 19%|█▉ | 7022/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.8.up_proj: 19%|█▉ | 7023/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.8.down_proj: 19%|█▉ | 7024/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.9.gate_proj: 19%|█▉ | 7025/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.9.up_proj: 19%|█▉ | 7026/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.9.down_proj: 19%|█▉ | 7027/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.10.gate_proj: 19%|█▉ | 7028/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.10.up_proj: 19%|█▉ | 7029/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.10.down_proj: 19%|█▉ | 7030/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.11.gate_proj: 19%|█▉ | 7031/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.11.up_proj: 19%|█▉ | 7032/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.11.down_proj: 19%|█▉ | 7033/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.12.gate_proj: 19%|█▉ | 7034/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.12.up_proj: 19%|█▉ | 7035/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.12.down_proj: 19%|█▉ | 7036/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.13.gate_proj: 19%|█▉ | 7037/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.13.up_proj: 19%|█▉ | 7038/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.13.down_proj: 19%|█▉ | 7039/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.14.gate_proj: 19%|█▉ | 7040/36566 [00:07<00:25, 1155.51it/s] packing model.layers.17.mlp.experts.14.gate_proj: 19%|█▉ | 7041/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.14.up_proj: 19%|█▉ | 7041/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.14.down_proj: 19%|█▉ | 7042/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.15.gate_proj: 19%|█▉ | 7043/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.15.up_proj: 19%|█▉ | 7044/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.15.down_proj: 19%|█▉ | 7045/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.16.gate_proj: 19%|█▉ | 7046/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.16.up_proj: 19%|█▉ | 7047/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.16.down_proj: 19%|█▉ | 7048/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.17.gate_proj: 19%|█▉ | 7049/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.17.up_proj: 19%|█▉ | 7050/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.17.down_proj: 19%|█▉ | 7051/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.18.gate_proj: 19%|█▉ | 7052/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.18.up_proj: 19%|█▉ | 7053/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.18.down_proj: 19%|█▉ | 7054/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.19.gate_proj: 19%|█▉ | 7055/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.19.up_proj: 19%|█▉ | 7056/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.19.down_proj: 19%|█▉ | 7057/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.20.gate_proj: 19%|█▉ | 7058/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.20.up_proj: 19%|█▉ | 7059/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.20.down_proj: 19%|█▉ | 7060/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.21.gate_proj: 19%|█▉ | 7061/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.21.up_proj: 19%|█▉ | 7062/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.21.down_proj: 19%|█▉ | 7063/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.22.gate_proj: 19%|█▉ | 7064/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.22.up_proj: 19%|█▉ | 7065/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.22.down_proj: 19%|█▉ | 7066/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.23.gate_proj: 19%|█▉ | 7067/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.23.up_proj: 19%|█▉ | 7068/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.23.down_proj: 19%|█▉ | 7069/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.24.gate_proj: 19%|█▉ | 7070/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.24.up_proj: 19%|█▉ | 7071/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.24.down_proj: 19%|█▉ | 7072/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.25.gate_proj: 19%|█▉ | 7073/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.25.up_proj: 19%|█▉ | 7074/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.25.down_proj: 19%|█▉ | 7075/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.26.gate_proj: 19%|█▉ | 7076/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.26.up_proj: 19%|█▉ | 7077/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.26.down_proj: 19%|█▉ | 7078/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.27.gate_proj: 19%|█▉ | 7079/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.27.up_proj: 19%|█▉ | 7080/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.27.down_proj: 19%|█▉ | 7081/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.28.gate_proj: 19%|█▉ | 7082/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.28.up_proj: 19%|█▉ | 7083/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.28.down_proj: 19%|█▉ | 7084/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.29.gate_proj: 19%|█▉ | 7085/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.29.up_proj: 19%|█▉ | 7086/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.29.down_proj: 19%|█▉ | 7087/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.30.gate_proj: 19%|█▉ | 7088/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.30.up_proj: 19%|█▉ | 7089/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.30.down_proj: 19%|█▉ | 7090/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.31.gate_proj: 19%|█▉ | 7091/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.31.up_proj: 19%|█▉ | 7092/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.31.down_proj: 19%|█▉ | 7093/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.32.gate_proj: 19%|█▉ | 7094/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.32.up_proj: 19%|█▉ | 7095/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.32.down_proj: 19%|█▉ | 7096/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.33.gate_proj: 19%|█▉ | 7097/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.33.up_proj: 19%|█▉ | 7098/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.33.down_proj: 19%|█▉ | 7099/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.34.gate_proj: 19%|█▉ | 7100/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.34.up_proj: 19%|█▉ | 7101/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.34.down_proj: 19%|█▉ | 7102/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.35.gate_proj: 19%|█▉ | 7103/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.35.up_proj: 19%|█▉ | 7104/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.35.down_proj: 19%|█▉ | 7105/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.36.gate_proj: 19%|█▉ | 7106/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.36.up_proj: 19%|█▉ | 7107/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.36.down_proj: 19%|█▉ | 7108/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.37.gate_proj: 19%|█▉ | 7109/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.37.up_proj: 19%|█▉ | 7110/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.37.down_proj: 19%|█▉ | 7111/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.38.gate_proj: 19%|█▉ | 7112/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.38.up_proj: 19%|█▉ | 7113/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.38.down_proj: 19%|█▉ | 7114/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.39.gate_proj: 19%|█▉ | 7115/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.39.up_proj: 19%|█▉ | 7116/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.39.down_proj: 19%|█▉ | 7117/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.40.gate_proj: 19%|█▉ | 7118/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.40.up_proj: 19%|█▉ | 7119/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.40.down_proj: 19%|█▉ | 7120/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.41.gate_proj: 19%|█▉ | 7121/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.41.up_proj: 19%|█▉ | 7122/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.41.down_proj: 19%|█▉ | 7123/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.42.gate_proj: 19%|█▉ | 7124/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.42.up_proj: 19%|█▉ | 7125/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.42.down_proj: 19%|█▉ | 7126/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.43.gate_proj: 19%|█▉ | 7127/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.43.up_proj: 19%|█▉ | 7128/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.43.down_proj: 19%|█▉ | 7129/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.44.gate_proj: 19%|█▉ | 7130/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.44.up_proj: 20%|█▉ | 7131/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.44.down_proj: 20%|█▉ | 7132/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.45.gate_proj: 20%|█▉ | 7133/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.45.up_proj: 20%|█▉ | 7134/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.45.down_proj: 20%|█▉ | 7135/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.46.gate_proj: 20%|█▉ | 7136/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.46.up_proj: 20%|█▉ | 7137/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.46.down_proj: 20%|█▉ | 7138/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.47.gate_proj: 20%|█▉ | 7139/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.47.up_proj: 20%|█▉ | 7140/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.47.down_proj: 20%|█▉ | 7141/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.48.gate_proj: 20%|█▉ | 7142/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.48.up_proj: 20%|█▉ | 7143/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.48.down_proj: 20%|█▉ | 7144/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.49.gate_proj: 20%|█▉ | 7145/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.49.up_proj: 20%|█▉ | 7146/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.49.down_proj: 20%|█▉ | 7147/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.50.gate_proj: 20%|█▉ | 7148/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.50.up_proj: 20%|█▉ | 7149/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.50.down_proj: 20%|█▉ | 7150/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.51.gate_proj: 20%|█▉ | 7151/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.51.up_proj: 20%|█▉ | 7152/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.51.down_proj: 20%|█▉ | 7153/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.52.gate_proj: 20%|█▉ | 7154/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.52.up_proj: 20%|█▉ | 7155/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.52.down_proj: 20%|█▉ | 7156/36566 [00:07<00:25, 1151.74it/s] packing model.layers.17.mlp.experts.52.down_proj: 20%|█▉ | 7157/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.53.gate_proj: 20%|█▉ | 7157/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.53.up_proj: 20%|█▉ | 7158/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.53.down_proj: 20%|█▉ | 7159/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.54.gate_proj: 20%|█▉ | 7160/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.54.up_proj: 20%|█▉ | 7161/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.54.down_proj: 20%|█▉ | 7162/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.55.gate_proj: 20%|█▉ | 7163/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.55.up_proj: 20%|█▉ | 7164/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.55.down_proj: 20%|█▉ | 7165/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.56.gate_proj: 20%|█▉ | 7166/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.56.up_proj: 20%|█▉ | 7167/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.56.down_proj: 20%|█▉ | 7168/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.57.gate_proj: 20%|█▉ | 7169/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.57.up_proj: 20%|█▉ | 7170/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.57.down_proj: 20%|█▉ | 7171/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.58.gate_proj: 20%|█▉ | 7172/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.58.up_proj: 20%|█▉ | 7173/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.58.down_proj: 20%|█▉ | 7174/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.59.gate_proj: 20%|█▉ | 7175/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.59.up_proj: 20%|█▉ | 7176/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.59.down_proj: 20%|█▉ | 7177/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.60.gate_proj: 20%|█▉ | 7178/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.60.up_proj: 20%|█▉ | 7179/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.60.down_proj: 20%|█▉ | 7180/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.61.gate_proj: 20%|█▉ | 7181/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.61.up_proj: 20%|█▉ | 7182/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.61.down_proj: 20%|█▉ | 7183/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.62.gate_proj: 20%|█▉ | 7184/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.62.up_proj: 20%|█▉ | 7185/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.62.down_proj: 20%|█▉ | 7186/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.63.gate_proj: 20%|█▉ | 7187/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.63.up_proj: 20%|█▉ | 7188/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.63.down_proj: 20%|█▉ | 7189/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.64.gate_proj: 20%|█▉ | 7190/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.64.up_proj: 20%|█▉ | 7191/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.64.down_proj: 20%|█▉ | 7192/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.65.gate_proj: 20%|█▉ | 7193/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.65.up_proj: 20%|█▉ | 7194/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.65.down_proj: 20%|█▉ | 7195/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.66.gate_proj: 20%|█▉ | 7196/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.66.up_proj: 20%|█▉ | 7197/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.66.down_proj: 20%|█▉ | 7198/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.67.gate_proj: 20%|█▉ | 7199/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.67.up_proj: 20%|█▉ | 7200/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.67.down_proj: 20%|█▉ | 7201/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.68.gate_proj: 20%|█▉ | 7202/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.68.up_proj: 20%|█▉ | 7203/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.68.down_proj: 20%|█▉ | 7204/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.69.gate_proj: 20%|█▉ | 7205/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.69.up_proj: 20%|█▉ | 7206/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.69.down_proj: 20%|█▉ | 7207/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.70.gate_proj: 20%|█▉ | 7208/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.70.up_proj: 20%|█▉ | 7209/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.70.down_proj: 20%|█▉ | 7210/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.71.gate_proj: 20%|█▉ | 7211/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.71.up_proj: 20%|█▉ | 7212/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.71.down_proj: 20%|█▉ | 7213/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.72.gate_proj: 20%|█▉ | 7214/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.72.up_proj: 20%|█▉ | 7215/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.72.down_proj: 20%|█▉ | 7216/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.73.gate_proj: 20%|█▉ | 7217/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.73.up_proj: 20%|█▉ | 7218/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.73.down_proj: 20%|█▉ | 7219/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.74.gate_proj: 20%|█▉ | 7220/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.74.up_proj: 20%|█▉ | 7221/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.74.down_proj: 20%|█▉ | 7222/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.75.gate_proj: 20%|█▉ | 7223/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.75.up_proj: 20%|█▉ | 7224/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.75.down_proj: 20%|█▉ | 7225/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.76.gate_proj: 20%|█▉ | 7226/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.76.up_proj: 20%|█▉ | 7227/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.76.down_proj: 20%|█▉ | 7228/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.77.gate_proj: 20%|█▉ | 7229/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.77.up_proj: 20%|█▉ | 7230/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.77.down_proj: 20%|█▉ | 7231/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.78.gate_proj: 20%|█▉ | 7232/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.78.up_proj: 20%|█▉ | 7233/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.78.down_proj: 20%|█▉ | 7234/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.79.gate_proj: 20%|█▉ | 7235/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.79.up_proj: 20%|█▉ | 7236/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.79.down_proj: 20%|█▉ | 7237/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.80.gate_proj: 20%|█▉ | 7238/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.80.up_proj: 20%|█▉ | 7239/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.80.down_proj: 20%|█▉ | 7240/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.81.gate_proj: 20%|█▉ | 7241/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.81.up_proj: 20%|█▉ | 7242/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.81.down_proj: 20%|█▉ | 7243/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.82.gate_proj: 20%|█▉ | 7244/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.82.up_proj: 20%|█▉ | 7245/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.82.down_proj: 20%|█▉ | 7246/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.83.gate_proj: 20%|█▉ | 7247/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.83.up_proj: 20%|█▉ | 7248/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.83.down_proj: 20%|█▉ | 7249/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.84.gate_proj: 20%|█▉ | 7250/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.84.up_proj: 20%|█▉ | 7251/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.84.down_proj: 20%|█▉ | 7252/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.85.gate_proj: 20%|█▉ | 7253/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.85.up_proj: 20%|█▉ | 7254/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.85.down_proj: 20%|█▉ | 7255/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.86.gate_proj: 20%|█▉ | 7256/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.86.up_proj: 20%|█▉ | 7257/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.86.down_proj: 20%|█▉ | 7258/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.87.gate_proj: 20%|█▉ | 7259/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.87.up_proj: 20%|█▉ | 7260/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.87.down_proj: 20%|█▉ | 7261/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.88.gate_proj: 20%|█▉ | 7262/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.88.up_proj: 20%|█▉ | 7263/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.88.down_proj: 20%|█▉ | 7264/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.89.gate_proj: 20%|█▉ | 7265/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.89.up_proj: 20%|█▉ | 7266/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.89.down_proj: 20%|█▉ | 7267/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.90.gate_proj: 20%|█▉ | 7268/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.90.up_proj: 20%|█▉ | 7269/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.90.down_proj: 20%|█▉ | 7270/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.91.gate_proj: 20%|█▉ | 7271/36566 [00:07<00:25, 1149.88it/s] packing model.layers.17.mlp.experts.91.gate_proj: 20%|█▉ | 7272/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.91.up_proj: 20%|█▉ | 7272/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.91.down_proj: 20%|█▉ | 7273/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.92.gate_proj: 20%|█▉ | 7274/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.92.up_proj: 20%|█▉ | 7275/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.92.down_proj: 20%|█▉ | 7276/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.93.gate_proj: 20%|█▉ | 7277/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.93.up_proj: 20%|█▉ | 7278/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.93.down_proj: 20%|█▉ | 7279/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.94.gate_proj: 20%|█▉ | 7280/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.94.up_proj: 20%|█▉ | 7281/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.94.down_proj: 20%|█▉ | 7282/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.95.gate_proj: 20%|█▉ | 7283/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.95.up_proj: 20%|█▉ | 7284/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.95.down_proj: 20%|█▉ | 7285/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.96.gate_proj: 20%|█▉ | 7286/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.96.up_proj: 20%|█▉ | 7287/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.96.down_proj: 20%|█▉ | 7288/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.97.gate_proj: 20%|█▉ | 7289/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.97.up_proj: 20%|█▉ | 7290/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.97.down_proj: 20%|█▉ | 7291/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.98.gate_proj: 20%|█▉ | 7292/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.98.up_proj: 20%|█▉ | 7293/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.98.down_proj: 20%|█▉ | 7294/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.99.gate_proj: 20%|█▉ | 7295/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.99.up_proj: 20%|█▉ | 7296/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.99.down_proj: 20%|█▉ | 7297/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.100.gate_proj: 20%|█▉ | 7298/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.100.up_proj: 20%|█▉ | 7299/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.100.down_proj: 20%|█▉ | 7300/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.101.gate_proj: 20%|█▉ | 7301/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.101.up_proj: 20%|█▉ | 7302/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.101.down_proj: 20%|█▉ | 7303/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.102.gate_proj: 20%|█▉ | 7304/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.102.up_proj: 20%|█▉ | 7305/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.102.down_proj: 20%|█▉ | 7306/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.103.gate_proj: 20%|█▉ | 7307/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.103.up_proj: 20%|█▉ | 7308/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.103.down_proj: 20%|█▉ | 7309/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.104.gate_proj: 20%|█▉ | 7310/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.104.up_proj: 20%|█▉ | 7311/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.104.down_proj: 20%|█▉ | 7312/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.105.gate_proj: 20%|█▉ | 7313/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.105.up_proj: 20%|██ | 7314/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.105.down_proj: 20%|██ | 7315/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.106.gate_proj: 20%|██ | 7316/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.106.up_proj: 20%|██ | 7317/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.106.down_proj: 20%|██ | 7318/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.107.gate_proj: 20%|██ | 7319/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.107.up_proj: 20%|██ | 7320/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.107.down_proj: 20%|██ | 7321/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.108.gate_proj: 20%|██ | 7322/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.108.up_proj: 20%|██ | 7323/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.108.down_proj: 20%|██ | 7324/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.109.gate_proj: 20%|██ | 7325/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.109.up_proj: 20%|██ | 7326/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.109.down_proj: 20%|██ | 7327/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.110.gate_proj: 20%|██ | 7328/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.110.up_proj: 20%|██ | 7329/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.110.down_proj: 20%|██ | 7330/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.111.gate_proj: 20%|██ | 7331/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.111.up_proj: 20%|██ | 7332/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.111.down_proj: 20%|██ | 7333/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.112.gate_proj: 20%|██ | 7334/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.112.up_proj: 20%|██ | 7335/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.112.down_proj: 20%|██ | 7336/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.113.gate_proj: 20%|██ | 7337/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.113.up_proj: 20%|██ | 7338/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.113.down_proj: 20%|██ | 7339/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.114.gate_proj: 20%|██ | 7340/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.114.up_proj: 20%|██ | 7341/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.114.down_proj: 20%|██ | 7342/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.115.gate_proj: 20%|██ | 7343/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.115.up_proj: 20%|██ | 7344/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.115.down_proj: 20%|██ | 7345/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.116.gate_proj: 20%|██ | 7346/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.116.up_proj: 20%|██ | 7347/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.116.down_proj: 20%|██ | 7348/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.117.gate_proj: 20%|██ | 7349/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.117.up_proj: 20%|██ | 7350/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.117.down_proj: 20%|██ | 7351/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.118.gate_proj: 20%|██ | 7352/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.118.up_proj: 20%|██ | 7353/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.118.down_proj: 20%|██ | 7354/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.119.gate_proj: 20%|██ | 7355/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.119.up_proj: 20%|██ | 7356/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.119.down_proj: 20%|██ | 7357/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.120.gate_proj: 20%|██ | 7358/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.120.up_proj: 20%|██ | 7359/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.120.down_proj: 20%|██ | 7360/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.121.gate_proj: 20%|██ | 7361/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.121.up_proj: 20%|██ | 7362/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.121.down_proj: 20%|██ | 7363/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.122.gate_proj: 20%|██ | 7364/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.122.up_proj: 20%|██ | 7365/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.122.down_proj: 20%|██ | 7366/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.123.gate_proj: 20%|██ | 7367/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.123.up_proj: 20%|██ | 7368/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.123.down_proj: 20%|██ | 7369/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.124.gate_proj: 20%|██ | 7370/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.124.up_proj: 20%|██ | 7371/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.124.down_proj: 20%|██ | 7372/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.125.gate_proj: 20%|██ | 7373/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.125.up_proj: 20%|██ | 7374/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.125.down_proj: 20%|██ | 7375/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.126.gate_proj: 20%|██ | 7376/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.126.up_proj: 20%|██ | 7377/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.126.down_proj: 20%|██ | 7378/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.127.gate_proj: 20%|██ | 7379/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.127.up_proj: 20%|██ | 7380/36566 [00:07<00:25, 1148.65it/s] packing model.layers.17.mlp.experts.127.down_proj: 20%|██ | 7381/36566 [00:07<00:25, 1148.65it/s] packing model.layers.18.mlp.experts.0.gate_proj: 20%|██ | 7382/36566 [00:07<00:25, 1148.65it/s] packing model.layers.18.mlp.experts.0.up_proj: 20%|██ | 7383/36566 [00:07<00:25, 1148.65it/s] packing model.layers.18.mlp.experts.0.down_proj: 20%|██ | 7384/36566 [00:07<00:25, 1148.65it/s] packing model.layers.18.mlp.experts.1.gate_proj: 20%|██ | 7385/36566 [00:07<00:25, 1148.65it/s] packing model.layers.18.mlp.experts.1.up_proj: 20%|██ | 7386/36566 [00:07<00:25, 1148.65it/s] packing model.layers.18.mlp.experts.1.up_proj: 20%|██ | 7387/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.1.down_proj: 20%|██ | 7387/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.2.gate_proj: 20%|██ | 7388/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.2.up_proj: 20%|██ | 7389/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.2.down_proj: 20%|██ | 7390/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.3.gate_proj: 20%|██ | 7391/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.3.up_proj: 20%|██ | 7392/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.3.down_proj: 20%|██ | 7393/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.4.gate_proj: 20%|██ | 7394/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.4.up_proj: 20%|██ | 7395/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.4.down_proj: 20%|██ | 7396/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.5.gate_proj: 20%|██ | 7397/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.5.up_proj: 20%|██ | 7398/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.5.down_proj: 20%|██ | 7399/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.6.gate_proj: 20%|██ | 7400/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.6.up_proj: 20%|██ | 7401/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.6.down_proj: 20%|██ | 7402/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.7.gate_proj: 20%|██ | 7403/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.7.up_proj: 20%|██ | 7404/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.7.down_proj: 20%|██ | 7405/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.8.gate_proj: 20%|██ | 7406/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.8.up_proj: 20%|██ | 7407/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.8.down_proj: 20%|██ | 7408/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.9.gate_proj: 20%|██ | 7409/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.9.up_proj: 20%|██ | 7410/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.9.down_proj: 20%|██ | 7411/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.10.gate_proj: 20%|██ | 7412/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.10.up_proj: 20%|██ | 7413/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.10.down_proj: 20%|██ | 7414/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.11.gate_proj: 20%|██ | 7415/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.11.up_proj: 20%|██ | 7416/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.11.down_proj: 20%|██ | 7417/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.12.gate_proj: 20%|██ | 7418/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.12.up_proj: 20%|██ | 7419/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.12.down_proj: 20%|██ | 7420/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.13.gate_proj: 20%|██ | 7421/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.13.up_proj: 20%|██ | 7422/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.13.down_proj: 20%|██ | 7423/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.14.gate_proj: 20%|██ | 7424/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.14.up_proj: 20%|██ | 7425/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.14.down_proj: 20%|██ | 7426/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.15.gate_proj: 20%|██ | 7427/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.15.up_proj: 20%|██ | 7428/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.15.down_proj: 20%|██ | 7429/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.16.gate_proj: 20%|██ | 7430/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.16.up_proj: 20%|██ | 7431/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.16.down_proj: 20%|██ | 7432/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.17.gate_proj: 20%|██ | 7433/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.17.up_proj: 20%|██ | 7434/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.17.down_proj: 20%|██ | 7435/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.18.gate_proj: 20%|██ | 7436/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.18.up_proj: 20%|██ | 7437/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.18.down_proj: 20%|██ | 7438/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.19.gate_proj: 20%|██ | 7439/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.19.up_proj: 20%|██ | 7440/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.19.down_proj: 20%|██ | 7441/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.20.gate_proj: 20%|██ | 7442/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.20.up_proj: 20%|██ | 7443/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.20.down_proj: 20%|██ | 7444/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.21.gate_proj: 20%|██ | 7445/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.21.up_proj: 20%|██ | 7446/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.21.down_proj: 20%|██ | 7447/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.22.gate_proj: 20%|██ | 7448/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.22.up_proj: 20%|██ | 7449/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.22.down_proj: 20%|██ | 7450/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.23.gate_proj: 20%|██ | 7451/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.23.up_proj: 20%|██ | 7452/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.23.down_proj: 20%|██ | 7453/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.24.gate_proj: 20%|██ | 7454/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.24.up_proj: 20%|██ | 7455/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.24.down_proj: 20%|██ | 7456/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.25.gate_proj: 20%|██ | 7457/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.25.up_proj: 20%|██ | 7458/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.25.down_proj: 20%|██ | 7459/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.26.gate_proj: 20%|██ | 7460/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.26.up_proj: 20%|██ | 7461/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.26.down_proj: 20%|██ | 7462/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.27.gate_proj: 20%|██ | 7463/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.27.up_proj: 20%|██ | 7464/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.27.down_proj: 20%|██ | 7465/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.28.gate_proj: 20%|██ | 7466/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.28.up_proj: 20%|██ | 7467/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.28.down_proj: 20%|██ | 7468/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.29.gate_proj: 20%|██ | 7469/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.29.up_proj: 20%|██ | 7470/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.29.down_proj: 20%|██ | 7471/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.30.gate_proj: 20%|██ | 7472/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.30.up_proj: 20%|██ | 7473/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.30.down_proj: 20%|██ | 7474/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.31.gate_proj: 20%|██ | 7475/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.31.up_proj: 20%|██ | 7476/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.31.down_proj: 20%|██ | 7477/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.32.gate_proj: 20%|██ | 7478/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.32.up_proj: 20%|██ | 7479/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.32.down_proj: 20%|██ | 7480/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.33.gate_proj: 20%|██ | 7481/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.33.up_proj: 20%|██ | 7482/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.33.down_proj: 20%|██ | 7483/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.34.gate_proj: 20%|██ | 7484/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.34.up_proj: 20%|██ | 7485/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.34.down_proj: 20%|██ | 7486/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.35.gate_proj: 20%|██ | 7487/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.35.up_proj: 20%|██ | 7488/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.35.down_proj: 20%|██ | 7489/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.36.gate_proj: 20%|██ | 7490/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.36.up_proj: 20%|██ | 7491/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.36.down_proj: 20%|██ | 7492/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.37.gate_proj: 20%|██ | 7493/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.37.up_proj: 20%|██ | 7494/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.37.down_proj: 20%|██ | 7495/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.38.gate_proj: 20%|██ | 7496/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.38.up_proj: 21%|██ | 7497/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.38.down_proj: 21%|██ | 7498/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.39.gate_proj: 21%|██ | 7499/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.39.up_proj: 21%|██ | 7500/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.39.down_proj: 21%|██ | 7501/36566 [00:07<00:25, 1145.81it/s] packing model.layers.18.mlp.experts.39.down_proj: 21%|██ | 7502/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.40.gate_proj: 21%|██ | 7502/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.40.up_proj: 21%|██ | 7503/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.40.down_proj: 21%|██ | 7504/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.41.gate_proj: 21%|██ | 7505/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.41.up_proj: 21%|██ | 7506/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.41.down_proj: 21%|██ | 7507/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.42.gate_proj: 21%|██ | 7508/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.42.up_proj: 21%|██ | 7509/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.42.down_proj: 21%|██ | 7510/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.43.gate_proj: 21%|██ | 7511/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.43.up_proj: 21%|██ | 7512/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.43.down_proj: 21%|██ | 7513/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.44.gate_proj: 21%|██ | 7514/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.44.up_proj: 21%|██ | 7515/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.44.down_proj: 21%|██ | 7516/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.45.gate_proj: 21%|██ | 7517/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.45.up_proj: 21%|██ | 7518/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.45.down_proj: 21%|██ | 7519/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.46.gate_proj: 21%|██ | 7520/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.46.up_proj: 21%|██ | 7521/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.46.down_proj: 21%|██ | 7522/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.47.gate_proj: 21%|██ | 7523/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.47.up_proj: 21%|██ | 7524/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.47.down_proj: 21%|██ | 7525/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.48.gate_proj: 21%|██ | 7526/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.48.up_proj: 21%|██ | 7527/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.48.down_proj: 21%|██ | 7528/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.49.gate_proj: 21%|██ | 7529/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.49.up_proj: 21%|██ | 7530/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.49.down_proj: 21%|██ | 7531/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.50.gate_proj: 21%|██ | 7532/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.50.up_proj: 21%|██ | 7533/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.50.down_proj: 21%|██ | 7534/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.51.gate_proj: 21%|██ | 7535/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.51.up_proj: 21%|██ | 7536/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.51.down_proj: 21%|██ | 7537/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.52.gate_proj: 21%|██ | 7538/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.52.up_proj: 21%|██ | 7539/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.52.down_proj: 21%|██ | 7540/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.53.gate_proj: 21%|██ | 7541/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.53.up_proj: 21%|██ | 7542/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.53.down_proj: 21%|██ | 7543/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.54.gate_proj: 21%|██ | 7544/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.54.up_proj: 21%|██ | 7545/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.54.down_proj: 21%|██ | 7546/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.55.gate_proj: 21%|██ | 7547/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.55.up_proj: 21%|██ | 7548/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.55.down_proj: 21%|██ | 7549/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.56.gate_proj: 21%|██ | 7550/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.56.up_proj: 21%|██ | 7551/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.56.down_proj: 21%|██ | 7552/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.57.gate_proj: 21%|██ | 7553/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.57.up_proj: 21%|██ | 7554/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.57.down_proj: 21%|██ | 7555/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.58.gate_proj: 21%|██ | 7556/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.58.up_proj: 21%|██ | 7557/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.58.down_proj: 21%|██ | 7558/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.59.gate_proj: 21%|██ | 7559/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.59.up_proj: 21%|██ | 7560/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.59.down_proj: 21%|██ | 7561/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.60.gate_proj: 21%|██ | 7562/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.60.up_proj: 21%|██ | 7563/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.60.down_proj: 21%|██ | 7564/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.61.gate_proj: 21%|██ | 7565/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.61.up_proj: 21%|██ | 7566/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.61.down_proj: 21%|██ | 7567/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.62.gate_proj: 21%|██ | 7568/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.62.up_proj: 21%|██ | 7569/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.62.down_proj: 21%|██ | 7570/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.63.gate_proj: 21%|██ | 7571/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.63.up_proj: 21%|██ | 7572/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.63.down_proj: 21%|██ | 7573/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.64.gate_proj: 21%|██ | 7574/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.64.up_proj: 21%|██ | 7575/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.64.down_proj: 21%|██ | 7576/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.65.gate_proj: 21%|██ | 7577/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.65.up_proj: 21%|██ | 7578/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.65.down_proj: 21%|██ | 7579/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.66.gate_proj: 21%|██ | 7580/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.66.up_proj: 21%|██ | 7581/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.66.down_proj: 21%|██ | 7582/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.67.gate_proj: 21%|██ | 7583/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.67.up_proj: 21%|██ | 7584/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.67.down_proj: 21%|██ | 7585/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.68.gate_proj: 21%|██ | 7586/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.68.up_proj: 21%|██ | 7587/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.68.down_proj: 21%|██ | 7588/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.69.gate_proj: 21%|██ | 7589/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.69.up_proj: 21%|██ | 7590/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.69.down_proj: 21%|██ | 7591/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.70.gate_proj: 21%|██ | 7592/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.70.up_proj: 21%|██ | 7593/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.70.down_proj: 21%|██ | 7594/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.71.gate_proj: 21%|██ | 7595/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.71.up_proj: 21%|██ | 7596/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.71.down_proj: 21%|██ | 7597/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.72.gate_proj: 21%|██ | 7598/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.72.up_proj: 21%|██ | 7599/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.72.down_proj: 21%|██ | 7600/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.73.gate_proj: 21%|██ | 7601/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.73.up_proj: 21%|██ | 7602/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.73.down_proj: 21%|██ | 7603/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.74.gate_proj: 21%|██ | 7604/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.74.up_proj: 21%|██ | 7605/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.74.down_proj: 21%|██ | 7606/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.75.gate_proj: 21%|██ | 7607/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.75.up_proj: 21%|██ | 7608/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.75.down_proj: 21%|██ | 7609/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.76.gate_proj: 21%|██ | 7610/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.76.up_proj: 21%|██ | 7611/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.76.down_proj: 21%|██ | 7612/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.77.gate_proj: 21%|██ | 7613/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.77.up_proj: 21%|██ | 7614/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.77.down_proj: 21%|██ | 7615/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.78.gate_proj: 21%|██ | 7616/36566 [00:07<00:25, 1144.21it/s] packing model.layers.18.mlp.experts.78.gate_proj: 21%|██ | 7617/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.78.up_proj: 21%|██ | 7617/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.78.down_proj: 21%|██ | 7618/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.79.gate_proj: 21%|██ | 7619/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.79.up_proj: 21%|██ | 7620/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.79.down_proj: 21%|██ | 7621/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.80.gate_proj: 21%|██ | 7622/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.80.up_proj: 21%|██ | 7623/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.80.down_proj: 21%|██ | 7624/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.81.gate_proj: 21%|██ | 7625/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.81.up_proj: 21%|██ | 7626/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.81.down_proj: 21%|██ | 7627/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.82.gate_proj: 21%|██ | 7628/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.82.up_proj: 21%|██ | 7629/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.82.down_proj: 21%|██ | 7630/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.83.gate_proj: 21%|██ | 7631/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.83.up_proj: 21%|██ | 7632/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.83.down_proj: 21%|██ | 7633/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.84.gate_proj: 21%|██ | 7634/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.84.up_proj: 21%|██ | 7635/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.84.down_proj: 21%|██ | 7636/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.85.gate_proj: 21%|██ | 7637/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.85.up_proj: 21%|██ | 7638/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.85.down_proj: 21%|██ | 7639/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.86.gate_proj: 21%|██ | 7640/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.86.up_proj: 21%|██ | 7641/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.86.down_proj: 21%|██ | 7642/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.87.gate_proj: 21%|██ | 7643/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.87.up_proj: 21%|██ | 7644/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.87.down_proj: 21%|██ | 7645/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.88.gate_proj: 21%|██ | 7646/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.88.up_proj: 21%|██ | 7647/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.88.down_proj: 21%|██ | 7648/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.89.gate_proj: 21%|██ | 7649/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.89.up_proj: 21%|██ | 7650/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.89.down_proj: 21%|██ | 7651/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.90.gate_proj: 21%|██ | 7652/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.90.up_proj: 21%|██ | 7653/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.90.down_proj: 21%|██ | 7654/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.91.gate_proj: 21%|██ | 7655/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.91.up_proj: 21%|██ | 7656/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.91.down_proj: 21%|██ | 7657/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.92.gate_proj: 21%|██ | 7658/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.92.up_proj: 21%|██ | 7659/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.92.down_proj: 21%|██ | 7660/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.93.gate_proj: 21%|██ | 7661/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.93.up_proj: 21%|██ | 7662/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.93.down_proj: 21%|██ | 7663/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.94.gate_proj: 21%|██ | 7664/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.94.up_proj: 21%|██ | 7665/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.94.down_proj: 21%|██ | 7666/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.95.gate_proj: 21%|██ | 7667/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.95.up_proj: 21%|██ | 7668/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.95.down_proj: 21%|██ | 7669/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.96.gate_proj: 21%|██ | 7670/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.96.up_proj: 21%|██ | 7671/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.96.down_proj: 21%|██ | 7672/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.97.gate_proj: 21%|██ | 7673/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.97.up_proj: 21%|██ | 7674/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.97.down_proj: 21%|██ | 7675/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.98.gate_proj: 21%|██ | 7676/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.98.up_proj: 21%|██ | 7677/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.98.down_proj: 21%|██ | 7678/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.99.gate_proj: 21%|██ | 7679/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.99.up_proj: 21%|██ | 7680/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.99.down_proj: 21%|██ | 7681/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.100.gate_proj: 21%|██ | 7682/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.100.up_proj: 21%|██ | 7683/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.100.down_proj: 21%|██ | 7684/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.101.gate_proj: 21%|██ | 7685/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.101.up_proj: 21%|██ | 7686/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.101.down_proj: 21%|██ | 7687/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.102.gate_proj: 21%|██ | 7688/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.102.up_proj: 21%|██ | 7689/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.102.down_proj: 21%|██ | 7690/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.103.gate_proj: 21%|██ | 7691/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.103.up_proj: 21%|██ | 7692/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.103.down_proj: 21%|██ | 7693/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.104.gate_proj: 21%|██ | 7694/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.104.up_proj: 21%|██ | 7695/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.104.down_proj: 21%|██ | 7696/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.105.gate_proj: 21%|██ | 7697/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.105.up_proj: 21%|██ | 7698/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.105.down_proj: 21%|██ | 7699/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.106.gate_proj: 21%|██ | 7700/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.106.up_proj: 21%|██ | 7701/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.106.down_proj: 21%|██ | 7702/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.107.gate_proj: 21%|██ | 7703/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.107.up_proj: 21%|██ | 7704/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.107.down_proj: 21%|██ | 7705/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.108.gate_proj: 21%|██ | 7706/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.108.up_proj: 21%|██ | 7707/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.108.down_proj: 21%|██ | 7708/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.109.gate_proj: 21%|██ | 7709/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.109.up_proj: 21%|██ | 7710/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.109.down_proj: 21%|██ | 7711/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.110.gate_proj: 21%|██ | 7712/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.110.up_proj: 21%|██ | 7713/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.110.down_proj: 21%|██ | 7714/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.111.gate_proj: 21%|██ | 7715/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.111.up_proj: 21%|██ | 7716/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.111.down_proj: 21%|██ | 7717/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.112.gate_proj: 21%|██ | 7718/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.112.up_proj: 21%|██ | 7719/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.112.down_proj: 21%|██ | 7720/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.113.gate_proj: 21%|██ | 7721/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.113.up_proj: 21%|██ | 7722/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.113.down_proj: 21%|██ | 7723/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.114.gate_proj: 21%|██ | 7724/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.114.up_proj: 21%|██ | 7725/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.114.down_proj: 21%|██ | 7726/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.115.gate_proj: 21%|██ | 7727/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.115.up_proj: 21%|██ | 7728/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.115.down_proj: 21%|██ | 7729/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.116.gate_proj: 21%|██ | 7730/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.116.up_proj: 21%|██ | 7731/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.116.down_proj: 21%|██ | 7732/36566 [00:07<00:25, 1145.89it/s] packing model.layers.18.mlp.experts.116.down_proj: 21%|██ | 7733/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.117.gate_proj: 21%|██ | 7733/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.117.up_proj: 21%|██ | 7734/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.117.down_proj: 21%|██ | 7735/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.118.gate_proj: 21%|██ | 7736/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.118.up_proj: 21%|██ | 7737/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.118.down_proj: 21%|██ | 7738/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.119.gate_proj: 21%|██ | 7739/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.119.up_proj: 21%|██ | 7740/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.119.down_proj: 21%|██ | 7741/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.120.gate_proj: 21%|██ | 7742/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.120.up_proj: 21%|██ | 7743/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.120.down_proj: 21%|██ | 7744/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.121.gate_proj: 21%|██ | 7745/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.121.up_proj: 21%|██ | 7746/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.121.down_proj: 21%|██ | 7747/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.122.gate_proj: 21%|██ | 7748/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.122.up_proj: 21%|██ | 7749/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.122.down_proj: 21%|██ | 7750/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.123.gate_proj: 21%|██ | 7751/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.123.up_proj: 21%|██ | 7752/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.123.down_proj: 21%|██ | 7753/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.124.gate_proj: 21%|██ | 7754/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.124.up_proj: 21%|██ | 7755/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.124.down_proj: 21%|██ | 7756/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.125.gate_proj: 21%|██ | 7757/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.125.up_proj: 21%|██ | 7758/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.125.down_proj: 21%|██ | 7759/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.126.gate_proj: 21%|██ | 7760/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.126.up_proj: 21%|██ | 7761/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.126.down_proj: 21%|██ | 7762/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.127.gate_proj: 21%|██ | 7763/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.127.up_proj: 21%|██ | 7764/36566 [00:07<00:25, 1147.81it/s] packing model.layers.18.mlp.experts.127.down_proj: 21%|██ | 7765/36566 [00:07<00:25, 1147.81it/s] packing model.layers.19.mlp.experts.0.gate_proj: 21%|██ | 7766/36566 [00:07<00:25, 1147.81it/s] packing model.layers.19.mlp.experts.0.up_proj: 21%|██ | 7767/36566 [00:07<00:25, 1147.81it/s] packing model.layers.19.mlp.experts.0.down_proj: 21%|██ | 7768/36566 [00:07<00:25, 1147.81it/s] packing model.layers.19.mlp.experts.1.gate_proj: 21%
qwen-qwen3-235b-a22b-i-47730-v23-uploader: 6.72it/s] packing model.layers.51.mlp.experts.69.up_proj: 55%|█████▌ | 20262/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.69.down_proj: 55%|█████▌ | 20263/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.70.gate_proj: 55%|█████▌ | 20264/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.70.up_proj: 55%|█████▌ | 20265/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.70.down_proj: 55%|█████▌ | 20266/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.71.gate_proj: 55%|█████▌ | 20267/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.71.up_proj: 55%|█████▌ | 20268/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.71.down_proj: 55%|█████▌ | 20269/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.72.gate_proj: 55%|█████▌ | 20270/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.72.up_proj: 55%|█████▌ | 20271/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.72.down_proj: 55%|█████▌ | 20272/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.73.gate_proj: 55%|█████▌ | 20273/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.73.up_proj: 55%|█████▌ | 20274/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.73.down_proj: 55%|█████▌ | 20275/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.74.gate_proj: 55%|█████▌ | 20276/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.74.up_proj: 55%|█████▌ | 20277/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.74.down_proj: 55%|█████▌ | 20278/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.75.gate_proj: 55%|█████▌ | 20279/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.75.up_proj: 55%|█████▌ | 20280/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.75.down_proj: 55%|█████▌ | 20281/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.76.gate_proj: 55%|█████▌ | 20282/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.76.up_proj: 55%|█████▌ | 20283/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.76.down_proj: 55%|█████▌ | 20284/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.77.gate_proj: 55%|█████▌ | 20285/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.77.up_proj: 55%|█████▌ | 20286/36566 [00:18<00:14, 1156.72it/s] packing model.layers.51.mlp.experts.77.up_proj: 55%|█████▌ | 20287/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.77.down_proj: 55%|█████▌ | 20287/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.78.gate_proj: 55%|█████▌ | 20288/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.78.up_proj: 55%|█████▌ | 20289/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.78.down_proj: 55%|█████▌ | 20290/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.79.gate_proj: 55%|█████▌ | 20291/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.79.up_proj: 55%|█████▌ | 20292/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.79.down_proj: 55%|█████▌ | 20293/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.80.gate_proj: 55%|█████▌ | 20294/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.80.up_proj: 56%|█████▌ | 20295/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.80.down_proj: 56%|█████▌ | 20296/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.81.gate_proj: 56%|█████▌ | 20297/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.81.up_proj: 56%|█████▌ | 20298/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.81.down_proj: 56%|█████▌ | 20299/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.82.gate_proj: 56%|█████▌ | 20300/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.82.up_proj: 56%|█████▌ | 20301/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.82.down_proj: 56%|█████▌ | 20302/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.83.gate_proj: 56%|█████▌ | 20303/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.83.up_proj: 56%|█████▌ | 20304/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.83.down_proj: 56%|█████▌ | 20305/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.84.gate_proj: 56%|█████▌ | 20306/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.84.up_proj: 56%|█████▌ | 20307/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.84.down_proj: 56%|█████▌ | 20308/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.85.gate_proj: 56%|█████▌ | 20309/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.85.up_proj: 56%|█████▌ | 20310/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.85.down_proj: 56%|█████▌ | 20311/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.86.gate_proj: 56%|█████▌ | 20312/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.86.up_proj: 56%|█████▌ | 20313/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.86.down_proj: 56%|█████▌ | 20314/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.87.gate_proj: 56%|█████▌ | 20315/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.87.up_proj: 56%|█████▌ | 20316/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.87.down_proj: 56%|█████▌ | 20317/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.88.gate_proj: 56%|█████▌ | 20318/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.88.up_proj: 56%|█████▌ | 20319/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.88.down_proj: 56%|█████▌ | 20320/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.89.gate_proj: 56%|█████▌ | 20321/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.89.up_proj: 56%|█████▌ | 20322/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.89.down_proj: 56%|█████▌ | 20323/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.90.gate_proj: 56%|█████▌ | 20324/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.90.up_proj: 56%|█████▌ | 20325/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.90.down_proj: 56%|█████▌ | 20326/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.91.gate_proj: 56%|█████▌ | 20327/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.91.up_proj: 56%|█████▌ | 20328/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.91.down_proj: 56%|█████▌ | 20329/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.92.gate_proj: 56%|█████▌ | 20330/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.92.up_proj: 56%|█████▌ | 20331/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.92.down_proj: 56%|█████▌ | 20332/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.93.gate_proj: 56%|█████▌ | 20333/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.93.up_proj: 56%|█████▌ | 20334/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.93.down_proj: 56%|█████▌ | 20335/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.94.gate_proj: 56%|█████▌ | 20336/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.94.up_proj: 56%|█████▌ | 20337/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.94.down_proj: 56%|█████▌ | 20338/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.95.gate_proj: 56%|█████▌ | 20339/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.95.up_proj: 56%|█████▌ | 20340/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.95.down_proj: 56%|█████▌ | 20341/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.96.gate_proj: 56%|█████▌ | 20342/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.96.up_proj: 56%|█████▌ | 20343/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.96.down_proj: 56%|█████▌ | 20344/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.97.gate_proj: 56%|█████▌ | 20345/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.97.up_proj: 56%|█████▌ | 20346/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.97.down_proj: 56%|█████▌ | 20347/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.98.gate_proj: 56%|█████▌ | 20348/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.98.up_proj: 56%|█████▌ | 20349/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.98.down_proj: 56%|█████▌ | 20350/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.99.gate_proj: 56%|█████▌ | 20351/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.99.up_proj: 56%|█████▌ | 20352/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.99.down_proj: 56%|█████▌ | 20353/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.100.gate_proj: 56%|█████▌ | 20354/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.100.up_proj: 56%|█████▌ | 20355/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.100.down_proj: 56%|█████▌ | 20356/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.101.gate_proj: 56%|█████▌ | 20357/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.101.up_proj: 56%|█████▌ | 20358/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.101.down_proj: 56%|█████▌ | 20359/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.102.gate_proj: 56%|█████▌ | 20360/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.102.up_proj: 56%|█████▌ | 20361/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.102.down_proj: 56%|█████▌ | 20362/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.103.gate_proj: 56%|█████▌ | 20363/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.103.up_proj: 56%|█████▌ | 20364/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.103.down_proj: 56%|█████▌ | 20365/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.104.gate_proj: 56%|█████▌ | 20366/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.104.up_proj: 56%|█████▌ | 20367/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.104.down_proj: 56%|█████▌ | 20368/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.105.gate_proj: 56%|█████▌ | 20369/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.105.up_proj: 56%|█████▌ | 20370/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.105.down_proj: 56%|█████▌ | 20371/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.106.gate_proj: 56%|█████▌ | 20372/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.106.up_proj: 56%|█████▌ | 20373/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.106.down_proj: 56%|█████▌ | 20374/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.107.gate_proj: 56%|█████▌ | 20375/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.107.up_proj: 56%|█████▌ | 20376/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.107.down_proj: 56%|█████▌ | 20377/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.108.gate_proj: 56%|█████▌ | 20378/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.108.up_proj: 56%|█████▌ | 20379/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.108.down_proj: 56%|█████▌ | 20380/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.109.gate_proj: 56%|█████▌ | 20381/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.109.up_proj: 56%|█████▌ | 20382/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.109.down_proj: 56%|█████▌ | 20383/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.110.gate_proj: 56%|█████▌ | 20384/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.110.up_proj: 56%|█████▌ | 20385/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.110.down_proj: 56%|█████▌ | 20386/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.111.gate_proj: 56%|█████▌ | 20387/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.111.up_proj: 56%|█████▌ | 20388/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.111.down_proj: 56%|█████▌ | 20389/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.112.gate_proj: 56%|█████▌ | 20390/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.112.up_proj: 56%|█████▌ | 20391/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.112.down_proj: 56%|█████▌ | 20392/36566 [00:18<00:14, 1155.23it/s] packing model.layers.51.mlp.experts.113.gate_proj: 56%|█████▌ | 20393/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.113.up_proj: 56%|█████▌ | 20394/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.113.down_proj: 56%|█████▌ | 20395/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.114.gate_proj: 56%|█████▌ | 20396/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.114.up_proj: 56%|█████▌ | 20397/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.114.down_proj: 56%|█████▌ | 20398/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.115.gate_proj: 56%|█████▌ | 20399/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.115.up_proj: 56%|█████▌ | 20400/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.115.down_proj: 56%|█████▌ | 20401/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.116.gate_proj: 56%|█████▌ | 20402/36566 [00:18<00:13, 1155.23it/s] packing model.layers.51.mlp.experts.116.gate_proj: 56%|█████▌ | 20403/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.116.up_proj: 56%|█████▌ | 20403/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.116.down_proj: 56%|█████▌ | 20404/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.117.gate_proj: 56%|█████▌ | 20405/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.117.up_proj: 56%|█████▌ | 20406/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.117.down_proj: 56%|█████▌ | 20407/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.118.gate_proj: 56%|█████▌ | 20408/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.118.up_proj: 56%|█████▌ | 20409/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.118.down_proj: 56%|█████▌ | 20410/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.119.gate_proj: 56%|█████▌ | 20411/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.119.up_proj: 56%|█████▌ | 20412/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.119.down_proj: 56%|█████▌ | 20413/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.120.gate_proj: 56%|█████▌ | 20414/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.120.up_proj: 56%|█████▌ | 20415/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.120.down_proj: 56%|█████▌ | 20416/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.121.gate_proj: 56%|█████▌ | 20417/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.121.up_proj: 56%|█████▌ | 20418/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.121.down_proj: 56%|█████▌ | 20419/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.122.gate_proj: 56%|█████▌ | 20420/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.122.up_proj: 56%|█████▌ | 20421/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.122.down_proj: 56%|█████▌ | 20422/36566 [00:18<00:14, 1153.08it/s] packing model.layers.51.mlp.experts.123.gate_proj: 56%|█████▌ | 20423/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.123.up_proj: 56%|█████▌ | 20424/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.123.down_proj: 56%|█████▌ | 20425/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.124.gate_proj: 56%|█████▌ | 20426/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.124.up_proj: 56%|█████▌ | 20427/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.124.down_proj: 56%|█████▌ | 20428/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.125.gate_proj: 56%|█████▌ | 20429/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.125.up_proj: 56%|█████▌ | 20430/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.125.down_proj: 56%|█████▌ | 20431/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.126.gate_proj: 56%|█████▌ | 20432/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.126.up_proj: 56%|█████▌ | 20433/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.126.down_proj: 56%|█████▌ | 20434/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.127.gate_proj: 56%|█████▌ | 20435/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.127.up_proj: 56%|█████▌ | 20436/36566 [00:18<00:13, 1153.08it/s] packing model.layers.51.mlp.experts.127.down_proj: 56%|█████▌ | 20437/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.0.gate_proj: 56%|█████▌ | 20438/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.0.up_proj: 56%|█████▌ | 20439/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.0.down_proj: 56%|█████▌ | 20440/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.1.gate_proj: 56%|█████▌ | 20441/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.1.up_proj: 56%|█████▌ | 20442/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.1.down_proj: 56%|█████▌ | 20443/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.2.gate_proj: 56%|█████▌ | 20444/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.2.up_proj: 56%|█████▌ | 20445/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.2.down_proj: 56%|█████▌ | 20446/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.3.gate_proj: 56%|█████▌ | 20447/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.3.up_proj: 56%|█████▌ | 20448/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.3.down_proj: 56%|█████▌ | 20449/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.4.gate_proj: 56%|█████▌ | 20450/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.4.up_proj: 56%|█████▌ | 20451/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.4.down_proj: 56%|█████▌ | 20452/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.5.gate_proj: 56%|█████▌ | 20453/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.5.up_proj: 56%|█████▌ | 20454/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.5.down_proj: 56%|█████▌ | 20455/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.6.gate_proj: 56%|█████▌ | 20456/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.6.up_proj: 56%|█████▌ | 20457/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.6.down_proj: 56%|█████▌ | 20458/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.7.gate_proj: 56%|█████▌ | 20459/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.7.up_proj: 56%|█████▌ | 20460/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.7.down_proj: 56%|█████▌ | 20461/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.8.gate_proj: 56%|█████▌ | 20462/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.8.up_proj: 56%|█████▌ | 20463/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.8.down_proj: 56%|█████▌ | 20464/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.9.gate_proj: 56%|█████▌ | 20465/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.9.up_proj: 56%|█████▌ | 20466/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.9.down_proj: 56%|█████▌ | 20467/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.10.gate_proj: 56%|█████▌ | 20468/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.10.up_proj: 56%|█████▌ | 20469/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.10.down_proj: 56%|█████▌ | 20470/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.11.gate_proj: 56%|█████▌ | 20471/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.11.up_proj: 56%|█████▌ | 20472/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.11.down_proj: 56%|█████▌ | 20473/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.12.gate_proj: 56%|█████▌ | 20474/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.12.up_proj: 56%|█████▌ | 20475/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.12.down_proj: 56%|█████▌ | 20476/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.13.gate_proj: 56%|█████▌ | 20477/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.13.up_proj: 56%|█████▌ | 20478/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.13.down_proj: 56%|█████▌ | 20479/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.14.gate_proj: 56%|█████▌ | 20480/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.14.up_proj: 56%|█████▌ | 20481/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.14.down_proj: 56%|█████▌ | 20482/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.15.gate_proj: 56%|█████▌ | 20483/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.15.up_proj: 56%|█████▌ | 20484/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.15.down_proj: 56%|█████▌ | 20485/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.16.gate_proj: 56%|█████▌ | 20486/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.16.up_proj: 56%|█████▌ | 20487/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.16.down_proj: 56%|█████▌ | 20488/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.17.gate_proj: 56%|█████▌ | 20489/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.17.up_proj: 56%|█████▌ | 20490/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.17.down_proj: 56%|█████▌ | 20491/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.18.gate_proj: 56%|█████▌ | 20492/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.18.up_proj: 56%|█████▌ | 20493/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.18.down_proj: 56%|█████▌ | 20494/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.19.gate_proj: 56%|█████▌ | 20495/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.19.up_proj: 56%|█████▌ | 20496/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.19.down_proj: 56%|█████▌ | 20497/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.20.gate_proj: 56%|█████▌ | 20498/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.20.up_proj: 56%|█████▌ | 20499/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.20.down_proj: 56%|█████▌ | 20500/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.21.gate_proj: 56%|█████▌ | 20501/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.21.up_proj: 56%|█████▌ | 20502/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.21.down_proj: 56%|█████▌ | 20503/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.22.gate_proj: 56%|█████▌ | 20504/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.22.up_proj: 56%|█████▌ | 20505/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.22.down_proj: 56%|█████▌ | 20506/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.23.gate_proj: 56%|█████▌ | 20507/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.23.up_proj: 56%|█████▌ | 20508/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.23.down_proj: 56%|█████▌ | 20509/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.24.gate_proj: 56%|█████▌ | 20510/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.24.up_proj: 56%|█████▌ | 20511/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.24.down_proj: 56%|█████▌ | 20512/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.25.gate_proj: 56%|█████▌ | 20513/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.25.up_proj: 56%|█████▌ | 20514/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.25.down_proj: 56%|█████▌ | 20515/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.26.gate_proj: 56%|█████▌ | 20516/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.26.up_proj: 56%|█████▌ | 20517/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.26.down_proj: 56%|█████▌ | 20518/36566 [00:18<00:13, 1153.08it/s] packing model.layers.52.mlp.experts.26.down_proj: 56%|█████▌ | 20519/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.27.gate_proj: 56%|█████▌ | 20519/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.27.up_proj: 56%|█████▌ | 20520/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.27.down_proj: 56%|█████▌ | 20521/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.28.gate_proj: 56%|█████▌ | 20522/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.28.up_proj: 56%|█████▌ | 20523/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.28.down_proj: 56%|█████▌ | 20524/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.29.gate_proj: 56%|█████▌ | 20525/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.29.up_proj: 56%|█████▌ | 20526/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.29.down_proj: 56%|█████▌ | 20527/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.30.gate_proj: 56%|█████▌ | 20528/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.30.up_proj: 56%|█████▌ | 20529/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.30.down_proj: 56%|█████▌ | 20530/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.31.gate_proj: 56%|█████▌ | 20531/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.31.up_proj: 56%|█████▌ | 20532/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.31.down_proj: 56%|█████▌ | 20533/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.32.gate_proj: 56%|█████▌ | 20534/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.32.up_proj: 56%|█████▌ | 20535/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.32.down_proj: 56%|█████▌ | 20536/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.33.gate_proj: 56%|█████▌ | 20537/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.33.up_proj: 56%|█████▌ | 20538/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.33.down_proj: 56%|█████▌ | 20539/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.34.gate_proj: 56%|█████▌ | 20540/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.34.up_proj: 56%|█████▌ | 20541/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.34.down_proj: 56%|█████▌ | 20542/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.35.gate_proj: 56%|█████▌ | 20543/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.35.up_proj: 56%|█████▌ | 20544/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.35.down_proj: 56%|█████▌ | 20545/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.36.gate_proj: 56%|█████▌ | 20546/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.36.up_proj: 56%|█████▌ | 20547/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.36.down_proj: 56%|█████▌ | 20548/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.37.gate_proj: 56%|█████▌ | 20549/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.37.up_proj: 56%|█████▌ | 20550/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.37.down_proj: 56%|█████▌ | 20551/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.38.gate_proj: 56%|█████▌ | 20552/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.38.up_proj: 56%|█████▌ | 20553/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.38.down_proj: 56%|█████▌ | 20554/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.39.gate_proj: 56%|█████▌ | 20555/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.39.up_proj: 56%|█████▌ | 20556/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.39.down_proj: 56%|█████▌ | 20557/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.40.gate_proj: 56%|█████▌ | 20558/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.40.up_proj: 56%|█████▌ | 20559/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.40.down_proj: 56%|█████▌ | 20560/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.41.gate_proj: 56%|█████▌ | 20561/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.41.up_proj: 56%|█████▌ | 20562/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.41.down_proj: 56%|█████▌ | 20563/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.42.gate_proj: 56%|█████▌ | 20564/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.42.up_proj: 56%|█████▌ | 20565/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.42.down_proj: 56%|█████▌ | 20566/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.43.gate_proj: 56%|█████▌ | 20567/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.43.up_proj: 56%|█████▌ | 20568/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.43.down_proj: 56%|█████▋ | 20569/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.44.gate_proj: 56%|█████▋ | 20570/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.44.up_proj: 56%|█████▋ | 20571/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.44.down_proj: 56%|█████▋ | 20572/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.45.gate_proj: 56%|█████▋ | 20573/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.45.up_proj: 56%|█████▋ | 20574/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.45.down_proj: 56%|█████▋ | 20575/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.46.gate_proj: 56%|█████▋ | 20576/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.46.up_proj: 56%|█████▋ | 20577/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.46.down_proj: 56%|█████▋ | 20578/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.47.gate_proj: 56%|█████▋ | 20579/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.47.up_proj: 56%|█████▋ | 20580/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.47.down_proj: 56%|█████▋ | 20581/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.48.gate_proj: 56%|█████▋ | 20582/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.48.up_proj: 56%|█████▋ | 20583/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.48.down_proj: 56%|█████▋ | 20584/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.49.gate_proj: 56%|█████▋ | 20585/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.49.up_proj: 56%|█████▋ | 20586/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.49.down_proj: 56%|█████▋ | 20587/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.50.gate_proj: 56%|█████▋ | 20588/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.50.up_proj: 56%|█████▋ | 20589/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.50.down_proj: 56%|█████▋ | 20590/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.51.gate_proj: 56%|█████▋ | 20591/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.51.up_proj: 56%|█████▋ | 20592/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.51.down_proj: 56%|█████▋ | 20593/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.52.gate_proj: 56%|█████▋ | 20594/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.52.up_proj: 56%|█████▋ | 20595/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.52.down_proj: 56%|█████▋ | 20596/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.53.gate_proj: 56%|█████▋ | 20597/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.53.up_proj: 56%|█████▋ | 20598/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.53.down_proj: 56%|█████▋ | 20599/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.54.gate_proj: 56%|█████▋ | 20600/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.54.up_proj: 56%|█████▋ | 20601/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.54.down_proj: 56%|█████▋ | 20602/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.55.gate_proj: 56%|█████▋ | 20603/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.55.up_proj: 56%|█████▋ | 20604/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.55.down_proj: 56%|█████▋ | 20605/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.56.gate_proj: 56%|█████▋ | 20606/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.56.up_proj: 56%|█████▋ | 20607/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.56.down_proj: 56%|█████▋ | 20608/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.57.gate_proj: 56%|█████▋ | 20609/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.57.up_proj: 56%|█████▋ | 20610/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.57.down_proj: 56%|█████▋ | 20611/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.58.gate_proj: 56%|█████▋ | 20612/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.58.up_proj: 56%|█████▋ | 20613/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.58.down_proj: 56%|█████▋ | 20614/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.59.gate_proj: 56%|█████▋ | 20615/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.59.up_proj: 56%|█████▋ | 20616/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.59.down_proj: 56%|█████▋ | 20617/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.60.gate_proj: 56%|█████▋ | 20618/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.60.up_proj: 56%|█████▋ | 20619/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.60.down_proj: 56%|█████▋ | 20620/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.61.gate_proj: 56%|█████▋ | 20621/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.61.up_proj: 56%|█████▋ | 20622/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.61.down_proj: 56%|█████▋ | 20623/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.62.gate_proj: 56%|█████▋ | 20624/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.62.up_proj: 56%|█████▋ | 20625/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.62.down_proj: 56%|█████▋ | 20626/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.63.gate_proj: 56%|█████▋ | 20627/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.63.up_proj: 56%|█████▋ | 20628/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.63.down_proj: 56%|█████▋ | 20629/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.64.gate_proj: 56%|█████▋ | 20630/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.64.up_proj: 56%|█████▋ | 20631/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.64.down_proj: 56%|█████▋ | 20632/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.65.gate_proj: 56%|█████▋ | 20633/36566 [00:18<00:13, 1149.17it/s] packing model.layers.52.mlp.experts.65.gate_proj: 56%|█████▋ | 20634/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.65.up_proj: 56%|█████▋ | 20634/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.65.down_proj: 56%|█████▋ | 20635/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.66.gate_proj: 56%|█████▋ | 20636/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.66.up_proj: 56%|█████▋ | 20637/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.66.down_proj: 56%|█████▋ | 20638/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.67.gate_proj: 56%|█████▋ | 20639/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.67.up_proj: 56%|█████▋ | 20640/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.67.down_proj: 56%|█████▋ | 20641/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.68.gate_proj: 56%|█████▋ | 20642/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.68.up_proj: 56%|█████▋ | 20643/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.68.down_proj: 56%|█████▋ | 20644/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.69.gate_proj: 56%|█████▋ | 20645/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.69.up_proj: 56%|█████▋ | 20646/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.69.down_proj: 56%|█████▋ | 20647/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.70.gate_proj: 56%|█████▋ | 20648/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.70.up_proj: 56%|█████▋ | 20649/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.70.down_proj: 56%|█████▋ | 20650/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.71.gate_proj: 56%|█████▋ | 20651/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.71.up_proj: 56%|█████▋ | 20652/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.71.down_proj: 56%|█████▋ | 20653/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.72.gate_proj: 56%|█████▋ | 20654/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.72.up_proj: 56%|█████▋ | 20655/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.72.down_proj: 56%|█████▋ | 20656/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.73.gate_proj: 56%|█████▋ | 20657/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.73.up_proj: 56%|█████▋ | 20658/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.73.down_proj: 56%|█████▋ | 20659/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.74.gate_proj: 57%|█████▋ | 20660/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.74.up_proj: 57%|█████▋ | 20661/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.74.down_proj: 57%|█████▋ | 20662/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.75.gate_proj: 57%|█████▋ | 20663/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.75.up_proj: 57%|█████▋ | 20664/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.75.down_proj: 57%|█████▋ | 20665/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.76.gate_proj: 57%|█████▋ | 20666/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.76.up_proj: 57%|█████▋ | 20667/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.76.down_proj: 57%|█████▋ | 20668/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.77.gate_proj: 57%|█████▋ | 20669/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.77.up_proj: 57%|█████▋ | 20670/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.77.down_proj: 57%|█████▋ | 20671/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.78.gate_proj: 57%|█████▋ | 20672/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.78.up_proj: 57%|█████▋ | 20673/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.78.down_proj: 57%|█████▋ | 20674/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.79.gate_proj: 57%|█████▋ | 20675/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.79.up_proj: 57%|█████▋ | 20676/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.79.down_proj: 57%|█████▋ | 20677/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.80.gate_proj: 57%|█████▋ | 20678/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.80.up_proj: 57%|█████▋ | 20679/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.80.down_proj: 57%|█████▋ | 20680/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.81.gate_proj: 57%|█████▋ | 20681/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.81.up_proj: 57%|█████▋ | 20682/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.81.down_proj: 57%|█████▋ | 20683/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.82.gate_proj: 57%|█████▋ | 20684/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.82.up_proj: 57%|█████▋ | 20685/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.82.down_proj: 57%|█████▋ | 20686/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.83.gate_proj: 57%|█████▋ | 20687/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.83.up_proj: 57%|█████▋ | 20688/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.83.down_proj: 57%|█████▋ | 20689/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.84.gate_proj: 57%|█████▋ | 20690/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.84.up_proj: 57%|█████▋ | 20691/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.84.down_proj: 57%|█████▋ | 20692/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.85.gate_proj: 57%|█████▋ | 20693/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.85.up_proj: 57%|█████▋ | 20694/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.85.down_proj: 57%|█████▋ | 20695/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.86.gate_proj: 57%|█████▋ | 20696/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.86.up_proj: 57%|█████▋ | 20697/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.86.down_proj: 57%|█████▋ | 20698/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.87.gate_proj: 57%|█████▋ | 20699/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.87.up_proj: 57%|█████▋ | 20700/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.87.down_proj: 57%|█████▋ | 20701/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.88.gate_proj: 57%|█████▋ | 20702/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.88.up_proj: 57%|█████▋ | 20703/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.88.down_proj: 57%|█████▋ | 20704/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.89.gate_proj: 57%|█████▋ | 20705/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.89.up_proj: 57%|█████▋ | 20706/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.89.down_proj: 57%|█████▋ | 20707/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.90.gate_proj: 57%|█████▋ | 20708/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.90.up_proj: 57%|█████▋ | 20709/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.90.down_proj: 57%|█████▋ | 20710/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.91.gate_proj: 57%|█████▋ | 20711/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.91.up_proj: 57%|█████▋ | 20712/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.91.down_proj: 57%|█████▋ | 20713/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.92.gate_proj: 57%|█████▋ | 20714/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.92.up_proj: 57%|█████▋ | 20715/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.92.down_proj: 57%|█████▋ | 20716/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.93.gate_proj: 57%|█████▋ | 20717/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.93.up_proj: 57%|█████▋ | 20718/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.93.down_proj: 57%|█████▋ | 20719/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.94.gate_proj: 57%|█████▋ | 20720/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.94.up_proj: 57%|█████▋ | 20721/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.94.down_proj: 57%|█████▋ | 20722/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.95.gate_proj: 57%|█████▋ | 20723/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.95.up_proj: 57%|█████▋ | 20724/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.95.down_proj: 57%|█████▋ | 20725/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.96.gate_proj: 57%|█████▋ | 20726/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.96.up_proj: 57%|█████▋ | 20727/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.96.down_proj: 57%|█████▋ | 20728/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.97.gate_proj: 57%|█████▋ | 20729/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.97.up_proj: 57%|█████▋ | 20730/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.97.down_proj: 57%|█████▋ | 20731/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.98.gate_proj: 57%|█████▋ | 20732/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.98.up_proj: 57%|█████▋ | 20733/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.98.down_proj: 57%|█████▋ | 20734/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.99.gate_proj: 57%|█████▋ | 20735/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.99.up_proj: 57%|█████▋ | 20736/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.99.down_proj: 57%|█████▋ | 20737/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.100.gate_proj: 57%|█████▋ | 20738/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.100.up_proj: 57%|█████▋ | 20739/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.100.down_proj: 57%|█████▋ | 20740/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.101.gate_proj: 57%|█████▋ | 20741/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.101.up_proj: 57%|█████▋ | 20742/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.101.down_proj: 57%|█████▋ | 20743/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.102.gate_proj: 57%|█████▋ | 20744/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.102.up_proj: 57%|█████▋ | 20745/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.102.down_proj: 57%|█████▋ | 20746/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.103.gate_proj: 57%|█████▋ | 20747/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.103.up_proj: 57%|█████▋ | 20748/36566 [00:18<00:13, 1147.53it/s] packing model.layers.52.mlp.experts.103.up_proj: 57%|█████▋ | 20749/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.103.down_proj: 57%|█████▋ | 20749/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.104.gate_proj: 57%|█████▋ | 20750/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.104.up_proj: 57%|█████▋ | 20751/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.104.down_proj: 57%|█████▋ | 20752/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.105.gate_proj: 57%|█████▋ | 20753/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.105.up_proj: 57%|█████▋ | 20754/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.105.down_proj: 57%|█████▋ | 20755/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.106.gate_proj: 57%|█████▋ | 20756/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.106.up_proj: 57%|█████▋ | 20757/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.106.down_proj: 57%|█████▋ | 20758/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.107.gate_proj: 57%|█████▋ | 20759/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.107.up_proj: 57%|█████▋ | 20760/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.107.down_proj: 57%|█████▋ | 20761/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.108.gate_proj: 57%|█████▋ | 20762/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.108.up_proj: 57%|█████▋ | 20763/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.108.down_proj: 57%|█████▋ | 20764/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.109.gate_proj: 57%|█████▋ | 20765/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.109.up_proj: 57%|█████▋ | 20766/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.109.down_proj: 57%|█████▋ | 20767/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.110.gate_proj: 57%|█████▋ | 20768/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.110.up_proj: 57%|█████▋ | 20769/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.110.down_proj: 57%|█████▋ | 20770/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.111.gate_proj: 57%|█████▋ | 20771/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.111.up_proj: 57%|█████▋ | 20772/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.111.down_proj: 57%|█████▋ | 20773/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.112.gate_proj: 57%|█████▋ | 20774/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.112.up_proj: 57%|█████▋ | 20775/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.112.down_proj: 57%|█████▋ | 20776/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.113.gate_proj: 57%|█████▋ | 20777/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.113.up_proj: 57%|█████▋ | 20778/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.113.down_proj: 57%|█████▋ | 20779/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.114.gate_proj: 57%|█████▋ | 20780/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.114.up_proj: 57%|█████▋ | 20781/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.114.down_proj: 57%|█████▋ | 20782/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.115.gate_proj: 57%|█████▋ | 20783/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.115.up_proj: 57%|█████▋ | 20784/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.115.down_proj: 57%|█████▋ | 20785/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.116.gate_proj: 57%|█████▋ | 20786/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.116.up_proj: 57%|█████▋ | 20787/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.116.down_proj: 57%|█████▋ | 20788/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.117.gate_proj: 57%|█████▋ | 20789/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.117.up_proj: 57%|█████▋ | 20790/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.117.down_proj: 57%|█████▋ | 20791/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.118.gate_proj: 57%|█████▋ | 20792/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.118.up_proj: 57%|█████▋ | 20793/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.118.down_proj: 57%|█████▋ | 20794/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.119.gate_proj: 57%|█████▋ | 20795/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.119.up_proj: 57%|█████▋ | 20796/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.119.down_proj: 57%|█████▋ | 20797/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.120.gate_proj: 57%|█████▋ | 20798/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.120.up_proj: 57%|█████▋ | 20799/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.120.down_proj: 57%|█████▋ | 20800/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.121.gate_proj: 57%|█████▋ | 20801/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.121.up_proj: 57%|█████▋ | 20802/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.121.down_proj: 57%|█████▋ | 20803/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.122.gate_proj: 57%|█████▋ | 20804/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.122.up_proj: 57%|█████▋ | 20805/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.122.down_proj: 57%|█████▋ | 20806/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.123.gate_proj: 57%|█████▋ | 20807/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.123.up_proj: 57%|█████▋ | 20808/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.123.down_proj: 57%|█████▋ | 20809/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.124.gate_proj: 57%|█████▋ | 20810/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.124.up_proj: 57%|█████▋ | 20811/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.124.down_proj: 57%|█████▋ | 20812/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.125.gate_proj: 57%|█████▋ | 20813/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.125.up_proj: 57%|█████▋ | 20814/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.125.down_proj: 57%|█████▋ | 20815/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.126.gate_proj: 57%|█████▋ | 20816/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.126.up_proj: 57%|█████▋ | 20817/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.126.down_proj: 57%|█████▋ | 20818/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.127.gate_proj: 57%|█████▋ | 20819/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.127.up_proj: 57%|█████▋ | 20820/36566 [00:18<00:13, 1145.85it/s] packing model.layers.52.mlp.experts.127.down_proj: 57%|█████▋ | 20821/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.0.gate_proj: 57%|█████▋ | 20822/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.0.up_proj: 57%|█████▋ | 20823/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.0.down_proj: 57%|█████▋ | 20824/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.1.gate_proj: 57%|█████▋ | 20825/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.1.up_proj: 57%|█████▋ | 20826/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.1.down_proj: 57%|█████▋ | 20827/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.2.gate_proj: 57%|█████▋ | 20828/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.2.up_proj: 57%|█████▋ | 20829/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.2.down_proj: 57%|█████▋ | 20830/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.3.gate_proj: 57%|█████▋ | 20831/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.3.up_proj: 57%|█████▋ | 20832/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.3.down_proj: 57%|█████▋ | 20833/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.4.gate_proj: 57%|█████▋ | 20834/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.4.up_proj: 57%|█████▋ | 20835/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.4.down_proj: 57%|█████▋ | 20836/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.5.gate_proj: 57%|█████▋ | 20837/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.5.up_proj: 57%|█████▋ | 20838/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.5.down_proj: 57%|█████▋ | 20839/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.6.gate_proj: 57%|█████▋ | 20840/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.6.up_proj: 57%|█████▋ | 20841/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.6.down_proj: 57%|█████▋ | 20842/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.7.gate_proj: 57%|█████▋ | 20843/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.7.up_proj: 57%|█████▋ | 20844/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.7.down_proj: 57%|█████▋ | 20845/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.8.gate_proj: 57%|█████▋ | 20846/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.8.up_proj: 57%|█████▋ | 20847/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.8.down_proj: 57%|█████▋ | 20848/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.9.gate_proj: 57%|█████▋ | 20849/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.9.up_proj: 57%|█████▋ | 20850/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.9.down_proj: 57%|█████▋ | 20851/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.10.gate_proj: 57%|█████▋ | 20852/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.10.up_proj: 57%|█████▋ | 20853/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.10.down_proj: 57%|█████▋ | 20854/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.11.gate_proj: 57%|█████▋ | 20855/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.11.up_proj: 57%|█████▋ | 20856/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.11.down_proj: 57%|█████▋ | 20857/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.12.gate_proj: 57%|█████▋ | 20858/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.12.up_proj: 57%|█████▋ | 20859/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.12.down_proj: 57%|█████▋ | 20860/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.13.gate_proj: 57%|█████▋ | 20861/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.13.up_proj: 57%|█████▋ | 20862/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.13.down_proj: 57%|█████▋ | 20863/36566 [00:18<00:13, 1145.85it/s] packing model.layers.53.mlp.experts.13.down_proj: 57%|█████▋ | 20864/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.14.gate_proj: 57%|█████▋ | 20864/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.14.up_proj: 57%|█████▋ | 20865/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.14.down_proj: 57%|█████▋ | 20866/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.15.gate_proj: 57%|█████▋ | 20867/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.15.up_proj: 57%|█████▋ | 20868/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.15.down_proj: 57%|█████▋ | 20869/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.16.gate_proj: 57%|█████▋ | 20870/36566 [00:18<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.16.up_proj: 57%|█████▋ | 20871/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.16.down_proj: 57%|█████▋ | 20872/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.17.gate_proj: 57%|█████▋ | 20873/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.17.up_proj: 57%|█████▋ | 20874/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.17.down_proj: 57%|█████▋ | 20875/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.18.gate_proj: 57%|█████▋ | 20876/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.18.up_proj: 57%|█████▋ | 20877/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.18.down_proj: 57%|█████▋ | 20878/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.19.gate_proj: 57%|█████▋ | 20879/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.19.up_proj: 57%|█████▋ | 20880/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.19.down_proj: 57%|█████▋ | 20881/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.20.gate_proj: 57%|█████▋ | 20882/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.20.up_proj: 57%|█████▋ | 20883/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.20.down_proj: 57%|█████▋ | 20884/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.21.gate_proj: 57%|█████▋ | 20885/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.21.up_proj: 57%|█████▋ | 20886/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.21.down_proj: 57%|█████▋ | 20887/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.22.gate_proj: 57%|█████▋ | 20888/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.22.up_proj: 57%|█████▋ | 20889/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.22.down_proj: 57%|█████▋ | 20890/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.23.gate_proj: 57%|█████▋ | 20891/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.23.up_proj: 57%|█████▋ | 20892/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.23.down_proj: 57%|█████▋ | 20893/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.24.gate_proj: 57%|█████▋ | 20894/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.24.up_proj: 57%|█████▋ | 20895/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.24.down_proj: 57%|█████▋ | 20896/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.25.gate_proj: 57%|█████▋ | 20897/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.25.up_proj: 57%|█████▋ | 20898/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.25.down_proj: 57%|█████▋ | 20899/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.26.gate_proj: 57%|█████▋ | 20900/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.26.up_proj: 57%|█████▋ | 20901/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.26.down_proj: 57%|█████▋ | 20902/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.27.gate_proj: 57%|█████▋ | 20903/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.27.up_proj: 57%|█████▋ | 20904/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.27.down_proj: 57%|█████▋ | 20905/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.28.gate_proj: 57%|█████▋ | 20906/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.28.up_proj: 57%|█████▋ | 20907/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.28.down_proj: 57%|█████▋ | 20908/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.29.gate_proj: 57%|█████▋ | 20909/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.29.up_proj: 57%|█████▋ | 20910/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.29.down_proj: 57%|█████▋ | 20911/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.30.gate_proj: 57%|█████▋ | 20912/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.30.up_proj: 57%|█████▋ | 20913/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.30.down_proj: 57%|█████▋ | 20914/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.31.gate_proj: 57%|█████▋ | 20915/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.31.up_proj: 57%|█████▋ | 20916/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.31.down_proj: 57%|█████▋ | 20917/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.32.gate_proj: 57%|█████▋ | 20918/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.32.up_proj: 57%|█████▋ | 20919/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.32.down_proj: 57%|█████▋ | 20920/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.33.gate_proj: 57%|█████▋ | 20921/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.33.up_proj: 57%|█████▋ | 20922/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.33.down_proj: 57%|█████▋ | 20923/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.34.gate_proj: 57%|█████▋ | 20924/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.34.up_proj: 57%|█████▋ | 20925/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.34.down_proj: 57%|█████▋ | 20926/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.35.gate_proj: 57%|█████▋ | 20927/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.35.up_proj: 57%|█████▋ | 20928/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.35.down_proj: 57%|█████▋ | 20929/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.36.gate_proj: 57%|█████▋ | 20930/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.36.up_proj: 57%|█████▋ | 20931/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.36.down_proj: 57%|█████▋ | 20932/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.37.gate_proj: 57%|█████▋ | 20933/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.37.up_proj: 57%|█████▋ | 20934/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.37.down_proj: 57%|█████▋ | 20935/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.38.gate_proj: 57%|█████▋ | 20936/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.38.up_proj: 57%|█████▋ | 20937/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.38.down_proj: 57%|█████▋ | 20938/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.39.gate_proj: 57%|█████▋ | 20939/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.39.up_proj: 57%|█████▋ | 20940/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.39.down_proj: 57%|█████▋ | 20941/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.40.gate_proj: 57%|█████▋ | 20942/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.40.up_proj: 57%|█████▋ | 20943/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.40.down_proj: 57%|█████▋ | 20944/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.41.gate_proj: 57%|█████▋ | 20945/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.41.up_proj: 57%|█████▋ | 20946/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.41.down_proj: 57%|█████▋ | 20947/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.42.gate_proj: 57%|█████▋ | 20948/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.42.up_proj: 57%|█████▋ | 20949/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.42.down_proj: 57%|█████▋ | 20950/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.43.gate_proj: 57%|█████▋ | 20951/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.43.up_proj: 57%|█████▋ | 20952/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.43.down_proj: 57%|█████▋ | 20953/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.44.gate_proj: 57%|█████▋ | 20954/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.44.up_proj: 57%|█████▋ | 20955/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.44.down_proj: 57%|█████▋ | 20956/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.45.gate_proj: 57%|█████▋ | 20957/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.45.up_proj: 57%|█████▋ | 20958/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.45.down_proj: 57%|█████▋ | 20959/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.46.gate_proj: 57%|█████▋ | 20960/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.46.up_proj: 57%|█████▋ | 20961/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.46.down_proj: 57%|█████▋ | 20962/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.47.gate_proj: 57%|█████▋ | 20963/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.47.up_proj: 57%|█████▋ | 20964/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.47.down_proj: 57%|█████▋ | 20965/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.48.gate_proj: 57%|█████▋ | 20966/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.48.up_proj: 57%|█████▋ | 20967/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.48.down_proj: 57%|█████▋ | 20968/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.49.gate_proj: 57%|█████▋ | 20969/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.49.up_proj: 57%|█████▋ | 20970/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.49.down_proj: 57%|█████▋ | 20971/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.50.gate_proj: 57%|█████▋ | 20972/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.50.up_proj: 57%|█████▋ | 20973/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.50.down_proj: 57%|█████▋ | 20974/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.51.gate_proj: 57%|█████▋ | 20975/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.51.up_proj: 57%|█████▋ | 20976/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.51.down_proj: 57%|█████▋ | 20977/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.52.gate_proj: 57%|█████▋ | 20978/36566 [00:19<00:13, 1145.52it/s] packing model.layers.53.mlp.experts.52.gate_proj: 57%|█████▋ | 20979/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.52.up_proj: 57%|█████▋ | 20979/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.52.down_proj: 57%|█████▋ | 20980/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.53.gate_proj: 57%|█████▋ | 20981/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.53.up_proj: 57%|█████▋ | 20982/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.53.down_proj: 57%|█████▋ | 20983/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.54.gate_proj: 57%|█████▋ | 20984/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.54.up_proj: 57%|█████▋ | 20985/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.54.down_proj: 57%|█████▋ | 20986/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.55.gate_proj: 57%|█████▋ | 20987/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.55.up_proj: 57%|█████▋ | 20988/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.55.down_proj: 57%|█████▋ | 20989/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.56.gate_proj: 57%|█████▋ | 20990/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.56.up_proj: 57%|█████▋ | 20991/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.56.down_proj: 57%|█████▋ | 20992/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.57.gate_proj: 57%|█████▋ | 20993/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.57.up_proj: 57%|█████▋ | 20994/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.57.down_proj: 57%|█████▋ | 20995/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.58.gate_proj: 57%|█████▋ | 20996/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.58.up_proj: 57%|█████▋ | 20997/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.58.down_proj: 57%|█████▋ | 20998/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.59.gate_proj: 57%|█████▋ | 20999/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.59.up_proj: 57%|█████▋ | 21000/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.59.down_proj: 57%|█████▋ | 21001/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.60.gate_proj: 57%|█████▋ | 21002/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.60.up_proj: 57%|█████▋ | 21003/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.60.down_proj: 57%|█████▋ | 21004/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.61.gate_proj: 57%|█████▋ | 21005/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.61.up_proj: 57%|█████▋ | 21006/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.61.down_proj: 57%|█████▋ | 21007/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.62.gate_proj: 57%|█████▋ | 21008/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.62.up_proj: 57%|█████▋ | 21009/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.62.down_proj: 57%|█████▋ | 21010/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.63.gate_proj: 57%|█████▋ | 21011/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.63.up_proj: 57%|█████▋ | 21012/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.63.down_proj: 57%|█████▋ | 21013/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.64.gate_proj: 57%|█████▋ | 21014/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.64.up_proj: 57%|█████▋ | 21015/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.64.down_proj: 57%|█████▋ | 21016/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.65.gate_proj: 57%|█████▋ | 21017/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.65.up_proj: 57%|█████▋ | 21018/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.65.down_proj: 57%|█████▋ | 21019/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.66.gate_proj: 57%|█████▋ | 21020/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.66.up_proj: 57%|█████▋ | 21021/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.66.down_proj: 57%|█████▋ | 21022/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.67.gate_proj: 57%|█████▋ | 21023/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.67.up_proj: 57%|█████▋ | 21024/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.67.down_proj: 57%|█████▋ | 21025/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.68.gate_proj: 58%|█████▊ | 21026/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.68.up_proj: 58%|█████▊ | 21027/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.68.down_proj: 58%|█████▊ | 21028/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.69.gate_proj: 58%|█████▊ | 21029/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.69.up_proj: 58%|█████▊ | 21030/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.69.down_proj: 58%|█████▊ | 21031/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.70.gate_proj: 58%|█████▊ | 21032/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.70.up_proj: 58%|█████▊ | 21033/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.70.down_proj: 58%|█████▊ | 21034/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.71.gate_proj: 58%|█████▊ | 21035/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.71.up_proj: 58%|█████▊ | 21036/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.71.down_proj: 58%|█████▊ | 21037/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.72.gate_proj: 58%|█████▊ | 21038/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.72.up_proj: 58%|█████▊ | 21039/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.72.down_proj: 58%|█████▊ | 21040/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.73.gate_proj: 58%|█████▊ | 21041/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.73.up_proj: 58%|█████▊ | 21042/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.73.down_proj: 58%|█████▊ | 21043/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.74.gate_proj: 58%|█████▊ | 21044/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.74.up_proj: 58%|█████▊ | 21045/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.74.down_proj: 58%|█████▊ | 21046/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.75.gate_proj: 58%|█████▊ | 21047/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.75.up_proj: 58%|█████▊ | 21048/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.75.down_proj: 58%|█████▊ | 21049/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.76.gate_proj: 58%|█████▊ | 21050/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.76.up_proj: 58%|█████▊ | 21051/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.76.down_proj: 58%|█████▊ | 21052/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.77.gate_proj: 58%|█████▊ | 21053/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.77.up_proj: 58%|█████▊ | 21054/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.77.down_proj: 58%|█████▊ | 21055/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.78.gate_proj: 58%|█████▊ | 21056/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.78.up_proj: 58%|█████▊ | 21057/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.78.down_proj: 58%|█████▊ | 21058/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.79.gate_proj: 58%|█████▊ | 21059/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.79.up_proj: 58%|█████▊ | 21060/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.79.down_proj: 58%|█████▊ | 21061/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.80.gate_proj: 58%|█████▊ | 21062/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.80.up_proj: 58%|█████▊ | 21063/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.80.down_proj: 58%|█████▊ | 21064/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.81.gate_proj: 58%|█████▊ | 21065/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.81.up_proj: 58%|█████▊ | 21066/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.81.down_proj: 58%|█████▊ | 21067/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.82.gate_proj: 58%|█████▊ | 21068/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.82.up_proj: 58%|█████▊ | 21069/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.82.down_proj: 58%|█████▊ | 21070/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.83.gate_proj: 58%|█████▊ | 21071/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.83.up_proj: 58%|█████▊ | 21072/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.83.down_proj: 58%|█████▊ | 21073/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.84.gate_proj: 58%|█████▊ | 21074/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.84.up_proj: 58%|█████▊ | 21075/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.84.down_proj: 58%|█████▊ | 21076/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.85.gate_proj: 58%|█████▊ | 21077/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.85.up_proj: 58%|█████▊ | 21078/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.85.down_proj: 58%|█████▊ | 21079/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.86.gate_proj: 58%|█████▊ | 21080/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.86.up_proj: 58%|█████▊ | 21081/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.86.down_proj: 58%|█████▊ | 21082/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.87.gate_proj: 58%|█████▊ | 21083/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.87.up_proj: 58%|█████▊ | 21084/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.87.down_proj: 58%|█████▊ | 21085/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.88.gate_proj: 58%|█████▊ | 21086/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.88.up_proj: 58%|█████▊ | 21087/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.88.down_proj: 58%|█████▊ | 21088/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.89.gate_proj: 58%|█████▊ | 21089/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.89.up_proj: 58%|█████▊ | 21090/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.89.down_proj: 58%|█████▊ | 21091/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.90.gate_proj: 58%|█████▊ | 21092/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.90.up_proj: 58%|█████▊ | 21093/36566 [00:19<00:13, 1146.17it/s] packing model.layers.53.mlp.experts.90.up_proj: 58%|█████▊ | 21094/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.90.down_proj: 58%|█████▊ | 21094/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.91.gate_proj: 58%|█████▊ | 21095/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.91.up_proj: 58%|█████▊ | 21096/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.91.down_proj: 58%|█████▊ | 21097/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.92.gate_proj: 58%|█████▊ | 21098/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.92.up_proj: 58%|█████▊ | 21099/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.92.down_proj: 58%|█████▊ | 21100/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.93.gate_proj: 58%|█████▊ | 21101/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.93.up_proj: 58%|█████▊ | 21102/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.93.down_proj: 58%|█████▊ | 21103/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.94.gate_proj: 58%|█████▊ | 21104/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.94.up_proj: 58%|█████▊ | 21105/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.94.down_proj: 58%|█████▊ | 21106/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.95.gate_proj: 58%|█████▊ | 21107/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.95.up_proj: 58%|█████▊ | 21108/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.95.down_proj: 58%|█████▊ | 21109/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.96.gate_proj: 58%|█████▊ | 21110/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.96.up_proj: 58%|█████▊ | 21111/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.96.down_proj: 58%|█████▊ | 21112/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.97.gate_proj: 58%|█████▊ | 21113/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.97.up_proj: 58%|█████▊ | 21114/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.97.down_proj: 58%|█████▊ | 21115/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.98.gate_proj: 58%|█████▊ | 21116/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.98.up_proj: 58%|█████▊ | 21117/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.98.down_proj: 58%|█████▊ | 21118/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.99.gate_proj: 58%|█████▊ | 21119/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.99.up_proj: 58%|█████▊ | 21120/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.99.down_proj: 58%|█████▊ | 21121/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.100.gate_proj: 58%|█████▊ | 21122/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.100.up_proj: 58%|█████▊ | 21123/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.100.down_proj: 58%|█████▊ | 21124/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.101.gate_proj: 58%|█████▊ | 21125/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.101.up_proj: 58%|█████▊ | 21126/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.101.down_proj: 58%|█████▊ | 21127/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.102.gate_proj: 58%|█████▊ | 21128/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.102.up_proj: 58%|█████▊ | 21129/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.102.down_proj: 58%|█████▊ | 21130/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.103.gate_proj: 58%|█████▊ | 21131/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.103.up_proj: 58%|█████▊ | 21132/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.103.down_proj: 58%|█████▊ | 21133/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.104.gate_proj: 58%|█████▊ | 21134/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.104.up_proj: 58%|█████▊ | 21135/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.104.down_proj: 58%|█████▊ | 21136/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.105.gate_proj: 58%|█████▊ | 21137/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.105.up_proj: 58%|█████▊ | 21138/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.105.down_proj: 58%|█████▊ | 21139/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.106.gate_proj: 58%|█████▊ | 21140/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.106.up_proj: 58%|█████▊ | 21141/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.106.down_proj: 58%|█████▊ | 21142/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.107.gate_proj: 58%|█████▊ | 21143/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.107.up_proj: 58%|█████▊ | 21144/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.107.down_proj: 58%|█████▊ | 21145/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.108.gate_proj: 58%|█████▊ | 21146/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.108.up_proj: 58%|█████▊ | 21147/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.108.down_proj: 58%|█████▊ | 21148/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.109.gate_proj: 58%|█████▊ | 21149/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.109.up_proj: 58%|█████▊ | 21150/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.109.down_proj: 58%|█████▊ | 21151/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.110.gate_proj: 58%|█████▊ | 21152/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.110.up_proj: 58%|█████▊ | 21153/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.110.down_proj: 58%|█████▊ | 21154/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.111.gate_proj: 58%|█████▊ | 21155/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.111.up_proj: 58%|█████▊ | 21156/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.111.down_proj: 58%|█████▊ | 21157/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.112.gate_proj: 58%|█████▊ | 21158/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.112.up_proj: 58%|█████▊ | 21159/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.112.down_proj: 58%|█████▊ | 21160/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.113.gate_proj: 58%|█████▊ | 21161/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.113.up_proj: 58%|█████▊ | 21162/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.113.down_proj: 58%|█████▊ | 21163/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.114.gate_proj: 58%|█████▊ | 21164/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.114.up_proj: 58%|█████▊ | 21165/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.114.down_proj: 58%|█████▊ | 21166/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.115.gate_proj: 58%|█████▊ | 21167/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.115.up_proj: 58%|█████▊ | 21168/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.115.down_proj: 58%|█████▊ | 21169/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.116.gate_proj: 58%|█████▊ | 21170/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.116.up_proj: 58%|█████▊ | 21171/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.116.down_proj: 58%|█████▊ | 21172/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.117.gate_proj: 58%|█████▊ | 21173/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.117.up_proj: 58%|█████▊ | 21174/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.117.down_proj: 58%|█████▊ | 21175/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.118.gate_proj: 58%|█████▊ | 21176/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.118.up_proj: 58%|█████▊ | 21177/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.118.down_proj: 58%|█████▊ | 21178/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.119.gate_proj: 58%|█████▊ | 21179/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.119.up_proj: 58%|█████▊ | 21180/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.119.down_proj: 58%|█████▊ | 21181/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.120.gate_proj: 58%|█████▊ | 21182/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.120.up_proj: 58%|█████▊ | 21183/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.120.down_proj: 58%|█████▊ | 21184/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.121.gate_proj: 58%|█████▊ | 21185/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.121.up_proj: 58%|█████▊ | 21186/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.121.down_proj: 58%|█████▊ | 21187/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.122.gate_proj: 58%|█████▊ | 21188/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.122.up_proj: 58%|█████▊ | 21189/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.122.down_proj: 58%|█████▊ | 21190/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.123.gate_proj: 58%|█████▊ | 21191/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.123.up_proj: 58%|█████▊ | 21192/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.123.down_proj: 58%|█████▊ | 21193/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.124.gate_proj: 58%|█████▊ | 21194/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.124.up_proj: 58%|█████▊ | 21195/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.124.down_proj: 58%|█████▊ | 21196/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.125.gate_proj: 58%|█████▊ | 21197/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.125.up_proj: 58%|█████▊ | 21198/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.125.down_proj: 58%|█████▊ | 21199/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.126.gate_proj: 58%|█████▊ | 21200/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.126.up_proj: 58%|█████▊ | 21201/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.126.down_proj: 58%|█████▊ | 21202/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.127.gate_proj: 58%|█████▊ | 21203/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.127.up_proj: 58%|█████▊ | 21204/36566 [00:19<00:13, 1146.98it/s] packing model.layers.53.mlp.experts.127.down_proj: 58%|█████▊ | 21205/36566 [00:19<00:13, 1146.98it/s] packing model.layers.54.mlp.experts.0.gate_proj: 58%|█████▊ | 21206/36566 [00:19<00:13, 1146.98it/s] packing model.layers.54.mlp.experts.0.up_proj: 58%|█████▊ | 21207/36566 [00:19<00:13, 1146.98it/s] packing model.layers.54.mlp.experts.0.down_proj: 58%|█████▊ | 21208/36566 [00:19<00:13, 1146.98it/s] packing model.layers.54.mlp.experts.0.down_proj: 58%|█████▊ | 21209/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.1.gate_proj: 58%|█████▊ | 21209/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.1.up_proj: 58%|█████▊ | 21210/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.1.down_proj: 58%|█████▊ | 21211/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.2.gate_proj: 58%|█████▊ | 21212/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.2.up_proj: 58%|█████▊ | 21213/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.2.down_proj: 58%|█████▊ | 21214/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.3.gate_proj: 58%|█████▊ | 21215/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.3.up_proj: 58%|█████▊ | 21216/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.3.down_proj: 58%|█████▊ | 21217/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.4.gate_proj: 58%|█████▊ | 21218/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.4.up_proj: 58%|█████▊ | 21219/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.4.down_proj: 58%|█████▊ | 21220/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.5.gate_proj: 58%|█████▊ | 21221/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.5.up_proj: 58%|█████▊ | 21222/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.5.down_proj: 58%|█████▊ | 21223/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.6.gate_proj: 58%|█████▊ | 21224/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.6.up_proj: 58%|█████▊ | 21225/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.6.down_proj: 58%|█████▊ | 21226/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.7.gate_proj: 58%|█████▊ | 21227/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.7.up_proj: 58%|█████▊ | 21228/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.7.down_proj: 58%|█████▊ | 21229/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.8.gate_proj: 58%|█████▊ | 21230/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.8.up_proj: 58%|█████▊ | 21231/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.8.down_proj: 58%|█████▊ | 21232/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.9.gate_proj: 58%|█████▊ | 21233/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.9.up_proj: 58%|█████▊ | 21234/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.9.down_proj: 58%|█████▊ | 21235/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.10.gate_proj: 58%|█████▊ | 21236/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.10.up_proj: 58%|█████▊ | 21237/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.10.down_proj: 58%|█████▊ | 21238/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.11.gate_proj: 58%|█████▊ | 21239/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.11.up_proj: 58%|█████▊ | 21240/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.11.down_proj: 58%|█████▊ | 21241/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.12.gate_proj: 58%|█████▊ | 21242/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.12.up_proj: 58%|█████▊ | 21243/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.12.down_proj: 58%|█████▊ | 21244/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.13.gate_proj: 58%|█████▊ | 21245/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.13.up_proj: 58%|█████▊ | 21246/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.13.down_proj: 58%|█████▊ | 21247/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.14.gate_proj: 58%|█████▊ | 21248/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.14.up_proj: 58%|█████▊ | 21249/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.14.down_proj: 58%|█████▊ | 21250/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.15.gate_proj: 58%|█████▊ | 21251/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.15.up_proj: 58%|█████▊ | 21252/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.15.down_proj: 58%|█████▊ | 21253/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.16.gate_proj: 58%|█████▊ | 21254/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.16.up_proj: 58%|█████▊ | 21255/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.16.down_proj: 58%|█████▊ | 21256/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.17.gate_proj: 58%|█████▊ | 21257/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.17.up_proj: 58%|█████▊ | 21258/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.17.down_proj: 58%|█████▊ | 21259/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.18.gate_proj: 58%|█████▊ | 21260/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.18.up_proj: 58%|█████▊ | 21261/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.18.down_proj: 58%|█████▊ | 21262/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.19.gate_proj: 58%|█████▊ | 21263/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.19.up_proj: 58%|█████▊ | 21264/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.19.down_proj: 58%|█████▊ | 21265/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.20.gate_proj: 58%|█████▊ | 21266/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.20.up_proj: 58%|█████▊ | 21267/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.20.down_proj: 58%|█████▊ | 21268/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.21.gate_proj: 58%|█████▊ | 21269/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.21.up_proj: 58%|█████▊ | 21270/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.21.down_proj: 58%|█████▊ | 21271/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.22.gate_proj: 58%|█████▊ | 21272/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.22.up_proj: 58%|█████▊ | 21273/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.22.down_proj: 58%|█████▊ | 21274/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.23.gate_proj: 58%|█████▊ | 21275/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.23.up_proj: 58%|█████▊ | 21276/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.23.down_proj: 58%|█████▊ | 21277/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.24.gate_proj: 58%|█████▊ | 21278/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.24.up_proj: 58%|█████▊ | 21279/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.24.down_proj: 58%|█████▊ | 21280/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.25.gate_proj: 58%|█████▊ | 21281/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.25.up_proj: 58%|█████▊ | 21282/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.25.down_proj: 58%|█████▊ | 21283/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.26.gate_proj: 58%|█████▊ | 21284/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.26.up_proj: 58%|█████▊ | 21285/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.26.down_proj: 58%|█████▊ | 21286/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.27.gate_proj: 58%|█████▊ | 21287/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.27.up_proj: 58%|█████▊ | 21288/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.27.down_proj: 58%|█████▊ | 21289/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.28.gate_proj: 58%|█████▊ | 21290/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.28.up_proj: 58%|█████▊ | 21291/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.28.down_proj: 58%|█████▊ | 21292/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.29.gate_proj: 58%|█████▊ | 21293/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.29.up_proj: 58%|█████▊ | 21294/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.29.down_proj: 58%|█████▊ | 21295/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.30.gate_proj: 58%|█████▊ | 21296/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.30.up_proj: 58%|█████▊ | 21297/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.30.down_proj: 58%|█████▊ | 21298/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.31.gate_proj: 58%|█████▊ | 21299/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.31.up_proj: 58%|█████▊ | 21300/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.31.down_proj: 58%|█████▊ | 21301/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.32.gate_proj: 58%|█████▊ | 21302/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.32.up_proj: 58%|█████▊ | 21303/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.32.down_proj: 58%|█████▊ | 21304/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.33.gate_proj: 58%|█████▊ | 21305/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.33.up_proj: 58%|█████▊ | 21306/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.33.down_proj: 58%|█████▊ | 21307/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.34.gate_proj: 58%|█████▊ | 21308/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.34.up_proj: 58%|█████▊ | 21309/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.34.down_proj: 58%|█████▊ | 21310/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.35.gate_proj: 58%|█████▊ | 21311/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.35.up_proj: 58%|█████▊ | 21312/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.35.down_proj: 58%|█████▊ | 21313/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.36.gate_proj: 58%|█████▊ | 21314/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.36.up_proj: 58%|█████▊ | 21315/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.36.down_proj: 58%|█████▊ | 21316/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.37.gate_proj: 58%|█████▊ | 21317/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.37.up_proj: 58%|█████▊ | 21318/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.37.down_proj: 58%|█████▊ | 21319/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.38.gate_proj: 58%|█████▊ | 21320/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.38.up_proj: 58%|█████▊ | 21321/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.38.down_proj: 58%|█████▊ | 21322/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.39.gate_proj: 58%|█████▊ | 21323/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.39.up_proj: 58%|█████▊ | 21324/36566 [00:19<00:13, 1147.57it/s] packing model.layers.54.mlp.experts.39.up_proj: 58%|█████▊ | 21325/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.39.down_proj: 58%|█████▊ | 21325/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.40.gate_proj: 58%|█████▊ | 21326/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.40.up_proj: 58%|█████▊ | 21327/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.40.down_proj: 58%|█████▊ | 21328/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.41.gate_proj: 58%|█████▊ | 21329/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.41.up_proj: 58%|█████▊ | 21330/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.41.down_proj: 58%|█████▊ | 21331/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.42.gate_proj: 58%|█████▊ | 21332/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.42.up_proj: 58%|█████▊ | 21333/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.42.down_proj: 58%|█████▊ | 21334/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.43.gate_proj: 58%|█████▊ | 21335/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.43.up_proj: 58%|█████▊ | 21336/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.43.down_proj: 58%|█████▊ | 21337/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.44.gate_proj: 58%|█████▊ | 21338/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.44.up_proj: 58%|█████▊ | 21339/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.44.down_proj: 58%|█████▊ | 21340/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.45.gate_proj: 58%|█████▊ | 21341/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.45.up_proj: 58%|█████▊ | 21342/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.45.down_proj: 58%|█████▊ | 21343/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.46.gate_proj: 58%|█████▊ | 21344/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.46.up_proj: 58%|█████▊ | 21345/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.46.down_proj: 58%|█████▊ | 21346/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.47.gate_proj: 58%|█████▊ | 21347/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.47.up_proj: 58%|█████▊ | 21348/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.47.down_proj: 58%|█████▊ | 21349/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.48.gate_proj: 58%|█████▊ | 21350/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.48.up_proj: 58%|█████▊ | 21351/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.48.down_proj: 58%|█████▊ | 21352/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.49.gate_proj: 58%|█████▊ | 21353/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.49.up_proj: 58%|█████▊ | 21354/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.49.down_proj: 58%|█████▊ | 21355/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.50.gate_proj: 58%|█████▊ | 21356/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.50.up_proj: 58%|█████▊ | 21357/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.50.down_proj: 58%|█████▊ | 21358/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.51.gate_proj: 58%|█████▊ | 21359/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.51.up_proj: 58%|█████▊ | 21360/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.51.down_proj: 58%|█████▊ | 21361/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.52.gate_proj: 58%|█████▊ | 21362/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.52.up_proj: 58%|█████▊ | 21363/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.52.down_proj: 58%|█████▊ | 21364/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.53.gate_proj: 58%|█████▊ | 21365/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.53.up_proj: 58%|█████▊ | 21366/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.53.down_proj: 58%|█████▊ | 21367/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.54.gate_proj: 58%|█████▊ | 21368/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.54.up_proj: 58%|█████▊ | 21369/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.54.down_proj: 58%|█████▊ | 21370/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.55.gate_proj: 58%|█████▊ | 21371/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.55.up_proj: 58%|█████▊ | 21372/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.55.down_proj: 58%|█████▊ | 21373/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.56.gate_proj: 58%|█████▊ | 21374/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.56.up_proj: 58%|█████▊ | 21375/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.56.down_proj: 58%|█████▊ | 21376/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.57.gate_proj: 58%|█████▊ | 21377/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.57.up_proj: 58%|█████▊ | 21378/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.57.down_proj: 58%|█████▊ | 21379/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.58.gate_proj: 58%|█████▊ | 21380/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.58.up_proj: 58%|█████▊ | 21381/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.58.down_proj: 58%|█████▊ | 21382/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.59.gate_proj: 58%|█████▊ | 21383/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.59.up_proj: 58%|█████▊ | 21384/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.59.down_proj: 58%|█████▊ | 21385/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.60.gate_proj: 58%|█████▊ | 21386/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.60.up_proj: 58%|█████▊ | 21387/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.60.down_proj: 58%|█████▊ | 21388/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.61.gate_proj: 58%|█████▊ | 21389/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.61.up_proj: 58%|█████▊ | 21390/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.61.down_proj: 58%|█████▊ | 21391/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.62.gate_proj: 59%|█████▊ | 21392/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.62.up_proj: 59%|█████▊ | 21393/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.62.down_proj: 59%|█████▊ | 21394/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.63.gate_proj: 59%|█████▊ | 21395/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.63.up_proj: 59%|█████▊ | 21396/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.63.down_proj: 59%|█████▊ | 21397/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.64.gate_proj: 59%|█████▊ | 21398/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.64.up_proj: 59%|█████▊ | 21399/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.64.down_proj: 59%|█████▊ | 21400/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.65.gate_proj: 59%|█████▊ | 21401/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.65.up_proj: 59%|█████▊ | 21402/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.65.down_proj: 59%|█████▊ | 21403/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.66.gate_proj: 59%|█████▊ | 21404/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.66.up_proj: 59%|█████▊ | 21405/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.66.down_proj: 59%|█████▊ | 21406/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.67.gate_proj: 59%|█████▊ | 21407/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.67.up_proj: 59%|█████▊ | 21408/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.67.down_proj: 59%|█████▊ | 21409/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.68.gate_proj: 59%|█████▊ | 21410/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.68.up_proj: 59%|█████▊ | 21411/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.68.down_proj: 59%|█████▊ | 21412/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.69.gate_proj: 59%|█████▊ | 21413/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.69.up_proj: 59%|█████▊ | 21414/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.69.down_proj: 59%|█████▊ | 21415/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.70.gate_proj: 59%|█████▊ | 21416/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.70.up_proj: 59%|█████▊ | 21417/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.70.down_proj: 59%|█████▊ | 21418/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.71.gate_proj: 59%|█████▊ | 21419/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.71.up_proj: 59%|█████▊ | 21420/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.71.down_proj: 59%|█████▊ | 21421/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.72.gate_proj: 59%|█████▊ | 21422/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.72.up_proj: 59%|█████▊ | 21423/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.72.down_proj: 59%|█████▊ | 21424/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.73.gate_proj: 59%|█████▊ | 21425/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.73.up_proj: 59%|█████▊ | 21426/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.73.down_proj: 59%|█████▊ | 21427/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.74.gate_proj: 59%|█████▊ | 21428/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.74.up_proj: 59%|█████▊ | 21429/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.74.down_proj: 59%|█████▊ | 21430/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.75.gate_proj: 59%|█████▊ | 21431/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.75.up_proj: 59%|█████▊ | 21432/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.75.down_proj: 59%|█████▊ | 21433/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.76.gate_proj: 59%|█████▊ | 21434/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.76.up_proj: 59%|█████▊ | 21435/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.76.down_proj: 59%|█████▊ | 21436/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.77.gate_proj: 59%|█████▊ | 21437/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.77.up_proj: 59%|█████▊ | 21438/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.77.down_proj: 59%|█████▊ | 21439/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.78.gate_proj: 59%|█████▊ | 21440/36566 [00:19<00:13, 1150.62it/s] packing model.layers.54.mlp.experts.78.gate_proj: 59%|█████▊ | 21441/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.78.up_proj: 59%|█████▊ | 21441/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.78.down_proj: 59%|█████▊ | 21442/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.79.gate_proj: 59%|█████▊ | 21443/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.79.up_proj: 59%|█████▊ | 21444/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.79.down_proj: 59%|█████▊ | 21445/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.80.gate_proj: 59%|█████▊ | 21446/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.80.up_proj: 59%|█████▊ | 21447/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.80.down_proj: 59%|█████▊ | 21448/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.81.gate_proj: 59%|█████▊ | 21449/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.81.up_proj: 59%|█████▊ | 21450/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.81.down_proj: 59%|█████▊ | 21451/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.82.gate_proj: 59%|█████▊ | 21452/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.82.up_proj: 59%|█████▊ | 21453/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.82.down_proj: 59%|█████▊ | 21454/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.83.gate_proj: 59%|█████▊ | 21455/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.83.up_proj: 59%|█████▊ | 21456/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.83.down_proj: 59%|█████▊ | 21457/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.84.gate_proj: 59%|█████▊ | 21458/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.84.up_proj: 59%|█████▊ | 21459/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.84.down_proj: 59%|█████▊ | 21460/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.85.gate_proj: 59%|█████▊ | 21461/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.85.up_proj: 59%|█████▊ | 21462/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.85.down_proj: 59%|█████▊ | 21463/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.86.gate_proj: 59%|█████▊ | 21464/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.86.up_proj: 59%|█████▊ | 21465/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.86.down_proj: 59%|█████▊ | 21466/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.87.gate_proj: 59%|█████▊ | 21467/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.87.up_proj: 59%|█████▊ | 21468/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.87.down_proj: 59%|█████▊ | 21469/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.88.gate_proj: 59%|█████▊ | 21470/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.88.up_proj: 59%|█████▊ | 21471/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.88.down_proj: 59%|█████▊ | 21472/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.89.gate_proj: 59%|█████▊ | 21473/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.89.up_proj: 59%|█████▊ | 21474/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.89.down_proj: 59%|█████▊ | 21475/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.90.gate_proj: 59%|█████▊ | 21476/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.90.up_proj: 59%|█████▊ | 21477/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.90.down_proj: 59%|█████▊ | 21478/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.91.gate_proj: 59%|█████▊ | 21479/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.91.up_proj: 59%|█████▊ | 21480/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.91.down_proj: 59%|█████▊ | 21481/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.92.gate_proj: 59%|█████▊ | 21482/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.92.up_proj: 59%|█████▉ | 21483/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.92.down_proj: 59%|█████▉ | 21484/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.93.gate_proj: 59%|█████▉ | 21485/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.93.up_proj: 59%|█████▉ | 21486/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.93.down_proj: 59%|█████▉ | 21487/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.94.gate_proj: 59%|█████▉ | 21488/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.94.up_proj: 59%|█████▉ | 21489/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.94.down_proj: 59%|█████▉ | 21490/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.95.gate_proj: 59%|█████▉ | 21491/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.95.up_proj: 59%|█████▉ | 21492/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.95.down_proj: 59%|█████▉ | 21493/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.96.gate_proj: 59%|█████▉ | 21494/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.96.up_proj: 59%|█████▉ | 21495/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.96.down_proj: 59%|█████▉ | 21496/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.97.gate_proj: 59%|█████▉ | 21497/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.97.up_proj: 59%|█████▉ | 21498/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.97.down_proj: 59%|█████▉ | 21499/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.98.gate_proj: 59%|█████▉ | 21500/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.98.up_proj: 59%|█████▉ | 21501/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.98.down_proj: 59%|█████▉ | 21502/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.99.gate_proj: 59%|█████▉ | 21503/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.99.up_proj: 59%|█████▉ | 21504/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.99.down_proj: 59%|█████▉ | 21505/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.100.gate_proj: 59%|█████▉ | 21506/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.100.up_proj: 59%|█████▉ | 21507/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.100.down_proj: 59%|█████▉ | 21508/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.101.gate_proj: 59%|█████▉ | 21509/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.101.up_proj: 59%|█████▉ | 21510/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.101.down_proj: 59%|█████▉ | 21511/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.102.gate_proj: 59%|█████▉ | 21512/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.102.up_proj: 59%|█████▉ | 21513/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.102.down_proj: 59%|█████▉ | 21514/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.103.gate_proj: 59%|█████▉ | 21515/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.103.up_proj: 59%|█████▉ | 21516/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.103.down_proj: 59%|█████▉ | 21517/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.104.gate_proj: 59%|█████▉ | 21518/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.104.up_proj: 59%|█████▉ | 21519/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.104.down_proj: 59%|█████▉ | 21520/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.105.gate_proj: 59%|█████▉ | 21521/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.105.up_proj: 59%|█████▉ | 21522/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.105.down_proj: 59%|█████▉ | 21523/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.106.gate_proj: 59%|█████▉ | 21524/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.106.up_proj: 59%|█████▉ | 21525/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.106.down_proj: 59%|█████▉ | 21526/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.107.gate_proj: 59%|█████▉ | 21527/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.107.up_proj: 59%|█████▉ | 21528/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.107.down_proj: 59%|█████▉ | 21529/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.108.gate_proj: 59%|█████▉ | 21530/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.108.up_proj: 59%|█████▉ | 21531/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.108.down_proj: 59%|█████▉ | 21532/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.109.gate_proj: 59%|█████▉ | 21533/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.109.up_proj: 59%|█████▉ | 21534/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.109.down_proj: 59%|█████▉ | 21535/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.110.gate_proj: 59%|█████▉ | 21536/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.110.up_proj: 59%|█████▉ | 21537/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.110.down_proj: 59%|█████▉ | 21538/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.111.gate_proj: 59%|█████▉ | 21539/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.111.up_proj: 59%|█████▉ | 21540/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.111.down_proj: 59%|█████▉ | 21541/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.112.gate_proj: 59%|█████▉ | 21542/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.112.up_proj: 59%|█████▉ | 21543/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.112.down_proj: 59%|█████▉ | 21544/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.113.gate_proj: 59%|█████▉ | 21545/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.113.up_proj: 59%|█████▉ | 21546/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.113.down_proj: 59%|█████▉ | 21547/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.114.gate_proj: 59%|█████▉ | 21548/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.114.up_proj: 59%|█████▉ | 21549/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.114.down_proj: 59%|█████▉ | 21550/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.115.gate_proj: 59%|█████▉ | 21551/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.115.up_proj: 59%|█████▉ | 21552/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.115.down_proj: 59%|█████▉ | 21553/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.116.gate_proj: 59%|█████▉ | 21554/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.116.up_proj: 59%|█████▉ | 21555/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.116.down_proj: 59%|█████▉ | 21556/36566 [00:19<00:13, 1152.18it/s] packing model.layers.54.mlp.experts.116.down_proj: 59%|█████▉ | 21557/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.117.gate_proj: 59%|█████▉ | 21557/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.117.up_proj: 59%|█████▉ | 21558/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.117.down_proj: 59%|█████▉ | 21559/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.118.gate_proj: 59%|█████▉ | 21560/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.118.up_proj: 59%|█████▉ | 21561/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.118.down_proj: 59%|█████▉ | 21562/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.119.gate_proj: 59%|█████▉ | 21563/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.119.up_proj: 59%|█████▉ | 21564/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.119.down_proj: 59%|█████▉ | 21565/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.120.gate_proj: 59%|█████▉ | 21566/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.120.up_proj: 59%|█████▉ | 21567/36566 [00:19<00:13, 1153.76it/s] packing model.layers.54.mlp.experts.120.down_proj: 59%|█████▉ | 21568/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.121.gate_proj: 59%|█████▉ | 21569/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.121.up_proj: 59%|█████▉ | 21570/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.121.down_proj: 59%|█████▉ | 21571/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.122.gate_proj: 59%|█████▉ | 21572/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.122.up_proj: 59%|█████▉ | 21573/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.122.down_proj: 59%|█████▉ | 21574/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.123.gate_proj: 59%|█████▉ | 21575/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.123.up_proj: 59%|█████▉ | 21576/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.123.down_proj: 59%|█████▉ | 21577/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.124.gate_proj: 59%|█████▉ | 21578/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.124.up_proj: 59%|█████▉ | 21579/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.124.down_proj: 59%|█████▉ | 21580/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.125.gate_proj: 59%|█████▉ | 21581/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.125.up_proj: 59%|█████▉ | 21582/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.125.down_proj: 59%|█████▉ | 21583/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.126.gate_proj: 59%|█████▉ | 21584/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.126.up_proj: 59%|█████▉ | 21585/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.126.down_proj: 59%|█████▉ | 21586/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.127.gate_proj: 59%|█████▉ | 21587/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.127.up_proj: 59%|█████▉ | 21588/36566 [00:19<00:12, 1153.76it/s] packing model.layers.54.mlp.experts.127.down_proj: 59%|█████▉ | 21589/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.0.gate_proj: 59%|█████▉ | 21590/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.0.up_proj: 59%|█████▉ | 21591/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.0.down_proj: 59%|█████▉ | 21592/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.1.gate_proj: 59%|█████▉ | 21593/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.1.up_proj: 59%|█████▉ | 21594/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.1.down_proj: 59%|█████▉ | 21595/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.2.gate_proj: 59%|█████▉ | 21596/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.2.up_proj: 59%|█████▉ | 21597/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.2.down_proj: 59%|█████▉ | 21598/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.3.gate_proj: 59%|█████▉ | 21599/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.3.up_proj: 59%|█████▉ | 21600/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.3.down_proj: 59%|█████▉ | 21601/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.4.gate_proj: 59%|█████▉ | 21602/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.4.up_proj: 59%|█████▉ | 21603/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.4.down_proj: 59%|█████▉ | 21604/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.5.gate_proj: 59%|█████▉ | 21605/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.5.up_proj: 59%|█████▉ | 21606/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.5.down_proj: 59%|█████▉ | 21607/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.6.gate_proj: 59%|█████▉ | 21608/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.6.up_proj: 59%|█████▉ | 21609/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.6.down_proj: 59%|█████▉ | 21610/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.7.gate_proj: 59%|█████▉ | 21611/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.7.up_proj: 59%|█████▉ | 21612/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.7.down_proj: 59%|█████▉ | 21613/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.8.gate_proj: 59%|█████▉ | 21614/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.8.up_proj: 59%|█████▉ | 21615/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.8.down_proj: 59%|█████▉ | 21616/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.9.gate_proj: 59%|█████▉ | 21617/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.9.up_proj: 59%|█████▉ | 21618/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.9.down_proj: 59%|█████▉ | 21619/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.10.gate_proj: 59%|█████▉ | 21620/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.10.up_proj: 59%|█████▉ | 21621/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.10.down_proj: 59%|█████▉ | 21622/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.11.gate_proj: 59%|█████▉ | 21623/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.11.up_proj: 59%|█████▉ | 21624/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.11.down_proj: 59%|█████▉ | 21625/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.12.gate_proj: 59%|█████▉ | 21626/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.12.up_proj: 59%|█████▉ | 21627/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.12.down_proj: 59%|█████▉ | 21628/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.13.gate_proj: 59%|█████▉ | 21629/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.13.up_proj: 59%|█████▉ | 21630/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.13.down_proj: 59%|█████▉ | 21631/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.14.gate_proj: 59%|█████▉ | 21632/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.14.up_proj: 59%|█████▉ | 21633/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.14.down_proj: 59%|█████▉ | 21634/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.15.gate_proj: 59%|█████▉ | 21635/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.15.up_proj: 59%|█████▉ | 21636/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.15.down_proj: 59%|█████▉ | 21637/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.16.gate_proj: 59%|█████▉ | 21638/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.16.up_proj: 59%|█████▉ | 21639/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.16.down_proj: 59%|█████▉ | 21640/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.17.gate_proj: 59%|█████▉ | 21641/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.17.up_proj: 59%|█████▉ | 21642/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.17.down_proj: 59%|█████▉ | 21643/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.18.gate_proj: 59%|█████▉ | 21644/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.18.up_proj: 59%|█████▉ | 21645/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.18.down_proj: 59%|█████▉ | 21646/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.19.gate_proj: 59%|█████▉ | 21647/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.19.up_proj: 59%|█████▉ | 21648/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.19.down_proj: 59%|█████▉ | 21649/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.20.gate_proj: 59%|█████▉ | 21650/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.20.up_proj: 59%|█████▉ | 21651/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.20.down_proj: 59%|█████▉ | 21652/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.21.gate_proj: 59%|█████▉ | 21653/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.21.up_proj: 59%|█████▉ | 21654/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.21.down_proj: 59%|█████▉ | 21655/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.22.gate_proj: 59%|█████▉ | 21656/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.22.up_proj: 59%|█████▉ | 21657/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.22.down_proj: 59%|█████▉ | 21658/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.23.gate_proj: 59%|█████▉ | 21659/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.23.up_proj: 59%|█████▉ | 21660/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.23.down_proj: 59%|█████▉ | 21661/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.24.gate_proj: 59%|█████▉ | 21662/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.24.up_proj: 59%|█████▉ | 21663/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.24.down_proj: 59%|█████▉ | 21664/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.25.gate_proj: 59%|█████▉ | 21665/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.25.up_proj: 59%|█████▉ | 21666/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.25.down_proj: 59%|█████▉ | 21667/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.26.gate_proj: 59%|█████▉ | 21668/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.26.up_proj: 59%|█████▉ | 21669/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.26.down_proj: 59%|█████▉ | 21670/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.27.gate_proj: 59%|█████▉ | 21671/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.27.up_proj: 59%|█████▉ | 21672/36566 [00:19<00:12, 1153.76it/s] packing model.layers.55.mlp.experts.27.up_proj: 59%|█████▉ | 21673/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.27.down_proj: 59%|█████▉ | 21673/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.28.gate_proj: 59%|█████▉ | 21674/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.28.up_proj: 59%|█████▉ | 21675/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.28.down_proj: 59%|█████▉ | 21676/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.29.gate_proj: 59%|█████▉ | 21677/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.29.up_proj: 59%|█████▉ | 21678/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.29.down_proj: 59%|█████▉ | 21679/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.30.gate_proj: 59%|█████▉ | 21680/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.30.up_proj: 59%|█████▉ | 21681/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.30.down_proj: 59%|█████▉ | 21682/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.31.gate_proj: 59%|█████▉ | 21683/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.31.up_proj: 59%|█████▉ | 21684/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.31.down_proj: 59%|█████▉ | 21685/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.32.gate_proj: 59%|█████▉ | 21686/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.32.up_proj: 59%|█████▉ | 21687/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.32.down_proj: 59%|█████▉ | 21688/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.33.gate_proj: 59%|█████▉ | 21689/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.33.up_proj: 59%|█████▉ | 21690/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.33.down_proj: 59%|█████▉ | 21691/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.34.gate_proj: 59%|█████▉ | 21692/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.34.up_proj: 59%|█████▉ | 21693/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.34.down_proj: 59%|█████▉ | 21694/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.35.gate_proj: 59%|█████▉ | 21695/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.35.up_proj: 59%|█████▉ | 21696/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.35.down_proj: 59%|█████▉ | 21697/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.36.gate_proj: 59%|█████▉ | 21698/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.36.up_proj: 59%|█████▉ | 21699/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.36.down_proj: 59%|█████▉ | 21700/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.37.gate_proj: 59%|█████▉ | 21701/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.37.up_proj: 59%|█████▉ | 21702/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.37.down_proj: 59%|█████▉ | 21703/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.38.gate_proj: 59%|█████▉ | 21704/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.38.up_proj: 59%|█████▉ | 21705/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.38.down_proj: 59%|█████▉ | 21706/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.39.gate_proj: 59%|█████▉ | 21707/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.39.up_proj: 59%|█████▉ | 21708/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.39.down_proj: 59%|█████▉ | 21709/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.40.gate_proj: 59%|█████▉ | 21710/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.40.up_proj: 59%|█████▉ | 21711/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.40.down_proj: 59%|█████▉ | 21712/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.41.gate_proj: 59%|█████▉ | 21713/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.41.up_proj: 59%|█████▉ | 21714/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.41.down_proj: 59%|█████▉ | 21715/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.42.gate_proj: 59%|█████▉ | 21716/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.42.up_proj: 59%|█████▉ | 21717/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.42.down_proj: 59%|█████▉ | 21718/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.43.gate_proj: 59%|█████▉ | 21719/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.43.up_proj: 59%|█████▉ | 21720/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.43.down_proj: 59%|█████▉ | 21721/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.44.gate_proj: 59%|█████▉ | 21722/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.44.up_proj: 59%|█████▉ | 21723/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.44.down_proj: 59%|█████▉ | 21724/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.45.gate_proj: 59%|█████▉ | 21725/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.45.up_proj: 59%|█████▉ | 21726/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.45.down_proj: 59%|█████▉ | 21727/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.46.gate_proj: 59%|█████▉ | 21728/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.46.up_proj: 59%|█████▉ | 21729/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.46.down_proj: 59%|█████▉ | 21730/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.47.gate_proj: 59%|█████▉ | 21731/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.47.up_proj: 59%|█████▉ | 21732/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.47.down_proj: 59%|█████▉ | 21733/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.48.gate_proj: 59%|█████▉ | 21734/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.48.up_proj: 59%|█████▉ | 21735/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.48.down_proj: 59%|█████▉ | 21736/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.49.gate_proj: 59%|█████▉ | 21737/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.49.up_proj: 59%|█████▉ | 21738/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.49.down_proj: 59%|█████▉ | 21739/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.50.gate_proj: 59%|█████▉ | 21740/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.50.up_proj: 59%|█████▉ | 21741/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.50.down_proj: 59%|█████▉ | 21742/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.51.gate_proj: 59%|█████▉ | 21743/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.51.up_proj: 59%|█████▉ | 21744/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.51.down_proj: 59%|█████▉ | 21745/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.52.gate_proj: 59%|█████▉ | 21746/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.52.up_proj: 59%|█████▉ | 21747/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.52.down_proj: 59%|█████▉ | 21748/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.53.gate_proj: 59%|█████▉ | 21749/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.53.up_proj: 59%|█████▉ | 21750/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.53.down_proj: 59%|█████▉ | 21751/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.54.gate_proj: 59%|█████▉ | 21752/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.54.up_proj: 59%|█████▉ | 21753/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.54.down_proj: 59%|█████▉ | 21754/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.55.gate_proj: 59%|█████▉ | 21755/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.55.up_proj: 59%|█████▉ | 21756/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.55.down_proj: 60%|█████▉ | 21757/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.56.gate_proj: 60%|█████▉ | 21758/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.56.up_proj: 60%|█████▉ | 21759/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.56.down_proj: 60%|█████▉ | 21760/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.57.gate_proj: 60%|█████▉ | 21761/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.57.up_proj: 60%|█████▉ | 21762/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.57.down_proj: 60%|█████▉ | 21763/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.58.gate_proj: 60%|█████▉ | 21764/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.58.up_proj: 60%|█████▉ | 21765/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.58.down_proj: 60%|█████▉ | 21766/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.59.gate_proj: 60%|█████▉ | 21767/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.59.up_proj: 60%|█████▉ | 21768/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.59.down_proj: 60%|█████▉ | 21769/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.60.gate_proj: 60%|█████▉ | 21770/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.60.up_proj: 60%|█████▉ | 21771/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.60.down_proj: 60%|█████▉ | 21772/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.61.gate_proj: 60%|█████▉ | 21773/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.61.up_proj: 60%|█████▉ | 21774/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.61.down_proj: 60%|█████▉ | 21775/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.62.gate_proj: 60%|█████▉ | 21776/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.62.up_proj: 60%|█████▉ | 21777/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.62.down_proj: 60%|█████▉ | 21778/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.63.gate_proj: 60%|█████▉ | 21779/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.63.up_proj: 60%|█████▉ | 21780/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.63.down_proj: 60%|█████▉ | 21781/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.64.gate_proj: 60%|█████▉ | 21782/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.64.up_proj: 60%|█████▉ | 21783/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.64.down_proj: 60%|█████▉ | 21784/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.65.gate_proj: 60%|█████▉ | 21785/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.65.up_proj: 60%|█████▉ | 21786/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.65.down_proj: 60%|█████▉ | 21787/36566 [00:19<00:12, 1148.83it/s] packing model.layers.55.mlp.experts.65.down_proj: 60%|█████▉ | 21788/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.66.gate_proj: 60%|█████▉ | 21788/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.66.up_proj: 60%|█████▉ | 21789/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.66.down_proj: 60%|█████▉ | 21790/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.67.gate_proj: 60%|█████▉ | 21791/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.67.up_proj: 60%|█████▉ | 21792/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.67.down_proj: 60%|█████▉ | 21793/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.68.gate_proj: 60%|█████▉ | 21794/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.68.up_proj: 60%|█████▉ | 21795/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.68.down_proj: 60%|█████▉ | 21796/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.69.gate_proj: 60%|█████▉ | 21797/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.69.up_proj: 60%|█████▉ | 21798/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.69.down_proj: 60%|█████▉ | 21799/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.70.gate_proj: 60%|█████▉ | 21800/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.70.up_proj: 60%|█████▉ | 21801/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.70.down_proj: 60%|█████▉ | 21802/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.71.gate_proj: 60%|█████▉ | 21803/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.71.up_proj: 60%|█████▉ | 21804/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.71.down_proj: 60%|█████▉ | 21805/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.72.gate_proj: 60%|█████▉ | 21806/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.72.up_proj: 60%|█████▉ | 21807/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.72.down_proj: 60%|█████▉ | 21808/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.73.gate_proj: 60%|█████▉ | 21809/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.73.up_proj: 60%|█████▉ | 21810/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.73.down_proj: 60%|█████▉ | 21811/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.74.gate_proj: 60%|█████▉ | 21812/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.74.up_proj: 60%|█████▉ | 21813/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.74.down_proj: 60%|█████▉ | 21814/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.75.gate_proj: 60%|█████▉ | 21815/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.75.up_proj: 60%|█████▉ | 21816/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.75.down_proj: 60%|█████▉ | 21817/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.76.gate_proj: 60%|█████▉ | 21818/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.76.up_proj: 60%|█████▉ | 21819/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.76.down_proj: 60%|█████▉ | 21820/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.77.gate_proj: 60%|█████▉ | 21821/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.77.up_proj: 60%|█████▉ | 21822/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.77.down_proj: 60%|█████▉ | 21823/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.78.gate_proj: 60%|█████▉ | 21824/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.78.up_proj: 60%|█████▉ | 21825/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.78.down_proj: 60%|█████▉ | 21826/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.79.gate_proj: 60%|█████▉ | 21827/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.79.up_proj: 60%|█████▉ | 21828/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.79.down_proj: 60%|█████▉ | 21829/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.80.gate_proj: 60%|█████▉ | 21830/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.80.up_proj: 60%|█████▉ | 21831/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.80.down_proj: 60%|█████▉ | 21832/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.81.gate_proj: 60%|█████▉ | 21833/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.81.up_proj: 60%|█████▉ | 21834/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.81.down_proj: 60%|█████▉ | 21835/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.82.gate_proj: 60%|█████▉ | 21836/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.82.up_proj: 60%|█████▉ | 21837/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.82.down_proj: 60%|█████▉ | 21838/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.83.gate_proj: 60%|█████▉ | 21839/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.83.up_proj: 60%|█████▉ | 21840/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.83.down_proj: 60%|█████▉ | 21841/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.84.gate_proj: 60%|█████▉ | 21842/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.84.up_proj: 60%|█████▉ | 21843/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.84.down_proj: 60%|█████▉ | 21844/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.85.gate_proj: 60%|█████▉ | 21845/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.85.up_proj: 60%|█████▉ | 21846/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.85.down_proj: 60%|█████▉ | 21847/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.86.gate_proj: 60%|█████▉ | 21848/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.86.up_proj: 60%|█████▉ | 21849/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.86.down_proj: 60%|█████▉ | 21850/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.87.gate_proj: 60%|█████▉ | 21851/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.87.up_proj: 60%|█████▉ | 21852/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.87.down_proj: 60%|█████▉ | 21853/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.88.gate_proj: 60%|█████▉ | 21854/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.88.up_proj: 60%|█████▉ | 21855/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.88.down_proj: 60%|█████▉ | 21856/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.89.gate_proj: 60%|█████▉ | 21857/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.89.up_proj: 60%|█████▉ | 21858/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.89.down_proj: 60%|█████▉ | 21859/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.90.gate_proj: 60%|█████▉ | 21860/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.90.up_proj: 60%|█████▉ | 21861/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.90.down_proj: 60%|█████▉ | 21862/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.91.gate_proj: 60%|█████▉ | 21863/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.91.up_proj: 60%|█████▉ | 21864/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.91.down_proj: 60%|█████▉ | 21865/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.92.gate_proj: 60%|█████▉ | 21866/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.92.up_proj: 60%|█████▉ | 21867/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.92.down_proj: 60%|█████▉ | 21868/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.93.gate_proj: 60%|█████▉ | 21869/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.93.up_proj: 60%|█████▉ | 21870/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.93.down_proj: 60%|█████▉ | 21871/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.94.gate_proj: 60%|█████▉ | 21872/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.94.up_proj: 60%|█████▉ | 21873/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.94.down_proj: 60%|█████▉ | 21874/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.95.gate_proj: 60%|█████▉ | 21875/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.95.up_proj: 60%|█████▉ | 21876/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.95.down_proj: 60%|█████▉ | 21877/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.96.gate_proj: 60%|█████▉ | 21878/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.96.up_proj: 60%|█████▉ | 21879/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.96.down_proj: 60%|█████▉ | 21880/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.97.gate_proj: 60%|█████▉ | 21881/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.97.up_proj: 60%|█████▉ | 21882/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.97.down_proj: 60%|█████▉ | 21883/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.98.gate_proj: 60%|█████▉ | 21884/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.98.up_proj: 60%|█████▉ | 21885/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.98.down_proj: 60%|█████▉ | 21886/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.99.gate_proj: 60%|█████▉ | 21887/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.99.up_proj: 60%|█████▉ | 21888/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.99.down_proj: 60%|█████▉ | 21889/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.100.gate_proj: 60%|█████▉ | 21890/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.100.up_proj: 60%|█████▉ | 21891/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.100.down_proj: 60%|█████▉ | 21892/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.101.gate_proj: 60%|█████▉ | 21893/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.101.up_proj: 60%|█████▉ | 21894/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.101.down_proj: 60%|█████▉ | 21895/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.102.gate_proj: 60%|█████▉ | 21896/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.102.up_proj: 60%|█████▉ | 21897/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.102.down_proj: 60%|█████▉ | 21898/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.103.gate_proj: 60%|█████▉ | 21899/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.103.up_proj: 60%|█████▉ | 21900/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.103.down_proj: 60%|█████▉ | 21901/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.104.gate_proj: 60%|█████▉ | 21902/36566 [00:19<00:12, 1144.85it/s] packing model.layers.55.mlp.experts.104.gate_proj: 60%|█████▉ | 21903/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.104.up_proj: 60%|█████▉ | 21903/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.104.down_proj: 60%|█████▉ | 21904/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.105.gate_proj: 60%|█████▉ | 21905/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.105.up_proj: 60%|█████▉ | 21906/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.105.down_proj: 60%|█████▉ | 21907/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.106.gate_proj: 60%|█████▉ | 21908/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.106.up_proj: 60%|█████▉ | 21909/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.106.down_proj: 60%|█████▉ | 21910/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.107.gate_proj: 60%|█████▉ | 21911/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.107.up_proj: 60%|█████▉ | 21912/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.107.down_proj: 60%|█████▉ | 21913/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.108.gate_proj: 60%|█████▉ | 21914/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.108.up_proj: 60%|█████▉ | 21915/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.108.down_proj: 60%|█████▉ | 21916/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.109.gate_proj: 60%|█████▉ | 21917/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.109.up_proj: 60%|█████▉ | 21918/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.109.down_proj: 60%|█████▉ | 21919/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.110.gate_proj: 60%|█████▉ | 21920/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.110.up_proj: 60%|█████▉ | 21921/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.110.down_proj: 60%|█████▉ | 21922/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.111.gate_proj: 60%|█████▉ | 21923/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.111.up_proj: 60%|█████▉ | 21924/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.111.down_proj: 60%|█████▉ | 21925/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.112.gate_proj: 60%|█████▉ | 21926/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.112.up_proj: 60%|█████▉ | 21927/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.112.down_proj: 60%|█████▉ | 21928/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.113.gate_proj: 60%|█████▉ | 21929/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.113.up_proj: 60%|█████▉ | 21930/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.113.down_proj: 60%|█████▉ | 21931/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.114.gate_proj: 60%|█████▉ | 21932/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.114.up_proj: 60%|█████▉ | 21933/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.114.down_proj: 60%|█████▉ | 21934/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.115.gate_proj: 60%|█████▉ | 21935/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.115.up_proj: 60%|█████▉ | 21936/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.115.down_proj: 60%|█████▉ | 21937/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.116.gate_proj: 60%|█████▉ | 21938/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.116.up_proj: 60%|█████▉ | 21939/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.116.down_proj: 60%|██████ | 21940/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.117.gate_proj: 60%|██████ | 21941/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.117.up_proj: 60%|██████ | 21942/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.117.down_proj: 60%|██████ | 21943/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.118.gate_proj: 60%|██████ | 21944/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.118.up_proj: 60%|██████ | 21945/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.118.down_proj: 60%|██████ | 21946/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.119.gate_proj: 60%|██████ | 21947/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.119.up_proj: 60%|██████ | 21948/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.119.down_proj: 60%|██████ | 21949/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.120.gate_proj: 60%|██████ | 21950/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.120.up_proj: 60%|██████ | 21951/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.120.down_proj: 60%|██████ | 21952/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.121.gate_proj: 60%|██████ | 21953/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.121.up_proj: 60%|██████ | 21954/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.121.down_proj: 60%|██████ | 21955/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.122.gate_proj: 60%|██████ | 21956/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.122.up_proj: 60%|██████ | 21957/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.122.down_proj: 60%|██████ | 21958/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.123.gate_proj: 60%|██████ | 21959/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.123.up_proj: 60%|██████ | 21960/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.123.down_proj: 60%|██████ | 21961/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.124.gate_proj: 60%|██████ | 21962/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.124.up_proj: 60%|██████ | 21963/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.124.down_proj: 60%|██████ | 21964/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.125.gate_proj: 60%|██████ | 21965/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.125.up_proj: 60%|██████ | 21966/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.125.down_proj: 60%|██████ | 21967/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.126.gate_proj: 60%|██████ | 21968/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.126.up_proj: 60%|██████ | 21969/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.126.down_proj: 60%|██████ | 21970/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.127.gate_proj: 60%|██████ | 21971/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.127.up_proj: 60%|██████ | 21972/36566 [00:19<00:12, 1143.73it/s] packing model.layers.55.mlp.experts.127.down_proj: 60%|██████ | 21973/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.0.gate_proj: 60%|██████ | 21974/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.0.up_proj: 60%|██████ | 21975/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.0.down_proj: 60%|██████ | 21976/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.1.gate_proj: 60%|██████ | 21977/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.1.up_proj: 60%|██████ | 21978/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.1.down_proj: 60%|██████ | 21979/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.2.gate_proj: 60%|██████ | 21980/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.2.up_proj: 60%|██████ | 21981/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.2.down_proj: 60%|██████ | 21982/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.3.gate_proj: 60%|██████ | 21983/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.3.up_proj: 60%|██████ | 21984/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.3.down_proj: 60%|██████ | 21985/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.4.gate_proj: 60%|██████ | 21986/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.4.up_proj: 60%|██████ | 21987/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.4.down_proj: 60%|██████ | 21988/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.5.gate_proj: 60%|██████ | 21989/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.5.up_proj: 60%|██████ | 21990/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.5.down_proj: 60%|██████ | 21991/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.6.gate_proj: 60%|██████ | 21992/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.6.up_proj: 60%|██████ | 21993/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.6.down_proj: 60%|██████ | 21994/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.7.gate_proj: 60%|██████ | 21995/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.7.up_proj: 60%|██████ | 21996/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.7.down_proj: 60%|██████ | 21997/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.8.gate_proj: 60%|██████ | 21998/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.8.up_proj: 60%|██████ | 21999/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.8.down_proj: 60%|██████ | 22000/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.9.gate_proj: 60%|██████ | 22001/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.9.up_proj: 60%|██████ | 22002/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.9.down_proj: 60%|██████ | 22003/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.10.gate_proj: 60%|██████ | 22004/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.10.up_proj: 60%|██████ | 22005/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.10.down_proj: 60%|██████ | 22006/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.11.gate_proj: 60%|██████ | 22007/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.11.up_proj: 60%|██████ | 22008/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.11.down_proj: 60%|██████ | 22009/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.12.gate_proj: 60%|██████ | 22010/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.12.up_proj: 60%|██████ | 22011/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.12.down_proj: 60%|██████ | 22012/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.13.gate_proj: 60%|██████ | 22013/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.13.up_proj: 60%|██████ | 22014/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.13.down_proj: 60%|██████ | 22015/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.14.gate_proj: 60%|██████ | 22016/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.14.up_proj: 60%|██████ | 22017/36566 [00:19<00:12, 1143.73it/s] packing model.layers.56.mlp.experts.14.up_proj: 60%|██████ | 22018/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.14.down_proj: 60%|██████ | 22018/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.15.gate_proj: 60%|██████ | 22019/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.15.up_proj: 60%|██████ | 22020/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.15.down_proj: 60%|██████ | 22021/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.16.gate_proj: 60%|██████ | 22022/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.16.up_proj: 60%|██████ | 22023/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.16.down_proj: 60%|██████ | 22024/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.17.gate_proj: 60%|██████ | 22025/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.17.up_proj: 60%|██████ | 22026/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.17.down_proj: 60%|██████ | 22027/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.18.gate_proj: 60%|██████ | 22028/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.18.up_proj: 60%|██████ | 22029/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.18.down_proj: 60%|██████ | 22030/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.19.gate_proj: 60%|██████ | 22031/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.19.up_proj: 60%|██████ | 22032/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.19.down_proj: 60%|██████ | 22033/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.20.gate_proj: 60%|██████ | 22034/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.20.up_proj: 60%|██████ | 22035/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.20.down_proj: 60%|██████ | 22036/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.21.gate_proj: 60%|██████ | 22037/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.21.up_proj: 60%|██████ | 22038/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.21.down_proj: 60%|██████ | 22039/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.22.gate_proj: 60%|██████ | 22040/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.22.up_proj: 60%|██████ | 22041/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.22.down_proj: 60%|██████ | 22042/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.23.gate_proj: 60%|██████ | 22043/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.23.up_proj: 60%|██████ | 22044/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.23.down_proj: 60%|██████ | 22045/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.24.gate_proj: 60%|██████ | 22046/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.24.up_proj: 60%|██████ | 22047/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.24.down_proj: 60%|██████ | 22048/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.25.gate_proj: 60%|██████ | 22049/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.25.up_proj: 60%|██████ | 22050/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.25.down_proj: 60%|██████ | 22051/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.26.gate_proj: 60%|██████ | 22052/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.26.up_proj: 60%|██████ | 22053/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.26.down_proj: 60%|██████ | 22054/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.27.gate_proj: 60%|██████ | 22055/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.27.up_proj: 60%|██████ | 22056/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.27.down_proj: 60%|██████ | 22057/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.28.gate_proj: 60%|██████ | 22058/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.28.up_proj: 60%|██████ | 22059/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.28.down_proj: 60%|██████ | 22060/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.29.gate_proj: 60%|██████ | 22061/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.29.up_proj: 60%|██████ | 22062/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.29.down_proj: 60%|██████ | 22063/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.30.gate_proj: 60%|██████ | 22064/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.30.up_proj: 60%|██████ | 22065/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.30.down_proj: 60%|██████ | 22066/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.31.gate_proj: 60%|██████ | 22067/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.31.up_proj: 60%|██████ | 22068/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.31.down_proj: 60%|██████ | 22069/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.32.gate_proj: 60%|██████ | 22070/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.32.up_proj: 60%|██████ | 22071/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.32.down_proj: 60%|██████ | 22072/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.33.gate_proj: 60%|██████ | 22073/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.33.up_proj: 60%|██████ | 22074/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.33.down_proj: 60%|██████ | 22075/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.34.gate_proj: 60%|██████ | 22076/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.34.up_proj: 60%|██████ | 22077/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.34.down_proj: 60%|██████ | 22078/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.35.gate_proj: 60%|██████ | 22079/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.35.up_proj: 60%|██████ | 22080/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.35.down_proj: 60%|██████ | 22081/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.36.gate_proj: 60%|██████ | 22082/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.36.up_proj: 60%|██████ | 22083/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.36.down_proj: 60%|██████ | 22084/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.37.gate_proj: 60%|██████ | 22085/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.37.up_proj: 60%|██████ | 22086/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.37.down_proj: 60%|██████ | 22087/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.38.gate_proj: 60%|██████ | 22088/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.38.up_proj: 60%|██████ | 22089/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.38.down_proj: 60%|██████ | 22090/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.39.gate_proj: 60%|██████ | 22091/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.39.up_proj: 60%|██████ | 22092/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.39.down_proj: 60%|██████ | 22093/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.40.gate_proj: 60%|██████ | 22094/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.40.up_proj: 60%|██████ | 22095/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.40.down_proj: 60%|██████ | 22096/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.41.gate_proj: 60%|██████ | 22097/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.41.up_proj: 60%|██████ | 22098/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.41.down_proj: 60%|██████ | 22099/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.42.gate_proj: 60%|██████ | 22100/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.42.up_proj: 60%|██████ | 22101/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.42.down_proj: 60%|██████ | 22102/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.43.gate_proj: 60%|██████ | 22103/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.43.up_proj: 60%|██████ | 22104/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.43.down_proj: 60%|██████ | 22105/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.44.gate_proj: 60%|██████ | 22106/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.44.up_proj: 60%|██████ | 22107/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.44.down_proj: 60%|██████ | 22108/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.45.gate_proj: 60%|██████ | 22109/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.45.up_proj: 60%|██████ | 22110/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.45.down_proj: 60%|██████ | 22111/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.46.gate_proj: 60%|██████ | 22112/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.46.up_proj: 60%|██████ | 22113/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.46.down_proj: 60%|██████ | 22114/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.47.gate_proj: 60%|██████ | 22115/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.47.up_proj: 60%|██████ | 22116/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.47.down_proj: 60%|██████ | 22117/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.48.gate_proj: 60%|██████ | 22118/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.48.up_proj: 60%|██████ | 22119/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.48.down_proj: 60%|██████ | 22120/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.49.gate_proj: 60%|██████ | 22121/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.49.up_proj: 60%|██████ | 22122/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.49.down_proj: 61%|██████ | 22123/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.50.gate_proj: 61%|██████ | 22124/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.50.up_proj: 61%|██████ | 22125/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.50.down_proj: 61%|██████ | 22126/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.51.gate_proj: 61%|██████ | 22127/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.51.up_proj: 61%|██████ | 22128/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.51.down_proj: 61%|██████ | 22129/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.52.gate_proj: 61%|██████ | 22130/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.52.up_proj: 61%|██████ | 22131/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.52.down_proj: 61%|██████ | 22132/36566 [00:20<00:12, 1141.36it/s] packing model.layers.56.mlp.experts.52.down_proj: 61%|██████ | 22133/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.53.gate_proj: 61%|██████ | 22133/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.53.up_proj: 61%|██████ | 22134/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.53.down_proj: 61%|██████ | 22135/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.54.gate_proj: 61%|██████ | 22136/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.54.up_proj: 61%|██████ | 22137/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.54.down_proj: 61%|██████ | 22138/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.55.gate_proj: 61%|██████ | 22139/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.55.up_proj: 61%|██████ | 22140/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.55.down_proj: 61%|██████ | 22141/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.56.gate_proj: 61%|██████ | 22142/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.56.up_proj: 61%|██████ | 22143/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.56.down_proj: 61%|██████ | 22144/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.57.gate_proj: 61%|██████ | 22145/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.57.up_proj: 61%|██████ | 22146/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.57.down_proj: 61%|██████ | 22147/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.58.gate_proj: 61%|██████ | 22148/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.58.up_proj: 61%|██████ | 22149/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.58.down_proj: 61%|██████ | 22150/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.59.gate_proj: 61%|██████ | 22151/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.59.up_proj: 61%|██████ | 22152/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.59.down_proj: 61%|██████ | 22153/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.60.gate_proj: 61%|██████ | 22154/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.60.up_proj: 61%|██████ | 22155/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.60.down_proj: 61%|██████ | 22156/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.61.gate_proj: 61%|██████ | 22157/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.61.up_proj: 61%|██████ | 22158/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.61.down_proj: 61%|██████ | 22159/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.62.gate_proj: 61%|██████ | 22160/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.62.up_proj: 61%|██████ | 22161/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.62.down_proj: 61%|██████ | 22162/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.63.gate_proj: 61%|██████ | 22163/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.63.up_proj: 61%|██████ | 22164/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.63.down_proj: 61%|██████ | 22165/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.64.gate_proj: 61%|██████ | 22166/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.64.up_proj: 61%|██████ | 22167/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.64.down_proj: 61%|██████ | 22168/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.65.gate_proj: 61%|██████ | 22169/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.65.up_proj: 61%|██████ | 22170/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.65.down_proj: 61%|██████ | 22171/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.66.gate_proj: 61%|██████ | 22172/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.66.up_proj: 61%|██████ | 22173/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.66.down_proj: 61%|██████ | 22174/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.67.gate_proj: 61%|██████ | 22175/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.67.up_proj: 61%|██████ | 22176/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.67.down_proj: 61%|██████ | 22177/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.68.gate_proj: 61%|██████ | 22178/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.68.up_proj: 61%|██████ | 22179/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.68.down_proj: 61%|██████ | 22180/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.69.gate_proj: 61%|██████ | 22181/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.69.up_proj: 61%|██████ | 22182/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.69.down_proj: 61%|██████ | 22183/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.70.gate_proj: 61%|██████ | 22184/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.70.up_proj: 61%|██████ | 22185/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.70.down_proj: 61%|██████ | 22186/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.71.gate_proj: 61%|██████ | 22187/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.71.up_proj: 61%|██████ | 22188/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.71.down_proj: 61%|██████ | 22189/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.72.gate_proj: 61%|██████ | 22190/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.72.up_proj: 61%|██████ | 22191/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.72.down_proj: 61%|██████ | 22192/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.73.gate_proj: 61%|██████ | 22193/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.73.up_proj: 61%|██████ | 22194/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.73.down_proj: 61%|██████ | 22195/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.74.gate_proj: 61%|██████ | 22196/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.74.up_proj: 61%|██████ | 22197/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.74.down_proj: 61%|██████ | 22198/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.75.gate_proj: 61%|██████ | 22199/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.75.up_proj: 61%|██████ | 22200/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.75.down_proj: 61%|██████ | 22201/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.76.gate_proj: 61%|██████ | 22202/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.76.up_proj: 61%|██████ | 22203/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.76.down_proj: 61%|██████ | 22204/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.77.gate_proj: 61%|██████ | 22205/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.77.up_proj: 61%|██████ | 22206/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.77.down_proj: 61%|██████ | 22207/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.78.gate_proj: 61%|██████ | 22208/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.78.up_proj: 61%|██████ | 22209/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.78.down_proj: 61%|██████ | 22210/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.79.gate_proj: 61%|██████ | 22211/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.79.up_proj: 61%|██████ | 22212/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.79.down_proj: 61%|██████ | 22213/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.80.gate_proj: 61%|██████ | 22214/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.80.up_proj: 61%|██████ | 22215/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.80.down_proj: 61%|██████ | 22216/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.81.gate_proj: 61%|██████ | 22217/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.81.up_proj: 61%|██████ | 22218/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.81.down_proj: 61%|██████ | 22219/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.82.gate_proj: 61%|██████ | 22220/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.82.up_proj: 61%|██████ | 22221/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.82.down_proj: 61%|██████ | 22222/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.83.gate_proj: 61%|██████ | 22223/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.83.up_proj: 61%|██████ | 22224/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.83.down_proj: 61%|██████ | 22225/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.84.gate_proj: 61%|██████ | 22226/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.84.up_proj: 61%|██████ | 22227/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.84.down_proj: 61%|██████ | 22228/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.85.gate_proj: 61%|██████ | 22229/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.85.up_proj: 61%|██████ | 22230/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.85.down_proj: 61%|██████ | 22231/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.86.gate_proj: 61%|██████ | 22232/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.86.up_proj: 61%|██████ | 22233/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.86.down_proj: 61%|██████ | 22234/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.87.gate_proj: 61%|██████ | 22235/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.87.up_proj: 61%|██████ | 22236/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.87.down_proj: 61%|██████ | 22237/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.88.gate_proj: 61%|██████ | 22238/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.88.up_proj: 61%|██████ | 22239/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.88.down_proj: 61%|██████ | 22240/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.89.gate_proj: 61%|██████ | 22241/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.89.up_proj: 61%|██████ | 22242/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.89.down_proj: 61%|██████ | 22243/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.90.gate_proj: 61%|██████ | 22244/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.90.up_proj: 61%|██████ | 22245/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.90.down_proj: 61%|██████ | 22246/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.91.gate_proj: 61%|██████ | 22247/36566 [00:20<00:12, 1141.78it/s] packing model.layers.56.mlp.experts.91.gate_proj: 61%|██████ | 22248/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.91.up_proj: 61%|██████ | 22248/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.91.down_proj: 61%|██████ | 22249/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.92.gate_proj: 61%|██████ | 22250/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.92.up_proj: 61%|██████ | 22251/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.92.down_proj: 61%|██████ | 22252/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.93.gate_proj: 61%|██████ | 22253/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.93.up_proj: 61%|██████ | 22254/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.93.down_proj: 61%|██████ | 22255/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.94.gate_proj: 61%|██████ | 22256/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.94.up_proj: 61%|██████ | 22257/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.94.down_proj: 61%|██████ | 22258/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.95.gate_proj: 61%|██████ | 22259/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.95.up_proj: 61%|██████ | 22260/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.95.down_proj: 61%|██████ | 22261/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.96.gate_proj: 61%|██████ | 22262/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.96.up_proj: 61%|██████ | 22263/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.96.down_proj: 61%|██████ | 22264/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.97.gate_proj: 61%|██████ | 22265/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.97.up_proj: 61%|██████ | 22266/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.97.down_proj: 61%|██████ | 22267/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.98.gate_proj: 61%|██████ | 22268/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.98.up_proj: 61%|██████ | 22269/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.98.down_proj: 61%|██████ | 22270/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.99.gate_proj: 61%|██████ | 22271/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.99.up_proj: 61%|██████ | 22272/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.99.down_proj: 61%|██████ | 22273/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.100.gate_proj: 61%|██████ | 22274/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.100.up_proj: 61%|██████ | 22275/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.100.down_proj: 61%|██████ | 22276/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.101.gate_proj: 61%|██████ | 22277/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.101.up_proj: 61%|██████ | 22278/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.101.down_proj: 61%|██████ | 22279/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.102.gate_proj: 61%|██████ | 22280/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.102.up_proj: 61%|██████ | 22281/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.102.down_proj: 61%|██████ | 22282/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.103.gate_proj: 61%|██████ | 22283/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.103.up_proj: 61%|██████ | 22284/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.103.down_proj: 61%|██████ | 22285/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.104.gate_proj: 61%|██████ | 22286/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.104.up_proj: 61%|██████ | 22287/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.104.down_proj: 61%|██████ | 22288/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.105.gate_proj: 61%|██████ | 22289/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.105.up_proj: 61%|██████ | 22290/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.105.down_proj: 61%|██████ | 22291/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.106.gate_proj: 61%|██████ | 22292/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.106.up_proj: 61%|██████ | 22293/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.106.down_proj: 61%|██████ | 22294/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.107.gate_proj: 61%|██████ | 22295/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.107.up_proj: 61%|██████ | 22296/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.107.down_proj: 61%|██████ | 22297/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.108.gate_proj: 61%|██████ | 22298/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.108.up_proj: 61%|██████ | 22299/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.108.down_proj: 61%|██████ | 22300/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.109.gate_proj: 61%|██████ | 22301/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.109.up_proj: 61%|██████ | 22302/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.109.down_proj: 61%|██████ | 22303/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.110.gate_proj: 61%|██████ | 22304/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.110.up_proj: 61%|██████ | 22305/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.110.down_proj: 61%|██████ | 22306/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.111.gate_proj: 61%|██████ | 22307/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.111.up_proj: 61%|██████ | 22308/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.111.down_proj: 61%|██████ | 22309/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.112.gate_proj: 61%|██████ | 22310/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.112.up_proj: 61%|██████ | 22311/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.112.down_proj: 61%|██████ | 22312/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.113.gate_proj: 61%|██████ | 22313/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.113.up_proj: 61%|██████ | 22314/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.113.down_proj: 61%|██████ | 22315/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.114.gate_proj: 61%|██████ | 22316/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.114.up_proj: 61%|██████ | 22317/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.114.down_proj: 61%|██████ | 22318/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.115.gate_proj: 61%|██████ | 22319/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.115.up_proj: 61%|██████ | 22320/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.115.down_proj: 61%|██████ | 22321/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.116.gate_proj: 61%|██████ | 22322/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.116.up_proj: 61%|██████ | 22323/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.116.down_proj: 61%|██████ | 22324/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.117.gate_proj: 61%|██████ | 22325/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.117.up_proj: 61%|██████ | 22326/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.117.down_proj: 61%|██████ | 22327/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.118.gate_proj: 61%|██████ | 22328/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.118.up_proj: 61%|██████ | 22329/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.118.down_proj: 61%|██████ | 22330/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.119.gate_proj: 61%|██████ | 22331/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.119.up_proj: 61%|██████ | 22332/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.119.down_proj: 61%|██████ | 22333/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.120.gate_proj: 61%|██████ | 22334/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.120.up_proj: 61%|██████ | 22335/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.120.down_proj: 61%|██████ | 22336/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.121.gate_proj: 61%|██████ | 22337/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.121.up_proj: 61%|██████ | 22338/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.121.down_proj: 61%|██████ | 22339/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.122.gate_proj: 61%|██████ | 22340/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.122.up_proj: 61%|██████ | 22341/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.122.down_proj: 61%|██████ | 22342/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.123.gate_proj: 61%|██████ | 22343/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.123.up_proj: 61%|██████ | 22344/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.123.down_proj: 61%|██████ | 22345/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.124.gate_proj: 61%|██████ | 22346/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.124.up_proj: 61%|██████ | 22347/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.124.down_proj: 61%|██████ | 22348/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.125.gate_proj: 61%|██████ | 22349/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.125.up_proj: 61%|██████ | 22350/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.125.down_proj: 61%|██████ | 22351/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.126.gate_proj: 61%|██████ | 22352/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.126.up_proj: 61%|██████ | 22353/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.126.down_proj: 61%|██████ | 22354/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.127.gate_proj: 61%|██████ | 22355/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.127.up_proj: 61%|██████ | 22356/36566 [00:20<00:12, 1142.97it/s] packing model.layers.56.mlp.experts.127.down_proj: 61%|██████ | 22357/36566 [00:20<00:12, 1142.97it/s] packing model.layers.57.mlp.experts.0.gate_proj: 61%|██████ | 22358/36566 [00:20<00:12, 1142.97it/s] packing model.layers.57.mlp.experts.0.up_proj: 61%|██████ | 22359/36566 [00:20<00:12, 1142.97it/s] packing model.layers.57.mlp.experts.0.down_proj: 61%|██████ | 22360/36566 [00:20<00:12, 1142.97it/s] packing model.layers.57.mlp.experts.1.gate_proj: 61%|██████ | 22361/36566 [00:20<00:12, 1142.97it/s] packing model.layers.57.mlp.experts.1.up_proj: 61%|██████ | 22362/36566 [00:20<00:12, 1142.97it/s] packing model.layers.57.mlp.experts.1.up_proj: 61%|██████ | 22363/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.1.down_proj: 61%|██████ | 22363/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.2.gate_proj: 61%|██████ | 22364/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.2.up_proj: 61%|██████ | 22365/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.2.down_proj: 61%|██████ | 22366/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.3.gate_proj: 61%|██████ | 22367/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.3.up_proj: 61%|██████ | 22368/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.3.down_proj: 61%|██████ | 22369/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.4.gate_proj: 61%|██████ | 22370/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.4.up_proj: 61%|██████ | 22371/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.4.down_proj: 61%|██████ | 22372/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.5.gate_proj: 61%|██████ | 22373/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.5.up_proj: 61%|██████ | 22374/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.5.down_proj: 61%|██████ | 22375/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.6.gate_proj: 61%|██████ | 22376/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.6.up_proj: 61%|██████ | 22377/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.6.down_proj: 61%|██████ | 22378/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.7.gate_proj: 61%|██████ | 22379/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.7.up_proj: 61%|██████ | 22380/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.7.down_proj: 61%|██████ | 22381/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.8.gate_proj: 61%|██████ | 22382/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.8.up_proj: 61%|██████ | 22383/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.8.down_proj: 61%|██████ | 22384/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.9.gate_proj: 61%|██████ | 22385/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.9.up_proj: 61%|██████ | 22386/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.9.down_proj: 61%|██████ | 22387/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.10.gate_proj: 61%|██████ | 22388/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.10.up_proj: 61%|██████ | 22389/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.10.down_proj: 61%|██████ | 22390/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.11.gate_proj: 61%|██████ | 22391/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.11.up_proj: 61%|██████ | 22392/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.11.down_proj: 61%|██████ | 22393/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.12.gate_proj: 61%|██████ | 22394/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.12.up_proj: 61%|██████ | 22395/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.12.down_proj: 61%|██████ | 22396/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.13.gate_proj: 61%|██████▏ | 22397/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.13.up_proj: 61%|██████▏ | 22398/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.13.down_proj: 61%|██████▏ | 22399/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.14.gate_proj: 61%|██████▏ | 22400/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.14.up_proj: 61%|██████▏ | 22401/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.14.down_proj: 61%|██████▏ | 22402/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.15.gate_proj: 61%|██████▏ | 22403/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.15.up_proj: 61%|██████▏ | 22404/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.15.down_proj: 61%|██████▏ | 22405/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.16.gate_proj: 61%|██████▏ | 22406/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.16.up_proj: 61%|██████▏ | 22407/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.16.down_proj: 61%|██████▏ | 22408/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.17.gate_proj: 61%|██████▏ | 22409/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.17.up_proj: 61%|██████▏ | 22410/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.17.down_proj: 61%|██████▏ | 22411/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.18.gate_proj: 61%|██████▏ | 22412/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.18.up_proj: 61%|██████▏ | 22413/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.18.down_proj: 61%|██████▏ | 22414/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.19.gate_proj: 61%|██████▏ | 22415/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.19.up_proj: 61%|██████▏ | 22416/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.19.down_proj: 61%|██████▏ | 22417/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.20.gate_proj: 61%|██████▏ | 22418/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.20.up_proj: 61%|██████▏ | 22419/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.20.down_proj: 61%|██████▏ | 22420/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.21.gate_proj: 61%|██████▏ | 22421/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.21.up_proj: 61%|██████▏ | 22422/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.21.down_proj: 61%|██████▏ | 22423/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.22.gate_proj: 61%|██████▏ | 22424/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.22.up_proj: 61%|██████▏ | 22425/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.22.down_proj: 61%|██████▏ | 22426/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.23.gate_proj: 61%|██████▏ | 22427/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.23.up_proj: 61%|██████▏ | 22428/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.23.down_proj: 61%|██████▏ | 22429/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.24.gate_proj: 61%|██████▏ | 22430/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.24.up_proj: 61%|██████▏ | 22431/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.24.down_proj: 61%|██████▏ | 22432/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.25.gate_proj: 61%|██████▏ | 22433/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.25.up_proj: 61%|██████▏ | 22434/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.25.down_proj: 61%|██████▏ | 22435/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.26.gate_proj: 61%|██████▏ | 22436/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.26.up_proj: 61%|██████▏ | 22437/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.26.down_proj: 61%|██████▏ | 22438/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.27.gate_proj: 61%|██████▏ | 22439/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.27.up_proj: 61%|██████▏ | 22440/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.27.down_proj: 61%|██████▏ | 22441/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.28.gate_proj: 61%|██████▏ | 22442/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.28.up_proj: 61%|██████▏ | 22443/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.28.down_proj: 61%|██████▏ | 22444/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.29.gate_proj: 61%|██████▏ | 22445/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.29.up_proj: 61%|██████▏ | 22446/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.29.down_proj: 61%|██████▏ | 22447/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.30.gate_proj: 61%|██████▏ | 22448/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.30.up_proj: 61%|██████▏ | 22449/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.30.down_proj: 61%|██████▏ | 22450/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.31.gate_proj: 61%|██████▏ | 22451/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.31.up_proj: 61%|██████▏ | 22452/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.31.down_proj: 61%|██████▏ | 22453/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.32.gate_proj: 61%|██████▏ | 22454/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.32.up_proj: 61%|██████▏ | 22455/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.32.down_proj: 61%|██████▏ | 22456/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.33.gate_proj: 61%|██████▏ | 22457/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.33.up_proj: 61%|██████▏ | 22458/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.33.down_proj: 61%|██████▏ | 22459/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.34.gate_proj: 61%|██████▏ | 22460/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.34.up_proj: 61%|██████▏ | 22461/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.34.down_proj: 61%|██████▏ | 22462/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.35.gate_proj: 61%|██████▏ | 22463/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.35.up_proj: 61%|██████▏ | 22464/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.35.down_proj: 61%|██████▏ | 22465/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.36.gate_proj: 61%|██████▏ | 22466/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.36.up_proj: 61%|██████▏ | 22467/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.36.down_proj: 61%|██████▏ | 22468/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.37.gate_proj: 61%|██████▏ | 22469/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.37.up_proj: 61%|██████▏ | 22470/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.37.down_proj: 61%|██████▏ | 22471/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.38.gate_proj: 61%|██████▏ | 22472/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.38.up_proj: 61%|██████▏ | 22473/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.38.down_proj: 61%|██████▏ | 22474/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.39.gate_proj: 61%|██████▏ | 22475/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.39.up_proj: 61%|██████▏ | 22476/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.39.down_proj: 61%|██████▏ | 22477/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.40.gate_proj: 61%|██████▏ | 22478/36566 [00:20<00:12, 1143.47it/s] packing model.layers.57.mlp.experts.40.gate_proj: 61%|██████▏ | 22479/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.40.up_proj: 61%|██████▏ | 22479/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.40.down_proj: 61%|██████▏ | 22480/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.41.gate_proj: 61%|██████▏ | 22481/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.41.up_proj: 61%|██████▏ | 22482/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.41.down_proj: 61%|██████▏ | 22483/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.42.gate_proj: 61%|██████▏ | 22484/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.42.up_proj: 61%|██████▏ | 22485/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.42.down_proj: 61%|██████▏ | 22486/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.43.gate_proj: 61%|██████▏ | 22487/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.43.up_proj: 61%|██████▏ | 22488/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.43.down_proj: 62%|██████▏ | 22489/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.44.gate_proj: 62%|██████▏ | 22490/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.44.up_proj: 62%|██████▏ | 22491/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.44.down_proj: 62%|██████▏ | 22492/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.45.gate_proj: 62%|██████▏ | 22493/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.45.up_proj: 62%|██████▏ | 22494/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.45.down_proj: 62%|██████▏ | 22495/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.46.gate_proj: 62%|██████▏ | 22496/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.46.up_proj: 62%|██████▏ | 22497/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.46.down_proj: 62%|██████▏ | 22498/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.47.gate_proj: 62%|██████▏ | 22499/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.47.up_proj: 62%|██████▏ | 22500/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.47.down_proj: 62%|██████▏ | 22501/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.48.gate_proj: 62%|██████▏ | 22502/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.48.up_proj: 62%|██████▏ | 22503/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.48.down_proj: 62%|██████▏ | 22504/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.49.gate_proj: 62%|██████▏ | 22505/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.49.up_proj: 62%|██████▏ | 22506/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.49.down_proj: 62%|██████▏ | 22507/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.50.gate_proj: 62%|██████▏ | 22508/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.50.up_proj: 62%|██████▏ | 22509/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.50.down_proj: 62%|██████▏ | 22510/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.51.gate_proj: 62%|██████▏ | 22511/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.51.up_proj: 62%|██████▏ | 22512/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.51.down_proj: 62%|██████▏ | 22513/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.52.gate_proj: 62%|██████▏ | 22514/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.52.up_proj: 62%|██████▏ | 22515/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.52.down_proj: 62%|██████▏ | 22516/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.53.gate_proj: 62%|██████▏ | 22517/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.53.up_proj: 62%|██████▏ | 22518/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.53.down_proj: 62%|██████▏ | 22519/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.54.gate_proj: 62%|██████▏ | 22520/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.54.up_proj: 62%|██████▏ | 22521/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.54.down_proj: 62%|██████▏ | 22522/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.55.gate_proj: 62%|██████▏ | 22523/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.55.up_proj: 62%|██████▏ | 22524/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.55.down_proj: 62%|██████▏ | 22525/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.56.gate_proj: 62%|██████▏ | 22526/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.56.up_proj: 62%|██████▏ | 22527/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.56.down_proj: 62%|██████▏ | 22528/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.57.gate_proj: 62%|██████▏ | 22529/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.57.up_proj: 62%|██████▏ | 22530/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.57.down_proj: 62%|██████▏ | 22531/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.58.gate_proj: 62%|██████▏ | 22532/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.58.up_proj: 62%|██████▏ | 22533/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.58.down_proj: 62%|██████▏ | 22534/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.59.gate_proj: 62%|██████▏ | 22535/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.59.up_proj: 62%|██████▏ | 22536/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.59.down_proj: 62%|██████▏ | 22537/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.60.gate_proj: 62%|██████▏ | 22538/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.60.up_proj: 62%|██████▏ | 22539/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.60.down_proj: 62%|██████▏ | 22540/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.61.gate_proj: 62%|██████▏ | 22541/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.61.up_proj: 62%|██████▏ | 22542/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.61.down_proj: 62%|██████▏ | 22543/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.62.gate_proj: 62%|██████▏ | 22544/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.62.up_proj: 62%|██████▏ | 22545/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.62.down_proj: 62%|██████▏ | 22546/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.63.gate_proj: 62%|██████▏ | 22547/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.63.up_proj: 62%|██████▏ | 22548/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.63.down_proj: 62%|██████▏ | 22549/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.64.gate_proj: 62%|██████▏ | 22550/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.64.up_proj: 62%|██████▏ | 22551/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.64.down_proj: 62%|██████▏ | 22552/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.65.gate_proj: 62%|██████▏ | 22553/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.65.up_proj: 62%|██████▏ | 22554/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.65.down_proj: 62%|██████▏ | 22555/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.66.gate_proj: 62%|██████▏ | 22556/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.66.up_proj: 62%|██████▏ | 22557/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.66.down_proj: 62%|██████▏ | 22558/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.67.gate_proj: 62%|██████▏ | 22559/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.67.up_proj: 62%|██████▏ | 22560/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.67.down_proj: 62%|██████▏ | 22561/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.68.gate_proj: 62%|██████▏ | 22562/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.68.up_proj: 62%|██████▏ | 22563/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.68.down_proj: 62%|██████▏ | 22564/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.69.gate_proj: 62%|██████▏ | 22565/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.69.up_proj: 62%|██████▏ | 22566/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.69.down_proj: 62%|██████▏ | 22567/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.70.gate_proj: 62%|██████▏ | 22568/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.70.up_proj: 62%|██████▏ | 22569/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.70.down_proj: 62%|██████▏ | 22570/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.71.gate_proj: 62%|██████▏ | 22571/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.71.up_proj: 62%|██████▏ | 22572/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.71.down_proj: 62%|██████▏ | 22573/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.72.gate_proj: 62%|██████▏ | 22574/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.72.up_proj: 62%|██████▏ | 22575/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.72.down_proj: 62%|██████▏ | 22576/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.73.gate_proj: 62%|██████▏ | 22577/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.73.up_proj: 62%|██████▏ | 22578/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.73.down_proj: 62%|██████▏ | 22579/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.74.gate_proj: 62%|██████▏ | 22580/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.74.up_proj: 62%|██████▏ | 22581/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.74.down_proj: 62%|██████▏ | 22582/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.75.gate_proj: 62%|██████▏ | 22583/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.75.up_proj: 62%|██████▏ | 22584/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.75.down_proj: 62%|██████▏ | 22585/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.76.gate_proj: 62%|██████▏ | 22586/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.76.up_proj: 62%|██████▏ | 22587/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.76.down_proj: 62%|██████▏ | 22588/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.77.gate_proj: 62%|██████▏ | 22589/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.77.up_proj: 62%|██████▏ | 22590/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.77.down_proj: 62%|██████▏ | 22591/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.78.gate_proj: 62%|██████▏ | 22592/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.78.up_proj: 62%|██████▏ | 22593/36566 [00:20<00:12, 1145.91it/s] packing model.layers.57.mlp.experts.78.up_proj: 62%|██████▏ | 22594/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.78.down_proj: 62%|██████▏ | 22594/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.79.gate_proj: 62%|██████▏ | 22595/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.79.up_proj: 62%|██████▏ | 22596/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.79.down_proj: 62%|██████▏ | 22597/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.80.gate_proj: 62%|██████▏ | 22598/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.80.up_proj: 62%|██████▏ | 22599/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.80.down_proj: 62%|██████▏ | 22600/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.81.gate_proj: 62%|██████▏ | 22601/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.81.up_proj: 62%|██████▏ | 22602/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.81.down_proj: 62%|██████▏ | 22603/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.82.gate_proj: 62%|██████▏ | 22604/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.82.up_proj: 62%|██████▏ | 22605/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.82.down_proj: 62%|██████▏ | 22606/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.83.gate_proj: 62%|██████▏ | 22607/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.83.up_proj: 62%|██████▏ | 22608/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.83.down_proj: 62%|██████▏ | 22609/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.84.gate_proj: 62%|██████▏ | 22610/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.84.up_proj: 62%|██████▏ | 22611/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.84.down_proj: 62%|██████▏ | 22612/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.85.gate_proj: 62%|██████▏ | 22613/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.85.up_proj: 62%|██████▏ | 22614/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.85.down_proj: 62%|██████▏ | 22615/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.86.gate_proj: 62%|██████▏ | 22616/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.86.up_proj: 62%|██████▏ | 22617/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.86.down_proj: 62%|██████▏ | 22618/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.87.gate_proj: 62%|██████▏ | 22619/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.87.up_proj: 62%|██████▏ | 22620/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.87.down_proj: 62%|██████▏ | 22621/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.88.gate_proj: 62%|██████▏ | 22622/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.88.up_proj: 62%|██████▏ | 22623/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.88.down_proj: 62%|██████▏ | 22624/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.89.gate_proj: 62%|██████▏ | 22625/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.89.up_proj: 62%|██████▏ | 22626/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.89.down_proj: 62%|██████▏ | 22627/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.90.gate_proj: 62%|██████▏ | 22628/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.90.up_proj: 62%|██████▏ | 22629/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.90.down_proj: 62%|██████▏ | 22630/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.91.gate_proj: 62%|██████▏ | 22631/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.91.up_proj: 62%|██████▏ | 22632/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.91.down_proj: 62%|██████▏ | 22633/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.92.gate_proj: 62%|██████▏ | 22634/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.92.up_proj: 62%|██████▏ | 22635/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.92.down_proj: 62%|██████▏ | 22636/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.93.gate_proj: 62%|██████▏ | 22637/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.93.up_proj: 62%|██████▏ | 22638/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.93.down_proj: 62%|██████▏ | 22639/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.94.gate_proj: 62%|██████▏ | 22640/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.94.up_proj: 62%|██████▏ | 22641/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.94.down_proj: 62%|██████▏ | 22642/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.95.gate_proj: 62%|██████▏ | 22643/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.95.up_proj: 62%|██████▏ | 22644/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.95.down_proj: 62%|██████▏ | 22645/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.96.gate_proj: 62%|██████▏ | 22646/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.96.up_proj: 62%|██████▏ | 22647/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.96.down_proj: 62%|██████▏ | 22648/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.97.gate_proj: 62%|██████▏ | 22649/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.97.up_proj: 62%|██████▏ | 22650/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.97.down_proj: 62%|██████▏ | 22651/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.98.gate_proj: 62%|██████▏ | 22652/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.98.up_proj: 62%|██████▏ | 22653/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.98.down_proj: 62%|██████▏ | 22654/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.99.gate_proj: 62%|██████▏ | 22655/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.99.up_proj: 62%|██████▏ | 22656/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.99.down_proj: 62%|██████▏ | 22657/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.100.gate_proj: 62%|██████▏ | 22658/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.100.up_proj: 62%|██████▏ | 22659/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.100.down_proj: 62%|██████▏ | 22660/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.101.gate_proj: 62%|██████▏ | 22661/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.101.up_proj: 62%|██████▏ | 22662/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.101.down_proj: 62%|██████▏ | 22663/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.102.gate_proj: 62%|██████▏ | 22664/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.102.up_proj: 62%|██████▏ | 22665/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.102.down_proj: 62%|██████▏ | 22666/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.103.gate_proj: 62%|██████▏ | 22667/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.103.up_proj: 62%|██████▏ | 22668/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.103.down_proj: 62%|██████▏ | 22669/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.104.gate_proj: 62%|██████▏ | 22670/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.104.up_proj: 62%|██████▏ | 22671/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.104.down_proj: 62%|██████▏ | 22672/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.105.gate_proj: 62%|██████▏ | 22673/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.105.up_proj: 62%|██████▏ | 22674/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.105.down_proj: 62%|██████▏ | 22675/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.106.gate_proj: 62%|██████▏ | 22676/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.106.up_proj: 62%|██████▏ | 22677/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.106.down_proj: 62%|██████▏ | 22678/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.107.gate_proj: 62%|██████▏ | 22679/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.107.up_proj: 62%|██████▏ | 22680/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.107.down_proj: 62%|██████▏ | 22681/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.108.gate_proj: 62%|██████▏ | 22682/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.108.up_proj: 62%|██████▏ | 22683/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.108.down_proj: 62%|██████▏ | 22684/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.109.gate_proj: 62%|██████▏ | 22685/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.109.up_proj: 62%|██████▏ | 22686/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.109.down_proj: 62%|██████▏ | 22687/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.110.gate_proj: 62%|██████▏ | 22688/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.110.up_proj: 62%|██████▏ | 22689/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.110.down_proj: 62%|██████▏ | 22690/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.111.gate_proj: 62%|██████▏ | 22691/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.111.up_proj: 62%|██████▏ | 22692/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.111.down_proj: 62%|██████▏ | 22693/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.112.gate_proj: 62%|██████▏ | 22694/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.112.up_proj: 62%|██████▏ | 22695/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.112.down_proj: 62%|██████▏ | 22696/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.113.gate_proj: 62%|██████▏ | 22697/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.113.up_proj: 62%|██████▏ | 22698/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.113.down_proj: 62%|██████▏ | 22699/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.114.gate_proj: 62%|██████▏ | 22700/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.114.up_proj: 62%|██████▏ | 22701/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.114.down_proj: 62%|██████▏ | 22702/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.115.gate_proj: 62%|██████▏ | 22703/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.115.up_proj: 62%|██████▏ | 22704/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.115.down_proj: 62%|██████▏ | 22705/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.116.gate_proj: 62%|██████▏ | 22706/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.116.up_proj: 62%|██████▏ | 22707/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.116.down_proj: 62%|██████▏ | 22708/36566 [00:20<00:12, 1146.70it/s] packing model.layers.57.mlp.experts.116.down_proj: 62%|██████▏ | 22709/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.117.gate_proj: 62%|██████▏ | 22709/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.117.up_proj: 62%|██████▏ | 22710/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.117.down_proj: 62%|██████▏ | 22711/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.118.gate_proj: 62%|██████▏ | 22712/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.118.up_proj: 62%|██████▏ | 22713/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.118.down_proj: 62%|██████▏ | 22714/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.119.gate_proj: 62%|██████▏ | 22715/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.119.up_proj: 62%|██████▏ | 22716/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.119.down_proj: 62%|██████▏ | 22717/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.120.gate_proj: 62%|██████▏ | 22718/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.120.up_proj: 62%|██████▏ | 22719/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.120.down_proj: 62%|██████▏ | 22720/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.121.gate_proj: 62%|██████▏ | 22721/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.121.up_proj: 62%|██████▏ | 22722/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.121.down_proj: 62%|██████▏ | 22723/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.122.gate_proj: 62%|██████▏ | 22724/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.122.up_proj: 62%|██████▏ | 22725/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.122.down_proj: 62%|██████▏ | 22726/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.123.gate_proj: 62%|██████▏ | 22727/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.123.up_proj: 62%|██████▏ | 22728/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.123.down_proj: 62%|██████▏ | 22729/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.124.gate_proj: 62%|██████▏ | 22730/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.124.up_proj: 62%|██████▏ | 22731/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.124.down_proj: 62%|██████▏ | 22732/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.125.gate_proj: 62%|██████▏ | 22733/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.125.up_proj: 62%|██████▏ | 22734/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.125.down_proj: 62%|██████▏ | 22735/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.126.gate_proj: 62%|██████▏ | 22736/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.126.up_proj: 62%|██████▏ | 22737/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.126.down_proj: 62%|██████▏ | 22738/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.127.gate_proj: 62%|██████▏ | 22739/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.127.up_proj: 62%|██████▏ | 22740/36566 [00:20<00:12, 1147.54it/s] packing model.layers.57.mlp.experts.127.down_proj: 62%|██████▏ | 22741/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.0.gate_proj: 62%|██████▏ | 22742/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.0.up_proj: 62%|██████▏ | 22743/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.0.down_proj: 62%|██████▏ | 22744/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.1.gate_proj: 62%|██████▏ | 22745/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.1.up_proj: 62%|██████▏ | 22746/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.1.down_proj: 62%|██████▏ | 22747/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.2.gate_proj: 62%|██████▏ | 22748/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.2.up_proj: 62%|██████▏ | 22749/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.2.down_proj: 62%|██████▏ | 22750/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.3.gate_proj: 62%|██████▏ | 22751/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.3.up_proj: 62%|██████▏ | 22752/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.3.down_proj: 62%|██████▏ | 22753/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.4.gate_proj: 62%|██████▏ | 22754/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.4.up_proj: 62%|██████▏ | 22755/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.4.down_proj: 62%|██████▏ | 22756/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.5.gate_proj: 62%|██████▏ | 22757/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.5.up_proj: 62%|██████▏ | 22758/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.5.down_proj: 62%|██████▏ | 22759/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.6.gate_proj: 62%|██████▏ | 22760/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.6.up_proj: 62%|██████▏ | 22761/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.6.down_proj: 62%|██████▏ | 22762/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.7.gate_proj: 62%|██████▏ | 22763/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.7.up_proj: 62%|██████▏ | 22764/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.7.down_proj: 62%|██████▏ | 22765/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.8.gate_proj: 62%|██████▏ | 22766/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.8.up_proj: 62%|██████▏ | 22767/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.8.down_proj: 62%|██████▏ | 22768/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.9.gate_proj: 62%|██████▏ | 22769/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.9.up_proj: 62%|██████▏ | 22770/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.9.down_proj: 62%|██████▏ | 22771/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.10.gate_proj: 62%|██████▏ | 22772/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.10.up_proj: 62%|██████▏ | 22773/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.10.down_proj: 62%|██████▏ | 22774/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.11.gate_proj: 62%|██████▏ | 22775/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.11.up_proj: 62%|██████▏ | 22776/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.11.down_proj: 62%|██████▏ | 22777/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.12.gate_proj: 62%|██████▏ | 22778/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.12.up_proj: 62%|██████▏ | 22779/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.12.down_proj: 62%|██████▏ | 22780/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.13.gate_proj: 62%|██████▏ | 22781/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.13.up_proj: 62%|██████▏ | 22782/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.13.down_proj: 62%|██████▏ | 22783/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.14.gate_proj: 62%|██████▏ | 22784/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.14.up_proj: 62%|██████▏ | 22785/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.14.down_proj: 62%|██████▏ | 22786/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.15.gate_proj: 62%|██████▏ | 22787/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.15.up_proj: 62%|██████▏ | 22788/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.15.down_proj: 62%|██████▏ | 22789/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.16.gate_proj: 62%|██████▏ | 22790/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.16.up_proj: 62%|██████▏ | 22791/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.16.down_proj: 62%|██████▏ | 22792/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.17.gate_proj: 62%|██████▏ | 22793/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.17.up_proj: 62%|██████▏ | 22794/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.17.down_proj: 62%|██████▏ | 22795/36566 [00:20<00:12, 1147.54it/s] packing model.layers.58.mlp.experts.18.gate_proj: 62%|██████▏ | 22796/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.18.up_proj: 62%|██████▏ | 22797/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.18.down_proj: 62%|██████▏ | 22798/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.19.gate_proj: 62%|██████▏ | 22799/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.19.up_proj: 62%|██████▏ | 22800/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.19.down_proj: 62%|██████▏ | 22801/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.20.gate_proj: 62%|██████▏ | 22802/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.20.up_proj: 62%|██████▏ | 22803/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.20.down_proj: 62%|██████▏ | 22804/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.21.gate_proj: 62%|██████▏ | 22805/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.21.up_proj: 62%|██████▏ | 22806/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.21.down_proj: 62%|██████▏ | 22807/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.22.gate_proj: 62%|██████▏ | 22808/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.22.up_proj: 62%|██████▏ | 22809/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.22.down_proj: 62%|██████▏ | 22810/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.23.gate_proj: 62%|██████▏ | 22811/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.23.up_proj: 62%|██████▏ | 22812/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.23.down_proj: 62%|██████▏ | 22813/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.24.gate_proj: 62%|██████▏ | 22814/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.24.up_proj: 62%|██████▏ | 22815/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.24.down_proj: 62%|██████▏ | 22816/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.25.gate_proj: 62%|██████▏ | 22817/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.25.up_proj: 62%|██████▏ | 22818/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.25.down_proj: 62%|██████▏ | 22819/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.26.gate_proj: 62%|██████▏ | 22820/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.26.up_proj: 62%|██████▏ | 22821/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.26.down_proj: 62%|██████▏ | 22822/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.27.gate_proj: 62%|██████▏ | 22823/36566 [00:20<00:11, 1147.54it/s] packing model.layers.58.mlp.experts.27.gate_proj: 62%|██████▏ | 22824/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.27.up_proj: 62%|██████▏ | 22824/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.27.down_proj: 62%|██████▏ | 22825/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.28.gate_proj: 62%|██████▏ | 22826/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.28.up_proj: 62%|██████▏ | 22827/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.28.down_proj: 62%|██████▏ | 22828/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.29.gate_proj: 62%|██████▏ | 22829/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.29.up_proj: 62%|██████▏ | 22830/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.29.down_proj: 62%|██████▏ | 22831/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.30.gate_proj: 62%|██████▏ | 22832/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.30.up_proj: 62%|██████▏ | 22833/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.30.down_proj: 62%|██████▏ | 22834/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.31.gate_proj: 62%|██████▏ | 22835/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.31.up_proj: 62%|██████▏ | 22836/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.31.down_proj: 62%|██████▏ | 22837/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.32.gate_proj: 62%|██████▏ | 22838/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.32.up_proj: 62%|██████▏ | 22839/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.32.down_proj: 62%|██████▏ | 22840/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.33.gate_proj: 62%|██████▏ | 22841/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.33.up_proj: 62%|██████▏ | 22842/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.33.down_proj: 62%|██████▏ | 22843/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.34.gate_proj: 62%|██████▏ | 22844/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.34.up_proj: 62%|██████▏ | 22845/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.34.down_proj: 62%|██████▏ | 22846/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.35.gate_proj: 62%|██████▏ | 22847/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.35.up_proj: 62%|██████▏ | 22848/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.35.down_proj: 62%|██████▏ | 22849/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.36.gate_proj: 62%|██████▏ | 22850/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.36.up_proj: 62%|██████▏ | 22851/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.36.down_proj: 62%|██████▏ | 22852/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.37.gate_proj: 62%|██████▏ | 22853/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.37.up_proj: 63%|██████▎ | 22854/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.37.down_proj: 63%|██████▎ | 22855/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.38.gate_proj: 63%|██████▎ | 22856/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.38.up_proj: 63%|██████▎ | 22857/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.38.down_proj: 63%|██████▎ | 22858/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.39.gate_proj: 63%|██████▎ | 22859/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.39.up_proj: 63%|██████▎ | 22860/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.39.down_proj: 63%|██████▎ | 22861/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.40.gate_proj: 63%|██████▎ | 22862/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.40.up_proj: 63%|██████▎ | 22863/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.40.down_proj: 63%|██████▎ | 22864/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.41.gate_proj: 63%|██████▎ | 22865/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.41.up_proj: 63%|██████▎ | 22866/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.41.down_proj: 63%|██████▎ | 22867/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.42.gate_proj: 63%|██████▎ | 22868/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.42.up_proj: 63%|██████▎ | 22869/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.42.down_proj: 63%|██████▎ | 22870/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.43.gate_proj: 63%|██████▎ | 22871/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.43.up_proj: 63%|██████▎ | 22872/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.43.down_proj: 63%|██████▎ | 22873/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.44.gate_proj: 63%|██████▎ | 22874/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.44.up_proj: 63%|██████▎ | 22875/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.44.down_proj: 63%|██████▎ | 22876/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.45.gate_proj: 63%|██████▎ | 22877/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.45.up_proj: 63%|██████▎ | 22878/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.45.down_proj: 63%|██████▎ | 22879/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.46.gate_proj: 63%|██████▎ | 22880/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.46.up_proj: 63%|██████▎ | 22881/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.46.down_proj: 63%|██████▎ | 22882/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.47.gate_proj: 63%|██████▎ | 22883/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.47.up_proj: 63%|██████▎ | 22884/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.47.down_proj: 63%|██████▎ | 22885/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.48.gate_proj: 63%|██████▎ | 22886/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.48.up_proj: 63%|██████▎ | 22887/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.48.down_proj: 63%|██████▎ | 22888/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.49.gate_proj: 63%|██████▎ | 22889/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.49.up_proj: 63%|██████▎ | 22890/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.49.down_proj: 63%|██████▎ | 22891/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.50.gate_proj: 63%|██████▎ | 22892/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.50.up_proj: 63%|██████▎ | 22893/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.50.down_proj: 63%|██████▎ | 22894/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.51.gate_proj: 63%|██████▎ | 22895/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.51.up_proj: 63%|██████▎ | 22896/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.51.down_proj: 63%|██████▎ | 22897/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.52.gate_proj: 63%|██████▎ | 22898/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.52.up_proj: 63%|██████▎ | 22899/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.52.down_proj: 63%|██████▎ | 22900/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.53.gate_proj: 63%|██████▎ | 22901/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.53.up_proj: 63%|██████▎ | 22902/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.53.down_proj: 63%|██████▎ | 22903/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.54.gate_proj: 63%|██████▎ | 22904/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.54.up_proj: 63%|██████▎ | 22905/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.54.down_proj: 63%|██████▎ | 22906/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.55.gate_proj: 63%|██████▎ | 22907/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.55.up_proj: 63%|██████▎ | 22908/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.55.down_proj: 63%|██████▎ | 22909/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.56.gate_proj: 63%|██████▎ | 22910/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.56.up_proj: 63%|██████▎ | 22911/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.56.down_proj: 63%|██████▎ | 22912/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.57.gate_proj: 63%|██████▎ | 22913/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.57.up_proj: 63%|██████▎ | 22914/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.57.down_proj: 63%|██████▎ | 22915/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.58.gate_proj: 63%|██████▎ | 22916/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.58.up_proj: 63%|██████▎ | 22917/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.58.down_proj: 63%|██████▎ | 22918/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.59.gate_proj: 63%|██████▎ | 22919/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.59.up_proj: 63%|██████▎ | 22920/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.59.down_proj: 63%|██████▎ | 22921/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.60.gate_proj: 63%|██████▎ | 22922/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.60.up_proj: 63%|██████▎ | 22923/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.60.down_proj: 63%|██████▎ | 22924/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.61.gate_proj: 63%|██████▎ | 22925/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.61.up_proj: 63%|██████▎ | 22926/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.61.down_proj: 63%|██████▎ | 22927/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.62.gate_proj: 63%|██████▎ | 22928/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.62.up_proj: 63%|██████▎ | 22929/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.62.down_proj: 63%|██████▎ | 22930/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.63.gate_proj: 63%|██████▎ | 22931/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.63.up_proj: 63%|██████▎ | 22932/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.63.down_proj: 63%|██████▎ | 22933/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.64.gate_proj: 63%|██████▎ | 22934/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.64.up_proj: 63%|██████▎ | 22935/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.64.down_proj: 63%|██████▎ | 22936/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.65.gate_proj: 63%|██████▎ | 22937/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.65.up_proj: 63%|██████▎ | 22938/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.65.down_proj: 63%|██████▎ | 22939/36566 [00:20<00:11, 1147.90it/s] packing model.layers.58.mlp.experts.65.down_proj: 63%|██████▎ | 22940/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.66.gate_proj: 63%|██████▎ | 22940/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.66.up_proj: 63%|██████▎ | 22941/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.66.down_proj: 63%|██████▎ | 22942/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.67.gate_proj: 63%|██████▎ | 22943/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.67.up_proj: 63%|██████▎ | 22944/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.67.down_proj: 63%|██████▎ | 22945/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.68.gate_proj: 63%|██████▎ | 22946/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.68.up_proj: 63%|██████▎ | 22947/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.68.down_proj: 63%|██████▎ | 22948/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.69.gate_proj: 63%|██████▎ | 22949/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.69.up_proj: 63%|██████▎ | 22950/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.69.down_proj: 63%|██████▎ | 22951/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.70.gate_proj: 63%|██████▎ | 22952/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.70.up_proj: 63%|██████▎ | 22953/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.70.down_proj: 63%|██████▎ | 22954/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.71.gate_proj: 63%|██████▎ | 22955/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.71.up_proj: 63%|██████▎ | 22956/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.71.down_proj: 63%|██████▎ | 22957/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.72.gate_proj: 63%|██████▎ | 22958/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.72.up_proj: 63%|██████▎ | 22959/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.72.down_proj: 63%|██████▎ | 22960/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.73.gate_proj: 63%|██████▎ | 22961/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.73.up_proj: 63%|██████▎ | 22962/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.73.down_proj: 63%|██████▎ | 22963/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.74.gate_proj: 63%|██████▎ | 22964/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.74.up_proj: 63%|██████▎ | 22965/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.74.down_proj: 63%|██████▎ | 22966/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.75.gate_proj: 63%|██████▎ | 22967/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.75.up_proj: 63%|██████▎ | 22968/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.75.down_proj: 63%|██████▎ | 22969/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.76.gate_proj: 63%|██████▎ | 22970/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.76.up_proj: 63%|██████▎ | 22971/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.76.down_proj: 63%|██████▎ | 22972/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.77.gate_proj: 63%|██████▎ | 22973/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.77.up_proj: 63%|██████▎ | 22974/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.77.down_proj: 63%|██████▎ | 22975/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.78.gate_proj: 63%|██████▎ | 22976/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.78.up_proj: 63%|██████▎ | 22977/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.78.down_proj: 63%|██████▎ | 22978/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.79.gate_proj: 63%|██████▎ | 22979/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.79.up_proj: 63%|██████▎ | 22980/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.79.down_proj: 63%|██████▎ | 22981/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.80.gate_proj: 63%|██████▎ | 22982/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.80.up_proj: 63%|██████▎ | 22983/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.80.down_proj: 63%|██████▎ | 22984/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.81.gate_proj: 63%|██████▎ | 22985/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.81.up_proj: 63%|██████▎ | 22986/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.81.down_proj: 63%|██████▎ | 22987/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.82.gate_proj: 63%|██████▎ | 22988/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.82.up_proj: 63%|██████▎ | 22989/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.82.down_proj: 63%|██████▎ | 22990/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.83.gate_proj: 63%|██████▎ | 22991/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.83.up_proj: 63%|██████▎ | 22992/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.83.down_proj: 63%|██████▎ | 22993/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.84.gate_proj: 63%|██████▎ | 22994/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.84.up_proj: 63%|██████▎ | 22995/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.84.down_proj: 63%|██████▎ | 22996/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.85.gate_proj: 63%|██████▎ | 22997/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.85.up_proj: 63%|██████▎ | 22998/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.85.down_proj: 63%|██████▎ | 22999/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.86.gate_proj: 63%|██████▎ | 23000/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.86.up_proj: 63%|██████▎ | 23001/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.86.down_proj: 63%|██████▎ | 23002/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.87.gate_proj: 63%|██████▎ | 23003/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.87.up_proj: 63%|██████▎ | 23004/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.87.down_proj: 63%|██████▎ | 23005/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.88.gate_proj: 63%|██████▎ | 23006/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.88.up_proj: 63%|██████▎ | 23007/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.88.down_proj: 63%|██████▎ | 23008/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.89.gate_proj: 63%|██████▎ | 23009/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.89.up_proj: 63%|██████▎ | 23010/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.89.down_proj: 63%|██████▎ | 23011/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.90.gate_proj: 63%|██████▎ | 23012/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.90.up_proj: 63%|██████▎ | 23013/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.90.down_proj: 63%|██████▎ | 23014/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.91.gate_proj: 63%|██████▎ | 23015/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.91.up_proj: 63%|██████▎ | 23016/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.91.down_proj: 63%|██████▎ | 23017/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.92.gate_proj: 63%|██████▎ | 23018/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.92.up_proj: 63%|██████▎ | 23019/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.92.down_proj: 63%|██████▎ | 23020/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.93.gate_proj: 63%|██████▎ | 23021/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.93.up_proj: 63%|██████▎ | 23022/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.93.down_proj: 63%|██████▎ | 23023/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.94.gate_proj: 63%|██████▎ | 23024/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.94.up_proj: 63%|██████▎ | 23025/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.94.down_proj: 63%|██████▎ | 23026/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.95.gate_proj: 63%|██████▎ | 23027/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.95.up_proj: 63%|██████▎ | 23028/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.95.down_proj: 63%|██████▎ | 23029/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.96.gate_proj: 63%|██████▎ | 23030/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.96.up_proj: 63%|██████▎ | 23031/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.96.down_proj: 63%|██████▎ | 23032/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.97.gate_proj: 63%|██████▎ | 23033/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.97.up_proj: 63%|██████▎ | 23034/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.97.down_proj: 63%|██████▎ | 23035/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.98.gate_proj: 63%|██████▎ | 23036/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.98.up_proj: 63%|██████▎ | 23037/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.98.down_proj: 63%|██████▎ | 23038/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.99.gate_proj: 63%|██████▎ | 23039/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.99.up_proj: 63%|██████▎ | 23040/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.99.down_proj: 63%|██████▎ | 23041/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.100.gate_proj: 63%|██████▎ | 23042/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.100.up_proj: 63%|██████▎ | 23043/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.100.down_proj: 63%|██████▎ | 23044/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.101.gate_proj: 63%|██████▎ | 23045/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.101.up_proj: 63%|██████▎ | 23046/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.101.down_proj: 63%|██████▎ | 23047/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.102.gate_proj: 63%|██████▎ | 23048/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.102.up_proj: 63%|██████▎ | 23049/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.102.down_proj: 63%|██████▎ | 23050/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.103.gate_proj: 63%|██████▎ | 23051/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.103.up_proj: 63%|██████▎ | 23052/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.103.down_proj: 63%|██████▎ | 23053/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.104.gate_proj: 63%|██████▎ | 23054/36566 [00:20<00:11, 1149.81it/s] packing model.layers.58.mlp.experts.104.gate_proj: 63%|██████▎ | 23055/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.104.up_proj: 63%|██████▎ | 23055/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.104.down_proj: 63%|██████▎ | 23056/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.105.gate_proj: 63%|██████▎ | 23057/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.105.up_proj: 63%|██████▎ | 23058/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.105.down_proj: 63%|██████▎ | 23059/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.106.gate_proj: 63%|██████▎ | 23060/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.106.up_proj: 63%|██████▎ | 23061/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.106.down_proj: 63%|██████▎ | 23062/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.107.gate_proj: 63%|██████▎ | 23063/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.107.up_proj: 63%|██████▎ | 23064/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.107.down_proj: 63%|██████▎ | 23065/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.108.gate_proj: 63%|██████▎ | 23066/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.108.up_proj: 63%|██████▎ | 23067/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.108.down_proj: 63%|██████▎ | 23068/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.109.gate_proj: 63%|██████▎ | 23069/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.109.up_proj: 63%|██████▎ | 23070/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.109.down_proj: 63%|██████▎ | 23071/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.110.gate_proj: 63%|██████▎ | 23072/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.110.up_proj: 63%|██████▎ | 23073/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.110.down_proj: 63%|██████▎ | 23074/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.111.gate_proj: 63%|██████▎ | 23075/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.111.up_proj: 63%|██████▎ | 23076/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.111.down_proj: 63%|██████▎ | 23077/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.112.gate_proj: 63%|██████▎ | 23078/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.112.up_proj: 63%|██████▎ | 23079/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.112.down_proj: 63%|██████▎ | 23080/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.113.gate_proj: 63%|██████▎ | 23081/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.113.up_proj: 63%|██████▎ | 23082/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.113.down_proj: 63%|██████▎ | 23083/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.114.gate_proj: 63%|██████▎ | 23084/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.114.up_proj: 63%|██████▎ | 23085/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.114.down_proj: 63%|██████▎ | 23086/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.115.gate_proj: 63%|██████▎ | 23087/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.115.up_proj: 63%|██████▎ | 23088/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.115.down_proj: 63%|██████▎ | 23089/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.116.gate_proj: 63%|██████▎ | 23090/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.116.up_proj: 63%|██████▎ | 23091/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.116.down_proj: 63%|██████▎ | 23092/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.117.gate_proj: 63%|██████▎ | 23093/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.117.up_proj: 63%|██████▎ | 23094/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.117.down_proj: 63%|██████▎ | 23095/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.118.gate_proj: 63%|██████▎ | 23096/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.118.up_proj: 63%|██████▎ | 23097/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.118.down_proj: 63%|██████▎ | 23098/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.119.gate_proj: 63%|██████▎ | 23099/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.119.up_proj: 63%|██████▎ | 23100/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.119.down_proj: 63%|██████▎ | 23101/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.120.gate_proj: 63%|██████▎ | 23102/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.120.up_proj: 63%|██████▎ | 23103/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.120.down_proj: 63%|██████▎ | 23104/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.121.gate_proj: 63%|██████▎ | 23105/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.121.up_proj: 63%|██████▎ | 23106/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.121.down_proj: 63%|██████▎ | 23107/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.122.gate_proj: 63%|██████▎ | 23108/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.122.up_proj: 63%|██████▎ | 23109/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.122.down_proj: 63%|██████▎ | 23110/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.123.gate_proj: 63%|██████▎ | 23111/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.123.up_proj: 63%|██████▎ | 23112/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.123.down_proj: 63%|██████▎ | 23113/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.124.gate_proj: 63%|██████▎ | 23114/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.124.up_proj: 63%|██████▎ | 23115/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.124.down_proj: 63%|██████▎ | 23116/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.125.gate_proj: 63%|██████▎ | 23117/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.125.up_proj: 63%|██████▎ | 23118/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.125.down_proj: 63%|██████▎ | 23119/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.126.gate_proj: 63%|██████▎ | 23120/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.126.up_proj: 63%|██████▎ | 23121/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.126.down_proj: 63%|██████▎ | 23122/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.127.gate_proj: 63%|██████▎ | 23123/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.127.up_proj: 63%|██████▎ | 23124/36566 [00:20<00:11, 1148.76it/s] packing model.layers.58.mlp.experts.127.down_proj: 63%|██████▎ | 23125/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.0.gate_proj: 63%|██████▎ | 23126/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.0.up_proj: 63%|██████▎ | 23127/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.0.down_proj: 63%|██████▎ | 23128/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.1.gate_proj: 63%|██████▎ | 23129/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.1.up_proj: 63%|██████▎ | 23130/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.1.down_proj: 63%|██████▎ | 23131/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.2.gate_proj: 63%|██████▎ | 23132/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.2.up_proj: 63%|██████▎ | 23133/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.2.down_proj: 63%|██████▎ | 23134/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.3.gate_proj: 63%|██████▎ | 23135/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.3.up_proj: 63%|██████▎ | 23136/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.3.down_proj: 63%|██████▎ | 23137/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.4.gate_proj: 63%|██████▎ | 23138/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.4.up_proj: 63%|██████▎ | 23139/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.4.down_proj: 63%|██████▎ | 23140/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.5.gate_proj: 63%|██████▎ | 23141/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.5.up_proj: 63%|██████▎ | 23142/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.5.down_proj: 63%|██████▎ | 23143/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.6.gate_proj: 63%|██████▎ | 23144/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.6.up_proj: 63%|██████▎ | 23145/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.6.down_proj: 63%|██████▎ | 23146/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.7.gate_proj: 63%|██████▎ | 23147/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.7.up_proj: 63%|██████▎ | 23148/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.7.down_proj: 63%|██████▎ | 23149/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.8.gate_proj: 63%|██████▎ | 23150/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.8.up_proj: 63%|██████▎ | 23151/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.8.down_proj: 63%|██████▎ | 23152/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.9.gate_proj: 63%|██████▎ | 23153/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.9.up_proj: 63%|██████▎ | 23154/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.9.down_proj: 63%|██████▎ | 23155/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.10.gate_proj: 63%|██████▎ | 23156/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.10.up_proj: 63%|██████▎ | 23157/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.10.down_proj: 63%|██████▎ | 23158/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.11.gate_proj: 63%|██████▎ | 23159/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.11.up_proj: 63%|██████▎ | 23160/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.11.down_proj: 63%|██████▎ | 23161/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.12.gate_proj: 63%|██████▎ | 23162/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.12.up_proj: 63%|██████▎ | 23163/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.12.down_proj: 63%|██████▎ | 23164/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.13.gate_proj: 63%|██████▎ | 23165/36566 [00:20<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.13.up_proj: 63%|██████▎ | 23166/36566 [00:21<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.13.down_proj: 63%|██████▎ | 23167/36566 [00:21<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.14.gate_proj: 63%|██████▎ | 23168/36566 [00:21<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.14.up_proj: 63%|██████▎ | 23169/36566 [00:21<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.14.down_proj: 63%|██████▎ | 23170/36566 [00:21<00:11, 1148.76it/s] packing model.layers.59.mlp.experts.14.down_proj: 63%|██████▎ | 23171/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.15.gate_proj: 63%|██████▎ | 23171/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.15.up_proj: 63%|██████▎ | 23172/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.15.down_proj: 63%|██████▎ | 23173/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.16.gate_proj: 63%|██████▎ | 23174/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.16.up_proj: 63%|██████▎ | 23175/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.16.down_proj: 63%|██████▎ | 23176/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.17.gate_proj: 63%|██████▎ | 23177/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.17.up_proj: 63%|██████▎ | 23178/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.17.down_proj: 63%|██████▎ | 23179/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.18.gate_proj: 63%|██████▎ | 23180/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.18.up_proj: 63%|██████▎ | 23181/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.18.down_proj: 63%|██████▎ | 23182/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.19.gate_proj: 63%|██████▎ | 23183/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.19.up_proj: 63%|██████▎ | 23184/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.19.down_proj: 63%|██████▎ | 23185/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.20.gate_proj: 63%|██████▎ | 23186/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.20.up_proj: 63%|██████▎ | 23187/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.20.down_proj: 63%|██████▎ | 23188/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.21.gate_proj: 63%|██████▎ | 23189/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.21.up_proj: 63%|██████▎ | 23190/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.21.down_proj: 63%|██████▎ | 23191/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.22.gate_proj: 63%|██████▎ | 23192/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.22.up_proj: 63%|██████▎ | 23193/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.22.down_proj: 63%|██████▎ | 23194/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.23.gate_proj: 63%|██████▎ | 23195/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.23.up_proj: 63%|██████▎ | 23196/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.23.down_proj: 63%|██████▎ | 23197/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.24.gate_proj: 63%|██████▎ | 23198/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.24.up_proj: 63%|██████▎ | 23199/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.24.down_proj: 63%|██████▎ | 23200/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.25.gate_proj: 63%|██████▎ | 23201/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.25.up_proj: 63%|██████▎ | 23202/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.25.down_proj: 63%|██████▎ | 23203/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.26.gate_proj: 63%|██████▎ | 23204/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.26.up_proj: 63%|██████▎ | 23205/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.26.down_proj: 63%|██████▎ | 23206/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.27.gate_proj: 63%|██████▎ | 23207/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.27.up_proj: 63%|██████▎ | 23208/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.27.down_proj: 63%|██████▎ | 23209/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.28.gate_proj: 63%|██████▎ | 23210/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.28.up_proj: 63%|██████▎ | 23211/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.28.down_proj: 63%|██████▎ | 23212/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.29.gate_proj: 63%|██████▎ | 23213/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.29.up_proj: 63%|██████▎ | 23214/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.29.down_proj: 63%|██████▎ | 23215/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.30.gate_proj: 63%|██████▎ | 23216/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.30.up_proj: 63%|██████▎ | 23217/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.30.down_proj: 63%|██████▎ | 23218/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.31.gate_proj: 63%|██████▎ | 23219/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.31.up_proj: 64%|██████▎ | 23220/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.31.down_proj: 64%|██████▎ | 23221/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.32.gate_proj: 64%|██████▎ | 23222/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.32.up_proj: 64%|██████▎ | 23223/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.32.down_proj: 64%|██████▎ | 23224/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.33.gate_proj: 64%|██████▎ | 23225/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.33.up_proj: 64%|██████▎ | 23226/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.33.down_proj: 64%|██████▎ | 23227/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.34.gate_proj: 64%|██████▎ | 23228/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.34.up_proj: 64%|██████▎ | 23229/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.34.down_proj: 64%|██████▎ | 23230/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.35.gate_proj: 64%|██████▎ | 23231/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.35.up_proj: 64%|██████▎ | 23232/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.35.down_proj: 64%|██████▎ | 23233/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.36.gate_proj: 64%|██████▎ | 23234/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.36.up_proj: 64%|██████▎ | 23235/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.36.down_proj: 64%|██████▎ | 23236/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.37.gate_proj: 64%|██████▎ | 23237/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.37.up_proj: 64%|██████▎ | 23238/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.37.down_proj: 64%|██████▎ | 23239/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.38.gate_proj: 64%|██████▎ | 23240/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.38.up_proj: 64%|██████▎ | 23241/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.38.down_proj: 64%|██████▎ | 23242/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.39.gate_proj: 64%|██████▎ | 23243/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.39.up_proj: 64%|██████▎ | 23244/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.39.down_proj: 64%|██████▎ | 23245/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.40.gate_proj: 64%|██████▎ | 23246/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.40.up_proj: 64%|██████▎ | 23247/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.40.down_proj: 64%|██████▎ | 23248/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.41.gate_proj: 64%|██████▎ | 23249/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.41.up_proj: 64%|██████▎ | 23250/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.41.down_proj: 64%|██████▎ | 23251/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.42.gate_proj: 64%|██████▎ | 23252/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.42.up_proj: 64%|██████▎ | 23253/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.42.down_proj: 64%|██████▎ | 23254/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.43.gate_proj: 64%|██████▎ | 23255/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.43.up_proj: 64%|██████▎ | 23256/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.43.down_proj: 64%|██████▎ | 23257/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.44.gate_proj: 64%|██████▎ | 23258/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.44.up_proj: 64%|██████▎ | 23259/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.44.down_proj: 64%|██████▎ | 23260/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.45.gate_proj: 64%|██████▎ | 23261/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.45.up_proj: 64%|██████▎ | 23262/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.45.down_proj: 64%|██████▎ | 23263/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.46.gate_proj: 64%|██████▎ | 23264/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.46.up_proj: 64%|██████▎ | 23265/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.46.down_proj: 64%|██████▎ | 23266/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.47.gate_proj: 64%|██████▎ | 23267/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.47.up_proj: 64%|██████▎ | 23268/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.47.down_proj: 64%|██████▎ | 23269/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.48.gate_proj: 64%|██████▎ | 23270/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.48.up_proj: 64%|██████▎ | 23271/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.48.down_proj: 64%|██████▎ | 23272/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.49.gate_proj: 64%|██████▎ | 23273/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.49.up_proj: 64%|██████▎ | 23274/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.49.down_proj: 64%|██████▎ | 23275/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.50.gate_proj: 64%|██████▎ | 23276/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.50.up_proj: 64%|██████▎ | 23277/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.50.down_proj: 64%|██████▎ | 23278/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.51.gate_proj: 64%|██████▎ | 23279/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.51.up_proj: 64%|██████▎ | 23280/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.51.down_proj: 64%|██████▎ | 23281/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.52.gate_proj: 64%|██████▎ | 23282/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.52.up_proj: 64%|██████▎ | 23283/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.52.down_proj: 64%|██████▎ | 23284/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.53.gate_proj: 64%|██████▎ | 23285/36566 [00:21<00:11, 1149.11it/s] packing model.layers.59.mlp.experts.53.gate_proj: 64%|██████▎ | 23286/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.53.up_proj: 64%|██████▎ | 23286/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.53.down_proj: 64%|██████▎ | 23287/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.54.gate_proj: 64%|██████▎ | 23288/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.54.up_proj: 64%|██████▎ | 23289/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.54.down_proj: 64%|██████▎ | 23290/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.55.gate_proj: 64%|██████▎ | 23291/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.55.up_proj: 64%|██████▎ | 23292/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.55.down_proj: 64%|██████▎ | 23293/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.56.gate_proj: 64%|██████▎ | 23294/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.56.up_proj: 64%|██████▎ | 23295/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.56.down_proj: 64%|██████▎ | 23296/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.57.gate_proj: 64%|██████▎ | 23297/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.57.up_proj: 64%|██████▎ | 23298/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.57.down_proj: 64%|██████▎ | 23299/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.58.gate_proj: 64%|██████▎ | 23300/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.58.up_proj: 64%|██████▎ | 23301/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.58.down_proj: 64%|██████▎ | 23302/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.59.gate_proj: 64%|██████▎ | 23303/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.59.up_proj: 64%|██████▎ | 23304/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.59.down_proj: 64%|██████▎ | 23305/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.60.gate_proj: 64%|██████▎ | 23306/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.60.up_proj: 64%|██████▎ | 23307/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.60.down_proj: 64%|██████▎ | 23308/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.61.gate_proj: 64%|██████▎ | 23309/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.61.up_proj: 64%|██████▎ | 23310/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.61.down_proj: 64%|██████▍ | 23311/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.62.gate_proj: 64%|██████▍ | 23312/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.62.up_proj: 64%|██████▍ | 23313/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.62.down_proj: 64%|██████▍ | 23314/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.63.gate_proj: 64%|██████▍ | 23315/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.63.up_proj: 64%|██████▍ | 23316/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.63.down_proj: 64%|██████▍ | 23317/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.64.gate_proj: 64%|██████▍ | 23318/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.64.up_proj: 64%|██████▍ | 23319/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.64.down_proj: 64%|██████▍ | 23320/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.65.gate_proj: 64%|██████▍ | 23321/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.65.up_proj: 64%|██████▍ | 23322/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.65.down_proj: 64%|██████▍ | 23323/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.66.gate_proj: 64%|██████▍ | 23324/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.66.up_proj: 64%|██████▍ | 23325/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.66.down_proj: 64%|██████▍ | 23326/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.67.gate_proj: 64%|██████▍ | 23327/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.67.up_proj: 64%|██████▍ | 23328/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.67.down_proj: 64%|██████▍ | 23329/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.68.gate_proj: 64%|██████▍ | 23330/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.68.up_proj: 64%|██████▍ | 23331/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.68.down_proj: 64%|██████▍ | 23332/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.69.gate_proj: 64%|██████▍ | 23333/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.69.up_proj: 64%|██████▍ | 23334/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.69.down_proj: 64%|██████▍ | 23335/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.70.gate_proj: 64%|██████▍ | 23336/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.70.up_proj: 64%|██████▍ | 23337/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.70.down_proj: 64%|██████▍ | 23338/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.71.gate_proj: 64%|██████▍ | 23339/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.71.up_proj: 64%|██████▍ | 23340/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.71.down_proj: 64%|██████▍ | 23341/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.72.gate_proj: 64%|██████▍ | 23342/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.72.up_proj: 64%|██████▍ | 23343/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.72.down_proj: 64%|██████▍ | 23344/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.73.gate_proj: 64%|██████▍ | 23345/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.73.up_proj: 64%|██████▍ | 23346/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.73.down_proj: 64%|██████▍ | 23347/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.74.gate_proj: 64%|██████▍ | 23348/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.74.up_proj: 64%|██████▍ | 23349/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.74.down_proj: 64%|██████▍ | 23350/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.75.gate_proj: 64%|██████▍ | 23351/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.75.up_proj: 64%|██████▍ | 23352/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.75.down_proj: 64%|██████▍ | 23353/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.76.gate_proj: 64%|██████▍ | 23354/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.76.up_proj: 64%|██████▍ | 23355/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.76.down_proj: 64%|██████▍ | 23356/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.77.gate_proj: 64%|██████▍ | 23357/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.77.up_proj: 64%|██████▍ | 23358/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.77.down_proj: 64%|██████▍ | 23359/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.78.gate_proj: 64%|██████▍ | 23360/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.78.up_proj: 64%|██████▍ | 23361/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.78.down_proj: 64%|██████▍ | 23362/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.79.gate_proj: 64%|██████▍ | 23363/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.79.up_proj: 64%|██████▍ | 23364/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.79.down_proj: 64%|██████▍ | 23365/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.80.gate_proj: 64%|██████▍ | 23366/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.80.up_proj: 64%|██████▍ | 23367/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.80.down_proj: 64%|██████▍ | 23368/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.81.gate_proj: 64%|██████▍ | 23369/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.81.up_proj: 64%|██████▍ | 23370/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.81.down_proj: 64%|██████▍ | 23371/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.82.gate_proj: 64%|██████▍ | 23372/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.82.up_proj: 64%|██████▍ | 23373/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.82.down_proj: 64%|██████▍ | 23374/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.83.gate_proj: 64%|██████▍ | 23375/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.83.up_proj: 64%|██████▍ | 23376/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.83.down_proj: 64%|██████▍ | 23377/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.84.gate_proj: 64%|██████▍ | 23378/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.84.up_proj: 64%|██████▍ | 23379/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.84.down_proj: 64%|██████▍ | 23380/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.85.gate_proj: 64%|██████▍ | 23381/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.85.up_proj: 64%|██████▍ | 23382/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.85.down_proj: 64%|██████▍ | 23383/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.86.gate_proj: 64%|██████▍ | 23384/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.86.up_proj: 64%|██████▍ | 23385/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.86.down_proj: 64%|██████▍ | 23386/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.87.gate_proj: 64%|██████▍ | 23387/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.87.up_proj: 64%|██████▍ | 23388/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.87.down_proj: 64%|██████▍ | 23389/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.88.gate_proj: 64%|██████▍ | 23390/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.88.up_proj: 64%|██████▍ | 23391/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.88.down_proj: 64%|██████▍ | 23392/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.89.gate_proj: 64%|██████▍ | 23393/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.89.up_proj: 64%|██████▍ | 23394/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.89.down_proj: 64%|██████▍ | 23395/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.90.gate_proj: 64%|██████▍ | 23396/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.90.up_proj: 64%|██████▍ | 23397/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.90.down_proj: 64%|██████▍ | 23398/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.91.gate_proj: 64%|██████▍ | 23399/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.91.up_proj: 64%|██████▍ | 23400/36566 [00:21<00:11, 1148.74it/s] packing model.layers.59.mlp.experts.91.up_proj: 64%|██████▍ | 23401/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.91.down_proj: 64%|██████▍ | 23401/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.92.gate_proj: 64%|██████▍ | 23402/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.92.up_proj: 64%|██████▍ | 23403/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.92.down_proj: 64%|██████▍ | 23404/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.93.gate_proj: 64%|██████▍ | 23405/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.93.up_proj: 64%|██████▍ | 23406/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.93.down_proj: 64%|██████▍ | 23407/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.94.gate_proj: 64%|██████▍ | 23408/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.94.up_proj: 64%|██████▍ | 23409/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.94.down_proj: 64%|██████▍ | 23410/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.95.gate_proj: 64%|██████▍ | 23411/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.95.up_proj: 64%|██████▍ | 23412/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.95.down_proj: 64%|██████▍ | 23413/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.96.gate_proj: 64%|██████▍ | 23414/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.96.up_proj: 64%|██████▍ | 23415/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.96.down_proj: 64%|██████▍ | 23416/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.97.gate_proj: 64%|██████▍ | 23417/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.97.up_proj: 64%|██████▍ | 23418/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.97.down_proj: 64%|██████▍ | 23419/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.98.gate_proj: 64%|██████▍ | 23420/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.98.up_proj: 64%|██████▍ | 23421/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.98.down_proj: 64%|██████▍ | 23422/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.99.gate_proj: 64%|██████▍ | 23423/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.99.up_proj: 64%|██████▍ | 23424/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.99.down_proj: 64%|██████▍ | 23425/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.100.gate_proj: 64%|██████▍ | 23426/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.100.up_proj: 64%|██████▍ | 23427/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.100.down_proj: 64%|██████▍ | 23428/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.101.gate_proj: 64%|██████▍ | 23429/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.101.up_proj: 64%|██████▍ | 23430/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.101.down_proj: 64%|██████▍ | 23431/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.102.gate_proj: 64%|██████▍ | 23432/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.102.up_proj: 64%|██████▍ | 23433/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.102.down_proj: 64%|██████▍ | 23434/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.103.gate_proj: 64%|██████▍ | 23435/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.103.up_proj: 64%|██████▍ | 23436/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.103.down_proj: 64%|██████▍ | 23437/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.104.gate_proj: 64%|██████▍ | 23438/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.104.up_proj: 64%|██████▍ | 23439/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.104.down_proj: 64%|██████▍ | 23440/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.105.gate_proj: 64%|██████▍ | 23441/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.105.up_proj: 64%|██████▍ | 23442/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.105.down_proj: 64%|██████▍ | 23443/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.106.gate_proj: 64%|██████▍ | 23444/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.106.up_proj: 64%|██████▍ | 23445/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.106.down_proj: 64%|██████▍ | 23446/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.107.gate_proj: 64%|██████▍ | 23447/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.107.up_proj: 64%|██████▍ | 23448/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.107.down_proj: 64%|██████▍ | 23449/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.108.gate_proj: 64%|██████▍ | 23450/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.108.up_proj: 64%|██████▍ | 23451/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.108.down_proj: 64%|██████▍ | 23452/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.109.gate_proj: 64%|██████▍ | 23453/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.109.up_proj: 64%|██████▍ | 23454/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.109.down_proj: 64%|██████▍ | 23455/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.110.gate_proj: 64%|██████▍ | 23456/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.110.up_proj: 64%|██████▍ | 23457/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.110.down_proj: 64%|██████▍ | 23458/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.111.gate_proj: 64%|██████▍ | 23459/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.111.up_proj: 64%|██████▍ | 23460/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.111.down_proj: 64%|██████▍ | 23461/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.112.gate_proj: 64%|██████▍ | 23462/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.112.up_proj: 64%|██████▍ | 23463/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.112.down_proj: 64%|██████▍ | 23464/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.113.gate_proj: 64%|██████▍ | 23465/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.113.up_proj: 64%|██████▍ | 23466/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.113.down_proj: 64%|██████▍ | 23467/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.114.gate_proj: 64%|██████▍ | 23468/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.114.up_proj: 64%|██████▍ | 23469/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.114.down_proj: 64%|██████▍ | 23470/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.115.gate_proj: 64%|██████▍ | 23471/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.115.up_proj: 64%|██████▍ | 23472/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.115.down_proj: 64%|██████▍ | 23473/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.116.gate_proj: 64%|██████▍ | 23474/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.116.up_proj: 64%|██████▍ | 23475/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.116.down_proj: 64%|██████▍ | 23476/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.117.gate_proj: 64%|██████▍ | 23477/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.117.up_proj: 64%|██████▍ | 23478/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.117.down_proj: 64%|██████▍ | 23479/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.118.gate_proj: 64%|██████▍ | 23480/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.118.up_proj: 64%|██████▍ | 23481/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.118.down_proj: 64%|██████▍ | 23482/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.119.gate_proj: 64%|██████▍ | 23483/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.119.up_proj: 64%|██████▍ | 23484/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.119.down_proj: 64%|██████▍ | 23485/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.120.gate_proj: 64%|██████▍ | 23486/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.120.up_proj: 64%|██████▍ | 23487/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.120.down_proj: 64%|██████▍ | 23488/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.121.gate_proj: 64%|██████▍ | 23489/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.121.up_proj: 64%|██████▍ | 23490/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.121.down_proj: 64%|██████▍ | 23491/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.122.gate_proj: 64%|██████▍ | 23492/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.122.up_proj: 64%|██████▍ | 23493/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.122.down_proj: 64%|██████▍ | 23494/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.123.gate_proj: 64%|██████▍ | 23495/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.123.up_proj: 64%|██████▍ | 23496/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.123.down_proj: 64%|██████▍ | 23497/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.124.gate_proj: 64%|██████▍ | 23498/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.124.up_proj: 64%|██████▍ | 23499/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.124.down_proj: 64%|██████▍ | 23500/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.125.gate_proj: 64%|██████▍ | 23501/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.125.up_proj: 64%|██████▍ | 23502/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.125.down_proj: 64%|██████▍ | 23503/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.126.gate_proj: 64%|██████▍ | 23504/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.126.up_proj: 64%|██████▍ | 23505/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.126.down_proj: 64%|██████▍ | 23506/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.127.gate_proj: 64%|██████▍ | 23507/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.127.up_proj: 64%|██████▍ | 23508/36566 [00:21<00:11, 1149.05it/s] packing model.layers.59.mlp.experts.127.down_proj: 64%|██████▍ | 23509/36566 [00:21<00:11, 1149.05it/s] packing model.layers.60.mlp.experts.0.gate_proj: 64%|██████▍ | 23510/36566 [00:21<00:11, 1149.05it/s] packing model.layers.60.mlp.experts.0.up_proj: 64%|██████▍ | 23511/36566 [00:21<00:11, 1149.05it/s] packing model.layers.60.mlp.experts.0.down_proj: 64%|██████▍ | 23512/36566 [00:21<00:11, 1149.05it/s] packing model.layers.60.mlp.experts.1.gate_proj: 64%|██████▍ | 23513/36566 [00:21<00:11, 1149.05it/s] packing model.layers.60.mlp.experts.1.up_proj: 64%|██████▍ | 23514/36566 [00:21<00:11, 1149.05it/s] packing model.layers.60.mlp.experts.1.down_proj: 64%|██████▍ | 23515/36566 [00:21<00:11, 1149.05it/s] packing model.layers.60.mlp.experts.1.down_proj: 64%|██████▍ | 23516/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.2.gate_proj: 64%|██████▍ | 23516/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.2.up_proj: 64%|██████▍ | 23517/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.2.down_proj: 64%|██████▍ | 23518/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.3.gate_proj: 64%|██████▍ | 23519/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.3.up_proj: 64%|██████▍ | 23520/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.3.down_proj: 64%|██████▍ | 23521/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.4.gate_proj: 64%|██████▍ | 23522/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.4.up_proj: 64%|██████▍ | 23523/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.4.down_proj: 64%|██████▍ | 23524/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.5.gate_proj: 64%|██████▍ | 23525/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.5.up_proj: 64%|██████▍ | 23526/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.5.down_proj: 64%|██████▍ | 23527/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.6.gate_proj: 64%|██████▍ | 23528/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.6.up_proj: 64%|██████▍ | 23529/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.6.down_proj: 64%|██████▍ | 23530/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.7.gate_proj: 64%|██████▍ | 23531/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.7.up_proj: 64%|██████▍ | 23532/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.7.down_proj: 64%|██████▍ | 23533/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.8.gate_proj: 64%|██████▍ | 23534/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.8.up_proj: 64%|██████▍ | 23535/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.8.down_proj: 64%|██████▍ | 23536/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.9.gate_proj: 64%|██████▍ | 23537/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.9.up_proj: 64%|██████▍ | 23538/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.9.down_proj: 64%|██████▍ | 23539/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.10.gate_proj: 64%|██████▍ | 23540/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.10.up_proj: 64%|██████▍ | 23541/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.10.down_proj: 64%|██████▍ | 23542/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.11.gate_proj: 64%|██████▍ | 23543/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.11.up_proj: 64%|██████▍ | 23544/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.11.down_proj: 64%|██████▍ | 23545/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.12.gate_proj: 64%|██████▍ | 23546/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.12.up_proj: 64%|██████▍ | 23547/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.12.down_proj: 64%|██████▍ | 23548/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.13.gate_proj: 64%|██████▍ | 23549/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.13.up_proj: 64%|██████▍ | 23550/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.13.down_proj: 64%|██████▍ | 23551/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.14.gate_proj: 64%|██████▍ | 23552/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.14.up_proj: 64%|██████▍ | 23553/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.14.down_proj: 64%|██████▍ | 23554/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.15.gate_proj: 64%|██████▍ | 23555/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.15.up_proj: 64%|██████▍ | 23556/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.15.down_proj: 64%|██████▍ | 23557/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.16.gate_proj: 64%|██████▍ | 23558/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.16.up_proj: 64%|██████▍ | 23559/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.16.down_proj: 64%|██████▍ | 23560/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.17.gate_proj: 64%|██████▍ | 23561/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.17.up_proj: 64%|██████▍ | 23562/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.17.down_proj: 64%|██████▍ | 23563/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.18.gate_proj: 64%|██████▍ | 23564/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.18.up_proj: 64%|██████▍ | 23565/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.18.down_proj: 64%|██████▍ | 23566/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.19.gate_proj: 64%|██████▍ | 23567/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.19.up_proj: 64%|██████▍ | 23568/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.19.down_proj: 64%|██████▍ | 23569/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.20.gate_proj: 64%|██████▍ | 23570/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.20.up_proj: 64%|██████▍ | 23571/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.20.down_proj: 64%|██████▍ | 23572/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.21.gate_proj: 64%|██████▍ | 23573/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.21.up_proj: 64%|██████▍ | 23574/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.21.down_proj: 64%|██████▍ | 23575/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.22.gate_proj: 64%|██████▍ | 23576/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.22.up_proj: 64%|██████▍ | 23577/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.22.down_proj: 64%|██████▍ | 23578/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.23.gate_proj: 64%|██████▍ | 23579/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.23.up_proj: 64%|██████▍ | 23580/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.23.down_proj: 64%|██████▍ | 23581/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.24.gate_proj: 64%|██████▍ | 23582/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.24.up_proj: 64%|██████▍ | 23583/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.24.down_proj: 64%|██████▍ | 23584/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.25.gate_proj: 64%|██████▍ | 23585/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.25.up_proj: 65%|██████▍ | 23586/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.25.down_proj: 65%|██████▍ | 23587/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.26.gate_proj: 65%|██████▍ | 23588/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.26.up_proj: 65%|██████▍ | 23589/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.26.down_proj: 65%|██████▍ | 23590/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.27.gate_proj: 65%|██████▍ | 23591/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.27.up_proj: 65%|██████▍ | 23592/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.27.down_proj: 65%|██████▍ | 23593/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.28.gate_proj: 65%|██████▍ | 23594/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.28.up_proj: 65%|██████▍ | 23595/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.28.down_proj: 65%|██████▍ | 23596/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.29.gate_proj: 65%|██████▍ | 23597/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.29.up_proj: 65%|██████▍ | 23598/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.29.down_proj: 65%|██████▍ | 23599/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.30.gate_proj: 65%|██████▍ | 23600/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.30.up_proj: 65%|██████▍ | 23601/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.30.down_proj: 65%|██████▍ | 23602/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.31.gate_proj: 65%|██████▍ | 23603/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.31.up_proj: 65%|██████▍ | 23604/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.31.down_proj: 65%|██████▍ | 23605/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.32.gate_proj: 65%|██████▍ | 23606/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.32.up_proj: 65%|██████▍ | 23607/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.32.down_proj: 65%|██████▍ | 23608/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.33.gate_proj: 65%|██████▍ | 23609/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.33.up_proj: 65%|██████▍ | 23610/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.33.down_proj: 65%|██████▍ | 23611/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.34.gate_proj: 65%|██████▍ | 23612/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.34.up_proj: 65%|██████▍ | 23613/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.34.down_proj: 65%|██████▍ | 23614/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.35.gate_proj: 65%|██████▍ | 23615/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.35.up_proj: 65%|██████▍ | 23616/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.35.down_proj: 65%|██████▍ | 23617/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.36.gate_proj: 65%|██████▍ | 23618/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.36.up_proj: 65%|██████▍ | 23619/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.36.down_proj: 65%|██████▍ | 23620/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.37.gate_proj: 65%|██████▍ | 23621/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.37.up_proj: 65%|██████▍ | 23622/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.37.down_proj: 65%|██████▍ | 23623/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.38.gate_proj: 65%|██████▍ | 23624/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.38.up_proj: 65%|██████▍ | 23625/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.38.down_proj: 65%|██████▍ | 23626/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.39.gate_proj: 65%|██████▍ | 23627/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.39.up_proj: 65%|██████▍ | 23628/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.39.down_proj: 65%|██████▍ | 23629/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.40.gate_proj: 65%|██████▍ | 23630/36566 [00:21<00:11, 1147.51it/s] packing model.layers.60.mlp.experts.40.gate_proj: 65%|██████▍ | 23631/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.40.up_proj: 65%|██████▍ | 23631/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.40.down_proj: 65%|██████▍ | 23632/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.41.gate_proj: 65%|██████▍ | 23633/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.41.up_proj: 65%|██████▍ | 23634/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.41.down_proj: 65%|██████▍ | 23635/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.42.gate_proj: 65%|██████▍ | 23636/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.42.up_proj: 65%|██████▍ | 23637/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.42.down_proj: 65%|██████▍ | 23638/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.43.gate_proj: 65%|██████▍ | 23639/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.43.up_proj: 65%|██████▍ | 23640/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.43.down_proj: 65%|██████▍ | 23641/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.44.gate_proj: 65%|██████▍ | 23642/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.44.up_proj: 65%|██████▍ | 23643/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.44.down_proj: 65%|██████▍ | 23644/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.45.gate_proj: 65%|██████▍ | 23645/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.45.up_proj: 65%|██████▍ | 23646/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.45.down_proj: 65%|██████▍ | 23647/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.46.gate_proj: 65%|██████▍ | 23648/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.46.up_proj: 65%|██████▍ | 23649/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.46.down_proj: 65%|██████▍ | 23650/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.47.gate_proj: 65%|██████▍ | 23651/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.47.up_proj: 65%|██████▍ | 23652/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.47.down_proj: 65%|██████▍ | 23653/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.48.gate_proj: 65%|██████▍ | 23654/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.48.up_proj: 65%|██████▍ | 23655/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.48.down_proj: 65%|██████▍ | 23656/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.49.gate_proj: 65%|██████▍ | 23657/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.49.up_proj: 65%|██████▍ | 23658/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.49.down_proj: 65%|██████▍ | 23659/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.50.gate_proj: 65%|██████▍ | 23660/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.50.up_proj: 65%|██████▍ | 23661/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.50.down_proj: 65%|██████▍ | 23662/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.51.gate_proj: 65%|██████▍ | 23663/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.51.up_proj: 65%|██████▍ | 23664/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.51.down_proj: 65%|██████▍ | 23665/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.52.gate_proj: 65%|██████▍ | 23666/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.52.up_proj: 65%|██████▍ | 23667/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.52.down_proj: 65%|██████▍ | 23668/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.53.gate_proj: 65%|██████▍ | 23669/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.53.up_proj: 65%|██████▍ | 23670/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.53.down_proj: 65%|██████▍ | 23671/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.54.gate_proj: 65%|██████▍ | 23672/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.54.up_proj: 65%|██████▍ | 23673/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.54.down_proj: 65%|██████▍ | 23674/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.55.gate_proj: 65%|██████▍ | 23675/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.55.up_proj: 65%|██████▍ | 23676/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.55.down_proj: 65%|██████▍ | 23677/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.56.gate_proj: 65%|██████▍ | 23678/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.56.up_proj: 65%|██████▍ | 23679/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.56.down_proj: 65%|██████▍ | 23680/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.57.gate_proj: 65%|██████▍ | 23681/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.57.up_proj: 65%|██████▍ | 23682/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.57.down_proj: 65%|██████▍ | 23683/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.58.gate_proj: 65%|██████▍ | 23684/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.58.up_proj: 65%|██████▍ | 23685/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.58.down_proj: 65%|██████▍ | 23686/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.59.gate_proj: 65%|██████▍ | 23687/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.59.up_proj: 65%|██████▍ | 23688/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.59.down_proj: 65%|██████▍ | 23689/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.60.gate_proj: 65%|██████▍ | 23690/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.60.up_proj: 65%|██████▍ | 23691/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.60.down_proj: 65%|██████▍ | 23692/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.61.gate_proj: 65%|██████▍ | 23693/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.61.up_proj: 65%|██████▍ | 23694/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.61.down_proj: 65%|██████▍ | 23695/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.62.gate_proj: 65%|██████▍ | 23696/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.62.up_proj: 65%|██████▍ | 23697/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.62.down_proj: 65%|██████▍ | 23698/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.63.gate_proj: 65%|██████▍ | 23699/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.63.up_proj: 65%|██████▍ | 23700/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.63.down_proj: 65%|██████▍ | 23701/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.64.gate_proj: 65%|██████▍ | 23702/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.64.up_proj: 65%|██████▍ | 23703/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.64.down_proj: 65%|██████▍ | 23704/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.65.gate_proj: 65%|██████▍ | 23705/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.65.up_proj: 65%|██████▍ | 23706/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.65.down_proj: 65%|██████▍ | 23707/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.66.gate_proj: 65%|██████▍ | 23708/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.66.up_proj: 65%|██████▍ | 23709/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.66.down_proj: 65%|██████▍ | 23710/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.67.gate_proj: 65%|██████▍ | 23711/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.67.up_proj: 65%|██████▍ | 23712/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.67.down_proj: 65%|██████▍ | 23713/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.68.gate_proj: 65%|██████▍ | 23714/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.68.up_proj: 65%|██████▍ | 23715/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.68.down_proj: 65%|██████▍ | 23716/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.69.gate_proj: 65%|██████▍ | 23717/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.69.up_proj: 65%|██████▍ | 23718/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.69.down_proj: 65%|██████▍ | 23719/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.70.gate_proj: 65%|██████▍ | 23720/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.70.up_proj: 65%|██████▍ | 23721/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.70.down_proj: 65%|██████▍ | 23722/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.71.gate_proj: 65%|██████▍ | 23723/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.71.up_proj: 65%|██████▍ | 23724/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.71.down_proj: 65%|██████▍ | 23725/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.72.gate_proj: 65%|██████▍ | 23726/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.72.up_proj: 65%|██████▍ | 23727/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.72.down_proj: 65%|██████▍ | 23728/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.73.gate_proj: 65%|██████▍ | 23729/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.73.up_proj: 65%|██████▍ | 23730/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.73.down_proj: 65%|██████▍ | 23731/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.74.gate_proj: 65%|██████▍ | 23732/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.74.up_proj: 65%|██████▍ | 23733/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.74.down_proj: 65%|██████▍ | 23734/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.75.gate_proj: 65%|██████▍ | 23735/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.75.up_proj: 65%|██████▍ | 23736/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.75.down_proj: 65%|██████▍ | 23737/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.76.gate_proj: 65%|██████▍ | 23738/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.76.up_proj: 65%|██████▍ | 23739/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.76.down_proj: 65%|██████▍ | 23740/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.77.gate_proj: 65%|██████▍ | 23741/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.77.up_proj: 65%|██████▍ | 23742/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.77.down_proj: 65%|██████▍ | 23743/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.78.gate_proj: 65%|██████▍ | 23744/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.78.up_proj: 65%|██████▍ | 23745/36566 [00:21<00:11, 1146.98it/s] packing model.layers.60.mlp.experts.78.up_proj: 65%|██████▍ | 23746/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.78.down_proj: 65%|██████▍ | 23746/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.79.gate_proj: 65%|██████▍ | 23747/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.79.up_proj: 65%|██████▍ | 23748/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.79.down_proj: 65%|██████▍ | 23749/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.80.gate_proj: 65%|██████▍ | 23750/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.80.up_proj: 65%|██████▍ | 23751/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.80.down_proj: 65%|██████▍ | 23752/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.81.gate_proj: 65%|██████▍ | 23753/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.81.up_proj: 65%|██████▍ | 23754/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.81.down_proj: 65%|██████▍ | 23755/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.82.gate_proj: 65%|██████▍ | 23756/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.82.up_proj: 65%|██████▍ | 23757/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.82.down_proj: 65%|██████▍ | 23758/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.83.gate_proj: 65%|██████▍ | 23759/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.83.up_proj: 65%|██████▍ | 23760/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.83.down_proj: 65%|██████▍ | 23761/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.84.gate_proj: 65%|██████▍ | 23762/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.84.up_proj: 65%|██████▍ | 23763/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.84.down_proj: 65%|██████▍ | 23764/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.85.gate_proj: 65%|██████▍ | 23765/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.85.up_proj: 65%|██████▍ | 23766/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.85.down_proj: 65%|██████▍ | 23767/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.86.gate_proj: 65%|██████▌ | 23768/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.86.up_proj: 65%|██████▌ | 23769/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.86.down_proj: 65%|██████▌ | 23770/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.87.gate_proj: 65%|██████▌ | 23771/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.87.up_proj: 65%|██████▌ | 23772/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.87.down_proj: 65%|██████▌ | 23773/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.88.gate_proj: 65%|██████▌ | 23774/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.88.up_proj: 65%|██████▌ | 23775/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.88.down_proj: 65%|██████▌ | 23776/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.89.gate_proj: 65%|██████▌ | 23777/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.89.up_proj: 65%|██████▌ | 23778/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.89.down_proj: 65%|██████▌ | 23779/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.90.gate_proj: 65%|██████▌ | 23780/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.90.up_proj: 65%|██████▌ | 23781/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.90.down_proj: 65%|██████▌ | 23782/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.91.gate_proj: 65%|██████▌ | 23783/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.91.up_proj: 65%|██████▌ | 23784/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.91.down_proj: 65%|██████▌ | 23785/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.92.gate_proj: 65%|██████▌ | 23786/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.92.up_proj: 65%|██████▌ | 23787/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.92.down_proj: 65%|██████▌ | 23788/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.93.gate_proj: 65%|██████▌ | 23789/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.93.up_proj: 65%|██████▌ | 23790/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.93.down_proj: 65%|██████▌ | 23791/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.94.gate_proj: 65%|██████▌ | 23792/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.94.up_proj: 65%|██████▌ | 23793/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.94.down_proj: 65%|██████▌ | 23794/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.95.gate_proj: 65%|██████▌ | 23795/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.95.up_proj: 65%|██████▌ | 23796/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.95.down_proj: 65%|██████▌ | 23797/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.96.gate_proj: 65%|██████▌ | 23798/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.96.up_proj: 65%|██████▌ | 23799/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.96.down_proj: 65%|██████▌ | 23800/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.97.gate_proj: 65%|██████▌ | 23801/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.97.up_proj: 65%|██████▌ | 23802/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.97.down_proj: 65%|██████▌ | 23803/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.98.gate_proj: 65%|██████▌ | 23804/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.98.up_proj: 65%|██████▌ | 23805/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.98.down_proj: 65%|██████▌ | 23806/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.99.gate_proj: 65%|██████▌ | 23807/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.99.up_proj: 65%|██████▌ | 23808/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.99.down_proj: 65%|██████▌ | 23809/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.100.gate_proj: 65%|██████▌ | 23810/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.100.up_proj: 65%|██████▌ | 23811/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.100.down_proj: 65%|██████▌ | 23812/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.101.gate_proj: 65%|██████▌ | 23813/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.101.up_proj: 65%|██████▌ | 23814/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.101.down_proj: 65%|██████▌ | 23815/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.102.gate_proj: 65%|██████▌ | 23816/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.102.up_proj: 65%|██████▌ | 23817/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.102.down_proj: 65%|██████▌ | 23818/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.103.gate_proj: 65%|██████▌ | 23819/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.103.up_proj: 65%|██████▌ | 23820/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.103.down_proj: 65%|██████▌ | 23821/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.104.gate_proj: 65%|██████▌ | 23822/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.104.up_proj: 65%|██████▌ | 23823/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.104.down_proj: 65%|██████▌ | 23824/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.105.gate_proj: 65%|██████▌ | 23825/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.105.up_proj: 65%|██████▌ | 23826/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.105.down_proj: 65%|██████▌ | 23827/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.106.gate_proj: 65%|██████▌ | 23828/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.106.up_proj: 65%|██████▌ | 23829/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.106.down_proj: 65%|██████▌ | 23830/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.107.gate_proj: 65%|██████▌ | 23831/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.107.up_proj: 65%|██████▌ | 23832/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.107.down_proj: 65%|██████▌ | 23833/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.108.gate_proj: 65%|██████▌ | 23834/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.108.up_proj: 65%|██████▌ | 23835/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.108.down_proj: 65%|██████▌ | 23836/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.109.gate_proj: 65%|██████▌ | 23837/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.109.up_proj: 65%|██████▌ | 23838/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.109.down_proj: 65%|██████▌ | 23839/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.110.gate_proj: 65%|██████▌ | 23840/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.110.up_proj: 65%|██████▌ | 23841/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.110.down_proj: 65%|██████▌ | 23842/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.111.gate_proj: 65%|██████▌ | 23843/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.111.up_proj: 65%|██████▌ | 23844/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.111.down_proj: 65%|██████▌ | 23845/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.112.gate_proj: 65%|██████▌ | 23846/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.112.up_proj: 65%|██████▌ | 23847/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.112.down_proj: 65%|██████▌ | 23848/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.113.gate_proj: 65%|██████▌ | 23849/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.113.up_proj: 65%|██████▌ | 23850/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.113.down_proj: 65%|██████▌ | 23851/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.114.gate_proj: 65%|██████▌ | 23852/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.114.up_proj: 65%|██████▌ | 23853/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.114.down_proj: 65%|██████▌ | 23854/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.115.gate_proj: 65%|██████▌ | 23855/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.115.up_proj: 65%|██████▌ | 23856/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.115.down_proj: 65%|██████▌ | 23857/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.116.gate_proj: 65%|██████▌ | 23858/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.116.up_proj: 65%|██████▌ | 23859/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.116.down_proj: 65%|██████▌ | 23860/36566 [00:21<00:11, 1146.07it/s] packing model.layers.60.mlp.experts.116.down_proj: 65%|██████▌ | 23861/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.117.gate_proj: 65%|██████▌ | 23861/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.117.up_proj: 65%|██████▌ | 23862/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.117.down_proj: 65%|██████▌ | 23863/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.118.gate_proj: 65%|██████▌ | 23864/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.118.up_proj: 65%|██████▌ | 23865/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.118.down_proj: 65%|██████▌ | 23866/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.119.gate_proj: 65%|██████▌ | 23867/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.119.up_proj: 65%|██████▌ | 23868/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.119.down_proj: 65%|██████▌ | 23869/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.120.gate_proj: 65%|██████▌ | 23870/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.120.up_proj: 65%|██████▌ | 23871/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.120.down_proj: 65%|██████▌ | 23872/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.121.gate_proj: 65%|██████▌ | 23873/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.121.up_proj: 65%|██████▌ | 23874/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.121.down_proj: 65%|██████▌ | 23875/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.122.gate_proj: 65%|██████▌ | 23876/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.122.up_proj: 65%|██████▌ | 23877/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.122.down_proj: 65%|██████▌ | 23878/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.123.gate_proj: 65%|██████▌ | 23879/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.123.up_proj: 65%|██████▌ | 23880/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.123.down_proj: 65%|██████▌ | 23881/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.124.gate_proj: 65%|██████▌ | 23882/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.124.up_proj: 65%|██████▌ | 23883/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.124.down_proj: 65%|██████▌ | 23884/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.125.gate_proj: 65%|██████▌ | 23885/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.125.up_proj: 65%|██████▌ | 23886/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.125.down_proj: 65%|██████▌ | 23887/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.126.gate_proj: 65%|██████▌ | 23888/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.126.up_proj: 65%|██████▌ | 23889/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.126.down_proj: 65%|██████▌ | 23890/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.127.gate_proj: 65%|██████▌ | 23891/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.127.up_proj: 65%|██████▌ | 23892/36566 [00:21<00:11, 1146.93it/s] packing model.layers.60.mlp.experts.127.down_proj: 65%|██████▌ | 23893/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.0.gate_proj: 65%|██████▌ | 23894/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.0.up_proj: 65%|██████▌ | 23895/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.0.down_proj: 65%|██████▌ | 23896/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.1.gate_proj: 65%|██████▌ | 23897/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.1.up_proj: 65%|██████▌ | 23898/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.1.down_proj: 65%|██████▌ | 23899/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.2.gate_proj: 65%|██████▌ | 23900/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.2.up_proj: 65%|██████▌ | 23901/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.2.down_proj: 65%|██████▌ | 23902/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.3.gate_proj: 65%|██████▌ | 23903/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.3.up_proj: 65%|██████▌ | 23904/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.3.down_proj: 65%|██████▌ | 23905/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.4.gate_proj: 65%|██████▌ | 23906/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.4.up_proj: 65%|██████▌ | 23907/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.4.down_proj: 65%|██████▌ | 23908/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.5.gate_proj: 65%|██████▌ | 23909/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.5.up_proj: 65%|██████▌ | 23910/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.5.down_proj: 65%|██████▌ | 23911/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.6.gate_proj: 65%|██████▌ | 23912/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.6.up_proj: 65%|██████▌ | 23913/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.6.down_proj: 65%|██████▌ | 23914/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.7.gate_proj: 65%|██████▌ | 23915/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.7.up_proj: 65%|██████▌ | 23916/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.7.down_proj: 65%|██████▌ | 23917/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.8.gate_proj: 65%|██████▌ | 23918/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.8.up_proj: 65%|██████▌ | 23919/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.8.down_proj: 65%|██████▌ | 23920/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.9.gate_proj: 65%|██████▌ | 23921/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.9.up_proj: 65%|██████▌ | 23922/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.9.down_proj: 65%|██████▌ | 23923/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.10.gate_proj: 65%|██████▌ | 23924/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.10.up_proj: 65%|██████▌ | 23925/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.10.down_proj: 65%|██████▌ | 23926/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.11.gate_proj: 65%|██████▌ | 23927/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.11.up_proj: 65%|██████▌ | 23928/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.11.down_proj: 65%|██████▌ | 23929/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.12.gate_proj: 65%|██████▌ | 23930/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.12.up_proj: 65%|██████▌ | 23931/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.12.down_proj: 65%|██████▌ | 23932/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.13.gate_proj: 65%|██████▌ | 23933/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.13.up_proj: 65%|██████▌ | 23934/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.13.down_proj: 65%|██████▌ | 23935/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.14.gate_proj: 65%|██████▌ | 23936/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.14.up_proj: 65%|██████▌ | 23937/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.14.down_proj: 65%|██████▌ | 23938/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.15.gate_proj: 65%|██████▌ | 23939/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.15.up_proj: 65%|██████▌ | 23940/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.15.down_proj: 65%|██████▌ | 23941/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.16.gate_proj: 65%|██████▌ | 23942/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.16.up_proj: 65%|██████▌ | 23943/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.16.down_proj: 65%|██████▌ | 23944/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.17.gate_proj: 65%|██████▌ | 23945/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.17.up_proj: 65%|██████▌ | 23946/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.17.down_proj: 65%|██████▌ | 23947/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.18.gate_proj: 65%|██████▌ | 23948/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.18.up_proj: 65%|██████▌ | 23949/36566 [00:21<00:11, 1146.93it/s] packing model.layers.61.mlp.experts.18.down_proj: 65%|██████▌ | 23950/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.19.gate_proj: 66%|██████▌ | 23951/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.19.up_proj: 66%|██████▌ | 23952/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.19.down_proj: 66%|██████▌ | 23953/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.20.gate_proj: 66%|██████▌ | 23954/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.20.up_proj: 66%|██████▌ | 23955/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.20.down_proj: 66%|██████▌ | 23956/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.21.gate_proj: 66%|██████▌ | 23957/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.21.up_proj: 66%|██████▌ | 23958/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.21.down_proj: 66%|██████▌ | 23959/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.22.gate_proj: 66%|██████▌ | 23960/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.22.up_proj: 66%|██████▌ | 23961/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.22.down_proj: 66%|██████▌ | 23962/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.23.gate_proj: 66%|██████▌ | 23963/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.23.up_proj: 66%|██████▌ | 23964/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.23.down_proj: 66%|██████▌ | 23965/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.24.gate_proj: 66%|██████▌ | 23966/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.24.up_proj: 66%|██████▌ | 23967/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.24.down_proj: 66%|██████▌ | 23968/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.25.gate_proj: 66%|██████▌ | 23969/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.25.up_proj: 66%|██████▌ | 23970/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.25.down_proj: 66%|██████▌ | 23971/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.26.gate_proj: 66%|██████▌ | 23972/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.26.up_proj: 66%|██████▌ | 23973/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.26.down_proj: 66%|██████▌ | 23974/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.27.gate_proj: 66%|██████▌ | 23975/36566 [00:21<00:10, 1146.93it/s] packing model.layers.61.mlp.experts.27.gate_proj: 66%|██████▌ | 23976/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.27.up_proj: 66%|██████▌ | 23976/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.27.down_proj: 66%|██████▌ | 23977/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.28.gate_proj: 66%|██████▌ | 23978/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.28.up_proj: 66%|██████▌ | 23979/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.28.down_proj: 66%|██████▌ | 23980/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.29.gate_proj: 66%|██████▌ | 23981/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.29.up_proj: 66%|██████▌ | 23982/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.29.down_proj: 66%|██████▌ | 23983/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.30.gate_proj: 66%|██████▌ | 23984/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.30.up_proj: 66%|██████▌ | 23985/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.30.down_proj: 66%|██████▌ | 23986/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.31.gate_proj: 66%|██████▌ | 23987/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.31.up_proj: 66%|██████▌ | 23988/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.31.down_proj: 66%|██████▌ | 23989/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.32.gate_proj: 66%|██████▌ | 23990/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.32.up_proj: 66%|██████▌ | 23991/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.32.down_proj: 66%|██████▌ | 23992/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.33.gate_proj: 66%|██████▌ | 23993/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.33.up_proj: 66%|██████▌ | 23994/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.33.down_proj: 66%|██████▌ | 23995/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.34.gate_proj: 66%|██████▌ | 23996/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.34.up_proj: 66%|██████▌ | 23997/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.34.down_proj: 66%|██████▌ | 23998/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.35.gate_proj: 66%|██████▌ | 23999/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.35.up_proj: 66%|██████▌ | 24000/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.35.down_proj: 66%|██████▌ | 24001/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.36.gate_proj: 66%|██████▌ | 24002/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.36.up_proj: 66%|██████▌ | 24003/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.36.down_proj: 66%|██████▌ | 24004/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.37.gate_proj: 66%|██████▌ | 24005/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.37.up_proj: 66%|██████▌ | 24006/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.37.down_proj: 66%|██████▌ | 24007/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.38.gate_proj: 66%|██████▌ | 24008/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.38.up_proj: 66%|██████▌ | 24009/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.38.down_proj: 66%|██████▌ | 24010/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.39.gate_proj: 66%|██████▌ | 24011/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.39.up_proj: 66%|██████▌ | 24012/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.39.down_proj: 66%|██████▌ | 24013/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.40.gate_proj: 66%|██████▌ | 24014/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.40.up_proj: 66%|██████▌ | 24015/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.40.down_proj: 66%|██████▌ | 24016/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.41.gate_proj: 66%|██████▌ | 24017/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.41.up_proj: 66%|██████▌ | 24018/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.41.down_proj: 66%|██████▌ | 24019/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.42.gate_proj: 66%|██████▌ | 24020/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.42.up_proj: 66%|██████▌ | 24021/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.42.down_proj: 66%|██████▌ | 24022/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.43.gate_proj: 66%|██████▌ | 24023/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.43.up_proj: 66%|██████▌ | 24024/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.43.down_proj: 66%|██████▌ | 24025/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.44.gate_proj: 66%|██████▌ | 24026/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.44.up_proj: 66%|██████▌ | 24027/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.44.down_proj: 66%|██████▌ | 24028/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.45.gate_proj: 66%|██████▌ | 24029/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.45.up_proj: 66%|██████▌ | 24030/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.45.down_proj: 66%|██████▌ | 24031/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.46.gate_proj: 66%|██████▌ | 24032/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.46.up_proj: 66%|██████▌ | 24033/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.46.down_proj: 66%|██████▌ | 24034/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.47.gate_proj: 66%|██████▌ | 24035/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.47.up_proj: 66%|██████▌ | 24036/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.47.down_proj: 66%|██████▌ | 24037/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.48.gate_proj: 66%|██████▌ | 24038/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.48.up_proj: 66%|██████▌ | 24039/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.48.down_proj: 66%|██████▌ | 24040/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.49.gate_proj: 66%|██████▌ | 24041/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.49.up_proj: 66%|██████▌ | 24042/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.49.down_proj: 66%|██████▌ | 24043/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.50.gate_proj: 66%|██████▌ | 24044/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.50.up_proj: 66%|██████▌ | 24045/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.50.down_proj: 66%|██████▌ | 24046/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.51.gate_proj: 66%|██████▌ | 24047/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.51.up_proj: 66%|██████▌ | 24048/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.51.down_proj: 66%|██████▌ | 24049/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.52.gate_proj: 66%|██████▌ | 24050/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.52.up_proj: 66%|██████▌ | 24051/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.52.down_proj: 66%|██████▌ | 24052/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.53.gate_proj: 66%|██████▌ | 24053/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.53.up_proj: 66%|██████▌ | 24054/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.53.down_proj: 66%|██████▌ | 24055/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.54.gate_proj: 66%|██████▌ | 24056/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.54.up_proj: 66%|██████▌ | 24057/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.54.down_proj: 66%|██████▌ | 24058/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.55.gate_proj: 66%|██████▌ | 24059/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.55.up_proj: 66%|██████▌ | 24060/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.55.down_proj: 66%|██████▌ | 24061/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.56.gate_proj: 66%|██████▌ | 24062/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.56.up_proj: 66%|██████▌ | 24063/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.56.down_proj: 66%|██████▌ | 24064/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.57.gate_proj: 66%|██████▌ | 24065/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.57.up_proj: 66%|██████▌ | 24066/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.57.down_proj: 66%|██████▌ | 24067/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.58.gate_proj: 66%|██████▌ | 24068/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.58.up_proj: 66%|██████▌ | 24069/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.58.down_proj: 66%|██████▌ | 24070/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.59.gate_proj: 66%|██████▌ | 24071/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.59.up_proj: 66%|██████▌ | 24072/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.59.down_proj: 66%|██████▌ | 24073/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.60.gate_proj: 66%|██████▌ | 24074/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.60.up_proj: 66%|██████▌ | 24075/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.60.down_proj: 66%|██████▌ | 24076/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.61.gate_proj: 66%|██████▌ | 24077/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.61.up_proj: 66%|██████▌ | 24078/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.61.down_proj: 66%|██████▌ | 24079/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.62.gate_proj: 66%|██████▌ | 24080/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.62.up_proj: 66%|██████▌ | 24081/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.62.down_proj: 66%|██████▌ | 24082/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.63.gate_proj: 66%|██████▌ | 24083/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.63.up_proj: 66%|██████▌ | 24084/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.63.down_proj: 66%|██████▌ | 24085/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.64.gate_proj: 66%|██████▌ | 24086/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.64.up_proj: 66%|██████▌ | 24087/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.64.down_proj: 66%|██████▌ | 24088/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.65.gate_proj: 66%|██████▌ | 24089/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.65.up_proj: 66%|██████▌ | 24090/36566 [00:21<00:10, 1146.24it/s] packing model.layers.61.mlp.experts.65.up_proj: 66%|██████▌ | 24091/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.65.down_proj: 66%|██████▌ | 24091/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.66.gate_proj: 66%|██████▌ | 24092/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.66.up_proj: 66%|██████▌ | 24093/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.66.down_proj: 66%|██████▌ | 24094/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.67.gate_proj: 66%|██████▌ | 24095/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.67.up_proj: 66%|██████▌ | 24096/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.67.down_proj: 66%|██████▌ | 24097/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.68.gate_proj: 66%|██████▌ | 24098/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.68.up_proj: 66%|██████▌ | 24099/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.68.down_proj: 66%|██████▌ | 24100/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.69.gate_proj: 66%|██████▌ | 24101/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.69.up_proj: 66%|██████▌ | 24102/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.69.down_proj: 66%|██████▌ | 24103/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.70.gate_proj: 66%|██████▌ | 24104/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.70.up_proj: 66%|██████▌ | 24105/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.70.down_proj: 66%|██████▌ | 24106/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.71.gate_proj: 66%|██████▌ | 24107/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.71.up_proj: 66%|██████▌ | 24108/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.71.down_proj: 66%|██████▌ | 24109/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.72.gate_proj: 66%|██████▌ | 24110/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.72.up_proj: 66%|██████▌ | 24111/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.72.down_proj: 66%|██████▌ | 24112/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.73.gate_proj: 66%|██████▌ | 24113/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.73.up_proj: 66%|██████▌ | 24114/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.73.down_proj: 66%|██████▌ | 24115/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.74.gate_proj: 66%|██████▌ | 24116/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.74.up_proj: 66%|██████▌ | 24117/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.74.down_proj: 66%|██████▌ | 24118/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.75.gate_proj: 66%|██████▌ | 24119/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.75.up_proj: 66%|██████▌ | 24120/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.75.down_proj: 66%|██████▌ | 24121/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.76.gate_proj: 66%|██████▌ | 24122/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.76.up_proj: 66%|██████▌ | 24123/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.76.down_proj: 66%|██████▌ | 24124/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.77.gate_proj: 66%|██████▌ | 24125/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.77.up_proj: 66%|██████▌ | 24126/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.77.down_proj: 66%|██████▌ | 24127/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.78.gate_proj: 66%|██████▌ | 24128/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.78.up_proj: 66%|██████▌ | 24129/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.78.down_proj: 66%|██████▌ | 24130/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.79.gate_proj: 66%|██████▌ | 24131/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.79.up_proj: 66%|██████▌ | 24132/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.79.down_proj: 66%|██████▌ | 24133/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.80.gate_proj: 66%|██████▌ | 24134/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.80.up_proj: 66%|██████▌ | 24135/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.80.down_proj: 66%|██████▌ | 24136/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.81.gate_proj: 66%|██████▌ | 24137/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.81.up_proj: 66%|██████▌ | 24138/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.81.down_proj: 66%|██████▌ | 24139/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.82.gate_proj: 66%|██████▌ | 24140/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.82.up_proj: 66%|██████▌ | 24141/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.82.down_proj: 66%|██████▌ | 24142/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.83.gate_proj: 66%|██████▌ | 24143/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.83.up_proj: 66%|██████▌ | 24144/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.83.down_proj: 66%|██████▌ | 24145/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.84.gate_proj: 66%|██████▌ | 24146/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.84.up_proj: 66%|██████▌ | 24147/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.84.down_proj: 66%|██████▌ | 24148/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.85.gate_proj: 66%|██████▌ | 24149/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.85.up_proj: 66%|██████▌ | 24150/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.85.down_proj: 66%|██████▌ | 24151/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.86.gate_proj: 66%|██████▌ | 24152/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.86.up_proj: 66%|██████▌ | 24153/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.86.down_proj: 66%|██████▌ | 24154/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.87.gate_proj: 66%|██████▌ | 24155/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.87.up_proj: 66%|██████▌ | 24156/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.87.down_proj: 66%|██████▌ | 24157/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.88.gate_proj: 66%|██████▌ | 24158/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.88.up_proj: 66%|██████▌ | 24159/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.88.down_proj: 66%|██████▌ | 24160/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.89.gate_proj: 66%|██████▌ | 24161/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.89.up_proj: 66%|██████▌ | 24162/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.89.down_proj: 66%|██████▌ | 24163/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.90.gate_proj: 66%|██████▌ | 24164/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.90.up_proj: 66%|██████▌ | 24165/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.90.down_proj: 66%|██████▌ | 24166/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.91.gate_proj: 66%|██████▌ | 24167/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.91.up_proj: 66%|██████▌ | 24168/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.91.down_proj: 66%|██████▌ | 24169/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.92.gate_proj: 66%|██████▌ | 24170/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.92.up_proj: 66%|██████▌ | 24171/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.92.down_proj: 66%|██████▌ | 24172/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.93.gate_proj: 66%|██████▌ | 24173/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.93.up_proj: 66%|██████▌ | 24174/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.93.down_proj: 66%|██████▌ | 24175/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.94.gate_proj: 66%|██████▌ | 24176/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.94.up_proj: 66%|██████▌ | 24177/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.94.down_proj: 66%|██████▌ | 24178/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.95.gate_proj: 66%|██████▌ | 24179/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.95.up_proj: 66%|██████▌ | 24180/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.95.down_proj: 66%|██████▌ | 24181/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.96.gate_proj: 66%|██████▌ | 24182/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.96.up_proj: 66%|██████▌ | 24183/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.96.down_proj: 66%|██████▌ | 24184/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.97.gate_proj: 66%|██████▌ | 24185/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.97.up_proj: 66%|██████▌ | 24186/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.97.down_proj: 66%|██████▌ | 24187/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.98.gate_proj: 66%|██████▌ | 24188/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.98.up_proj: 66%|██████▌ | 24189/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.98.down_proj: 66%|██████▌ | 24190/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.99.gate_proj: 66%|██████▌ | 24191/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.99.up_proj: 66%|██████▌ | 24192/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.99.down_proj: 66%|██████▌ | 24193/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.100.gate_proj: 66%|██████▌ | 24194/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.100.up_proj: 66%|██████▌ | 24195/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.100.down_proj: 66%|██████▌ | 24196/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.101.gate_proj: 66%|██████▌ | 24197/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.101.up_proj: 66%|██████▌ | 24198/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.101.down_proj: 66%|██████▌ | 24199/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.102.gate_proj: 66%|██████▌ | 24200/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.102.up_proj: 66%|██████▌ | 24201/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.102.down_proj: 66%|██████▌ | 24202/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.103.gate_proj: 66%|██████▌ | 24203/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.103.up_proj: 66%|██████▌ | 24204/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.103.down_proj: 66%|██████▌ | 24205/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.104.gate_proj: 66%|██████▌ | 24206/36566 [00:21<00:10, 1146.47it/s] packing model.layers.61.mlp.experts.104.gate_proj: 66%|██████▌ | 24207/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.104.up_proj: 66%|██████▌ | 24207/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.104.down_proj: 66%|██████▌ | 24208/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.105.gate_proj: 66%|██████▌ | 24209/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.105.up_proj: 66%|██████▌ | 24210/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.105.down_proj: 66%|██████▌ | 24211/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.106.gate_proj: 66%|██████▌ | 24212/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.106.up_proj: 66%|██████▌ | 24213/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.106.down_proj: 66%|██████▌ | 24214/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.107.gate_proj: 66%|██████▌ | 24215/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.107.up_proj: 66%|██████▌ | 24216/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.107.down_proj: 66%|██████▌ | 24217/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.108.gate_proj: 66%|██████▌ | 24218/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.108.up_proj: 66%|██████▌ | 24219/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.108.down_proj: 66%|██████▌ | 24220/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.109.gate_proj: 66%|██████▌ | 24221/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.109.up_proj: 66%|██████▌ | 24222/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.109.down_proj: 66%|██████▌ | 24223/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.110.gate_proj: 66%|██████▌ | 24224/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.110.up_proj: 66%|██████▋ | 24225/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.110.down_proj: 66%|██████▋ | 24226/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.111.gate_proj: 66%|██████▋ | 24227/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.111.up_proj: 66%|██████▋ | 24228/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.111.down_proj: 66%|██████▋ | 24229/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.112.gate_proj: 66%|██████▋ | 24230/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.112.up_proj: 66%|██████▋ | 24231/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.112.down_proj: 66%|██████▋ | 24232/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.113.gate_proj: 66%|██████▋ | 24233/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.113.up_proj: 66%|██████▋ | 24234/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.113.down_proj: 66%|██████▋ | 24235/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.114.gate_proj: 66%|██████▋ | 24236/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.114.up_proj: 66%|██████▋ | 24237/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.114.down_proj: 66%|██████▋ | 24238/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.115.gate_proj: 66%|██████▋ | 24239/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.115.up_proj: 66%|██████▋ | 24240/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.115.down_proj: 66%|██████▋ | 24241/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.116.gate_proj: 66%|██████▋ | 24242/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.116.up_proj: 66%|██████▋ | 24243/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.116.down_proj: 66%|██████▋ | 24244/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.117.gate_proj: 66%|██████▋ | 24245/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.117.up_proj: 66%|██████▋ | 24246/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.117.down_proj: 66%|██████▋ | 24247/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.118.gate_proj: 66%|██████▋ | 24248/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.118.up_proj: 66%|██████▋ | 24249/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.118.down_proj: 66%|██████▋ | 24250/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.119.gate_proj: 66%|██████▋ | 24251/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.119.up_proj: 66%|██████▋ | 24252/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.119.down_proj: 66%|██████▋ | 24253/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.120.gate_proj: 66%|██████▋ | 24254/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.120.up_proj: 66%|██████▋ | 24255/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.120.down_proj: 66%|██████▋ | 24256/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.121.gate_proj: 66%|██████▋ | 24257/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.121.up_proj: 66%|██████▋ | 24258/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.121.down_proj: 66%|██████▋ | 24259/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.122.gate_proj: 66%|██████▋ | 24260/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.122.up_proj: 66%|██████▋ | 24261/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.122.down_proj: 66%|██████▋ | 24262/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.123.gate_proj: 66%|██████▋ | 24263/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.123.up_proj: 66%|██████▋ | 24264/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.123.down_proj: 66%|██████▋ | 24265/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.124.gate_proj: 66%|██████▋ | 24266/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.124.up_proj: 66%|██████▋ | 24267/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.124.down_proj: 66%|██████▋ | 24268/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.125.gate_proj: 66%|██████▋ | 24269/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.125.up_proj: 66%|██████▋ | 24270/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.125.down_proj: 66%|██████▋ | 24271/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.126.gate_proj: 66%|██████▋ | 24272/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.126.up_proj: 66%|██████▋ | 24273/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.126.down_proj: 66%|██████▋ | 24274/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.127.gate_proj: 66%|██████▋ | 24275/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.127.up_proj: 66%|██████▋ | 24276/36566 [00:21<00:10, 1147.87it/s] packing model.layers.61.mlp.experts.127.down_proj: 66%|██████▋ | 24277/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.0.gate_proj: 66%|██████▋ | 24278/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.0.up_proj: 66%|██████▋ | 24279/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.0.down_proj: 66%|██████▋ | 24280/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.1.gate_proj: 66%|██████▋ | 24281/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.1.up_proj: 66%|██████▋ | 24282/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.1.down_proj: 66%|██████▋ | 24283/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.2.gate_proj: 66%|██████▋ | 24284/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.2.up_proj: 66%|██████▋ | 24285/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.2.down_proj: 66%|██████▋ | 24286/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.3.gate_proj: 66%|██████▋ | 24287/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.3.up_proj: 66%|██████▋ | 24288/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.3.down_proj: 66%|██████▋ | 24289/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.4.gate_proj: 66%|██████▋ | 24290/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.4.up_proj: 66%|██████▋ | 24291/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.4.down_proj: 66%|██████▋ | 24292/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.5.gate_proj: 66%|██████▋ | 24293/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.5.up_proj: 66%|██████▋ | 24294/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.5.down_proj: 66%|██████▋ | 24295/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.6.gate_proj: 66%|██████▋ | 24296/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.6.up_proj: 66%|██████▋ | 24297/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.6.down_proj: 66%|██████▋ | 24298/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.7.gate_proj: 66%|██████▋ | 24299/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.7.up_proj: 66%|██████▋ | 24300/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.7.down_proj: 66%|██████▋ | 24301/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.8.gate_proj: 66%|██████▋ | 24302/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.8.up_proj: 66%|██████▋ | 24303/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.8.down_proj: 66%|██████▋ | 24304/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.9.gate_proj: 66%|██████▋ | 24305/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.9.up_proj: 66%|██████▋ | 24306/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.9.down_proj: 66%|██████▋ | 24307/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.10.gate_proj: 66%|██████▋ | 24308/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.10.up_proj: 66%|██████▋ | 24309/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.10.down_proj: 66%|██████▋ | 24310/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.11.gate_proj: 66%|██████▋ | 24311/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.11.up_proj: 66%|██████▋ | 24312/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.11.down_proj: 66%|██████▋ | 24313/36566 [00:21<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.12.gate_proj: 66%|██████▋ | 24314/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.12.up_proj: 66%|██████▋ | 24315/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.12.down_proj: 66%|██████▋ | 24316/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.13.gate_proj: 67%|██████▋ | 24317/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.13.up_proj: 67%|██████▋ | 24318/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.13.down_proj: 67%|██████▋ | 24319/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.14.gate_proj: 67%|██████▋ | 24320/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.14.up_proj: 67%|██████▋ | 24321/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.14.down_proj: 67%|██████▋ | 24322/36566 [00:22<00:10, 1147.87it/s] packing model.layers.62.mlp.experts.14.down_proj: 67%|██████▋ | 24323/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.15.gate_proj: 67%|██████▋ | 24323/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.15.up_proj: 67%|██████▋ | 24324/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.15.down_proj: 67%|██████▋ | 24325/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.16.gate_proj: 67%|██████▋ | 24326/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.16.up_proj: 67%|██████▋ | 24327/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.16.down_proj: 67%|██████▋ | 24328/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.17.gate_proj: 67%|██████▋ | 24329/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.17.up_proj: 67%|██████▋ | 24330/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.17.down_proj: 67%|██████▋ | 24331/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.18.gate_proj: 67%|██████▋ | 24332/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.18.up_proj: 67%|██████▋ | 24333/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.18.down_proj: 67%|██████▋ | 24334/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.19.gate_proj: 67%|██████▋ | 24335/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.19.up_proj: 67%|██████▋ | 24336/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.19.down_proj: 67%|██████▋ | 24337/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.20.gate_proj: 67%|██████▋ | 24338/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.20.up_proj: 67%|██████▋ | 24339/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.20.down_proj: 67%|██████▋ | 24340/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.21.gate_proj: 67%|██████▋ | 24341/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.21.up_proj: 67%|██████▋ | 24342/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.21.down_proj: 67%|██████▋ | 24343/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.22.gate_proj: 67%|██████▋ | 24344/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.22.up_proj: 67%|██████▋ | 24345/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.22.down_proj: 67%|██████▋ | 24346/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.23.gate_proj: 67%|██████▋ | 24347/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.23.up_proj: 67%|██████▋ | 24348/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.23.down_proj: 67%|██████▋ | 24349/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.24.gate_proj: 67%|██████▋ | 24350/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.24.up_proj: 67%|██████▋ | 24351/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.24.down_proj: 67%|██████▋ | 24352/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.25.gate_proj: 67%|██████▋ | 24353/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.25.up_proj: 67%|██████▋ | 24354/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.25.down_proj: 67%|██████▋ | 24355/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.26.gate_proj: 67%|██████▋ | 24356/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.26.up_proj: 67%|██████▋ | 24357/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.26.down_proj: 67%|██████▋ | 24358/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.27.gate_proj: 67%|██████▋ | 24359/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.27.up_proj: 67%|██████▋ | 24360/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.27.down_proj: 67%|██████▋ | 24361/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.28.gate_proj: 67%|██████▋ | 24362/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.28.up_proj: 67%|██████▋ | 24363/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.28.down_proj: 67%|██████▋ | 24364/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.29.gate_proj: 67%|██████▋ | 24365/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.29.up_proj: 67%|██████▋ | 24366/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.29.down_proj: 67%|██████▋ | 24367/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.30.gate_proj: 67%|██████▋ | 24368/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.30.up_proj: 67%|██████▋ | 24369/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.30.down_proj: 67%|██████▋ | 24370/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.31.gate_proj: 67%|██████▋ | 24371/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.31.up_proj: 67%|██████▋ | 24372/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.31.down_proj: 67%|██████▋ | 24373/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.32.gate_proj: 67%|██████▋ | 24374/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.32.up_proj: 67%|██████▋ | 24375/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.32.down_proj: 67%|██████▋ | 24376/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.33.gate_proj: 67%|██████▋ | 24377/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.33.up_proj: 67%|██████▋ | 24378/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.33.down_proj: 67%|██████▋ | 24379/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.34.gate_proj: 67%|██████▋ | 24380/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.34.up_proj: 67%|██████▋ | 24381/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.34.down_proj: 67%|██████▋ | 24382/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.35.gate_proj: 67%|██████▋ | 24383/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.35.up_proj: 67%|██████▋ | 24384/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.35.down_proj: 67%|██████▋ | 24385/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.36.gate_proj: 67%|██████▋ | 24386/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.36.up_proj: 67%|██████▋ | 24387/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.36.down_proj: 67%|██████▋ | 24388/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.37.gate_proj: 67%|██████▋ | 24389/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.37.up_proj: 67%|██████▋ | 24390/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.37.down_proj: 67%|██████▋ | 24391/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.38.gate_proj: 67%|██████▋ | 24392/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.38.up_proj: 67%|██████▋ | 24393/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.38.down_proj: 67%|██████▋ | 24394/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.39.gate_proj: 67%|██████▋ | 24395/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.39.up_proj: 67%|██████▋ | 24396/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.39.down_proj: 67%|██████▋ | 24397/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.40.gate_proj: 67%|██████▋ | 24398/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.40.up_proj: 67%|██████▋ | 24399/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.40.down_proj: 67%|██████▋ | 24400/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.41.gate_proj: 67%|██████▋ | 24401/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.41.up_proj: 67%|██████▋ | 24402/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.41.down_proj: 67%|██████▋ | 24403/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.42.gate_proj: 67%|██████▋ | 24404/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.42.up_proj: 67%|██████▋ | 24405/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.42.down_proj: 67%|██████▋ | 24406/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.43.gate_proj: 67%|██████▋ | 24407/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.43.up_proj: 67%|██████▋ | 24408/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.43.down_proj: 67%|██████▋ | 24409/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.44.gate_proj: 67%|██████▋ | 24410/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.44.up_proj: 67%|██████▋ | 24411/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.44.down_proj: 67%|██████▋ | 24412/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.45.gate_proj: 67%|██████▋ | 24413/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.45.up_proj: 67%|██████▋ | 24414/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.45.down_proj: 67%|██████▋ | 24415/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.46.gate_proj: 67%|██████▋ | 24416/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.46.up_proj: 67%|██████▋ | 24417/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.46.down_proj: 67%|██████▋ | 24418/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.47.gate_proj: 67%|██████▋ | 24419/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.47.up_proj: 67%|██████▋ | 24420/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.47.down_proj: 67%|██████▋ | 24421/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.48.gate_proj: 67%|██████▋ | 24422/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.48.up_proj: 67%|██████▋ | 24423/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.48.down_proj: 67%|██████▋ | 24424/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.49.gate_proj: 67%|██████▋ | 24425/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.49.up_proj: 67%|██████▋ | 24426/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.49.down_proj: 67%|██████▋ | 24427/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.50.gate_proj: 67%|██████▋ | 24428/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.50.up_proj: 67%|██████▋ | 24429/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.50.down_proj: 67%|██████▋ | 24430/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.51.gate_proj: 67%|██████▋ | 24431/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.51.up_proj: 67%|██████▋ | 24432/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.51.down_proj: 67%|██████▋ | 24433/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.52.gate_proj: 67%|██████▋ | 24434/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.52.up_proj: 67%|██████▋ | 24435/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.52.down_proj: 67%|██████▋ | 24436/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.53.gate_proj: 67%|██████▋ | 24437/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.53.up_proj: 67%|██████▋ | 24438/36566 [00:22<00:10, 1151.06it/s] packing model.layers.62.mlp.experts.53.up_proj: 67%|██████▋ | 24439/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.53.down_proj: 67%|██████▋ | 24439/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.54.gate_proj: 67%|██████▋ | 24440/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.54.up_proj: 67%|██████▋ | 24441/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.54.down_proj: 67%|██████▋ | 24442/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.55.gate_proj: 67%|██████▋ | 24443/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.55.up_proj: 67%|██████▋ | 24444/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.55.down_proj: 67%|██████▋ | 24445/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.56.gate_proj: 67%|██████▋ | 24446/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.56.up_proj: 67%|██████▋ | 24447/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.56.down_proj: 67%|██████▋ | 24448/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.57.gate_proj: 67%|██████▋ | 24449/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.57.up_proj: 67%|██████▋ | 24450/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.57.down_proj: 67%|██████▋ | 24451/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.58.gate_proj: 67%|██████▋ | 24452/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.58.up_proj: 67%|██████▋ | 24453/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.58.down_proj: 67%|██████▋ | 24454/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.59.gate_proj: 67%|██████▋ | 24455/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.59.up_proj: 67%|██████▋ | 24456/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.59.down_proj: 67%|██████▋ | 24457/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.60.gate_proj: 67%|██████▋ | 24458/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.60.up_proj: 67%|██████▋ | 24459/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.60.down_proj: 67%|██████▋ | 24460/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.61.gate_proj: 67%|██████▋ | 24461/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.61.up_proj: 67%|██████▋ | 24462/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.61.down_proj: 67%|██████▋ | 24463/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.62.gate_proj: 67%|██████▋ | 24464/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.62.up_proj: 67%|██████▋ | 24465/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.62.down_proj: 67%|██████▋ | 24466/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.63.gate_proj: 67%|██████▋ | 24467/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.63.up_proj: 67%|██████▋ | 24468/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.63.down_proj: 67%|██████▋ | 24469/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.64.gate_proj: 67%|██████▋ | 24470/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.64.up_proj: 67%|██████▋ | 24471/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.64.down_proj: 67%|██████▋ | 24472/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.65.gate_proj: 67%|██████▋ | 24473/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.65.up_proj: 67%|██████▋ | 24474/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.65.down_proj: 67%|██████▋ | 24475/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.66.gate_proj: 67%|██████▋ | 24476/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.66.up_proj: 67%|██████▋ | 24477/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.66.down_proj: 67%|██████▋ | 24478/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.67.gate_proj: 67%|██████▋ | 24479/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.67.up_proj: 67%|██████▋ | 24480/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.67.down_proj: 67%|██████▋ | 24481/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.68.gate_proj: 67%|██████▋ | 24482/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.68.up_proj: 67%|██████▋ | 24483/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.68.down_proj: 67%|██████▋ | 24484/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.69.gate_proj: 67%|██████▋ | 24485/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.69.up_proj: 67%|██████▋ | 24486/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.69.down_proj: 67%|██████▋ | 24487/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.70.gate_proj: 67%|██████▋ | 24488/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.70.up_proj: 67%|██████▋ | 24489/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.70.down_proj: 67%|██████▋ | 24490/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.71.gate_proj: 67%|██████▋ | 24491/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.71.up_proj: 67%|██████▋ | 24492/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.71.down_proj: 67%|██████▋ | 24493/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.72.gate_proj: 67%|██████▋ | 24494/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.72.up_proj: 67%|██████▋ | 24495/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.72.down_proj: 67%|██████▋ | 24496/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.73.gate_proj: 67%|██████▋ | 24497/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.73.up_proj: 67%|██████▋ | 24498/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.73.down_proj: 67%|██████▋ | 24499/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.74.gate_proj: 67%|██████▋ | 24500/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.74.up_proj: 67%|██████▋ | 24501/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.74.down_proj: 67%|██████▋ | 24502/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.75.gate_proj: 67%|██████▋ | 24503/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.75.up_proj: 67%|██████▋ | 24504/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.75.down_proj: 67%|██████▋ | 24505/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.76.gate_proj: 67%|██████▋ | 24506/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.76.up_proj: 67%|██████▋ | 24507/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.76.down_proj: 67%|██████▋ | 24508/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.77.gate_proj: 67%|██████▋ | 24509/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.77.up_proj: 67%|██████▋ | 24510/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.77.down_proj: 67%|██████▋ | 24511/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.78.gate_proj: 67%|██████▋ | 24512/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.78.up_proj: 67%|██████▋ | 24513/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.78.down_proj: 67%|██████▋ | 24514/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.79.gate_proj: 67%|██████▋ | 24515/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.79.up_proj: 67%|██████▋ | 24516/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.79.down_proj: 67%|██████▋ | 24517/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.80.gate_proj: 67%|██████▋ | 24518/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.80.up_proj: 67%|██████▋ | 24519/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.80.down_proj: 67%|██████▋ | 24520/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.81.gate_proj: 67%|██████▋ | 24521/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.81.up_proj: 67%|██████▋ | 24522/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.81.down_proj: 67%|██████▋ | 24523/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.82.gate_proj: 67%|██████▋ | 24524/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.82.up_proj: 67%|██████▋ | 24525/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.82.down_proj: 67%|██████▋ | 24526/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.83.gate_proj: 67%|██████▋ | 24527/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.83.up_proj: 67%|██████▋ | 24528/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.83.down_proj: 67%|██████▋ | 24529/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.84.gate_proj: 67%|██████▋ | 24530/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.84.up_proj: 67%|██████▋ | 24531/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.84.down_proj: 67%|██████▋ | 24532/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.85.gate_proj: 67%|██████▋ | 24533/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.85.up_proj: 67%|██████▋ | 24534/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.85.down_proj: 67%|██████▋ | 24535/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.86.gate_proj: 67%|██████▋ | 24536/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.86.up_proj: 67%|██████▋ | 24537/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.86.down_proj: 67%|██████▋ | 24538/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.87.gate_proj: 67%|██████▋ | 24539/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.87.up_proj: 67%|██████▋ | 24540/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.87.down_proj: 67%|██████▋ | 24541/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.88.gate_proj: 67%|██████▋ | 24542/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.88.up_proj: 67%|██████▋ | 24543/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.88.down_proj: 67%|██████▋ | 24544/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.89.gate_proj: 67%|██████▋ | 24545/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.89.up_proj: 67%|██████▋ | 24546/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.89.down_proj: 67%|██████▋ | 24547/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.90.gate_proj: 67%|██████▋ | 24548/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.90.up_proj: 67%|██████▋ | 24549/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.90.down_proj: 67%|██████▋ | 24550/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.91.gate_proj: 67%|██████▋ | 24551/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.91.up_proj: 67%|██████▋ | 24552/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.91.down_proj: 67%|██████▋ | 24553/36566 [00:22<00:10, 1147.15it/s] packing model.layers.62.mlp.experts.91.down_proj: 67%|██████▋ | 24554/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.92.gate_proj: 67%|██████▋ | 24554/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.92.up_proj: 67%|██████▋ | 24555/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.92.down_proj: 67%|██████▋ | 24556/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.93.gate_proj: 67%|██████▋ | 24557/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.93.up_proj: 67%|██████▋ | 24558/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.93.down_proj: 67%|██████▋ | 24559/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.94.gate_proj: 67%|██████▋ | 24560/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.94.up_proj: 67%|██████▋ | 24561/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.94.down_proj: 67%|██████▋ | 24562/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.95.gate_proj: 67%|██████▋ | 24563/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.95.up_proj: 67%|██████▋ | 24564/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.95.down_proj: 67%|██████▋ | 24565/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.96.gate_proj: 67%|██████▋ | 24566/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.96.up_proj: 67%|██████▋ | 24567/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.96.down_proj: 67%|██████▋ | 24568/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.97.gate_proj: 67%|██████▋ | 24569/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.97.up_proj: 67%|██████▋ | 24570/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.97.down_proj: 67%|██████▋ | 24571/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.98.gate_proj: 67%|██████▋ | 24572/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.98.up_proj: 67%|██████▋ | 24573/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.98.down_proj: 67%|██████▋ | 24574/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.99.gate_proj: 67%|██████▋ | 24575/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.99.up_proj: 67%|██████▋ | 24576/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.99.down_proj: 67%|██████▋ | 24577/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.100.gate_proj: 67%|██████▋ | 24578/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.100.up_proj: 67%|██████▋ | 24579/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.100.down_proj: 67%|██████▋ | 24580/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.101.gate_proj: 67%|██████▋ | 24581/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.101.up_proj: 67%|██████▋ | 24582/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.101.down_proj: 67%|██████▋ | 24583/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.102.gate_proj: 67%|██████▋ | 24584/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.102.up_proj: 67%|██████▋ | 24585/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.102.down_proj: 67%|██████▋ | 24586/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.103.gate_proj: 67%|██████▋ | 24587/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.103.up_proj: 67%|██████▋ | 24588/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.103.down_proj: 67%|██████▋ | 24589/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.104.gate_proj: 67%|██████▋ | 24590/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.104.up_proj: 67%|██████▋ | 24591/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.104.down_proj: 67%|██████▋ | 24592/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.105.gate_proj: 67%|██████▋ | 24593/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.105.up_proj: 67%|██████▋ | 24594/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.105.down_proj: 67%|██████▋ | 24595/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.106.gate_proj: 67%|██████▋ | 24596/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.106.up_proj: 67%|██████▋ | 24597/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.106.down_proj: 67%|██████▋ | 24598/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.107.gate_proj: 67%|██████▋ | 24599/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.107.up_proj: 67%|██████▋ | 24600/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.107.down_proj: 67%|██████▋ | 24601/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.108.gate_proj: 67%|██████▋ | 24602/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.108.up_proj: 67%|██████▋ | 24603/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.108.down_proj: 67%|██████▋ | 24604/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.109.gate_proj: 67%|██████▋ | 24605/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.109.up_proj: 67%|██████▋ | 24606/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.109.down_proj: 67%|██████▋ | 24607/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.110.gate_proj: 67%|██████▋ | 24608/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.110.up_proj: 67%|██████▋ | 24609/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.110.down_proj: 67%|██████▋ | 24610/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.111.gate_proj: 67%|██████▋ | 24611/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.111.up_proj: 67%|██████▋ | 24612/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.111.down_proj: 67%|██████▋ | 24613/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.112.gate_proj: 67%|██████▋ | 24614/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.112.up_proj: 67%|██████▋ | 24615/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.112.down_proj: 67%|██████▋ | 24616/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.113.gate_proj: 67%|██████▋ | 24617/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.113.up_proj: 67%|██████▋ | 24618/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.113.down_proj: 67%|██████▋ | 24619/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.114.gate_proj: 67%|██████▋ | 24620/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.114.up_proj: 67%|██████▋ | 24621/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.114.down_proj: 67%|██████▋ | 24622/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.115.gate_proj: 67%|██████▋ | 24623/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.115.up_proj: 67%|██████▋ | 24624/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.115.down_proj: 67%|██████▋ | 24625/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.116.gate_proj: 67%|██████▋ | 24626/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.116.up_proj: 67%|██████▋ | 24627/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.116.down_proj: 67%|██████▋ | 24628/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.117.gate_proj: 67%|██████▋ | 24629/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.117.up_proj: 67%|██████▋ | 24630/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.117.down_proj: 67%|██████▋ | 24631/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.118.gate_proj: 67%|██████▋ | 24632/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.118.up_proj: 67%|██████▋ | 24633/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.118.down_proj: 67%|██████▋ | 24634/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.119.gate_proj: 67%|██████▋ | 24635/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.119.up_proj: 67%|██████▋ | 24636/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.119.down_proj: 67%|██████▋ | 24637/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.120.gate_proj: 67%|██████▋ | 24638/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.120.up_proj: 67%|██████▋ | 24639/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.120.down_proj: 67%|██████▋ | 24640/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.121.gate_proj: 67%|██████▋ | 24641/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.121.up_proj: 67%|██████▋ | 24642/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.121.down_proj: 67%|██████▋ | 24643/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.122.gate_proj: 67%|██████▋ | 24644/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.122.up_proj: 67%|██████▋ | 24645/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.122.down_proj: 67%|██████▋ | 24646/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.123.gate_proj: 67%|██████▋ | 24647/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.123.up_proj: 67%|██████▋ | 24648/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.123.down_proj: 67%|██████▋ | 24649/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.124.gate_proj: 67%|██████▋ | 24650/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.124.up_proj: 67%|██████▋ | 24651/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.124.down_proj: 67%|██████▋ | 24652/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.125.gate_proj: 67%|██████▋ | 24653/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.125.up_proj: 67%|██████▋ | 24654/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.125.down_proj: 67%|██████▋ | 24655/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.126.gate_proj: 67%|██████▋ | 24656/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.126.up_proj: 67%|██████▋ | 24657/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.126.down_proj: 67%|██████▋ | 24658/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.127.gate_proj: 67%|██████▋ | 24659/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.127.up_proj: 67%|██████▋ | 24660/36566 [00:22<00:10, 1146.06it/s] packing model.layers.62.mlp.experts.127.down_proj: 67%|██████▋ | 24661/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.0.gate_proj: 67%|██████▋ | 24662/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.0.up_proj: 67%|██████▋ | 24663/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.0.down_proj: 67%|██████▋ | 24664/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.1.gate_proj: 67%|██████▋ | 24665/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.1.up_proj: 67%|██████▋ | 24666/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.1.down_proj: 67%|██████▋ | 24667/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.2.gate_proj: 67%|██████▋ | 24668/36566 [00:22<00:10, 1146.06it/s] packing model.layers.63.mlp.experts.2.gate_proj: 67%|██████▋ | 24669/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.2.up_proj: 67%|██████▋ | 24669/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.2.down_proj: 67%|██████▋ | 24670/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.3.gate_proj: 67%|██████▋ | 24671/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.3.up_proj: 67%|██████▋ | 24672/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.3.down_proj: 67%|██████▋ | 24673/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.4.gate_proj: 67%|██████▋ | 24674/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.4.up_proj: 67%|██████▋ | 24675/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.4.down_proj: 67%|██████▋ | 24676/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.5.gate_proj: 67%|██████▋ | 24677/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.5.up_proj: 67%|██████▋ | 24678/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.5.down_proj: 67%|██████▋ | 24679/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.6.gate_proj: 67%|██████▋ | 24680/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.6.up_proj: 67%|██████▋ | 24681/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.6.down_proj: 67%|██████▋ | 24682/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.7.gate_proj: 68%|██████▊ | 24683/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.7.up_proj: 68%|██████▊ | 24684/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.7.down_proj: 68%|██████▊ | 24685/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.8.gate_proj: 68%|██████▊ | 24686/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.8.up_proj: 68%|██████▊ | 24687/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.8.down_proj: 68%|██████▊ | 24688/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.9.gate_proj: 68%|██████▊ | 24689/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.9.up_proj: 68%|██████▊ | 24690/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.9.down_proj: 68%|██████▊ | 24691/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.10.gate_proj: 68%|██████▊ | 24692/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.10.up_proj: 68%|██████▊ | 24693/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.10.down_proj: 68%|██████▊ | 24694/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.11.gate_proj: 68%|██████▊ | 24695/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.11.up_proj: 68%|██████▊ | 24696/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.11.down_proj: 68%|██████▊ | 24697/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.12.gate_proj: 68%|██████▊ | 24698/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.12.up_proj: 68%|██████▊ | 24699/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.12.down_proj: 68%|██████▊ | 24700/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.13.gate_proj: 68%|██████▊ | 24701/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.13.up_proj: 68%|██████▊ | 24702/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.13.down_proj: 68%|██████▊ | 24703/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.14.gate_proj: 68%|██████▊ | 24704/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.14.up_proj: 68%|██████▊ | 24705/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.14.down_proj: 68%|██████▊ | 24706/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.15.gate_proj: 68%|██████▊ | 24707/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.15.up_proj: 68%|██████▊ | 24708/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.15.down_proj: 68%|██████▊ | 24709/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.16.gate_proj: 68%|██████▊ | 24710/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.16.up_proj: 68%|██████▊ | 24711/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.16.down_proj: 68%|██████▊ | 24712/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.17.gate_proj: 68%|██████▊ | 24713/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.17.up_proj: 68%|██████▊ | 24714/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.17.down_proj: 68%|██████▊ | 24715/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.18.gate_proj: 68%|██████▊ | 24716/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.18.up_proj: 68%|██████▊ | 24717/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.18.down_proj: 68%|██████▊ | 24718/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.19.gate_proj: 68%|██████▊ | 24719/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.19.up_proj: 68%|██████▊ | 24720/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.19.down_proj: 68%|██████▊ | 24721/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.20.gate_proj: 68%|██████▊ | 24722/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.20.up_proj: 68%|██████▊ | 24723/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.20.down_proj: 68%|██████▊ | 24724/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.21.gate_proj: 68%|██████▊ | 24725/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.21.up_proj: 68%|██████▊ | 24726/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.21.down_proj: 68%|██████▊ | 24727/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.22.gate_proj: 68%|██████▊ | 24728/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.22.up_proj: 68%|██████▊ | 24729/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.22.down_proj: 68%|██████▊ | 24730/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.23.gate_proj: 68%|██████▊ | 24731/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.23.up_proj: 68%|██████▊ | 24732/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.23.down_proj: 68%|██████▊ | 24733/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.24.gate_proj: 68%|██████▊ | 24734/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.24.up_proj: 68%|██████▊ | 24735/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.24.down_proj: 68%|██████▊ | 24736/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.25.gate_proj: 68%|██████▊ | 24737/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.25.up_proj: 68%|██████▊ | 24738/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.25.down_proj: 68%|██████▊ | 24739/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.26.gate_proj: 68%|██████▊ | 24740/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.26.up_proj: 68%|██████▊ | 24741/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.26.down_proj: 68%|██████▊ | 24742/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.27.gate_proj: 68%|██████▊ | 24743/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.27.up_proj: 68%|██████▊ | 24744/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.27.down_proj: 68%|██████▊ | 24745/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.28.gate_proj: 68%|██████▊ | 24746/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.28.up_proj: 68%|██████▊ | 24747/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.28.down_proj: 68%|██████▊ | 24748/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.29.gate_proj: 68%|██████▊ | 24749/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.29.up_proj: 68%|██████▊ | 24750/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.29.down_proj: 68%|██████▊ | 24751/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.30.gate_proj: 68%|██████▊ | 24752/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.30.up_proj: 68%|██████▊ | 24753/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.30.down_proj: 68%|██████▊ | 24754/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.31.gate_proj: 68%|██████▊ | 24755/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.31.up_proj: 68%|██████▊ | 24756/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.31.down_proj: 68%|██████▊ | 24757/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.32.gate_proj: 68%|██████▊ | 24758/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.32.up_proj: 68%|██████▊ | 24759/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.32.down_proj: 68%|██████▊ | 24760/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.33.gate_proj: 68%|██████▊ | 24761/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.33.up_proj: 68%|██████▊ | 24762/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.33.down_proj: 68%|██████▊ | 24763/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.34.gate_proj: 68%|██████▊ | 24764/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.34.up_proj: 68%|██████▊ | 24765/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.34.down_proj: 68%|██████▊ | 24766/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.35.gate_proj: 68%|██████▊ | 24767/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.35.up_proj: 68%|██████▊ | 24768/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.35.down_proj: 68%|██████▊ | 24769/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.36.gate_proj: 68%|██████▊ | 24770/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.36.up_proj: 68%|██████▊ | 24771/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.36.down_proj: 68%|██████▊ | 24772/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.37.gate_proj: 68%|██████▊ | 24773/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.37.up_proj: 68%|██████▊ | 24774/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.37.down_proj: 68%|██████▊ | 24775/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.38.gate_proj: 68%|██████▊ | 24776/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.38.up_proj: 68%|██████▊ | 24777/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.38.down_proj: 68%|██████▊ | 24778/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.39.gate_proj: 68%|██████▊ | 24779/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.39.up_proj: 68%|██████▊ | 24780/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.39.down_proj: 68%|██████▊ | 24781/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.40.gate_proj: 68%|██████▊ | 24782/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.40.up_proj: 68%|██████▊ | 24783/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.40.down_proj: 68%|██████▊ | 24784/36566 [00:22<00:10, 1144.35it/s] packing model.layers.63.mlp.experts.40.down_proj: 68%|██████▊ | 24785/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.41.gate_proj: 68%|██████▊ | 24785/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.41.up_proj: 68%|██████▊ | 24786/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.41.down_proj: 68%|██████▊ | 24787/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.42.gate_proj: 68%|██████▊ | 24788/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.42.up_proj: 68%|██████▊ | 24789/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.42.down_proj: 68%|██████▊ | 24790/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.43.gate_proj: 68%|██████▊ | 24791/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.43.up_proj: 68%|██████▊ | 24792/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.43.down_proj: 68%|██████▊ | 24793/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.44.gate_proj: 68%|██████▊ | 24794/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.44.up_proj: 68%|██████▊ | 24795/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.44.down_proj: 68%|██████▊ | 24796/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.45.gate_proj: 68%|██████▊ | 24797/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.45.up_proj: 68%|██████▊ | 24798/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.45.down_proj: 68%|██████▊ | 24799/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.46.gate_proj: 68%|██████▊ | 24800/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.46.up_proj: 68%|██████▊ | 24801/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.46.down_proj: 68%|██████▊ | 24802/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.47.gate_proj: 68%|██████▊ | 24803/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.47.up_proj: 68%|██████▊ | 24804/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.47.down_proj: 68%|██████▊ | 24805/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.48.gate_proj: 68%|██████▊ | 24806/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.48.up_proj: 68%|██████▊ | 24807/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.48.down_proj: 68%|██████▊ | 24808/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.49.gate_proj: 68%|██████▊ | 24809/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.49.up_proj: 68%|██████▊ | 24810/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.49.down_proj: 68%|██████▊ | 24811/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.50.gate_proj: 68%|██████▊ | 24812/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.50.up_proj: 68%|██████▊ | 24813/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.50.down_proj: 68%|██████▊ | 24814/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.51.gate_proj: 68%|██████▊ | 24815/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.51.up_proj: 68%|██████▊ | 24816/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.51.down_proj: 68%|██████▊ | 24817/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.52.gate_proj: 68%|██████▊ | 24818/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.52.up_proj: 68%|██████▊ | 24819/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.52.down_proj: 68%|██████▊ | 24820/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.53.gate_proj: 68%|██████▊ | 24821/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.53.up_proj: 68%|██████▊ | 24822/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.53.down_proj: 68%|██████▊ | 24823/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.54.gate_proj: 68%|██████▊ | 24824/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.54.up_proj: 68%|██████▊ | 24825/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.54.down_proj: 68%|██████▊ | 24826/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.55.gate_proj: 68%|██████▊ | 24827/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.55.up_proj: 68%|██████▊ | 24828/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.55.down_proj: 68%|██████▊ | 24829/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.56.gate_proj: 68%|██████▊ | 24830/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.56.up_proj: 68%|██████▊ | 24831/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.56.down_proj: 68%|██████▊ | 24832/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.57.gate_proj: 68%|██████▊ | 24833/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.57.up_proj: 68%|██████▊ | 24834/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.57.down_proj: 68%|██████▊ | 24835/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.58.gate_proj: 68%|██████▊ | 24836/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.58.up_proj: 68%|██████▊ | 24837/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.58.down_proj: 68%|██████▊ | 24838/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.59.gate_proj: 68%|██████▊ | 24839/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.59.up_proj: 68%|██████▊ | 24840/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.59.down_proj: 68%|██████▊ | 24841/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.60.gate_proj: 68%|██████▊ | 24842/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.60.up_proj: 68%|██████▊ | 24843/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.60.down_proj: 68%|██████▊ | 24844/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.61.gate_proj: 68%|██████▊ | 24845/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.61.up_proj: 68%|██████▊ | 24846/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.61.down_proj: 68%|██████▊ | 24847/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.62.gate_proj: 68%|██████▊ | 24848/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.62.up_proj: 68%|██████▊ | 24849/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.62.down_proj: 68%|██████▊ | 24850/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.63.gate_proj: 68%|██████▊ | 24851/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.63.up_proj: 68%|██████▊ | 24852/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.63.down_proj: 68%|██████▊ | 24853/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.64.gate_proj: 68%|██████▊ | 24854/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.64.up_proj: 68%|██████▊ | 24855/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.64.down_proj: 68%|██████▊ | 24856/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.65.gate_proj: 68%|██████▊ | 24857/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.65.up_proj: 68%|██████▊ | 24858/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.65.down_proj: 68%|██████▊ | 24859/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.66.gate_proj: 68%|██████▊ | 24860/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.66.up_proj: 68%|██████▊ | 24861/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.66.down_proj: 68%|██████▊ | 24862/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.67.gate_proj: 68%|██████▊ | 24863/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.67.up_proj: 68%|██████▊ | 24864/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.67.down_proj: 68%|██████▊ | 24865/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.68.gate_proj: 68%|██████▊ | 24866/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.68.up_proj: 68%|██████▊ | 24867/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.68.down_proj: 68%|██████▊ | 24868/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.69.gate_proj: 68%|██████▊ | 24869/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.69.up_proj: 68%|██████▊ | 24870/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.69.down_proj: 68%|██████▊ | 24871/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.70.gate_proj: 68%|██████▊ | 24872/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.70.up_proj: 68%|██████▊ | 24873/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.70.down_proj: 68%|██████▊ | 24874/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.71.gate_proj: 68%|██████▊ | 24875/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.71.up_proj: 68%|██████▊ | 24876/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.71.down_proj: 68%|██████▊ | 24877/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.72.gate_proj: 68%|██████▊ | 24878/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.72.up_proj: 68%|██████▊ | 24879/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.72.down_proj: 68%|██████▊ | 24880/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.73.gate_proj: 68%|██████▊ | 24881/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.73.up_proj: 68%|██████▊ | 24882/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.73.down_proj: 68%|██████▊ | 24883/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.74.gate_proj: 68%|██████▊ | 24884/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.74.up_proj: 68%|██████▊ | 24885/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.74.down_proj: 68%|██████▊ | 24886/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.75.gate_proj: 68%|██████▊ | 24887/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.75.up_proj: 68%|██████▊ | 24888/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.75.down_proj: 68%|██████▊ | 24889/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.76.gate_proj: 68%|██████▊ | 24890/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.76.up_proj: 68%|██████▊ | 24891/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.76.down_proj: 68%|██████▊ | 24892/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.77.gate_proj: 68%|██████▊ | 24893/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.77.up_proj: 68%|██████▊ | 24894/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.77.down_proj: 68%|██████▊ | 24895/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.78.gate_proj: 68%|██████▊ | 24896/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.78.up_proj: 68%|██████▊ | 24897/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.78.down_proj: 68%|██████▊ | 24898/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.79.gate_proj: 68%|██████▊ | 24899/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.79.up_proj: 68%|██████▊ | 24900/36566 [00:22<00:10, 1145.83it/s] packing model.layers.63.mlp.experts.79.up_proj: 68%|██████▊ | 24901/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.79.down_proj: 68%|██████▊ | 24901/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.80.gate_proj: 68%|██████▊ | 24902/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.80.up_proj: 68%|██████▊ | 24903/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.80.down_proj: 68%|██████▊ | 24904/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.81.gate_proj: 68%|██████▊ | 24905/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.81.up_proj: 68%|██████▊ | 24906/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.81.down_proj: 68%|██████▊ | 24907/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.82.gate_proj: 68%|██████▊ | 24908/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.82.up_proj: 68%|██████▊ | 24909/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.82.down_proj: 68%|██████▊ | 24910/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.83.gate_proj: 68%|██████▊ | 24911/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.83.up_proj: 68%|██████▊ | 24912/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.83.down_proj: 68%|██████▊ | 24913/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.84.gate_proj: 68%|██████▊ | 24914/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.84.up_proj: 68%|██████▊ | 24915/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.84.down_proj: 68%|██████▊ | 24916/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.85.gate_proj: 68%|██████▊ | 24917/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.85.up_proj: 68%|██████▊ | 24918/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.85.down_proj: 68%|██████▊ | 24919/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.86.gate_proj: 68%|██████▊ | 24920/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.86.up_proj: 68%|██████▊ | 24921/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.86.down_proj: 68%|██████▊ | 24922/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.87.gate_proj: 68%|██████▊ | 24923/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.87.up_proj: 68%|██████▊ | 24924/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.87.down_proj: 68%|██████▊ | 24925/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.88.gate_proj: 68%|██████▊ | 24926/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.88.up_proj: 68%|██████▊ | 24927/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.88.down_proj: 68%|██████▊ | 24928/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.89.gate_proj: 68%|██████▊ | 24929/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.89.up_proj: 68%|██████▊ | 24930/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.89.down_proj: 68%|██████▊ | 24931/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.90.gate_proj: 68%|██████▊ | 24932/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.90.up_proj: 68%|██████▊ | 24933/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.90.down_proj: 68%|██████▊ | 24934/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.91.gate_proj: 68%|██████▊ | 24935/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.91.up_proj: 68%|██████▊ | 24936/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.91.down_proj: 68%|██████▊ | 24937/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.92.gate_proj: 68%|██████▊ | 24938/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.92.up_proj: 68%|██████▊ | 24939/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.92.down_proj: 68%|██████▊ | 24940/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.93.gate_proj: 68%|██████▊ | 24941/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.93.up_proj: 68%|██████▊ | 24942/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.93.down_proj: 68%|██████▊ | 24943/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.94.gate_proj: 68%|██████▊ | 24944/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.94.up_proj: 68%|██████▊ | 24945/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.94.down_proj: 68%|██████▊ | 24946/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.95.gate_proj: 68%|██████▊ | 24947/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.95.up_proj: 68%|██████▊ | 24948/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.95.down_proj: 68%|██████▊ | 24949/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.96.gate_proj: 68%|██████▊ | 24950/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.96.up_proj: 68%|██████▊ | 24951/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.96.down_proj: 68%|██████▊ | 24952/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.97.gate_proj: 68%|██████▊ | 24953/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.97.up_proj: 68%|██████▊ | 24954/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.97.down_proj: 68%|██████▊ | 24955/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.98.gate_proj: 68%|██████▊ | 24956/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.98.up_proj: 68%|██████▊ | 24957/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.98.down_proj: 68%|██████▊ | 24958/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.99.gate_proj: 68%|██████▊ | 24959/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.99.up_proj: 68%|██████▊ | 24960/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.99.down_proj: 68%|██████▊ | 24961/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.100.gate_proj: 68%|██████▊ | 24962/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.100.up_proj: 68%|██████▊ | 24963/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.100.down_proj: 68%|██████▊ | 24964/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.101.gate_proj: 68%|██████▊ | 24965/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.101.up_proj: 68%|██████▊ | 24966/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.101.down_proj: 68%|██████▊ | 24967/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.102.gate_proj: 68%|██████▊ | 24968/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.102.up_proj: 68%|██████▊ | 24969/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.102.down_proj: 68%|██████▊ | 24970/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.103.gate_proj: 68%|██████▊ | 24971/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.103.up_proj: 68%|██████▊ | 24972/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.103.down_proj: 68%|██████▊ | 24973/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.104.gate_proj: 68%|██████▊ | 24974/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.104.up_proj: 68%|██████▊ | 24975/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.104.down_proj: 68%|██████▊ | 24976/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.105.gate_proj: 68%|██████▊ | 24977/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.105.up_proj: 68%|██████▊ | 24978/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.105.down_proj: 68%|██████▊ | 24979/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.106.gate_proj: 68%|██████▊ | 24980/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.106.up_proj: 68%|██████▊ | 24981/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.106.down_proj: 68%|██████▊ | 24982/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.107.gate_proj: 68%|██████▊ | 24983/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.107.up_proj: 68%|██████▊ | 24984/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.107.down_proj: 68%|██████▊ | 24985/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.108.gate_proj: 68%|██████▊ | 24986/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.108.up_proj: 68%|██████▊ | 24987/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.108.down_proj: 68%|██████▊ | 24988/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.109.gate_proj: 68%|██████▊ | 24989/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.109.up_proj: 68%|██████▊ | 24990/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.109.down_proj: 68%|██████▊ | 24991/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.110.gate_proj: 68%|██████▊ | 24992/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.110.up_proj: 68%|██████▊ | 24993/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.110.down_proj: 68%|██████▊ | 24994/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.111.gate_proj: 68%|██████▊ | 24995/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.111.up_proj: 68%|██████▊ | 24996/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.111.down_proj: 68%|██████▊ | 24997/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.112.gate_proj: 68%|██████▊ | 24998/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.112.up_proj: 68%|██████▊ | 24999/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.112.down_proj: 68%|██████▊ | 25000/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.113.gate_proj: 68%|██████▊ | 25001/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.113.up_proj: 68%|██████▊ | 25002/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.113.down_proj: 68%|██████▊ | 25003/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.114.gate_proj: 68%|██████▊ | 25004/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.114.up_proj: 68%|██████▊ | 25005/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.114.down_proj: 68%|██████▊ | 25006/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.115.gate_proj: 68%|██████▊ | 25007/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.115.up_proj: 68%|██████▊ | 25008/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.115.down_proj: 68%|██████▊ | 25009/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.116.gate_proj: 68%|██████▊ | 25010/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.116.up_proj: 68%|██████▊ | 25011/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.116.down_proj: 68%|██████▊ | 25012/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.117.gate_proj: 68%|██████▊ | 25013/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.117.up_proj: 68%|██████▊ | 25014/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.117.down_proj: 68%|██████▊ | 25015/36566 [00:22<00:10, 1147.72it/s] packing model.layers.63.mlp.experts.117.down_proj: 68%|██████▊ | 25016/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.118.gate_proj: 68%|██████▊ | 25016/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.118.up_proj: 68%|██████▊ | 25017/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.118.down_proj: 68%|██████▊ | 25018/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.119.gate_proj: 68%|██████▊ | 25019/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.119.up_proj: 68%|██████▊ | 25020/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.119.down_proj: 68%|██████▊ | 25021/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.120.gate_proj: 68%|██████▊ | 25022/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.120.up_proj: 68%|██████▊ | 25023/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.120.down_proj: 68%|██████▊ | 25024/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.121.gate_proj: 68%|██████▊ | 25025/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.121.up_proj: 68%|██████▊ | 25026/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.121.down_proj: 68%|██████▊ | 25027/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.122.gate_proj: 68%|██████▊ | 25028/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.122.up_proj: 68%|██████▊ | 25029/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.122.down_proj: 68%|██████▊ | 25030/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.123.gate_proj: 68%|██████▊ | 25031/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.123.up_proj: 68%|██████▊ | 25032/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.123.down_proj: 68%|██████▊ | 25033/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.124.gate_proj: 68%|██████▊ | 25034/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.124.up_proj: 68%|██████▊ | 25035/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.124.down_proj: 68%|██████▊ | 25036/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.125.gate_proj: 68%|██████▊ | 25037/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.125.up_proj: 68%|██████▊ | 25038/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.125.down_proj: 68%|██████▊ | 25039/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.126.gate_proj: 68%|██████▊ | 25040/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.126.up_proj: 68%|██████▊ | 25041/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.126.down_proj: 68%|██████▊ | 25042/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.127.gate_proj: 68%|██████▊ | 25043/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.127.up_proj: 68%|██████▊ | 25044/36566 [00:22<00:10, 1146.16it/s] packing model.layers.63.mlp.experts.127.down_proj: 68%|██████▊ | 25045/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.0.gate_proj: 68%|██████▊ | 25046/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.0.up_proj: 68%|██████▊ | 25047/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.0.down_proj: 69%|██████▊ | 25048/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.1.gate_proj: 69%|██████▊ | 25049/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.1.up_proj: 69%|██████▊ | 25050/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.1.down_proj: 69%|██████▊ | 25051/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.2.gate_proj: 69%|██████▊ | 25052/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.2.up_proj: 69%|██████▊ | 25053/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.2.down_proj: 69%|██████▊ | 25054/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.3.gate_proj: 69%|██████▊ | 25055/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.3.up_proj: 69%|██████▊ | 25056/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.3.down_proj: 69%|██████▊ | 25057/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.4.gate_proj: 69%|██████▊ | 25058/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.4.up_proj: 69%|██████▊ | 25059/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.4.down_proj: 69%|██████▊ | 25060/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.5.gate_proj: 69%|██████▊ | 25061/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.5.up_proj: 69%|██████▊ | 25062/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.5.down_proj: 69%|██████▊ | 25063/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.6.gate_proj: 69%|██████▊ | 25064/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.6.up_proj: 69%|██████▊ | 25065/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.6.down_proj: 69%|██████▊ | 25066/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.7.gate_proj: 69%|██████▊ | 25067/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.7.up_proj: 69%|██████▊ | 25068/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.7.down_proj: 69%|██████▊ | 25069/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.8.gate_proj: 69%|██████▊ | 25070/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.8.up_proj: 69%|██████▊ | 25071/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.8.down_proj: 69%|██████▊ | 25072/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.9.gate_proj: 69%|██████▊ | 25073/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.9.up_proj: 69%|██████▊ | 25074/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.9.down_proj: 69%|██████▊ | 25075/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.10.gate_proj: 69%|██████▊ | 25076/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.10.up_proj: 69%|██████▊ | 25077/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.10.down_proj: 69%|██████▊ | 25078/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.11.gate_proj: 69%|██████▊ | 25079/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.11.up_proj: 69%|██████▊ | 25080/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.11.down_proj: 69%|██████▊ | 25081/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.12.gate_proj: 69%|██████▊ | 25082/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.12.up_proj: 69%|██████▊ | 25083/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.12.down_proj: 69%|██████▊ | 25084/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.13.gate_proj: 69%|██████▊ | 25085/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.13.up_proj: 69%|██████▊ | 25086/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.13.down_proj: 69%|██████▊ | 25087/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.14.gate_proj: 69%|██████▊ | 25088/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.14.up_proj: 69%|██████▊ | 25089/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.14.down_proj: 69%|██████▊ | 25090/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.15.gate_proj: 69%|██████▊ | 25091/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.15.up_proj: 69%|██████▊ | 25092/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.15.down_proj: 69%|██████▊ | 25093/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.16.gate_proj: 69%|██████▊ | 25094/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.16.up_proj: 69%|██████▊ | 25095/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.16.down_proj: 69%|██████▊ | 25096/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.17.gate_proj: 69%|██████▊ | 25097/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.17.up_proj: 69%|██████▊ | 25098/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.17.down_proj: 69%|██████▊ | 25099/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.18.gate_proj: 69%|██████▊ | 25100/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.18.up_proj: 69%|██████▊ | 25101/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.18.down_proj: 69%|██████▊ | 25102/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.19.gate_proj: 69%|██████▊ | 25103/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.19.up_proj: 69%|██████▊ | 25104/36566 [00:22<00:10, 1146.16it/s] packing model.layers.64.mlp.experts.19.down_proj: 69%|██████▊ | 25105/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.20.gate_proj: 69%|██████▊ | 25106/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.20.up_proj: 69%|██████▊ | 25107/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.20.down_proj: 69%|██████▊ | 25108/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.21.gate_proj: 69%|██████▊ | 25109/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.21.up_proj: 69%|██████▊ | 25110/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.21.down_proj: 69%|██████▊ | 25111/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.22.gate_proj: 69%|██████▊ | 25112/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.22.up_proj: 69%|██████▊ | 25113/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.22.down_proj: 69%|██████▊ | 25114/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.23.gate_proj: 69%|██████▊ | 25115/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.23.up_proj: 69%|██████▊ | 25116/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.23.down_proj: 69%|██████▊ | 25117/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.24.gate_proj: 69%|██████▊ | 25118/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.24.up_proj: 69%|██████▊ | 25119/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.24.down_proj: 69%|██████▊ | 25120/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.25.gate_proj: 69%|██████▊ | 25121/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.25.up_proj: 69%|██████▊ | 25122/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.25.down_proj: 69%|██████▊ | 25123/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.26.gate_proj: 69%|██████▊ | 25124/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.26.up_proj: 69%|██████▊ | 25125/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.26.down_proj: 69%|██████▊ | 25126/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.27.gate_proj: 69%|██████▊ | 25127/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.27.up_proj: 69%|██████▊ | 25128/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.27.down_proj: 69%|██████▊ | 25129/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.28.gate_proj: 69%|██████▊ | 25130/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.28.gate_proj: 69%|██████▊ | 25131/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.28.up_proj: 69%|██████▊ | 25131/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.28.down_proj: 69%|██████▊ | 25132/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.29.gate_proj: 69%|██████▊ | 25133/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.29.up_proj: 69%|██████▊ | 25134/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.29.down_proj: 69%|██████▊ | 25135/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.30.gate_proj: 69%|██████▊ | 25136/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.30.up_proj: 69%|██████▊ | 25137/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.30.down_proj: 69%|██████▊ | 25138/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.31.gate_proj: 69%|██████▊ | 25139/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.31.up_proj: 69%|██████▉ | 25140/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.31.down_proj: 69%|██████▉ | 25141/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.32.gate_proj: 69%|██████▉ | 25142/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.32.up_proj: 69%|██████▉ | 25143/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.32.down_proj: 69%|██████▉ | 25144/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.33.gate_proj: 69%|██████▉ | 25145/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.33.up_proj: 69%|██████▉ | 25146/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.33.down_proj: 69%|██████▉ | 25147/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.34.gate_proj: 69%|██████▉ | 25148/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.34.up_proj: 69%|██████▉ | 25149/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.34.down_proj: 69%|██████▉ | 25150/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.35.gate_proj: 69%|██████▉ | 25151/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.35.up_proj: 69%|██████▉ | 25152/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.35.down_proj: 69%|██████▉ | 25153/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.36.gate_proj: 69%|██████▉ | 25154/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.36.up_proj: 69%|██████▉ | 25155/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.36.down_proj: 69%|██████▉ | 25156/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.37.gate_proj: 69%|██████▉ | 25157/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.37.up_proj: 69%|██████▉ | 25158/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.37.down_proj: 69%|██████▉ | 25159/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.38.gate_proj: 69%|██████▉ | 25160/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.38.up_proj: 69%|██████▉ | 25161/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.38.down_proj: 69%|██████▉ | 25162/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.39.gate_proj: 69%|██████▉ | 25163/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.39.up_proj: 69%|██████▉ | 25164/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.39.down_proj: 69%|██████▉ | 25165/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.40.gate_proj: 69%|██████▉ | 25166/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.40.up_proj: 69%|██████▉ | 25167/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.40.down_proj: 69%|██████▉ | 25168/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.41.gate_proj: 69%|██████▉ | 25169/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.41.up_proj: 69%|██████▉ | 25170/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.41.down_proj: 69%|██████▉ | 25171/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.42.gate_proj: 69%|██████▉ | 25172/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.42.up_proj: 69%|██████▉ | 25173/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.42.down_proj: 69%|██████▉ | 25174/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.43.gate_proj: 69%|██████▉ | 25175/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.43.up_proj: 69%|██████▉ | 25176/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.43.down_proj: 69%|██████▉ | 25177/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.44.gate_proj: 69%|██████▉ | 25178/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.44.up_proj: 69%|██████▉ | 25179/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.44.down_proj: 69%|██████▉ | 25180/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.45.gate_proj: 69%|██████▉ | 25181/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.45.up_proj: 69%|██████▉ | 25182/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.45.down_proj: 69%|██████▉ | 25183/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.46.gate_proj: 69%|██████▉ | 25184/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.46.up_proj: 69%|██████▉ | 25185/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.46.down_proj: 69%|██████▉ | 25186/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.47.gate_proj: 69%|██████▉ | 25187/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.47.up_proj: 69%|██████▉ | 25188/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.47.down_proj: 69%|██████▉ | 25189/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.48.gate_proj: 69%|██████▉ | 25190/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.48.up_proj: 69%|██████▉ | 25191/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.48.down_proj: 69%|██████▉ | 25192/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.49.gate_proj: 69%|██████▉ | 25193/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.49.up_proj: 69%|██████▉ | 25194/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.49.down_proj: 69%|██████▉ | 25195/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.50.gate_proj: 69%|██████▉ | 25196/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.50.up_proj: 69%|██████▉ | 25197/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.50.down_proj: 69%|██████▉ | 25198/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.51.gate_proj: 69%|██████▉ | 25199/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.51.up_proj: 69%|██████▉ | 25200/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.51.down_proj: 69%|██████▉ | 25201/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.52.gate_proj: 69%|██████▉ | 25202/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.52.up_proj: 69%|██████▉ | 25203/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.52.down_proj: 69%|██████▉ | 25204/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.53.gate_proj: 69%|██████▉ | 25205/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.53.up_proj: 69%|██████▉ | 25206/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.53.down_proj: 69%|██████▉ | 25207/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.54.gate_proj: 69%|██████▉ | 25208/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.54.up_proj: 69%|██████▉ | 25209/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.54.down_proj: 69%|██████▉ | 25210/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.55.gate_proj: 69%|██████▉ | 25211/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.55.up_proj: 69%|██████▉ | 25212/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.55.down_proj: 69%|██████▉ | 25213/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.56.gate_proj: 69%|██████▉ | 25214/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.56.up_proj: 69%|██████▉ | 25215/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.56.down_proj: 69%|██████▉ | 25216/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.57.gate_proj: 69%|██████▉ | 25217/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.57.up_proj: 69%|██████▉ | 25218/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.57.down_proj: 69%|██████▉ | 25219/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.58.gate_proj: 69%|██████▉ | 25220/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.58.up_proj: 69%|██████▉ | 25221/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.58.down_proj: 69%|██████▉ | 25222/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.59.gate_proj: 69%|██████▉ | 25223/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.59.up_proj: 69%|██████▉ | 25224/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.59.down_proj: 69%|██████▉ | 25225/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.60.gate_proj: 69%|██████▉ | 25226/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.60.up_proj: 69%|██████▉ | 25227/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.60.down_proj: 69%|██████▉ | 25228/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.61.gate_proj: 69%|██████▉ | 25229/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.61.up_proj: 69%|██████▉ | 25230/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.61.down_proj: 69%|██████▉ | 25231/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.62.gate_proj: 69%|██████▉ | 25232/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.62.up_proj: 69%|██████▉ | 25233/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.62.down_proj: 69%|██████▉ | 25234/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.63.gate_proj: 69%|██████▉ | 25235/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.63.up_proj: 69%|██████▉ | 25236/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.63.down_proj: 69%|██████▉ | 25237/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.64.gate_proj: 69%|██████▉ | 25238/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.64.up_proj: 69%|██████▉ | 25239/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.64.down_proj: 69%|██████▉ | 25240/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.65.gate_proj: 69%|██████▉ | 25241/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.65.up_proj: 69%|██████▉ | 25242/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.65.down_proj: 69%|██████▉ | 25243/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.66.gate_proj: 69%|██████▉ | 25244/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.66.up_proj: 69%|██████▉ | 25245/36566 [00:22<00:09, 1146.16it/s] packing model.layers.64.mlp.experts.66.up_proj: 69%|██████▉ | 25246/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.66.down_proj: 69%|██████▉ | 25246/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.67.gate_proj: 69%|██████▉ | 25247/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.67.up_proj: 69%|██████▉ | 25248/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.67.down_proj: 69%|██████▉ | 25249/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.68.gate_proj: 69%|██████▉ | 25250/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.68.up_proj: 69%|██████▉ | 25251/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.68.down_proj: 69%|██████▉ | 25252/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.69.gate_proj: 69%|██████▉ | 25253/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.69.up_proj: 69%|██████▉ | 25254/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.69.down_proj: 69%|██████▉ | 25255/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.70.gate_proj: 69%|██████▉ | 25256/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.70.up_proj: 69%|██████▉ | 25257/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.70.down_proj: 69%|██████▉ | 25258/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.71.gate_proj: 69%|██████▉ | 25259/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.71.up_proj: 69%|██████▉ | 25260/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.71.down_proj: 69%|██████▉ | 25261/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.72.gate_proj: 69%|██████▉ | 25262/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.72.up_proj: 69%|██████▉ | 25263/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.72.down_proj: 69%|██████▉ | 25264/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.73.gate_proj: 69%|██████▉ | 25265/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.73.up_proj: 69%|██████▉ | 25266/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.73.down_proj: 69%|██████▉ | 25267/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.74.gate_proj: 69%|██████▉ | 25268/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.74.up_proj: 69%|██████▉ | 25269/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.74.down_proj: 69%|██████▉ | 25270/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.75.gate_proj: 69%|██████▉ | 25271/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.75.up_proj: 69%|██████▉ | 25272/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.75.down_proj: 69%|██████▉ | 25273/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.76.gate_proj: 69%|██████▉ | 25274/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.76.up_proj: 69%|██████▉ | 25275/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.76.down_proj: 69%|██████▉ | 25276/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.77.gate_proj: 69%|██████▉ | 25277/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.77.up_proj: 69%|██████▉ | 25278/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.77.down_proj: 69%|██████▉ | 25279/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.78.gate_proj: 69%|██████▉ | 25280/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.78.up_proj: 69%|██████▉ | 25281/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.78.down_proj: 69%|██████▉ | 25282/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.79.gate_proj: 69%|██████▉ | 25283/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.79.up_proj: 69%|██████▉ | 25284/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.79.down_proj: 69%|██████▉ | 25285/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.80.gate_proj: 69%|██████▉ | 25286/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.80.up_proj: 69%|██████▉ | 25287/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.80.down_proj: 69%|██████▉ | 25288/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.81.gate_proj: 69%|██████▉ | 25289/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.81.up_proj: 69%|██████▉ | 25290/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.81.down_proj: 69%|██████▉ | 25291/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.82.gate_proj: 69%|██████▉ | 25292/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.82.up_proj: 69%|██████▉ | 25293/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.82.down_proj: 69%|██████▉ | 25294/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.83.gate_proj: 69%|██████▉ | 25295/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.83.up_proj: 69%|██████▉ | 25296/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.83.down_proj: 69%|██████▉ | 25297/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.84.gate_proj: 69%|██████▉ | 25298/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.84.up_proj: 69%|██████▉ | 25299/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.84.down_proj: 69%|██████▉ | 25300/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.85.gate_proj: 69%|██████▉ | 25301/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.85.up_proj: 69%|██████▉ | 25302/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.85.down_proj: 69%|██████▉ | 25303/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.86.gate_proj: 69%|██████▉ | 25304/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.86.up_proj: 69%|██████▉ | 25305/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.86.down_proj: 69%|██████▉ | 25306/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.87.gate_proj: 69%|██████▉ | 25307/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.87.up_proj: 69%|██████▉ | 25308/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.87.down_proj: 69%|██████▉ | 25309/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.88.gate_proj: 69%|██████▉ | 25310/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.88.up_proj: 69%|██████▉ | 25311/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.88.down_proj: 69%|██████▉ | 25312/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.89.gate_proj: 69%|██████▉ | 25313/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.89.up_proj: 69%|██████▉ | 25314/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.89.down_proj: 69%|██████▉ | 25315/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.90.gate_proj: 69%|██████▉ | 25316/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.90.up_proj: 69%|██████▉ | 25317/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.90.down_proj: 69%|██████▉ | 25318/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.91.gate_proj: 69%|██████▉ | 25319/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.91.up_proj: 69%|██████▉ | 25320/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.91.down_proj: 69%|██████▉ | 25321/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.92.gate_proj: 69%|██████▉ | 25322/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.92.up_proj: 69%|██████▉ | 25323/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.92.down_proj: 69%|██████▉ | 25324/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.93.gate_proj: 69%|██████▉ | 25325/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.93.up_proj: 69%|██████▉ | 25326/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.93.down_proj: 69%|██████▉ | 25327/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.94.gate_proj: 69%|██████▉ | 25328/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.94.up_proj: 69%|██████▉ | 25329/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.94.down_proj: 69%|██████▉ | 25330/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.95.gate_proj: 69%|██████▉ | 25331/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.95.up_proj: 69%|██████▉ | 25332/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.95.down_proj: 69%|██████▉ | 25333/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.96.gate_proj: 69%|██████▉ | 25334/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.96.up_proj: 69%|██████▉ | 25335/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.96.down_proj: 69%|██████▉ | 25336/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.97.gate_proj: 69%|██████▉ | 25337/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.97.up_proj: 69%|██████▉ | 25338/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.97.down_proj: 69%|██████▉ | 25339/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.98.gate_proj: 69%|██████▉ | 25340/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.98.up_proj: 69%|██████▉ | 25341/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.98.down_proj: 69%|██████▉ | 25342/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.99.gate_proj: 69%|██████▉ | 25343/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.99.up_proj: 69%|██████▉ | 25344/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.99.down_proj: 69%|██████▉ | 25345/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.100.gate_proj: 69%|██████▉ | 25346/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.100.up_proj: 69%|██████▉ | 25347/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.100.down_proj: 69%|██████▉ | 25348/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.101.gate_proj: 69%|██████▉ | 25349/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.101.up_proj: 69%|██████▉ | 25350/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.101.down_proj: 69%|██████▉ | 25351/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.102.gate_proj: 69%|██████▉ | 25352/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.102.up_proj: 69%|██████▉ | 25353/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.102.down_proj: 69%|██████▉ | 25354/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.103.gate_proj: 69%|██████▉ | 25355/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.103.up_proj: 69%|██████▉ | 25356/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.103.down_proj: 69%|██████▉ | 25357/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.104.gate_proj: 69%|██████▉ | 25358/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.104.up_proj: 69%|██████▉ | 25359/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.104.down_proj: 69%|██████▉ | 25360/36566 [00:22<00:09, 1146.30it/s] packing model.layers.64.mlp.experts.104.down_proj: 69%|██████▉ | 25361/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.105.gate_proj: 69%|██████▉ | 25361/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.105.up_proj: 69%|██████▉ | 25362/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.105.down_proj: 69%|██████▉ | 25363/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.106.gate_proj: 69%|██████▉ | 25364/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.106.up_proj: 69%|██████▉ | 25365/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.106.down_proj: 69%|██████▉ | 25366/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.107.gate_proj: 69%|██████▉ | 25367/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.107.up_proj: 69%|██████▉ | 25368/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.107.down_proj: 69%|██████▉ | 25369/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.108.gate_proj: 69%|██████▉ | 25370/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.108.up_proj: 69%|██████▉ | 25371/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.108.down_proj: 69%|██████▉ | 25372/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.109.gate_proj: 69%|██████▉ | 25373/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.109.up_proj: 69%|██████▉ | 25374/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.109.down_proj: 69%|██████▉ | 25375/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.110.gate_proj: 69%|██████▉ | 25376/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.110.up_proj: 69%|██████▉ | 25377/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.110.down_proj: 69%|██████▉ | 25378/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.111.gate_proj: 69%|██████▉ | 25379/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.111.up_proj: 69%|██████▉ | 25380/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.111.down_proj: 69%|██████▉ | 25381/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.112.gate_proj: 69%|██████▉ | 25382/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.112.up_proj: 69%|██████▉ | 25383/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.112.down_proj: 69%|██████▉ | 25384/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.113.gate_proj: 69%|██████▉ | 25385/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.113.up_proj: 69%|██████▉ | 25386/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.113.down_proj: 69%|██████▉ | 25387/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.114.gate_proj: 69%|██████▉ | 25388/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.114.up_proj: 69%|██████▉ | 25389/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.114.down_proj: 69%|██████▉ | 25390/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.115.gate_proj: 69%|██████▉ | 25391/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.115.up_proj: 69%|██████▉ | 25392/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.115.down_proj: 69%|██████▉ | 25393/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.116.gate_proj: 69%|██████▉ | 25394/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.116.up_proj: 69%|██████▉ | 25395/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.116.down_proj: 69%|██████▉ | 25396/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.117.gate_proj: 69%|██████▉ | 25397/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.117.up_proj: 69%|██████▉ | 25398/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.117.down_proj: 69%|██████▉ | 25399/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.118.gate_proj: 69%|██████▉ | 25400/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.118.up_proj: 69%|██████▉ | 25401/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.118.down_proj: 69%|██████▉ | 25402/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.119.gate_proj: 69%|██████▉ | 25403/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.119.up_proj: 69%|██████▉ | 25404/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.119.down_proj: 69%|██████▉ | 25405/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.120.gate_proj: 69%|██████▉ | 25406/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.120.up_proj: 69%|██████▉ | 25407/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.120.down_proj: 69%|██████▉ | 25408/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.121.gate_proj: 69%|██████▉ | 25409/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.121.up_proj: 69%|██████▉ | 25410/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.121.down_proj: 69%|██████▉ | 25411/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.122.gate_proj: 69%|██████▉ | 25412/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.122.up_proj: 69%|██████▉ | 25413/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.122.down_proj: 70%|██████▉ | 25414/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.123.gate_proj: 70%|██████▉ | 25415/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.123.up_proj: 70%|██████▉ | 25416/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.123.down_proj: 70%|██████▉ | 25417/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.124.gate_proj: 70%|██████▉ | 25418/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.124.up_proj: 70%|██████▉ | 25419/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.124.down_proj: 70%|██████▉ | 25420/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.125.gate_proj: 70%|██████▉ | 25421/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.125.up_proj: 70%|██████▉ | 25422/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.125.down_proj: 70%|██████▉ | 25423/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.126.gate_proj: 70%|██████▉ | 25424/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.126.up_proj: 70%|██████▉ | 25425/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.126.down_proj: 70%|██████▉ | 25426/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.127.gate_proj: 70%|██████▉ | 25427/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.127.up_proj: 70%|██████▉ | 25428/36566 [00:22<00:09, 1147.10it/s] packing model.layers.64.mlp.experts.127.down_proj: 70%|██████▉ | 25429/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.0.gate_proj: 70%|██████▉ | 25430/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.0.up_proj: 70%|██████▉ | 25431/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.0.down_proj: 70%|██████▉ | 25432/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.1.gate_proj: 70%|██████▉ | 25433/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.1.up_proj: 70%|██████▉ | 25434/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.1.down_proj: 70%|██████▉ | 25435/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.2.gate_proj: 70%|██████▉ | 25436/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.2.up_proj: 70%|██████▉ | 25437/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.2.down_proj: 70%|██████▉ | 25438/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.3.gate_proj: 70%|██████▉ | 25439/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.3.up_proj: 70%|██████▉ | 25440/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.3.down_proj: 70%|██████▉ | 25441/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.4.gate_proj: 70%|██████▉ | 25442/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.4.up_proj: 70%|██████▉ | 25443/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.4.down_proj: 70%|██████▉ | 25444/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.5.gate_proj: 70%|██████▉ | 25445/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.5.up_proj: 70%|██████▉ | 25446/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.5.down_proj: 70%|██████▉ | 25447/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.6.gate_proj: 70%|██████▉ | 25448/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.6.up_proj: 70%|██████▉ | 25449/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.6.down_proj: 70%|██████▉ | 25450/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.7.gate_proj: 70%|██████▉ | 25451/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.7.up_proj: 70%|██████▉ | 25452/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.7.down_proj: 70%|██████▉ | 25453/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.8.gate_proj: 70%|██████▉ | 25454/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.8.up_proj: 70%|██████▉ | 25455/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.8.down_proj: 70%|██████▉ | 25456/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.9.gate_proj: 70%|██████▉ | 25457/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.9.up_proj: 70%|██████▉ | 25458/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.9.down_proj: 70%|██████▉ | 25459/36566 [00:22<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.10.gate_proj: 70%|██████▉ | 25460/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.10.up_proj: 70%|██████▉ | 25461/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.10.down_proj: 70%|██████▉ | 25462/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.11.gate_proj: 70%|██████▉ | 25463/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.11.up_proj: 70%|██████▉ | 25464/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.11.down_proj: 70%|██████▉ | 25465/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.12.gate_proj: 70%|██████▉ | 25466/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.12.up_proj: 70%|██████▉ | 25467/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.12.down_proj: 70%|██████▉ | 25468/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.13.gate_proj: 70%|██████▉ | 25469/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.13.up_proj: 70%|██████▉ | 25470/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.13.down_proj: 70%|██████▉ | 25471/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.14.gate_proj: 70%|██████▉ | 25472/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.14.up_proj: 70%|██████▉ | 25473/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.14.down_proj: 70%|██████▉ | 25474/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.15.gate_proj: 70%|██████▉ | 25475/36566 [00:23<00:09, 1147.10it/s] packing model.layers.65.mlp.experts.15.gate_proj: 70%|██████▉ | 25476/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.15.up_proj: 70%|██████▉ | 25476/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.15.down_proj: 70%|██████▉ | 25477/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.16.gate_proj: 70%|██████▉ | 25478/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.16.up_proj: 70%|██████▉ | 25479/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.16.down_proj: 70%|██████▉ | 25480/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.17.gate_proj: 70%|██████▉ | 25481/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.17.up_proj: 70%|██████▉ | 25482/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.17.down_proj: 70%|██████▉ | 25483/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.18.gate_proj: 70%|██████▉ | 25484/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.18.up_proj: 70%|██████▉ | 25485/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.18.down_proj: 70%|██████▉ | 25486/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.19.gate_proj: 70%|██████▉ | 25487/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.19.up_proj: 70%|██████▉ | 25488/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.19.down_proj: 70%|██████▉ | 25489/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.20.gate_proj: 70%|██████▉ | 25490/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.20.up_proj: 70%|██████▉ | 25491/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.20.down_proj: 70%|██████▉ | 25492/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.21.gate_proj: 70%|██████▉ | 25493/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.21.up_proj: 70%|██████▉ | 25494/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.21.down_proj: 70%|██████▉ | 25495/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.22.gate_proj: 70%|██████▉ | 25496/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.22.up_proj: 70%|██████▉ | 25497/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.22.down_proj: 70%|██████▉ | 25498/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.23.gate_proj: 70%|██████▉ | 25499/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.23.up_proj: 70%|██████▉ | 25500/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.23.down_proj: 70%|██████▉ | 25501/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.24.gate_proj: 70%|██████▉ | 25502/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.24.up_proj: 70%|██████▉ | 25503/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.24.down_proj: 70%|██████▉ | 25504/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.25.gate_proj: 70%|██████▉ | 25505/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.25.up_proj: 70%|██████▉ | 25506/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.25.down_proj: 70%|██████▉ | 25507/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.26.gate_proj: 70%|██████▉ | 25508/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.26.up_proj: 70%|██████▉ | 25509/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.26.down_proj: 70%|██████▉ | 25510/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.27.gate_proj: 70%|██████▉ | 25511/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.27.up_proj: 70%|██████▉ | 25512/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.27.down_proj: 70%|██████▉ | 25513/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.28.gate_proj: 70%|██████▉ | 25514/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.28.up_proj: 70%|██████▉ | 25515/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.28.down_proj: 70%|██████▉ | 25516/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.29.gate_proj: 70%|██████▉ | 25517/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.29.up_proj: 70%|██████▉ | 25518/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.29.down_proj: 70%|██████▉ | 25519/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.30.gate_proj: 70%|██████▉ | 25520/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.30.up_proj: 70%|██████▉ | 25521/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.30.down_proj: 70%|██████▉ | 25522/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.31.gate_proj: 70%|██████▉ | 25523/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.31.up_proj: 70%|██████▉ | 25524/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.31.down_proj: 70%|██████▉ | 25525/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.32.gate_proj: 70%|██████▉ | 25526/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.32.up_proj: 70%|██████▉ | 25527/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.32.down_proj: 70%|██████▉ | 25528/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.33.gate_proj: 70%|██████▉ | 25529/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.33.up_proj: 70%|██████▉ | 25530/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.33.down_proj: 70%|██████▉ | 25531/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.34.gate_proj: 70%|██████▉ | 25532/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.34.up_proj: 70%|██████▉ | 25533/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.34.down_proj: 70%|██████▉ | 25534/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.35.gate_proj: 70%|██████▉ | 25535/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.35.up_proj: 70%|██████▉ | 25536/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.35.down_proj: 70%|██████▉ | 25537/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.36.gate_proj: 70%|██████▉ | 25538/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.36.up_proj: 70%|██████▉ | 25539/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.36.down_proj: 70%|██████▉ | 25540/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.37.gate_proj: 70%|██████▉ | 25541/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.37.up_proj: 70%|██████▉ | 25542/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.37.down_proj: 70%|██████▉ | 25543/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.38.gate_proj: 70%|██████▉ | 25544/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.38.up_proj: 70%|██████▉ | 25545/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.38.down_proj: 70%|██████▉ | 25546/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.39.gate_proj: 70%|██████▉ | 25547/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.39.up_proj: 70%|██████▉ | 25548/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.39.down_proj: 70%|██████▉ | 25549/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.40.gate_proj: 70%|██████▉ | 25550/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.40.up_proj: 70%|██████▉ | 25551/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.40.down_proj: 70%|██████▉ | 25552/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.41.gate_proj: 70%|██████▉ | 25553/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.41.up_proj: 70%|██████▉ | 25554/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.41.down_proj: 70%|██████▉ | 25555/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.42.gate_proj: 70%|██████▉ | 25556/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.42.up_proj: 70%|██████▉ | 25557/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.42.down_proj: 70%|██████▉ | 25558/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.43.gate_proj: 70%|██████▉ | 25559/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.43.up_proj: 70%|██████▉ | 25560/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.43.down_proj: 70%|██████▉ | 25561/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.44.gate_proj: 70%|██████▉ | 25562/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.44.up_proj: 70%|██████▉ | 25563/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.44.down_proj: 70%|██████▉ | 25564/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.45.gate_proj: 70%|██████▉ | 25565/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.45.up_proj: 70%|██████▉ | 25566/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.45.down_proj: 70%|██████▉ | 25567/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.46.gate_proj: 70%|██████▉ | 25568/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.46.up_proj: 70%|██████▉ | 25569/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.46.down_proj: 70%|██████▉ | 25570/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.47.gate_proj: 70%|██████▉ | 25571/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.47.up_proj: 70%|██████▉ | 25572/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.47.down_proj: 70%|██████▉ | 25573/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.48.gate_proj: 70%|██████▉ | 25574/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.48.up_proj: 70%|██████▉ | 25575/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.48.down_proj: 70%|██████▉ | 25576/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.49.gate_proj: 70%|██████▉ | 25577/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.49.up_proj: 70%|██████▉ | 25578/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.49.down_proj: 70%|██████▉ | 25579/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.50.gate_proj: 70%|██████▉ | 25580/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.50.up_proj: 70%|██████▉ | 25581/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.50.down_proj: 70%|██████▉ | 25582/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.51.gate_proj: 70%|██████▉ | 25583/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.51.up_proj: 70%|██████▉ | 25584/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.51.down_proj: 70%|██████▉ | 25585/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.52.gate_proj: 70%|██████▉ | 25586/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.52.up_proj: 70%|██████▉ | 25587/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.52.down_proj: 70%|██████▉ | 25588/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.53.gate_proj: 70%|██████▉ | 25589/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.53.up_proj: 70%|██████▉ | 25590/36566 [00:23<00:09, 1147.09it/s] packing model.layers.65.mlp.experts.53.up_proj: 70%|██████▉ | 25591/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.53.down_proj: 70%|██████▉ | 25591/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.54.gate_proj: 70%|██████▉ | 25592/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.54.up_proj: 70%|██████▉ | 25593/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.54.down_proj: 70%|██████▉ | 25594/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.55.gate_proj: 70%|██████▉ | 25595/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.55.up_proj: 70%|██████▉ | 25596/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.55.down_proj: 70%|███████ | 25597/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.56.gate_proj: 70%|███████ | 25598/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.56.up_proj: 70%|███████ | 25599/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.56.down_proj: 70%|███████ | 25600/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.57.gate_proj: 70%|███████ | 25601/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.57.up_proj: 70%|███████ | 25602/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.57.down_proj: 70%|███████ | 25603/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.58.gate_proj: 70%|███████ | 25604/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.58.up_proj: 70%|███████ | 25605/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.58.down_proj: 70%|███████ | 25606/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.59.gate_proj: 70%|███████ | 25607/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.59.up_proj: 70%|███████ | 25608/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.59.down_proj: 70%|███████ | 25609/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.60.gate_proj: 70%|███████ | 25610/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.60.up_proj: 70%|███████ | 25611/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.60.down_proj: 70%|███████ | 25612/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.61.gate_proj: 70%|███████ | 25613/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.61.up_proj: 70%|███████ | 25614/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.61.down_proj: 70%|███████ | 25615/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.62.gate_proj: 70%|███████ | 25616/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.62.up_proj: 70%|███████ | 25617/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.62.down_proj: 70%|███████ | 25618/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.63.gate_proj: 70%|███████ | 25619/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.63.up_proj: 70%|███████ | 25620/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.63.down_proj: 70%|███████ | 25621/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.64.gate_proj: 70%|███████ | 25622/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.64.up_proj: 70%|███████ | 25623/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.64.down_proj: 70%|███████ | 25624/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.65.gate_proj: 70%|███████ | 25625/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.65.up_proj: 70%|███████ | 25626/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.65.down_proj: 70%|███████ | 25627/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.66.gate_proj: 70%|███████ | 25628/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.66.up_proj: 70%|███████ | 25629/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.66.down_proj: 70%|███████ | 25630/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.67.gate_proj: 70%|███████ | 25631/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.67.up_proj: 70%|███████ | 25632/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.67.down_proj: 70%|███████ | 25633/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.68.gate_proj: 70%|███████ | 25634/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.68.up_proj: 70%|███████ | 25635/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.68.down_proj: 70%|███████ | 25636/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.69.gate_proj: 70%|███████ | 25637/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.69.up_proj: 70%|███████ | 25638/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.69.down_proj: 70%|███████ | 25639/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.70.gate_proj: 70%|███████ | 25640/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.70.up_proj: 70%|███████ | 25641/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.70.down_proj: 70%|███████ | 25642/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.71.gate_proj: 70%|███████ | 25643/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.71.up_proj: 70%|███████ | 25644/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.71.down_proj: 70%|███████ | 25645/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.72.gate_proj: 70%|███████ | 25646/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.72.up_proj: 70%|███████ | 25647/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.72.down_proj: 70%|███████ | 25648/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.73.gate_proj: 70%|███████ | 25649/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.73.up_proj: 70%|███████ | 25650/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.73.down_proj: 70%|███████ | 25651/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.74.gate_proj: 70%|███████ | 25652/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.74.up_proj: 70%|███████ | 25653/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.74.down_proj: 70%|███████ | 25654/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.75.gate_proj: 70%|███████ | 25655/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.75.up_proj: 70%|███████ | 25656/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.75.down_proj: 70%|███████ | 25657/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.76.gate_proj: 70%|███████ | 25658/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.76.up_proj: 70%|███████ | 25659/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.76.down_proj: 70%|███████ | 25660/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.77.gate_proj: 70%|███████ | 25661/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.77.up_proj: 70%|███████ | 25662/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.77.down_proj: 70%|███████ | 25663/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.78.gate_proj: 70%|███████ | 25664/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.78.up_proj: 70%|███████ | 25665/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.78.down_proj: 70%|███████ | 25666/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.79.gate_proj: 70%|███████ | 25667/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.79.up_proj: 70%|███████ | 25668/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.79.down_proj: 70%|███████ | 25669/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.80.gate_proj: 70%|███████ | 25670/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.80.up_proj: 70%|███████ | 25671/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.80.down_proj: 70%|███████ | 25672/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.81.gate_proj: 70%|███████ | 25673/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.81.up_proj: 70%|███████ | 25674/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.81.down_proj: 70%|███████ | 25675/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.82.gate_proj: 70%|███████ | 25676/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.82.up_proj: 70%|███████ | 25677/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.82.down_proj: 70%|███████ | 25678/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.83.gate_proj: 70%|███████ | 25679/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.83.up_proj: 70%|███████ | 25680/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.83.down_proj: 70%|███████ | 25681/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.84.gate_proj: 70%|███████ | 25682/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.84.up_proj: 70%|███████ | 25683/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.84.down_proj: 70%|███████ | 25684/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.85.gate_proj: 70%|███████ | 25685/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.85.up_proj: 70%|███████ | 25686/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.85.down_proj: 70%|███████ | 25687/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.86.gate_proj: 70%|███████ | 25688/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.86.up_proj: 70%|███████ | 25689/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.86.down_proj: 70%|███████ | 25690/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.87.gate_proj: 70%|███████ | 25691/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.87.up_proj: 70%|███████ | 25692/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.87.down_proj: 70%|███████ | 25693/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.88.gate_proj: 70%|███████ | 25694/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.88.up_proj: 70%|███████ | 25695/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.88.down_proj: 70%|███████ | 25696/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.89.gate_proj: 70%|███████ | 25697/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.89.up_proj: 70%|███████ | 25698/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.89.down_proj: 70%|███████ | 25699/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.90.gate_proj: 70%|███████ | 25700/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.90.up_proj: 70%|███████ | 25701/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.90.down_proj: 70%|███████ | 25702/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.91.gate_proj: 70%|███████ | 25703/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.91.up_proj: 70%|███████ | 25704/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.91.down_proj: 70%|███████ | 25705/36566 [00:23<00:09, 1144.79it/s] packing model.layers.65.mlp.experts.91.down_proj: 70%|███████ | 25706/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.92.gate_proj: 70%|███████ | 25706/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.92.up_proj: 70%|███████ | 25707/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.92.down_proj: 70%|███████ | 25708/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.93.gate_proj: 70%|███████ | 25709/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.93.up_proj: 70%|███████ | 25710/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.93.down_proj: 70%|███████ | 25711/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.94.gate_proj: 70%|███████ | 25712/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.94.up_proj: 70%|███████ | 25713/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.94.down_proj: 70%|███████ | 25714/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.95.gate_proj: 70%|███████ | 25715/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.95.up_proj: 70%|███████ | 25716/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.95.down_proj: 70%|███████ | 25717/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.96.gate_proj: 70%|███████ | 25718/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.96.up_proj: 70%|███████ | 25719/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.96.down_proj: 70%|███████ | 25720/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.97.gate_proj: 70%|███████ | 25721/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.97.up_proj: 70%|███████ | 25722/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.97.down_proj: 70%|███████ | 25723/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.98.gate_proj: 70%|███████ | 25724/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.98.up_proj: 70%|███████ | 25725/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.98.down_proj: 70%|███████ | 25726/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.99.gate_proj: 70%|███████ | 25727/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.99.up_proj: 70%|███████ | 25728/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.99.down_proj: 70%|███████ | 25729/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.100.gate_proj: 70%|███████ | 25730/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.100.up_proj: 70%|███████ | 25731/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.100.down_proj: 70%|███████ | 25732/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.101.gate_proj: 70%|███████ | 25733/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.101.up_proj: 70%|███████ | 25734/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.101.down_proj: 70%|███████ | 25735/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.102.gate_proj: 70%|███████ | 25736/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.102.up_proj: 70%|███████ | 25737/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.102.down_proj: 70%|███████ | 25738/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.103.gate_proj: 70%|███████ | 25739/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.103.up_proj: 70%|███████ | 25740/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.103.down_proj: 70%|███████ | 25741/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.104.gate_proj: 70%|███████ | 25742/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.104.up_proj: 70%|███████ | 25743/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.104.down_proj: 70%|███████ | 25744/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.105.gate_proj: 70%|███████ | 25745/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.105.up_proj: 70%|███████ | 25746/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.105.down_proj: 70%|███████ | 25747/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.106.gate_proj: 70%|███████ | 25748/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.106.up_proj: 70%|███████ | 25749/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.106.down_proj: 70%|███████ | 25750/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.107.gate_proj: 70%|███████ | 25751/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.107.up_proj: 70%|███████ | 25752/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.107.down_proj: 70%|███████ | 25753/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.108.gate_proj: 70%|███████ | 25754/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.108.up_proj: 70%|███████ | 25755/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.108.down_proj: 70%|███████ | 25756/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.109.gate_proj: 70%|███████ | 25757/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.109.up_proj: 70%|███████ | 25758/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.109.down_proj: 70%|███████ | 25759/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.110.gate_proj: 70%|███████ | 25760/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.110.up_proj: 70%|███████ | 25761/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.110.down_proj: 70%|███████ | 25762/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.111.gate_proj: 70%|███████ | 25763/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.111.up_proj: 70%|███████ | 25764/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.111.down_proj: 70%|███████ | 25765/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.112.gate_proj: 70%|███████ | 25766/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.112.up_proj: 70%|███████ | 25767/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.112.down_proj: 70%|███████ | 25768/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.113.gate_proj: 70%|███████ | 25769/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.113.up_proj: 70%|███████ | 25770/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.113.down_proj: 70%|███████ | 25771/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.114.gate_proj: 70%|███████ | 25772/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.114.up_proj: 70%|███████ | 25773/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.114.down_proj: 70%|███████ | 25774/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.115.gate_proj: 70%|███████ | 25775/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.115.up_proj: 70%|███████ | 25776/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.115.down_proj: 70%|███████ | 25777/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.116.gate_proj: 70%|███████ | 25778/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.116.up_proj: 70%|███████ | 25779/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.116.down_proj: 71%|███████ | 25780/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.117.gate_proj: 71%|███████ | 25781/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.117.up_proj: 71%|███████ | 25782/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.117.down_proj: 71%|███████ | 25783/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.118.gate_proj: 71%|███████ | 25784/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.118.up_proj: 71%|███████ | 25785/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.118.down_proj: 71%|███████ | 25786/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.119.gate_proj: 71%|███████ | 25787/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.119.up_proj: 71%|███████ | 25788/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.119.down_proj: 71%|███████ | 25789/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.120.gate_proj: 71%|███████ | 25790/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.120.up_proj: 71%|███████ | 25791/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.120.down_proj: 71%|███████ | 25792/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.121.gate_proj: 71%|███████ | 25793/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.121.up_proj: 71%|███████ | 25794/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.121.down_proj: 71%|███████ | 25795/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.122.gate_proj: 71%|███████ | 25796/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.122.up_proj: 71%|███████ | 25797/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.122.down_proj: 71%|███████ | 25798/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.123.gate_proj: 71%|███████ | 25799/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.123.up_proj: 71%|███████ | 25800/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.123.down_proj: 71%|███████ | 25801/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.124.gate_proj: 71%|███████ | 25802/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.124.up_proj: 71%|███████ | 25803/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.124.down_proj: 71%|███████ | 25804/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.125.gate_proj: 71%|███████ | 25805/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.125.up_proj: 71%|███████ | 25806/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.125.down_proj: 71%|███████ | 25807/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.126.gate_proj: 71%|███████ | 25808/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.126.up_proj: 71%|███████ | 25809/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.126.down_proj: 71%|███████ | 25810/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.127.gate_proj: 71%|███████ | 25811/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.127.up_proj: 71%|███████ | 25812/36566 [00:23<00:09, 1143.47it/s] packing model.layers.65.mlp.experts.127.down_proj: 71%|███████ | 25813/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.0.gate_proj: 71%|███████ | 25814/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.0.up_proj: 71%|███████ | 25815/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.0.down_proj: 71%|███████ | 25816/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.1.gate_proj: 71%|███████ | 25817/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.1.up_proj: 71%|███████ | 25818/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.1.down_proj: 71%|███████ | 25819/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.2.gate_proj: 71%|███████ | 25820/36566 [00:23<00:09, 1143.47it/s] packing model.layers.66.mlp.experts.2.gate_proj: 71%|███████ | 25821/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.2.up_proj: 71%|███████ | 25821/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.2.down_proj: 71%|███████ | 25822/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.3.gate_proj: 71%|███████ | 25823/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.3.up_proj: 71%|███████ | 25824/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.3.down_proj: 71%|███████ | 25825/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.4.gate_proj: 71%|███████ | 25826/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.4.up_proj: 71%|███████ | 25827/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.4.down_proj: 71%|███████ | 25828/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.5.gate_proj: 71%|███████ | 25829/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.5.up_proj: 71%|███████ | 25830/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.5.down_proj: 71%|███████ | 25831/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.6.gate_proj: 71%|███████ | 25832/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.6.up_proj: 71%|███████ | 25833/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.6.down_proj: 71%|███████ | 25834/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.7.gate_proj: 71%|███████ | 25835/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.7.up_proj: 71%|███████ | 25836/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.7.down_proj: 71%|███████ | 25837/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.8.gate_proj: 71%|███████ | 25838/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.8.up_proj: 71%|███████ | 25839/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.8.down_proj: 71%|███████ | 25840/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.9.gate_proj: 71%|███████ | 25841/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.9.up_proj: 71%|███████ | 25842/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.9.down_proj: 71%|███████ | 25843/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.10.gate_proj: 71%|███████ | 25844/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.10.up_proj: 71%|███████ | 25845/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.10.down_proj: 71%|███████ | 25846/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.11.gate_proj: 71%|███████ | 25847/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.11.up_proj: 71%|███████ | 25848/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.11.down_proj: 71%|███████ | 25849/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.12.gate_proj: 71%|███████ | 25850/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.12.up_proj: 71%|███████ | 25851/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.12.down_proj: 71%|███████ | 25852/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.13.gate_proj: 71%|███████ | 25853/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.13.up_proj: 71%|███████ | 25854/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.13.down_proj: 71%|███████ | 25855/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.14.gate_proj: 71%|███████ | 25856/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.14.up_proj: 71%|███████ | 25857/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.14.down_proj: 71%|███████ | 25858/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.15.gate_proj: 71%|███████ | 25859/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.15.up_proj: 71%|███████ | 25860/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.15.down_proj: 71%|███████ | 25861/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.16.gate_proj: 71%|███████ | 25862/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.16.up_proj: 71%|███████ | 25863/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.16.down_proj: 71%|███████ | 25864/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.17.gate_proj: 71%|███████ | 25865/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.17.up_proj: 71%|███████ | 25866/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.17.down_proj: 71%|███████ | 25867/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.18.gate_proj: 71%|███████ | 25868/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.18.up_proj: 71%|███████ | 25869/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.18.down_proj: 71%|███████ | 25870/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.19.gate_proj: 71%|███████ | 25871/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.19.up_proj: 71%|███████ | 25872/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.19.down_proj: 71%|███████ | 25873/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.20.gate_proj: 71%|███████ | 25874/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.20.up_proj: 71%|███████ | 25875/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.20.down_proj: 71%|███████ | 25876/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.21.gate_proj: 71%|███████ | 25877/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.21.up_proj: 71%|███████ | 25878/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.21.down_proj: 71%|███████ | 25879/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.22.gate_proj: 71%|███████ | 25880/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.22.up_proj: 71%|███████ | 25881/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.22.down_proj: 71%|███████ | 25882/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.23.gate_proj: 71%|███████ | 25883/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.23.up_proj: 71%|███████ | 25884/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.23.down_proj: 71%|███████ | 25885/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.24.gate_proj: 71%|███████ | 25886/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.24.up_proj: 71%|███████ | 25887/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.24.down_proj: 71%|███████ | 25888/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.25.gate_proj: 71%|███████ | 25889/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.25.up_proj: 71%|███████ | 25890/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.25.down_proj: 71%|███████ | 25891/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.26.gate_proj: 71%|███████ | 25892/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.26.up_proj: 71%|███████ | 25893/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.26.down_proj: 71%|███████ | 25894/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.27.gate_proj: 71%|███████ | 25895/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.27.up_proj: 71%|███████ | 25896/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.27.down_proj: 71%|███████ | 25897/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.28.gate_proj: 71%|███████ | 25898/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.28.up_proj: 71%|███████ | 25899/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.28.down_proj: 71%|███████ | 25900/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.29.gate_proj: 71%|███████ | 25901/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.29.up_proj: 71%|███████ | 25902/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.29.down_proj: 71%|███████ | 25903/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.30.gate_proj: 71%|███████ | 25904/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.30.up_proj: 71%|███████ | 25905/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.30.down_proj: 71%|███████ | 25906/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.31.gate_proj: 71%|███████ | 25907/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.31.up_proj: 71%|███████ | 25908/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.31.down_proj: 71%|███████ | 25909/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.32.gate_proj: 71%|███████ | 25910/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.32.up_proj: 71%|███████ | 25911/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.32.down_proj: 71%|███████ | 25912/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.33.gate_proj: 71%|███████ | 25913/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.33.up_proj: 71%|███████ | 25914/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.33.down_proj: 71%|███████ | 25915/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.34.gate_proj: 71%|███████ | 25916/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.34.up_proj: 71%|███████ | 25917/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.34.down_proj: 71%|███████ | 25918/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.35.gate_proj: 71%|███████ | 25919/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.35.up_proj: 71%|███████ | 25920/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.35.down_proj: 71%|███████ | 25921/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.36.gate_proj: 71%|███████ | 25922/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.36.up_proj: 71%|███████ | 25923/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.36.down_proj: 71%|███████ | 25924/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.37.gate_proj: 71%|███████ | 25925/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.37.up_proj: 71%|███████ | 25926/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.37.down_proj: 71%|███████ | 25927/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.38.gate_proj: 71%|███████ | 25928/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.38.up_proj: 71%|███████ | 25929/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.38.down_proj: 71%|███████ | 25930/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.39.gate_proj: 71%|███████ | 25931/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.39.up_proj: 71%|███████ | 25932/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.39.down_proj: 71%|███████ | 25933/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.40.gate_proj: 71%|███████ | 25934/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.40.up_proj: 71%|███████ | 25935/36566 [00:23<00:09, 1144.07it/s] packing model.layers.66.mlp.experts.40.up_proj: 71%|███████ | 25936/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.40.down_proj: 71%|███████ | 25936/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.41.gate_proj: 71%|███████ | 25937/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.41.up_proj: 71%|███████ | 25938/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.41.down_proj: 71%|███████ | 25939/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.42.gate_proj: 71%|███████ | 25940/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.42.up_proj: 71%|███████ | 25941/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.42.down_proj: 71%|███████ | 25942/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.43.gate_proj: 71%|███████ | 25943/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.43.up_proj: 71%|███████ | 25944/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.43.down_proj: 71%|███████ | 25945/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.44.gate_proj: 71%|███████ | 25946/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.44.up_proj: 71%|███████ | 25947/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.44.down_proj: 71%|███████ | 25948/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.45.gate_proj: 71%|███████ | 25949/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.45.up_proj: 71%|███████ | 25950/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.45.down_proj: 71%|███████ | 25951/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.46.gate_proj: 71%|███████ | 25952/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.46.up_proj: 71%|███████ | 25953/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.46.down_proj: 71%|███████ | 25954/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.47.gate_proj: 71%|███████ | 25955/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.47.up_proj: 71%|███████ | 25956/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.47.down_proj: 71%|███████ | 25957/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.48.gate_proj: 71%|███████ | 25958/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.48.up_proj: 71%|███████ | 25959/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.48.down_proj: 71%|███████ | 25960/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.49.gate_proj: 71%|███████ | 25961/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.49.up_proj: 71%|███████ | 25962/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.49.down_proj: 71%|███████ | 25963/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.50.gate_proj: 71%|███████ | 25964/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.50.up_proj: 71%|███████ | 25965/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.50.down_proj: 71%|███████ | 25966/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.51.gate_proj: 71%|███████ | 25967/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.51.up_proj: 71%|███████ | 25968/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.51.down_proj: 71%|███████ | 25969/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.52.gate_proj: 71%|███████ | 25970/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.52.up_proj: 71%|███████ | 25971/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.52.down_proj: 71%|███████ | 25972/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.53.gate_proj: 71%|███████ | 25973/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.53.up_proj: 71%|███████ | 25974/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.53.down_proj: 71%|███████ | 25975/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.54.gate_proj: 71%|███████ | 25976/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.54.up_proj: 71%|███████ | 25977/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.54.down_proj: 71%|███████ | 25978/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.55.gate_proj: 71%|███████ | 25979/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.55.up_proj: 71%|███████ | 25980/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.55.down_proj: 71%|███████ | 25981/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.56.gate_proj: 71%|███████ | 25982/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.56.up_proj: 71%|███████ | 25983/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.56.down_proj: 71%|███████ | 25984/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.57.gate_proj: 71%|███████ | 25985/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.57.up_proj: 71%|███████ | 25986/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.57.down_proj: 71%|███████ | 25987/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.58.gate_proj: 71%|███████ | 25988/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.58.up_proj: 71%|███████ | 25989/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.58.down_proj: 71%|███████ | 25990/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.59.gate_proj: 71%|███████ | 25991/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.59.up_proj: 71%|███████ | 25992/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.59.down_proj: 71%|███████ | 25993/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.60.gate_proj: 71%|███████ | 25994/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.60.up_proj: 71%|███████ | 25995/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.60.down_proj: 71%|███████ | 25996/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.61.gate_proj: 71%|███████ | 25997/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.61.up_proj: 71%|███████ | 25998/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.61.down_proj: 71%|███████ | 25999/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.62.gate_proj: 71%|███████ | 26000/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.62.up_proj: 71%|███████ | 26001/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.62.down_proj: 71%|███████ | 26002/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.63.gate_proj: 71%|███████ | 26003/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.63.up_proj: 71%|███████ | 26004/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.63.down_proj: 71%|███████ | 26005/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.64.gate_proj: 71%|███████ | 26006/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.64.up_proj: 71%|███████ | 26007/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.64.down_proj: 71%|███████ | 26008/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.65.gate_proj: 71%|███████ | 26009/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.65.up_proj: 71%|███████ | 26010/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.65.down_proj: 71%|███████ | 26011/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.66.gate_proj: 71%|███████ | 26012/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.66.up_proj: 71%|███████ | 26013/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.66.down_proj: 71%|███████ | 26014/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.67.gate_proj: 71%|███████ | 26015/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.67.up_proj: 71%|███████ | 26016/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.67.down_proj: 71%|███████ | 26017/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.68.gate_proj: 71%|███████ | 26018/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.68.up_proj: 71%|███████ | 26019/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.68.down_proj: 71%|███████ | 26020/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.69.gate_proj: 71%|███████ | 26021/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.69.up_proj: 71%|███████ | 26022/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.69.down_proj: 71%|███████ | 26023/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.70.gate_proj: 71%|███████ | 26024/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.70.up_proj: 71%|███████ | 26025/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.70.down_proj: 71%|███████ | 26026/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.71.gate_proj: 71%|███████ | 26027/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.71.up_proj: 71%|███████ | 26028/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.71.down_proj: 71%|███████ | 26029/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.72.gate_proj: 71%|███████ | 26030/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.72.up_proj: 71%|███████ | 26031/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.72.down_proj: 71%|███████ | 26032/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.73.gate_proj: 71%|███████ | 26033/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.73.up_proj: 71%|███████ | 26034/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.73.down_proj: 71%|███████ | 26035/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.74.gate_proj: 71%|███████ | 26036/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.74.up_proj: 71%|███████ | 26037/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.74.down_proj: 71%|███████ | 26038/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.75.gate_proj: 71%|███████ | 26039/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.75.up_proj: 71%|███████ | 26040/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.75.down_proj: 71%|███████ | 26041/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.76.gate_proj: 71%|███████ | 26042/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.76.up_proj: 71%|███████ | 26043/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.76.down_proj: 71%|███████ | 26044/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.77.gate_proj: 71%|███████ | 26045/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.77.up_proj: 71%|███████ | 26046/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.77.down_proj: 71%|███████ | 26047/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.78.gate_proj: 71%|███████ | 26048/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.78.up_proj: 71%|███████ | 26049/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.78.down_proj: 71%|███████ | 26050/36566 [00:23<00:09, 1144.65it/s] packing model.layers.66.mlp.experts.78.down_proj: 71%|███████ | 26051/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.79.gate_proj: 71%|███████ | 26051/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.79.up_proj: 71%|███████ | 26052/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.79.down_proj: 71%|███████ | 26053/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.80.gate_proj: 71%|███████▏ | 26054/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.80.up_proj: 71%|███████▏ | 26055/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.80.down_proj: 71%|███████▏ | 26056/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.81.gate_proj: 71%|███████▏ | 26057/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.81.up_proj: 71%|███████▏ | 26058/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.81.down_proj: 71%|███████▏ | 26059/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.82.gate_proj: 71%|███████▏ | 26060/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.82.up_proj: 71%|███████▏ | 26061/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.82.down_proj: 71%|███████▏ | 26062/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.83.gate_proj: 71%|███████▏ | 26063/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.83.up_proj: 71%|███████▏ | 26064/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.83.down_proj: 71%|███████▏ | 26065/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.84.gate_proj: 71%|███████▏ | 26066/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.84.up_proj: 71%|███████▏ | 26067/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.84.down_proj: 71%|███████▏ | 26068/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.85.gate_proj: 71%|███████▏ | 26069/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.85.up_proj: 71%|███████▏ | 26070/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.85.down_proj: 71%|███████▏ | 26071/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.86.gate_proj: 71%|███████▏ | 26072/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.86.up_proj: 71%|███████▏ | 26073/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.86.down_proj: 71%|███████▏ | 26074/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.87.gate_proj: 71%|███████▏ | 26075/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.87.up_proj: 71%|███████▏ | 26076/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.87.down_proj: 71%|███████▏ | 26077/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.88.gate_proj: 71%|███████▏ | 26078/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.88.up_proj: 71%|███████▏ | 26079/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.88.down_proj: 71%|███████▏ | 26080/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.89.gate_proj: 71%|███████▏ | 26081/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.89.up_proj: 71%|███████▏ | 26082/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.89.down_proj: 71%|███████▏ | 26083/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.90.gate_proj: 71%|███████▏ | 26084/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.90.up_proj: 71%|███████▏ | 26085/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.90.down_proj: 71%|███████▏ | 26086/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.91.gate_proj: 71%|███████▏ | 26087/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.91.up_proj: 71%|███████▏ | 26088/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.91.down_proj: 71%|███████▏ | 26089/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.92.gate_proj: 71%|███████▏ | 26090/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.92.up_proj: 71%|███████▏ | 26091/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.92.down_proj: 71%|███████▏ | 26092/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.93.gate_proj: 71%|███████▏ | 26093/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.93.up_proj: 71%|███████▏ | 26094/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.93.down_proj: 71%|███████▏ | 26095/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.94.gate_proj: 71%|███████▏ | 26096/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.94.up_proj: 71%|███████▏ | 26097/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.94.down_proj: 71%|███████▏ | 26098/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.95.gate_proj: 71%|███████▏ | 26099/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.95.up_proj: 71%|███████▏ | 26100/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.95.down_proj: 71%|███████▏ | 26101/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.96.gate_proj: 71%|███████▏ | 26102/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.96.up_proj: 71%|███████▏ | 26103/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.96.down_proj: 71%|███████▏ | 26104/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.97.gate_proj: 71%|███████▏ | 26105/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.97.up_proj: 71%|███████▏ | 26106/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.97.down_proj: 71%|███████▏ | 26107/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.98.gate_proj: 71%|███████▏ | 26108/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.98.up_proj: 71%|███████▏ | 26109/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.98.down_proj: 71%|███████▏ | 26110/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.99.gate_proj: 71%|███████▏ | 26111/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.99.up_proj: 71%|███████▏ | 26112/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.99.down_proj: 71%|███████▏ | 26113/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.100.gate_proj: 71%|███████▏ | 26114/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.100.up_proj: 71%|███████▏ | 26115/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.100.down_proj: 71%|███████▏ | 26116/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.101.gate_proj: 71%|███████▏ | 26117/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.101.up_proj: 71%|███████▏ | 26118/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.101.down_proj: 71%|███████▏ | 26119/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.102.gate_proj: 71%|███████▏ | 26120/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.102.up_proj: 71%|███████▏ | 26121/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.102.down_proj: 71%|███████▏ | 26122/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.103.gate_proj: 71%|███████▏ | 26123/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.103.up_proj: 71%|███████▏ | 26124/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.103.down_proj: 71%|███████▏ | 26125/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.104.gate_proj: 71%|███████▏ | 26126/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.104.up_proj: 71%|███████▏ | 26127/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.104.down_proj: 71%|███████▏ | 26128/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.105.gate_proj: 71%|███████▏ | 26129/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.105.up_proj: 71%|███████▏ | 26130/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.105.down_proj: 71%|███████▏ | 26131/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.106.gate_proj: 71%|███████▏ | 26132/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.106.up_proj: 71%|███████▏ | 26133/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.106.down_proj: 71%|███████▏ | 26134/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.107.gate_proj: 71%|███████▏ | 26135/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.107.up_proj: 71%|███████▏ | 26136/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.107.down_proj: 71%|███████▏ | 26137/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.108.gate_proj: 71%|███████▏ | 26138/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.108.up_proj: 71%|███████▏ | 26139/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.108.down_proj: 71%|███████▏ | 26140/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.109.gate_proj: 71%|███████▏ | 26141/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.109.up_proj: 71%|███████▏ | 26142/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.109.down_proj: 71%|███████▏ | 26143/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.110.gate_proj: 71%|███████▏ | 26144/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.110.up_proj: 72%|███████▏ | 26145/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.110.down_proj: 72%|███████▏ | 26146/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.111.gate_proj: 72%|███████▏ | 26147/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.111.up_proj: 72%|███████▏ | 26148/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.111.down_proj: 72%|███████▏ | 26149/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.112.gate_proj: 72%|███████▏ | 26150/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.112.up_proj: 72%|███████▏ | 26151/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.112.down_proj: 72%|███████▏ | 26152/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.113.gate_proj: 72%|███████▏ | 26153/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.113.up_proj: 72%|███████▏ | 26154/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.113.down_proj: 72%|███████▏ | 26155/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.114.gate_proj: 72%|███████▏ | 26156/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.114.up_proj: 72%|███████▏ | 26157/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.114.down_proj: 72%|███████▏ | 26158/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.115.gate_proj: 72%|███████▏ | 26159/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.115.up_proj: 72%|███████▏ | 26160/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.115.down_proj: 72%|███████▏ | 26161/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.116.gate_proj: 72%|███████▏ | 26162/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.116.up_proj: 72%|███████▏ | 26163/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.116.down_proj: 72%|███████▏ | 26164/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.117.gate_proj: 72%|███████▏ | 26165/36566 [00:23<00:09, 1141.57it/s] packing model.layers.66.mlp.experts.117.gate_proj: 72%|███████▏ | 26166/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.117.up_proj: 72%|███████▏ | 26166/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.117.down_proj: 72%|███████▏ | 26167/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.118.gate_proj: 72%|███████▏ | 26168/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.118.up_proj: 72%|███████▏ | 26169/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.118.down_proj: 72%|███████▏ | 26170/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.119.gate_proj: 72%|███████▏ | 26171/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.119.up_proj: 72%|███████▏ | 26172/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.119.down_proj: 72%|███████▏ | 26173/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.120.gate_proj: 72%|███████▏ | 26174/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.120.up_proj: 72%|███████▏ | 26175/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.120.down_proj: 72%|███████▏ | 26176/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.121.gate_proj: 72%|███████▏ | 26177/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.121.up_proj: 72%|███████▏ | 26178/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.121.down_proj: 72%|███████▏ | 26179/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.122.gate_proj: 72%|███████▏ | 26180/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.122.up_proj: 72%|███████▏ | 26181/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.122.down_proj: 72%|███████▏ | 26182/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.123.gate_proj: 72%|███████▏ | 26183/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.123.up_proj: 72%|███████▏ | 26184/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.123.down_proj: 72%|███████▏ | 26185/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.124.gate_proj: 72%|███████▏ | 26186/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.124.up_proj: 72%|███████▏ | 26187/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.124.down_proj: 72%|███████▏ | 26188/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.125.gate_proj: 72%|███████▏ | 26189/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.125.up_proj: 72%|███████▏ | 26190/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.125.down_proj: 72%|███████▏ | 26191/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.126.gate_proj: 72%|███████▏ | 26192/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.126.up_proj: 72%|███████▏ | 26193/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.126.down_proj: 72%|███████▏ | 26194/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.127.gate_proj: 72%|███████▏ | 26195/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.127.up_proj: 72%|███████▏ | 26196/36566 [00:23<00:09, 1139.64it/s] packing model.layers.66.mlp.experts.127.down_proj: 72%|███████▏ | 26197/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.0.gate_proj: 72%|███████▏ | 26198/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.0.up_proj: 72%|███████▏ | 26199/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.0.down_proj: 72%|███████▏ | 26200/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.1.gate_proj: 72%|███████▏ | 26201/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.1.up_proj: 72%|███████▏ | 26202/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.1.down_proj: 72%|███████▏ | 26203/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.2.gate_proj: 72%|███████▏ | 26204/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.2.up_proj: 72%|███████▏ | 26205/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.2.down_proj: 72%|███████▏ | 26206/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.3.gate_proj: 72%|███████▏ | 26207/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.3.up_proj: 72%|███████▏ | 26208/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.3.down_proj: 72%|███████▏ | 26209/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.4.gate_proj: 72%|███████▏ | 26210/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.4.up_proj: 72%|███████▏ | 26211/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.4.down_proj: 72%|███████▏ | 26212/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.5.gate_proj: 72%|███████▏ | 26213/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.5.up_proj: 72%|███████▏ | 26214/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.5.down_proj: 72%|███████▏ | 26215/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.6.gate_proj: 72%|███████▏ | 26216/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.6.up_proj: 72%|███████▏ | 26217/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.6.down_proj: 72%|███████▏ | 26218/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.7.gate_proj: 72%|███████▏ | 26219/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.7.up_proj: 72%|███████▏ | 26220/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.7.down_proj: 72%|███████▏ | 26221/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.8.gate_proj: 72%|███████▏ | 26222/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.8.up_proj: 72%|███████▏ | 26223/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.8.down_proj: 72%|███████▏ | 26224/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.9.gate_proj: 72%|███████▏ | 26225/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.9.up_proj: 72%|███████▏ | 26226/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.9.down_proj: 72%|███████▏ | 26227/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.10.gate_proj: 72%|███████▏ | 26228/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.10.up_proj: 72%|███████▏ | 26229/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.10.down_proj: 72%|███████▏ | 26230/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.11.gate_proj: 72%|███████▏ | 26231/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.11.up_proj: 72%|███████▏ | 26232/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.11.down_proj: 72%|███████▏ | 26233/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.12.gate_proj: 72%|███████▏ | 26234/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.12.up_proj: 72%|███████▏ | 26235/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.12.down_proj: 72%|███████▏ | 26236/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.13.gate_proj: 72%|███████▏ | 26237/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.13.up_proj: 72%|███████▏ | 26238/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.13.down_proj: 72%|███████▏ | 26239/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.14.gate_proj: 72%|███████▏ | 26240/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.14.up_proj: 72%|███████▏ | 26241/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.14.down_proj: 72%|███████▏ | 26242/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.15.gate_proj: 72%|███████▏ | 26243/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.15.up_proj: 72%|███████▏ | 26244/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.15.down_proj: 72%|███████▏ | 26245/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.16.gate_proj: 72%|███████▏ | 26246/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.16.up_proj: 72%|███████▏ | 26247/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.16.down_proj: 72%|███████▏ | 26248/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.17.gate_proj: 72%|███████▏ | 26249/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.17.up_proj: 72%|███████▏ | 26250/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.17.down_proj: 72%|███████▏ | 26251/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.18.gate_proj: 72%|███████▏ | 26252/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.18.up_proj: 72%|███████▏ | 26253/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.18.down_proj: 72%|███████▏ | 26254/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.19.gate_proj: 72%|███████▏ | 26255/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.19.up_proj: 72%|███████▏ | 26256/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.19.down_proj: 72%|███████▏ | 26257/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.20.gate_proj: 72%|███████▏ | 26258/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.20.up_proj: 72%|███████▏ | 26259/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.20.down_proj: 72%|███████▏ | 26260/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.21.gate_proj: 72%|███████▏ | 26261/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.21.up_proj: 72%|███████▏ | 26262/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.21.down_proj: 72%|███████▏ | 26263/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.22.gate_proj: 72%|███████▏ | 26264/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.22.up_proj: 72%|███████▏ | 26265/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.22.down_proj: 72%|███████▏ | 26266/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.23.gate_proj: 72%|███████▏ | 26267/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.23.up_proj: 72%|███████▏ | 26268/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.23.down_proj: 72%|███████▏ | 26269/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.24.gate_proj: 72%|███████▏ | 26270/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.24.up_proj: 72%|███████▏ | 26271/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.24.down_proj: 72%|███████▏ | 26272/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.25.gate_proj: 72%|███████▏ | 26273/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.25.up_proj: 72%|███████▏ | 26274/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.25.down_proj: 72%|███████▏ | 26275/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.26.gate_proj: 72%|███████▏ | 26276/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.26.up_proj: 72%|███████▏ | 26277/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.26.down_proj: 72%|███████▏ | 26278/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.27.gate_proj: 72%|███████▏ | 26279/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.27.up_proj: 72%|███████▏ | 26280/36566 [00:23<00:09, 1139.64it/s] packing model.layers.67.mlp.experts.27.up_proj: 72%|███████▏ | 26281/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.27.down_proj: 72%|███████▏ | 26281/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.28.gate_proj: 72%|███████▏ | 26282/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.28.up_proj: 72%|███████▏ | 26283/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.28.down_proj: 72%|███████▏ | 26284/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.29.gate_proj: 72%|███████▏ | 26285/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.29.up_proj: 72%|███████▏ | 26286/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.29.down_proj: 72%|███████▏ | 26287/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.30.gate_proj: 72%|███████▏ | 26288/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.30.up_proj: 72%|███████▏ | 26289/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.30.down_proj: 72%|███████▏ | 26290/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.31.gate_proj: 72%|███████▏ | 26291/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.31.up_proj: 72%|███████▏ | 26292/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.31.down_proj: 72%|███████▏ | 26293/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.32.gate_proj: 72%|███████▏ | 26294/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.32.up_proj: 72%|███████▏ | 26295/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.32.down_proj: 72%|███████▏ | 26296/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.33.gate_proj: 72%|███████▏ | 26297/36566 [00:23<00:09, 1140.98it/s] packing model.layers.67.mlp.experts.33.up_proj: 72%|███████▏ | 26298/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.33.down_proj: 72%|███████▏ | 26299/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.34.gate_proj: 72%|███████▏ | 26300/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.34.up_proj: 72%|███████▏ | 26301/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.34.down_proj: 72%|███████▏ | 26302/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.35.gate_proj: 72%|███████▏ | 26303/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.35.up_proj: 72%|███████▏ | 26304/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.35.down_proj: 72%|███████▏ | 26305/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.36.gate_proj: 72%|███████▏ | 26306/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.36.up_proj: 72%|███████▏ | 26307/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.36.down_proj: 72%|███████▏ | 26308/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.37.gate_proj: 72%|███████▏ | 26309/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.37.up_proj: 72%|███████▏ | 26310/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.37.down_proj: 72%|███████▏ | 26311/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.38.gate_proj: 72%|███████▏ | 26312/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.38.up_proj: 72%|███████▏ | 26313/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.38.down_proj: 72%|███████▏ | 26314/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.39.gate_proj: 72%|███████▏ | 26315/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.39.up_proj: 72%|███████▏ | 26316/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.39.down_proj: 72%|███████▏ | 26317/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.40.gate_proj: 72%|███████▏ | 26318/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.40.up_proj: 72%|███████▏ | 26319/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.40.down_proj: 72%|███████▏ | 26320/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.41.gate_proj: 72%|███████▏ | 26321/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.41.up_proj: 72%|███████▏ | 26322/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.41.down_proj: 72%|███████▏ | 26323/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.42.gate_proj: 72%|███████▏ | 26324/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.42.up_proj: 72%|███████▏ | 26325/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.42.down_proj: 72%|███████▏ | 26326/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.43.gate_proj: 72%|███████▏ | 26327/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.43.up_proj: 72%|███████▏ | 26328/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.43.down_proj: 72%|███████▏ | 26329/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.44.gate_proj: 72%|███████▏ | 26330/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.44.up_proj: 72%|███████▏ | 26331/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.44.down_proj: 72%|███████▏ | 26332/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.45.gate_proj: 72%|███████▏ | 26333/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.45.up_proj: 72%|███████▏ | 26334/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.45.down_proj: 72%|███████▏ | 26335/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.46.gate_proj: 72%|███████▏ | 26336/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.46.up_proj: 72%|███████▏ | 26337/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.46.down_proj: 72%|███████▏ | 26338/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.47.gate_proj: 72%|███████▏ | 26339/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.47.up_proj: 72%|███████▏ | 26340/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.47.down_proj: 72%|███████▏ | 26341/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.48.gate_proj: 72%|███████▏ | 26342/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.48.up_proj: 72%|███████▏ | 26343/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.48.down_proj: 72%|███████▏ | 26344/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.49.gate_proj: 72%|███████▏ | 26345/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.49.up_proj: 72%|███████▏ | 26346/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.49.down_proj: 72%|███████▏ | 26347/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.50.gate_proj: 72%|███████▏ | 26348/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.50.up_proj: 72%|███████▏ | 26349/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.50.down_proj: 72%|███████▏ | 26350/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.51.gate_proj: 72%|███████▏ | 26351/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.51.up_proj: 72%|███████▏ | 26352/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.51.down_proj: 72%|███████▏ | 26353/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.52.gate_proj: 72%|███████▏ | 26354/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.52.up_proj: 72%|███████▏ | 26355/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.52.down_proj: 72%|███████▏ | 26356/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.53.gate_proj: 72%|███████▏ | 26357/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.53.up_proj: 72%|███████▏ | 26358/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.53.down_proj: 72%|███████▏ | 26359/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.54.gate_proj: 72%|███████▏ | 26360/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.54.up_proj: 72%|███████▏ | 26361/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.54.down_proj: 72%|███████▏ | 26362/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.55.gate_proj: 72%|███████▏ | 26363/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.55.up_proj: 72%|███████▏ | 26364/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.55.down_proj: 72%|███████▏ | 26365/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.56.gate_proj: 72%|███████▏ | 26366/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.56.up_proj: 72%|███████▏ | 26367/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.56.down_proj: 72%|███████▏ | 26368/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.57.gate_proj: 72%|███████▏ | 26369/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.57.up_proj: 72%|███████▏ | 26370/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.57.down_proj: 72%|███████▏ | 26371/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.58.gate_proj: 72%|███████▏ | 26372/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.58.up_proj: 72%|███████▏ | 26373/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.58.down_proj: 72%|███████▏ | 26374/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.59.gate_proj: 72%|███████▏ | 26375/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.59.up_proj: 72%|███████▏ | 26376/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.59.down_proj: 72%|███████▏ | 26377/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.60.gate_proj: 72%|███████▏ | 26378/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.60.up_proj: 72%|███████▏ | 26379/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.60.down_proj: 72%|███████▏ | 26380/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.61.gate_proj: 72%|███████▏ | 26381/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.61.up_proj: 72%|███████▏ | 26382/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.61.down_proj: 72%|███████▏ | 26383/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.62.gate_proj: 72%|███████▏ | 26384/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.62.up_proj: 72%|███████▏ | 26385/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.62.down_proj: 72%|███████▏ | 26386/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.63.gate_proj: 72%|███████▏ | 26387/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.63.up_proj: 72%|███████▏ | 26388/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.63.down_proj: 72%|███████▏ | 26389/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.64.gate_proj: 72%|███████▏ | 26390/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.64.up_proj: 72%|███████▏ | 26391/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.64.down_proj: 72%|███████▏ | 26392/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.65.gate_proj: 72%|███████▏ | 26393/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.65.up_proj: 72%|███████▏ | 26394/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.65.down_proj: 72%|███████▏ | 26395/36566 [00:23<00:08, 1140.98it/s] packing model.layers.67.mlp.experts.65.down_proj: 72%|███████▏ | 26396/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.66.gate_proj: 72%|███████▏ | 26396/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.66.up_proj: 72%|███████▏ | 26397/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.66.down_proj: 72%|███████▏ | 26398/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.67.gate_proj: 72%|███████▏ | 26399/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.67.up_proj: 72%|███████▏ | 26400/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.67.down_proj: 72%|███████▏ | 26401/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.68.gate_proj: 72%|███████▏ | 26402/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.68.up_proj: 72%|███████▏ | 26403/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.68.down_proj: 72%|███████▏ | 26404/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.69.gate_proj: 72%|███████▏ | 26405/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.69.up_proj: 72%|███████▏ | 26406/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.69.down_proj: 72%|███████▏ | 26407/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.70.gate_proj: 72%|███████▏ | 26408/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.70.up_proj: 72%|███████▏ | 26409/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.70.down_proj: 72%|███████▏ | 26410/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.71.gate_proj: 72%|███████▏ | 26411/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.71.up_proj: 72%|███████▏ | 26412/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.71.down_proj: 72%|███████▏ | 26413/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.72.gate_proj: 72%|███████▏ | 26414/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.72.up_proj: 72%|███████▏ | 26415/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.72.down_proj: 72%|███████▏ | 26416/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.73.gate_proj: 72%|███████▏ | 26417/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.73.up_proj: 72%|███████▏ | 26418/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.73.down_proj: 72%|███████▏ | 26419/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.74.gate_proj: 72%|███████▏ | 26420/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.74.up_proj: 72%|███████▏ | 26421/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.74.down_proj: 72%|███████▏ | 26422/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.75.gate_proj: 72%|███████▏ | 26423/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.75.up_proj: 72%|███████▏ | 26424/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.75.down_proj: 72%|███████▏ | 26425/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.76.gate_proj: 72%|███████▏ | 26426/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.76.up_proj: 72%|███████▏ | 26427/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.76.down_proj: 72%|███████▏ | 26428/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.77.gate_proj: 72%|███████▏ | 26429/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.77.up_proj: 72%|███████▏ | 26430/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.77.down_proj: 72%|███████▏ | 26431/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.78.gate_proj: 72%|███████▏ | 26432/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.78.up_proj: 72%|███████▏ | 26433/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.78.down_proj: 72%|███████▏ | 26434/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.79.gate_proj: 72%|███████▏ | 26435/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.79.up_proj: 72%|███████▏ | 26436/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.79.down_proj: 72%|███████▏ | 26437/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.80.gate_proj: 72%|███████▏ | 26438/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.80.up_proj: 72%|███████▏ | 26439/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.80.down_proj: 72%|███████▏ | 26440/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.81.gate_proj: 72%|███████▏ | 26441/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.81.up_proj: 72%|███████▏ | 26442/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.81.down_proj: 72%|███████▏ | 26443/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.82.gate_proj: 72%|███████▏ | 26444/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.82.up_proj: 72%|███████▏ | 26445/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.82.down_proj: 72%|███████▏ | 26446/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.83.gate_proj: 72%|███████▏ | 26447/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.83.up_proj: 72%|███████▏ | 26448/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.83.down_proj: 72%|███████▏ | 26449/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.84.gate_proj: 72%|███████▏ | 26450/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.84.up_proj: 72%|███████▏ | 26451/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.84.down_proj: 72%|███████▏ | 26452/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.85.gate_proj: 72%|███████▏ | 26453/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.85.up_proj: 72%|███████▏ | 26454/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.85.down_proj: 72%|███████▏ | 26455/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.86.gate_proj: 72%|███████▏ | 26456/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.86.up_proj: 72%|███████▏ | 26457/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.86.down_proj: 72%|███████▏ | 26458/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.87.gate_proj: 72%|███████▏ | 26459/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.87.up_proj: 72%|███████▏ | 26460/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.87.down_proj: 72%|███████▏ | 26461/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.88.gate_proj: 72%|███████▏ | 26462/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.88.up_proj: 72%|███████▏ | 26463/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.88.down_proj: 72%|███████▏ | 26464/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.89.gate_proj: 72%|███████▏ | 26465/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.89.up_proj: 72%|███████▏ | 26466/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.89.down_proj: 72%|███████▏ | 26467/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.90.gate_proj: 72%|███████▏ | 26468/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.90.up_proj: 72%|███████▏ | 26469/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.90.down_proj: 72%|███████▏ | 26470/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.91.gate_proj: 72%|███████▏ | 26471/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.91.up_proj: 72%|███████▏ | 26472/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.91.down_proj: 72%|███████▏ | 26473/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.92.gate_proj: 72%|███████▏ | 26474/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.92.up_proj: 72%|███████▏ | 26475/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.92.down_proj: 72%|███████▏ | 26476/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.93.gate_proj: 72%|███████▏ | 26477/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.93.up_proj: 72%|███████▏ | 26478/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.93.down_proj: 72%|███████▏ | 26479/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.94.gate_proj: 72%|███████▏ | 26480/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.94.up_proj: 72%|███████▏ | 26481/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.94.down_proj: 72%|███████▏ | 26482/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.95.gate_proj: 72%|███████▏ | 26483/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.95.up_proj: 72%|███████▏ | 26484/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.95.down_proj: 72%|███████▏ | 26485/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.96.gate_proj: 72%|███████▏ | 26486/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.96.up_proj: 72%|███████▏ | 26487/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.96.down_proj: 72%|███████▏ | 26488/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.97.gate_proj: 72%|███████▏ | 26489/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.97.up_proj: 72%|███████▏ | 26490/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.97.down_proj: 72%|███████▏ | 26491/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.98.gate_proj: 72%|███████▏ | 26492/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.98.up_proj: 72%|███████▏ | 26493/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.98.down_proj: 72%|███████▏ | 26494/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.99.gate_proj: 72%|███████▏ | 26495/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.99.up_proj: 72%|███████▏ | 26496/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.99.down_proj: 72%|███████▏ | 26497/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.100.gate_proj: 72%|███████▏ | 26498/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.100.up_proj: 72%|███████▏ | 26499/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.100.down_proj: 72%|███████▏ | 26500/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.101.gate_proj: 72%|███████▏ | 26501/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.101.up_proj: 72%|███████▏ | 26502/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.101.down_proj: 72%|███████▏ | 26503/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.102.gate_proj: 72%|███████▏ | 26504/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.102.up_proj: 72%|███████▏ | 26505/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.102.down_proj: 72%|███████▏ | 26506/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.103.gate_proj: 72%|███████▏ | 26507/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.103.up_proj: 72%|███████▏ | 26508/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.103.down_proj: 72%|███████▏ | 26509/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.104.gate_proj: 72%|███████▏ | 26510/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.104.up_proj: 73%|███████▎ | 26511/36566 [00:23<00:08, 1142.06it/s] packing model.layers.67.mlp.experts.104.up_proj: 73%|███████▎ | 26512/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.104.down_proj: 73%|███████▎ | 26512/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.105.gate_proj: 73%|███████▎ | 26513/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.105.up_proj: 73%|███████▎ | 26514/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.105.down_proj: 73%|███████▎ | 26515/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.106.gate_proj: 73%|███████▎ | 26516/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.106.up_proj: 73%|███████▎ | 26517/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.106.down_proj: 73%|███████▎ | 26518/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.107.gate_proj: 73%|███████▎ | 26519/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.107.up_proj: 73%|███████▎ | 26520/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.107.down_proj: 73%|███████▎ | 26521/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.108.gate_proj: 73%|███████▎ | 26522/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.108.up_proj: 73%|███████▎ | 26523/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.108.down_proj: 73%|███████▎ | 26524/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.109.gate_proj: 73%|███████▎ | 26525/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.109.up_proj: 73%|███████▎ | 26526/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.109.down_proj: 73%|███████▎ | 26527/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.110.gate_proj: 73%|███████▎ | 26528/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.110.up_proj: 73%|███████▎ | 26529/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.110.down_proj: 73%|███████▎ | 26530/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.111.gate_proj: 73%|███████▎ | 26531/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.111.up_proj: 73%|███████▎ | 26532/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.111.down_proj: 73%|███████▎ | 26533/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.112.gate_proj: 73%|███████▎ | 26534/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.112.up_proj: 73%|███████▎ | 26535/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.112.down_proj: 73%|███████▎ | 26536/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.113.gate_proj: 73%|███████▎ | 26537/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.113.up_proj: 73%|███████▎ | 26538/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.113.down_proj: 73%|███████▎ | 26539/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.114.gate_proj: 73%|███████▎ | 26540/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.114.up_proj: 73%|███████▎ | 26541/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.114.down_proj: 73%|███████▎ | 26542/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.115.gate_proj: 73%|███████▎ | 26543/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.115.up_proj: 73%|███████▎ | 26544/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.115.down_proj: 73%|███████▎ | 26545/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.116.gate_proj: 73%|███████▎ | 26546/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.116.up_proj: 73%|███████▎ | 26547/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.116.down_proj: 73%|███████▎ | 26548/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.117.gate_proj: 73%|███████▎ | 26549/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.117.up_proj: 73%|███████▎ | 26550/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.117.down_proj: 73%|███████▎ | 26551/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.118.gate_proj: 73%|███████▎ | 26552/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.118.up_proj: 73%|███████▎ | 26553/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.118.down_proj: 73%|███████▎ | 26554/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.119.gate_proj: 73%|███████▎ | 26555/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.119.up_proj: 73%|███████▎ | 26556/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.119.down_proj: 73%|███████▎ | 26557/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.120.gate_proj: 73%|███████▎ | 26558/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.120.up_proj: 73%|███████▎ | 26559/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.120.down_proj: 73%|███████▎ | 26560/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.121.gate_proj: 73%|███████▎ | 26561/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.121.up_proj: 73%|███████▎ | 26562/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.121.down_proj: 73%|███████▎ | 26563/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.122.gate_proj: 73%|███████▎ | 26564/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.122.up_proj: 73%|███████▎ | 26565/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.122.down_proj: 73%|███████▎ | 26566/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.123.gate_proj: 73%|███████▎ | 26567/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.123.up_proj: 73%|███████▎ | 26568/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.123.down_proj: 73%|███████▎ | 26569/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.124.gate_proj: 73%|███████▎ | 26570/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.124.up_proj: 73%|███████▎ | 26571/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.124.down_proj: 73%|███████▎ | 26572/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.125.gate_proj: 73%|███████▎ | 26573/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.125.up_proj: 73%|███████▎ | 26574/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.125.down_proj: 73%|███████▎ | 26575/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.126.gate_proj: 73%|███████▎ | 26576/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.126.up_proj: 73%|███████▎ | 26577/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.126.down_proj: 73%|███████▎ | 26578/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.127.gate_proj: 73%|███████▎ | 26579/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.127.up_proj: 73%|███████▎ | 26580/36566 [00:23<00:08, 1144.92it/s] packing model.layers.67.mlp.experts.127.down_proj: 73%|███████▎ | 26581/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.0.gate_proj: 73%|███████▎ | 26582/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.0.up_proj: 73%|███████▎ | 26583/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.0.down_proj: 73%|███████▎ | 26584/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.1.gate_proj: 73%|███████▎ | 26585/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.1.up_proj: 73%|███████▎ | 26586/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.1.down_proj: 73%|███████▎ | 26587/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.2.gate_proj: 73%|███████▎ | 26588/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.2.up_proj: 73%|███████▎ | 26589/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.2.down_proj: 73%|███████▎ | 26590/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.3.gate_proj: 73%|███████▎ | 26591/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.3.up_proj: 73%|███████▎ | 26592/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.3.down_proj: 73%|███████▎ | 26593/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.4.gate_proj: 73%|███████▎ | 26594/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.4.up_proj: 73%|███████▎ | 26595/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.4.down_proj: 73%|███████▎ | 26596/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.5.gate_proj: 73%|███████▎ | 26597/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.5.up_proj: 73%|███████▎ | 26598/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.5.down_proj: 73%|███████▎ | 26599/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.6.gate_proj: 73%|███████▎ | 26600/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.6.up_proj: 73%|███████▎ | 26601/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.6.down_proj: 73%|███████▎ | 26602/36566 [00:23<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.7.gate_proj: 73%|███████▎ | 26603/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.7.up_proj: 73%|███████▎ | 26604/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.7.down_proj: 73%|███████▎ | 26605/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.8.gate_proj: 73%|███████▎ | 26606/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.8.up_proj: 73%|███████▎ | 26607/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.8.down_proj: 73%|███████▎ | 26608/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.9.gate_proj: 73%|███████▎ | 26609/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.9.up_proj: 73%|███████▎ | 26610/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.9.down_proj: 73%|███████▎ | 26611/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.10.gate_proj: 73%|███████▎ | 26612/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.10.up_proj: 73%|███████▎ | 26613/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.10.down_proj: 73%|███████▎ | 26614/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.11.gate_proj: 73%|███████▎ | 26615/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.11.up_proj: 73%|███████▎ | 26616/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.11.down_proj: 73%|███████▎ | 26617/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.12.gate_proj: 73%|███████▎ | 26618/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.12.up_proj: 73%|███████▎ | 26619/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.12.down_proj: 73%|███████▎ | 26620/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.13.gate_proj: 73%|███████▎ | 26621/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.13.up_proj: 73%|███████▎ | 26622/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.13.down_proj: 73%|███████▎ | 26623/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.14.gate_proj: 73%|███████▎ | 26624/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.14.up_proj: 73%|███████▎ | 26625/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.14.down_proj: 73%|███████▎ | 26626/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.15.gate_proj: 73%|███████▎ | 26627/36566 [00:24<00:08, 1144.92it/s] packing model.layers.68.mlp.experts.15.gate_proj: 73%|███████▎ | 26628/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.15.up_proj: 73%|███████▎ | 26628/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.15.down_proj: 73%|███████▎ | 26629/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.16.gate_proj: 73%|███████▎ | 26630/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.16.up_proj: 73%|███████▎ | 26631/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.16.down_proj: 73%|███████▎ | 26632/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.17.gate_proj: 73%|███████▎ | 26633/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.17.up_proj: 73%|███████▎ | 26634/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.17.down_proj: 73%|███████▎ | 26635/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.18.gate_proj: 73%|███████▎ | 26636/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.18.up_proj: 73%|███████▎ | 26637/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.18.down_proj: 73%|███████▎ | 26638/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.19.gate_proj: 73%|███████▎ | 26639/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.19.up_proj: 73%|███████▎ | 26640/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.19.down_proj: 73%|███████▎ | 26641/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.20.gate_proj: 73%|███████▎ | 26642/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.20.up_proj: 73%|███████▎ | 26643/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.20.down_proj: 73%|███████▎ | 26644/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.21.gate_proj: 73%|███████▎ | 26645/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.21.up_proj: 73%|███████▎ | 26646/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.21.down_proj: 73%|███████▎ | 26647/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.22.gate_proj: 73%|███████▎ | 26648/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.22.up_proj: 73%|███████▎ | 26649/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.22.down_proj: 73%|███████▎ | 26650/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.23.gate_proj: 73%|███████▎ | 26651/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.23.up_proj: 73%|███████▎ | 26652/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.23.down_proj: 73%|███████▎ | 26653/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.24.gate_proj: 73%|███████▎ | 26654/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.24.up_proj: 73%|███████▎ | 26655/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.24.down_proj: 73%|███████▎ | 26656/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.25.gate_proj: 73%|███████▎ | 26657/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.25.up_proj: 73%|███████▎ | 26658/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.25.down_proj: 73%|███████▎ | 26659/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.26.gate_proj: 73%|███████▎ | 26660/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.26.up_proj: 73%|███████▎ | 26661/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.26.down_proj: 73%|███████▎ | 26662/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.27.gate_proj: 73%|███████▎ | 26663/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.27.up_proj: 73%|███████▎ | 26664/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.27.down_proj: 73%|███████▎ | 26665/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.28.gate_proj: 73%|███████▎ | 26666/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.28.up_proj: 73%|███████▎ | 26667/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.28.down_proj: 73%|███████▎ | 26668/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.29.gate_proj: 73%|███████▎ | 26669/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.29.up_proj: 73%|███████▎ | 26670/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.29.down_proj: 73%|███████▎ | 26671/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.30.gate_proj: 73%|███████▎ | 26672/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.30.up_proj: 73%|███████▎ | 26673/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.30.down_proj: 73%|███████▎ | 26674/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.31.gate_proj: 73%|███████▎ | 26675/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.31.up_proj: 73%|███████▎ | 26676/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.31.down_proj: 73%|███████▎ | 26677/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.32.gate_proj: 73%|███████▎ | 26678/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.32.up_proj: 73%|███████▎ | 26679/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.32.down_proj: 73%|███████▎ | 26680/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.33.gate_proj: 73%|███████▎ | 26681/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.33.up_proj: 73%|███████▎ | 26682/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.33.down_proj: 73%|███████▎ | 26683/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.34.gate_proj: 73%|███████▎ | 26684/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.34.up_proj: 73%|███████▎ | 26685/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.34.down_proj: 73%|███████▎ | 26686/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.35.gate_proj: 73%|███████▎ | 26687/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.35.up_proj: 73%|███████▎ | 26688/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.35.down_proj: 73%|███████▎ | 26689/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.36.gate_proj: 73%|███████▎ | 26690/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.36.up_proj: 73%|███████▎ | 26691/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.36.down_proj: 73%|███████▎ | 26692/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.37.gate_proj: 73%|███████▎ | 26693/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.37.up_proj: 73%|███████▎ | 26694/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.37.down_proj: 73%|███████▎ | 26695/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.38.gate_proj: 73%|███████▎ | 26696/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.38.up_proj: 73%|███████▎ | 26697/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.38.down_proj: 73%|███████▎ | 26698/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.39.gate_proj: 73%|███████▎ | 26699/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.39.up_proj: 73%|███████▎ | 26700/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.39.down_proj: 73%|███████▎ | 26701/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.40.gate_proj: 73%|███████▎ | 26702/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.40.up_proj: 73%|███████▎ | 26703/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.40.down_proj: 73%|███████▎ | 26704/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.41.gate_proj: 73%|███████▎ | 26705/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.41.up_proj: 73%|███████▎ | 26706/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.41.down_proj: 73%|███████▎ | 26707/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.42.gate_proj: 73%|███████▎ | 26708/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.42.up_proj: 73%|███████▎ | 26709/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.42.down_proj: 73%|███████▎ | 26710/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.43.gate_proj: 73%|███████▎ | 26711/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.43.up_proj: 73%|███████▎ | 26712/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.43.down_proj: 73%|███████▎ | 26713/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.44.gate_proj: 73%|███████▎ | 26714/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.44.up_proj: 73%|███████▎ | 26715/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.44.down_proj: 73%|███████▎ | 26716/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.45.gate_proj: 73%|███████▎ | 26717/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.45.up_proj: 73%|███████▎ | 26718/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.45.down_proj: 73%|███████▎ | 26719/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.46.gate_proj: 73%|███████▎ | 26720/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.46.up_proj: 73%|███████▎ | 26721/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.46.down_proj: 73%|███████▎ | 26722/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.47.gate_proj: 73%|███████▎ | 26723/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.47.up_proj: 73%|███████▎ | 26724/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.47.down_proj: 73%|███████▎ | 26725/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.48.gate_proj: 73%|███████▎ | 26726/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.48.up_proj: 73%|███████▎ | 26727/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.48.down_proj: 73%|███████▎ | 26728/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.49.gate_proj: 73%|███████▎ | 26729/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.49.up_proj: 73%|███████▎ | 26730/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.49.down_proj: 73%|███████▎ | 26731/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.50.gate_proj: 73%|███████▎ | 26732/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.50.up_proj: 73%|███████▎ | 26733/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.50.down_proj: 73%|███████▎ | 26734/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.51.gate_proj: 73%|███████▎ | 26735/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.51.up_proj: 73%|███████▎ | 26736/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.51.down_proj: 73%|███████▎ | 26737/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.52.gate_proj: 73%|███████▎ | 26738/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.52.up_proj: 73%|███████▎ | 26739/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.52.down_proj: 73%|███████▎ | 26740/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.53.gate_proj: 73%|███████▎ | 26741/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.53.up_proj: 73%|███████▎ | 26742/36566 [00:24<00:08, 1146.55it/s] packing model.layers.68.mlp.experts.53.up_proj: 73%|███████▎ | 26743/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.53.down_proj: 73%|███████▎ | 26743/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.54.gate_proj: 73%|███████▎ | 26744/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.54.up_proj: 73%|███████▎ | 26745/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.54.down_proj: 73%|███████▎ | 26746/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.55.gate_proj: 73%|███████▎ | 26747/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.55.up_proj: 73%|███████▎ | 26748/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.55.down_proj: 73%|███████▎ | 26749/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.56.gate_proj: 73%|███████▎ | 26750/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.56.up_proj: 73%|███████▎ | 26751/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.56.down_proj: 73%|███████▎ | 26752/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.57.gate_proj: 73%|███████▎ | 26753/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.57.up_proj: 73%|███████▎ | 26754/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.57.down_proj: 73%|███████▎ | 26755/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.58.gate_proj: 73%|███████▎ | 26756/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.58.up_proj: 73%|███████▎ | 26757/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.58.down_proj: 73%|███████▎ | 26758/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.59.gate_proj: 73%|███████▎ | 26759/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.59.up_proj: 73%|███████▎ | 26760/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.59.down_proj: 73%|███████▎ | 26761/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.60.gate_proj: 73%|███████▎ | 26762/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.60.up_proj: 73%|███████▎ | 26763/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.60.down_proj: 73%|███████▎ | 26764/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.61.gate_proj: 73%|███████▎ | 26765/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.61.up_proj: 73%|███████▎ | 26766/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.61.down_proj: 73%|███████▎ | 26767/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.62.gate_proj: 73%|███████▎ | 26768/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.62.up_proj: 73%|███████▎ | 26769/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.62.down_proj: 73%|███████▎ | 26770/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.63.gate_proj: 73%|███████▎ | 26771/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.63.up_proj: 73%|███████▎ | 26772/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.63.down_proj: 73%|███████▎ | 26773/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.64.gate_proj: 73%|███████▎ | 26774/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.64.up_proj: 73%|███████▎ | 26775/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.64.down_proj: 73%|███████▎ | 26776/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.65.gate_proj: 73%|███████▎ | 26777/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.65.up_proj: 73%|███████▎ | 26778/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.65.down_proj: 73%|███████▎ | 26779/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.66.gate_proj: 73%|███████▎ | 26780/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.66.up_proj: 73%|███████▎ | 26781/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.66.down_proj: 73%|███████▎ | 26782/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.67.gate_proj: 73%|███████▎ | 26783/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.67.up_proj: 73%|███████▎ | 26784/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.67.down_proj: 73%|███████▎ | 26785/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.68.gate_proj: 73%|███████▎ | 26786/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.68.up_proj: 73%|███████▎ | 26787/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.68.down_proj: 73%|███████▎ | 26788/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.69.gate_proj: 73%|███████▎ | 26789/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.69.up_proj: 73%|███████▎ | 26790/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.69.down_proj: 73%|███████▎ | 26791/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.70.gate_proj: 73%|███████▎ | 26792/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.70.up_proj: 73%|███████▎ | 26793/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.70.down_proj: 73%|███████▎ | 26794/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.71.gate_proj: 73%|███████▎ | 26795/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.71.up_proj: 73%|███████▎ | 26796/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.71.down_proj: 73%|███████▎ | 26797/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.72.gate_proj: 73%|███████▎ | 26798/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.72.up_proj: 73%|███████▎ | 26799/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.72.down_proj: 73%|███████▎ | 26800/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.73.gate_proj: 73%|███████▎ | 26801/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.73.up_proj: 73%|███████▎ | 26802/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.73.down_proj: 73%|███████▎ | 26803/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.74.gate_proj: 73%|███████▎ | 26804/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.74.up_proj: 73%|███████▎ | 26805/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.74.down_proj: 73%|███████▎ | 26806/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.75.gate_proj: 73%|███████▎ | 26807/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.75.up_proj: 73%|███████▎ | 26808/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.75.down_proj: 73%|███████▎ | 26809/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.76.gate_proj: 73%|███████▎ | 26810/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.76.up_proj: 73%|███████▎ | 26811/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.76.down_proj: 73%|███████▎ | 26812/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.77.gate_proj: 73%|███████▎ | 26813/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.77.up_proj: 73%|███████▎ | 26814/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.77.down_proj: 73%|███████▎ | 26815/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.78.gate_proj: 73%|███████▎ | 26816/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.78.up_proj: 73%|███████▎ | 26817/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.78.down_proj: 73%|███████▎ | 26818/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.79.gate_proj: 73%|███████▎ | 26819/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.79.up_proj: 73%|███████▎ | 26820/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.79.down_proj: 73%|███████▎ | 26821/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.80.gate_proj: 73%|███████▎ | 26822/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.80.up_proj: 73%|███████▎ | 26823/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.80.down_proj: 73%|███████▎ | 26824/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.81.gate_proj: 73%|███████▎ | 26825/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.81.up_proj: 73%|███████▎ | 26826/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.81.down_proj: 73%|███████▎ | 26827/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.82.gate_proj: 73%|███████▎ | 26828/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.82.up_proj: 73%|███████▎ | 26829/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.82.down_proj: 73%|███████▎ | 26830/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.83.gate_proj: 73%|███████▎ | 26831/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.83.up_proj: 73%|███████▎ | 26832/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.83.down_proj: 73%|███████▎ | 26833/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.84.gate_proj: 73%|███████▎ | 26834/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.84.up_proj: 73%|███████▎ | 26835/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.84.down_proj: 73%|███████▎ | 26836/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.85.gate_proj: 73%|███████▎ | 26837/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.85.up_proj: 73%|███████▎ | 26838/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.85.down_proj: 73%|███████▎ | 26839/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.86.gate_proj: 73%|███████▎ | 26840/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.86.up_proj: 73%|███████▎ | 26841/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.86.down_proj: 73%|███████▎ | 26842/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.87.gate_proj: 73%|███████▎ | 26843/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.87.up_proj: 73%|███████▎ | 26844/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.87.down_proj: 73%|███████▎ | 26845/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.88.gate_proj: 73%|███████▎ | 26846/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.88.up_proj: 73%|███████▎ | 26847/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.88.down_proj: 73%|███████▎ | 26848/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.89.gate_proj: 73%|███████▎ | 26849/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.89.up_proj: 73%|███████▎ | 26850/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.89.down_proj: 73%|███████▎ | 26851/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.90.gate_proj: 73%|███████▎ | 26852/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.90.up_proj: 73%|███████▎ | 26853/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.90.down_proj: 73%|███████▎ | 26854/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.91.gate_proj: 73%|███████▎ | 26855/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.91.up_proj: 73%|███████▎ | 26856/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.91.down_proj: 73%|███████▎ | 26857/36566 [00:24<00:08, 1146.03it/s] packing model.layers.68.mlp.experts.91.down_proj: 73%|███████▎ | 26858/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.92.gate_proj: 73%|███████▎ | 26858/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.92.up_proj: 73%|███████▎ | 26859/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.92.down_proj: 73%|███████▎ | 26860/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.93.gate_proj: 73%|███████▎ | 26861/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.93.up_proj: 73%|███████▎ | 26862/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.93.down_proj: 73%|███████▎ | 26863/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.94.gate_proj: 73%|███████▎ | 26864/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.94.up_proj: 73%|███████▎ | 26865/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.94.down_proj: 73%|███████▎ | 26866/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.95.gate_proj: 73%|███████▎ | 26867/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.95.up_proj: 73%|███████▎ | 26868/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.95.down_proj: 73%|███████▎ | 26869/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.96.gate_proj: 73%|███████▎ | 26870/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.96.up_proj: 73%|███████▎ | 26871/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.96.down_proj: 73%|███████▎ | 26872/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.97.gate_proj: 73%|███████▎ | 26873/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.97.up_proj: 73%|███████▎ | 26874/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.97.down_proj: 73%|███████▎ | 26875/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.98.gate_proj: 73%|███████▎ | 26876/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.98.up_proj: 74%|███████▎ | 26877/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.98.down_proj: 74%|███████▎ | 26878/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.99.gate_proj: 74%|███████▎ | 26879/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.99.up_proj: 74%|███████▎ | 26880/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.99.down_proj: 74%|███████▎ | 26881/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.100.gate_proj: 74%|███████▎ | 26882/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.100.up_proj: 74%|███████▎ | 26883/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.100.down_proj: 74%|███████▎ | 26884/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.101.gate_proj: 74%|███████▎ | 26885/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.101.up_proj: 74%|███████▎ | 26886/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.101.down_proj: 74%|███████▎ | 26887/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.102.gate_proj: 74%|███████▎ | 26888/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.102.up_proj: 74%|███████▎ | 26889/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.102.down_proj: 74%|███████▎ | 26890/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.103.gate_proj: 74%|███████▎ | 26891/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.103.up_proj: 74%|███████▎ | 26892/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.103.down_proj: 74%|███████▎ | 26893/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.104.gate_proj: 74%|███████▎ | 26894/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.104.up_proj: 74%|███████▎ | 26895/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.104.down_proj: 74%|███████▎ | 26896/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.105.gate_proj: 74%|███████▎ | 26897/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.105.up_proj: 74%|███████▎ | 26898/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.105.down_proj: 74%|███████▎ | 26899/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.106.gate_proj: 74%|███████▎ | 26900/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.106.up_proj: 74%|███████▎ | 26901/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.106.down_proj: 74%|███████▎ | 26902/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.107.gate_proj: 74%|███████▎ | 26903/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.107.up_proj: 74%|███████▎ | 26904/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.107.down_proj: 74%|███████▎ | 26905/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.108.gate_proj: 74%|███████▎ | 26906/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.108.up_proj: 74%|███████▎ | 26907/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.108.down_proj: 74%|███████▎ | 26908/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.109.gate_proj: 74%|███████▎ | 26909/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.109.up_proj: 74%|███████▎ | 26910/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.109.down_proj: 74%|███████▎ | 26911/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.110.gate_proj: 74%|███████▎ | 26912/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.110.up_proj: 74%|███████▎ | 26913/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.110.down_proj: 74%|███████▎ | 26914/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.111.gate_proj: 74%|███████▎ | 26915/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.111.up_proj: 74%|███████▎ | 26916/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.111.down_proj: 74%|███████▎ | 26917/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.112.gate_proj: 74%|███████▎ | 26918/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.112.up_proj: 74%|███████▎ | 26919/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.112.down_proj: 74%|███████▎ | 26920/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.113.gate_proj: 74%|███████▎ | 26921/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.113.up_proj: 74%|███████▎ | 26922/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.113.down_proj: 74%|███████▎ | 26923/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.114.gate_proj: 74%|███████▎ | 26924/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.114.up_proj: 74%|███████▎ | 26925/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.114.down_proj: 74%|███████▎ | 26926/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.115.gate_proj: 74%|███████▎ | 26927/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.115.up_proj: 74%|███████▎ | 26928/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.115.down_proj: 74%|███████▎ | 26929/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.116.gate_proj: 74%|███████▎ | 26930/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.116.up_proj: 74%|███████▎ | 26931/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.116.down_proj: 74%|███████▎ | 26932/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.117.gate_proj: 74%|███████▎ | 26933/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.117.up_proj: 74%|███████▎ | 26934/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.117.down_proj: 74%|███████▎ | 26935/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.118.gate_proj: 74%|███████▎ | 26936/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.118.up_proj: 74%|███████▎ | 26937/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.118.down_proj: 74%|███████▎ | 26938/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.119.gate_proj: 74%|███████▎ | 26939/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.119.up_proj: 74%|███████▎ | 26940/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.119.down_proj: 74%|███████▎ | 26941/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.120.gate_proj: 74%|███████▎ | 26942/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.120.up_proj: 74%|███████▎ | 26943/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.120.down_proj: 74%|███████▎ | 26944/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.121.gate_proj: 74%|███████▎ | 26945/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.121.up_proj: 74%|███████▎ | 26946/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.121.down_proj: 74%|███████▎ | 26947/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.122.gate_proj: 74%|███████▎ | 26948/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.122.up_proj: 74%|███████▎ | 26949/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.122.down_proj: 74%|███████▎ | 26950/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.123.gate_proj: 74%|███████▎ | 26951/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.123.up_proj: 74%|███████▎ | 26952/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.123.down_proj: 74%|███████▎ | 26953/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.124.gate_proj: 74%|███████▎ | 26954/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.124.up_proj: 74%|███████▎ | 26955/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.124.down_proj: 74%|███████▎ | 26956/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.125.gate_proj: 74%|███████▎ | 26957/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.125.up_proj: 74%|███████▎ | 26958/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.125.down_proj: 74%|███████▎ | 26959/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.126.gate_proj: 74%|███████▎ | 26960/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.126.up_proj: 74%|███████▎ | 26961/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.126.down_proj: 74%|███████▎ | 26962/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.127.gate_proj: 74%|███████▎ | 26963/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.127.up_proj: 74%|███████▎ | 26964/36566 [00:24<00:08, 1144.70it/s] packing model.layers.68.mlp.experts.127.down_proj: 74%|███████▎ | 26965/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.0.gate_proj: 74%|███████▎ | 26966/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.0.up_proj: 74%|███████▎ | 26967/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.0.down_proj: 74%|███████▍ | 26968/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.1.gate_proj: 74%|███████▍ | 26969/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.1.up_proj: 74%|███████▍ | 26970/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.1.down_proj: 74%|███████▍ | 26971/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.2.gate_proj: 74%|███████▍ | 26972/36566 [00:24<00:08, 1144.70it/s] packing model.layers.69.mlp.experts.2.gate_proj: 74%|███████▍ | 26973/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.2.up_proj: 74%|███████▍ | 26973/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.2.down_proj: 74%|███████▍ | 26974/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.3.gate_proj: 74%|███████▍ | 26975/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.3.up_proj: 74%|███████▍ | 26976/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.3.down_proj: 74%|███████▍ | 26977/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.4.gate_proj: 74%|███████▍ | 26978/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.4.up_proj: 74%|███████▍ | 26979/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.4.down_proj: 74%|███████▍ | 26980/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.5.gate_proj: 74%|███████▍ | 26981/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.5.up_proj: 74%|███████▍ | 26982/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.5.down_proj: 74%|███████▍ | 26983/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.6.gate_proj: 74%|███████▍ | 26984/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.6.up_proj: 74%|███████▍ | 26985/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.6.down_proj: 74%|███████▍ | 26986/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.7.gate_proj: 74%|███████▍ | 26987/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.7.up_proj: 74%|███████▍ | 26988/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.7.down_proj: 74%|███████▍ | 26989/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.8.gate_proj: 74%|███████▍ | 26990/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.8.up_proj: 74%|███████▍ | 26991/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.8.down_proj: 74%|███████▍ | 26992/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.9.gate_proj: 74%|███████▍ | 26993/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.9.up_proj: 74%|███████▍ | 26994/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.9.down_proj: 74%|███████▍ | 26995/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.10.gate_proj: 74%|███████▍ | 26996/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.10.up_proj: 74%|███████▍ | 26997/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.10.down_proj: 74%|███████▍ | 26998/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.11.gate_proj: 74%|███████▍ | 26999/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.11.up_proj: 74%|███████▍ | 27000/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.11.down_proj: 74%|███████▍ | 27001/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.12.gate_proj: 74%|███████▍ | 27002/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.12.up_proj: 74%|███████▍ | 27003/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.12.down_proj: 74%|███████▍ | 27004/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.13.gate_proj: 74%|███████▍ | 27005/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.13.up_proj: 74%|███████▍ | 27006/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.13.down_proj: 74%|███████▍ | 27007/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.14.gate_proj: 74%|███████▍ | 27008/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.14.up_proj: 74%|███████▍ | 27009/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.14.down_proj: 74%|███████▍ | 27010/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.15.gate_proj: 74%|███████▍ | 27011/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.15.up_proj: 74%|███████▍ | 27012/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.15.down_proj: 74%|███████▍ | 27013/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.16.gate_proj: 74%|███████▍ | 27014/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.16.up_proj: 74%|███████▍ | 27015/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.16.down_proj: 74%|███████▍ | 27016/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.17.gate_proj: 74%|███████▍ | 27017/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.17.up_proj: 74%|███████▍ | 27018/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.17.down_proj: 74%|███████▍ | 27019/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.18.gate_proj: 74%|███████▍ | 27020/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.18.up_proj: 74%|███████▍ | 27021/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.18.down_proj: 74%|███████▍ | 27022/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.19.gate_proj: 74%|███████▍ | 27023/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.19.up_proj: 74%|███████▍ | 27024/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.19.down_proj: 74%|███████▍ | 27025/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.20.gate_proj: 74%|███████▍ | 27026/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.20.up_proj: 74%|███████▍ | 27027/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.20.down_proj: 74%|███████▍ | 27028/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.21.gate_proj: 74%|███████▍ | 27029/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.21.up_proj: 74%|███████▍ | 27030/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.21.down_proj: 74%|███████▍ | 27031/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.22.gate_proj: 74%|███████▍ | 27032/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.22.up_proj: 74%|███████▍ | 27033/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.22.down_proj: 74%|███████▍ | 27034/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.23.gate_proj: 74%|███████▍ | 27035/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.23.up_proj: 74%|███████▍ | 27036/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.23.down_proj: 74%|███████▍ | 27037/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.24.gate_proj: 74%|███████▍ | 27038/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.24.up_proj: 74%|███████▍ | 27039/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.24.down_proj: 74%|███████▍ | 27040/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.25.gate_proj: 74%|███████▍ | 27041/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.25.up_proj: 74%|███████▍ | 27042/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.25.down_proj: 74%|███████▍ | 27043/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.26.gate_proj: 74%|███████▍ | 27044/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.26.up_proj: 74%|███████▍ | 27045/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.26.down_proj: 74%|███████▍ | 27046/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.27.gate_proj: 74%|███████▍ | 27047/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.27.up_proj: 74%|███████▍ | 27048/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.27.down_proj: 74%|███████▍ | 27049/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.28.gate_proj: 74%|███████▍ | 27050/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.28.up_proj: 74%|███████▍ | 27051/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.28.down_proj: 74%|███████▍ | 27052/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.29.gate_proj: 74%|███████▍ | 27053/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.29.up_proj: 74%|███████▍ | 27054/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.29.down_proj: 74%|███████▍ | 27055/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.30.gate_proj: 74%|███████▍ | 27056/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.30.up_proj: 74%|███████▍ | 27057/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.30.down_proj: 74%|███████▍ | 27058/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.31.gate_proj: 74%|███████▍ | 27059/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.31.up_proj: 74%|███████▍ | 27060/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.31.down_proj: 74%|███████▍ | 27061/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.32.gate_proj: 74%|███████▍ | 27062/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.32.up_proj: 74%|███████▍ | 27063/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.32.down_proj: 74%|███████▍ | 27064/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.33.gate_proj: 74%|███████▍ | 27065/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.33.up_proj: 74%|███████▍ | 27066/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.33.down_proj: 74%|███████▍ | 27067/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.34.gate_proj: 74%|███████▍ | 27068/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.34.up_proj: 74%|███████▍ | 27069/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.34.down_proj: 74%|███████▍ | 27070/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.35.gate_proj: 74%|███████▍ | 27071/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.35.up_proj: 74%|███████▍ | 27072/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.35.down_proj: 74%|███████▍ | 27073/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.36.gate_proj: 74%|███████▍ | 27074/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.36.up_proj: 74%|███████▍ | 27075/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.36.down_proj: 74%|███████▍ | 27076/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.37.gate_proj: 74%|███████▍ | 27077/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.37.up_proj: 74%|███████▍ | 27078/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.37.down_proj: 74%|███████▍ | 27079/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.38.gate_proj: 74%|███████▍ | 27080/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.38.up_proj: 74%|███████▍ | 27081/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.38.down_proj: 74%|███████▍ | 27082/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.39.gate_proj: 74%|███████▍ | 27083/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.39.up_proj: 74%|███████▍ | 27084/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.39.down_proj: 74%|███████▍ | 27085/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.40.gate_proj: 74%|███████▍ | 27086/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.40.up_proj: 74%|███████▍ | 27087/36566 [00:24<00:08, 1142.61it/s] packing model.layers.69.mlp.experts.40.up_proj: 74%|███████▍ | 27088/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.40.down_proj: 74%|███████▍ | 27088/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.41.gate_proj: 74%|███████▍ | 27089/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.41.up_proj: 74%|███████▍ | 27090/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.41.down_proj: 74%|███████▍ | 27091/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.42.gate_proj: 74%|███████▍ | 27092/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.42.up_proj: 74%|███████▍ | 27093/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.42.down_proj: 74%|███████▍ | 27094/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.43.gate_proj: 74%|███████▍ | 27095/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.43.up_proj: 74%|███████▍ | 27096/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.43.down_proj: 74%|███████▍ | 27097/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.44.gate_proj: 74%|███████▍ | 27098/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.44.up_proj: 74%|███████▍ | 27099/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.44.down_proj: 74%|███████▍ | 27100/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.45.gate_proj: 74%|███████▍ | 27101/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.45.up_proj: 74%|███████▍ | 27102/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.45.down_proj: 74%|███████▍ | 27103/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.46.gate_proj: 74%|███████▍ | 27104/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.46.up_proj: 74%|███████▍ | 27105/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.46.down_proj: 74%|███████▍ | 27106/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.47.gate_proj: 74%|███████▍ | 27107/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.47.up_proj: 74%|███████▍ | 27108/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.47.down_proj: 74%|███████▍ | 27109/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.48.gate_proj: 74%|███████▍ | 27110/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.48.up_proj: 74%|███████▍ | 27111/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.48.down_proj: 74%|███████▍ | 27112/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.49.gate_proj: 74%|███████▍ | 27113/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.49.up_proj: 74%|███████▍ | 27114/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.49.down_proj: 74%|███████▍ | 27115/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.50.gate_proj: 74%|███████▍ | 27116/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.50.up_proj: 74%|███████▍ | 27117/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.50.down_proj: 74%|███████▍ | 27118/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.51.gate_proj: 74%|███████▍ | 27119/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.51.up_proj: 74%|███████▍ | 27120/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.51.down_proj: 74%|███████▍ | 27121/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.52.gate_proj: 74%|███████▍ | 27122/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.52.up_proj: 74%|███████▍ | 27123/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.52.down_proj: 74%|███████▍ | 27124/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.53.gate_proj: 74%|███████▍ | 27125/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.53.up_proj: 74%|███████▍ | 27126/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.53.down_proj: 74%|███████▍ | 27127/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.54.gate_proj: 74%|███████▍ | 27128/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.54.up_proj: 74%|███████▍ | 27129/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.54.down_proj: 74%|███████▍ | 27130/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.55.gate_proj: 74%|███████▍ | 27131/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.55.up_proj: 74%|███████▍ | 27132/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.55.down_proj: 74%|███████▍ | 27133/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.56.gate_proj: 74%|███████▍ | 27134/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.56.up_proj: 74%|███████▍ | 27135/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.56.down_proj: 74%|███████▍ | 27136/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.57.gate_proj: 74%|███████▍ | 27137/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.57.up_proj: 74%|███████▍ | 27138/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.57.down_proj: 74%|███████▍ | 27139/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.58.gate_proj: 74%|███████▍ | 27140/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.58.up_proj: 74%|███████▍ | 27141/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.58.down_proj: 74%|███████▍ | 27142/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.59.gate_proj: 74%|███████▍ | 27143/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.59.up_proj: 74%|███████▍ | 27144/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.59.down_proj: 74%|███████▍ | 27145/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.60.gate_proj: 74%|███████▍ | 27146/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.60.up_proj: 74%|███████▍ | 27147/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.60.down_proj: 74%|███████▍ | 27148/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.61.gate_proj: 74%|███████▍ | 27149/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.61.up_proj: 74%|███████▍ | 27150/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.61.down_proj: 74%|███████▍ | 27151/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.62.gate_proj: 74%|███████▍ | 27152/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.62.up_proj: 74%|███████▍ | 27153/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.62.down_proj: 74%|███████▍ | 27154/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.63.gate_proj: 74%|███████▍ | 27155/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.63.up_proj: 74%|███████▍ | 27156/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.63.down_proj: 74%|███████▍ | 27157/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.64.gate_proj: 74%|███████▍ | 27158/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.64.up_proj: 74%|███████▍ | 27159/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.64.down_proj: 74%|███████▍ | 27160/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.65.gate_proj: 74%|███████▍ | 27161/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.65.up_proj: 74%|███████▍ | 27162/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.65.down_proj: 74%|███████▍ | 27163/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.66.gate_proj: 74%|███████▍ | 27164/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.66.up_proj: 74%|███████▍ | 27165/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.66.down_proj: 74%|███████▍ | 27166/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.67.gate_proj: 74%|███████▍ | 27167/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.67.up_proj: 74%|███████▍ | 27168/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.67.down_proj: 74%|███████▍ | 27169/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.68.gate_proj: 74%|███████▍ | 27170/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.68.up_proj: 74%|███████▍ | 27171/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.68.down_proj: 74%|███████▍ | 27172/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.69.gate_proj: 74%|███████▍ | 27173/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.69.up_proj: 74%|███████▍ | 27174/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.69.down_proj: 74%|███████▍ | 27175/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.70.gate_proj: 74%|███████▍ | 27176/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.70.up_proj: 74%|███████▍ | 27177/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.70.down_proj: 74%|███████▍ | 27178/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.71.gate_proj: 74%|███████▍ | 27179/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.71.up_proj: 74%|███████▍ | 27180/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.71.down_proj: 74%|███████▍ | 27181/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.72.gate_proj: 74%|███████▍ | 27182/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.72.up_proj: 74%|███████▍ | 27183/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.72.down_proj: 74%|███████▍ | 27184/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.73.gate_proj: 74%|███████▍ | 27185/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.73.up_proj: 74%|███████▍ | 27186/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.73.down_proj: 74%|███████▍ | 27187/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.74.gate_proj: 74%|███████▍ | 27188/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.74.up_proj: 74%|███████▍ | 27189/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.74.down_proj: 74%|███████▍ | 27190/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.75.gate_proj: 74%|███████▍ | 27191/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.75.up_proj: 74%|███████▍ | 27192/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.75.down_proj: 74%|███████▍ | 27193/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.76.gate_proj: 74%|███████▍ | 27194/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.76.up_proj: 74%|███████▍ | 27195/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.76.down_proj: 74%|███████▍ | 27196/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.77.gate_proj: 74%|███████▍ | 27197/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.77.up_proj: 74%|███████▍ | 27198/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.77.down_proj: 74%|███████▍ | 27199/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.78.gate_proj: 74%|███████▍ | 27200/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.78.up_proj: 74%|███████▍ | 27201/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.78.down_proj: 74%|███████▍ | 27202/36566 [00:24<00:08, 1142.67it/s] packing model.layers.69.mlp.experts.78.down_proj: 74%|███████▍ | 27203/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.79.gate_proj: 74%|███████▍ | 27203/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.79.up_proj: 74%|███████▍ | 27204/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.79.down_proj: 74%|███████▍ | 27205/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.80.gate_proj: 74%|███████▍ | 27206/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.80.up_proj: 74%|███████▍ | 27207/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.80.down_proj: 74%|███████▍ | 27208/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.81.gate_proj: 74%|███████▍ | 27209/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.81.up_proj: 74%|███████▍ | 27210/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.81.down_proj: 74%|███████▍ | 27211/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.82.gate_proj: 74%|███████▍ | 27212/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.82.up_proj: 74%|███████▍ | 27213/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.82.down_proj: 74%|███████▍ | 27214/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.83.gate_proj: 74%|███████▍ | 27215/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.83.up_proj: 74%|███████▍ | 27216/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.83.down_proj: 74%|███████▍ | 27217/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.84.gate_proj: 74%|███████▍ | 27218/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.84.up_proj: 74%|███████▍ | 27219/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.84.down_proj: 74%|███████▍ | 27220/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.85.gate_proj: 74%|███████▍ | 27221/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.85.up_proj: 74%|███████▍ | 27222/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.85.down_proj: 74%|███████▍ | 27223/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.86.gate_proj: 74%|███████▍ | 27224/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.86.up_proj: 74%|███████▍ | 27225/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.86.down_proj: 74%|███████▍ | 27226/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.87.gate_proj: 74%|███████▍ | 27227/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.87.up_proj: 74%|███████▍ | 27228/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.87.down_proj: 74%|███████▍ | 27229/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.88.gate_proj: 74%|███████▍ | 27230/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.88.up_proj: 74%|███████▍ | 27231/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.88.down_proj: 74%|███████▍ | 27232/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.89.gate_proj: 74%|███████▍ | 27233/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.89.up_proj: 74%|███████▍ | 27234/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.89.down_proj: 74%|███████▍ | 27235/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.90.gate_proj: 74%|███████▍ | 27236/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.90.up_proj: 74%|███████▍ | 27237/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.90.down_proj: 74%|███████▍ | 27238/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.91.gate_proj: 74%|███████▍ | 27239/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.91.up_proj: 74%|███████▍ | 27240/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.91.down_proj: 74%|███████▍ | 27241/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.92.gate_proj: 75%|███████▍ | 27242/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.92.up_proj: 75%|███████▍ | 27243/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.92.down_proj: 75%|███████▍ | 27244/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.93.gate_proj: 75%|███████▍ | 27245/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.93.up_proj: 75%|███████▍ | 27246/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.93.down_proj: 75%|███████▍ | 27247/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.94.gate_proj: 75%|███████▍ | 27248/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.94.up_proj: 75%|███████▍ | 27249/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.94.down_proj: 75%|███████▍ | 27250/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.95.gate_proj: 75%|███████▍ | 27251/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.95.up_proj: 75%|███████▍ | 27252/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.95.down_proj: 75%|███████▍ | 27253/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.96.gate_proj: 75%|███████▍ | 27254/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.96.up_proj: 75%|███████▍ | 27255/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.96.down_proj: 75%|███████▍ | 27256/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.97.gate_proj: 75%|███████▍ | 27257/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.97.up_proj: 75%|███████▍ | 27258/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.97.down_proj: 75%|███████▍ | 27259/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.98.gate_proj: 75%|███████▍ | 27260/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.98.up_proj: 75%|███████▍ | 27261/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.98.down_proj: 75%|███████▍ | 27262/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.99.gate_proj: 75%|███████▍ | 27263/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.99.up_proj: 75%|███████▍ | 27264/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.99.down_proj: 75%|███████▍ | 27265/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.100.gate_proj: 75%|███████▍ | 27266/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.100.up_proj: 75%|███████▍ | 27267/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.100.down_proj: 75%|███████▍ | 27268/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.101.gate_proj: 75%|███████▍ | 27269/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.101.up_proj: 75%|███████▍ | 27270/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.101.down_proj: 75%|███████▍ | 27271/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.102.gate_proj: 75%|███████▍ | 27272/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.102.up_proj: 75%|███████▍ | 27273/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.102.down_proj: 75%|███████▍ | 27274/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.103.gate_proj: 75%|███████▍ | 27275/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.103.up_proj: 75%|███████▍ | 27276/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.103.down_proj: 75%|███████▍ | 27277/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.104.gate_proj: 75%|███████▍ | 27278/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.104.up_proj: 75%|███████▍ | 27279/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.104.down_proj: 75%|███████▍ | 27280/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.105.gate_proj: 75%|███████▍ | 27281/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.105.up_proj: 75%|███████▍ | 27282/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.105.down_proj: 75%|███████▍ | 27283/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.106.gate_proj: 75%|███████▍ | 27284/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.106.up_proj: 75%|███████▍ | 27285/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.106.down_proj: 75%|███████▍ | 27286/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.107.gate_proj: 75%|███████▍ | 27287/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.107.up_proj: 75%|███████▍ | 27288/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.107.down_proj: 75%|███████▍ | 27289/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.108.gate_proj: 75%|███████▍ | 27290/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.108.up_proj: 75%|███████▍ | 27291/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.108.down_proj: 75%|███████▍ | 27292/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.109.gate_proj: 75%|███████▍ | 27293/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.109.up_proj: 75%|███████▍ | 27294/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.109.down_proj: 75%|███████▍ | 27295/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.110.gate_proj: 75%|███████▍ | 27296/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.110.up_proj: 75%|███████▍ | 27297/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.110.down_proj: 75%|███████▍ | 27298/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.111.gate_proj: 75%|███████▍ | 27299/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.111.up_proj: 75%|███████▍ | 27300/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.111.down_proj: 75%|███████▍ | 27301/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.112.gate_proj: 75%|███████▍ | 27302/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.112.up_proj: 75%|███████▍ | 27303/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.112.down_proj: 75%|███████▍ | 27304/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.113.gate_proj: 75%|███████▍ | 27305/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.113.up_proj: 75%|███████▍ | 27306/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.113.down_proj: 75%|███████▍ | 27307/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.114.gate_proj: 75%|███████▍ | 27308/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.114.up_proj: 75%|███████▍ | 27309/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.114.down_proj: 75%|███████▍ | 27310/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.115.gate_proj: 75%|███████▍ | 27311/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.115.up_proj: 75%|███████▍ | 27312/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.115.down_proj: 75%|███████▍ | 27313/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.116.gate_proj: 75%|███████▍ | 27314/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.116.up_proj: 75%|███████▍ | 27315/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.116.down_proj: 75%|███████▍ | 27316/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.117.gate_proj: 75%|███████▍ | 27317/36566 [00:24<00:08, 1142.27it/s] packing model.layers.69.mlp.experts.117.gate_proj: 75%|███████▍ | 27318/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.117.up_proj: 75%|███████▍ | 27318/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.117.down_proj: 75%|███████▍ | 27319/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.118.gate_proj: 75%|███████▍ | 27320/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.118.up_proj: 75%|███████▍ | 27321/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.118.down_proj: 75%|███████▍ | 27322/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.119.gate_proj: 75%|███████▍ | 27323/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.119.up_proj: 75%|███████▍ | 27324/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.119.down_proj: 75%|███████▍ | 27325/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.120.gate_proj: 75%|███████▍ | 27326/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.120.up_proj: 75%|███████▍ | 27327/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.120.down_proj: 75%|███████▍ | 27328/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.121.gate_proj: 75%|███████▍ | 27329/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.121.up_proj: 75%|███████▍ | 27330/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.121.down_proj: 75%|███████▍ | 27331/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.122.gate_proj: 75%|███████▍ | 27332/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.122.up_proj: 75%|███████▍ | 27333/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.122.down_proj: 75%|███████▍ | 27334/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.123.gate_proj: 75%|███████▍ | 27335/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.123.up_proj: 75%|███████▍ | 27336/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.123.down_proj: 75%|███████▍ | 27337/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.124.gate_proj: 75%|███████▍ | 27338/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.124.up_proj: 75%|███████▍ | 27339/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.124.down_proj: 75%|███████▍ | 27340/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.125.gate_proj: 75%|███████▍ | 27341/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.125.up_proj: 75%|███████▍ | 27342/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.125.down_proj: 75%|███████▍ | 27343/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.126.gate_proj: 75%|███████▍ | 27344/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.126.up_proj: 75%|███████▍ | 27345/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.126.down_proj: 75%|███████▍ | 27346/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.127.gate_proj: 75%|███████▍ | 27347/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.127.up_proj: 75%|███████▍ | 27348/36566 [00:24<00:08, 1141.30it/s] packing model.layers.69.mlp.experts.127.down_proj: 75%|███████▍ | 27349/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.0.gate_proj: 75%|███████▍ | 27350/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.0.up_proj: 75%|███████▍ | 27351/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.0.down_proj: 75%|███████▍ | 27352/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.1.gate_proj: 75%|███████▍ | 27353/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.1.up_proj: 75%|███████▍ | 27354/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.1.down_proj: 75%|███████▍ | 27355/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.2.gate_proj: 75%|███████▍ | 27356/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.2.up_proj: 75%|███████▍ | 27357/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.2.down_proj: 75%|███████▍ | 27358/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.3.gate_proj: 75%|███████▍ | 27359/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.3.up_proj: 75%|███████▍ | 27360/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.3.down_proj: 75%|███████▍ | 27361/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.4.gate_proj: 75%|███████▍ | 27362/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.4.up_proj: 75%|███████▍ | 27363/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.4.down_proj: 75%|███████▍ | 27364/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.5.gate_proj: 75%|███████▍ | 27365/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.5.up_proj: 75%|███████▍ | 27366/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.5.down_proj: 75%|███████▍ | 27367/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.6.gate_proj: 75%|███████▍ | 27368/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.6.up_proj: 75%|███████▍ | 27369/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.6.down_proj: 75%|███████▍ | 27370/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.7.gate_proj: 75%|███████▍ | 27371/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.7.up_proj: 75%|███████▍ | 27372/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.7.down_proj: 75%|███████▍ | 27373/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.8.gate_proj: 75%|███████▍ | 27374/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.8.up_proj: 75%|███████▍ | 27375/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.8.down_proj: 75%|███████▍ | 27376/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.9.gate_proj: 75%|███████▍ | 27377/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.9.up_proj: 75%|███████▍ | 27378/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.9.down_proj: 75%|███████▍ | 27379/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.10.gate_proj: 75%|███████▍ | 27380/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.10.up_proj: 75%|███████▍ | 27381/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.10.down_proj: 75%|███████▍ | 27382/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.11.gate_proj: 75%|███████▍ | 27383/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.11.up_proj: 75%|███████▍ | 27384/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.11.down_proj: 75%|███████▍ | 27385/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.12.gate_proj: 75%|███████▍ | 27386/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.12.up_proj: 75%|███████▍ | 27387/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.12.down_proj: 75%|███████▍ | 27388/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.13.gate_proj: 75%|███████▍ | 27389/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.13.up_proj: 75%|███████▍ | 27390/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.13.down_proj: 75%|███████▍ | 27391/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.14.gate_proj: 75%|███████▍ | 27392/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.14.up_proj: 75%|███████▍ | 27393/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.14.down_proj: 75%|███████▍ | 27394/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.15.gate_proj: 75%|███████▍ | 27395/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.15.up_proj: 75%|███████▍ | 27396/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.15.down_proj: 75%|███████▍ | 27397/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.16.gate_proj: 75%|███████▍ | 27398/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.16.up_proj: 75%|███████▍ | 27399/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.16.down_proj: 75%|███████▍ | 27400/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.17.gate_proj: 75%|███████▍ | 27401/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.17.up_proj: 75%|███████▍ | 27402/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.17.down_proj: 75%|███████▍ | 27403/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.18.gate_proj: 75%|███████▍ | 27404/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.18.up_proj: 75%|███████▍ | 27405/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.18.down_proj: 75%|███████▍ | 27406/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.19.gate_proj: 75%|███████▍ | 27407/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.19.up_proj: 75%|███████▍ | 27408/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.19.down_proj: 75%|███████▍ | 27409/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.20.gate_proj: 75%|███████▍ | 27410/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.20.up_proj: 75%|███████▍ | 27411/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.20.down_proj: 75%|███████▍ | 27412/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.21.gate_proj: 75%|███████▍ | 27413/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.21.up_proj: 75%|███████▍ | 27414/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.21.down_proj: 75%|███████▍ | 27415/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.22.gate_proj: 75%|███████▍ | 27416/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.22.up_proj: 75%|███████▍ | 27417/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.22.down_proj: 75%|███████▍ | 27418/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.23.gate_proj: 75%|███████▍ | 27419/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.23.up_proj: 75%|███████▍ | 27420/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.23.down_proj: 75%|███████▍ | 27421/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.24.gate_proj: 75%|███████▍ | 27422/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.24.up_proj: 75%|███████▍ | 27423/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.24.down_proj: 75%|███████▍ | 27424/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.25.gate_proj: 75%|███████▌ | 27425/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.25.up_proj: 75%|███████▌ | 27426/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.25.down_proj: 75%|███████▌ | 27427/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.26.gate_proj: 75%|███████▌ | 27428/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.26.up_proj: 75%|███████▌ | 27429/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.26.down_proj: 75%|███████▌ | 27430/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.27.gate_proj: 75%|███████▌ | 27431/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.27.up_proj: 75%|███████▌ | 27432/36566 [00:24<00:08, 1141.30it/s] packing model.layers.70.mlp.experts.27.up_proj: 75%|███████▌ | 27433/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.27.down_proj: 75%|███████▌ | 27433/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.28.gate_proj: 75%|███████▌ | 27434/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.28.up_proj: 75%|███████▌ | 27435/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.28.down_proj: 75%|███████▌ | 27436/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.29.gate_proj: 75%|███████▌ | 27437/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.29.up_proj: 75%|███████▌ | 27438/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.29.down_proj: 75%|███████▌ | 27439/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.30.gate_proj: 75%|███████▌ | 27440/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.30.up_proj: 75%|███████▌ | 27441/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.30.down_proj: 75%|███████▌ | 27442/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.31.gate_proj: 75%|███████▌ | 27443/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.31.up_proj: 75%|███████▌ | 27444/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.31.down_proj: 75%|███████▌ | 27445/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.32.gate_proj: 75%|███████▌ | 27446/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.32.up_proj: 75%|███████▌ | 27447/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.32.down_proj: 75%|███████▌ | 27448/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.33.gate_proj: 75%|███████▌ | 27449/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.33.up_proj: 75%|███████▌ | 27450/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.33.down_proj: 75%|███████▌ | 27451/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.34.gate_proj: 75%|███████▌ | 27452/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.34.up_proj: 75%|███████▌ | 27453/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.34.down_proj: 75%|███████▌ | 27454/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.35.gate_proj: 75%|███████▌ | 27455/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.35.up_proj: 75%|███████▌ | 27456/36566 [00:24<00:08, 1138.72it/s] packing model.layers.70.mlp.experts.35.down_proj: 75%|███████▌ | 27457/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.36.gate_proj: 75%|███████▌ | 27458/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.36.up_proj: 75%|███████▌ | 27459/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.36.down_proj: 75%|███████▌ | 27460/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.37.gate_proj: 75%|███████▌ | 27461/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.37.up_proj: 75%|███████▌ | 27462/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.37.down_proj: 75%|███████▌ | 27463/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.38.gate_proj: 75%|███████▌ | 27464/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.38.up_proj: 75%|███████▌ | 27465/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.38.down_proj: 75%|███████▌ | 27466/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.39.gate_proj: 75%|███████▌ | 27467/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.39.up_proj: 75%|███████▌ | 27468/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.39.down_proj: 75%|███████▌ | 27469/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.40.gate_proj: 75%|███████▌ | 27470/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.40.up_proj: 75%|███████▌ | 27471/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.40.down_proj: 75%|███████▌ | 27472/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.41.gate_proj: 75%|███████▌ | 27473/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.41.up_proj: 75%|███████▌ | 27474/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.41.down_proj: 75%|███████▌ | 27475/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.42.gate_proj: 75%|███████▌ | 27476/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.42.up_proj: 75%|███████▌ | 27477/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.42.down_proj: 75%|███████▌ | 27478/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.43.gate_proj: 75%|███████▌ | 27479/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.43.up_proj: 75%|███████▌ | 27480/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.43.down_proj: 75%|███████▌ | 27481/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.44.gate_proj: 75%|███████▌ | 27482/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.44.up_proj: 75%|███████▌ | 27483/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.44.down_proj: 75%|███████▌ | 27484/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.45.gate_proj: 75%|███████▌ | 27485/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.45.up_proj: 75%|███████▌ | 27486/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.45.down_proj: 75%|███████▌ | 27487/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.46.gate_proj: 75%|███████▌ | 27488/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.46.up_proj: 75%|███████▌ | 27489/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.46.down_proj: 75%|███████▌ | 27490/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.47.gate_proj: 75%|███████▌ | 27491/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.47.up_proj: 75%|███████▌ | 27492/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.47.down_proj: 75%|███████▌ | 27493/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.48.gate_proj: 75%|███████▌ | 27494/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.48.up_proj: 75%|███████▌ | 27495/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.48.down_proj: 75%|███████▌ | 27496/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.49.gate_proj: 75%|███████▌ | 27497/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.49.up_proj: 75%|███████▌ | 27498/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.49.down_proj: 75%|███████▌ | 27499/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.50.gate_proj: 75%|███████▌ | 27500/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.50.up_proj: 75%|███████▌ | 27501/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.50.down_proj: 75%|███████▌ | 27502/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.51.gate_proj: 75%|███████▌ | 27503/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.51.up_proj: 75%|███████▌ | 27504/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.51.down_proj: 75%|███████▌ | 27505/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.52.gate_proj: 75%|███████▌ | 27506/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.52.up_proj: 75%|███████▌ | 27507/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.52.down_proj: 75%|███████▌ | 27508/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.53.gate_proj: 75%|███████▌ | 27509/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.53.up_proj: 75%|███████▌ | 27510/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.53.down_proj: 75%|███████▌ | 27511/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.54.gate_proj: 75%|███████▌ | 27512/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.54.up_proj: 75%|███████▌ | 27513/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.54.down_proj: 75%|███████▌ | 27514/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.55.gate_proj: 75%|███████▌ | 27515/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.55.up_proj: 75%|███████▌ | 27516/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.55.down_proj: 75%|███████▌ | 27517/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.56.gate_proj: 75%|███████▌ | 27518/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.56.up_proj: 75%|███████▌ | 27519/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.56.down_proj: 75%|███████▌ | 27520/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.57.gate_proj: 75%|███████▌ | 27521/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.57.up_proj: 75%|███████▌ | 27522/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.57.down_proj: 75%|███████▌ | 27523/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.58.gate_proj: 75%|███████▌ | 27524/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.58.up_proj: 75%|███████▌ | 27525/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.58.down_proj: 75%|███████▌ | 27526/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.59.gate_proj: 75%|███████▌ | 27527/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.59.up_proj: 75%|███████▌ | 27528/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.59.down_proj: 75%|███████▌ | 27529/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.60.gate_proj: 75%|███████▌ | 27530/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.60.up_proj: 75%|███████▌ | 27531/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.60.down_proj: 75%|███████▌ | 27532/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.61.gate_proj: 75%|███████▌ | 27533/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.61.up_proj: 75%|███████▌ | 27534/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.61.down_proj: 75%|███████▌ | 27535/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.62.gate_proj: 75%|███████▌ | 27536/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.62.up_proj: 75%|███████▌ | 27537/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.62.down_proj: 75%|███████▌ | 27538/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.63.gate_proj: 75%|███████▌ | 27539/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.63.up_proj: 75%|███████▌ | 27540/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.63.down_proj: 75%|███████▌ | 27541/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.64.gate_proj: 75%|███████▌ | 27542/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.64.up_proj: 75%|███████▌ | 27543/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.64.down_proj: 75%|███████▌ | 27544/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.65.gate_proj: 75%|███████▌ | 27545/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.65.up_proj: 75%|███████▌ | 27546/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.65.down_proj: 75%|███████▌ | 27547/36566 [00:24<00:07, 1138.72it/s] packing model.layers.70.mlp.experts.65.down_proj: 75%|███████▌ | 27548/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.66.gate_proj: 75%|███████▌ | 27548/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.66.up_proj: 75%|███████▌ | 27549/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.66.down_proj: 75%|███████▌ | 27550/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.67.gate_proj: 75%|███████▌ | 27551/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.67.up_proj: 75%|███████▌ | 27552/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.67.down_proj: 75%|███████▌ | 27553/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.68.gate_proj: 75%|███████▌ | 27554/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.68.up_proj: 75%|███████▌ | 27555/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.68.down_proj: 75%|███████▌ | 27556/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.69.gate_proj: 75%|███████▌ | 27557/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.69.up_proj: 75%|███████▌ | 27558/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.69.down_proj: 75%|███████▌ | 27559/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.70.gate_proj: 75%|███████▌ | 27560/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.70.up_proj: 75%|███████▌ | 27561/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.70.down_proj: 75%|███████▌ | 27562/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.71.gate_proj: 75%|███████▌ | 27563/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.71.up_proj: 75%|███████▌ | 27564/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.71.down_proj: 75%|███████▌ | 27565/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.72.gate_proj: 75%|███████▌ | 27566/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.72.up_proj: 75%|███████▌ | 27567/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.72.down_proj: 75%|███████▌ | 27568/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.73.gate_proj: 75%|███████▌ | 27569/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.73.up_proj: 75%|███████▌ | 27570/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.73.down_proj: 75%|███████▌ | 27571/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.74.gate_proj: 75%|███████▌ | 27572/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.74.up_proj: 75%|███████▌ | 27573/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.74.down_proj: 75%|███████▌ | 27574/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.75.gate_proj: 75%|███████▌ | 27575/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.75.up_proj: 75%|███████▌ | 27576/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.75.down_proj: 75%|███████▌ | 27577/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.76.gate_proj: 75%|███████▌ | 27578/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.76.up_proj: 75%|███████▌ | 27579/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.76.down_proj: 75%|███████▌ | 27580/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.77.gate_proj: 75%|███████▌ | 27581/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.77.up_proj: 75%|███████▌ | 27582/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.77.down_proj: 75%|███████▌ | 27583/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.78.gate_proj: 75%|███████▌ | 27584/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.78.up_proj: 75%|███████▌ | 27585/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.78.down_proj: 75%|███████▌ | 27586/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.79.gate_proj: 75%|███████▌ | 27587/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.79.up_proj: 75%|███████▌ | 27588/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.79.down_proj: 75%|███████▌ | 27589/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.80.gate_proj: 75%|███████▌ | 27590/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.80.up_proj: 75%|███████▌ | 27591/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.80.down_proj: 75%|███████▌ | 27592/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.81.gate_proj: 75%|███████▌ | 27593/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.81.up_proj: 75%|███████▌ | 27594/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.81.down_proj: 75%|███████▌ | 27595/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.82.gate_proj: 75%|███████▌ | 27596/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.82.up_proj: 75%|███████▌ | 27597/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.82.down_proj: 75%|███████▌ | 27598/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.83.gate_proj: 75%|███████▌ | 27599/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.83.up_proj: 75%|███████▌ | 27600/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.83.down_proj: 75%|███████▌ | 27601/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.84.gate_proj: 75%|███████▌ | 27602/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.84.up_proj: 75%|███████▌ | 27603/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.84.down_proj: 75%|███████▌ | 27604/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.85.gate_proj: 75%|███████▌ | 27605/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.85.up_proj: 75%|███████▌ | 27606/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.85.down_proj: 75%|███████▌ | 27607/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.86.gate_proj: 76%|███████▌ | 27608/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.86.up_proj: 76%|███████▌ | 27609/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.86.down_proj: 76%|███████▌ | 27610/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.87.gate_proj: 76%|███████▌ | 27611/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.87.up_proj: 76%|███████▌ | 27612/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.87.down_proj: 76%|███████▌ | 27613/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.88.gate_proj: 76%|███████▌ | 27614/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.88.up_proj: 76%|███████▌ | 27615/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.88.down_proj: 76%|███████▌ | 27616/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.89.gate_proj: 76%|███████▌ | 27617/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.89.up_proj: 76%|███████▌ | 27618/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.89.down_proj: 76%|███████▌ | 27619/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.90.gate_proj: 76%|███████▌ | 27620/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.90.up_proj: 76%|███████▌ | 27621/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.90.down_proj: 76%|███████▌ | 27622/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.91.gate_proj: 76%|███████▌ | 27623/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.91.up_proj: 76%|███████▌ | 27624/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.91.down_proj: 76%|███████▌ | 27625/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.92.gate_proj: 76%|███████▌ | 27626/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.92.up_proj: 76%|███████▌ | 27627/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.92.down_proj: 76%|███████▌ | 27628/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.93.gate_proj: 76%|███████▌ | 27629/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.93.up_proj: 76%|███████▌ | 27630/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.93.down_proj: 76%|███████▌ | 27631/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.94.gate_proj: 76%|███████▌ | 27632/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.94.up_proj: 76%|███████▌ | 27633/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.94.down_proj: 76%|███████▌ | 27634/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.95.gate_proj: 76%|███████▌ | 27635/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.95.up_proj: 76%|███████▌ | 27636/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.95.down_proj: 76%|███████▌ | 27637/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.96.gate_proj: 76%|███████▌ | 27638/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.96.up_proj: 76%|███████▌ | 27639/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.96.down_proj: 76%|███████▌ | 27640/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.97.gate_proj: 76%|███████▌ | 27641/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.97.up_proj: 76%|███████▌ | 27642/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.97.down_proj: 76%|███████▌ | 27643/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.98.gate_proj: 76%|███████▌ | 27644/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.98.up_proj: 76%|███████▌ | 27645/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.98.down_proj: 76%|███████▌ | 27646/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.99.gate_proj: 76%|███████▌ | 27647/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.99.up_proj: 76%|███████▌ | 27648/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.99.down_proj: 76%|███████▌ | 27649/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.100.gate_proj: 76%|███████▌ | 27650/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.100.up_proj: 76%|███████▌ | 27651/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.100.down_proj: 76%|███████▌ | 27652/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.101.gate_proj: 76%|███████▌ | 27653/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.101.up_proj: 76%|███████▌ | 27654/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.101.down_proj: 76%|███████▌ | 27655/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.102.gate_proj: 76%|███████▌ | 27656/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.102.up_proj: 76%|███████▌ | 27657/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.102.down_proj: 76%|███████▌ | 27658/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.103.gate_proj: 76%|███████▌ | 27659/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.103.up_proj: 76%|███████▌ | 27660/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.103.down_proj: 76%|███████▌ | 27661/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.104.gate_proj: 76%|███████▌ | 27662/36566 [00:24<00:07, 1141.14it/s] packing model.layers.70.mlp.experts.104.gate_proj: 76%|███████▌ | 27663/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.104.up_proj: 76%|███████▌ | 27663/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.104.down_proj: 76%|███████▌ | 27664/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.105.gate_proj: 76%|███████▌ | 27665/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.105.up_proj: 76%|███████▌ | 27666/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.105.down_proj: 76%|███████▌ | 27667/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.106.gate_proj: 76%|███████▌ | 27668/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.106.up_proj: 76%|███████▌ | 27669/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.106.down_proj: 76%|███████▌ | 27670/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.107.gate_proj: 76%|███████▌ | 27671/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.107.up_proj: 76%|███████▌ | 27672/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.107.down_proj: 76%|███████▌ | 27673/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.108.gate_proj: 76%|███████▌ | 27674/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.108.up_proj: 76%|███████▌ | 27675/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.108.down_proj: 76%|███████▌ | 27676/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.109.gate_proj: 76%|███████▌ | 27677/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.109.up_proj: 76%|███████▌ | 27678/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.109.down_proj: 76%|███████▌ | 27679/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.110.gate_proj: 76%|███████▌ | 27680/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.110.up_proj: 76%|███████▌ | 27681/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.110.down_proj: 76%|███████▌ | 27682/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.111.gate_proj: 76%|███████▌ | 27683/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.111.up_proj: 76%|███████▌ | 27684/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.111.down_proj: 76%|███████▌ | 27685/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.112.gate_proj: 76%|███████▌ | 27686/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.112.up_proj: 76%|███████▌ | 27687/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.112.down_proj: 76%|███████▌ | 27688/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.113.gate_proj: 76%|███████▌ | 27689/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.113.up_proj: 76%|███████▌ | 27690/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.113.down_proj: 76%|███████▌ | 27691/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.114.gate_proj: 76%|███████▌ | 27692/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.114.up_proj: 76%|███████▌ | 27693/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.114.down_proj: 76%|███████▌ | 27694/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.115.gate_proj: 76%|███████▌ | 27695/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.115.up_proj: 76%|███████▌ | 27696/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.115.down_proj: 76%|███████▌ | 27697/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.116.gate_proj: 76%|███████▌ | 27698/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.116.up_proj: 76%|███████▌ | 27699/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.116.down_proj: 76%|███████▌ | 27700/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.117.gate_proj: 76%|███████▌ | 27701/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.117.up_proj: 76%|███████▌ | 27702/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.117.down_proj: 76%|███████▌ | 27703/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.118.gate_proj: 76%|███████▌ | 27704/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.118.up_proj: 76%|███████▌ | 27705/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.118.down_proj: 76%|███████▌ | 27706/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.119.gate_proj: 76%|███████▌ | 27707/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.119.up_proj: 76%|███████▌ | 27708/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.119.down_proj: 76%|███████▌ | 27709/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.120.gate_proj: 76%|███████▌ | 27710/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.120.up_proj: 76%|███████▌ | 27711/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.120.down_proj: 76%|███████▌ | 27712/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.121.gate_proj: 76%|███████▌ | 27713/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.121.up_proj: 76%|███████▌ | 27714/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.121.down_proj: 76%|███████▌ | 27715/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.122.gate_proj: 76%|███████▌ | 27716/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.122.up_proj: 76%|███████▌ | 27717/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.122.down_proj: 76%|███████▌ | 27718/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.123.gate_proj: 76%|███████▌ | 27719/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.123.up_proj: 76%|███████▌ | 27720/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.123.down_proj: 76%|███████▌ | 27721/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.124.gate_proj: 76%|███████▌ | 27722/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.124.up_proj: 76%|███████▌ | 27723/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.124.down_proj: 76%|███████▌ | 27724/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.125.gate_proj: 76%|███████▌ | 27725/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.125.up_proj: 76%|███████▌ | 27726/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.125.down_proj: 76%|███████▌ | 27727/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.126.gate_proj: 76%|███████▌ | 27728/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.126.up_proj: 76%|███████▌ | 27729/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.126.down_proj: 76%|███████▌ | 27730/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.127.gate_proj: 76%|███████▌ | 27731/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.127.up_proj: 76%|███████▌ | 27732/36566 [00:24<00:07, 1141.15it/s] packing model.layers.70.mlp.experts.127.down_proj: 76%|███████▌ | 27733/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.0.gate_proj: 76%|███████▌ | 27734/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.0.up_proj: 76%|███████▌ | 27735/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.0.down_proj: 76%|███████▌ | 27736/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.1.gate_proj: 76%|███████▌ | 27737/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.1.up_proj: 76%|███████▌ | 27738/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.1.down_proj: 76%|███████▌ | 27739/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.2.gate_proj: 76%|███████▌ | 27740/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.2.up_proj: 76%|███████▌ | 27741/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.2.down_proj: 76%|███████▌ | 27742/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.3.gate_proj: 76%|███████▌ | 27743/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.3.up_proj: 76%|███████▌ | 27744/36566 [00:24<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.3.down_proj: 76%|███████▌ | 27745/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.4.gate_proj: 76%|███████▌ | 27746/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.4.up_proj: 76%|███████▌ | 27747/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.4.down_proj: 76%|███████▌ | 27748/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.5.gate_proj: 76%|███████▌ | 27749/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.5.up_proj: 76%|███████▌ | 27750/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.5.down_proj: 76%|███████▌ | 27751/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.6.gate_proj: 76%|███████▌ | 27752/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.6.up_proj: 76%|███████▌ | 27753/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.6.down_proj: 76%|███████▌ | 27754/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.7.gate_proj: 76%|███████▌ | 27755/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.7.up_proj: 76%|███████▌ | 27756/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.7.down_proj: 76%|███████▌ | 27757/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.8.gate_proj: 76%|███████▌ | 27758/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.8.up_proj: 76%|███████▌ | 27759/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.8.down_proj: 76%|███████▌ | 27760/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.9.gate_proj: 76%|███████▌ | 27761/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.9.up_proj: 76%|███████▌ | 27762/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.9.down_proj: 76%|███████▌ | 27763/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.10.gate_proj: 76%|███████▌ | 27764/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.10.up_proj: 76%|███████▌ | 27765/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.10.down_proj: 76%|███████▌ | 27766/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.11.gate_proj: 76%|███████▌ | 27767/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.11.up_proj: 76%|███████▌ | 27768/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.11.down_proj: 76%|███████▌ | 27769/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.12.gate_proj: 76%|███████▌ | 27770/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.12.up_proj: 76%|███████▌ | 27771/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.12.down_proj: 76%|███████▌ | 27772/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.13.gate_proj: 76%|███████▌ | 27773/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.13.up_proj: 76%|███████▌ | 27774/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.13.down_proj: 76%|███████▌ | 27775/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.14.gate_proj: 76%|███████▌ | 27776/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.14.up_proj: 76%|███████▌ | 27777/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.14.down_proj: 76%|███████▌ | 27778/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.15.gate_proj: 76%|███████▌ | 27779/36566 [00:25<00:07, 1141.15it/s] packing model.layers.71.mlp.experts.15.gate_proj: 76%|███████▌ | 27780/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.15.up_proj: 76%|███████▌ | 27780/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.15.down_proj: 76%|███████▌ | 27781/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.16.gate_proj: 76%|███████▌ | 27782/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.16.up_proj: 76%|███████▌ | 27783/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.16.down_proj: 76%|███████▌ | 27784/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.17.gate_proj: 76%|███████▌ | 27785/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.17.up_proj: 76%|███████▌ | 27786/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.17.down_proj: 76%|███████▌ | 27787/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.18.gate_proj: 76%|███████▌ | 27788/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.18.up_proj: 76%|███████▌ | 27789/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.18.down_proj: 76%|███████▌ | 27790/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.19.gate_proj: 76%|███████▌ | 27791/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.19.up_proj: 76%|███████▌ | 27792/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.19.down_proj: 76%|███████▌ | 27793/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.20.gate_proj: 76%|███████▌ | 27794/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.20.up_proj: 76%|███████▌ | 27795/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.20.down_proj: 76%|███████▌ | 27796/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.21.gate_proj: 76%|███████▌ | 27797/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.21.up_proj: 76%|███████▌ | 27798/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.21.down_proj: 76%|███████▌ | 27799/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.22.gate_proj: 76%|███████▌ | 27800/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.22.up_proj: 76%|███████▌ | 27801/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.22.down_proj: 76%|███████▌ | 27802/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.23.gate_proj: 76%|███████▌ | 27803/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.23.up_proj: 76%|███████▌ | 27804/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.23.down_proj: 76%|███████▌ | 27805/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.24.gate_proj: 76%|███████▌ | 27806/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.24.up_proj: 76%|███████▌ | 27807/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.24.down_proj: 76%|███████▌ | 27808/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.25.gate_proj: 76%|███████▌ | 27809/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.25.up_proj: 76%|███████▌ | 27810/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.25.down_proj: 76%|███████▌ | 27811/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.26.gate_proj: 76%|███████▌ | 27812/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.26.up_proj: 76%|███████▌ | 27813/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.26.down_proj: 76%|███████▌ | 27814/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.27.gate_proj: 76%|███████▌ | 27815/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.27.up_proj: 76%|███████▌ | 27816/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.27.down_proj: 76%|███████▌ | 27817/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.28.gate_proj: 76%|███████▌ | 27818/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.28.up_proj: 76%|███████▌ | 27819/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.28.down_proj: 76%|███████▌ | 27820/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.29.gate_proj: 76%|███████▌ | 27821/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.29.up_proj: 76%|███████▌ | 27822/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.29.down_proj: 76%|███████▌ | 27823/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.30.gate_proj: 76%|███████▌ | 27824/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.30.up_proj: 76%|███████▌ | 27825/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.30.down_proj: 76%|███████▌ | 27826/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.31.gate_proj: 76%|███████▌ | 27827/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.31.up_proj: 76%|███████▌ | 27828/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.31.down_proj: 76%|███████▌ | 27829/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.32.gate_proj: 76%|███████▌ | 27830/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.32.up_proj: 76%|███████▌ | 27831/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.32.down_proj: 76%|███████▌ | 27832/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.33.gate_proj: 76%|███████▌ | 27833/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.33.up_proj: 76%|███████▌ | 27834/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.33.down_proj: 76%|███████▌ | 27835/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.34.gate_proj: 76%|███████▌ | 27836/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.34.up_proj: 76%|███████▌ | 27837/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.34.down_proj: 76%|███████▌ | 27838/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.35.gate_proj: 76%|███████▌ | 27839/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.35.up_proj: 76%|███████▌ | 27840/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.35.down_proj: 76%|███████▌ | 27841/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.36.gate_proj: 76%|███████▌ | 27842/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.36.up_proj: 76%|███████▌ | 27843/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.36.down_proj: 76%|███████▌ | 27844/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.37.gate_proj: 76%|███████▌ | 27845/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.37.up_proj: 76%|███████▌ | 27846/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.37.down_proj: 76%|███████▌ | 27847/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.38.gate_proj: 76%|███████▌ | 27848/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.38.up_proj: 76%|███████▌ | 27849/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.38.down_proj: 76%|███████▌ | 27850/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.39.gate_proj: 76%|███████▌ | 27851/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.39.up_proj: 76%|███████▌ | 27852/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.39.down_proj: 76%|███████▌ | 27853/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.40.gate_proj: 76%|███████▌ | 27854/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.40.up_proj: 76%|███████▌ | 27855/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.40.down_proj: 76%|███████▌ | 27856/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.41.gate_proj: 76%|███████▌ | 27857/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.41.up_proj: 76%|███████▌ | 27858/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.41.down_proj: 76%|███████▌ | 27859/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.42.gate_proj: 76%|███████▌ | 27860/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.42.up_proj: 76%|███████▌ | 27861/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.42.down_proj: 76%|███████▌ | 27862/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.43.gate_proj: 76%|███████▌ | 27863/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.43.up_proj: 76%|███████▌ | 27864/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.43.down_proj: 76%|███████▌ | 27865/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.44.gate_proj: 76%|███████▌ | 27866/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.44.up_proj: 76%|███████▌ | 27867/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.44.down_proj: 76%|███████▌ | 27868/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.45.gate_proj: 76%|███████▌ | 27869/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.45.up_proj: 76%|███████▌ | 27870/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.45.down_proj: 76%|███████▌ | 27871/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.46.gate_proj: 76%|███████▌ | 27872/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.46.up_proj: 76%|███████▌ | 27873/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.46.down_proj: 76%|███████▌ | 27874/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.47.gate_proj: 76%|███████▌ | 27875/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.47.up_proj: 76%|███████▌ | 27876/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.47.down_proj: 76%|███████▌ | 27877/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.48.gate_proj: 76%|███████▌ | 27878/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.48.up_proj: 76%|███████▌ | 27879/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.48.down_proj: 76%|███████▌ | 27880/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.49.gate_proj: 76%|███████▌ | 27881/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.49.up_proj: 76%|███████▋ | 27882/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.49.down_proj: 76%|███████▋ | 27883/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.50.gate_proj: 76%|███████▋ | 27884/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.50.up_proj: 76%|███████▋ | 27885/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.50.down_proj: 76%|███████▋ | 27886/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.51.gate_proj: 76%|███████▋ | 27887/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.51.up_proj: 76%|███████▋ | 27888/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.51.down_proj: 76%|███████▋ | 27889/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.52.gate_proj: 76%|███████▋ | 27890/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.52.up_proj: 76%|███████▋ | 27891/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.52.down_proj: 76%|███████▋ | 27892/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.53.gate_proj: 76%|███████▋ | 27893/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.53.up_proj: 76%|███████▋ | 27894/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.53.down_proj: 76%|███████▋ | 27895/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.54.gate_proj: 76%|███████▋ | 27896/36566 [00:25<00:07, 1147.24it/s] packing model.layers.71.mlp.experts.54.gate_proj: 76%|███████▋ | 27897/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.54.up_proj: 76%|███████▋ | 27897/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.54.down_proj: 76%|███████▋ | 27898/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.55.gate_proj: 76%|███████▋ | 27899/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.55.up_proj: 76%|███████▋ | 27900/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.55.down_proj: 76%|███████▋ | 27901/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.56.gate_proj: 76%|███████▋ | 27902/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.56.up_proj: 76%|███████▋ | 27903/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.56.down_proj: 76%|███████▋ | 27904/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.57.gate_proj: 76%|███████▋ | 27905/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.57.up_proj: 76%|███████▋ | 27906/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.57.down_proj: 76%|███████▋ | 27907/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.58.gate_proj: 76%|███████▋ | 27908/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.58.up_proj: 76%|███████▋ | 27909/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.58.down_proj: 76%|███████▋ | 27910/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.59.gate_proj: 76%|███████▋ | 27911/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.59.up_proj: 76%|███████▋ | 27912/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.59.down_proj: 76%|███████▋ | 27913/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.60.gate_proj: 76%|███████▋ | 27914/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.60.up_proj: 76%|███████▋ | 27915/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.60.down_proj: 76%|███████▋ | 27916/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.61.gate_proj: 76%|███████▋ | 27917/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.61.up_proj: 76%|███████▋ | 27918/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.61.down_proj: 76%|███████▋ | 27919/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.62.gate_proj: 76%|███████▋ | 27920/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.62.up_proj: 76%|███████▋ | 27921/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.62.down_proj: 76%|███████▋ | 27922/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.63.gate_proj: 76%|███████▋ | 27923/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.63.up_proj: 76%|███████▋ | 27924/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.63.down_proj: 76%|███████▋ | 27925/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.64.gate_proj: 76%|███████▋ | 27926/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.64.up_proj: 76%|███████▋ | 27927/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.64.down_proj: 76%|███████▋ | 27928/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.65.gate_proj: 76%|███████▋ | 27929/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.65.up_proj: 76%|███████▋ | 27930/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.65.down_proj: 76%|███████▋ | 27931/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.66.gate_proj: 76%|███████▋ | 27932/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.66.up_proj: 76%|███████▋ | 27933/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.66.down_proj: 76%|███████▋ | 27934/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.67.gate_proj: 76%|███████▋ | 27935/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.67.up_proj: 76%|███████▋ | 27936/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.67.down_proj: 76%|███████▋ | 27937/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.68.gate_proj: 76%|███████▋ | 27938/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.68.up_proj: 76%|███████▋ | 27939/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.68.down_proj: 76%|███████▋ | 27940/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.69.gate_proj: 76%|███████▋ | 27941/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.69.up_proj: 76%|███████▋ | 27942/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.69.down_proj: 76%|███████▋ | 27943/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.70.gate_proj: 76%|███████▋ | 27944/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.70.up_proj: 76%|███████▋ | 27945/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.70.down_proj: 76%|███████▋ | 27946/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.71.gate_proj: 76%|███████▋ | 27947/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.71.up_proj: 76%|███████▋ | 27948/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.71.down_proj: 76%|███████▋ | 27949/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.72.gate_proj: 76%|███████▋ | 27950/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.72.up_proj: 76%|███████▋ | 27951/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.72.down_proj: 76%|███████▋ | 27952/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.73.gate_proj: 76%|███████▋ | 27953/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.73.up_proj: 76%|███████▋ | 27954/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.73.down_proj: 76%|███████▋ | 27955/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.74.gate_proj: 76%|███████▋ | 27956/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.74.up_proj: 76%|███████▋ | 27957/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.74.down_proj: 76%|███████▋ | 27958/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.75.gate_proj: 76%|███████▋ | 27959/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.75.up_proj: 76%|███████▋ | 27960/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.75.down_proj: 76%|███████▋ | 27961/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.76.gate_proj: 76%|███████▋ | 27962/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.76.up_proj: 76%|███████▋ | 27963/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.76.down_proj: 76%|███████▋ | 27964/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.77.gate_proj: 76%|███████▋ | 27965/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.77.up_proj: 76%|███████▋ | 27966/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.77.down_proj: 76%|███████▋ | 27967/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.78.gate_proj: 76%|███████▋ | 27968/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.78.up_proj: 76%|███████▋ | 27969/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.78.down_proj: 76%|███████▋ | 27970/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.79.gate_proj: 76%|███████▋ | 27971/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.79.up_proj: 76%|███████▋ | 27972/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.79.down_proj: 77%|███████▋ | 27973/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.80.gate_proj: 77%|███████▋ | 27974/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.80.up_proj: 77%|███████▋ | 27975/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.80.down_proj: 77%|███████▋ | 27976/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.81.gate_proj: 77%|███████▋ | 27977/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.81.up_proj: 77%|███████▋ | 27978/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.81.down_proj: 77%|███████▋ | 27979/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.82.gate_proj: 77%|███████▋ | 27980/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.82.up_proj: 77%|███████▋ | 27981/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.82.down_proj: 77%|███████▋ | 27982/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.83.gate_proj: 77%|███████▋ | 27983/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.83.up_proj: 77%|███████▋ | 27984/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.83.down_proj: 77%|███████▋ | 27985/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.84.gate_proj: 77%|███████▋ | 27986/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.84.up_proj: 77%|███████▋ | 27987/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.84.down_proj: 77%|███████▋ | 27988/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.85.gate_proj: 77%|███████▋ | 27989/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.85.up_proj: 77%|███████▋ | 27990/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.85.down_proj: 77%|███████▋ | 27991/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.86.gate_proj: 77%|███████▋ | 27992/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.86.up_proj: 77%|███████▋ | 27993/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.86.down_proj: 77%|███████▋ | 27994/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.87.gate_proj: 77%|███████▋ | 27995/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.87.up_proj: 77%|███████▋ | 27996/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.87.down_proj: 77%|███████▋ | 27997/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.88.gate_proj: 77%|███████▋ | 27998/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.88.up_proj: 77%|███████▋ | 27999/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.88.down_proj: 77%|███████▋ | 28000/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.89.gate_proj: 77%|███████▋ | 28001/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.89.up_proj: 77%|███████▋ | 28002/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.89.down_proj: 77%|███████▋ | 28003/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.90.gate_proj: 77%|███████▋ | 28004/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.90.up_proj: 77%|███████▋ | 28005/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.90.down_proj: 77%|███████▋ | 28006/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.91.gate_proj: 77%|███████▋ | 28007/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.91.up_proj: 77%|███████▋ | 28008/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.91.down_proj: 77%|███████▋ | 28009/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.92.gate_proj: 77%|███████▋ | 28010/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.92.up_proj: 77%|███████▋ | 28011/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.92.down_proj: 77%|███████▋ | 28012/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.93.gate_proj: 77%|███████▋ | 28013/36566 [00:25<00:07, 1151.65it/s] packing model.layers.71.mlp.experts.93.gate_proj: 77%|███████▋ | 28014/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.93.up_proj: 77%|███████▋ | 28014/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.93.down_proj: 77%|███████▋ | 28015/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.94.gate_proj: 77%|███████▋ | 28016/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.94.up_proj: 77%|███████▋ | 28017/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.94.down_proj: 77%|███████▋ | 28018/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.95.gate_proj: 77%|███████▋ | 28019/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.95.up_proj: 77%|███████▋ | 28020/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.95.down_proj: 77%|███████▋ | 28021/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.96.gate_proj: 77%|███████▋ | 28022/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.96.up_proj: 77%|███████▋ | 28023/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.96.down_proj: 77%|███████▋ | 28024/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.97.gate_proj: 77%|███████▋ | 28025/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.97.up_proj: 77%|███████▋ | 28026/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.97.down_proj: 77%|███████▋ | 28027/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.98.gate_proj: 77%|███████▋ | 28028/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.98.up_proj: 77%|███████▋ | 28029/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.98.down_proj: 77%|███████▋ | 28030/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.99.gate_proj: 77%|███████▋ | 28031/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.99.up_proj: 77%|███████▋ | 28032/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.99.down_proj: 77%|███████▋ | 28033/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.100.gate_proj: 77%|███████▋ | 28034/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.100.up_proj: 77%|███████▋ | 28035/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.100.down_proj: 77%|███████▋ | 28036/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.101.gate_proj: 77%|███████▋ | 28037/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.101.up_proj: 77%|███████▋ | 28038/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.101.down_proj: 77%|███████▋ | 28039/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.102.gate_proj: 77%|███████▋ | 28040/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.102.up_proj: 77%|███████▋ | 28041/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.102.down_proj: 77%|███████▋ | 28042/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.103.gate_proj: 77%|███████▋ | 28043/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.103.up_proj: 77%|███████▋ | 28044/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.103.down_proj: 77%|███████▋ | 28045/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.104.gate_proj: 77%|███████▋ | 28046/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.104.up_proj: 77%|███████▋ | 28047/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.104.down_proj: 77%|███████▋ | 28048/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.105.gate_proj: 77%|███████▋ | 28049/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.105.up_proj: 77%|███████▋ | 28050/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.105.down_proj: 77%|███████▋ | 28051/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.106.gate_proj: 77%|███████▋ | 28052/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.106.up_proj: 77%|███████▋ | 28053/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.106.down_proj: 77%|███████▋ | 28054/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.107.gate_proj: 77%|███████▋ | 28055/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.107.up_proj: 77%|███████▋ | 28056/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.107.down_proj: 77%|███████▋ | 28057/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.108.gate_proj: 77%|███████▋ | 28058/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.108.up_proj: 77%|███████▋ | 28059/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.108.down_proj: 77%|███████▋ | 28060/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.109.gate_proj: 77%|███████▋ | 28061/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.109.up_proj: 77%|███████▋ | 28062/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.109.down_proj: 77%|███████▋ | 28063/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.110.gate_proj: 77%|███████▋ | 28064/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.110.up_proj: 77%|███████▋ | 28065/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.110.down_proj: 77%|███████▋ | 28066/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.111.gate_proj: 77%|███████▋ | 28067/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.111.up_proj: 77%|███████▋ | 28068/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.111.down_proj: 77%|███████▋ | 28069/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.112.gate_proj: 77%|███████▋ | 28070/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.112.up_proj: 77%|███████▋ | 28071/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.112.down_proj: 77%|███████▋ | 28072/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.113.gate_proj: 77%|███████▋ | 28073/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.113.up_proj: 77%|███████▋ | 28074/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.113.down_proj: 77%|███████▋ | 28075/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.114.gate_proj: 77%|███████▋ | 28076/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.114.up_proj: 77%|███████▋ | 28077/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.114.down_proj: 77%|███████▋ | 28078/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.115.gate_proj: 77%|███████▋ | 28079/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.115.up_proj: 77%|███████▋ | 28080/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.115.down_proj: 77%|███████▋ | 28081/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.116.gate_proj: 77%|███████▋ | 28082/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.116.up_proj: 77%|███████▋ | 28083/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.116.down_proj: 77%|███████▋ | 28084/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.117.gate_proj: 77%|███████▋ | 28085/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.117.up_proj: 77%|███████▋ | 28086/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.117.down_proj: 77%|███████▋ | 28087/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.118.gate_proj: 77%|███████▋ | 28088/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.118.up_proj: 77%|███████▋ | 28089/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.118.down_proj: 77%|███████▋ | 28090/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.119.gate_proj: 77%|███████▋ | 28091/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.119.up_proj: 77%|███████▋ | 28092/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.119.down_proj: 77%|███████▋ | 28093/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.120.gate_proj: 77%|███████▋ | 28094/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.120.up_proj: 77%|███████▋ | 28095/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.120.down_proj: 77%|███████▋ | 28096/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.121.gate_proj: 77%|███████▋ | 28097/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.121.up_proj: 77%|███████▋ | 28098/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.121.down_proj: 77%|███████▋ | 28099/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.122.gate_proj: 77%|███████▋ | 28100/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.122.up_proj: 77%|███████▋ | 28101/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.122.down_proj: 77%|███████▋ | 28102/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.123.gate_proj: 77%|███████▋ | 28103/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.123.up_proj: 77%|███████▋ | 28104/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.123.down_proj: 77%|███████▋ | 28105/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.124.gate_proj: 77%|███████▋ | 28106/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.124.up_proj: 77%|███████▋ | 28107/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.124.down_proj: 77%|███████▋ | 28108/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.125.gate_proj: 77%|███████▋ | 28109/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.125.up_proj: 77%|███████▋ | 28110/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.125.down_proj: 77%|███████▋ | 28111/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.126.gate_proj: 77%|███████▋ | 28112/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.126.up_proj: 77%|███████▋ | 28113/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.126.down_proj: 77%|███████▋ | 28114/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.127.gate_proj: 77%|███████▋ | 28115/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.127.up_proj: 77%|███████▋ | 28116/36566 [00:25<00:07, 1156.59it/s] packing model.layers.71.mlp.experts.127.down_proj: 77%|███████▋ | 28117/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.0.gate_proj: 77%|███████▋ | 28118/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.0.up_proj: 77%|███████▋ | 28119/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.0.down_proj: 77%|███████▋ | 28120/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.1.gate_proj: 77%|███████▋ | 28121/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.1.up_proj: 77%|███████▋ | 28122/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.1.down_proj: 77%|███████▋ | 28123/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.2.gate_proj: 77%|███████▋ | 28124/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.2.up_proj: 77%|███████▋ | 28125/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.2.down_proj: 77%|███████▋ | 28126/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.3.gate_proj: 77%|███████▋ | 28127/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.3.up_proj: 77%|███████▋ | 28128/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.3.down_proj: 77%|███████▋ | 28129/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.4.gate_proj: 77%|███████▋ | 28130/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.4.up_proj: 77%|███████▋ | 28131/36566 [00:25<00:07, 1156.59it/s] packing model.layers.72.mlp.experts.4.up_proj: 77%|███████▋ | 28132/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.4.down_proj: 77%|███████▋ | 28132/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.5.gate_proj: 77%|███████▋ | 28133/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.5.up_proj: 77%|███████▋ | 28134/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.5.down_proj: 77%|███████▋ | 28135/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.6.gate_proj: 77%|███████▋ | 28136/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.6.up_proj: 77%|███████▋ | 28137/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.6.down_proj: 77%|███████▋ | 28138/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.7.gate_proj: 77%|███████▋ | 28139/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.7.up_proj: 77%|███████▋ | 28140/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.7.down_proj: 77%|███████▋ | 28141/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.8.gate_proj: 77%|███████▋ | 28142/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.8.up_proj: 77%|███████▋ | 28143/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.8.down_proj: 77%|███████▋ | 28144/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.9.gate_proj: 77%|███████▋ | 28145/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.9.up_proj: 77%|███████▋ | 28146/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.9.down_proj: 77%|███████▋ | 28147/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.10.gate_proj: 77%|███████▋ | 28148/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.10.up_proj: 77%|███████▋ | 28149/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.10.down_proj: 77%|███████▋ | 28150/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.11.gate_proj: 77%|███████▋ | 28151/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.11.up_proj: 77%|███████▋ | 28152/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.11.down_proj: 77%|███████▋ | 28153/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.12.gate_proj: 77%|███████▋ | 28154/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.12.up_proj: 77%|███████▋ | 28155/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.12.down_proj: 77%|███████▋ | 28156/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.13.gate_proj: 77%|███████▋ | 28157/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.13.up_proj: 77%|███████▋ | 28158/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.13.down_proj: 77%|███████▋ | 28159/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.14.gate_proj: 77%|███████▋ | 28160/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.14.up_proj: 77%|███████▋ | 28161/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.14.down_proj: 77%|███████▋ | 28162/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.15.gate_proj: 77%|███████▋ | 28163/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.15.up_proj: 77%|███████▋ | 28164/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.15.down_proj: 77%|███████▋ | 28165/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.16.gate_proj: 77%|███████▋ | 28166/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.16.up_proj: 77%|███████▋ | 28167/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.16.down_proj: 77%|███████▋ | 28168/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.17.gate_proj: 77%|███████▋ | 28169/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.17.up_proj: 77%|███████▋ | 28170/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.17.down_proj: 77%|███████▋ | 28171/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.18.gate_proj: 77%|███████▋ | 28172/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.18.up_proj: 77%|███████▋ | 28173/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.18.down_proj: 77%|███████▋ | 28174/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.19.gate_proj: 77%|███████▋ | 28175/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.19.up_proj: 77%|███████▋ | 28176/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.19.down_proj: 77%|███████▋ | 28177/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.20.gate_proj: 77%|███████▋ | 28178/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.20.up_proj: 77%|███████▋ | 28179/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.20.down_proj: 77%|███████▋ | 28180/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.21.gate_proj: 77%|███████▋ | 28181/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.21.up_proj: 77%|███████▋ | 28182/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.21.down_proj: 77%|███████▋ | 28183/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.22.gate_proj: 77%|███████▋ | 28184/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.22.up_proj: 77%|███████▋ | 28185/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.22.down_proj: 77%|███████▋ | 28186/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.23.gate_proj: 77%|███████▋ | 28187/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.23.up_proj: 77%|███████▋ | 28188/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.23.down_proj: 77%|███████▋ | 28189/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.24.gate_proj: 77%|███████▋ | 28190/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.24.up_proj: 77%|███████▋ | 28191/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.24.down_proj: 77%|███████▋ | 28192/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.25.gate_proj: 77%|███████▋ | 28193/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.25.up_proj: 77%|███████▋ | 28194/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.25.down_proj: 77%|███████▋ | 28195/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.26.gate_proj: 77%|███████▋ | 28196/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.26.up_proj: 77%|███████▋ | 28197/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.26.down_proj: 77%|███████▋ | 28198/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.27.gate_proj: 77%|███████▋ | 28199/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.27.up_proj: 77%|███████▋ | 28200/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.27.down_proj: 77%|███████▋ | 28201/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.28.gate_proj: 77%|███████▋ | 28202/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.28.up_proj: 77%|███████▋ | 28203/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.28.down_proj: 77%|███████▋ | 28204/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.29.gate_proj: 77%|███████▋ | 28205/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.29.up_proj: 77%|███████▋ | 28206/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.29.down_proj: 77%|███████▋ | 28207/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.30.gate_proj: 77%|███████▋ | 28208/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.30.up_proj: 77%|███████▋ | 28209/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.30.down_proj: 77%|███████▋ | 28210/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.31.gate_proj: 77%|███████▋ | 28211/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.31.up_proj: 77%|███████▋ | 28212/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.31.down_proj: 77%|███████▋ | 28213/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.32.gate_proj: 77%|███████▋ | 28214/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.32.up_proj: 77%|███████▋ | 28215/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.32.down_proj: 77%|███████▋ | 28216/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.33.gate_proj: 77%|███████▋ | 28217/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.33.up_proj: 77%|███████▋ | 28218/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.33.down_proj: 77%|███████▋ | 28219/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.34.gate_proj: 77%|███████▋ | 28220/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.34.up_proj: 77%|███████▋ | 28221/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.34.down_proj: 77%|███████▋ | 28222/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.35.gate_proj: 77%|███████▋ | 28223/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.35.up_proj: 77%|███████▋ | 28224/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.35.down_proj: 77%|███████▋ | 28225/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.36.gate_proj: 77%|███████▋ | 28226/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.36.up_proj: 77%|███████▋ | 28227/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.36.down_proj: 77%|███████▋ | 28228/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.37.gate_proj: 77%|███████▋ | 28229/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.37.up_proj: 77%|███████▋ | 28230/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.37.down_proj: 77%|███████▋ | 28231/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.38.gate_proj: 77%|███████▋ | 28232/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.38.up_proj: 77%|███████▋ | 28233/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.38.down_proj: 77%|███████▋ | 28234/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.39.gate_proj: 77%|███████▋ | 28235/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.39.up_proj: 77%|███████▋ | 28236/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.39.down_proj: 77%|███████▋ | 28237/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.40.gate_proj: 77%|███████▋ | 28238/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.40.up_proj: 77%|███████▋ | 28239/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.40.down_proj: 77%|███████▋ | 28240/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.41.gate_proj: 77%|███████▋ | 28241/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.41.up_proj: 77%|███████▋ | 28242/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.41.down_proj: 77%|███████▋ | 28243/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.42.gate_proj: 77%|███████▋ | 28244/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.42.up_proj: 77%|███████▋ | 28245/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.42.down_proj: 77%|███████▋ | 28246/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.43.gate_proj: 77%|███████▋ | 28247/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.43.up_proj: 77%|███████▋ | 28248/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.43.down_proj: 77%|███████▋ | 28249/36566 [00:25<00:07, 1161.26it/s] packing model.layers.72.mlp.experts.43.down_proj: 77%|███████▋ | 28250/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.44.gate_proj: 77%|███████▋ | 28250/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.44.up_proj: 77%|███████▋ | 28251/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.44.down_proj: 77%|███████▋ | 28252/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.45.gate_proj: 77%|███████▋ | 28253/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.45.up_proj: 77%|███████▋ | 28254/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.45.down_proj: 77%|███████▋ | 28255/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.46.gate_proj: 77%|███████▋ | 28256/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.46.up_proj: 77%|███████▋ | 28257/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.46.down_proj: 77%|███████▋ | 28258/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.47.gate_proj: 77%|███████▋ | 28259/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.47.up_proj: 77%|███████▋ | 28260/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.47.down_proj: 77%|███████▋ | 28261/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.48.gate_proj: 77%|███████▋ | 28262/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.48.up_proj: 77%|███████▋ | 28263/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.48.down_proj: 77%|███████▋ | 28264/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.49.gate_proj: 77%|███████▋ | 28265/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.49.up_proj: 77%|███████▋ | 28266/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.49.down_proj: 77%|███████▋ | 28267/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.50.gate_proj: 77%|███████▋ | 28268/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.50.up_proj: 77%|███████▋ | 28269/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.50.down_proj: 77%|███████▋ | 28270/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.51.gate_proj: 77%|███████▋ | 28271/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.51.up_proj: 77%|███████▋ | 28272/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.51.down_proj: 77%|███████▋ | 28273/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.52.gate_proj: 77%|███████▋ | 28274/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.52.up_proj: 77%|███████▋ | 28275/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.52.down_proj: 77%|███████▋ | 28276/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.53.gate_proj: 77%|███████▋ | 28277/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.53.up_proj: 77%|███████▋ | 28278/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.53.down_proj: 77%|███████▋ | 28279/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.54.gate_proj: 77%|███████▋ | 28280/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.54.up_proj: 77%|███████▋ | 28281/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.54.down_proj: 77%|███████▋ | 28282/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.55.gate_proj: 77%|███████▋ | 28283/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.55.up_proj: 77%|███████▋ | 28284/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.55.down_proj: 77%|███████▋ | 28285/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.56.gate_proj: 77%|███████▋ | 28286/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.56.up_proj: 77%|███████▋ | 28287/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.56.down_proj: 77%|███████▋ | 28288/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.57.gate_proj: 77%|███████▋ | 28289/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.57.up_proj: 77%|███████▋ | 28290/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.57.down_proj: 77%|███████▋ | 28291/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.58.gate_proj: 77%|███████▋ | 28292/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.58.up_proj: 77%|███████▋ | 28293/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.58.down_proj: 77%|███████▋ | 28294/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.59.gate_proj: 77%|███████▋ | 28295/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.59.up_proj: 77%|███████▋ | 28296/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.59.down_proj: 77%|███████▋ | 28297/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.60.gate_proj: 77%|███████▋ | 28298/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.60.up_proj: 77%|███████▋ | 28299/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.60.down_proj: 77%|███████▋ | 28300/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.61.gate_proj: 77%|███████▋ | 28301/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.61.up_proj: 77%|███████▋ | 28302/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.61.down_proj: 77%|███████▋ | 28303/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.62.gate_proj: 77%|███████▋ | 28304/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.62.up_proj: 77%|███████▋ | 28305/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.62.down_proj: 77%|███████▋ | 28306/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.63.gate_proj: 77%|███████▋ | 28307/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.63.up_proj: 77%|███████▋ | 28308/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.63.down_proj: 77%|███████▋ | 28309/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.64.gate_proj: 77%|███████▋ | 28310/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.64.up_proj: 77%|███████▋ | 28311/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.64.down_proj: 77%|███████▋ | 28312/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.65.gate_proj: 77%|███████▋ | 28313/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.65.up_proj: 77%|███████▋ | 28314/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.65.down_proj: 77%|███████▋ | 28315/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.66.gate_proj: 77%|███████▋ | 28316/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.66.up_proj: 77%|███████▋ | 28317/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.66.down_proj: 77%|███████▋ | 28318/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.67.gate_proj: 77%|███████▋ | 28319/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.67.up_proj: 77%|███████▋ | 28320/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.67.down_proj: 77%|███████▋ | 28321/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.68.gate_proj: 77%|███████▋ | 28322/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.68.up_proj: 77%|███████▋ | 28323/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.68.down_proj: 77%|███████▋ | 28324/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.69.gate_proj: 77%|███████▋ | 28325/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.69.up_proj: 77%|███████▋ | 28326/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.69.down_proj: 77%|███████▋ | 28327/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.70.gate_proj: 77%|███████▋ | 28328/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.70.up_proj: 77%|███████▋ | 28329/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.70.down_proj: 77%|███████▋ | 28330/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.71.gate_proj: 77%|███████▋ | 28331/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.71.up_proj: 77%|███████▋ | 28332/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.71.down_proj: 77%|███████▋ | 28333/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.72.gate_proj: 77%|███████▋ | 28334/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.72.up_proj: 77%|███████▋ | 28335/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.72.down_proj: 77%|███████▋ | 28336/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.73.gate_proj: 77%|███████▋ | 28337/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.73.up_proj: 77%|███████▋ | 28338/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.73.down_proj: 78%|███████▊ | 28339/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.74.gate_proj: 78%|███████▊ | 28340/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.74.up_proj: 78%|███████▊ | 28341/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.74.down_proj: 78%|███████▊ | 28342/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.75.gate_proj: 78%|███████▊ | 28343/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.75.up_proj: 78%|███████▊ | 28344/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.75.down_proj: 78%|███████▊ | 28345/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.76.gate_proj: 78%|███████▊ | 28346/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.76.up_proj: 78%|███████▊ | 28347/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.76.down_proj: 78%|███████▊ | 28348/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.77.gate_proj: 78%|███████▊ | 28349/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.77.up_proj: 78%|███████▊ | 28350/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.77.down_proj: 78%|███████▊ | 28351/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.78.gate_proj: 78%|███████▊ | 28352/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.78.up_proj: 78%|███████▊ | 28353/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.78.down_proj: 78%|███████▊ | 28354/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.79.gate_proj: 78%|███████▊ | 28355/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.79.up_proj: 78%|███████▊ | 28356/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.79.down_proj: 78%|███████▊ | 28357/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.80.gate_proj: 78%|███████▊ | 28358/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.80.up_proj: 78%|███████▊ | 28359/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.80.down_proj: 78%|███████▊ | 28360/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.81.gate_proj: 78%|███████▊ | 28361/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.81.up_proj: 78%|███████▊ | 28362/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.81.down_proj: 78%|███████▊ | 28363/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.82.gate_proj: 78%|███████▊ | 28364/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.82.up_proj: 78%|███████▊ | 28365/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.82.down_proj: 78%|███████▊ | 28366/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.83.gate_proj: 78%|███████▊ | 28367/36566 [00:25<00:07, 1164.83it/s] packing model.layers.72.mlp.experts.83.gate_proj: 78%|███████▊ | 28368/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.83.up_proj: 78%|███████▊ | 28368/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.83.down_proj: 78%|███████▊ | 28369/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.84.gate_proj: 78%|███████▊ | 28370/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.84.up_proj: 78%|███████▊ | 28371/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.84.down_proj: 78%|███████▊ | 28372/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.85.gate_proj: 78%|███████▊ | 28373/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.85.up_proj: 78%|███████▊ | 28374/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.85.down_proj: 78%|███████▊ | 28375/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.86.gate_proj: 78%|███████▊ | 28376/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.86.up_proj: 78%|███████▊ | 28377/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.86.down_proj: 78%|███████▊ | 28378/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.87.gate_proj: 78%|███████▊ | 28379/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.87.up_proj: 78%|███████▊ | 28380/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.87.down_proj: 78%|███████▊ | 28381/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.88.gate_proj: 78%|███████▊ | 28382/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.88.up_proj: 78%|███████▊ | 28383/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.88.down_proj: 78%|███████▊ | 28384/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.89.gate_proj: 78%|███████▊ | 28385/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.89.up_proj: 78%|███████▊ | 28386/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.89.down_proj: 78%|███████▊ | 28387/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.90.gate_proj: 78%|███████▊ | 28388/36566 [00:25<00:07, 1168.28it/s] packing model.layers.72.mlp.experts.90.up_proj: 78%|███████▊ | 28389/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.90.down_proj: 78%|███████▊ | 28390/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.91.gate_proj: 78%|███████▊ | 28391/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.91.up_proj: 78%|███████▊ | 28392/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.91.down_proj: 78%|███████▊ | 28393/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.92.gate_proj: 78%|███████▊ | 28394/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.92.up_proj: 78%|███████▊ | 28395/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.92.down_proj: 78%|███████▊ | 28396/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.93.gate_proj: 78%|███████▊ | 28397/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.93.up_proj: 78%|███████▊ | 28398/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.93.down_proj: 78%|███████▊ | 28399/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.94.gate_proj: 78%|███████▊ | 28400/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.94.up_proj: 78%|███████▊ | 28401/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.94.down_proj: 78%|███████▊ | 28402/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.95.gate_proj: 78%|███████▊ | 28403/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.95.up_proj: 78%|███████▊ | 28404/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.95.down_proj: 78%|███████▊ | 28405/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.96.gate_proj: 78%|███████▊ | 28406/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.96.up_proj: 78%|███████▊ | 28407/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.96.down_proj: 78%|███████▊ | 28408/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.97.gate_proj: 78%|███████▊ | 28409/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.97.up_proj: 78%|███████▊ | 28410/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.97.down_proj: 78%|███████▊ | 28411/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.98.gate_proj: 78%|███████▊ | 28412/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.98.up_proj: 78%|███████▊ | 28413/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.98.down_proj: 78%|███████▊ | 28414/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.99.gate_proj: 78%|███████▊ | 28415/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.99.up_proj: 78%|███████▊ | 28416/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.99.down_proj: 78%|███████▊ | 28417/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.100.gate_proj: 78%|███████▊ | 28418/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.100.up_proj: 78%|███████▊ | 28419/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.100.down_proj: 78%|███████▊ | 28420/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.101.gate_proj: 78%|███████▊ | 28421/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.101.up_proj: 78%|███████▊ | 28422/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.101.down_proj: 78%|███████▊ | 28423/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.102.gate_proj: 78%|███████▊ | 28424/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.102.up_proj: 78%|███████▊ | 28425/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.102.down_proj: 78%|███████▊ | 28426/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.103.gate_proj: 78%|███████▊ | 28427/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.103.up_proj: 78%|███████▊ | 28428/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.103.down_proj: 78%|███████▊ | 28429/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.104.gate_proj: 78%|███████▊ | 28430/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.104.up_proj: 78%|███████▊ | 28431/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.104.down_proj: 78%|███████▊ | 28432/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.105.gate_proj: 78%|███████▊ | 28433/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.105.up_proj: 78%|███████▊ | 28434/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.105.down_proj: 78%|███████▊ | 28435/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.106.gate_proj: 78%|███████▊ | 28436/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.106.up_proj: 78%|███████▊ | 28437/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.106.down_proj: 78%|███████▊ | 28438/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.107.gate_proj: 78%|███████▊ | 28439/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.107.up_proj: 78%|███████▊ | 28440/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.107.down_proj: 78%|███████▊ | 28441/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.108.gate_proj: 78%|███████▊ | 28442/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.108.up_proj: 78%|███████▊ | 28443/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.108.down_proj: 78%|███████▊ | 28444/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.109.gate_proj: 78%|███████▊ | 28445/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.109.up_proj: 78%|███████▊ | 28446/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.109.down_proj: 78%|███████▊ | 28447/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.110.gate_proj: 78%|███████▊ | 28448/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.110.up_proj: 78%|███████▊ | 28449/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.110.down_proj: 78%|███████▊ | 28450/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.111.gate_proj: 78%|███████▊ | 28451/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.111.up_proj: 78%|███████▊ | 28452/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.111.down_proj: 78%|███████▊ | 28453/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.112.gate_proj: 78%|███████▊ | 28454/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.112.up_proj: 78%|███████▊ | 28455/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.112.down_proj: 78%|███████▊ | 28456/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.113.gate_proj: 78%|███████▊ | 28457/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.113.up_proj: 78%|███████▊ | 28458/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.113.down_proj: 78%|███████▊ | 28459/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.114.gate_proj: 78%|███████▊ | 28460/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.114.up_proj: 78%|███████▊ | 28461/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.114.down_proj: 78%|███████▊ | 28462/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.115.gate_proj: 78%|███████▊ | 28463/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.115.up_proj: 78%|███████▊ | 28464/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.115.down_proj: 78%|███████▊ | 28465/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.116.gate_proj: 78%|███████▊ | 28466/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.116.up_proj: 78%|███████▊ | 28467/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.116.down_proj: 78%|███████▊ | 28468/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.117.gate_proj: 78%|███████▊ | 28469/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.117.up_proj: 78%|███████▊ | 28470/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.117.down_proj: 78%|███████▊ | 28471/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.118.gate_proj: 78%|███████▊ | 28472/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.118.up_proj: 78%|███████▊ | 28473/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.118.down_proj: 78%|███████▊ | 28474/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.119.gate_proj: 78%|███████▊ | 28475/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.119.up_proj: 78%|███████▊ | 28476/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.119.down_proj: 78%|███████▊ | 28477/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.120.gate_proj: 78%|███████▊ | 28478/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.120.up_proj: 78%|███████▊ | 28479/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.120.down_proj: 78%|███████▊ | 28480/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.121.gate_proj: 78%|███████▊ | 28481/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.121.up_proj: 78%|███████▊ | 28482/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.121.down_proj: 78%|███████▊ | 28483/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.122.gate_proj: 78%|███████▊ | 28484/36566 [00:25<00:06, 1168.28it/s] packing model.layers.72.mlp.experts.122.gate_proj: 78%|███████▊ | 28485/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.122.up_proj: 78%|███████▊ | 28485/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.122.down_proj: 78%|███████▊ | 28486/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.123.gate_proj: 78%|███████▊ | 28487/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.123.up_proj: 78%|███████▊ | 28488/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.123.down_proj: 78%|███████▊ | 28489/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.124.gate_proj: 78%|███████▊ | 28490/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.124.up_proj: 78%|███████▊ | 28491/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.124.down_proj: 78%|███████▊ | 28492/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.125.gate_proj: 78%|███████▊ | 28493/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.125.up_proj: 78%|███████▊ | 28494/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.125.down_proj: 78%|███████▊ | 28495/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.126.gate_proj: 78%|███████▊ | 28496/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.126.up_proj: 78%|███████▊ | 28497/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.126.down_proj: 78%|███████▊ | 28498/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.127.gate_proj: 78%|███████▊ | 28499/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.127.up_proj: 78%|███████▊ | 28500/36566 [00:25<00:06, 1168.39it/s] packing model.layers.72.mlp.experts.127.down_proj: 78%|███████▊ | 28501/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.0.gate_proj: 78%|███████▊ | 28502/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.0.up_proj: 78%|███████▊ | 28503/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.0.down_proj: 78%|███████▊ | 28504/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.1.gate_proj: 78%|███████▊ | 28505/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.1.up_proj: 78%|███████▊ | 28506/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.1.down_proj: 78%|███████▊ | 28507/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.2.gate_proj: 78%|███████▊ | 28508/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.2.up_proj: 78%|███████▊ | 28509/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.2.down_proj: 78%|███████▊ | 28510/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.3.gate_proj: 78%|███████▊ | 28511/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.3.up_proj: 78%|███████▊ | 28512/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.3.down_proj: 78%|███████▊ | 28513/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.4.gate_proj: 78%|███████▊ | 28514/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.4.up_proj: 78%|███████▊ | 28515/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.4.down_proj: 78%|███████▊ | 28516/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.5.gate_proj: 78%|███████▊ | 28517/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.5.up_proj: 78%|███████▊ | 28518/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.5.down_proj: 78%|███████▊ | 28519/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.6.gate_proj: 78%|███████▊ | 28520/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.6.up_proj: 78%|███████▊ | 28521/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.6.down_proj: 78%|███████▊ | 28522/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.7.gate_proj: 78%|███████▊ | 28523/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.7.up_proj: 78%|███████▊ | 28524/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.7.down_proj: 78%|███████▊ | 28525/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.8.gate_proj: 78%|███████▊ | 28526/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.8.up_proj: 78%|███████▊ | 28527/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.8.down_proj: 78%|███████▊ | 28528/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.9.gate_proj: 78%|███████▊ | 28529/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.9.up_proj: 78%|███████▊ | 28530/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.9.down_proj: 78%|███████▊ | 28531/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.10.gate_proj: 78%|███████▊ | 28532/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.10.up_proj: 78%|███████▊ | 28533/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.10.down_proj: 78%|███████▊ | 28534/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.11.gate_proj: 78%|███████▊ | 28535/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.11.up_proj: 78%|███████▊ | 28536/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.11.down_proj: 78%|███████▊ | 28537/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.12.gate_proj: 78%|███████▊ | 28538/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.12.up_proj: 78%|███████▊ | 28539/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.12.down_proj: 78%|███████▊ | 28540/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.13.gate_proj: 78%|███████▊ | 28541/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.13.up_proj: 78%|███████▊ | 28542/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.13.down_proj: 78%|███████▊ | 28543/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.14.gate_proj: 78%|███████▊ | 28544/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.14.up_proj: 78%|███████▊ | 28545/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.14.down_proj: 78%|███████▊ | 28546/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.15.gate_proj: 78%|███████▊ | 28547/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.15.up_proj: 78%|███████▊ | 28548/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.15.down_proj: 78%|███████▊ | 28549/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.16.gate_proj: 78%|███████▊ | 28550/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.16.up_proj: 78%|███████▊ | 28551/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.16.down_proj: 78%|███████▊ | 28552/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.17.gate_proj: 78%|███████▊ | 28553/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.17.up_proj: 78%|███████▊ | 28554/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.17.down_proj: 78%|███████▊ | 28555/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.18.gate_proj: 78%|███████▊ | 28556/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.18.up_proj: 78%|███████▊ | 28557/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.18.down_proj: 78%|███████▊ | 28558/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.19.gate_proj: 78%|███████▊ | 28559/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.19.up_proj: 78%|███████▊ | 28560/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.19.down_proj: 78%|███████▊ | 28561/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.20.gate_proj: 78%|███████▊ | 28562/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.20.up_proj: 78%|███████▊ | 28563/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.20.down_proj: 78%|███████▊ | 28564/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.21.gate_proj: 78%|███████▊ | 28565/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.21.up_proj: 78%|███████▊ | 28566/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.21.down_proj: 78%|███████▊ | 28567/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.22.gate_proj: 78%|███████▊ | 28568/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.22.up_proj: 78%|███████▊ | 28569/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.22.down_proj: 78%|███████▊ | 28570/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.23.gate_proj: 78%|███████▊ | 28571/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.23.up_proj: 78%|███████▊ | 28572/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.23.down_proj: 78%|███████▊ | 28573/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.24.gate_proj: 78%|███████▊ | 28574/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.24.up_proj: 78%|███████▊ | 28575/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.24.down_proj: 78%|███████▊ | 28576/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.25.gate_proj: 78%|███████▊ | 28577/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.25.up_proj: 78%|███████▊ | 28578/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.25.down_proj: 78%|███████▊ | 28579/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.26.gate_proj: 78%|███████▊ | 28580/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.26.up_proj: 78%|███████▊ | 28581/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.26.down_proj: 78%|███████▊ | 28582/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.27.gate_proj: 78%|███████▊ | 28583/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.27.up_proj: 78%|███████▊ | 28584/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.27.down_proj: 78%|███████▊ | 28585/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.28.gate_proj: 78%|███████▊ | 28586/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.28.up_proj: 78%|███████▊ | 28587/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.28.down_proj: 78%|███████▊ | 28588/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.29.gate_proj: 78%|███████▊ | 28589/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.29.up_proj: 78%|███████▊ | 28590/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.29.down_proj: 78%|███████▊ | 28591/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.30.gate_proj: 78%|███████▊ | 28592/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.30.up_proj: 78%|███████▊ | 28593/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.30.down_proj: 78%|███████▊ | 28594/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.31.gate_proj: 78%|███████▊ | 28595/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.31.up_proj: 78%|███████▊ | 28596/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.31.down_proj: 78%|███████▊ | 28597/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.32.gate_proj: 78%|███████▊ | 28598/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.32.up_proj: 78%|███████▊ | 28599/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.32.down_proj: 78%|███████▊ | 28600/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.33.gate_proj: 78%|███████▊ | 28601/36566 [00:25<00:06, 1168.39it/s] packing model.layers.73.mlp.experts.33.gate_proj: 78%|███████▊ | 28602/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.33.up_proj: 78%|███████▊ | 28602/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.33.down_proj: 78%|███████▊ | 28603/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.34.gate_proj: 78%|███████▊ | 28604/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.34.up_proj: 78%|███████▊ | 28605/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.34.down_proj: 78%|███████▊ | 28606/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.35.gate_proj: 78%|███████▊ | 28607/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.35.up_proj: 78%|███████▊ | 28608/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.35.down_proj: 78%|███████▊ | 28609/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.36.gate_proj: 78%|███████▊ | 28610/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.36.up_proj: 78%|███████▊ | 28611/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.36.down_proj: 78%|███████▊ | 28612/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.37.gate_proj: 78%|███████▊ | 28613/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.37.up_proj: 78%|███████▊ | 28614/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.37.down_proj: 78%|███████▊ | 28615/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.38.gate_proj: 78%|███████▊ | 28616/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.38.up_proj: 78%|███████▊ | 28617/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.38.down_proj: 78%|███████▊ | 28618/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.39.gate_proj: 78%|███████▊ | 28619/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.39.up_proj: 78%|███████▊ | 28620/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.39.down_proj: 78%|███████▊ | 28621/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.40.gate_proj: 78%|███████▊ | 28622/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.40.up_proj: 78%|███████▊ | 28623/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.40.down_proj: 78%|███████▊ | 28624/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.41.gate_proj: 78%|███████▊ | 28625/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.41.up_proj: 78%|███████▊ | 28626/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.41.down_proj: 78%|███████▊ | 28627/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.42.gate_proj: 78%|███████▊ | 28628/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.42.up_proj: 78%|███████▊ | 28629/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.42.down_proj: 78%|███████▊ | 28630/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.43.gate_proj: 78%|███████▊ | 28631/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.43.up_proj: 78%|███████▊ | 28632/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.43.down_proj: 78%|███████▊ | 28633/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.44.gate_proj: 78%|███████▊ | 28634/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.44.up_proj: 78%|███████▊ | 28635/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.44.down_proj: 78%|███████▊ | 28636/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.45.gate_proj: 78%|███████▊ | 28637/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.45.up_proj: 78%|███████▊ | 28638/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.45.down_proj: 78%|███████▊ | 28639/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.46.gate_proj: 78%|███████▊ | 28640/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.46.up_proj: 78%|███████▊ | 28641/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.46.down_proj: 78%|███████▊ | 28642/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.47.gate_proj: 78%|███████▊ | 28643/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.47.up_proj: 78%|███████▊ | 28644/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.47.down_proj: 78%|███████▊ | 28645/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.48.gate_proj: 78%|███████▊ | 28646/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.48.up_proj: 78%|███████▊ | 28647/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.48.down_proj: 78%|███████▊ | 28648/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.49.gate_proj: 78%|███████▊ | 28649/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.49.up_proj: 78%|███████▊ | 28650/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.49.down_proj: 78%|███████▊ | 28651/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.50.gate_proj: 78%|███████▊ | 28652/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.50.up_proj: 78%|███████▊ | 28653/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.50.down_proj: 78%|███████▊ | 28654/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.51.gate_proj: 78%|███████▊ | 28655/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.51.up_proj: 78%|███████▊ | 28656/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.51.down_proj: 78%|███████▊ | 28657/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.52.gate_proj: 78%|███████▊ | 28658/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.52.up_proj: 78%|███████▊ | 28659/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.52.down_proj: 78%|███████▊ | 28660/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.53.gate_proj: 78%|███████▊ | 28661/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.53.up_proj: 78%|███████▊ | 28662/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.53.down_proj: 78%|███████▊ | 28663/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.54.gate_proj: 78%|███████▊ | 28664/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.54.up_proj: 78%|███████▊ | 28665/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.54.down_proj: 78%|███████▊ | 28666/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.55.gate_proj: 78%|███████▊ | 28667/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.55.up_proj: 78%|███████▊ | 28668/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.55.down_proj: 78%|███████▊ | 28669/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.56.gate_proj: 78%|███████▊ | 28670/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.56.up_proj: 78%|███████▊ | 28671/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.56.down_proj: 78%|███████▊ | 28672/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.57.gate_proj: 78%|███████▊ | 28673/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.57.up_proj: 78%|███████▊ | 28674/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.57.down_proj: 78%|███████▊ | 28675/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.58.gate_proj: 78%|███████▊ | 28676/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.58.up_proj: 78%|███████▊ | 28677/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.58.down_proj: 78%|███████▊ | 28678/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.59.gate_proj: 78%|███████▊ | 28679/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.59.up_proj: 78%|███████▊ | 28680/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.59.down_proj: 78%|███████▊ | 28681/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.60.gate_proj: 78%|███████▊ | 28682/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.60.up_proj: 78%|███████▊ | 28683/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.60.down_proj: 78%|███████▊ | 28684/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.61.gate_proj: 78%|███████▊ | 28685/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.61.up_proj: 78%|███████▊ | 28686/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.61.down_proj: 78%|███████▊ | 28687/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.62.gate_proj: 78%|███████▊ | 28688/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.62.up_proj: 78%|███████▊ | 28689/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.62.down_proj: 78%|███████▊ | 28690/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.63.gate_proj: 78%|███████▊ | 28691/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.63.up_proj: 78%|███████▊ | 28692/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.63.down_proj: 78%|███████▊ | 28693/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.64.gate_proj: 78%|███████▊ | 28694/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.64.up_proj: 78%|███████▊ | 28695/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.64.down_proj: 78%|███████▊ | 28696/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.65.gate_proj: 78%|███████▊ | 28697/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.65.up_proj: 78%|███████▊ | 28698/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.65.down_proj: 78%|███████▊ | 28699/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.66.gate_proj: 78%|███████▊ | 28700/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.66.up_proj: 78%|███████▊ | 28701/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.66.down_proj: 78%|███████▊ | 28702/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.67.gate_proj: 78%|███████▊ | 28703/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.67.up_proj: 78%|███████▊ | 28704/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.67.down_proj: 79%|███████▊ | 28705/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.68.gate_proj: 79%|███████▊ | 28706/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.68.up_proj: 79%|███████▊ | 28707/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.68.down_proj: 79%|███████▊ | 28708/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.69.gate_proj: 79%|███████▊ | 28709/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.69.up_proj: 79%|███████▊ | 28710/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.69.down_proj: 79%|███████▊ | 28711/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.70.gate_proj: 79%|███████▊ | 28712/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.70.up_proj: 79%|███████▊ | 28713/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.70.down_proj: 79%|███████▊ | 28714/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.71.gate_proj: 79%|███████▊ | 28715/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.71.up_proj: 79%|███████▊ | 28716/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.71.down_proj: 79%|███████▊ | 28717/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.72.gate_proj: 79%|███████▊ | 28718/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.72.up_proj: 79%|███████▊ | 28719/36566 [00:25<00:06, 1167.03it/s] packing model.layers.73.mlp.experts.72.up_proj: 79%|███████▊ | 28720/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.72.down_proj: 79%|███████▊ | 28720/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.73.gate_proj: 79%|███████▊ | 28721/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.73.up_proj: 79%|███████▊ | 28722/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.73.down_proj: 79%|███████▊ | 28723/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.74.gate_proj: 79%|███████▊ | 28724/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.74.up_proj: 79%|███████▊ | 28725/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.74.down_proj: 79%|███████▊ | 28726/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.75.gate_proj: 79%|███████▊ | 28727/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.75.up_proj: 79%|███████▊ | 28728/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.75.down_proj: 79%|███████▊ | 28729/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.76.gate_proj: 79%|███████▊ | 28730/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.76.up_proj: 79%|███████▊ | 28731/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.76.down_proj: 79%|███████▊ | 28732/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.77.gate_proj: 79%|███████▊ | 28733/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.77.up_proj: 79%|███████▊ | 28734/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.77.down_proj: 79%|███████▊ | 28735/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.78.gate_proj: 79%|███████▊ | 28736/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.78.up_proj: 79%|███████▊ | 28737/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.78.down_proj: 79%|███████▊ | 28738/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.79.gate_proj: 79%|███████▊ | 28739/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.79.up_proj: 79%|███████▊ | 28740/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.79.down_proj: 79%|███████▊ | 28741/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.80.gate_proj: 79%|███████▊ | 28742/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.80.up_proj: 79%|███████▊ | 28743/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.80.down_proj: 79%|███████▊ | 28744/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.81.gate_proj: 79%|███████▊ | 28745/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.81.up_proj: 79%|███████▊ | 28746/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.81.down_proj: 79%|███████▊ | 28747/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.82.gate_proj: 79%|███████▊ | 28748/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.82.up_proj: 79%|███████▊ | 28749/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.82.down_proj: 79%|███████▊ | 28750/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.83.gate_proj: 79%|███████▊ | 28751/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.83.up_proj: 79%|███████▊ | 28752/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.83.down_proj: 79%|███████▊ | 28753/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.84.gate_proj: 79%|███████▊ | 28754/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.84.up_proj: 79%|███████▊ | 28755/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.84.down_proj: 79%|███████▊ | 28756/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.85.gate_proj: 79%|███████▊ | 28757/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.85.up_proj: 79%|███████▊ | 28758/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.85.down_proj: 79%|███████▊ | 28759/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.86.gate_proj: 79%|███████▊ | 28760/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.86.up_proj: 79%|███████▊ | 28761/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.86.down_proj: 79%|███████▊ | 28762/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.87.gate_proj: 79%|███████▊ | 28763/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.87.up_proj: 79%|███████▊ | 28764/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.87.down_proj: 79%|███████▊ | 28765/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.88.gate_proj: 79%|███████▊ | 28766/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.88.up_proj: 79%|███████▊ | 28767/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.88.down_proj: 79%|███████▊ | 28768/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.89.gate_proj: 79%|███████▊ | 28769/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.89.up_proj: 79%|███████▊ | 28770/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.89.down_proj: 79%|███████▊ | 28771/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.90.gate_proj: 79%|███████▊ | 28772/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.90.up_proj: 79%|███████▊ | 28773/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.90.down_proj: 79%|███████▊ | 28774/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.91.gate_proj: 79%|███████▊ | 28775/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.91.up_proj: 79%|███████▊ | 28776/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.91.down_proj: 79%|███████▊ | 28777/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.92.gate_proj: 79%|███████▊ | 28778/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.92.up_proj: 79%|███████▊ | 28779/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.92.down_proj: 79%|███████▊ | 28780/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.93.gate_proj: 79%|███████▊ | 28781/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.93.up_proj: 79%|███████▊ | 28782/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.93.down_proj: 79%|███████▊ | 28783/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.94.gate_proj: 79%|███████▊ | 28784/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.94.up_proj: 79%|███████▊ | 28785/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.94.down_proj: 79%|███████▊ | 28786/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.95.gate_proj: 79%|███████▊ | 28787/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.95.up_proj: 79%|███████▊ | 28788/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.95.down_proj: 79%|███████▊ | 28789/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.96.gate_proj: 79%|███████▊ | 28790/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.96.up_proj: 79%|███████▊ | 28791/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.96.down_proj: 79%|███████▊ | 28792/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.97.gate_proj: 79%|███████▊ | 28793/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.97.up_proj: 79%|███████▊ | 28794/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.97.down_proj: 79%|███████▊ | 28795/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.98.gate_proj: 79%|███████▉ | 28796/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.98.up_proj: 79%|███████▉ | 28797/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.98.down_proj: 79%|███████▉ | 28798/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.99.gate_proj: 79%|███████▉ | 28799/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.99.up_proj: 79%|███████▉ | 28800/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.99.down_proj: 79%|███████▉ | 28801/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.100.gate_proj: 79%|███████▉ | 28802/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.100.up_proj: 79%|███████▉ | 28803/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.100.down_proj: 79%|███████▉ | 28804/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.101.gate_proj: 79%|███████▉ | 28805/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.101.up_proj: 79%|███████▉ | 28806/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.101.down_proj: 79%|███████▉ | 28807/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.102.gate_proj: 79%|███████▉ | 28808/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.102.up_proj: 79%|███████▉ | 28809/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.102.down_proj: 79%|███████▉ | 28810/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.103.gate_proj: 79%|███████▉ | 28811/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.103.up_proj: 79%|███████▉ | 28812/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.103.down_proj: 79%|███████▉ | 28813/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.104.gate_proj: 79%|███████▉ | 28814/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.104.up_proj: 79%|███████▉ | 28815/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.104.down_proj: 79%|███████▉ | 28816/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.105.gate_proj: 79%|███████▉ | 28817/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.105.up_proj: 79%|███████▉ | 28818/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.105.down_proj: 79%|███████▉ | 28819/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.106.gate_proj: 79%|███████▉ | 28820/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.106.up_proj: 79%|███████▉ | 28821/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.106.down_proj: 79%|███████▉ | 28822/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.107.gate_proj: 79%|███████▉ | 28823/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.107.up_proj: 79%|███████▉ | 28824/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.107.down_proj: 79%|███████▉ | 28825/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.108.gate_proj: 79%|███████▉ | 28826/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.108.up_proj: 79%|███████▉ | 28827/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.108.down_proj: 79%|███████▉ | 28828/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.109.gate_proj: 79%|███████▉ | 28829/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.109.up_proj: 79%|███████▉ | 28830/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.109.down_proj: 79%|███████▉ | 28831/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.110.gate_proj: 79%|███████▉ | 28832/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.110.up_proj: 79%|███████▉ | 28833/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.110.down_proj: 79%|███████▉ | 28834/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.111.gate_proj: 79%|███████▉ | 28835/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.111.up_proj: 79%|███████▉ | 28836/36566 [00:25<00:06, 1168.33it/s] packing model.layers.73.mlp.experts.111.up_proj: 79%|███████▉ | 28837/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.111.down_proj: 79%|███████▉ | 28837/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.112.gate_proj: 79%|███████▉ | 28838/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.112.up_proj: 79%|███████▉ | 28839/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.112.down_proj: 79%|███████▉ | 28840/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.113.gate_proj: 79%|███████▉ | 28841/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.113.up_proj: 79%|███████▉ | 28842/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.113.down_proj: 79%|███████▉ | 28843/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.114.gate_proj: 79%|███████▉ | 28844/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.114.up_proj: 79%|███████▉ | 28845/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.114.down_proj: 79%|███████▉ | 28846/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.115.gate_proj: 79%|███████▉ | 28847/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.115.up_proj: 79%|███████▉ | 28848/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.115.down_proj: 79%|███████▉ | 28849/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.116.gate_proj: 79%|███████▉ | 28850/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.116.up_proj: 79%|███████▉ | 28851/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.116.down_proj: 79%|███████▉ | 28852/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.117.gate_proj: 79%|███████▉ | 28853/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.117.up_proj: 79%|███████▉ | 28854/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.117.down_proj: 79%|███████▉ | 28855/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.118.gate_proj: 79%|███████▉ | 28856/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.118.up_proj: 79%|███████▉ | 28857/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.118.down_proj: 79%|███████▉ | 28858/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.119.gate_proj: 79%|███████▉ | 28859/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.119.up_proj: 79%|███████▉ | 28860/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.119.down_proj: 79%|███████▉ | 28861/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.120.gate_proj: 79%|███████▉ | 28862/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.120.up_proj: 79%|███████▉ | 28863/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.120.down_proj: 79%|███████▉ | 28864/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.121.gate_proj: 79%|███████▉ | 28865/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.121.up_proj: 79%|███████▉ | 28866/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.121.down_proj: 79%|███████▉ | 28867/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.122.gate_proj: 79%|███████▉ | 28868/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.122.up_proj: 79%|███████▉ | 28869/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.122.down_proj: 79%|███████▉ | 28870/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.123.gate_proj: 79%|███████▉ | 28871/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.123.up_proj: 79%|███████▉ | 28872/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.123.down_proj: 79%|███████▉ | 28873/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.124.gate_proj: 79%|███████▉ | 28874/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.124.up_proj: 79%|███████▉ | 28875/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.124.down_proj: 79%|███████▉ | 28876/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.125.gate_proj: 79%|███████▉ | 28877/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.125.up_proj: 79%|███████▉ | 28878/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.125.down_proj: 79%|███████▉ | 28879/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.126.gate_proj: 79%|███████▉ | 28880/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.126.up_proj: 79%|███████▉ | 28881/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.126.down_proj: 79%|███████▉ | 28882/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.127.gate_proj: 79%|███████▉ | 28883/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.127.up_proj: 79%|███████▉ | 28884/36566 [00:25<00:06, 1168.57it/s] packing model.layers.73.mlp.experts.127.down_proj: 79%|███████▉ | 28885/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.0.gate_proj: 79%|███████▉ | 28886/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.0.up_proj: 79%|███████▉ | 28887/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.0.down_proj: 79%|███████▉ | 28888/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.1.gate_proj: 79%|███████▉ | 28889/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.1.up_proj: 79%|███████▉ | 28890/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.1.down_proj: 79%|███████▉ | 28891/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.2.gate_proj: 79%|███████▉ | 28892/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.2.up_proj: 79%|███████▉ | 28893/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.2.down_proj: 79%|███████▉ | 28894/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.3.gate_proj: 79%|███████▉ | 28895/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.3.up_proj: 79%|███████▉ | 28896/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.3.down_proj: 79%|███████▉ | 28897/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.4.gate_proj: 79%|███████▉ | 28898/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.4.up_proj: 79%|███████▉ | 28899/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.4.down_proj: 79%|███████▉ | 28900/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.5.gate_proj: 79%|███████▉ | 28901/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.5.up_proj: 79%|███████▉ | 28902/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.5.down_proj: 79%|███████▉ | 28903/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.6.gate_proj: 79%|███████▉ | 28904/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.6.up_proj: 79%|███████▉ | 28905/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.6.down_proj: 79%|███████▉ | 28906/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.7.gate_proj: 79%|███████▉ | 28907/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.7.up_proj: 79%|███████▉ | 28908/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.7.down_proj: 79%|███████▉ | 28909/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.8.gate_proj: 79%|███████▉ | 28910/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.8.up_proj: 79%|███████▉ | 28911/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.8.down_proj: 79%|███████▉ | 28912/36566 [00:25<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.9.gate_proj: 79%|███████▉ | 28913/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.9.up_proj: 79%|███████▉ | 28914/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.9.down_proj: 79%|███████▉ | 28915/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.10.gate_proj: 79%|███████▉ | 28916/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.10.up_proj: 79%|███████▉ | 28917/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.10.down_proj: 79%|███████▉ | 28918/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.11.gate_proj: 79%|███████▉ | 28919/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.11.up_proj: 79%|███████▉ | 28920/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.11.down_proj: 79%|███████▉ | 28921/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.12.gate_proj: 79%|███████▉ | 28922/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.12.up_proj: 79%|███████▉ | 28923/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.12.down_proj: 79%|███████▉ | 28924/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.13.gate_proj: 79%|███████▉ | 28925/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.13.up_proj: 79%|███████▉ | 28926/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.13.down_proj: 79%|███████▉ | 28927/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.14.gate_proj: 79%|███████▉ | 28928/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.14.up_proj: 79%|███████▉ | 28929/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.14.down_proj: 79%|███████▉ | 28930/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.15.gate_proj: 79%|███████▉ | 28931/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.15.up_proj: 79%|███████▉ | 28932/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.15.down_proj: 79%|███████▉ | 28933/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.16.gate_proj: 79%|███████▉ | 28934/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.16.up_proj: 79%|███████▉ | 28935/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.16.down_proj: 79%|███████▉ | 28936/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.17.gate_proj: 79%|███████▉ | 28937/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.17.up_proj: 79%|███████▉ | 28938/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.17.down_proj: 79%|███████▉ | 28939/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.18.gate_proj: 79%|███████▉ | 28940/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.18.up_proj: 79%|███████▉ | 28941/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.18.down_proj: 79%|███████▉ | 28942/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.19.gate_proj: 79%|███████▉ | 28943/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.19.up_proj: 79%|███████▉ | 28944/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.19.down_proj: 79%|███████▉ | 28945/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.20.gate_proj: 79%|███████▉ | 28946/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.20.up_proj: 79%|███████▉ | 28947/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.20.down_proj: 79%|███████▉ | 28948/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.21.gate_proj: 79%|███████▉ | 28949/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.21.up_proj: 79%|███████▉ | 28950/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.21.down_proj: 79%|███████▉ | 28951/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.22.gate_proj: 79%|███████▉ | 28952/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.22.up_proj: 79%|███████▉ | 28953/36566 [00:26<00:06, 1168.57it/s] packing model.layers.74.mlp.experts.22.up_proj: 79%|███████▉ | 28954/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.22.down_proj: 79%|███████▉ | 28954/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.23.gate_proj: 79%|███████▉ | 28955/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.23.up_proj: 79%|███████▉ | 28956/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.23.down_proj: 79%|███████▉ | 28957/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.24.gate_proj: 79%|███████▉ | 28958/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.24.up_proj: 79%|███████▉ | 28959/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.24.down_proj: 79%|███████▉ | 28960/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.25.gate_proj: 79%|███████▉ | 28961/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.25.up_proj: 79%|███████▉ | 28962/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.25.down_proj: 79%|███████▉ | 28963/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.26.gate_proj: 79%|███████▉ | 28964/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.26.up_proj: 79%|███████▉ | 28965/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.26.down_proj: 79%|███████▉ | 28966/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.27.gate_proj: 79%|███████▉ | 28967/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.27.up_proj: 79%|███████▉ | 28968/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.27.down_proj: 79%|███████▉ | 28969/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.28.gate_proj: 79%|███████▉ | 28970/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.28.up_proj: 79%|███████▉ | 28971/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.28.down_proj: 79%|███████▉ | 28972/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.29.gate_proj: 79%|███████▉ | 28973/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.29.up_proj: 79%|███████▉ | 28974/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.29.down_proj: 79%|███████▉ | 28975/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.30.gate_proj: 79%|███████▉ | 28976/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.30.up_proj: 79%|███████▉ | 28977/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.30.down_proj: 79%|███████▉ | 28978/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.31.gate_proj: 79%|███████▉ | 28979/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.31.up_proj: 79%|███████▉ | 28980/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.31.down_proj: 79%|███████▉ | 28981/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.32.gate_proj: 79%|███████▉ | 28982/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.32.up_proj: 79%|███████▉ | 28983/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.32.down_proj: 79%|███████▉ | 28984/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.33.gate_proj: 79%|███████▉ | 28985/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.33.up_proj: 79%|███████▉ | 28986/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.33.down_proj: 79%|███████▉ | 28987/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.34.gate_proj: 79%|███████▉ | 28988/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.34.up_proj: 79%|███████▉ | 28989/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.34.down_proj: 79%|███████▉ | 28990/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.35.gate_proj: 79%|███████▉ | 28991/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.35.up_proj: 79%|███████▉ | 28992/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.35.down_proj: 79%|███████▉ | 28993/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.36.gate_proj: 79%|███████▉ | 28994/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.36.up_proj: 79%|███████▉ | 28995/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.36.down_proj: 79%|███████▉ | 28996/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.37.gate_proj: 79%|███████▉ | 28997/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.37.up_proj: 79%|███████▉ | 28998/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.37.down_proj: 79%|███████▉ | 28999/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.38.gate_proj: 79%|███████▉ | 29000/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.38.up_proj: 79%|███████▉ | 29001/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.38.down_proj: 79%|███████▉ | 29002/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.39.gate_proj: 79%|███████▉ | 29003/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.39.up_proj: 79%|███████▉ | 29004/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.39.down_proj: 79%|███████▉ | 29005/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.40.gate_proj: 79%|███████▉ | 29006/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.40.up_proj: 79%|███████▉ | 29007/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.40.down_proj: 79%|███████▉ | 29008/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.41.gate_proj: 79%|███████▉ | 29009/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.41.up_proj: 79%|███████▉ | 29010/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.41.down_proj: 79%|███████▉ | 29011/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.42.gate_proj: 79%|███████▉ | 29012/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.42.up_proj: 79%|███████▉ | 29013/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.42.down_proj: 79%|███████▉ | 29014/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.43.gate_proj: 79%|███████▉ | 29015/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.43.up_proj: 79%|███████▉ | 29016/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.43.down_proj: 79%|███████▉ | 29017/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.44.gate_proj: 79%|███████▉ | 29018/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.44.up_proj: 79%|███████▉ | 29019/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.44.down_proj: 79%|███████▉ | 29020/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.45.gate_proj: 79%|███████▉ | 29021/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.45.up_proj: 79%|███████▉ | 29022/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.45.down_proj: 79%|███████▉ | 29023/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.46.gate_proj: 79%|███████▉ | 29024/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.46.up_proj: 79%|███████▉ | 29025/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.46.down_proj: 79%|███████▉ | 29026/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.47.gate_proj: 79%|███████▉ | 29027/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.47.up_proj: 79%|███████▉ | 29028/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.47.down_proj: 79%|███████▉ | 29029/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.48.gate_proj: 79%|███████▉ | 29030/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.48.up_proj: 79%|███████▉ | 29031/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.48.down_proj: 79%|███████▉ | 29032/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.49.gate_proj: 79%|███████▉ | 29033/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.49.up_proj: 79%|███████▉ | 29034/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.49.down_proj: 79%|███████▉ | 29035/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.50.gate_proj: 79%|███████▉ | 29036/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.50.up_proj: 79%|███████▉ | 29037/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.50.down_proj: 79%|███████▉ | 29038/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.51.gate_proj: 79%|███████▉ | 29039/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.51.up_proj: 79%|███████▉ | 29040/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.51.down_proj: 79%|███████▉ | 29041/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.52.gate_proj: 79%|███████▉ | 29042/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.52.up_proj: 79%|███████▉ | 29043/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.52.down_proj: 79%|███████▉ | 29044/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.53.gate_proj: 79%|███████▉ | 29045/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.53.up_proj: 79%|███████▉ | 29046/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.53.down_proj: 79%|███████▉ | 29047/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.54.gate_proj: 79%|███████▉ | 29048/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.54.up_proj: 79%|███████▉ | 29049/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.54.down_proj: 79%|███████▉ | 29050/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.55.gate_proj: 79%|███████▉ | 29051/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.55.up_proj: 79%|███████▉ | 29052/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.55.down_proj: 79%|███████▉ | 29053/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.56.gate_proj: 79%|███████▉ | 29054/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.56.up_proj: 79%|███████▉ | 29055/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.56.down_proj: 79%|███████▉ | 29056/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.57.gate_proj: 79%|███████▉ | 29057/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.57.up_proj: 79%|███████▉ | 29058/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.57.down_proj: 79%|███████▉ | 29059/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.58.gate_proj: 79%|███████▉ | 29060/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.58.up_proj: 79%|███████▉ | 29061/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.58.down_proj: 79%|███████▉ | 29062/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.59.gate_proj: 79%|███████▉ | 29063/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.59.up_proj: 79%|███████▉ | 29064/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.59.down_proj: 79%|███████▉ | 29065/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.60.gate_proj: 79%|███████▉ | 29066/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.60.up_proj: 79%|███████▉ | 29067/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.60.down_proj: 79%|███████▉ | 29068/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.61.gate_proj: 79%|███████▉ | 29069/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.61.up_proj: 80%|███████▉ | 29070/36566 [00:26<00:06, 1166.09it/s] packing model.layers.74.mlp.experts.61.up_proj: 80%|███████▉ | 29071/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.61.down_proj: 80%|███████▉ | 29071/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.62.gate_proj: 80%|███████▉ | 29072/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.62.up_proj: 80%|███████▉ | 29073/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.62.down_proj: 80%|███████▉ | 29074/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.63.gate_proj: 80%|███████▉ | 29075/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.63.up_proj: 80%|███████▉ | 29076/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.63.down_proj: 80%|███████▉ | 29077/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.64.gate_proj: 80%|███████▉ | 29078/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.64.up_proj: 80%|███████▉ | 29079/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.64.down_proj: 80%|███████▉ | 29080/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.65.gate_proj: 80%|███████▉ | 29081/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.65.up_proj: 80%|███████▉ | 29082/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.65.down_proj: 80%|███████▉ | 29083/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.66.gate_proj: 80%|███████▉ | 29084/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.66.up_proj: 80%|███████▉ | 29085/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.66.down_proj: 80%|███████▉ | 29086/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.67.gate_proj: 80%|███████▉ | 29087/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.67.up_proj: 80%|███████▉ | 29088/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.67.down_proj: 80%|███████▉ | 29089/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.68.gate_proj: 80%|███████▉ | 29090/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.68.up_proj: 80%|███████▉ | 29091/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.68.down_proj: 80%|███████▉ | 29092/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.69.gate_proj: 80%|███████▉ | 29093/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.69.up_proj: 80%|███████▉ | 29094/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.69.down_proj: 80%|███████▉ | 29095/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.70.gate_proj: 80%|███████▉ | 29096/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.70.up_proj: 80%|███████▉ | 29097/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.70.down_proj: 80%|███████▉ | 29098/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.71.gate_proj: 80%|███████▉ | 29099/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.71.up_proj: 80%|███████▉ | 29100/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.71.down_proj: 80%|███████▉ | 29101/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.72.gate_proj: 80%|███████▉ | 29102/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.72.up_proj: 80%|███████▉ | 29103/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.72.down_proj: 80%|███████▉ | 29104/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.73.gate_proj: 80%|███████▉ | 29105/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.73.up_proj: 80%|███████▉ | 29106/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.73.down_proj: 80%|███████▉ | 29107/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.74.gate_proj: 80%|███████▉ | 29108/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.74.up_proj: 80%|███████▉ | 29109/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.74.down_proj: 80%|███████▉ | 29110/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.75.gate_proj: 80%|███████▉ | 29111/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.75.up_proj: 80%|███████▉ | 29112/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.75.down_proj: 80%|███████▉ | 29113/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.76.gate_proj: 80%|███████▉ | 29114/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.76.up_proj: 80%|███████▉ | 29115/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.76.down_proj: 80%|███████▉ | 29116/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.77.gate_proj: 80%|███████▉ | 29117/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.77.up_proj: 80%|███████▉ | 29118/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.77.down_proj: 80%|███████▉ | 29119/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.78.gate_proj: 80%|███████▉ | 29120/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.78.up_proj: 80%|███████▉ | 29121/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.78.down_proj: 80%|███████▉ | 29122/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.79.gate_proj: 80%|███████▉ | 29123/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.79.up_proj: 80%|███████▉ | 29124/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.79.down_proj: 80%|███████▉ | 29125/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.80.gate_proj: 80%|███████▉ | 29126/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.80.up_proj: 80%|███████▉ | 29127/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.80.down_proj: 80%|███████▉ | 29128/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.81.gate_proj: 80%|███████▉ | 29129/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.81.up_proj: 80%|███████▉ | 29130/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.81.down_proj: 80%|███████▉ | 29131/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.82.gate_proj: 80%|███████▉ | 29132/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.82.up_proj: 80%|███████▉ | 29133/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.82.down_proj: 80%|███████▉ | 29134/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.83.gate_proj: 80%|███████▉ | 29135/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.83.up_proj: 80%|███████▉ | 29136/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.83.down_proj: 80%|███████▉ | 29137/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.84.gate_proj: 80%|███████▉ | 29138/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.84.up_proj: 80%|███████▉ | 29139/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.84.down_proj: 80%|███████▉ | 29140/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.85.gate_proj: 80%|███████▉ | 29141/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.85.up_proj: 80%|███████▉ | 29142/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.85.down_proj: 80%|███████▉ | 29143/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.86.gate_proj: 80%|███████▉ | 29144/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.86.up_proj: 80%|███████▉ | 29145/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.86.down_proj: 80%|███████▉ | 29146/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.87.gate_proj: 80%|███████▉ | 29147/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.87.up_proj: 80%|███████▉ | 29148/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.87.down_proj: 80%|███████▉ | 29149/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.88.gate_proj: 80%|███████▉ | 29150/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.88.up_proj: 80%|███████▉ | 29151/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.88.down_proj: 80%|███████▉ | 29152/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.89.gate_proj: 80%|███████▉ | 29153/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.89.up_proj: 80%|███████▉ | 29154/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.89.down_proj: 80%|███████▉ | 29155/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.90.gate_proj: 80%|███████▉ | 29156/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.90.up_proj: 80%|███████▉ | 29157/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.90.down_proj: 80%|███████▉ | 29158/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.91.gate_proj: 80%|███████▉ | 29159/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.91.up_proj: 80%|███████▉ | 29160/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.91.down_proj: 80%|███████▉ | 29161/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.92.gate_proj: 80%|███████▉ | 29162/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.92.up_proj: 80%|███████▉ | 29163/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.92.down_proj: 80%|███████▉ | 29164/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.93.gate_proj: 80%|███████▉ | 29165/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.93.up_proj: 80%|███████▉ | 29166/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.93.down_proj: 80%|███████▉ | 29167/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.94.gate_proj: 80%|███████▉ | 29168/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.94.up_proj: 80%|███████▉ | 29169/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.94.down_proj: 80%|███████▉ | 29170/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.95.gate_proj: 80%|███████▉ | 29171/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.95.up_proj: 80%|███████▉ | 29172/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.95.down_proj: 80%|███████▉ | 29173/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.96.gate_proj: 80%|███████▉ | 29174/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.96.up_proj: 80%|███████▉ | 29175/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.96.down_proj: 80%|███████▉ | 29176/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.97.gate_proj: 80%|███████▉ | 29177/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.97.up_proj: 80%|███████▉ | 29178/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.97.down_proj: 80%|███████▉ | 29179/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.98.gate_proj: 80%|███████▉ | 29180/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.98.up_proj: 80%|███████▉ | 29181/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.98.down_proj: 80%|███████▉ | 29182/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.99.gate_proj: 80%|███████▉ | 29183/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.99.up_proj: 80%|███████▉ | 29184/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.99.down_proj: 80%|███████▉ | 29185/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.100.gate_proj: 80%|███████▉ | 29186/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.100.up_proj: 80%|███████▉ | 29187/36566 [00:26<00:06, 1166.14it/s] packing model.layers.74.mlp.experts.100.up_proj: 80%|███████▉ | 29188/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.100.down_proj: 80%|███████▉ | 29188/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.101.gate_proj: 80%|███████▉ | 29189/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.101.up_proj: 80%|███████▉ | 29190/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.101.down_proj: 80%|███████▉ | 29191/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.102.gate_proj: 80%|███████▉ | 29192/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.102.up_proj: 80%|███████▉ | 29193/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.102.down_proj: 80%|███████▉ | 29194/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.103.gate_proj: 80%|███████▉ | 29195/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.103.up_proj: 80%|███████▉ | 29196/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.103.down_proj: 80%|███████▉ | 29197/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.104.gate_proj: 80%|███████▉ | 29198/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.104.up_proj: 80%|███████▉ | 29199/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.104.down_proj: 80%|███████▉ | 29200/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.105.gate_proj: 80%|███████▉ | 29201/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.105.up_proj: 80%|███████▉ | 29202/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.105.down_proj: 80%|███████▉ | 29203/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.106.gate_proj: 80%|███████▉ | 29204/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.106.up_proj: 80%|███████▉ | 29205/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.106.down_proj: 80%|███████▉ | 29206/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.107.gate_proj: 80%|███████▉ | 29207/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.107.up_proj: 80%|███████▉ | 29208/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.107.down_proj: 80%|███████▉ | 29209/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.108.gate_proj: 80%|███████▉ | 29210/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.108.up_proj: 80%|███████▉ | 29211/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.108.down_proj: 80%|███████▉ | 29212/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.109.gate_proj: 80%|███████▉ | 29213/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.109.up_proj: 80%|███████▉ | 29214/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.109.down_proj: 80%|███████▉ | 29215/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.110.gate_proj: 80%|███████▉ | 29216/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.110.up_proj: 80%|███████▉ | 29217/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.110.down_proj: 80%|███████▉ | 29218/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.111.gate_proj: 80%|███████▉ | 29219/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.111.up_proj: 80%|███████▉ | 29220/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.111.down_proj: 80%|███████▉ | 29221/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.112.gate_proj: 80%|███████▉ | 29222/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.112.up_proj: 80%|███████▉ | 29223/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.112.down_proj: 80%|███████▉ | 29224/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.113.gate_proj: 80%|███████▉ | 29225/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.113.up_proj: 80%|███████▉ | 29226/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.113.down_proj: 80%|███████▉ | 29227/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.114.gate_proj: 80%|███████▉ | 29228/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.114.up_proj: 80%|███████▉ | 29229/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.114.down_proj: 80%|███████▉ | 29230/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.115.gate_proj: 80%|███████▉ | 29231/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.115.up_proj: 80%|███████▉ | 29232/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.115.down_proj: 80%|███████▉ | 29233/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.116.gate_proj: 80%|███████▉ | 29234/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.116.up_proj: 80%|███████▉ | 29235/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.116.down_proj: 80%|███████▉ | 29236/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.117.gate_proj: 80%|███████▉ | 29237/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.117.up_proj: 80%|███████▉ | 29238/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.117.down_proj: 80%|███████▉ | 29239/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.118.gate_proj: 80%|███████▉ | 29240/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.118.up_proj: 80%|███████▉ | 29241/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.118.down_proj: 80%|███████▉ | 29242/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.119.gate_proj: 80%|███████▉ | 29243/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.119.up_proj: 80%|███████▉ | 29244/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.119.down_proj: 80%|███████▉ | 29245/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.120.gate_proj: 80%|███████▉ | 29246/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.120.up_proj: 80%|███████▉ | 29247/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.120.down_proj: 80%|███████▉ | 29248/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.121.gate_proj: 80%|███████▉ | 29249/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.121.up_proj: 80%|███████▉ | 29250/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.121.down_proj: 80%|███████▉ | 29251/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.122.gate_proj: 80%|███████▉ | 29252/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.122.up_proj: 80%|████████ | 29253/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.122.down_proj: 80%|████████ | 29254/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.123.gate_proj: 80%|████████ | 29255/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.123.up_proj: 80%|████████ | 29256/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.123.down_proj: 80%|████████ | 29257/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.124.gate_proj: 80%|████████ | 29258/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.124.up_proj: 80%|████████ | 29259/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.124.down_proj: 80%|████████ | 29260/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.125.gate_proj: 80%|████████ | 29261/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.125.up_proj: 80%|████████ | 29262/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.125.down_proj: 80%|████████ | 29263/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.126.gate_proj: 80%|████████ | 29264/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.126.up_proj: 80%|████████ | 29265/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.126.down_proj: 80%|████████ | 29266/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.127.gate_proj: 80%|████████ | 29267/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.127.up_proj: 80%|████████ | 29268/36566 [00:26<00:06, 1165.50it/s] packing model.layers.74.mlp.experts.127.down_proj: 80%|████████ | 29269/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.0.gate_proj: 80%|████████ | 29270/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.0.up_proj: 80%|████████ | 29271/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.0.down_proj: 80%|████████ | 29272/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.1.gate_proj: 80%|████████ | 29273/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.1.up_proj: 80%|████████ | 29274/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.1.down_proj: 80%|████████ | 29275/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.2.gate_proj: 80%|████████ | 29276/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.2.up_proj: 80%|████████ | 29277/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.2.down_proj: 80%|████████ | 29278/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.3.gate_proj: 80%|████████ | 29279/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.3.up_proj: 80%|████████ | 29280/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.3.down_proj: 80%|████████ | 29281/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.4.gate_proj: 80%|████████ | 29282/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.4.up_proj: 80%|████████ | 29283/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.4.down_proj: 80%|████████ | 29284/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.5.gate_proj: 80%|████████ | 29285/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.5.up_proj: 80%|████████ | 29286/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.5.down_proj: 80%|████████ | 29287/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.6.gate_proj: 80%|████████ | 29288/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.6.up_proj: 80%|████████ | 29289/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.6.down_proj: 80%|████████ | 29290/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.7.gate_proj: 80%|████████ | 29291/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.7.up_proj: 80%|████████ | 29292/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.7.down_proj: 80%|████████ | 29293/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.8.gate_proj: 80%|████████ | 29294/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.8.up_proj: 80%|████████ | 29295/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.8.down_proj: 80%|████████ | 29296/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.9.gate_proj: 80%|████████ | 29297/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.9.up_proj: 80%|████████ | 29298/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.9.down_proj: 80%|████████ | 29299/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.10.gate_proj: 80%|████████ | 29300/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.10.up_proj: 80%|████████ | 29301/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.10.down_proj: 80%|████████ | 29302/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.11.gate_proj: 80%|████████ | 29303/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.11.up_proj: 80%|████████ | 29304/36566 [00:26<00:06, 1165.50it/s] packing model.layers.75.mlp.experts.11.up_proj: 80%|████████ | 29305/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.11.down_proj: 80%|████████ | 29305/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.12.gate_proj: 80%|████████ | 29306/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.12.up_proj: 80%|████████ | 29307/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.12.down_proj: 80%|████████ | 29308/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.13.gate_proj: 80%|████████ | 29309/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.13.up_proj: 80%|████████ | 29310/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.13.down_proj: 80%|████████ | 29311/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.14.gate_proj: 80%|████████ | 29312/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.14.up_proj: 80%|████████ | 29313/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.14.down_proj: 80%|████████ | 29314/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.15.gate_proj: 80%|████████ | 29315/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.15.up_proj: 80%|████████ | 29316/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.15.down_proj: 80%|████████ | 29317/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.16.gate_proj: 80%|████████ | 29318/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.16.up_proj: 80%|████████ | 29319/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.16.down_proj: 80%|████████ | 29320/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.17.gate_proj: 80%|████████ | 29321/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.17.up_proj: 80%|████████ | 29322/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.17.down_proj: 80%|████████ | 29323/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.18.gate_proj: 80%|████████ | 29324/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.18.up_proj: 80%|████████ | 29325/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.18.down_proj: 80%|████████ | 29326/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.19.gate_proj: 80%|████████ | 29327/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.19.up_proj: 80%|████████ | 29328/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.19.down_proj: 80%|████████ | 29329/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.20.gate_proj: 80%|████████ | 29330/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.20.up_proj: 80%|████████ | 29331/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.20.down_proj: 80%|████████ | 29332/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.21.gate_proj: 80%|████████ | 29333/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.21.up_proj: 80%|████████ | 29334/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.21.down_proj: 80%|████████ | 29335/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.22.gate_proj: 80%|████████ | 29336/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.22.up_proj: 80%|████████ | 29337/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.22.down_proj: 80%|████████ | 29338/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.23.gate_proj: 80%|████████ | 29339/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.23.up_proj: 80%|████████ | 29340/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.23.down_proj: 80%|████████ | 29341/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.24.gate_proj: 80%|████████ | 29342/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.24.up_proj: 80%|████████ | 29343/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.24.down_proj: 80%|████████ | 29344/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.25.gate_proj: 80%|████████ | 29345/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.25.up_proj: 80%|████████ | 29346/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.25.down_proj: 80%|████████ | 29347/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.26.gate_proj: 80%|████████ | 29348/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.26.up_proj: 80%|████████ | 29349/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.26.down_proj: 80%|████████ | 29350/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.27.gate_proj: 80%|████████ | 29351/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.27.up_proj: 80%|████████ | 29352/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.27.down_proj: 80%|████████ | 29353/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.28.gate_proj: 80%|████████ | 29354/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.28.up_proj: 80%|████████ | 29355/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.28.down_proj: 80%|████████ | 29356/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.29.gate_proj: 80%|████████ | 29357/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.29.up_proj: 80%|████████ | 29358/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.29.down_proj: 80%|████████ | 29359/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.30.gate_proj: 80%|████████ | 29360/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.30.up_proj: 80%|████████ | 29361/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.30.down_proj: 80%|████████ | 29362/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.31.gate_proj: 80%|████████ | 29363/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.31.up_proj: 80%|████████ | 29364/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.31.down_proj: 80%|████████ | 29365/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.32.gate_proj: 80%|████████ | 29366/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.32.up_proj: 80%|████████ | 29367/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.32.down_proj: 80%|████████ | 29368/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.33.gate_proj: 80%|████████ | 29369/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.33.up_proj: 80%|████████ | 29370/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.33.down_proj: 80%|████████ | 29371/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.34.gate_proj: 80%|████████ | 29372/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.34.up_proj: 80%|████████ | 29373/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.34.down_proj: 80%|████████ | 29374/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.35.gate_proj: 80%|████████ | 29375/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.35.up_proj: 80%|████████ | 29376/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.35.down_proj: 80%|████████ | 29377/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.36.gate_proj: 80%|████████ | 29378/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.36.up_proj: 80%|████████ | 29379/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.36.down_proj: 80%|████████ | 29380/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.37.gate_proj: 80%|████████ | 29381/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.37.up_proj: 80%|████████ | 29382/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.37.down_proj: 80%|████████ | 29383/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.38.gate_proj: 80%|████████ | 29384/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.38.up_proj: 80%|████████ | 29385/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.38.down_proj: 80%|████████ | 29386/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.39.gate_proj: 80%|████████ | 29387/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.39.up_proj: 80%|████████ | 29388/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.39.down_proj: 80%|████████ | 29389/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.40.gate_proj: 80%|████████ | 29390/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.40.up_proj: 80%|████████ | 29391/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.40.down_proj: 80%|████████ | 29392/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.41.gate_proj: 80%|████████ | 29393/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.41.up_proj: 80%|████████ | 29394/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.41.down_proj: 80%|████████ | 29395/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.42.gate_proj: 80%|████████ | 29396/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.42.up_proj: 80%|████████ | 29397/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.42.down_proj: 80%|████████ | 29398/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.43.gate_proj: 80%|████████ | 29399/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.43.up_proj: 80%|████████ | 29400/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.43.down_proj: 80%|████████ | 29401/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.44.gate_proj: 80%|████████ | 29402/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.44.up_proj: 80%|████████ | 29403/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.44.down_proj: 80%|████████ | 29404/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.45.gate_proj: 80%|████████ | 29405/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.45.up_proj: 80%|████████ | 29406/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.45.down_proj: 80%|████████ | 29407/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.46.gate_proj: 80%|████████ | 29408/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.46.up_proj: 80%|████████ | 29409/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.46.down_proj: 80%|████████ | 29410/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.47.gate_proj: 80%|████████ | 29411/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.47.up_proj: 80%|████████ | 29412/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.47.down_proj: 80%|████████ | 29413/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.48.gate_proj: 80%|████████ | 29414/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.48.up_proj: 80%|████████ | 29415/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.48.down_proj: 80%|████████ | 29416/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.49.gate_proj: 80%|████████ | 29417/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.49.up_proj: 80%|████████ | 29418/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.49.down_proj: 80%|████████ | 29419/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.50.gate_proj: 80%|████████ | 29420/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.50.up_proj: 80%|████████ | 29421/36566 [00:26<00:06, 1164.40it/s] packing model.layers.75.mlp.experts.50.up_proj: 80%|████████ | 29422/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.50.down_proj: 80%|████████ | 29422/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.51.gate_proj: 80%|████████ | 29423/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.51.up_proj: 80%|████████ | 29424/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.51.down_proj: 80%|████████ | 29425/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.52.gate_proj: 80%|████████ | 29426/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.52.up_proj: 80%|████████ | 29427/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.52.down_proj: 80%|████████ | 29428/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.53.gate_proj: 80%|████████ | 29429/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.53.up_proj: 80%|████████ | 29430/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.53.down_proj: 80%|████████ | 29431/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.54.gate_proj: 80%|████████ | 29432/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.54.up_proj: 80%|████████ | 29433/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.54.down_proj: 80%|████████ | 29434/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.55.gate_proj: 80%|████████ | 29435/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.55.up_proj: 81%|████████ | 29436/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.55.down_proj: 81%|████████ | 29437/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.56.gate_proj: 81%|████████ | 29438/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.56.up_proj: 81%|████████ | 29439/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.56.down_proj: 81%|████████ | 29440/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.57.gate_proj: 81%|████████ | 29441/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.57.up_proj: 81%|████████ | 29442/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.57.down_proj: 81%|████████ | 29443/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.58.gate_proj: 81%|████████ | 29444/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.58.up_proj: 81%|████████ | 29445/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.58.down_proj: 81%|████████ | 29446/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.59.gate_proj: 81%|████████ | 29447/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.59.up_proj: 81%|████████ | 29448/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.59.down_proj: 81%|████████ | 29449/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.60.gate_proj: 81%|████████ | 29450/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.60.up_proj: 81%|████████ | 29451/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.60.down_proj: 81%|████████ | 29452/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.61.gate_proj: 81%|████████ | 29453/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.61.up_proj: 81%|████████ | 29454/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.61.down_proj: 81%|████████ | 29455/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.62.gate_proj: 81%|████████ | 29456/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.62.up_proj: 81%|████████ | 29457/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.62.down_proj: 81%|████████ | 29458/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.63.gate_proj: 81%|████████ | 29459/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.63.up_proj: 81%|████████ | 29460/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.63.down_proj: 81%|████████ | 29461/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.64.gate_proj: 81%|████████ | 29462/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.64.up_proj: 81%|████████ | 29463/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.64.down_proj: 81%|████████ | 29464/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.65.gate_proj: 81%|████████ | 29465/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.65.up_proj: 81%|████████ | 29466/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.65.down_proj: 81%|████████ | 29467/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.66.gate_proj: 81%|████████ | 29468/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.66.up_proj: 81%|████████ | 29469/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.66.down_proj: 81%|████████ | 29470/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.67.gate_proj: 81%|████████ | 29471/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.67.up_proj: 81%|████████ | 29472/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.67.down_proj: 81%|████████ | 29473/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.68.gate_proj: 81%|████████ | 29474/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.68.up_proj: 81%|████████ | 29475/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.68.down_proj: 81%|████████ | 29476/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.69.gate_proj: 81%|████████ | 29477/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.69.up_proj: 81%|████████ | 29478/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.69.down_proj: 81%|████████ | 29479/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.70.gate_proj: 81%|████████ | 29480/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.70.up_proj: 81%|████████ | 29481/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.70.down_proj: 81%|████████ | 29482/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.71.gate_proj: 81%|████████ | 29483/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.71.up_proj: 81%|████████ | 29484/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.71.down_proj: 81%|████████ | 29485/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.72.gate_proj: 81%|████████ | 29486/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.72.up_proj: 81%|████████ | 29487/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.72.down_proj: 81%|████████ | 29488/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.73.gate_proj: 81%|████████ | 29489/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.73.up_proj: 81%|████████ | 29490/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.73.down_proj: 81%|████████ | 29491/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.74.gate_proj: 81%|████████ | 29492/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.74.up_proj: 81%|████████ | 29493/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.74.down_proj: 81%|████████ | 29494/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.75.gate_proj: 81%|████████ | 29495/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.75.up_proj: 81%|████████ | 29496/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.75.down_proj: 81%|████████ | 29497/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.76.gate_proj: 81%|████████ | 29498/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.76.up_proj: 81%|████████ | 29499/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.76.down_proj: 81%|████████ | 29500/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.77.gate_proj: 81%|████████ | 29501/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.77.up_proj: 81%|████████ | 29502/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.77.down_proj: 81%|████████ | 29503/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.78.gate_proj: 81%|████████ | 29504/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.78.up_proj: 81%|████████ | 29505/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.78.down_proj: 81%|████████ | 29506/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.79.gate_proj: 81%|████████ | 29507/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.79.up_proj: 81%|████████ | 29508/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.79.down_proj: 81%|████████ | 29509/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.80.gate_proj: 81%|████████ | 29510/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.80.up_proj: 81%|████████ | 29511/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.80.down_proj: 81%|████████ | 29512/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.81.gate_proj: 81%|████████ | 29513/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.81.up_proj: 81%|████████ | 29514/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.81.down_proj: 81%|████████ | 29515/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.82.gate_proj: 81%|████████ | 29516/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.82.up_proj: 81%|████████ | 29517/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.82.down_proj: 81%|████████ | 29518/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.83.gate_proj: 81%|████████ | 29519/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.83.up_proj: 81%|████████ | 29520/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.83.down_proj: 81%|████████ | 29521/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.84.gate_proj: 81%|████████ | 29522/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.84.up_proj: 81%|████████ | 29523/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.84.down_proj: 81%|████████ | 29524/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.85.gate_proj: 81%|████████ | 29525/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.85.up_proj: 81%|████████ | 29526/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.85.down_proj: 81%|████████ | 29527/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.86.gate_proj: 81%|████████ | 29528/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.86.up_proj: 81%|████████ | 29529/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.86.down_proj: 81%|████████ | 29530/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.87.gate_proj: 81%|████████ | 29531/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.87.up_proj: 81%|████████ | 29532/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.87.down_proj: 81%|████████ | 29533/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.88.gate_proj: 81%|████████ | 29534/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.88.up_proj: 81%|████████ | 29535/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.88.down_proj: 81%|████████ | 29536/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.89.gate_proj: 81%|████████ | 29537/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.89.up_proj: 81%|████████ | 29538/36566 [00:26<00:06, 1163.56it/s] packing model.layers.75.mlp.experts.89.up_proj: 81%|████████ | 29539/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.89.down_proj: 81%|████████ | 29539/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.90.gate_proj: 81%|████████ | 29540/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.90.up_proj: 81%|████████ | 29541/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.90.down_proj: 81%|████████ | 29542/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.91.gate_proj: 81%|████████ | 29543/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.91.up_proj: 81%|████████ | 29544/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.91.down_proj: 81%|████████ | 29545/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.92.gate_proj: 81%|████████ | 29546/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.92.up_proj: 81%|████████ | 29547/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.92.down_proj: 81%|████████ | 29548/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.93.gate_proj: 81%|████████ | 29549/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.93.up_proj: 81%|████████ | 29550/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.93.down_proj: 81%|████████ | 29551/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.94.gate_proj: 81%|████████ | 29552/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.94.up_proj: 81%|████████ | 29553/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.94.down_proj: 81%|████████ | 29554/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.95.gate_proj: 81%|████████ | 29555/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.95.up_proj: 81%|████████ | 29556/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.95.down_proj: 81%|████████ | 29557/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.96.gate_proj: 81%|████████ | 29558/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.96.up_proj: 81%|████████ | 29559/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.96.down_proj: 81%|████████ | 29560/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.97.gate_proj: 81%|████████ | 29561/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.97.up_proj: 81%|████████ | 29562/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.97.down_proj: 81%|████████ | 29563/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.98.gate_proj: 81%|████████ | 29564/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.98.up_proj: 81%|████████ | 29565/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.98.down_proj: 81%|████████ | 29566/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.99.gate_proj: 81%|████████ | 29567/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.99.up_proj: 81%|████████ | 29568/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.99.down_proj: 81%|████████ | 29569/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.100.gate_proj: 81%|████████ | 29570/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.100.up_proj: 81%|████████ | 29571/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.100.down_proj: 81%|████████ | 29572/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.101.gate_proj: 81%|████████ | 29573/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.101.up_proj: 81%|████████ | 29574/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.101.down_proj: 81%|████████ | 29575/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.102.gate_proj: 81%|████████ | 29576/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.102.up_proj: 81%|████████ | 29577/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.102.down_proj: 81%|████████ | 29578/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.103.gate_proj: 81%|████████ | 29579/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.103.up_proj: 81%|████████ | 29580/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.103.down_proj: 81%|████████ | 29581/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.104.gate_proj: 81%|████████ | 29582/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.104.up_proj: 81%|████████ | 29583/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.104.down_proj: 81%|████████ | 29584/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.105.gate_proj: 81%|████████ | 29585/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.105.up_proj: 81%|████████ | 29586/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.105.down_proj: 81%|████████ | 29587/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.106.gate_proj: 81%|████████ | 29588/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.106.up_proj: 81%|████████ | 29589/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.106.down_proj: 81%|████████ | 29590/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.107.gate_proj: 81%|████████ | 29591/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.107.up_proj: 81%|████████ | 29592/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.107.down_proj: 81%|████████ | 29593/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.108.gate_proj: 81%|████████ | 29594/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.108.up_proj: 81%|████████ | 29595/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.108.down_proj: 81%|████████ | 29596/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.109.gate_proj: 81%|████████ | 29597/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.109.up_proj: 81%|████████ | 29598/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.109.down_proj: 81%|████████ | 29599/36566 [00:26<00:06, 1161.09it/s] packing model.layers.75.mlp.experts.110.gate_proj: 81%|████████ | 29600/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.110.up_proj: 81%|████████ | 29601/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.110.down_proj: 81%|████████ | 29602/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.111.gate_proj: 81%|████████ | 29603/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.111.up_proj: 81%|████████ | 29604/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.111.down_proj: 81%|████████ | 29605/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.112.gate_proj: 81%|████████ | 29606/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.112.up_proj: 81%|████████ | 29607/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.112.down_proj: 81%|████████ | 29608/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.113.gate_proj: 81%|████████ | 29609/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.113.up_proj: 81%|████████ | 29610/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.113.down_proj: 81%|████████ | 29611/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.114.gate_proj: 81%|████████ | 29612/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.114.up_proj: 81%|████████ | 29613/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.114.down_proj: 81%|████████ | 29614/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.115.gate_proj: 81%|████████ | 29615/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.115.up_proj: 81%|████████ | 29616/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.115.down_proj: 81%|████████ | 29617/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.116.gate_proj: 81%|████████ | 29618/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.116.up_proj: 81%|████████ | 29619/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.116.down_proj: 81%|████████ | 29620/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.117.gate_proj: 81%|████████ | 29621/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.117.up_proj: 81%|████████ | 29622/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.117.down_proj: 81%|████████ | 29623/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.118.gate_proj: 81%|████████ | 29624/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.118.up_proj: 81%|████████ | 29625/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.118.down_proj: 81%|████████ | 29626/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.119.gate_proj: 81%|████████ | 29627/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.119.up_proj: 81%|████████ | 29628/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.119.down_proj: 81%|████████ | 29629/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.120.gate_proj: 81%|████████ | 29630/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.120.up_proj: 81%|████████ | 29631/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.120.down_proj: 81%|████████ | 29632/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.121.gate_proj: 81%|████████ | 29633/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.121.up_proj: 81%|████████ | 29634/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.121.down_proj: 81%|████████ | 29635/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.122.gate_proj: 81%|████████ | 29636/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.122.up_proj: 81%|████████ | 29637/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.122.down_proj: 81%|████████ | 29638/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.123.gate_proj: 81%|████████ | 29639/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.123.up_proj: 81%|████████ | 29640/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.123.down_proj: 81%|████████ | 29641/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.124.gate_proj: 81%|████████ | 29642/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.124.up_proj: 81%|████████ | 29643/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.124.down_proj: 81%|████████ | 29644/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.125.gate_proj: 81%|████████ | 29645/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.125.up_proj: 81%|████████ | 29646/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.125.down_proj: 81%|████████ | 29647/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.126.gate_proj: 81%|████████ | 29648/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.126.up_proj: 81%|████████ | 29649/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.126.down_proj: 81%|████████ | 29650/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.127.gate_proj: 81%|████████ | 29651/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.127.up_proj: 81%|████████ | 29652/36566 [00:26<00:05, 1161.09it/s] packing model.layers.75.mlp.experts.127.down_proj: 81%|████████ | 29653/36566 [00:26<00:05, 1161.09it/s] packing model.layers.76.mlp.experts.0.gate_proj: 81%|████████ | 29654/36566 [00:26<00:05, 1161.09it/s] packing model.layers.76.mlp.experts.0.up_proj: 81%|████████ | 29655/36566 [00:26<00:05, 1161.09it/s] packing model.layers.76.mlp.experts.0.up_proj: 81%|████████ | 29656/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.0.down_proj: 81%|████████ | 29656/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.1.gate_proj: 81%|████████ | 29657/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.1.up_proj: 81%|████████ | 29658/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.1.down_proj: 81%|████████ | 29659/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.2.gate_proj: 81%|████████ | 29660/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.2.up_proj: 81%|████████ | 29661/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.2.down_proj: 81%|████████ | 29662/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.3.gate_proj: 81%|████████ | 29663/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.3.up_proj: 81%|████████ | 29664/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.3.down_proj: 81%|████████ | 29665/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.4.gate_proj: 81%|████████ | 29666/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.4.up_proj: 81%|████████ | 29667/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.4.down_proj: 81%|████████ | 29668/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.5.gate_proj: 81%|████████ | 29669/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.5.up_proj: 81%|████████ | 29670/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.5.down_proj: 81%|████████ | 29671/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.6.gate_proj: 81%|████████ | 29672/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.6.up_proj: 81%|████████ | 29673/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.6.down_proj: 81%|████████ | 29674/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.7.gate_proj: 81%|████████ | 29675/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.7.up_proj: 81%|████████ | 29676/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.7.down_proj: 81%|████████ | 29677/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.8.gate_proj: 81%|████████ | 29678/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.8.up_proj: 81%|████████ | 29679/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.8.down_proj: 81%|████████ | 29680/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.9.gate_proj: 81%|████████ | 29681/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.9.up_proj: 81%|████████ | 29682/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.9.down_proj: 81%|████████ | 29683/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.10.gate_proj: 81%|████████ | 29684/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.10.up_proj: 81%|████████ | 29685/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.10.down_proj: 81%|████████ | 29686/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.11.gate_proj: 81%|████████ | 29687/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.11.up_proj: 81%|████████ | 29688/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.11.down_proj: 81%|████████ | 29689/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.12.gate_proj: 81%|████████ | 29690/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.12.up_proj: 81%|████████ | 29691/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.12.down_proj: 81%|████████ | 29692/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.13.gate_proj: 81%|████████ | 29693/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.13.up_proj: 81%|████████ | 29694/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.13.down_proj: 81%|████████ | 29695/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.14.gate_proj: 81%|████████ | 29696/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.14.up_proj: 81%|████████ | 29697/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.14.down_proj: 81%|████████ | 29698/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.15.gate_proj: 81%|████████ | 29699/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.15.up_proj: 81%|████████ | 29700/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.15.down_proj: 81%|████████ | 29701/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.16.gate_proj: 81%|████████ | 29702/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.16.up_proj: 81%|████████ | 29703/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.16.down_proj: 81%|████████ | 29704/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.17.gate_proj: 81%|████████ | 29705/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.17.up_proj: 81%|████████ | 29706/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.17.down_proj: 81%|████████ | 29707/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.18.gate_proj: 81%|████████ | 29708/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.18.up_proj: 81%|████████ | 29709/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.18.down_proj: 81%|████████▏ | 29710/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.19.gate_proj: 81%|████████▏ | 29711/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.19.up_proj: 81%|████████▏ | 29712/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.19.down_proj: 81%|████████▏ | 29713/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.20.gate_proj: 81%|████████▏ | 29714/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.20.up_proj: 81%|████████▏ | 29715/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.20.down_proj: 81%|████████▏ | 29716/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.21.gate_proj: 81%|████████▏ | 29717/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.21.up_proj: 81%|████████▏ | 29718/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.21.down_proj: 81%|████████▏ | 29719/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.22.gate_proj: 81%|████████▏ | 29720/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.22.up_proj: 81%|████████▏ | 29721/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.22.down_proj: 81%|████████▏ | 29722/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.23.gate_proj: 81%|████████▏ | 29723/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.23.up_proj: 81%|████████▏ | 29724/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.23.down_proj: 81%|████████▏ | 29725/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.24.gate_proj: 81%|████████▏ | 29726/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.24.up_proj: 81%|████████▏ | 29727/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.24.down_proj: 81%|████████▏ | 29728/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.25.gate_proj: 81%|████████▏ | 29729/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.25.up_proj: 81%|████████▏ | 29730/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.25.down_proj: 81%|████████▏ | 29731/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.26.gate_proj: 81%|████████▏ | 29732/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.26.up_proj: 81%|████████▏ | 29733/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.26.down_proj: 81%|████████▏ | 29734/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.27.gate_proj: 81%|████████▏ | 29735/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.27.up_proj: 81%|████████▏ | 29736/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.27.down_proj: 81%|████████▏ | 29737/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.28.gate_proj: 81%|████████▏ | 29738/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.28.up_proj: 81%|████████▏ | 29739/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.28.down_proj: 81%|████████▏ | 29740/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.29.gate_proj: 81%|████████▏ | 29741/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.29.up_proj: 81%|████████▏ | 29742/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.29.down_proj: 81%|████████▏ | 29743/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.30.gate_proj: 81%|████████▏ | 29744/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.30.up_proj: 81%|████████▏ | 29745/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.30.down_proj: 81%|████████▏ | 29746/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.31.gate_proj: 81%|████████▏ | 29747/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.31.up_proj: 81%|████████▏ | 29748/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.31.down_proj: 81%|████████▏ | 29749/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.32.gate_proj: 81%|████████▏ | 29750/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.32.up_proj: 81%|████████▏ | 29751/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.32.down_proj: 81%|████████▏ | 29752/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.33.gate_proj: 81%|████████▏ | 29753/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.33.up_proj: 81%|████████▏ | 29754/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.33.down_proj: 81%|████████▏ | 29755/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.34.gate_proj: 81%|████████▏ | 29756/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.34.up_proj: 81%|████████▏ | 29757/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.34.down_proj: 81%|████████▏ | 29758/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.35.gate_proj: 81%|████████▏ | 29759/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.35.up_proj: 81%|████████▏ | 29760/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.35.down_proj: 81%|████████▏ | 29761/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.36.gate_proj: 81%|████████▏ | 29762/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.36.up_proj: 81%|████████▏ | 29763/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.36.down_proj: 81%|████████▏ | 29764/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.37.gate_proj: 81%|████████▏ | 29765/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.37.up_proj: 81%|████████▏ | 29766/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.37.down_proj: 81%|████████▏ | 29767/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.38.gate_proj: 81%|████████▏ | 29768/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.38.up_proj: 81%|████████▏ | 29769/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.38.down_proj: 81%|████████▏ | 29770/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.39.gate_proj: 81%|████████▏ | 29771/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.39.up_proj: 81%|████████▏ | 29772/36566 [00:26<00:05, 1160.92it/s] packing model.layers.76.mlp.experts.39.up_proj: 81%|████████▏ | 29773/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.39.down_proj: 81%|████████▏ | 29773/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.40.gate_proj: 81%|████████▏ | 29774/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.40.up_proj: 81%|████████▏ | 29775/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.40.down_proj: 81%|████████▏ | 29776/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.41.gate_proj: 81%|████████▏ | 29777/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.41.up_proj: 81%|████████▏ | 29778/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.41.down_proj: 81%|████████▏ | 29779/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.42.gate_proj: 81%|████████▏ | 29780/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.42.up_proj: 81%|████████▏ | 29781/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.42.down_proj: 81%|████████▏ | 29782/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.43.gate_proj: 81%|████████▏ | 29783/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.43.up_proj: 81%|████████▏ | 29784/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.43.down_proj: 81%|████████▏ | 29785/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.44.gate_proj: 81%|████████▏ | 29786/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.44.up_proj: 81%|████████▏ | 29787/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.44.down_proj: 81%|████████▏ | 29788/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.45.gate_proj: 81%|████████▏ | 29789/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.45.up_proj: 81%|████████▏ | 29790/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.45.down_proj: 81%|████████▏ | 29791/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.46.gate_proj: 81%|████████▏ | 29792/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.46.up_proj: 81%|████████▏ | 29793/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.46.down_proj: 81%|████████▏ | 29794/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.47.gate_proj: 81%|████████▏ | 29795/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.47.up_proj: 81%|████████▏ | 29796/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.47.down_proj: 81%|████████▏ | 29797/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.48.gate_proj: 81%|████████▏ | 29798/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.48.up_proj: 81%|████████▏ | 29799/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.48.down_proj: 81%|████████▏ | 29800/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.49.gate_proj: 81%|████████▏ | 29801/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.49.up_proj: 82%|████████▏ | 29802/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.49.down_proj: 82%|████████▏ | 29803/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.50.gate_proj: 82%|████████▏ | 29804/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.50.up_proj: 82%|████████▏ | 29805/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.50.down_proj: 82%|████████▏ | 29806/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.51.gate_proj: 82%|████████▏ | 29807/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.51.up_proj: 82%|████████▏ | 29808/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.51.down_proj: 82%|████████▏ | 29809/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.52.gate_proj: 82%|████████▏ | 29810/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.52.up_proj: 82%|████████▏ | 29811/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.52.down_proj: 82%|████████▏ | 29812/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.53.gate_proj: 82%|████████▏ | 29813/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.53.up_proj: 82%|████████▏ | 29814/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.53.down_proj: 82%|████████▏ | 29815/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.54.gate_proj: 82%|████████▏ | 29816/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.54.up_proj: 82%|████████▏ | 29817/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.54.down_proj: 82%|████████▏ | 29818/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.55.gate_proj: 82%|████████▏ | 29819/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.55.up_proj: 82%|████████▏ | 29820/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.55.down_proj: 82%|████████▏ | 29821/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.56.gate_proj: 82%|████████▏ | 29822/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.56.up_proj: 82%|████████▏ | 29823/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.56.down_proj: 82%|████████▏ | 29824/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.57.gate_proj: 82%|████████▏ | 29825/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.57.up_proj: 82%|████████▏ | 29826/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.57.down_proj: 82%|████████▏ | 29827/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.58.gate_proj: 82%|████████▏ | 29828/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.58.up_proj: 82%|████████▏ | 29829/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.58.down_proj: 82%|████████▏ | 29830/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.59.gate_proj: 82%|████████▏ | 29831/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.59.up_proj: 82%|████████▏ | 29832/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.59.down_proj: 82%|████████▏ | 29833/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.60.gate_proj: 82%|████████▏ | 29834/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.60.up_proj: 82%|████████▏ | 29835/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.60.down_proj: 82%|████████▏ | 29836/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.61.gate_proj: 82%|████████▏ | 29837/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.61.up_proj: 82%|████████▏ | 29838/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.61.down_proj: 82%|████████▏ | 29839/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.62.gate_proj: 82%|████████▏ | 29840/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.62.up_proj: 82%|████████▏ | 29841/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.62.down_proj: 82%|████████▏ | 29842/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.63.gate_proj: 82%|████████▏ | 29843/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.63.up_proj: 82%|████████▏ | 29844/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.63.down_proj: 82%|████████▏ | 29845/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.64.gate_proj: 82%|████████▏ | 29846/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.64.up_proj: 82%|████████▏ | 29847/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.64.down_proj: 82%|████████▏ | 29848/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.65.gate_proj: 82%|████████▏ | 29849/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.65.up_proj: 82%|████████▏ | 29850/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.65.down_proj: 82%|████████▏ | 29851/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.66.gate_proj: 82%|████████▏ | 29852/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.66.up_proj: 82%|████████▏ | 29853/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.66.down_proj: 82%|████████▏ | 29854/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.67.gate_proj: 82%|████████▏ | 29855/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.67.up_proj: 82%|████████▏ | 29856/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.67.down_proj: 82%|████████▏ | 29857/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.68.gate_proj: 82%|████████▏ | 29858/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.68.up_proj: 82%|████████▏ | 29859/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.68.down_proj: 82%|████████▏ | 29860/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.69.gate_proj: 82%|████████▏ | 29861/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.69.up_proj: 82%|████████▏ | 29862/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.69.down_proj: 82%|████████▏ | 29863/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.70.gate_proj: 82%|████████▏ | 29864/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.70.up_proj: 82%|████████▏ | 29865/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.70.down_proj: 82%|████████▏ | 29866/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.71.gate_proj: 82%|████████▏ | 29867/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.71.up_proj: 82%|████████▏ | 29868/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.71.down_proj: 82%|████████▏ | 29869/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.72.gate_proj: 82%|████████▏ | 29870/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.72.up_proj: 82%|████████▏ | 29871/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.72.down_proj: 82%|████████▏ | 29872/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.73.gate_proj: 82%|████████▏ | 29873/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.73.up_proj: 82%|████████▏ | 29874/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.73.down_proj: 82%|████████▏ | 29875/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.74.gate_proj: 82%|████████▏ | 29876/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.74.up_proj: 82%|████████▏ | 29877/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.74.down_proj: 82%|████████▏ | 29878/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.75.gate_proj: 82%|████████▏ | 29879/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.75.up_proj: 82%|████████▏ | 29880/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.75.down_proj: 82%|████████▏ | 29881/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.76.gate_proj: 82%|████████▏ | 29882/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.76.up_proj: 82%|████████▏ | 29883/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.76.down_proj: 82%|████████▏ | 29884/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.77.gate_proj: 82%|████████▏ | 29885/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.77.up_proj: 82%|████████▏ | 29886/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.77.down_proj: 82%|████████▏ | 29887/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.78.gate_proj: 82%|████████▏ | 29888/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.78.up_proj: 82%|████████▏ | 29889/36566 [00:26<00:05, 1161.99it/s] packing model.layers.76.mlp.experts.78.up_proj: 82%|████████▏ | 29890/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.78.down_proj: 82%|████████▏ | 29890/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.79.gate_proj: 82%|████████▏ | 29891/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.79.up_proj: 82%|████████▏ | 29892/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.79.down_proj: 82%|████████▏ | 29893/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.80.gate_proj: 82%|████████▏ | 29894/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.80.up_proj: 82%|████████▏ | 29895/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.80.down_proj: 82%|████████▏ | 29896/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.81.gate_proj: 82%|████████▏ | 29897/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.81.up_proj: 82%|████████▏ | 29898/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.81.down_proj: 82%|████████▏ | 29899/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.82.gate_proj: 82%|████████▏ | 29900/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.82.up_proj: 82%|████████▏ | 29901/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.82.down_proj: 82%|████████▏ | 29902/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.83.gate_proj: 82%|████████▏ | 29903/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.83.up_proj: 82%|████████▏ | 29904/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.83.down_proj: 82%|████████▏ | 29905/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.84.gate_proj: 82%|████████▏ | 29906/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.84.up_proj: 82%|████████▏ | 29907/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.84.down_proj: 82%|████████▏ | 29908/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.85.gate_proj: 82%|████████▏ | 29909/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.85.up_proj: 82%|████████▏ | 29910/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.85.down_proj: 82%|████████▏ | 29911/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.86.gate_proj: 82%|████████▏ | 29912/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.86.up_proj: 82%|████████▏ | 29913/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.86.down_proj: 82%|████████▏ | 29914/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.87.gate_proj: 82%|████████▏ | 29915/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.87.up_proj: 82%|████████▏ | 29916/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.87.down_proj: 82%|████████▏ | 29917/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.88.gate_proj: 82%|████████▏ | 29918/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.88.up_proj: 82%|████████▏ | 29919/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.88.down_proj: 82%|████████▏ | 29920/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.89.gate_proj: 82%|████████▏ | 29921/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.89.up_proj: 82%|████████▏ | 29922/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.89.down_proj: 82%|████████▏ | 29923/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.90.gate_proj: 82%|████████▏ | 29924/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.90.up_proj: 82%|████████▏ | 29925/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.90.down_proj: 82%|████████▏ | 29926/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.91.gate_proj: 82%|████████▏ | 29927/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.91.up_proj: 82%|████████▏ | 29928/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.91.down_proj: 82%|████████▏ | 29929/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.92.gate_proj: 82%|████████▏ | 29930/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.92.up_proj: 82%|████████▏ | 29931/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.92.down_proj: 82%|████████▏ | 29932/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.93.gate_proj: 82%|████████▏ | 29933/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.93.up_proj: 82%|████████▏ | 29934/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.93.down_proj: 82%|████████▏ | 29935/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.94.gate_proj: 82%|████████▏ | 29936/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.94.up_proj: 82%|████████▏ | 29937/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.94.down_proj: 82%|████████▏ | 29938/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.95.gate_proj: 82%|████████▏ | 29939/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.95.up_proj: 82%|████████▏ | 29940/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.95.down_proj: 82%|████████▏ | 29941/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.96.gate_proj: 82%|████████▏ | 29942/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.96.up_proj: 82%|████████▏ | 29943/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.96.down_proj: 82%|████████▏ | 29944/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.97.gate_proj: 82%|████████▏ | 29945/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.97.up_proj: 82%|████████▏ | 29946/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.97.down_proj: 82%|████████▏ | 29947/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.98.gate_proj: 82%|████████▏ | 29948/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.98.up_proj: 82%|████████▏ | 29949/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.98.down_proj: 82%|████████▏ | 29950/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.99.gate_proj: 82%|████████▏ | 29951/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.99.up_proj: 82%|████████▏ | 29952/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.99.down_proj: 82%|████████▏ | 29953/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.100.gate_proj: 82%|████████▏ | 29954/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.100.up_proj: 82%|████████▏ | 29955/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.100.down_proj: 82%|████████▏ | 29956/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.101.gate_proj: 82%|████████▏ | 29957/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.101.up_proj: 82%|████████▏ | 29958/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.101.down_proj: 82%|████████▏ | 29959/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.102.gate_proj: 82%|████████▏ | 29960/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.102.up_proj: 82%|████████▏ | 29961/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.102.down_proj: 82%|████████▏ | 29962/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.103.gate_proj: 82%|████████▏ | 29963/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.103.up_proj: 82%|████████▏ | 29964/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.103.down_proj: 82%|████████▏ | 29965/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.104.gate_proj: 82%|████████▏ | 29966/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.104.up_proj: 82%|████████▏ | 29967/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.104.down_proj: 82%|████████▏ | 29968/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.105.gate_proj: 82%|████████▏ | 29969/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.105.up_proj: 82%|████████▏ | 29970/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.105.down_proj: 82%|████████▏ | 29971/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.106.gate_proj: 82%|████████▏ | 29972/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.106.up_proj: 82%|████████▏ | 29973/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.106.down_proj: 82%|████████▏ | 29974/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.107.gate_proj: 82%|████████▏ | 29975/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.107.up_proj: 82%|████████▏ | 29976/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.107.down_proj: 82%|████████▏ | 29977/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.108.gate_proj: 82%|████████▏ | 29978/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.108.up_proj: 82%|████████▏ | 29979/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.108.down_proj: 82%|████████▏ | 29980/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.109.gate_proj: 82%|████████▏ | 29981/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.109.up_proj: 82%|████████▏ | 29982/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.109.down_proj: 82%|████████▏ | 29983/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.110.gate_proj: 82%|████████▏ | 29984/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.110.up_proj: 82%|████████▏ | 29985/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.110.down_proj: 82%|████████▏ | 29986/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.111.gate_proj: 82%|████████▏ | 29987/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.111.up_proj: 82%|████████▏ | 29988/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.111.down_proj: 82%|████████▏ | 29989/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.112.gate_proj: 82%|████████▏ | 29990/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.112.up_proj: 82%|████████▏ | 29991/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.112.down_proj: 82%|████████▏ | 29992/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.113.gate_proj: 82%|████████▏ | 29993/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.113.up_proj: 82%|████████▏ | 29994/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.113.down_proj: 82%|████████▏ | 29995/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.114.gate_proj: 82%|████████▏ | 29996/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.114.up_proj: 82%|████████▏ | 29997/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.114.down_proj: 82%|████████▏ | 29998/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.115.gate_proj: 82%|████████▏ | 29999/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.115.up_proj: 82%|████████▏ | 30000/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.115.down_proj: 82%|████████▏ | 30001/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.116.gate_proj: 82%|████████▏ | 30002/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.116.up_proj: 82%|████████▏ | 30003/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.116.down_proj: 82%|████████▏ | 30004/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.117.gate_proj: 82%|████████▏ | 30005/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.117.up_proj: 82%|████████▏ | 30006/36566 [00:26<00:05, 1161.94it/s] packing model.layers.76.mlp.experts.117.up_proj: 82%|████████▏ | 30007/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.117.down_proj: 82%|████████▏ | 30007/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.118.gate_proj: 82%|████████▏ | 30008/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.118.up_proj: 82%|████████▏ | 30009/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.118.down_proj: 82%|████████▏ | 30010/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.119.gate_proj: 82%|████████▏ | 30011/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.119.up_proj: 82%|████████▏ | 30012/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.119.down_proj: 82%|████████▏ | 30013/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.120.gate_proj: 82%|████████▏ | 30014/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.120.up_proj: 82%|████████▏ | 30015/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.120.down_proj: 82%|████████▏ | 30016/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.121.gate_proj: 82%|████████▏ | 30017/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.121.up_proj: 82%|████████▏ | 30018/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.121.down_proj: 82%|████████▏ | 30019/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.122.gate_proj: 82%|████████▏ | 30020/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.122.up_proj: 82%|████████▏ | 30021/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.122.down_proj: 82%|████████▏ | 30022/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.123.gate_proj: 82%|████████▏ | 30023/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.123.up_proj: 82%|████████▏ | 30024/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.123.down_proj: 82%|████████▏ | 30025/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.124.gate_proj: 82%|████████▏ | 30026/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.124.up_proj: 82%|████████▏ | 30027/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.124.down_proj: 82%|████████▏ | 30028/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.125.gate_proj: 82%|████████▏ | 30029/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.125.up_proj: 82%|████████▏ | 30030/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.125.down_proj: 82%|████████▏ | 30031/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.126.gate_proj: 82%|████████▏ | 30032/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.126.up_proj: 82%|████████▏ | 30033/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.126.down_proj: 82%|████████▏ | 30034/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.127.gate_proj: 82%|████████▏ | 30035/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.127.up_proj: 82%|████████▏ | 30036/36566 [00:26<00:05, 1161.77it/s] packing model.layers.76.mlp.experts.127.down_proj: 82%|████████▏ | 30037/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.0.gate_proj: 82%|████████▏ | 30038/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.0.up_proj: 82%|████████▏ | 30039/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.0.down_proj: 82%|████████▏ | 30040/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.1.gate_proj: 82%|████████▏ | 30041/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.1.up_proj: 82%|████████▏ | 30042/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.1.down_proj: 82%|████████▏ | 30043/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.2.gate_proj: 82%|████████▏ | 30044/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.2.up_proj: 82%|████████▏ | 30045/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.2.down_proj: 82%|████████▏ | 30046/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.3.gate_proj: 82%|████████▏ | 30047/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.3.up_proj: 82%|████████▏ | 30048/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.3.down_proj: 82%|████████▏ | 30049/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.4.gate_proj: 82%|████████▏ | 30050/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.4.up_proj: 82%|████████▏ | 30051/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.4.down_proj: 82%|████████▏ | 30052/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.5.gate_proj: 82%|████████▏ | 30053/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.5.up_proj: 82%|████████▏ | 30054/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.5.down_proj: 82%|████████▏ | 30055/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.6.gate_proj: 82%|████████▏ | 30056/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.6.up_proj: 82%|████████▏ | 30057/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.6.down_proj: 82%|████████▏ | 30058/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.7.gate_proj: 82%|████████▏ | 30059/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.7.up_proj: 82%|████████▏ | 30060/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.7.down_proj: 82%|████████▏ | 30061/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.8.gate_proj: 82%|████████▏ | 30062/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.8.up_proj: 82%|████████▏ | 30063/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.8.down_proj: 82%|████████▏ | 30064/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.9.gate_proj: 82%|████████▏ | 30065/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.9.up_proj: 82%|████████▏ | 30066/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.9.down_proj: 82%|████████▏ | 30067/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.10.gate_proj: 82%|████████▏ | 30068/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.10.up_proj: 82%|████████▏ | 30069/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.10.down_proj: 82%|████████▏ | 30070/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.11.gate_proj: 82%|████████▏ | 30071/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.11.up_proj: 82%|████████▏ | 30072/36566 [00:26<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.11.down_proj: 82%|████████▏ | 30073/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.12.gate_proj: 82%|████████▏ | 30074/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.12.up_proj: 82%|████████▏ | 30075/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.12.down_proj: 82%|████████▏ | 30076/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.13.gate_proj: 82%|████████▏ | 30077/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.13.up_proj: 82%|████████▏ | 30078/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.13.down_proj: 82%|████████▏ | 30079/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.14.gate_proj: 82%|████████▏ | 30080/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.14.up_proj: 82%|████████▏ | 30081/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.14.down_proj: 82%|████████▏ | 30082/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.15.gate_proj: 82%|████████▏ | 30083/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.15.up_proj: 82%|████████▏ | 30084/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.15.down_proj: 82%|████████▏ | 30085/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.16.gate_proj: 82%|████████▏ | 30086/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.16.up_proj: 82%|████████▏ | 30087/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.16.down_proj: 82%|████████▏ | 30088/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.17.gate_proj: 82%|████████▏ | 30089/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.17.up_proj: 82%|████████▏ | 30090/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.17.down_proj: 82%|████████▏ | 30091/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.18.gate_proj: 82%|████████▏ | 30092/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.18.up_proj: 82%|████████▏ | 30093/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.18.down_proj: 82%|████████▏ | 30094/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.19.gate_proj: 82%|████████▏ | 30095/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.19.up_proj: 82%|████████▏ | 30096/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.19.down_proj: 82%|████████▏ | 30097/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.20.gate_proj: 82%|████████▏ | 30098/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.20.up_proj: 82%|████████▏ | 30099/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.20.down_proj: 82%|████████▏ | 30100/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.21.gate_proj: 82%|████████▏ | 30101/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.21.up_proj: 82%|████████▏ | 30102/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.21.down_proj: 82%|████████▏ | 30103/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.22.gate_proj: 82%|████████▏ | 30104/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.22.up_proj: 82%|████████▏ | 30105/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.22.down_proj: 82%|████████▏ | 30106/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.23.gate_proj: 82%|████████▏ | 30107/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.23.up_proj: 82%|████████▏ | 30108/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.23.down_proj: 82%|████████▏ | 30109/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.24.gate_proj: 82%|████████▏ | 30110/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.24.up_proj: 82%|████████▏ | 30111/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.24.down_proj: 82%|████████▏ | 30112/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.25.gate_proj: 82%|████████▏ | 30113/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.25.up_proj: 82%|████████▏ | 30114/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.25.down_proj: 82%|████████▏ | 30115/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.26.gate_proj: 82%|████████▏ | 30116/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.26.up_proj: 82%|████████▏ | 30117/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.26.down_proj: 82%|████████▏ | 30118/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.27.gate_proj: 82%|████████▏ | 30119/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.27.up_proj: 82%|████████▏ | 30120/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.27.down_proj: 82%|████████▏ | 30121/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.28.gate_proj: 82%|████████▏ | 30122/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.28.up_proj: 82%|████████▏ | 30123/36566 [00:27<00:05, 1161.77it/s] packing model.layers.77.mlp.experts.28.up_proj: 82%|████████▏ | 30124/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.28.down_proj: 82%|████████▏ | 30124/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.29.gate_proj: 82%|████████▏ | 30125/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.29.up_proj: 82%|████████▏ | 30126/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.29.down_proj: 82%|████████▏ | 30127/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.30.gate_proj: 82%|████████▏ | 30128/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.30.up_proj: 82%|████████▏ | 30129/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.30.down_proj: 82%|████████▏ | 30130/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.31.gate_proj: 82%|████████▏ | 30131/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.31.up_proj: 82%|████████▏ | 30132/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.31.down_proj: 82%|████████▏ | 30133/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.32.gate_proj: 82%|████████▏ | 30134/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.32.up_proj: 82%|████████▏ | 30135/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.32.down_proj: 82%|████████▏ | 30136/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.33.gate_proj: 82%|████████▏ | 30137/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.33.up_proj: 82%|████████▏ | 30138/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.33.down_proj: 82%|████████▏ | 30139/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.34.gate_proj: 82%|████████▏ | 30140/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.34.up_proj: 82%|████████▏ | 30141/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.34.down_proj: 82%|████████▏ | 30142/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.35.gate_proj: 82%|████████▏ | 30143/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.35.up_proj: 82%|████████▏ | 30144/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.35.down_proj: 82%|████████▏ | 30145/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.36.gate_proj: 82%|████████▏ | 30146/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.36.up_proj: 82%|████████▏ | 30147/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.36.down_proj: 82%|████████▏ | 30148/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.37.gate_proj: 82%|████████▏ | 30149/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.37.up_proj: 82%|████████▏ | 30150/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.37.down_proj: 82%|████████▏ | 30151/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.38.gate_proj: 82%|████████▏ | 30152/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.38.up_proj: 82%|████████▏ | 30153/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.38.down_proj: 82%|████████▏ | 30154/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.39.gate_proj: 82%|████████▏ | 30155/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.39.up_proj: 82%|████████▏ | 30156/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.39.down_proj: 82%|████████▏ | 30157/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.40.gate_proj: 82%|████████▏ | 30158/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.40.up_proj: 82%|████████▏ | 30159/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.40.down_proj: 82%|████████▏ | 30160/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.41.gate_proj: 82%|████████▏ | 30161/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.41.up_proj: 82%|████████▏ | 30162/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.41.down_proj: 82%|████████▏ | 30163/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.42.gate_proj: 82%|████████▏ | 30164/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.42.up_proj: 82%|████████▏ | 30165/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.42.down_proj: 82%|████████▏ | 30166/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.43.gate_proj: 83%|████████▎ | 30167/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.43.up_proj: 83%|████████▎ | 30168/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.43.down_proj: 83%|████████▎ | 30169/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.44.gate_proj: 83%|████████▎ | 30170/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.44.up_proj: 83%|████████▎ | 30171/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.44.down_proj: 83%|████████▎ | 30172/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.45.gate_proj: 83%|████████▎ | 30173/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.45.up_proj: 83%|████████▎ | 30174/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.45.down_proj: 83%|████████▎ | 30175/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.46.gate_proj: 83%|████████▎ | 30176/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.46.up_proj: 83%|████████▎ | 30177/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.46.down_proj: 83%|████████▎ | 30178/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.47.gate_proj: 83%|████████▎ | 30179/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.47.up_proj: 83%|████████▎ | 30180/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.47.down_proj: 83%|████████▎ | 30181/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.48.gate_proj: 83%|████████▎ | 30182/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.48.up_proj: 83%|████████▎ | 30183/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.48.down_proj: 83%|████████▎ | 30184/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.49.gate_proj: 83%|████████▎ | 30185/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.49.up_proj: 83%|████████▎ | 30186/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.49.down_proj: 83%|████████▎ | 30187/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.50.gate_proj: 83%|████████▎ | 30188/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.50.up_proj: 83%|████████▎ | 30189/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.50.down_proj: 83%|████████▎ | 30190/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.51.gate_proj: 83%|████████▎ | 30191/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.51.up_proj: 83%|████████▎ | 30192/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.51.down_proj: 83%|████████▎ | 30193/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.52.gate_proj: 83%|████████▎ | 30194/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.52.up_proj: 83%|████████▎ | 30195/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.52.down_proj: 83%|████████▎ | 30196/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.53.gate_proj: 83%|████████▎ | 30197/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.53.up_proj: 83%|████████▎ | 30198/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.53.down_proj: 83%|████████▎ | 30199/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.54.gate_proj: 83%|████████▎ | 30200/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.54.up_proj: 83%|████████▎ | 30201/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.54.down_proj: 83%|████████▎ | 30202/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.55.gate_proj: 83%|████████▎ | 30203/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.55.up_proj: 83%|████████▎ | 30204/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.55.down_proj: 83%|████████▎ | 30205/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.56.gate_proj: 83%|████████▎ | 30206/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.56.up_proj: 83%|████████▎ | 30207/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.56.down_proj: 83%|████████▎ | 30208/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.57.gate_proj: 83%|████████▎ | 30209/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.57.up_proj: 83%|████████▎ | 30210/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.57.down_proj: 83%|████████▎ | 30211/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.58.gate_proj: 83%|████████▎ | 30212/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.58.up_proj: 83%|████████▎ | 30213/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.58.down_proj: 83%|████████▎ | 30214/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.59.gate_proj: 83%|████████▎ | 30215/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.59.up_proj: 83%|████████▎ | 30216/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.59.down_proj: 83%|████████▎ | 30217/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.60.gate_proj: 83%|████████▎ | 30218/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.60.up_proj: 83%|████████▎ | 30219/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.60.down_proj: 83%|████████▎ | 30220/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.61.gate_proj: 83%|████████▎ | 30221/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.61.up_proj: 83%|████████▎ | 30222/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.61.down_proj: 83%|████████▎ | 30223/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.62.gate_proj: 83%|████████▎ | 30224/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.62.up_proj: 83%|████████▎ | 30225/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.62.down_proj: 83%|████████▎ | 30226/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.63.gate_proj: 83%|████████▎ | 30227/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.63.up_proj: 83%|████████▎ | 30228/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.63.down_proj: 83%|████████▎ | 30229/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.64.gate_proj: 83%|████████▎ | 30230/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.64.up_proj: 83%|████████▎ | 30231/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.64.down_proj: 83%|████████▎ | 30232/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.65.gate_proj: 83%|████████▎ | 30233/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.65.up_proj: 83%|████████▎ | 30234/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.65.down_proj: 83%|████████▎ | 30235/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.66.gate_proj: 83%|████████▎ | 30236/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.66.up_proj: 83%|████████▎ | 30237/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.66.down_proj: 83%|████████▎ | 30238/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.67.gate_proj: 83%|████████▎ | 30239/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.67.up_proj: 83%|████████▎ | 30240/36566 [00:27<00:05, 1152.06it/s] packing model.layers.77.mlp.experts.67.up_proj: 83%|████████▎ | 30241/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.67.down_proj: 83%|████████▎ | 30241/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.68.gate_proj: 83%|████████▎ | 30242/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.68.up_proj: 83%|████████▎ | 30243/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.68.down_proj: 83%|████████▎ | 30244/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.69.gate_proj: 83%|████████▎ | 30245/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.69.up_proj: 83%|████████▎ | 30246/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.69.down_proj: 83%|████████▎ | 30247/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.70.gate_proj: 83%|████████▎ | 30248/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.70.up_proj: 83%|████████▎ | 30249/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.70.down_proj: 83%|████████▎ | 30250/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.71.gate_proj: 83%|████████▎ | 30251/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.71.up_proj: 83%|████████▎ | 30252/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.71.down_proj: 83%|████████▎ | 30253/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.72.gate_proj: 83%|████████▎ | 30254/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.72.up_proj: 83%|████████▎ | 30255/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.72.down_proj: 83%|████████▎ | 30256/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.73.gate_proj: 83%|████████▎ | 30257/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.73.up_proj: 83%|████████▎ | 30258/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.73.down_proj: 83%|████████▎ | 30259/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.74.gate_proj: 83%|████████▎ | 30260/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.74.up_proj: 83%|████████▎ | 30261/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.74.down_proj: 83%|████████▎ | 30262/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.75.gate_proj: 83%|████████▎ | 30263/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.75.up_proj: 83%|████████▎ | 30264/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.75.down_proj: 83%|████████▎ | 30265/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.76.gate_proj: 83%|████████▎ | 30266/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.76.up_proj: 83%|████████▎ | 30267/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.76.down_proj: 83%|████████▎ | 30268/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.77.gate_proj: 83%|████████▎ | 30269/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.77.up_proj: 83%|████████▎ | 30270/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.77.down_proj: 83%|████████▎ | 30271/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.78.gate_proj: 83%|████████▎ | 30272/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.78.up_proj: 83%|████████▎ | 30273/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.78.down_proj: 83%|████████▎ | 30274/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.79.gate_proj: 83%|████████▎ | 30275/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.79.up_proj: 83%|████████▎ | 30276/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.79.down_proj: 83%|████████▎ | 30277/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.80.gate_proj: 83%|████████▎ | 30278/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.80.up_proj: 83%|████████▎ | 30279/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.80.down_proj: 83%|████████▎ | 30280/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.81.gate_proj: 83%|████████▎ | 30281/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.81.up_proj: 83%|████████▎ | 30282/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.81.down_proj: 83%|████████▎ | 30283/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.82.gate_proj: 83%|████████▎ | 30284/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.82.up_proj: 83%|████████▎ | 30285/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.82.down_proj: 83%|████████▎ | 30286/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.83.gate_proj: 83%|████████▎ | 30287/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.83.up_proj: 83%|████████▎ | 30288/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.83.down_proj: 83%|████████▎ | 30289/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.84.gate_proj: 83%|████████▎ | 30290/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.84.up_proj: 83%|████████▎ | 30291/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.84.down_proj: 83%|████████▎ | 30292/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.85.gate_proj: 83%|████████▎ | 30293/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.85.up_proj: 83%|████████▎ | 30294/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.85.down_proj: 83%|████████▎ | 30295/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.86.gate_proj: 83%|████████▎ | 30296/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.86.up_proj: 83%|████████▎ | 30297/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.86.down_proj: 83%|████████▎ | 30298/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.87.gate_proj: 83%|████████▎ | 30299/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.87.up_proj: 83%|████████▎ | 30300/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.87.down_proj: 83%|████████▎ | 30301/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.88.gate_proj: 83%|████████▎ | 30302/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.88.up_proj: 83%|████████▎ | 30303/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.88.down_proj: 83%|████████▎ | 30304/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.89.gate_proj: 83%|████████▎ | 30305/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.89.up_proj: 83%|████████▎ | 30306/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.89.down_proj: 83%|████████▎ | 30307/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.90.gate_proj: 83%|████████▎ | 30308/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.90.up_proj: 83%|████████▎ | 30309/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.90.down_proj: 83%|████████▎ | 30310/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.91.gate_proj: 83%|████████▎ | 30311/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.91.up_proj: 83%|████████▎ | 30312/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.91.down_proj: 83%|████████▎ | 30313/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.92.gate_proj: 83%|████████▎ | 30314/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.92.up_proj: 83%|████████▎ | 30315/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.92.down_proj: 83%|████████▎ | 30316/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.93.gate_proj: 83%|████████▎ | 30317/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.93.up_proj: 83%|████████▎ | 30318/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.93.down_proj: 83%|████████▎ | 30319/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.94.gate_proj: 83%|████████▎ | 30320/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.94.up_proj: 83%|████████▎ | 30321/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.94.down_proj: 83%|████████▎ | 30322/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.95.gate_proj: 83%|████████▎ | 30323/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.95.up_proj: 83%|████████▎ | 30324/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.95.down_proj: 83%|████████▎ | 30325/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.96.gate_proj: 83%|████████▎ | 30326/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.96.up_proj: 83%|████████▎ | 30327/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.96.down_proj: 83%|████████▎ | 30328/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.97.gate_proj: 83%|████████▎ | 30329/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.97.up_proj: 83%|████████▎ | 30330/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.97.down_proj: 83%|████████▎ | 30331/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.98.gate_proj: 83%|████████▎ | 30332/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.98.up_proj: 83%|████████▎ | 30333/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.98.down_proj: 83%|████████▎ | 30334/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.99.gate_proj: 83%|████████▎ | 30335/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.99.up_proj: 83%|████████▎ | 30336/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.99.down_proj: 83%|████████▎ | 30337/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.100.gate_proj: 83%|████████▎ | 30338/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.100.up_proj: 83%|████████▎ | 30339/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.100.down_proj: 83%|████████▎ | 30340/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.101.gate_proj: 83%|████████▎ | 30341/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.101.up_proj: 83%|████████▎ | 30342/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.101.down_proj: 83%|████████▎ | 30343/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.102.gate_proj: 83%|████████▎ | 30344/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.102.up_proj: 83%|████████▎ | 30345/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.102.down_proj: 83%|████████▎ | 30346/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.103.gate_proj: 83%|████████▎ | 30347/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.103.up_proj: 83%|████████▎ | 30348/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.103.down_proj: 83%|████████▎ | 30349/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.104.gate_proj: 83%|████████▎ | 30350/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.104.up_proj: 83%|████████▎ | 30351/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.104.down_proj: 83%|████████▎ | 30352/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.105.gate_proj: 83%|████████▎ | 30353/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.105.up_proj: 83%|████████▎ | 30354/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.105.down_proj: 83%|████████▎ | 30355/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.106.gate_proj: 83%|████████▎ | 30356/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.106.up_proj: 83%|████████▎ | 30357/36566 [00:27<00:05, 1156.32it/s] packing model.layers.77.mlp.experts.106.up_proj: 83%|████████▎ | 30358/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.106.down_proj: 83%|████████▎ | 30358/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.107.gate_proj: 83%|████████▎ | 30359/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.107.up_proj: 83%|████████▎ | 30360/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.107.down_proj: 83%|████████▎ | 30361/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.108.gate_proj: 83%|████████▎ | 30362/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.108.up_proj: 83%|████████▎ | 30363/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.108.down_proj: 83%|████████▎ | 30364/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.109.gate_proj: 83%|████████▎ | 30365/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.109.up_proj: 83%|████████▎ | 30366/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.109.down_proj: 83%|████████▎ | 30367/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.110.gate_proj: 83%|████████▎ | 30368/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.110.up_proj: 83%|████████▎ | 30369/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.110.down_proj: 83%|████████▎ | 30370/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.111.gate_proj: 83%|████████▎ | 30371/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.111.up_proj: 83%|████████▎ | 30372/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.111.down_proj: 83%|████████▎ | 30373/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.112.gate_proj: 83%|████████▎ | 30374/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.112.up_proj: 83%|████████▎ | 30375/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.112.down_proj: 83%|████████▎ | 30376/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.113.gate_proj: 83%|████████▎ | 30377/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.113.up_proj: 83%|████████▎ | 30378/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.113.down_proj: 83%|████████▎ | 30379/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.114.gate_proj: 83%|████████▎ | 30380/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.114.up_proj: 83%|████████▎ | 30381/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.114.down_proj: 83%|████████▎ | 30382/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.115.gate_proj: 83%|████████▎ | 30383/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.115.up_proj: 83%|████████▎ | 30384/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.115.down_proj: 83%|████████▎ | 30385/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.116.gate_proj: 83%|████████▎ | 30386/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.116.up_proj: 83%|████████▎ | 30387/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.116.down_proj: 83%|████████▎ | 30388/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.117.gate_proj: 83%|████████▎ | 30389/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.117.up_proj: 83%|████████▎ | 30390/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.117.down_proj: 83%|████████▎ | 30391/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.118.gate_proj: 83%|████████▎ | 30392/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.118.up_proj: 83%|████████▎ | 30393/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.118.down_proj: 83%|████████▎ | 30394/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.119.gate_proj: 83%|████████▎ | 30395/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.119.up_proj: 83%|████████▎ | 30396/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.119.down_proj: 83%|████████▎ | 30397/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.120.gate_proj: 83%|████████▎ | 30398/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.120.up_proj: 83%|████████▎ | 30399/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.120.down_proj: 83%|████████▎ | 30400/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.121.gate_proj: 83%|████████▎ | 30401/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.121.up_proj: 83%|████████▎ | 30402/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.121.down_proj: 83%|████████▎ | 30403/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.122.gate_proj: 83%|████████▎ | 30404/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.122.up_proj: 83%|████████▎ | 30405/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.122.down_proj: 83%|████████▎ | 30406/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.123.gate_proj: 83%|████████▎ | 30407/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.123.up_proj: 83%|████████▎ | 30408/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.123.down_proj: 83%|████████▎ | 30409/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.124.gate_proj: 83%|████████▎ | 30410/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.124.up_proj: 83%|████████▎ | 30411/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.124.down_proj: 83%|████████▎ | 30412/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.125.gate_proj: 83%|████████▎ | 30413/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.125.up_proj: 83%|████████▎ | 30414/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.125.down_proj: 83%|████████▎ | 30415/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.126.gate_proj: 83%|████████▎ | 30416/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.126.up_proj: 83%|████████▎ | 30417/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.126.down_proj: 83%|████████▎ | 30418/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.127.gate_proj: 83%|████████▎ | 30419/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.127.up_proj: 83%|████████▎ | 30420/36566 [00:27<00:05, 1157.65it/s] packing model.layers.77.mlp.experts.127.down_proj: 83%|████████▎ | 30421/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.0.gate_proj: 83%|████████▎ | 30422/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.0.up_proj: 83%|████████▎ | 30423/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.0.down_proj: 83%|████████▎ | 30424/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.1.gate_proj: 83%|████████▎ | 30425/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.1.up_proj: 83%|████████▎ | 30426/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.1.down_proj: 83%|████████▎ | 30427/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.2.gate_proj: 83%|████████▎ | 30428/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.2.up_proj: 83%|████████▎ | 30429/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.2.down_proj: 83%|████████▎ | 30430/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.3.gate_proj: 83%|████████▎ | 30431/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.3.up_proj: 83%|████████▎ | 30432/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.3.down_proj: 83%|████████▎ | 30433/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.4.gate_proj: 83%|████████▎ | 30434/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.4.up_proj: 83%|████████▎ | 30435/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.4.down_proj: 83%|████████▎ | 30436/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.5.gate_proj: 83%|████████▎ | 30437/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.5.up_proj: 83%|████████▎ | 30438/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.5.down_proj: 83%|████████▎ | 30439/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.6.gate_proj: 83%|████████▎ | 30440/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.6.up_proj: 83%|████████▎ | 30441/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.6.down_proj: 83%|████████▎ | 30442/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.7.gate_proj: 83%|████████▎ | 30443/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.7.up_proj: 83%|████████▎ | 30444/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.7.down_proj: 83%|████████▎ | 30445/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.8.gate_proj: 83%|████████▎ | 30446/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.8.up_proj: 83%|████████▎ | 30447/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.8.down_proj: 83%|████████▎ | 30448/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.9.gate_proj: 83%|████████▎ | 30449/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.9.up_proj: 83%|████████▎ | 30450/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.9.down_proj: 83%|████████▎ | 30451/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.10.gate_proj: 83%|████████▎ | 30452/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.10.up_proj: 83%|████████▎ | 30453/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.10.down_proj: 83%|████████▎ | 30454/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.11.gate_proj: 83%|████████▎ | 30455/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.11.up_proj: 83%|████████▎ | 30456/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.11.down_proj: 83%|████████▎ | 30457/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.12.gate_proj: 83%|████████▎ | 30458/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.12.up_proj: 83%|████████▎ | 30459/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.12.down_proj: 83%|████████▎ | 30460/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.13.gate_proj: 83%|████████▎ | 30461/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.13.up_proj: 83%|████████▎ | 30462/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.13.down_proj: 83%|████████▎ | 30463/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.14.gate_proj: 83%|████████▎ | 30464/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.14.up_proj: 83%|████████▎ | 30465/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.14.down_proj: 83%|████████▎ | 30466/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.15.gate_proj: 83%|████████▎ | 30467/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.15.up_proj: 83%|████████▎ | 30468/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.15.down_proj: 83%|████████▎ | 30469/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.16.gate_proj: 83%|████████▎ | 30470/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.16.up_proj: 83%|████████▎ | 30471/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.16.down_proj: 83%|████████▎ | 30472/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.17.gate_proj: 83%|████████▎ | 30473/36566 [00:27<00:05, 1157.65it/s] packing model.layers.78.mlp.experts.17.gate_proj: 83%|████████▎ | 30474/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.17.up_proj: 83%|████████▎ | 30474/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.17.down_proj: 83%|████████▎ | 30475/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.18.gate_proj: 83%|████████▎ | 30476/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.18.up_proj: 83%|████████▎ | 30477/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.18.down_proj: 83%|████████▎ | 30478/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.19.gate_proj: 83%|████████▎ | 30479/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.19.up_proj: 83%|████████▎ | 30480/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.19.down_proj: 83%|████████▎ | 30481/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.20.gate_proj: 83%|████████▎ | 30482/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.20.up_proj: 83%|████████▎ | 30483/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.20.down_proj: 83%|████████▎ | 30484/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.21.gate_proj: 83%|████████▎ | 30485/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.21.up_proj: 83%|████████▎ | 30486/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.21.down_proj: 83%|████████▎ | 30487/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.22.gate_proj: 83%|████████▎ | 30488/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.22.up_proj: 83%|████████▎ | 30489/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.22.down_proj: 83%|████████▎ | 30490/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.23.gate_proj: 83%|████████▎ | 30491/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.23.up_proj: 83%|████████▎ | 30492/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.23.down_proj: 83%|████████▎ | 30493/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.24.gate_proj: 83%|████████▎ | 30494/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.24.up_proj: 83%|████████▎ | 30495/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.24.down_proj: 83%|████████▎ | 30496/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.25.gate_proj: 83%|████████▎ | 30497/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.25.up_proj: 83%|████████▎ | 30498/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.25.down_proj: 83%|████████▎ | 30499/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.26.gate_proj: 83%|████████▎ | 30500/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.26.up_proj: 83%|████████▎ | 30501/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.26.down_proj: 83%|████████▎ | 30502/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.27.gate_proj: 83%|████████▎ | 30503/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.27.up_proj: 83%|████████▎ | 30504/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.27.down_proj: 83%|████████▎ | 30505/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.28.gate_proj: 83%|████████▎ | 30506/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.28.up_proj: 83%|████████▎ | 30507/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.28.down_proj: 83%|████████▎ | 30508/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.29.gate_proj: 83%|████████▎ | 30509/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.29.up_proj: 83%|████████▎ | 30510/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.29.down_proj: 83%|████████▎ | 30511/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.30.gate_proj: 83%|████████▎ | 30512/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.30.up_proj: 83%|████████▎ | 30513/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.30.down_proj: 83%|████████▎ | 30514/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.31.gate_proj: 83%|████████▎ | 30515/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.31.up_proj: 83%|████████▎ | 30516/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.31.down_proj: 83%|████████▎ | 30517/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.32.gate_proj: 83%|████████▎ | 30518/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.32.up_proj: 83%|████████▎ | 30519/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.32.down_proj: 83%|████████▎ | 30520/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.33.gate_proj: 83%|████████▎ | 30521/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.33.up_proj: 83%|████████▎ | 30522/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.33.down_proj: 83%|████████▎ | 30523/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.34.gate_proj: 83%|████████▎ | 30524/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.34.up_proj: 83%|████████▎ | 30525/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.34.down_proj: 83%|████████▎ | 30526/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.35.gate_proj: 83%|████████▎ | 30527/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.35.up_proj: 83%|████████▎ | 30528/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.35.down_proj: 83%|████████▎ | 30529/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.36.gate_proj: 83%|████████▎ | 30530/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.36.up_proj: 83%|████████▎ | 30531/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.36.down_proj: 83%|████████▎ | 30532/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.37.gate_proj: 84%|████████▎ | 30533/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.37.up_proj: 84%|████████▎ | 30534/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.37.down_proj: 84%|████████▎ | 30535/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.38.gate_proj: 84%|████████▎ | 30536/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.38.up_proj: 84%|████████▎ | 30537/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.38.down_proj: 84%|████████▎ | 30538/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.39.gate_proj: 84%|████████▎ | 30539/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.39.up_proj: 84%|████████▎ | 30540/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.39.down_proj: 84%|████████▎ | 30541/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.40.gate_proj: 84%|████████▎ | 30542/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.40.up_proj: 84%|████████▎ | 30543/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.40.down_proj: 84%|████████▎ | 30544/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.41.gate_proj: 84%|████████▎ | 30545/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.41.up_proj: 84%|████████▎ | 30546/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.41.down_proj: 84%|████████▎ | 30547/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.42.gate_proj: 84%|████████▎ | 30548/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.42.up_proj: 84%|████████▎ | 30549/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.42.down_proj: 84%|████████▎ | 30550/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.43.gate_proj: 84%|████████▎ | 30551/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.43.up_proj: 84%|████████▎ | 30552/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.43.down_proj: 84%|████████▎ | 30553/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.44.gate_proj: 84%|████████▎ | 30554/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.44.up_proj: 84%|████████▎ | 30555/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.44.down_proj: 84%|████████▎ | 30556/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.45.gate_proj: 84%|████████▎ | 30557/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.45.up_proj: 84%|████████▎ | 30558/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.45.down_proj: 84%|████████▎ | 30559/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.46.gate_proj: 84%|████████▎ | 30560/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.46.up_proj: 84%|████████▎ | 30561/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.46.down_proj: 84%|████████▎ | 30562/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.47.gate_proj: 84%|████████▎ | 30563/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.47.up_proj: 84%|████████▎ | 30564/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.47.down_proj: 84%|████████▎ | 30565/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.48.gate_proj: 84%|████████▎ | 30566/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.48.up_proj: 84%|████████▎ | 30567/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.48.down_proj: 84%|████████▎ | 30568/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.49.gate_proj: 84%|████████▎ | 30569/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.49.up_proj: 84%|████████▎ | 30570/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.49.down_proj: 84%|████████▎ | 30571/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.50.gate_proj: 84%|████████▎ | 30572/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.50.up_proj: 84%|████████▎ | 30573/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.50.down_proj: 84%|████████▎ | 30574/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.51.gate_proj: 84%|████████▎ | 30575/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.51.up_proj: 84%|████████▎ | 30576/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.51.down_proj: 84%|████████▎ | 30577/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.52.gate_proj: 84%|████████▎ | 30578/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.52.up_proj: 84%|████████▎ | 30579/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.52.down_proj: 84%|████████▎ | 30580/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.53.gate_proj: 84%|████████▎ | 30581/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.53.up_proj: 84%|████████▎ | 30582/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.53.down_proj: 84%|████████▎ | 30583/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.54.gate_proj: 84%|████████▎ | 30584/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.54.up_proj: 84%|████████▎ | 30585/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.54.down_proj: 84%|████████▎ | 30586/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.55.gate_proj: 84%|████████▎ | 30587/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.55.up_proj: 84%|████████▎ | 30588/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.55.down_proj: 84%|████████▎ | 30589/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.56.gate_proj: 84%|████████▎ | 30590/36566 [00:27<00:05, 1153.75it/s] packing model.layers.78.mlp.experts.56.gate_proj: 84%|████████▎ | 30591/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.56.up_proj: 84%|████████▎ | 30591/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.56.down_proj: 84%|████████▎ | 30592/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.57.gate_proj: 84%|████████▎ | 30593/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.57.up_proj: 84%|████████▎ | 30594/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.57.down_proj: 84%|████████▎ | 30595/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.58.gate_proj: 84%|████████▎ | 30596/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.58.up_proj: 84%|████████▎ | 30597/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.58.down_proj: 84%|████████▎ | 30598/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.59.gate_proj: 84%|████████▎ | 30599/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.59.up_proj: 84%|████████▎ | 30600/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.59.down_proj: 84%|████████▎ | 30601/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.60.gate_proj: 84%|████████▎ | 30602/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.60.up_proj: 84%|████████▎ | 30603/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.60.down_proj: 84%|████████▎ | 30604/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.61.gate_proj: 84%|████████▎ | 30605/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.61.up_proj: 84%|████████▎ | 30606/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.61.down_proj: 84%|████████▎ | 30607/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.62.gate_proj: 84%|████████▎ | 30608/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.62.up_proj: 84%|████████▎ | 30609/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.62.down_proj: 84%|████████▎ | 30610/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.63.gate_proj: 84%|████████▎ | 30611/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.63.up_proj: 84%|████████▎ | 30612/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.63.down_proj: 84%|████████▎ | 30613/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.64.gate_proj: 84%|████████▎ | 30614/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.64.up_proj: 84%|████████▎ | 30615/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.64.down_proj: 84%|████████▎ | 30616/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.65.gate_proj: 84%|████████▎ | 30617/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.65.up_proj: 84%|████████▎ | 30618/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.65.down_proj: 84%|████████▎ | 30619/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.66.gate_proj: 84%|████████▎ | 30620/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.66.up_proj: 84%|████████▎ | 30621/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.66.down_proj: 84%|████████▎ | 30622/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.67.gate_proj: 84%|████████▎ | 30623/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.67.up_proj: 84%|████████▎ | 30624/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.67.down_proj: 84%|████████▍ | 30625/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.68.gate_proj: 84%|████████▍ | 30626/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.68.up_proj: 84%|████████▍ | 30627/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.68.down_proj: 84%|████████▍ | 30628/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.69.gate_proj: 84%|████████▍ | 30629/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.69.up_proj: 84%|████████▍ | 30630/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.69.down_proj: 84%|████████▍ | 30631/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.70.gate_proj: 84%|████████▍ | 30632/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.70.up_proj: 84%|████████▍ | 30633/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.70.down_proj: 84%|████████▍ | 30634/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.71.gate_proj: 84%|████████▍ | 30635/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.71.up_proj: 84%|████████▍ | 30636/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.71.down_proj: 84%|████████▍ | 30637/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.72.gate_proj: 84%|████████▍ | 30638/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.72.up_proj: 84%|████████▍ | 30639/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.72.down_proj: 84%|████████▍ | 30640/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.73.gate_proj: 84%|████████▍ | 30641/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.73.up_proj: 84%|████████▍ | 30642/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.73.down_proj: 84%|████████▍ | 30643/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.74.gate_proj: 84%|████████▍ | 30644/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.74.up_proj: 84%|████████▍ | 30645/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.74.down_proj: 84%|████████▍ | 30646/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.75.gate_proj: 84%|████████▍ | 30647/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.75.up_proj: 84%|████████▍ | 30648/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.75.down_proj: 84%|████████▍ | 30649/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.76.gate_proj: 84%|████████▍ | 30650/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.76.up_proj: 84%|████████▍ | 30651/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.76.down_proj: 84%|████████▍ | 30652/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.77.gate_proj: 84%|████████▍ | 30653/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.77.up_proj: 84%|████████▍ | 30654/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.77.down_proj: 84%|████████▍ | 30655/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.78.gate_proj: 84%|████████▍ | 30656/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.78.up_proj: 84%|████████▍ | 30657/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.78.down_proj: 84%|████████▍ | 30658/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.79.gate_proj: 84%|████████▍ | 30659/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.79.up_proj: 84%|████████▍ | 30660/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.79.down_proj: 84%|████████▍ | 30661/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.80.gate_proj: 84%|████████▍ | 30662/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.80.up_proj: 84%|████████▍ | 30663/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.80.down_proj: 84%|████████▍ | 30664/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.81.gate_proj: 84%|████████▍ | 30665/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.81.up_proj: 84%|████████▍ | 30666/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.81.down_proj: 84%|████████▍ | 30667/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.82.gate_proj: 84%|████████▍ | 30668/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.82.up_proj: 84%|████████▍ | 30669/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.82.down_proj: 84%|████████▍ | 30670/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.83.gate_proj: 84%|████████▍ | 30671/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.83.up_proj: 84%|████████▍ | 30672/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.83.down_proj: 84%|████████▍ | 30673/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.84.gate_proj: 84%|████████▍ | 30674/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.84.up_proj: 84%|████████▍ | 30675/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.84.down_proj: 84%|████████▍ | 30676/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.85.gate_proj: 84%|████████▍ | 30677/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.85.up_proj: 84%|████████▍ | 30678/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.85.down_proj: 84%|████████▍ | 30679/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.86.gate_proj: 84%|████████▍ | 30680/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.86.up_proj: 84%|████████▍ | 30681/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.86.down_proj: 84%|████████▍ | 30682/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.87.gate_proj: 84%|████████▍ | 30683/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.87.up_proj: 84%|████████▍ | 30684/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.87.down_proj: 84%|████████▍ | 30685/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.88.gate_proj: 84%|████████▍ | 30686/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.88.up_proj: 84%|████████▍ | 30687/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.88.down_proj: 84%|████████▍ | 30688/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.89.gate_proj: 84%|████████▍ | 30689/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.89.up_proj: 84%|████████▍ | 30690/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.89.down_proj: 84%|████████▍ | 30691/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.90.gate_proj: 84%|████████▍ | 30692/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.90.up_proj: 84%|████████▍ | 30693/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.90.down_proj: 84%|████████▍ | 30694/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.91.gate_proj: 84%|████████▍ | 30695/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.91.up_proj: 84%|████████▍ | 30696/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.91.down_proj: 84%|████████▍ | 30697/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.92.gate_proj: 84%|████████▍ | 30698/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.92.up_proj: 84%|████████▍ | 30699/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.92.down_proj: 84%|████████▍ | 30700/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.93.gate_proj: 84%|████████▍ | 30701/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.93.up_proj: 84%|████████▍ | 30702/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.93.down_proj: 84%|████████▍ | 30703/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.94.gate_proj: 84%|████████▍ | 30704/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.94.up_proj: 84%|████████▍ | 30705/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.94.down_proj: 84%|████████▍ | 30706/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.95.gate_proj: 84%|████████▍ | 30707/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.95.up_proj: 84%|████████▍ | 30708/36566 [00:27<00:05, 1157.39it/s] packing model.layers.78.mlp.experts.95.up_proj: 84%|████████▍ | 30709/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.95.down_proj: 84%|████████▍ | 30709/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.96.gate_proj: 84%|████████▍ | 30710/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.96.up_proj: 84%|████████▍ | 30711/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.96.down_proj: 84%|████████▍ | 30712/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.97.gate_proj: 84%|████████▍ | 30713/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.97.up_proj: 84%|████████▍ | 30714/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.97.down_proj: 84%|████████▍ | 30715/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.98.gate_proj: 84%|████████▍ | 30716/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.98.up_proj: 84%|████████▍ | 30717/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.98.down_proj: 84%|████████▍ | 30718/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.99.gate_proj: 84%|████████▍ | 30719/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.99.up_proj: 84%|████████▍ | 30720/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.99.down_proj: 84%|████████▍ | 30721/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.100.gate_proj: 84%|████████▍ | 30722/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.100.up_proj: 84%|████████▍ | 30723/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.100.down_proj: 84%|████████▍ | 30724/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.101.gate_proj: 84%|████████▍ | 30725/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.101.up_proj: 84%|████████▍ | 30726/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.101.down_proj: 84%|████████▍ | 30727/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.102.gate_proj: 84%|████████▍ | 30728/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.102.up_proj: 84%|████████▍ | 30729/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.102.down_proj: 84%|████████▍ | 30730/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.103.gate_proj: 84%|████████▍ | 30731/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.103.up_proj: 84%|████████▍ | 30732/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.103.down_proj: 84%|████████▍ | 30733/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.104.gate_proj: 84%|████████▍ | 30734/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.104.up_proj: 84%|████████▍ | 30735/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.104.down_proj: 84%|████████▍ | 30736/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.105.gate_proj: 84%|████████▍ | 30737/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.105.up_proj: 84%|████████▍ | 30738/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.105.down_proj: 84%|████████▍ | 30739/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.106.gate_proj: 84%|████████▍ | 30740/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.106.up_proj: 84%|████████▍ | 30741/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.106.down_proj: 84%|████████▍ | 30742/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.107.gate_proj: 84%|████████▍ | 30743/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.107.up_proj: 84%|████████▍ | 30744/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.107.down_proj: 84%|████████▍ | 30745/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.108.gate_proj: 84%|████████▍ | 30746/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.108.up_proj: 84%|████████▍ | 30747/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.108.down_proj: 84%|████████▍ | 30748/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.109.gate_proj: 84%|████████▍ | 30749/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.109.up_proj: 84%|████████▍ | 30750/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.109.down_proj: 84%|████████▍ | 30751/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.110.gate_proj: 84%|████████▍ | 30752/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.110.up_proj: 84%|████████▍ | 30753/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.110.down_proj: 84%|████████▍ | 30754/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.111.gate_proj: 84%|████████▍ | 30755/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.111.up_proj: 84%|████████▍ | 30756/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.111.down_proj: 84%|████████▍ | 30757/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.112.gate_proj: 84%|████████▍ | 30758/36566 [00:27<00:05, 1161.43it/s] packing model.layers.78.mlp.experts.112.up_proj: 84%|████████▍ | 30759/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.112.down_proj: 84%|████████▍ | 30760/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.113.gate_proj: 84%|████████▍ | 30761/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.113.up_proj: 84%|████████▍ | 30762/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.113.down_proj: 84%|████████▍ | 30763/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.114.gate_proj: 84%|████████▍ | 30764/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.114.up_proj: 84%|████████▍ | 30765/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.114.down_proj: 84%|████████▍ | 30766/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.115.gate_proj: 84%|████████▍ | 30767/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.115.up_proj: 84%|████████▍ | 30768/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.115.down_proj: 84%|████████▍ | 30769/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.116.gate_proj: 84%|████████▍ | 30770/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.116.up_proj: 84%|████████▍ | 30771/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.116.down_proj: 84%|████████▍ | 30772/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.117.gate_proj: 84%|████████▍ | 30773/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.117.up_proj: 84%|████████▍ | 30774/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.117.down_proj: 84%|████████▍ | 30775/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.118.gate_proj: 84%|████████▍ | 30776/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.118.up_proj: 84%|████████▍ | 30777/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.118.down_proj: 84%|████████▍ | 30778/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.119.gate_proj: 84%|████████▍ | 30779/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.119.up_proj: 84%|████████▍ | 30780/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.119.down_proj: 84%|████████▍ | 30781/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.120.gate_proj: 84%|████████▍ | 30782/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.120.up_proj: 84%|████████▍ | 30783/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.120.down_proj: 84%|████████▍ | 30784/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.121.gate_proj: 84%|████████▍ | 30785/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.121.up_proj: 84%|████████▍ | 30786/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.121.down_proj: 84%|████████▍ | 30787/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.122.gate_proj: 84%|████████▍ | 30788/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.122.up_proj: 84%|████████▍ | 30789/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.122.down_proj: 84%|████████▍ | 30790/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.123.gate_proj: 84%|████████▍ | 30791/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.123.up_proj: 84%|████████▍ | 30792/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.123.down_proj: 84%|████████▍ | 30793/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.124.gate_proj: 84%|████████▍ | 30794/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.124.up_proj: 84%|████████▍ | 30795/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.124.down_proj: 84%|████████▍ | 30796/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.125.gate_proj: 84%|████████▍ | 30797/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.125.up_proj: 84%|████████▍ | 30798/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.125.down_proj: 84%|████████▍ | 30799/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.126.gate_proj: 84%|████████▍ | 30800/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.126.up_proj: 84%|████████▍ | 30801/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.126.down_proj: 84%|████████▍ | 30802/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.127.gate_proj: 84%|████████▍ | 30803/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.127.up_proj: 84%|████████▍ | 30804/36566 [00:27<00:04, 1161.43it/s] packing model.layers.78.mlp.experts.127.down_proj: 84%|████████▍ | 30805/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.0.gate_proj: 84%|████████▍ | 30806/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.0.up_proj: 84%|████████▍ | 30807/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.0.down_proj: 84%|████████▍ | 30808/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.1.gate_proj: 84%|████████▍ | 30809/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.1.up_proj: 84%|████████▍ | 30810/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.1.down_proj: 84%|████████▍ | 30811/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.2.gate_proj: 84%|████████▍ | 30812/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.2.up_proj: 84%|████████▍ | 30813/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.2.down_proj: 84%|████████▍ | 30814/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.3.gate_proj: 84%|████████▍ | 30815/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.3.up_proj: 84%|████████▍ | 30816/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.3.down_proj: 84%|████████▍ | 30817/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.4.gate_proj: 84%|████████▍ | 30818/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.4.up_proj: 84%|████████▍ | 30819/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.4.down_proj: 84%|████████▍ | 30820/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.5.gate_proj: 84%|████████▍ | 30821/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.5.up_proj: 84%|████████▍ | 30822/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.5.down_proj: 84%|████████▍ | 30823/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.6.gate_proj: 84%|████████▍ | 30824/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.6.up_proj: 84%|████████▍ | 30825/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.6.down_proj: 84%|████████▍ | 30826/36566 [00:27<00:04, 1161.43it/s] packing model.layers.79.mlp.experts.6.down_proj: 84%|████████▍ | 30827/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.7.gate_proj: 84%|████████▍ | 30827/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.7.up_proj: 84%|████████▍ | 30828/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.7.down_proj: 84%|████████▍ | 30829/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.8.gate_proj: 84%|████████▍ | 30830/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.8.up_proj: 84%|████████▍ | 30831/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.8.down_proj: 84%|████████▍ | 30832/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.9.gate_proj: 84%|████████▍ | 30833/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.9.up_proj: 84%|████████▍ | 30834/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.9.down_proj: 84%|████████▍ | 30835/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.10.gate_proj: 84%|████████▍ | 30836/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.10.up_proj: 84%|████████▍ | 30837/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.10.down_proj: 84%|████████▍ | 30838/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.11.gate_proj: 84%|████████▍ | 30839/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.11.up_proj: 84%|████████▍ | 30840/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.11.down_proj: 84%|████████▍ | 30841/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.12.gate_proj: 84%|████████▍ | 30842/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.12.up_proj: 84%|████████▍ | 30843/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.12.down_proj: 84%|████████▍ | 30844/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.13.gate_proj: 84%|████████▍ | 30845/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.13.up_proj: 84%|████████▍ | 30846/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.13.down_proj: 84%|████████▍ | 30847/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.14.gate_proj: 84%|████████▍ | 30848/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.14.up_proj: 84%|████████▍ | 30849/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.14.down_proj: 84%|████████▍ | 30850/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.15.gate_proj: 84%|████████▍ | 30851/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.15.up_proj: 84%|████████▍ | 30852/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.15.down_proj: 84%|████████▍ | 30853/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.16.gate_proj: 84%|████████▍ | 30854/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.16.up_proj: 84%|████████▍ | 30855/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.16.down_proj: 84%|████████▍ | 30856/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.17.gate_proj: 84%|████████▍ | 30857/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.17.up_proj: 84%|████████▍ | 30858/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.17.down_proj: 84%|████████▍ | 30859/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.18.gate_proj: 84%|████████▍ | 30860/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.18.up_proj: 84%|████████▍ | 30861/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.18.down_proj: 84%|████████▍ | 30862/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.19.gate_proj: 84%|████████▍ | 30863/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.19.up_proj: 84%|████████▍ | 30864/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.19.down_proj: 84%|████████▍ | 30865/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.20.gate_proj: 84%|████████▍ | 30866/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.20.up_proj: 84%|████████▍ | 30867/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.20.down_proj: 84%|████████▍ | 30868/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.21.gate_proj: 84%|████████▍ | 30869/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.21.up_proj: 84%|████████▍ | 30870/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.21.down_proj: 84%|████████▍ | 30871/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.22.gate_proj: 84%|████████▍ | 30872/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.22.up_proj: 84%|████████▍ | 30873/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.22.down_proj: 84%|████████▍ | 30874/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.23.gate_proj: 84%|████████▍ | 30875/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.23.up_proj: 84%|████████▍ | 30876/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.23.down_proj: 84%|████████▍ | 30877/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.24.gate_proj: 84%|████████▍ | 30878/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.24.up_proj: 84%|████████▍ | 30879/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.24.down_proj: 84%|████████▍ | 30880/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.25.gate_proj: 84%|████████▍ | 30881/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.25.up_proj: 84%|████████▍ | 30882/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.25.down_proj: 84%|████████▍ | 30883/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.26.gate_proj: 84%|████████▍ | 30884/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.26.up_proj: 84%|████████▍ | 30885/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.26.down_proj: 84%|████████▍ | 30886/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.27.gate_proj: 84%|████████▍ | 30887/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.27.up_proj: 84%|████████▍ | 30888/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.27.down_proj: 84%|████████▍ | 30889/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.28.gate_proj: 84%|████████▍ | 30890/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.28.up_proj: 84%|████████▍ | 30891/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.28.down_proj: 84%|████████▍ | 30892/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.29.gate_proj: 84%|████████▍ | 30893/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.29.up_proj: 84%|████████▍ | 30894/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.29.down_proj: 84%|████████▍ | 30895/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.30.gate_proj: 84%|████████▍ | 30896/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.30.up_proj: 84%|████████▍ | 30897/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.30.down_proj: 84%|████████▍ | 30898/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.31.gate_proj: 85%|████████▍ | 30899/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.31.up_proj: 85%|████████▍ | 30900/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.31.down_proj: 85%|████████▍ | 30901/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.32.gate_proj: 85%|████████▍ | 30902/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.32.up_proj: 85%|████████▍ | 30903/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.32.down_proj: 85%|████████▍ | 30904/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.33.gate_proj: 85%|████████▍ | 30905/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.33.up_proj: 85%|████████▍ | 30906/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.33.down_proj: 85%|████████▍ | 30907/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.34.gate_proj: 85%|████████▍ | 30908/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.34.up_proj: 85%|████████▍ | 30909/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.34.down_proj: 85%|████████▍ | 30910/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.35.gate_proj: 85%|████████▍ | 30911/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.35.up_proj: 85%|████████▍ | 30912/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.35.down_proj: 85%|████████▍ | 30913/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.36.gate_proj: 85%|████████▍ | 30914/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.36.up_proj: 85%|████████▍ | 30915/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.36.down_proj: 85%|████████▍ | 30916/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.37.gate_proj: 85%|████████▍ | 30917/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.37.up_proj: 85%|████████▍ | 30918/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.37.down_proj: 85%|████████▍ | 30919/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.38.gate_proj: 85%|████████▍ | 30920/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.38.up_proj: 85%|████████▍ | 30921/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.38.down_proj: 85%|████████▍ | 30922/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.39.gate_proj: 85%|████████▍ | 30923/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.39.up_proj: 85%|████████▍ | 30924/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.39.down_proj: 85%|████████▍ | 30925/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.40.gate_proj: 85%|████████▍ | 30926/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.40.up_proj: 85%|████████▍ | 30927/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.40.down_proj: 85%|████████▍ | 30928/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.41.gate_proj: 85%|████████▍ | 30929/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.41.up_proj: 85%|████████▍ | 30930/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.41.down_proj: 85%|████████▍ | 30931/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.42.gate_proj: 85%|████████▍ | 30932/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.42.up_proj: 85%|████████▍ | 30933/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.42.down_proj: 85%|████████▍ | 30934/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.43.gate_proj: 85%|████████▍ | 30935/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.43.up_proj: 85%|████████▍ | 30936/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.43.down_proj: 85%|████████▍ | 30937/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.44.gate_proj: 85%|████████▍ | 30938/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.44.up_proj: 85%|████████▍ | 30939/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.44.down_proj: 85%|████████▍ | 30940/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.45.gate_proj: 85%|████████▍ | 30941/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.45.up_proj: 85%|████████▍ | 30942/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.45.down_proj: 85%|████████▍ | 30943/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.46.gate_proj: 85%|████████▍ | 30944/36566 [00:27<00:04, 1165.09it/s] packing model.layers.79.mlp.experts.46.gate_proj: 85%|████████▍ | 30945/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.46.up_proj: 85%|████████▍ | 30945/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.46.down_proj: 85%|████████▍ | 30946/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.47.gate_proj: 85%|████████▍ | 30947/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.47.up_proj: 85%|████████▍ | 30948/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.47.down_proj: 85%|████████▍ | 30949/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.48.gate_proj: 85%|████████▍ | 30950/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.48.up_proj: 85%|████████▍ | 30951/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.48.down_proj: 85%|████████▍ | 30952/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.49.gate_proj: 85%|████████▍ | 30953/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.49.up_proj: 85%|████████▍ | 30954/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.49.down_proj: 85%|████████▍ | 30955/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.50.gate_proj: 85%|████████▍ | 30956/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.50.up_proj: 85%|████████▍ | 30957/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.50.down_proj: 85%|████████▍ | 30958/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.51.gate_proj: 85%|████████▍ | 30959/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.51.up_proj: 85%|████████▍ | 30960/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.51.down_proj: 85%|████████▍ | 30961/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.52.gate_proj: 85%|████████▍ | 30962/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.52.up_proj: 85%|████████▍ | 30963/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.52.down_proj: 85%|████████▍ | 30964/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.53.gate_proj: 85%|████████▍ | 30965/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.53.up_proj: 85%|████████▍ | 30966/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.53.down_proj: 85%|████████▍ | 30967/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.54.gate_proj: 85%|████████▍ | 30968/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.54.up_proj: 85%|████████▍ | 30969/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.54.down_proj: 85%|████████▍ | 30970/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.55.gate_proj: 85%|████████▍ | 30971/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.55.up_proj: 85%|████████▍ | 30972/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.55.down_proj: 85%|████████▍ | 30973/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.56.gate_proj: 85%|████████▍ | 30974/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.56.up_proj: 85%|████████▍ | 30975/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.56.down_proj: 85%|████████▍ | 30976/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.57.gate_proj: 85%|████████▍ | 30977/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.57.up_proj: 85%|████████▍ | 30978/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.57.down_proj: 85%|████████▍ | 30979/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.58.gate_proj: 85%|████████▍ | 30980/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.58.up_proj: 85%|████████▍ | 30981/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.58.down_proj: 85%|████████▍ | 30982/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.59.gate_proj: 85%|████████▍ | 30983/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.59.up_proj: 85%|████████▍ | 30984/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.59.down_proj: 85%|████████▍ | 30985/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.60.gate_proj: 85%|████████▍ | 30986/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.60.up_proj: 85%|████████▍ | 30987/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.60.down_proj: 85%|████████▍ | 30988/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.61.gate_proj: 85%|████████▍ | 30989/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.61.up_proj: 85%|████████▍ | 30990/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.61.down_proj: 85%|████████▍ | 30991/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.62.gate_proj: 85%|████████▍ | 30992/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.62.up_proj: 85%|████████▍ | 30993/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.62.down_proj: 85%|████████▍ | 30994/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.63.gate_proj: 85%|████████▍ | 30995/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.63.up_proj: 85%|████████▍ | 30996/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.63.down_proj: 85%|████████▍ | 30997/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.64.gate_proj: 85%|████████▍ | 30998/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.64.up_proj: 85%|████████▍ | 30999/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.64.down_proj: 85%|████████▍ | 31000/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.65.gate_proj: 85%|████████▍ | 31001/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.65.up_proj: 85%|████████▍ | 31002/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.65.down_proj: 85%|████████▍ | 31003/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.66.gate_proj: 85%|████████▍ | 31004/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.66.up_proj: 85%|████████▍ | 31005/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.66.down_proj: 85%|████████▍ | 31006/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.67.gate_proj: 85%|████████▍ | 31007/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.67.up_proj: 85%|████████▍ | 31008/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.67.down_proj: 85%|████████▍ | 31009/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.68.gate_proj: 85%|████████▍ | 31010/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.68.up_proj: 85%|████████▍ | 31011/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.68.down_proj: 85%|████████▍ | 31012/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.69.gate_proj: 85%|████████▍ | 31013/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.69.up_proj: 85%|████████▍ | 31014/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.69.down_proj: 85%|████████▍ | 31015/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.70.gate_proj: 85%|████████▍ | 31016/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.70.up_proj: 85%|████████▍ | 31017/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.70.down_proj: 85%|████████▍ | 31018/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.71.gate_proj: 85%|████████▍ | 31019/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.71.up_proj: 85%|████████▍ | 31020/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.71.down_proj: 85%|████████▍ | 31021/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.72.gate_proj: 85%|████████▍ | 31022/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.72.up_proj: 85%|████████▍ | 31023/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.72.down_proj: 85%|████████▍ | 31024/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.73.gate_proj: 85%|████████▍ | 31025/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.73.up_proj: 85%|████████▍ | 31026/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.73.down_proj: 85%|████████▍ | 31027/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.74.gate_proj: 85%|████████▍ | 31028/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.74.up_proj: 85%|████████▍ | 31029/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.74.down_proj: 85%|████████▍ | 31030/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.75.gate_proj: 85%|████████▍ | 31031/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.75.up_proj: 85%|████████▍ | 31032/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.75.down_proj: 85%|████████▍ | 31033/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.76.gate_proj: 85%|████████▍ | 31034/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.76.up_proj: 85%|████████▍ | 31035/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.76.down_proj: 85%|████████▍ | 31036/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.77.gate_proj: 85%|████████▍ | 31037/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.77.up_proj: 85%|████████▍ | 31038/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.77.down_proj: 85%|████████▍ | 31039/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.78.gate_proj: 85%|████████▍ | 31040/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.78.up_proj: 85%|████████▍ | 31041/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.78.down_proj: 85%|████████▍ | 31042/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.79.gate_proj: 85%|████████▍ | 31043/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.79.up_proj: 85%|████████▍ | 31044/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.79.down_proj: 85%|████████▍ | 31045/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.80.gate_proj: 85%|████████▍ | 31046/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.80.up_proj: 85%|████████▍ | 31047/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.80.down_proj: 85%|████████▍ | 31048/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.81.gate_proj: 85%|████████▍ | 31049/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.81.up_proj: 85%|████████▍ | 31050/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.81.down_proj: 85%|████████▍ | 31051/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.82.gate_proj: 85%|████████▍ | 31052/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.82.up_proj: 85%|████████▍ | 31053/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.82.down_proj: 85%|████████▍ | 31054/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.83.gate_proj: 85%|████████▍ | 31055/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.83.up_proj: 85%|████████▍ | 31056/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.83.down_proj: 85%|████████▍ | 31057/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.84.gate_proj: 85%|████████▍ | 31058/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.84.up_proj: 85%|████████▍ | 31059/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.84.down_proj: 85%|████████▍ | 31060/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.85.gate_proj: 85%|████████▍ | 31061/36566 [00:27<00:04, 1168.27it/s] packing model.layers.79.mlp.experts.85.gate_proj: 85%|████████▍ | 31062/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.85.up_proj: 85%|████████▍ | 31062/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.85.down_proj: 85%|████████▍ | 31063/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.86.gate_proj: 85%|████████▍ | 31064/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.86.up_proj: 85%|████████▍ | 31065/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.86.down_proj: 85%|████████▍ | 31066/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.87.gate_proj: 85%|████████▍ | 31067/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.87.up_proj: 85%|████████▍ | 31068/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.87.down_proj: 85%|████████▍ | 31069/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.88.gate_proj: 85%|████████▍ | 31070/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.88.up_proj: 85%|████████▍ | 31071/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.88.down_proj: 85%|████████▍ | 31072/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.89.gate_proj: 85%|████████▍ | 31073/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.89.up_proj: 85%|████████▍ | 31074/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.89.down_proj: 85%|████████▍ | 31075/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.90.gate_proj: 85%|████████▍ | 31076/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.90.up_proj: 85%|████████▍ | 31077/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.90.down_proj: 85%|████████▍ | 31078/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.91.gate_proj: 85%|████████▍ | 31079/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.91.up_proj: 85%|████████▍ | 31080/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.91.down_proj: 85%|████████▍ | 31081/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.92.gate_proj: 85%|████████▌ | 31082/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.92.up_proj: 85%|████████▌ | 31083/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.92.down_proj: 85%|████████▌ | 31084/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.93.gate_proj: 85%|████████▌ | 31085/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.93.up_proj: 85%|████████▌ | 31086/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.93.down_proj: 85%|████████▌ | 31087/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.94.gate_proj: 85%|████████▌ | 31088/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.94.up_proj: 85%|████████▌ | 31089/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.94.down_proj: 85%|████████▌ | 31090/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.95.gate_proj: 85%|████████▌ | 31091/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.95.up_proj: 85%|████████▌ | 31092/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.95.down_proj: 85%|████████▌ | 31093/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.96.gate_proj: 85%|████████▌ | 31094/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.96.up_proj: 85%|████████▌ | 31095/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.96.down_proj: 85%|████████▌ | 31096/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.97.gate_proj: 85%|████████▌ | 31097/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.97.up_proj: 85%|████████▌ | 31098/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.97.down_proj: 85%|████████▌ | 31099/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.98.gate_proj: 85%|████████▌ | 31100/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.98.up_proj: 85%|████████▌ | 31101/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.98.down_proj: 85%|████████▌ | 31102/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.99.gate_proj: 85%|████████▌ | 31103/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.99.up_proj: 85%|████████▌ | 31104/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.99.down_proj: 85%|████████▌ | 31105/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.100.gate_proj: 85%|████████▌ | 31106/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.100.up_proj: 85%|████████▌ | 31107/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.100.down_proj: 85%|████████▌ | 31108/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.101.gate_proj: 85%|████████▌ | 31109/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.101.up_proj: 85%|████████▌ | 31110/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.101.down_proj: 85%|████████▌ | 31111/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.102.gate_proj: 85%|████████▌ | 31112/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.102.up_proj: 85%|████████▌ | 31113/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.102.down_proj: 85%|████████▌ | 31114/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.103.gate_proj: 85%|████████▌ | 31115/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.103.up_proj: 85%|████████▌ | 31116/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.103.down_proj: 85%|████████▌ | 31117/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.104.gate_proj: 85%|████████▌ | 31118/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.104.up_proj: 85%|████████▌ | 31119/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.104.down_proj: 85%|████████▌ | 31120/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.105.gate_proj: 85%|████████▌ | 31121/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.105.up_proj: 85%|████████▌ | 31122/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.105.down_proj: 85%|████████▌ | 31123/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.106.gate_proj: 85%|████████▌ | 31124/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.106.up_proj: 85%|████████▌ | 31125/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.106.down_proj: 85%|████████▌ | 31126/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.107.gate_proj: 85%|████████▌ | 31127/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.107.up_proj: 85%|████████▌ | 31128/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.107.down_proj: 85%|████████▌ | 31129/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.108.gate_proj: 85%|████████▌ | 31130/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.108.up_proj: 85%|████████▌ | 31131/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.108.down_proj: 85%|████████▌ | 31132/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.109.gate_proj: 85%|████████▌ | 31133/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.109.up_proj: 85%|████████▌ | 31134/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.109.down_proj: 85%|████████▌ | 31135/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.110.gate_proj: 85%|████████▌ | 31136/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.110.up_proj: 85%|████████▌ | 31137/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.110.down_proj: 85%|████████▌ | 31138/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.111.gate_proj: 85%|████████▌ | 31139/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.111.up_proj: 85%|████████▌ | 31140/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.111.down_proj: 85%|████████▌ | 31141/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.112.gate_proj: 85%|████████▌ | 31142/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.112.up_proj: 85%|████████▌ | 31143/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.112.down_proj: 85%|████████▌ | 31144/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.113.gate_proj: 85%|████████▌ | 31145/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.113.up_proj: 85%|████████▌ | 31146/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.113.down_proj: 85%|████████▌ | 31147/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.114.gate_proj: 85%|████████▌ | 31148/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.114.up_proj: 85%|████████▌ | 31149/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.114.down_proj: 85%|████████▌ | 31150/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.115.gate_proj: 85%|████████▌ | 31151/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.115.up_proj: 85%|████████▌ | 31152/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.115.down_proj: 85%|████████▌ | 31153/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.116.gate_proj: 85%|████████▌ | 31154/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.116.up_proj: 85%|████████▌ | 31155/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.116.down_proj: 85%|████████▌ | 31156/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.117.gate_proj: 85%|████████▌ | 31157/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.117.up_proj: 85%|████████▌ | 31158/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.117.down_proj: 85%|████████▌ | 31159/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.118.gate_proj: 85%|████████▌ | 31160/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.118.up_proj: 85%|████████▌ | 31161/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.118.down_proj: 85%|████████▌ | 31162/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.119.gate_proj: 85%|████████▌ | 31163/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.119.up_proj: 85%|████████▌ | 31164/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.119.down_proj: 85%|████████▌ | 31165/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.120.gate_proj: 85%|████████▌ | 31166/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.120.up_proj: 85%|████████▌ | 31167/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.120.down_proj: 85%|████████▌ | 31168/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.121.gate_proj: 85%|████████▌ | 31169/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.121.up_proj: 85%|████████▌ | 31170/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.121.down_proj: 85%|████████▌ | 31171/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.122.gate_proj: 85%|████████▌ | 31172/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.122.up_proj: 85%|████████▌ | 31173/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.122.down_proj: 85%|████████▌ | 31174/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.123.gate_proj: 85%|████████▌ | 31175/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.123.up_proj: 85%|████████▌ | 31176/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.123.down_proj: 85%|████████▌ | 31177/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.124.gate_proj: 85%|████████▌ | 31178/36566 [00:27<00:04, 1167.21it/s] packing model.layers.79.mlp.experts.124.gate_proj: 85%|████████▌ | 31179/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.124.up_proj: 85%|████████▌ | 31179/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.124.down_proj: 85%|████████▌ | 31180/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.125.gate_proj: 85%|████████▌ | 31181/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.125.up_proj: 85%|████████▌ | 31182/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.125.down_proj: 85%|████████▌ | 31183/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.126.gate_proj: 85%|████████▌ | 31184/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.126.up_proj: 85%|████████▌ | 31185/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.126.down_proj: 85%|████████▌ | 31186/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.127.gate_proj: 85%|████████▌ | 31187/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.127.up_proj: 85%|████████▌ | 31188/36566 [00:27<00:04, 1167.14it/s] packing model.layers.79.mlp.experts.127.down_proj: 85%|████████▌ | 31189/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.0.gate_proj: 85%|████████▌ | 31190/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.0.up_proj: 85%|████████▌ | 31191/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.0.down_proj: 85%|████████▌ | 31192/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.1.gate_proj: 85%|████████▌ | 31193/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.1.up_proj: 85%|████████▌ | 31194/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.1.down_proj: 85%|████████▌ | 31195/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.2.gate_proj: 85%|████████▌ | 31196/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.2.up_proj: 85%|████████▌ | 31197/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.2.down_proj: 85%|████████▌ | 31198/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.3.gate_proj: 85%|████████▌ | 31199/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.3.up_proj: 85%|████████▌ | 31200/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.3.down_proj: 85%|████████▌ | 31201/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.4.gate_proj: 85%|████████▌ | 31202/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.4.up_proj: 85%|████████▌ | 31203/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.4.down_proj: 85%|████████▌ | 31204/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.5.gate_proj: 85%|████████▌ | 31205/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.5.up_proj: 85%|████████▌ | 31206/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.5.down_proj: 85%|████████▌ | 31207/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.6.gate_proj: 85%|████████▌ | 31208/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.6.up_proj: 85%|████████▌ | 31209/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.6.down_proj: 85%|████████▌ | 31210/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.7.gate_proj: 85%|████████▌ | 31211/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.7.up_proj: 85%|████████▌ | 31212/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.7.down_proj: 85%|████████▌ | 31213/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.8.gate_proj: 85%|████████▌ | 31214/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.8.up_proj: 85%|████████▌ | 31215/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.8.down_proj: 85%|████████▌ | 31216/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.9.gate_proj: 85%|████████▌ | 31217/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.9.up_proj: 85%|████████▌ | 31218/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.9.down_proj: 85%|████████▌ | 31219/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.10.gate_proj: 85%|████████▌ | 31220/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.10.up_proj: 85%|████████▌ | 31221/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.10.down_proj: 85%|████████▌ | 31222/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.11.gate_proj: 85%|████████▌ | 31223/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.11.up_proj: 85%|████████▌ | 31224/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.11.down_proj: 85%|████████▌ | 31225/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.12.gate_proj: 85%|████████▌ | 31226/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.12.up_proj: 85%|████████▌ | 31227/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.12.down_proj: 85%|████████▌ | 31228/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.13.gate_proj: 85%|████████▌ | 31229/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.13.up_proj: 85%|████████▌ | 31230/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.13.down_proj: 85%|████████▌ | 31231/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.14.gate_proj: 85%|████████▌ | 31232/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.14.up_proj: 85%|████████▌ | 31233/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.14.down_proj: 85%|████████▌ | 31234/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.15.gate_proj: 85%|████████▌ | 31235/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.15.up_proj: 85%|████████▌ | 31236/36566 [00:27<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.15.down_proj: 85%|████████▌ | 31237/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.16.gate_proj: 85%|████████▌ | 31238/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.16.up_proj: 85%|████████▌ | 31239/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.16.down_proj: 85%|████████▌ | 31240/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.17.gate_proj: 85%|████████▌ | 31241/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.17.up_proj: 85%|████████▌ | 31242/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.17.down_proj: 85%|████████▌ | 31243/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.18.gate_proj: 85%|████████▌ | 31244/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.18.up_proj: 85%|████████▌ | 31245/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.18.down_proj: 85%|████████▌ | 31246/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.19.gate_proj: 85%|████████▌ | 31247/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.19.up_proj: 85%|████████▌ | 31248/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.19.down_proj: 85%|████████▌ | 31249/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.20.gate_proj: 85%|████████▌ | 31250/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.20.up_proj: 85%|████████▌ | 31251/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.20.down_proj: 85%|████████▌ | 31252/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.21.gate_proj: 85%|████████▌ | 31253/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.21.up_proj: 85%|████████▌ | 31254/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.21.down_proj: 85%|████████▌ | 31255/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.22.gate_proj: 85%|████████▌ | 31256/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.22.up_proj: 85%|████████▌ | 31257/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.22.down_proj: 85%|████████▌ | 31258/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.23.gate_proj: 85%|████████▌ | 31259/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.23.up_proj: 85%|████████▌ | 31260/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.23.down_proj: 85%|████████▌ | 31261/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.24.gate_proj: 85%|████████▌ | 31262/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.24.up_proj: 85%|████████▌ | 31263/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.24.down_proj: 86%|████████▌ | 31264/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.25.gate_proj: 86%|████████▌ | 31265/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.25.up_proj: 86%|████████▌ | 31266/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.25.down_proj: 86%|████████▌ | 31267/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.26.gate_proj: 86%|████████▌ | 31268/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.26.up_proj: 86%|████████▌ | 31269/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.26.down_proj: 86%|████████▌ | 31270/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.27.gate_proj: 86%|████████▌ | 31271/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.27.up_proj: 86%|████████▌ | 31272/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.27.down_proj: 86%|████████▌ | 31273/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.28.gate_proj: 86%|████████▌ | 31274/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.28.up_proj: 86%|████████▌ | 31275/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.28.down_proj: 86%|████████▌ | 31276/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.29.gate_proj: 86%|████████▌ | 31277/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.29.up_proj: 86%|████████▌ | 31278/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.29.down_proj: 86%|████████▌ | 31279/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.30.gate_proj: 86%|████████▌ | 31280/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.30.up_proj: 86%|████████▌ | 31281/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.30.down_proj: 86%|████████▌ | 31282/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.31.gate_proj: 86%|████████▌ | 31283/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.31.up_proj: 86%|████████▌ | 31284/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.31.down_proj: 86%|████████▌ | 31285/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.32.gate_proj: 86%|████████▌ | 31286/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.32.up_proj: 86%|████████▌ | 31287/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.32.down_proj: 86%|████████▌ | 31288/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.33.gate_proj: 86%|████████▌ | 31289/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.33.up_proj: 86%|████████▌ | 31290/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.33.down_proj: 86%|████████▌ | 31291/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.34.gate_proj: 86%|████████▌ | 31292/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.34.up_proj: 86%|████████▌ | 31293/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.34.down_proj: 86%|████████▌ | 31294/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.35.gate_proj: 86%|████████▌ | 31295/36566 [00:28<00:04, 1167.14it/s] packing model.layers.80.mlp.experts.35.gate_proj: 86%|████████▌ | 31296/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.35.up_proj: 86%|████████▌ | 31296/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.35.down_proj: 86%|████████▌ | 31297/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.36.gate_proj: 86%|████████▌ | 31298/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.36.up_proj: 86%|████████▌ | 31299/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.36.down_proj: 86%|████████▌ | 31300/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.37.gate_proj: 86%|████████▌ | 31301/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.37.up_proj: 86%|████████▌ | 31302/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.37.down_proj: 86%|████████▌ | 31303/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.38.gate_proj: 86%|████████▌ | 31304/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.38.up_proj: 86%|████████▌ | 31305/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.38.down_proj: 86%|████████▌ | 31306/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.39.gate_proj: 86%|████████▌ | 31307/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.39.up_proj: 86%|████████▌ | 31308/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.39.down_proj: 86%|████████▌ | 31309/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.40.gate_proj: 86%|████████▌ | 31310/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.40.up_proj: 86%|████████▌ | 31311/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.40.down_proj: 86%|████████▌ | 31312/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.41.gate_proj: 86%|████████▌ | 31313/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.41.up_proj: 86%|████████▌ | 31314/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.41.down_proj: 86%|████████▌ | 31315/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.42.gate_proj: 86%|████████▌ | 31316/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.42.up_proj: 86%|████████▌ | 31317/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.42.down_proj: 86%|████████▌ | 31318/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.43.gate_proj: 86%|████████▌ | 31319/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.43.up_proj: 86%|████████▌ | 31320/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.43.down_proj: 86%|████████▌ | 31321/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.44.gate_proj: 86%|████████▌ | 31322/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.44.up_proj: 86%|████████▌ | 31323/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.44.down_proj: 86%|████████▌ | 31324/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.45.gate_proj: 86%|████████▌ | 31325/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.45.up_proj: 86%|████████▌ | 31326/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.45.down_proj: 86%|████████▌ | 31327/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.46.gate_proj: 86%|████████▌ | 31328/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.46.up_proj: 86%|████████▌ | 31329/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.46.down_proj: 86%|████████▌ | 31330/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.47.gate_proj: 86%|████████▌ | 31331/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.47.up_proj: 86%|████████▌ | 31332/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.47.down_proj: 86%|████████▌ | 31333/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.48.gate_proj: 86%|████████▌ | 31334/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.48.up_proj: 86%|████████▌ | 31335/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.48.down_proj: 86%|████████▌ | 31336/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.49.gate_proj: 86%|████████▌ | 31337/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.49.up_proj: 86%|████████▌ | 31338/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.49.down_proj: 86%|████████▌ | 31339/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.50.gate_proj: 86%|████████▌ | 31340/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.50.up_proj: 86%|████████▌ | 31341/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.50.down_proj: 86%|████████▌ | 31342/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.51.gate_proj: 86%|████████▌ | 31343/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.51.up_proj: 86%|████████▌ | 31344/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.51.down_proj: 86%|████████▌ | 31345/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.52.gate_proj: 86%|████████▌ | 31346/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.52.up_proj: 86%|████████▌ | 31347/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.52.down_proj: 86%|████████▌ | 31348/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.53.gate_proj: 86%|████████▌ | 31349/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.53.up_proj: 86%|████████▌ | 31350/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.53.down_proj: 86%|████████▌ | 31351/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.54.gate_proj: 86%|████████▌ | 31352/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.54.up_proj: 86%|████████▌ | 31353/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.54.down_proj: 86%|████████▌ | 31354/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.55.gate_proj: 86%|████████▌ | 31355/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.55.up_proj: 86%|████████▌ | 31356/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.55.down_proj: 86%|████████▌ | 31357/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.56.gate_proj: 86%|████████▌ | 31358/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.56.up_proj: 86%|████████▌ | 31359/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.56.down_proj: 86%|████████▌ | 31360/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.57.gate_proj: 86%|████████▌ | 31361/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.57.up_proj: 86%|████████▌ | 31362/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.57.down_proj: 86%|████████▌ | 31363/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.58.gate_proj: 86%|████████▌ | 31364/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.58.up_proj: 86%|████████▌ | 31365/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.58.down_proj: 86%|████████▌ | 31366/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.59.gate_proj: 86%|████████▌ | 31367/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.59.up_proj: 86%|████████▌ | 31368/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.59.down_proj: 86%|████████▌ | 31369/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.60.gate_proj: 86%|████████▌ | 31370/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.60.up_proj: 86%|████████▌ | 31371/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.60.down_proj: 86%|████████▌ | 31372/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.61.gate_proj: 86%|████████▌ | 31373/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.61.up_proj: 86%|████████▌ | 31374/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.61.down_proj: 86%|████████▌ | 31375/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.62.gate_proj: 86%|████████▌ | 31376/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.62.up_proj: 86%|████████▌ | 31377/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.62.down_proj: 86%|████████▌ | 31378/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.63.gate_proj: 86%|████████▌ | 31379/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.63.up_proj: 86%|████████▌ | 31380/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.63.down_proj: 86%|████████▌ | 31381/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.64.gate_proj: 86%|████████▌ | 31382/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.64.up_proj: 86%|████████▌ | 31383/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.64.down_proj: 86%|████████▌ | 31384/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.65.gate_proj: 86%|████████▌ | 31385/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.65.up_proj: 86%|████████▌ | 31386/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.65.down_proj: 86%|████████▌ | 31387/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.66.gate_proj: 86%|████████▌ | 31388/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.66.up_proj: 86%|████████▌ | 31389/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.66.down_proj: 86%|████████▌ | 31390/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.67.gate_proj: 86%|████████▌ | 31391/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.67.up_proj: 86%|████████▌ | 31392/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.67.down_proj: 86%|████████▌ | 31393/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.68.gate_proj: 86%|████████▌ | 31394/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.68.up_proj: 86%|████████▌ | 31395/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.68.down_proj: 86%|████████▌ | 31396/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.69.gate_proj: 86%|████████▌ | 31397/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.69.up_proj: 86%|████████▌ | 31398/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.69.down_proj: 86%|████████▌ | 31399/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.70.gate_proj: 86%|████████▌ | 31400/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.70.up_proj: 86%|████████▌ | 31401/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.70.down_proj: 86%|████████▌ | 31402/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.71.gate_proj: 86%|████████▌ | 31403/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.71.up_proj: 86%|████████▌ | 31404/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.71.down_proj: 86%|████████▌ | 31405/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.72.gate_proj: 86%|████████▌ | 31406/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.72.up_proj: 86%|████████▌ | 31407/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.72.down_proj: 86%|████████▌ | 31408/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.73.gate_proj: 86%|████████▌ | 31409/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.73.up_proj: 86%|████████▌ | 31410/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.73.down_proj: 86%|████████▌ | 31411/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.74.gate_proj: 86%|████████▌ | 31412/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.74.up_proj: 86%|████████▌ | 31413/36566 [00:28<00:04, 1166.15it/s] packing model.layers.80.mlp.experts.74.up_proj: 86%|████████▌ | 31414/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.74.down_proj: 86%|████████▌ | 31414/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.75.gate_proj: 86%|████████▌ | 31415/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.75.up_proj: 86%|████████▌ | 31416/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.75.down_proj: 86%|████████▌ | 31417/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.76.gate_proj: 86%|████████▌ | 31418/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.76.up_proj: 86%|████████▌ | 31419/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.76.down_proj: 86%|████████▌ | 31420/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.77.gate_proj: 86%|████████▌ | 31421/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.77.up_proj: 86%|████████▌ | 31422/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.77.down_proj: 86%|████████▌ | 31423/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.78.gate_proj: 86%|████████▌ | 31424/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.78.up_proj: 86%|████████▌ | 31425/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.78.down_proj: 86%|████████▌ | 31426/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.79.gate_proj: 86%|████████▌ | 31427/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.79.up_proj: 86%|████████▌ | 31428/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.79.down_proj: 86%|████████▌ | 31429/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.80.gate_proj: 86%|████████▌ | 31430/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.80.up_proj: 86%|████████▌ | 31431/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.80.down_proj: 86%|████████▌ | 31432/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.81.gate_proj: 86%|████████▌ | 31433/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.81.up_proj: 86%|████████▌ | 31434/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.81.down_proj: 86%|████████▌ | 31435/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.82.gate_proj: 86%|████████▌ | 31436/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.82.up_proj: 86%|████████▌ | 31437/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.82.down_proj: 86%|████████▌ | 31438/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.83.gate_proj: 86%|████████▌ | 31439/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.83.up_proj: 86%|████████▌ | 31440/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.83.down_proj: 86%|████████▌ | 31441/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.84.gate_proj: 86%|████████▌ | 31442/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.84.up_proj: 86%|████████▌ | 31443/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.84.down_proj: 86%|████████▌ | 31444/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.85.gate_proj: 86%|████████▌ | 31445/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.85.up_proj: 86%|████████▌ | 31446/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.85.down_proj: 86%|████████▌ | 31447/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.86.gate_proj: 86%|████████▌ | 31448/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.86.up_proj: 86%|████████▌ | 31449/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.86.down_proj: 86%|████████▌ | 31450/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.87.gate_proj: 86%|████████▌ | 31451/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.87.up_proj: 86%|████████▌ | 31452/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.87.down_proj: 86%|████████▌ | 31453/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.88.gate_proj: 86%|████████▌ | 31454/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.88.up_proj: 86%|████████▌ | 31455/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.88.down_proj: 86%|████████▌ | 31456/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.89.gate_proj: 86%|████████▌ | 31457/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.89.up_proj: 86%|████████▌ | 31458/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.89.down_proj: 86%|████████▌ | 31459/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.90.gate_proj: 86%|████████▌ | 31460/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.90.up_proj: 86%|████████▌ | 31461/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.90.down_proj: 86%|████████▌ | 31462/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.91.gate_proj: 86%|████████▌ | 31463/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.91.up_proj: 86%|████████▌ | 31464/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.91.down_proj: 86%|████████▌ | 31465/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.92.gate_proj: 86%|████████▌ | 31466/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.92.up_proj: 86%|████████▌ | 31467/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.92.down_proj: 86%|████████▌ | 31468/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.93.gate_proj: 86%|████████▌ | 31469/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.93.up_proj: 86%|████████▌ | 31470/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.93.down_proj: 86%|████████▌ | 31471/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.94.gate_proj: 86%|████████▌ | 31472/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.94.up_proj: 86%|████████▌ | 31473/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.94.down_proj: 86%|████████▌ | 31474/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.95.gate_proj: 86%|████████▌ | 31475/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.95.up_proj: 86%|████████▌ | 31476/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.95.down_proj: 86%|████████▌ | 31477/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.96.gate_proj: 86%|████████▌ | 31478/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.96.up_proj: 86%|████████▌ | 31479/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.96.down_proj: 86%|████████▌ | 31480/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.97.gate_proj: 86%|████████▌ | 31481/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.97.up_proj: 86%|████████▌ | 31482/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.97.down_proj: 86%|████████▌ | 31483/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.98.gate_proj: 86%|████████▌ | 31484/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.98.up_proj: 86%|████████▌ | 31485/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.98.down_proj: 86%|████████▌ | 31486/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.99.gate_proj: 86%|████████▌ | 31487/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.99.up_proj: 86%|████████▌ | 31488/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.99.down_proj: 86%|████████▌ | 31489/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.100.gate_proj: 86%|████████▌ | 31490/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.100.up_proj: 86%|████████▌ | 31491/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.100.down_proj: 86%|████████▌ | 31492/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.101.gate_proj: 86%|████████▌ | 31493/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.101.up_proj: 86%|████████▌ | 31494/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.101.down_proj: 86%|████████▌ | 31495/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.102.gate_proj: 86%|████████▌ | 31496/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.102.up_proj: 86%|████████▌ | 31497/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.102.down_proj: 86%|████████▌ | 31498/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.103.gate_proj: 86%|████████▌ | 31499/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.103.up_proj: 86%|████████▌ | 31500/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.103.down_proj: 86%|████████▌ | 31501/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.104.gate_proj: 86%|████████▌ | 31502/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.104.up_proj: 86%|████████▌ | 31503/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.104.down_proj: 86%|████████▌ | 31504/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.105.gate_proj: 86%|████████▌ | 31505/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.105.up_proj: 86%|████████▌ | 31506/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.105.down_proj: 86%|████████▌ | 31507/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.106.gate_proj: 86%|████████▌ | 31508/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.106.up_proj: 86%|████████▌ | 31509/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.106.down_proj: 86%|████████▌ | 31510/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.107.gate_proj: 86%|████████▌ | 31511/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.107.up_proj: 86%|████████▌ | 31512/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.107.down_proj: 86%|████████▌ | 31513/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.108.gate_proj: 86%|████████▌ | 31514/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.108.up_proj: 86%|████████▌ | 31515/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.108.down_proj: 86%|████████▌ | 31516/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.109.gate_proj: 86%|████████▌ | 31517/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.109.up_proj: 86%|████████▌ | 31518/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.109.down_proj: 86%|████████▌ | 31519/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.110.gate_proj: 86%|████████▌ | 31520/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.110.up_proj: 86%|████████▌ | 31521/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.110.down_proj: 86%|████████▌ | 31522/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.111.gate_proj: 86%|████████▌ | 31523/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.111.up_proj: 86%|████████▌ | 31524/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.111.down_proj: 86%|████████▌ | 31525/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.112.gate_proj: 86%|████████▌ | 31526/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.112.up_proj: 86%|████████▌ | 31527/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.112.down_proj: 86%|████████▌ | 31528/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.113.gate_proj: 86%|████████▌ | 31529/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.113.up_proj: 86%|████████▌ | 31530/36566 [00:28<00:04, 1168.30it/s] packing model.layers.80.mlp.experts.113.up_proj: 86%|████████▌ | 31531/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.113.down_proj: 86%|████████▌ | 31531/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.114.gate_proj: 86%|████████▌ | 31532/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.114.up_proj: 86%|████████▌ | 31533/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.114.down_proj: 86%|████████▌ | 31534/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.115.gate_proj: 86%|████████▌ | 31535/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.115.up_proj: 86%|████████▌ | 31536/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.115.down_proj: 86%|████████▌ | 31537/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.116.gate_proj: 86%|████████▌ | 31538/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.116.up_proj: 86%|████████▋ | 31539/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.116.down_proj: 86%|████████▋ | 31540/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.117.gate_proj: 86%|████████▋ | 31541/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.117.up_proj: 86%|████████▋ | 31542/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.117.down_proj: 86%|████████▋ | 31543/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.118.gate_proj: 86%|████████▋ | 31544/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.118.up_proj: 86%|████████▋ | 31545/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.118.down_proj: 86%|████████▋ | 31546/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.119.gate_proj: 86%|████████▋ | 31547/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.119.up_proj: 86%|████████▋ | 31548/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.119.down_proj: 86%|████████▋ | 31549/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.120.gate_proj: 86%|████████▋ | 31550/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.120.up_proj: 86%|████████▋ | 31551/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.120.down_proj: 86%|████████▋ | 31552/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.121.gate_proj: 86%|████████▋ | 31553/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.121.up_proj: 86%|████████▋ | 31554/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.121.down_proj: 86%|████████▋ | 31555/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.122.gate_proj: 86%|████████▋ | 31556/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.122.up_proj: 86%|████████▋ | 31557/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.122.down_proj: 86%|████████▋ | 31558/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.123.gate_proj: 86%|████████▋ | 31559/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.123.up_proj: 86%|████████▋ | 31560/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.123.down_proj: 86%|████████▋ | 31561/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.124.gate_proj: 86%|████████▋ | 31562/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.124.up_proj: 86%|████████▋ | 31563/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.124.down_proj: 86%|████████▋ | 31564/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.125.gate_proj: 86%|████████▋ | 31565/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.125.up_proj: 86%|████████▋ | 31566/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.125.down_proj: 86%|████████▋ | 31567/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.126.gate_proj: 86%|████████▋ | 31568/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.126.up_proj: 86%|████████▋ | 31569/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.126.down_proj: 86%|████████▋ | 31570/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.127.gate_proj: 86%|████████▋ | 31571/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.127.up_proj: 86%|████████▋ | 31572/36566 [00:28<00:04, 1166.43it/s] packing model.layers.80.mlp.experts.127.down_proj: 86%|████████▋ | 31573/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.0.gate_proj: 86%|████████▋ | 31574/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.0.up_proj: 86%|████████▋ | 31575/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.0.down_proj: 86%|████████▋ | 31576/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.1.gate_proj: 86%|████████▋ | 31577/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.1.up_proj: 86%|████████▋ | 31578/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.1.down_proj: 86%|████████▋ | 31579/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.2.gate_proj: 86%|████████▋ | 31580/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.2.up_proj: 86%|████████▋ | 31581/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.2.down_proj: 86%|████████▋ | 31582/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.3.gate_proj: 86%|████████▋ | 31583/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.3.up_proj: 86%|████████▋ | 31584/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.3.down_proj: 86%|████████▋ | 31585/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.4.gate_proj: 86%|████████▋ | 31586/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.4.up_proj: 86%|████████▋ | 31587/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.4.down_proj: 86%|████████▋ | 31588/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.5.gate_proj: 86%|████████▋ | 31589/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.5.up_proj: 86%|████████▋ | 31590/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.5.down_proj: 86%|████████▋ | 31591/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.6.gate_proj: 86%|████████▋ | 31592/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.6.up_proj: 86%|████████▋ | 31593/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.6.down_proj: 86%|████████▋ | 31594/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.7.gate_proj: 86%|████████▋ | 31595/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.7.up_proj: 86%|████████▋ | 31596/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.7.down_proj: 86%|████████▋ | 31597/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.8.gate_proj: 86%|████████▋ | 31598/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.8.up_proj: 86%|████████▋ | 31599/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.8.down_proj: 86%|████████▋ | 31600/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.9.gate_proj: 86%|████████▋ | 31601/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.9.up_proj: 86%|████████▋ | 31602/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.9.down_proj: 86%|████████▋ | 31603/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.10.gate_proj: 86%|████████▋ | 31604/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.10.up_proj: 86%|████████▋ | 31605/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.10.down_proj: 86%|████████▋ | 31606/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.11.gate_proj: 86%|████████▋ | 31607/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.11.up_proj: 86%|████████▋ | 31608/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.11.down_proj: 86%|████████▋ | 31609/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.12.gate_proj: 86%|████████▋ | 31610/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.12.up_proj: 86%|████████▋ | 31611/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.12.down_proj: 86%|████████▋ | 31612/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.13.gate_proj: 86%|████████▋ | 31613/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.13.up_proj: 86%|████████▋ | 31614/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.13.down_proj: 86%|████████▋ | 31615/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.14.gate_proj: 86%|████████▋ | 31616/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.14.up_proj: 86%|████████▋ | 31617/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.14.down_proj: 86%|████████▋ | 31618/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.15.gate_proj: 86%|████████▋ | 31619/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.15.up_proj: 86%|████████▋ | 31620/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.15.down_proj: 86%|████████▋ | 31621/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.16.gate_proj: 86%|████████▋ | 31622/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.16.up_proj: 86%|████████▋ | 31623/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.16.down_proj: 86%|████████▋ | 31624/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.17.gate_proj: 86%|████████▋ | 31625/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.17.up_proj: 86%|████████▋ | 31626/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.17.down_proj: 86%|████████▋ | 31627/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.18.gate_proj: 86%|████████▋ | 31628/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.18.up_proj: 86%|████████▋ | 31629/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.18.down_proj: 87%|████████▋ | 31630/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.19.gate_proj: 87%|████████▋ | 31631/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.19.up_proj: 87%|████████▋ | 31632/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.19.down_proj: 87%|████████▋ | 31633/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.20.gate_proj: 87%|████████▋ | 31634/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.20.up_proj: 87%|████████▋ | 31635/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.20.down_proj: 87%|████████▋ | 31636/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.21.gate_proj: 87%|████████▋ | 31637/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.21.up_proj: 87%|████████▋ | 31638/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.21.down_proj: 87%|████████▋ | 31639/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.22.gate_proj: 87%|████████▋ | 31640/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.22.up_proj: 87%|████████▋ | 31641/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.22.down_proj: 87%|████████▋ | 31642/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.23.gate_proj: 87%|████████▋ | 31643/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.23.up_proj: 87%|████████▋ | 31644/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.23.down_proj: 87%|████████▋ | 31645/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.24.gate_proj: 87%|████████▋ | 31646/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.24.up_proj: 87%|████████▋ | 31647/36566 [00:28<00:04, 1166.43it/s] packing model.layers.81.mlp.experts.24.up_proj: 87%|████████▋ | 31648/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.24.down_proj: 87%|████████▋ | 31648/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.25.gate_proj: 87%|████████▋ | 31649/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.25.up_proj: 87%|████████▋ | 31650/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.25.down_proj: 87%|████████▋ | 31651/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.26.gate_proj: 87%|████████▋ | 31652/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.26.up_proj: 87%|████████▋ | 31653/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.26.down_proj: 87%|████████▋ | 31654/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.27.gate_proj: 87%|████████▋ | 31655/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.27.up_proj: 87%|████████▋ | 31656/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.27.down_proj: 87%|████████▋ | 31657/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.28.gate_proj: 87%|████████▋ | 31658/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.28.up_proj: 87%|████████▋ | 31659/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.28.down_proj: 87%|████████▋ | 31660/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.29.gate_proj: 87%|████████▋ | 31661/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.29.up_proj: 87%|████████▋ | 31662/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.29.down_proj: 87%|████████▋ | 31663/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.30.gate_proj: 87%|████████▋ | 31664/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.30.up_proj: 87%|████████▋ | 31665/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.30.down_proj: 87%|████████▋ | 31666/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.31.gate_proj: 87%|████████▋ | 31667/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.31.up_proj: 87%|████████▋ | 31668/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.31.down_proj: 87%|████████▋ | 31669/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.32.gate_proj: 87%|████████▋ | 31670/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.32.up_proj: 87%|████████▋ | 31671/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.32.down_proj: 87%|████████▋ | 31672/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.33.gate_proj: 87%|████████▋ | 31673/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.33.up_proj: 87%|████████▋ | 31674/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.33.down_proj: 87%|████████▋ | 31675/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.34.gate_proj: 87%|████████▋ | 31676/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.34.up_proj: 87%|████████▋ | 31677/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.34.down_proj: 87%|████████▋ | 31678/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.35.gate_proj: 87%|████████▋ | 31679/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.35.up_proj: 87%|████████▋ | 31680/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.35.down_proj: 87%|████████▋ | 31681/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.36.gate_proj: 87%|████████▋ | 31682/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.36.up_proj: 87%|████████▋ | 31683/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.36.down_proj: 87%|████████▋ | 31684/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.37.gate_proj: 87%|████████▋ | 31685/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.37.up_proj: 87%|████████▋ | 31686/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.37.down_proj: 87%|████████▋ | 31687/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.38.gate_proj: 87%|████████▋ | 31688/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.38.up_proj: 87%|████████▋ | 31689/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.38.down_proj: 87%|████████▋ | 31690/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.39.gate_proj: 87%|████████▋ | 31691/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.39.up_proj: 87%|████████▋ | 31692/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.39.down_proj: 87%|████████▋ | 31693/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.40.gate_proj: 87%|████████▋ | 31694/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.40.up_proj: 87%|████████▋ | 31695/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.40.down_proj: 87%|████████▋ | 31696/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.41.gate_proj: 87%|████████▋ | 31697/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.41.up_proj: 87%|████████▋ | 31698/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.41.down_proj: 87%|████████▋ | 31699/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.42.gate_proj: 87%|████████▋ | 31700/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.42.up_proj: 87%|████████▋ | 31701/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.42.down_proj: 87%|████████▋ | 31702/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.43.gate_proj: 87%|████████▋ | 31703/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.43.up_proj: 87%|████████▋ | 31704/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.43.down_proj: 87%|████████▋ | 31705/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.44.gate_proj: 87%|████████▋ | 31706/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.44.up_proj: 87%|████████▋ | 31707/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.44.down_proj: 87%|████████▋ | 31708/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.45.gate_proj: 87%|████████▋ | 31709/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.45.up_proj: 87%|████████▋ | 31710/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.45.down_proj: 87%|████████▋ | 31711/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.46.gate_proj: 87%|████████▋ | 31712/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.46.up_proj: 87%|████████▋ | 31713/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.46.down_proj: 87%|████████▋ | 31714/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.47.gate_proj: 87%|████████▋ | 31715/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.47.up_proj: 87%|████████▋ | 31716/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.47.down_proj: 87%|████████▋ | 31717/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.48.gate_proj: 87%|████████▋ | 31718/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.48.up_proj: 87%|████████▋ | 31719/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.48.down_proj: 87%|████████▋ | 31720/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.49.gate_proj: 87%|████████▋ | 31721/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.49.up_proj: 87%|████████▋ | 31722/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.49.down_proj: 87%|████████▋ | 31723/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.50.gate_proj: 87%|████████▋ | 31724/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.50.up_proj: 87%|████████▋ | 31725/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.50.down_proj: 87%|████████▋ | 31726/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.51.gate_proj: 87%|████████▋ | 31727/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.51.up_proj: 87%|████████▋ | 31728/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.51.down_proj: 87%|████████▋ | 31729/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.52.gate_proj: 87%|████████▋ | 31730/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.52.up_proj: 87%|████████▋ | 31731/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.52.down_proj: 87%|████████▋ | 31732/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.53.gate_proj: 87%|████████▋ | 31733/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.53.up_proj: 87%|████████▋ | 31734/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.53.down_proj: 87%|████████▋ | 31735/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.54.gate_proj: 87%|████████▋ | 31736/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.54.up_proj: 87%|████████▋ | 31737/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.54.down_proj: 87%|████████▋ | 31738/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.55.gate_proj: 87%|████████▋ | 31739/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.55.up_proj: 87%|████████▋ | 31740/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.55.down_proj: 87%|████████▋ | 31741/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.56.gate_proj: 87%|████████▋ | 31742/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.56.up_proj: 87%|████████▋ | 31743/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.56.down_proj: 87%|████████▋ | 31744/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.57.gate_proj: 87%|████████▋ | 31745/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.57.up_proj: 87%|████████▋ | 31746/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.57.down_proj: 87%|████████▋ | 31747/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.58.gate_proj: 87%|████████▋ | 31748/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.58.up_proj: 87%|████████▋ | 31749/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.58.down_proj: 87%|████████▋ | 31750/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.59.gate_proj: 87%|████████▋ | 31751/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.59.up_proj: 87%|████████▋ | 31752/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.59.down_proj: 87%|████████▋ | 31753/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.60.gate_proj: 87%|████████▋ | 31754/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.60.up_proj: 87%|████████▋ | 31755/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.60.down_proj: 87%|████████▋ | 31756/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.61.gate_proj: 87%|████████▋ | 31757/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.61.up_proj: 87%|████████▋ | 31758/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.61.down_proj: 87%|████████▋ | 31759/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.62.gate_proj: 87%|████████▋ | 31760/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.62.up_proj: 87%|████████▋ | 31761/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.62.down_proj: 87%|████████▋ | 31762/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.63.gate_proj: 87%|████████▋ | 31763/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.63.up_proj: 87%|████████▋ | 31764/36566 [00:28<00:04, 1165.28it/s] packing model.layers.81.mlp.experts.63.up_proj: 87%|████████▋ | 31765/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.63.down_proj: 87%|████████▋ | 31765/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.64.gate_proj: 87%|████████▋ | 31766/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.64.up_proj: 87%|████████▋ | 31767/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.64.down_proj: 87%|████████▋ | 31768/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.65.gate_proj: 87%|████████▋ | 31769/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.65.up_proj: 87%|████████▋ | 31770/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.65.down_proj: 87%|████████▋ | 31771/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.66.gate_proj: 87%|████████▋ | 31772/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.66.up_proj: 87%|████████▋ | 31773/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.66.down_proj: 87%|████████▋ | 31774/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.67.gate_proj: 87%|████████▋ | 31775/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.67.up_proj: 87%|████████▋ | 31776/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.67.down_proj: 87%|████████▋ | 31777/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.68.gate_proj: 87%|████████▋ | 31778/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.68.up_proj: 87%|████████▋ | 31779/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.68.down_proj: 87%|████████▋ | 31780/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.69.gate_proj: 87%|████████▋ | 31781/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.69.up_proj: 87%|████████▋ | 31782/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.69.down_proj: 87%|████████▋ | 31783/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.70.gate_proj: 87%|████████▋ | 31784/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.70.up_proj: 87%|████████▋ | 31785/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.70.down_proj: 87%|████████▋ | 31786/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.71.gate_proj: 87%|████████▋ | 31787/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.71.up_proj: 87%|████████▋ | 31788/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.71.down_proj: 87%|████████▋ | 31789/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.72.gate_proj: 87%|████████▋ | 31790/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.72.up_proj: 87%|████████▋ | 31791/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.72.down_proj: 87%|████████▋ | 31792/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.73.gate_proj: 87%|████████▋ | 31793/36566 [00:28<00:04, 1165.91it/s] packing model.layers.81.mlp.experts.73.up_proj: 87%|████████▋ | 31794/365
qwen-qwen3-235b-a22b-i-47730-v23-uploader: █████▊ | 32449/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.36.gate_proj: 89%|████████▊ | 32450/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.36.up_proj: 89%|████████▊ | 32451/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.36.down_proj: 89%|████████▊ | 32452/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.37.gate_proj: 89%|████████▉ | 32453/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.37.up_proj: 89%|████████▉ | 32454/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.37.down_proj: 89%|████████▉ | 32455/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.38.gate_proj: 89%|████████▉ | 32456/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.38.up_proj: 89%|████████▉ | 32457/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.38.down_proj: 89%|████████▉ | 32458/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.39.gate_proj: 89%|████████▉ | 32459/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.39.up_proj: 89%|████████▉ | 32460/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.39.down_proj: 89%|████████▉ | 32461/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.40.gate_proj: 89%|████████▉ | 32462/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.40.up_proj: 89%|████████▉ | 32463/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.40.down_proj: 89%|████████▉ | 32464/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.41.gate_proj: 89%|████████▉ | 32465/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.41.up_proj: 89%|████████▉ | 32466/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.41.down_proj: 89%|████████▉ | 32467/36566 [00:29<00:03, 1167.28it/s] packing model.layers.83.mlp.experts.41.down_proj: 89%|████████▉ | 32468/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.42.gate_proj: 89%|████████▉ | 32468/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.42.up_proj: 89%|████████▉ | 32469/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.42.down_proj: 89%|████████▉ | 32470/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.43.gate_proj: 89%|████████▉ | 32471/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.43.up_proj: 89%|████████▉ | 32472/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.43.down_proj: 89%|████████▉ | 32473/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.44.gate_proj: 89%|████████▉ | 32474/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.44.up_proj: 89%|████████▉ | 32475/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.44.down_proj: 89%|████████▉ | 32476/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.45.gate_proj: 89%|████████▉ | 32477/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.45.up_proj: 89%|████████▉ | 32478/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.45.down_proj: 89%|████████▉ | 32479/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.46.gate_proj: 89%|████████▉ | 32480/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.46.up_proj: 89%|████████▉ | 32481/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.46.down_proj: 89%|████████▉ | 32482/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.47.gate_proj: 89%|████████▉ | 32483/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.47.up_proj: 89%|████████▉ | 32484/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.47.down_proj: 89%|████████▉ | 32485/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.48.gate_proj: 89%|████████▉ | 32486/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.48.up_proj: 89%|████████▉ | 32487/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.48.down_proj: 89%|████████▉ | 32488/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.49.gate_proj: 89%|████████▉ | 32489/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.49.up_proj: 89%|████████▉ | 32490/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.49.down_proj: 89%|████████▉ | 32491/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.50.gate_proj: 89%|████████▉ | 32492/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.50.up_proj: 89%|████████▉ | 32493/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.50.down_proj: 89%|████████▉ | 32494/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.51.gate_proj: 89%|████████▉ | 32495/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.51.up_proj: 89%|████████▉ | 32496/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.51.down_proj: 89%|████████▉ | 32497/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.52.gate_proj: 89%|████████▉ | 32498/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.52.up_proj: 89%|████████▉ | 32499/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.52.down_proj: 89%|████████▉ | 32500/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.53.gate_proj: 89%|████████▉ | 32501/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.53.up_proj: 89%|████████▉ | 32502/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.53.down_proj: 89%|████████▉ | 32503/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.54.gate_proj: 89%|████████▉ | 32504/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.54.up_proj: 89%|████████▉ | 32505/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.54.down_proj: 89%|████████▉ | 32506/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.55.gate_proj: 89%|████████▉ | 32507/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.55.up_proj: 89%|████████▉ | 32508/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.55.down_proj: 89%|████████▉ | 32509/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.56.gate_proj: 89%|████████▉ | 32510/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.56.up_proj: 89%|████████▉ | 32511/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.56.down_proj: 89%|████████▉ | 32512/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.57.gate_proj: 89%|████████▉ | 32513/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.57.up_proj: 89%|████████▉ | 32514/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.57.down_proj: 89%|████████▉ | 32515/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.58.gate_proj: 89%|████████▉ | 32516/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.58.up_proj: 89%|████████▉ | 32517/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.58.down_proj: 89%|████████▉ | 32518/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.59.gate_proj: 89%|████████▉ | 32519/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.59.up_proj: 89%|████████▉ | 32520/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.59.down_proj: 89%|████████▉ | 32521/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.60.gate_proj: 89%|████████▉ | 32522/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.60.up_proj: 89%|████████▉ | 32523/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.60.down_proj: 89%|████████▉ | 32524/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.61.gate_proj: 89%|████████▉ | 32525/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.61.up_proj: 89%|████████▉ | 32526/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.61.down_proj: 89%|████████▉ | 32527/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.62.gate_proj: 89%|████████▉ | 32528/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.62.up_proj: 89%|████████▉ | 32529/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.62.down_proj: 89%|████████▉ | 32530/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.63.gate_proj: 89%|████████▉ | 32531/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.63.up_proj: 89%|████████▉ | 32532/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.63.down_proj: 89%|████████▉ | 32533/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.64.gate_proj: 89%|████████▉ | 32534/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.64.up_proj: 89%|████████▉ | 32535/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.64.down_proj: 89%|████████▉ | 32536/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.65.gate_proj: 89%|████████▉ | 32537/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.65.up_proj: 89%|████████▉ | 32538/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.65.down_proj: 89%|████████▉ | 32539/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.66.gate_proj: 89%|████████▉ | 32540/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.66.up_proj: 89%|████████▉ | 32541/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.66.down_proj: 89%|████████▉ | 32542/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.67.gate_proj: 89%|████████▉ | 32543/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.67.up_proj: 89%|████████▉ | 32544/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.67.down_proj: 89%|████████▉ | 32545/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.68.gate_proj: 89%|████████▉ | 32546/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.68.up_proj: 89%|████████▉ | 32547/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.68.down_proj: 89%|████████▉ | 32548/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.69.gate_proj: 89%|████████▉ | 32549/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.69.up_proj: 89%|████████▉ | 32550/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.69.down_proj: 89%|████████▉ | 32551/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.70.gate_proj: 89%|████████▉ | 32552/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.70.up_proj: 89%|████████▉ | 32553/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.70.down_proj: 89%|████████▉ | 32554/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.71.gate_proj: 89%|████████▉ | 32555/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.71.up_proj: 89%|████████▉ | 32556/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.71.down_proj: 89%|████████▉ | 32557/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.72.gate_proj: 89%|████████▉ | 32558/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.72.up_proj: 89%|████████▉ | 32559/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.72.down_proj: 89%|████████▉ | 32560/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.73.gate_proj: 89%|████████▉ | 32561/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.73.up_proj: 89%|████████▉ | 32562/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.73.down_proj: 89%|████████▉ | 32563/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.74.gate_proj: 89%|████████▉ | 32564/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.74.up_proj: 89%|████████▉ | 32565/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.74.down_proj: 89%|████████▉ | 32566/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.75.gate_proj: 89%|████████▉ | 32567/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.75.up_proj: 89%|████████▉ | 32568/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.75.down_proj: 89%|████████▉ | 32569/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.76.gate_proj: 89%|████████▉ | 32570/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.76.up_proj: 89%|████████▉ | 32571/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.76.down_proj: 89%|████████▉ | 32572/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.77.gate_proj: 89%|████████▉ | 32573/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.77.up_proj: 89%|████████▉ | 32574/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.77.down_proj: 89%|████████▉ | 32575/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.78.gate_proj: 89%|████████▉ | 32576/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.78.up_proj: 89%|████████▉ | 32577/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.78.down_proj: 89%|████████▉ | 32578/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.79.gate_proj: 89%|████████▉ | 32579/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.79.up_proj: 89%|████████▉ | 32580/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.79.down_proj: 89%|████████▉ | 32581/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.80.gate_proj: 89%|████████▉ | 32582/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.80.up_proj: 89%|████████▉ | 32583/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.80.down_proj: 89%|████████▉ | 32584/36566 [00:29<00:03, 1164.70it/s] packing model.layers.83.mlp.experts.80.down_proj: 89%|████████▉ | 32585/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.81.gate_proj: 89%|████████▉ | 32585/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.81.up_proj: 89%|████████▉ | 32586/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.81.down_proj: 89%|████████▉ | 32587/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.82.gate_proj: 89%|████████▉ | 32588/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.82.up_proj: 89%|████████▉ | 32589/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.82.down_proj: 89%|████████▉ | 32590/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.83.gate_proj: 89%|████████▉ | 32591/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.83.up_proj: 89%|████████▉ | 32592/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.83.down_proj: 89%|████████▉ | 32593/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.84.gate_proj: 89%|████████▉ | 32594/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.84.up_proj: 89%|████████▉ | 32595/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.84.down_proj: 89%|████████▉ | 32596/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.85.gate_proj: 89%|████████▉ | 32597/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.85.up_proj: 89%|████████▉ | 32598/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.85.down_proj: 89%|████████▉ | 32599/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.86.gate_proj: 89%|████████▉ | 32600/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.86.up_proj: 89%|████████▉ | 32601/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.86.down_proj: 89%|████████▉ | 32602/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.87.gate_proj: 89%|████████▉ | 32603/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.87.up_proj: 89%|████████▉ | 32604/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.87.down_proj: 89%|████████▉ | 32605/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.88.gate_proj: 89%|████████▉ | 32606/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.88.up_proj: 89%|████████▉ | 32607/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.88.down_proj: 89%|████████▉ | 32608/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.89.gate_proj: 89%|████████▉ | 32609/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.89.up_proj: 89%|████████▉ | 32610/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.89.down_proj: 89%|████████▉ | 32611/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.90.gate_proj: 89%|████████▉ | 32612/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.90.up_proj: 89%|████████▉ | 32613/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.90.down_proj: 89%|████████▉ | 32614/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.91.gate_proj: 89%|████████▉ | 32615/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.91.up_proj: 89%|████████▉ | 32616/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.91.down_proj: 89%|████████▉ | 32617/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.92.gate_proj: 89%|████████▉ | 32618/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.92.up_proj: 89%|████████▉ | 32619/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.92.down_proj: 89%|████████▉ | 32620/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.93.gate_proj: 89%|████████▉ | 32621/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.93.up_proj: 89%|████████▉ | 32622/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.93.down_proj: 89%|████████▉ | 32623/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.94.gate_proj: 89%|████████▉ | 32624/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.94.up_proj: 89%|████████▉ | 32625/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.94.down_proj: 89%|████████▉ | 32626/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.95.gate_proj: 89%|████████▉ | 32627/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.95.up_proj: 89%|████████▉ | 32628/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.95.down_proj: 89%|████████▉ | 32629/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.96.gate_proj: 89%|████████▉ | 32630/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.96.up_proj: 89%|████████▉ | 32631/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.96.down_proj: 89%|████████▉ | 32632/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.97.gate_proj: 89%|████████▉ | 32633/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.97.up_proj: 89%|████████▉ | 32634/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.97.down_proj: 89%|████████▉ | 32635/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.98.gate_proj: 89%|████████▉ | 32636/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.98.up_proj: 89%|████████▉ | 32637/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.98.down_proj: 89%|████████▉ | 32638/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.99.gate_proj: 89%|████████▉ | 32639/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.99.up_proj: 89%|████████▉ | 32640/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.99.down_proj: 89%|████████▉ | 32641/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.100.gate_proj: 89%|████████▉ | 32642/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.100.up_proj: 89%|████████▉ | 32643/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.100.down_proj: 89%|████████▉ | 32644/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.101.gate_proj: 89%|████████▉ | 32645/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.101.up_proj: 89%|████████▉ | 32646/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.101.down_proj: 89%|████████▉ | 32647/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.102.gate_proj: 89%|████████▉ | 32648/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.102.up_proj: 89%|████████▉ | 32649/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.102.down_proj: 89%|████████▉ | 32650/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.103.gate_proj: 89%|████████▉ | 32651/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.103.up_proj: 89%|████████▉ | 32652/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.103.down_proj: 89%|████████▉ | 32653/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.104.gate_proj: 89%|████████▉ | 32654/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.104.up_proj: 89%|████████▉ | 32655/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.104.down_proj: 89%|████████▉ | 32656/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.105.gate_proj: 89%|████████▉ | 32657/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.105.up_proj: 89%|████████▉ | 32658/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.105.down_proj: 89%|████████▉ | 32659/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.106.gate_proj: 89%|████████▉ | 32660/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.106.up_proj: 89%|████████▉ | 32661/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.106.down_proj: 89%|████████▉ | 32662/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.107.gate_proj: 89%|████████▉ | 32663/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.107.up_proj: 89%|████████▉ | 32664/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.107.down_proj: 89%|████████▉ | 32665/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.108.gate_proj: 89%|████████▉ | 32666/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.108.up_proj: 89%|████████▉ | 32667/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.108.down_proj: 89%|████████▉ | 32668/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.109.gate_proj: 89%|████████▉ | 32669/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.109.up_proj: 89%|████████▉ | 32670/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.109.down_proj: 89%|████████▉ | 32671/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.110.gate_proj: 89%|████████▉ | 32672/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.110.up_proj: 89%|████████▉ | 32673/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.110.down_proj: 89%|████████▉ | 32674/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.111.gate_proj: 89%|████████▉ | 32675/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.111.up_proj: 89%|████████▉ | 32676/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.111.down_proj: 89%|████████▉ | 32677/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.112.gate_proj: 89%|████████▉ | 32678/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.112.up_proj: 89%|████████▉ | 32679/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.112.down_proj: 89%|████████▉ | 32680/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.113.gate_proj: 89%|████████▉ | 32681/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.113.up_proj: 89%|████████▉ | 32682/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.113.down_proj: 89%|████████▉ | 32683/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.114.gate_proj: 89%|████████▉ | 32684/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.114.up_proj: 89%|████████▉ | 32685/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.114.down_proj: 89%|████████▉ | 32686/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.115.gate_proj: 89%|████████▉ | 32687/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.115.up_proj: 89%|████████▉ | 32688/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.115.down_proj: 89%|████████▉ | 32689/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.116.gate_proj: 89%|████████▉ | 32690/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.116.up_proj: 89%|████████▉ | 32691/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.116.down_proj: 89%|████████▉ | 32692/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.117.gate_proj: 89%|████████▉ | 32693/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.117.up_proj: 89%|████████▉ | 32694/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.117.down_proj: 89%|████████▉ | 32695/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.118.gate_proj: 89%|████████▉ | 32696/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.118.up_proj: 89%|████████▉ | 32697/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.118.down_proj: 89%|████████▉ | 32698/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.119.gate_proj: 89%|████████▉ | 32699/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.119.up_proj: 89%|████████▉ | 32700/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.119.down_proj: 89%|████████▉ | 32701/36566 [00:29<00:03, 1165.22it/s] packing model.layers.83.mlp.experts.119.down_proj: 89%|████████▉ | 32702/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.120.gate_proj: 89%|████████▉ | 32702/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.120.up_proj: 89%|████████▉ | 32703/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.120.down_proj: 89%|████████▉ | 32704/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.121.gate_proj: 89%|████████▉ | 32705/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.121.up_proj: 89%|████████▉ | 32706/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.121.down_proj: 89%|████████▉ | 32707/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.122.gate_proj: 89%|████████▉ | 32708/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.122.up_proj: 89%|████████▉ | 32709/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.122.down_proj: 89%|████████▉ | 32710/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.123.gate_proj: 89%|████████▉ | 32711/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.123.up_proj: 89%|████████▉ | 32712/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.123.down_proj: 89%|████████▉ | 32713/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.124.gate_proj: 89%|████████▉ | 32714/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.124.up_proj: 89%|████████▉ | 32715/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.124.down_proj: 89%|████████▉ | 32716/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.125.gate_proj: 89%|████████▉ | 32717/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.125.up_proj: 89%|████████▉ | 32718/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.125.down_proj: 89%|████████▉ | 32719/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.126.gate_proj: 89%|████████▉ | 32720/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.126.up_proj: 89%|████████▉ | 32721/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.126.down_proj: 89%|████████▉ | 32722/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.127.gate_proj: 89%|████████▉ | 32723/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.127.up_proj: 89%|████████▉ | 32724/36566 [00:29<00:03, 1164.06it/s] packing model.layers.83.mlp.experts.127.down_proj: 89%|████████▉ | 32725/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.0.gate_proj: 89%|████████▉ | 32726/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.0.up_proj: 90%|████████▉ | 32727/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.0.down_proj: 90%|████████▉ | 32728/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.1.gate_proj: 90%|████████▉ | 32729/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.1.up_proj: 90%|████████▉ | 32730/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.1.down_proj: 90%|████████▉ | 32731/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.2.gate_proj: 90%|████████▉ | 32732/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.2.up_proj: 90%|████████▉ | 32733/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.2.down_proj: 90%|████████▉ | 32734/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.3.gate_proj: 90%|████████▉ | 32735/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.3.up_proj: 90%|████████▉ | 32736/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.3.down_proj: 90%|████████▉ | 32737/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.4.gate_proj: 90%|████████▉ | 32738/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.4.up_proj: 90%|████████▉ | 32739/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.4.down_proj: 90%|████████▉ | 32740/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.5.gate_proj: 90%|████████▉ | 32741/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.5.up_proj: 90%|████████▉ | 32742/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.5.down_proj: 90%|████████▉ | 32743/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.6.gate_proj: 90%|████████▉ | 32744/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.6.up_proj: 90%|████████▉ | 32745/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.6.down_proj: 90%|████████▉ | 32746/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.7.gate_proj: 90%|████████▉ | 32747/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.7.up_proj: 90%|████████▉ | 32748/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.7.down_proj: 90%|████████▉ | 32749/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.8.gate_proj: 90%|████████▉ | 32750/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.8.up_proj: 90%|████████▉ | 32751/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.8.down_proj: 90%|████████▉ | 32752/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.9.gate_proj: 90%|████████▉ | 32753/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.9.up_proj: 90%|████████▉ | 32754/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.9.down_proj: 90%|████████▉ | 32755/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.10.gate_proj: 90%|████████▉ | 32756/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.10.up_proj: 90%|████████▉ | 32757/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.10.down_proj: 90%|████████▉ | 32758/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.11.gate_proj: 90%|████████▉ | 32759/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.11.up_proj: 90%|████████▉ | 32760/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.11.down_proj: 90%|████████▉ | 32761/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.12.gate_proj: 90%|████████▉ | 32762/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.12.up_proj: 90%|████████▉ | 32763/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.12.down_proj: 90%|████████▉ | 32764/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.13.gate_proj: 90%|████████▉ | 32765/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.13.up_proj: 90%|████████▉ | 32766/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.13.down_proj: 90%|████████▉ | 32767/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.14.gate_proj: 90%|████████▉ | 32768/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.14.up_proj: 90%|████████▉ | 32769/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.14.down_proj: 90%|████████▉ | 32770/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.15.gate_proj: 90%|████████▉ | 32771/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.15.up_proj: 90%|████████▉ | 32772/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.15.down_proj: 90%|████████▉ | 32773/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.16.gate_proj: 90%|████████▉ | 32774/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.16.up_proj: 90%|████████▉ | 32775/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.16.down_proj: 90%|████████▉ | 32776/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.17.gate_proj: 90%|████████▉ | 32777/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.17.up_proj: 90%|████████▉ | 32778/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.17.down_proj: 90%|████████▉ | 32779/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.18.gate_proj: 90%|████████▉ | 32780/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.18.up_proj: 90%|████████▉ | 32781/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.18.down_proj: 90%|████████▉ | 32782/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.19.gate_proj: 90%|████████▉ | 32783/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.19.up_proj: 90%|████████▉ | 32784/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.19.down_proj: 90%|████████▉ | 32785/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.20.gate_proj: 90%|████████▉ | 32786/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.20.up_proj: 90%|████████▉ | 32787/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.20.down_proj: 90%|████████▉ | 32788/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.21.gate_proj: 90%|████████▉ | 32789/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.21.up_proj: 90%|████████▉ | 32790/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.21.down_proj: 90%|████████▉ | 32791/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.22.gate_proj: 90%|████████▉ | 32792/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.22.up_proj: 90%|████████▉ | 32793/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.22.down_proj: 90%|████████▉ | 32794/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.23.gate_proj: 90%|████████▉ | 32795/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.23.up_proj: 90%|████████▉ | 32796/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.23.down_proj: 90%|████████▉ | 32797/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.24.gate_proj: 90%|████████▉ | 32798/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.24.up_proj: 90%|████████▉ | 32799/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.24.down_proj: 90%|████████▉ | 32800/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.25.gate_proj: 90%|████████▉ | 32801/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.25.up_proj: 90%|████████▉ | 32802/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.25.down_proj: 90%|████████▉ | 32803/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.26.gate_proj: 90%|████████▉ | 32804/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.26.up_proj: 90%|████████▉ | 32805/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.26.down_proj: 90%|████████▉ | 32806/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.27.gate_proj: 90%|████████▉ | 32807/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.27.up_proj: 90%|████████▉ | 32808/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.27.down_proj: 90%|████████▉ | 32809/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.28.gate_proj: 90%|████████▉ | 32810/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.28.up_proj: 90%|████████▉ | 32811/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.28.down_proj: 90%|████████▉ | 32812/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.29.gate_proj: 90%|████████▉ | 32813/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.29.up_proj: 90%|████████▉ | 32814/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.29.down_proj: 90%|████████▉ | 32815/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.30.gate_proj: 90%|████████▉ | 32816/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.30.up_proj: 90%|████████▉ | 32817/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.30.down_proj: 90%|████████▉ | 32818/36566 [00:29<00:03, 1164.06it/s] packing model.layers.84.mlp.experts.30.down_proj: 90%|████████▉ | 32819/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.31.gate_proj: 90%|████████▉ | 32819/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.31.up_proj: 90%|████████▉ | 32820/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.31.down_proj: 90%|████████▉ | 32821/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.32.gate_proj: 90%|████████▉ | 32822/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.32.up_proj: 90%|████████▉ | 32823/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.32.down_proj: 90%|████████▉ | 32824/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.33.gate_proj: 90%|████████▉ | 32825/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.33.up_proj: 90%|████████▉ | 32826/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.33.down_proj: 90%|████████▉ | 32827/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.34.gate_proj: 90%|████████▉ | 32828/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.34.up_proj: 90%|████████▉ | 32829/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.34.down_proj: 90%|████████▉ | 32830/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.35.gate_proj: 90%|████████▉ | 32831/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.35.up_proj: 90%|████████▉ | 32832/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.35.down_proj: 90%|████████▉ | 32833/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.36.gate_proj: 90%|████████▉ | 32834/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.36.up_proj: 90%|████████▉ | 32835/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.36.down_proj: 90%|████████▉ | 32836/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.37.gate_proj: 90%|████████▉ | 32837/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.37.up_proj: 90%|████████▉ | 32838/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.37.down_proj: 90%|████████▉ | 32839/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.38.gate_proj: 90%|████████▉ | 32840/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.38.up_proj: 90%|████████▉ | 32841/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.38.down_proj: 90%|████████▉ | 32842/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.39.gate_proj: 90%|████████▉ | 32843/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.39.up_proj: 90%|████████▉ | 32844/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.39.down_proj: 90%|████████▉ | 32845/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.40.gate_proj: 90%|████████▉ | 32846/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.40.up_proj: 90%|████████▉ | 32847/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.40.down_proj: 90%|████████▉ | 32848/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.41.gate_proj: 90%|████████▉ | 32849/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.41.up_proj: 90%|████████▉ | 32850/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.41.down_proj: 90%|████████▉ | 32851/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.42.gate_proj: 90%|████████▉ | 32852/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.42.up_proj: 90%|████████▉ | 32853/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.42.down_proj: 90%|████████▉ | 32854/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.43.gate_proj: 90%|████████▉ | 32855/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.43.up_proj: 90%|████████▉ | 32856/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.43.down_proj: 90%|████████▉ | 32857/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.44.gate_proj: 90%|████████▉ | 32858/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.44.up_proj: 90%|████████▉ | 32859/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.44.down_proj: 90%|████████▉ | 32860/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.45.gate_proj: 90%|████████▉ | 32861/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.45.up_proj: 90%|████████▉ | 32862/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.45.down_proj: 90%|████████▉ | 32863/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.46.gate_proj: 90%|████████▉ | 32864/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.46.up_proj: 90%|████████▉ | 32865/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.46.down_proj: 90%|████████▉ | 32866/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.47.gate_proj: 90%|████████▉ | 32867/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.47.up_proj: 90%|████████▉ | 32868/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.47.down_proj: 90%|████████▉ | 32869/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.48.gate_proj: 90%|████████▉ | 32870/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.48.up_proj: 90%|████████▉ | 32871/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.48.down_proj: 90%|████████▉ | 32872/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.49.gate_proj: 90%|████████▉ | 32873/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.49.up_proj: 90%|████████▉ | 32874/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.49.down_proj: 90%|████████▉ | 32875/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.50.gate_proj: 90%|████████▉ | 32876/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.50.up_proj: 90%|████████▉ | 32877/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.50.down_proj: 90%|████████▉ | 32878/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.51.gate_proj: 90%|████████▉ | 32879/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.51.up_proj: 90%|████████▉ | 32880/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.51.down_proj: 90%|████████▉ | 32881/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.52.gate_proj: 90%|████████▉ | 32882/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.52.up_proj: 90%|████████▉ | 32883/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.52.down_proj: 90%|████████▉ | 32884/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.53.gate_proj: 90%|████████▉ | 32885/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.53.up_proj: 90%|████████▉ | 32886/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.53.down_proj: 90%|████████▉ | 32887/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.54.gate_proj: 90%|████████▉ | 32888/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.54.up_proj: 90%|████████▉ | 32889/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.54.down_proj: 90%|████████▉ | 32890/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.55.gate_proj: 90%|████████▉ | 32891/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.55.up_proj: 90%|████████▉ | 32892/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.55.down_proj: 90%|████████▉ | 32893/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.56.gate_proj: 90%|████████▉ | 32894/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.56.up_proj: 90%|████████▉ | 32895/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.56.down_proj: 90%|████████▉ | 32896/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.57.gate_proj: 90%|████████▉ | 32897/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.57.up_proj: 90%|████████▉ | 32898/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.57.down_proj: 90%|████████▉ | 32899/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.58.gate_proj: 90%|████████▉ | 32900/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.58.up_proj: 90%|████████▉ | 32901/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.58.down_proj: 90%|████████▉ | 32902/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.59.gate_proj: 90%|████████▉ | 32903/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.59.up_proj: 90%|████████▉ | 32904/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.59.down_proj: 90%|████████▉ | 32905/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.60.gate_proj: 90%|████████▉ | 32906/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.60.up_proj: 90%|████████▉ | 32907/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.60.down_proj: 90%|████████▉ | 32908/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.61.gate_proj: 90%|████████▉ | 32909/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.61.up_proj: 90%|█████████ | 32910/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.61.down_proj: 90%|█████████ | 32911/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.62.gate_proj: 90%|█████████ | 32912/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.62.up_proj: 90%|█████████ | 32913/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.62.down_proj: 90%|█████████ | 32914/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.63.gate_proj: 90%|█████████ | 32915/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.63.up_proj: 90%|█████████ | 32916/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.63.down_proj: 90%|█████████ | 32917/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.64.gate_proj: 90%|█████████ | 32918/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.64.up_proj: 90%|█████████ | 32919/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.64.down_proj: 90%|█████████ | 32920/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.65.gate_proj: 90%|█████████ | 32921/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.65.up_proj: 90%|█████████ | 32922/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.65.down_proj: 90%|█████████ | 32923/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.66.gate_proj: 90%|█████████ | 32924/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.66.up_proj: 90%|█████████ | 32925/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.66.down_proj: 90%|█████████ | 32926/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.67.gate_proj: 90%|█████████ | 32927/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.67.up_proj: 90%|█████████ | 32928/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.67.down_proj: 90%|█████████ | 32929/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.68.gate_proj: 90%|█████████ | 32930/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.68.up_proj: 90%|█████████ | 32931/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.68.down_proj: 90%|█████████ | 32932/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.69.gate_proj: 90%|█████████ | 32933/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.69.up_proj: 90%|█████████ | 32934/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.69.down_proj: 90%|█████████ | 32935/36566 [00:29<00:03, 1164.62it/s] packing model.layers.84.mlp.experts.69.down_proj: 90%|█████████ | 32936/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.70.gate_proj: 90%|█████████ | 32936/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.70.up_proj: 90%|█████████ | 32937/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.70.down_proj: 90%|█████████ | 32938/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.71.gate_proj: 90%|█████████ | 32939/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.71.up_proj: 90%|█████████ | 32940/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.71.down_proj: 90%|█████████ | 32941/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.72.gate_proj: 90%|█████████ | 32942/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.72.up_proj: 90%|█████████ | 32943/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.72.down_proj: 90%|█████████ | 32944/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.73.gate_proj: 90%|█████████ | 32945/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.73.up_proj: 90%|█████████ | 32946/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.73.down_proj: 90%|█████████ | 32947/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.74.gate_proj: 90%|█████████ | 32948/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.74.up_proj: 90%|█████████ | 32949/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.74.down_proj: 90%|█████████ | 32950/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.75.gate_proj: 90%|█████████ | 32951/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.75.up_proj: 90%|█████████ | 32952/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.75.down_proj: 90%|█████████ | 32953/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.76.gate_proj: 90%|█████████ | 32954/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.76.up_proj: 90%|█████████ | 32955/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.76.down_proj: 90%|█████████ | 32956/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.77.gate_proj: 90%|█████████ | 32957/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.77.up_proj: 90%|█████████ | 32958/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.77.down_proj: 90%|█████████ | 32959/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.78.gate_proj: 90%|█████████ | 32960/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.78.up_proj: 90%|█████████ | 32961/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.78.down_proj: 90%|█████████ | 32962/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.79.gate_proj: 90%|█████████ | 32963/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.79.up_proj: 90%|█████████ | 32964/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.79.down_proj: 90%|█████████ | 32965/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.80.gate_proj: 90%|█████████ | 32966/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.80.up_proj: 90%|█████████ | 32967/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.80.down_proj: 90%|█████████ | 32968/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.81.gate_proj: 90%|█████████ | 32969/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.81.up_proj: 90%|█████████ | 32970/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.81.down_proj: 90%|█████████ | 32971/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.82.gate_proj: 90%|█████████ | 32972/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.82.up_proj: 90%|█████████ | 32973/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.82.down_proj: 90%|█████████ | 32974/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.83.gate_proj: 90%|█████████ | 32975/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.83.up_proj: 90%|█████████ | 32976/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.83.down_proj: 90%|█████████ | 32977/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.84.gate_proj: 90%|█████████ | 32978/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.84.up_proj: 90%|█████████ | 32979/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.84.down_proj: 90%|█████████ | 32980/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.85.gate_proj: 90%|█████████ | 32981/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.85.up_proj: 90%|█████████ | 32982/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.85.down_proj: 90%|█████████ | 32983/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.86.gate_proj: 90%|█████████ | 32984/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.86.up_proj: 90%|█████████ | 32985/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.86.down_proj: 90%|█████████ | 32986/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.87.gate_proj: 90%|█████████ | 32987/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.87.up_proj: 90%|█████████ | 32988/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.87.down_proj: 90%|█████████ | 32989/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.88.gate_proj: 90%|█████████ | 32990/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.88.up_proj: 90%|█████████ | 32991/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.88.down_proj: 90%|█████████ | 32992/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.89.gate_proj: 90%|█████████ | 32993/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.89.up_proj: 90%|█████████ | 32994/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.89.down_proj: 90%|█████████ | 32995/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.90.gate_proj: 90%|█████████ | 32996/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.90.up_proj: 90%|█████████ | 32997/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.90.down_proj: 90%|█████████ | 32998/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.91.gate_proj: 90%|█████████ | 32999/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.91.up_proj: 90%|█████████ | 33000/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.91.down_proj: 90%|█████████ | 33001/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.92.gate_proj: 90%|█████████ | 33002/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.92.up_proj: 90%|█████████ | 33003/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.92.down_proj: 90%|█████████ | 33004/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.93.gate_proj: 90%|█████████ | 33005/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.93.up_proj: 90%|█████████ | 33006/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.93.down_proj: 90%|█████████ | 33007/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.94.gate_proj: 90%|█████████ | 33008/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.94.up_proj: 90%|█████████ | 33009/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.94.down_proj: 90%|█████████ | 33010/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.95.gate_proj: 90%|█████████ | 33011/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.95.up_proj: 90%|█████████ | 33012/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.95.down_proj: 90%|█████████ | 33013/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.96.gate_proj: 90%|█████████ | 33014/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.96.up_proj: 90%|█████████ | 33015/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.96.down_proj: 90%|█████████ | 33016/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.97.gate_proj: 90%|█████████ | 33017/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.97.up_proj: 90%|█████████ | 33018/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.97.down_proj: 90%|█████████ | 33019/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.98.gate_proj: 90%|█████████ | 33020/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.98.up_proj: 90%|█████████ | 33021/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.98.down_proj: 90%|█████████ | 33022/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.99.gate_proj: 90%|█████████ | 33023/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.99.up_proj: 90%|█████████ | 33024/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.99.down_proj: 90%|█████████ | 33025/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.100.gate_proj: 90%|█████████ | 33026/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.100.up_proj: 90%|█████████ | 33027/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.100.down_proj: 90%|█████████ | 33028/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.101.gate_proj: 90%|█████████ | 33029/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.101.up_proj: 90%|█████████ | 33030/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.101.down_proj: 90%|█████████ | 33031/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.102.gate_proj: 90%|█████████ | 33032/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.102.up_proj: 90%|█████████ | 33033/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.102.down_proj: 90%|█████████ | 33034/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.103.gate_proj: 90%|█████████ | 33035/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.103.up_proj: 90%|█████████ | 33036/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.103.down_proj: 90%|█████████ | 33037/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.104.gate_proj: 90%|█████████ | 33038/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.104.up_proj: 90%|█████████ | 33039/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.104.down_proj: 90%|█████████ | 33040/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.105.gate_proj: 90%|█████████ | 33041/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.105.up_proj: 90%|█████████ | 33042/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.105.down_proj: 90%|█████████ | 33043/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.106.gate_proj: 90%|█████████ | 33044/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.106.up_proj: 90%|█████████ | 33045/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.106.down_proj: 90%|█████████ | 33046/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.107.gate_proj: 90%|█████████ | 33047/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.107.up_proj: 90%|█████████ | 33048/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.107.down_proj: 90%|█████████ | 33049/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.108.gate_proj: 90%|█████████ | 33050/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.108.up_proj: 90%|█████████ | 33051/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.108.down_proj: 90%|█████████ | 33052/36566 [00:29<00:03, 1164.16it/s] packing model.layers.84.mlp.experts.108.down_proj: 90%|█████████ | 33053/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.109.gate_proj: 90%|█████████ | 33053/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.109.up_proj: 90%|█████████ | 33054/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.109.down_proj: 90%|█████████ | 33055/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.110.gate_proj: 90%|█████████ | 33056/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.110.up_proj: 90%|█████████ | 33057/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.110.down_proj: 90%|█████████ | 33058/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.111.gate_proj: 90%|█████████ | 33059/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.111.up_proj: 90%|█████████ | 33060/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.111.down_proj: 90%|█████████ | 33061/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.112.gate_proj: 90%|█████████ | 33062/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.112.up_proj: 90%|█████████ | 33063/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.112.down_proj: 90%|█████████ | 33064/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.113.gate_proj: 90%|█████████ | 33065/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.113.up_proj: 90%|█████████ | 33066/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.113.down_proj: 90%|█████████ | 33067/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.114.gate_proj: 90%|█████████ | 33068/36566 [00:29<00:03, 1165.84it/s] packing model.layers.84.mlp.experts.114.up_proj: 90%|█████████ | 33069/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.114.down_proj: 90%|█████████ | 33070/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.115.gate_proj: 90%|█████████ | 33071/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.115.up_proj: 90%|█████████ | 33072/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.115.down_proj: 90%|█████████ | 33073/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.116.gate_proj: 90%|█████████ | 33074/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.116.up_proj: 90%|█████████ | 33075/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.116.down_proj: 90%|█████████ | 33076/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.117.gate_proj: 90%|█████████ | 33077/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.117.up_proj: 90%|█████████ | 33078/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.117.down_proj: 90%|█████████ | 33079/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.118.gate_proj: 90%|█████████ | 33080/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.118.up_proj: 90%|█████████ | 33081/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.118.down_proj: 90%|█████████ | 33082/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.119.gate_proj: 90%|█████████ | 33083/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.119.up_proj: 90%|█████████ | 33084/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.119.down_proj: 90%|█████████ | 33085/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.120.gate_proj: 90%|█████████ | 33086/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.120.up_proj: 90%|█████████ | 33087/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.120.down_proj: 90%|█████████ | 33088/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.121.gate_proj: 90%|█████████ | 33089/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.121.up_proj: 90%|█████████ | 33090/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.121.down_proj: 90%|█████████ | 33091/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.122.gate_proj: 90%|█████████ | 33092/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.122.up_proj: 91%|█████████ | 33093/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.122.down_proj: 91%|█████████ | 33094/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.123.gate_proj: 91%|█████████ | 33095/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.123.up_proj: 91%|█████████ | 33096/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.123.down_proj: 91%|█████████ | 33097/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.124.gate_proj: 91%|█████████ | 33098/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.124.up_proj: 91%|█████████ | 33099/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.124.down_proj: 91%|█████████ | 33100/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.125.gate_proj: 91%|█████████ | 33101/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.125.up_proj: 91%|█████████ | 33102/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.125.down_proj: 91%|█████████ | 33103/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.126.gate_proj: 91%|█████████ | 33104/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.126.up_proj: 91%|█████████ | 33105/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.126.down_proj: 91%|█████████ | 33106/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.127.gate_proj: 91%|█████████ | 33107/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.127.up_proj: 91%|█████████ | 33108/36566 [00:29<00:02, 1165.84it/s] packing model.layers.84.mlp.experts.127.down_proj: 91%|█████████ | 33109/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.0.gate_proj: 91%|█████████ | 33110/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.0.up_proj: 91%|█████████ | 33111/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.0.down_proj: 91%|█████████ | 33112/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.1.gate_proj: 91%|█████████ | 33113/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.1.up_proj: 91%|█████████ | 33114/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.1.down_proj: 91%|█████████ | 33115/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.2.gate_proj: 91%|█████████ | 33116/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.2.up_proj: 91%|█████████ | 33117/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.2.down_proj: 91%|█████████ | 33118/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.3.gate_proj: 91%|█████████ | 33119/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.3.up_proj: 91%|█████████ | 33120/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.3.down_proj: 91%|█████████ | 33121/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.4.gate_proj: 91%|█████████ | 33122/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.4.up_proj: 91%|█████████ | 33123/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.4.down_proj: 91%|█████████ | 33124/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.5.gate_proj: 91%|█████████ | 33125/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.5.up_proj: 91%|█████████ | 33126/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.5.down_proj: 91%|█████████ | 33127/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.6.gate_proj: 91%|█████████ | 33128/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.6.up_proj: 91%|█████████ | 33129/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.6.down_proj: 91%|█████████ | 33130/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.7.gate_proj: 91%|█████████ | 33131/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.7.up_proj: 91%|█████████ | 33132/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.7.down_proj: 91%|█████████ | 33133/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.8.gate_proj: 91%|█████████ | 33134/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.8.up_proj: 91%|█████████ | 33135/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.8.down_proj: 91%|█████████ | 33136/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.9.gate_proj: 91%|█████████ | 33137/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.9.up_proj: 91%|█████████ | 33138/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.9.down_proj: 91%|█████████ | 33139/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.10.gate_proj: 91%|█████████ | 33140/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.10.up_proj: 91%|█████████ | 33141/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.10.down_proj: 91%|█████████ | 33142/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.11.gate_proj: 91%|█████████ | 33143/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.11.up_proj: 91%|█████████ | 33144/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.11.down_proj: 91%|█████████ | 33145/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.12.gate_proj: 91%|█████████ | 33146/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.12.up_proj: 91%|█████████ | 33147/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.12.down_proj: 91%|█████████ | 33148/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.13.gate_proj: 91%|█████████ | 33149/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.13.up_proj: 91%|█████████ | 33150/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.13.down_proj: 91%|█████████ | 33151/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.14.gate_proj: 91%|█████████ | 33152/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.14.up_proj: 91%|█████████ | 33153/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.14.down_proj: 91%|█████████ | 33154/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.15.gate_proj: 91%|█████████ | 33155/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.15.up_proj: 91%|█████████ | 33156/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.15.down_proj: 91%|█████████ | 33157/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.16.gate_proj: 91%|█████████ | 33158/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.16.up_proj: 91%|█████████ | 33159/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.16.down_proj: 91%|█████████ | 33160/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.17.gate_proj: 91%|█████████ | 33161/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.17.up_proj: 91%|█████████ | 33162/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.17.down_proj: 91%|█████████ | 33163/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.18.gate_proj: 91%|█████████ | 33164/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.18.up_proj: 91%|█████████ | 33165/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.18.down_proj: 91%|█████████ | 33166/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.19.gate_proj: 91%|█████████ | 33167/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.19.up_proj: 91%|█████████ | 33168/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.19.down_proj: 91%|█████████ | 33169/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.20.gate_proj: 91%|█████████ | 33170/36566 [00:29<00:02, 1165.84it/s] packing model.layers.85.mlp.experts.20.gate_proj: 91%|█████████ | 33171/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.20.up_proj: 91%|█████████ | 33171/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.20.down_proj: 91%|█████████ | 33172/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.21.gate_proj: 91%|█████████ | 33173/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.21.up_proj: 91%|█████████ | 33174/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.21.down_proj: 91%|█████████ | 33175/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.22.gate_proj: 91%|█████████ | 33176/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.22.up_proj: 91%|█████████ | 33177/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.22.down_proj: 91%|█████████ | 33178/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.23.gate_proj: 91%|█████████ | 33179/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.23.up_proj: 91%|█████████ | 33180/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.23.down_proj: 91%|█████████ | 33181/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.24.gate_proj: 91%|█████████ | 33182/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.24.up_proj: 91%|█████████ | 33183/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.24.down_proj: 91%|█████████ | 33184/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.25.gate_proj: 91%|█████████ | 33185/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.25.up_proj: 91%|█████████ | 33186/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.25.down_proj: 91%|█████████ | 33187/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.26.gate_proj: 91%|█████████ | 33188/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.26.up_proj: 91%|█████████ | 33189/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.26.down_proj: 91%|█████████ | 33190/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.27.gate_proj: 91%|█████████ | 33191/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.27.up_proj: 91%|█████████ | 33192/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.27.down_proj: 91%|█████████ | 33193/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.28.gate_proj: 91%|█████████ | 33194/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.28.up_proj: 91%|█████████ | 33195/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.28.down_proj: 91%|█████████ | 33196/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.29.gate_proj: 91%|█████████ | 33197/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.29.up_proj: 91%|█████████ | 33198/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.29.down_proj: 91%|█████████ | 33199/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.30.gate_proj: 91%|█████████ | 33200/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.30.up_proj: 91%|█████████ | 33201/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.30.down_proj: 91%|█████████ | 33202/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.31.gate_proj: 91%|█████████ | 33203/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.31.up_proj: 91%|█████████ | 33204/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.31.down_proj: 91%|█████████ | 33205/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.32.gate_proj: 91%|█████████ | 33206/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.32.up_proj: 91%|█████████ | 33207/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.32.down_proj: 91%|█████████ | 33208/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.33.gate_proj: 91%|█████████ | 33209/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.33.up_proj: 91%|█████████ | 33210/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.33.down_proj: 91%|█████████ | 33211/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.34.gate_proj: 91%|█████████ | 33212/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.34.up_proj: 91%|█████████ | 33213/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.34.down_proj: 91%|█████████ | 33214/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.35.gate_proj: 91%|█████████ | 33215/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.35.up_proj: 91%|█████████ | 33216/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.35.down_proj: 91%|█████████ | 33217/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.36.gate_proj: 91%|█████████ | 33218/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.36.up_proj: 91%|█████████ | 33219/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.36.down_proj: 91%|█████████ | 33220/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.37.gate_proj: 91%|█████████ | 33221/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.37.up_proj: 91%|█████████ | 33222/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.37.down_proj: 91%|█████████ | 33223/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.38.gate_proj: 91%|█████████ | 33224/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.38.up_proj: 91%|█████████ | 33225/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.38.down_proj: 91%|█████████ | 33226/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.39.gate_proj: 91%|█████████ | 33227/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.39.up_proj: 91%|█████████ | 33228/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.39.down_proj: 91%|█████████ | 33229/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.40.gate_proj: 91%|█████████ | 33230/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.40.up_proj: 91%|█████████ | 33231/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.40.down_proj: 91%|█████████ | 33232/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.41.gate_proj: 91%|█████████ | 33233/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.41.up_proj: 91%|█████████ | 33234/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.41.down_proj: 91%|█████████ | 33235/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.42.gate_proj: 91%|█████████ | 33236/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.42.up_proj: 91%|█████████ | 33237/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.42.down_proj: 91%|█████████ | 33238/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.43.gate_proj: 91%|█████████ | 33239/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.43.up_proj: 91%|█████████ | 33240/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.43.down_proj: 91%|█████████ | 33241/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.44.gate_proj: 91%|█████████ | 33242/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.44.up_proj: 91%|█████████ | 33243/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.44.down_proj: 91%|█████████ | 33244/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.45.gate_proj: 91%|█████████ | 33245/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.45.up_proj: 91%|█████████ | 33246/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.45.down_proj: 91%|█████████ | 33247/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.46.gate_proj: 91%|█████████ | 33248/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.46.up_proj: 91%|█████████ | 33249/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.46.down_proj: 91%|█████████ | 33250/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.47.gate_proj: 91%|█████████ | 33251/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.47.up_proj: 91%|█████████ | 33252/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.47.down_proj: 91%|█████████ | 33253/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.48.gate_proj: 91%|█████████ | 33254/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.48.up_proj: 91%|█████████ | 33255/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.48.down_proj: 91%|█████████ | 33256/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.49.gate_proj: 91%|█████████ | 33257/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.49.up_proj: 91%|█████████ | 33258/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.49.down_proj: 91%|█████████ | 33259/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.50.gate_proj: 91%|█████████ | 33260/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.50.up_proj: 91%|█████████ | 33261/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.50.down_proj: 91%|█████████ | 33262/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.51.gate_proj: 91%|█████████ | 33263/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.51.up_proj: 91%|█████████ | 33264/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.51.down_proj: 91%|█████████ | 33265/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.52.gate_proj: 91%|█████████ | 33266/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.52.up_proj: 91%|█████████ | 33267/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.52.down_proj: 91%|█████████ | 33268/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.53.gate_proj: 91%|█████████ | 33269/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.53.up_proj: 91%|█████████ | 33270/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.53.down_proj: 91%|█████████ | 33271/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.54.gate_proj: 91%|█████████ | 33272/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.54.up_proj: 91%|█████████ | 33273/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.54.down_proj: 91%|█████████ | 33274/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.55.gate_proj: 91%|█████████ | 33275/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.55.up_proj: 91%|█████████ | 33276/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.55.down_proj: 91%|█████████ | 33277/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.56.gate_proj: 91%|█████████ | 33278/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.56.up_proj: 91%|█████████ | 33279/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.56.down_proj: 91%|█████████ | 33280/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.57.gate_proj: 91%|█████████ | 33281/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.57.up_proj: 91%|█████████ | 33282/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.57.down_proj: 91%|█████████ | 33283/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.58.gate_proj: 91%|█████████ | 33284/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.58.up_proj: 91%|█████████ | 33285/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.58.down_proj: 91%|█████████ | 33286/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.59.gate_proj: 91%|█████████ | 33287/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.59.up_proj: 91%|█████████ | 33288/36566 [00:29<00:02, 1168.19it/s] packing model.layers.85.mlp.experts.59.up_proj: 91%|█████████ | 33289/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.59.down_proj: 91%|█████████ | 33289/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.60.gate_proj: 91%|█████████ | 33290/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.60.up_proj: 91%|█████████ | 33291/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.60.down_proj: 91%|█████████ | 33292/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.61.gate_proj: 91%|█████████ | 33293/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.61.up_proj: 91%|█████████ | 33294/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.61.down_proj: 91%|█████████ | 33295/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.62.gate_proj: 91%|█████████ | 33296/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.62.up_proj: 91%|█████████ | 33297/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.62.down_proj: 91%|█████████ | 33298/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.63.gate_proj: 91%|█████████ | 33299/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.63.up_proj: 91%|█████████ | 33300/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.63.down_proj: 91%|█████████ | 33301/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.64.gate_proj: 91%|█████████ | 33302/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.64.up_proj: 91%|█████████ | 33303/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.64.down_proj: 91%|█████████ | 33304/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.65.gate_proj: 91%|█████████ | 33305/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.65.up_proj: 91%|█████████ | 33306/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.65.down_proj: 91%|█████████ | 33307/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.66.gate_proj: 91%|█████████ | 33308/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.66.up_proj: 91%|█████████ | 33309/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.66.down_proj: 91%|█████████ | 33310/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.67.gate_proj: 91%|█████████ | 33311/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.67.up_proj: 91%|█████████ | 33312/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.67.down_proj: 91%|█████████ | 33313/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.68.gate_proj: 91%|█████████ | 33314/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.68.up_proj: 91%|█████████ | 33315/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.68.down_proj: 91%|█████████ | 33316/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.69.gate_proj: 91%|█████████ | 33317/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.69.up_proj: 91%|█████████ | 33318/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.69.down_proj: 91%|█████████ | 33319/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.70.gate_proj: 91%|█████████ | 33320/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.70.up_proj: 91%|█████████ | 33321/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.70.down_proj: 91%|█████████ | 33322/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.71.gate_proj: 91%|█████████ | 33323/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.71.up_proj: 91%|█████████ | 33324/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.71.down_proj: 91%|█████████ | 33325/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.72.gate_proj: 91%|█████████ | 33326/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.72.up_proj: 91%|█████████ | 33327/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.72.down_proj: 91%|█████████ | 33328/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.73.gate_proj: 91%|█████████ | 33329/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.73.up_proj: 91%|█████████ | 33330/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.73.down_proj: 91%|█████████ | 33331/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.74.gate_proj: 91%|█████████ | 33332/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.74.up_proj: 91%|█████████ | 33333/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.74.down_proj: 91%|█████████ | 33334/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.75.gate_proj: 91%|█████████ | 33335/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.75.up_proj: 91%|█████████ | 33336/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.75.down_proj: 91%|█████████ | 33337/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.76.gate_proj: 91%|█████████ | 33338/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.76.up_proj: 91%|█████████ | 33339/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.76.down_proj: 91%|█████████ | 33340/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.77.gate_proj: 91%|█████████ | 33341/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.77.up_proj: 91%|█████████ | 33342/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.77.down_proj: 91%|█████████ | 33343/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.78.gate_proj: 91%|█████████ | 33344/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.78.up_proj: 91%|█████████ | 33345/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.78.down_proj: 91%|█████████ | 33346/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.79.gate_proj: 91%|█████████ | 33347/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.79.up_proj: 91%|█████████ | 33348/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.79.down_proj: 91%|█████████ | 33349/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.80.gate_proj: 91%|█████████ | 33350/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.80.up_proj: 91%|█████████ | 33351/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.80.down_proj: 91%|█████████ | 33352/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.81.gate_proj: 91%|█████████ | 33353/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.81.up_proj: 91%|█████████ | 33354/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.81.down_proj: 91%|█████████ | 33355/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.82.gate_proj: 91%|█████████ | 33356/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.82.up_proj: 91%|█████████ | 33357/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.82.down_proj: 91%|█████████ | 33358/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.83.gate_proj: 91%|█████████ | 33359/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.83.up_proj: 91%|█████████ | 33360/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.83.down_proj: 91%|█████████ | 33361/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.84.gate_proj: 91%|█████████ | 33362/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.84.up_proj: 91%|█████████ | 33363/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.84.down_proj: 91%|█████████ | 33364/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.85.gate_proj: 91%|█████████ | 33365/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.85.up_proj: 91%|█████████ | 33366/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.85.down_proj: 91%|█████████▏| 33367/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.86.gate_proj: 91%|█████████▏| 33368/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.86.up_proj: 91%|█████████▏| 33369/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.86.down_proj: 91%|█████████▏| 33370/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.87.gate_proj: 91%|█████████▏| 33371/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.87.up_proj: 91%|█████████▏| 33372/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.87.down_proj: 91%|█████████▏| 33373/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.88.gate_proj: 91%|█████████▏| 33374/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.88.up_proj: 91%|█████████▏| 33375/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.88.down_proj: 91%|█████████▏| 33376/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.89.gate_proj: 91%|█████████▏| 33377/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.89.up_proj: 91%|█████████▏| 33378/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.89.down_proj: 91%|█████████▏| 33379/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.90.gate_proj: 91%|█████████▏| 33380/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.90.up_proj: 91%|█████████▏| 33381/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.90.down_proj: 91%|█████████▏| 33382/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.91.gate_proj: 91%|█████████▏| 33383/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.91.up_proj: 91%|█████████▏| 33384/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.91.down_proj: 91%|█████████▏| 33385/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.92.gate_proj: 91%|█████████▏| 33386/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.92.up_proj: 91%|█████████▏| 33387/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.92.down_proj: 91%|█████████▏| 33388/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.93.gate_proj: 91%|█████████▏| 33389/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.93.up_proj: 91%|█████████▏| 33390/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.93.down_proj: 91%|█████████▏| 33391/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.94.gate_proj: 91%|█████████▏| 33392/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.94.up_proj: 91%|█████████▏| 33393/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.94.down_proj: 91%|█████████▏| 33394/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.95.gate_proj: 91%|█████████▏| 33395/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.95.up_proj: 91%|█████████▏| 33396/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.95.down_proj: 91%|█████████▏| 33397/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.96.gate_proj: 91%|█████████▏| 33398/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.96.up_proj: 91%|█████████▏| 33399/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.96.down_proj: 91%|█████████▏| 33400/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.97.gate_proj: 91%|█████████▏| 33401/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.97.up_proj: 91%|█████████▏| 33402/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.97.down_proj: 91%|█████████▏| 33403/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.98.gate_proj: 91%|█████████▏| 33404/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.98.up_proj: 91%|█████████▏| 33405/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.98.down_proj: 91%|█████████▏| 33406/36566 [00:29<00:02, 1170.39it/s] packing model.layers.85.mlp.experts.98.down_proj: 91%|█████████▏| 33407/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.99.gate_proj: 91%|█████████▏| 33407/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.99.up_proj: 91%|█████████▏| 33408/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.99.down_proj: 91%|█████████▏| 33409/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.100.gate_proj: 91%|█████████▏| 33410/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.100.up_proj: 91%|█████████▏| 33411/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.100.down_proj: 91%|█████████▏| 33412/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.101.gate_proj: 91%|█████████▏| 33413/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.101.up_proj: 91%|█████████▏| 33414/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.101.down_proj: 91%|█████████▏| 33415/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.102.gate_proj: 91%|█████████▏| 33416/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.102.up_proj: 91%|█████████▏| 33417/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.102.down_proj: 91%|█████████▏| 33418/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.103.gate_proj: 91%|█████████▏| 33419/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.103.up_proj: 91%|█████████▏| 33420/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.103.down_proj: 91%|█████████▏| 33421/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.104.gate_proj: 91%|█████████▏| 33422/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.104.up_proj: 91%|█████████▏| 33423/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.104.down_proj: 91%|█████████▏| 33424/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.105.gate_proj: 91%|█████████▏| 33425/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.105.up_proj: 91%|█████████▏| 33426/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.105.down_proj: 91%|█████████▏| 33427/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.106.gate_proj: 91%|█████████▏| 33428/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.106.up_proj: 91%|█████████▏| 33429/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.106.down_proj: 91%|█████████▏| 33430/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.107.gate_proj: 91%|█████████▏| 33431/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.107.up_proj: 91%|█████████▏| 33432/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.107.down_proj: 91%|█████████▏| 33433/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.108.gate_proj: 91%|█████████▏| 33434/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.108.up_proj: 91%|█████████▏| 33435/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.108.down_proj: 91%|█████████▏| 33436/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.109.gate_proj: 91%|█████████▏| 33437/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.109.up_proj: 91%|█████████▏| 33438/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.109.down_proj: 91%|█████████▏| 33439/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.110.gate_proj: 91%|█████████▏| 33440/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.110.up_proj: 91%|█████████▏| 33441/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.110.down_proj: 91%|█████████▏| 33442/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.111.gate_proj: 91%|█████████▏| 33443/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.111.up_proj: 91%|█████████▏| 33444/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.111.down_proj: 91%|█████████▏| 33445/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.112.gate_proj: 91%|█████████▏| 33446/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.112.up_proj: 91%|█████████▏| 33447/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.112.down_proj: 91%|█████████▏| 33448/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.113.gate_proj: 91%|█████████▏| 33449/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.113.up_proj: 91%|█████████▏| 33450/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.113.down_proj: 91%|█████████▏| 33451/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.114.gate_proj: 91%|█████████▏| 33452/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.114.up_proj: 91%|█████████▏| 33453/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.114.down_proj: 91%|█████████▏| 33454/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.115.gate_proj: 91%|█████████▏| 33455/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.115.up_proj: 91%|█████████▏| 33456/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.115.down_proj: 91%|█████████▏| 33457/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.116.gate_proj: 92%|█████████▏| 33458/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.116.up_proj: 92%|█████████▏| 33459/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.116.down_proj: 92%|█████████▏| 33460/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.117.gate_proj: 92%|█████████▏| 33461/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.117.up_proj: 92%|█████████▏| 33462/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.117.down_proj: 92%|█████████▏| 33463/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.118.gate_proj: 92%|█████████▏| 33464/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.118.up_proj: 92%|█████████▏| 33465/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.118.down_proj: 92%|█████████▏| 33466/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.119.gate_proj: 92%|█████████▏| 33467/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.119.up_proj: 92%|█████████▏| 33468/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.119.down_proj: 92%|█████████▏| 33469/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.120.gate_proj: 92%|█████████▏| 33470/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.120.up_proj: 92%|█████████▏| 33471/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.120.down_proj: 92%|█████████▏| 33472/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.121.gate_proj: 92%|█████████▏| 33473/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.121.up_proj: 92%|█████████▏| 33474/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.121.down_proj: 92%|█████████▏| 33475/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.122.gate_proj: 92%|█████████▏| 33476/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.122.up_proj: 92%|█████████▏| 33477/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.122.down_proj: 92%|█████████▏| 33478/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.123.gate_proj: 92%|█████████▏| 33479/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.123.up_proj: 92%|█████████▏| 33480/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.123.down_proj: 92%|█████████▏| 33481/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.124.gate_proj: 92%|█████████▏| 33482/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.124.up_proj: 92%|█████████▏| 33483/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.124.down_proj: 92%|█████████▏| 33484/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.125.gate_proj: 92%|█████████▏| 33485/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.125.up_proj: 92%|█████████▏| 33486/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.125.down_proj: 92%|█████████▏| 33487/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.126.gate_proj: 92%|█████████▏| 33488/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.126.up_proj: 92%|█████████▏| 33489/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.126.down_proj: 92%|█████████▏| 33490/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.127.gate_proj: 92%|█████████▏| 33491/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.127.up_proj: 92%|█████████▏| 33492/36566 [00:29<00:02, 1171.14it/s] packing model.layers.85.mlp.experts.127.down_proj: 92%|█████████▏| 33493/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.0.gate_proj: 92%|█████████▏| 33494/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.0.up_proj: 92%|█████████▏| 33495/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.0.down_proj: 92%|█████████▏| 33496/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.1.gate_proj: 92%|█████████▏| 33497/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.1.up_proj: 92%|█████████▏| 33498/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.1.down_proj: 92%|█████████▏| 33499/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.2.gate_proj: 92%|█████████▏| 33500/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.2.up_proj: 92%|█████████▏| 33501/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.2.down_proj: 92%|█████████▏| 33502/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.3.gate_proj: 92%|█████████▏| 33503/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.3.up_proj: 92%|█████████▏| 33504/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.3.down_proj: 92%|█████████▏| 33505/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.4.gate_proj: 92%|█████████▏| 33506/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.4.up_proj: 92%|█████████▏| 33507/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.4.down_proj: 92%|█████████▏| 33508/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.5.gate_proj: 92%|█████████▏| 33509/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.5.up_proj: 92%|█████████▏| 33510/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.5.down_proj: 92%|█████████▏| 33511/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.6.gate_proj: 92%|█████████▏| 33512/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.6.up_proj: 92%|█████████▏| 33513/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.6.down_proj: 92%|█████████▏| 33514/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.7.gate_proj: 92%|█████████▏| 33515/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.7.up_proj: 92%|█████████▏| 33516/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.7.down_proj: 92%|█████████▏| 33517/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.8.gate_proj: 92%|█████████▏| 33518/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.8.up_proj: 92%|█████████▏| 33519/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.8.down_proj: 92%|█████████▏| 33520/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.9.gate_proj: 92%|█████████▏| 33521/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.9.up_proj: 92%|█████████▏| 33522/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.9.down_proj: 92%|█████████▏| 33523/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.10.gate_proj: 92%|█████████▏| 33524/36566 [00:29<00:02, 1171.14it/s] packing model.layers.86.mlp.experts.10.gate_proj: 92%|█████████▏| 33525/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.10.up_proj: 92%|█████████▏| 33525/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.10.down_proj: 92%|█████████▏| 33526/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.11.gate_proj: 92%|█████████▏| 33527/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.11.up_proj: 92%|█████████▏| 33528/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.11.down_proj: 92%|█████████▏| 33529/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.12.gate_proj: 92%|█████████▏| 33530/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.12.up_proj: 92%|█████████▏| 33531/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.12.down_proj: 92%|█████████▏| 33532/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.13.gate_proj: 92%|█████████▏| 33533/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.13.up_proj: 92%|█████████▏| 33534/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.13.down_proj: 92%|█████████▏| 33535/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.14.gate_proj: 92%|█████████▏| 33536/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.14.up_proj: 92%|█████████▏| 33537/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.14.down_proj: 92%|█████████▏| 33538/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.15.gate_proj: 92%|█████████▏| 33539/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.15.up_proj: 92%|█████████▏| 33540/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.15.down_proj: 92%|█████████▏| 33541/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.16.gate_proj: 92%|█████████▏| 33542/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.16.up_proj: 92%|█████████▏| 33543/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.16.down_proj: 92%|█████████▏| 33544/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.17.gate_proj: 92%|█████████▏| 33545/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.17.up_proj: 92%|█████████▏| 33546/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.17.down_proj: 92%|█████████▏| 33547/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.18.gate_proj: 92%|█████████▏| 33548/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.18.up_proj: 92%|█████████▏| 33549/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.18.down_proj: 92%|█████████▏| 33550/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.19.gate_proj: 92%|█████████▏| 33551/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.19.up_proj: 92%|█████████▏| 33552/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.19.down_proj: 92%|█████████▏| 33553/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.20.gate_proj: 92%|█████████▏| 33554/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.20.up_proj: 92%|█████████▏| 33555/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.20.down_proj: 92%|█████████▏| 33556/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.21.gate_proj: 92%|█████████▏| 33557/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.21.up_proj: 92%|█████████▏| 33558/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.21.down_proj: 92%|█████████▏| 33559/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.22.gate_proj: 92%|█████████▏| 33560/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.22.up_proj: 92%|█████████▏| 33561/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.22.down_proj: 92%|█████████▏| 33562/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.23.gate_proj: 92%|█████████▏| 33563/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.23.up_proj: 92%|█████████▏| 33564/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.23.down_proj: 92%|█████████▏| 33565/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.24.gate_proj: 92%|█████████▏| 33566/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.24.up_proj: 92%|█████████▏| 33567/36566 [00:29<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.24.down_proj: 92%|█████████▏| 33568/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.25.gate_proj: 92%|█████████▏| 33569/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.25.up_proj: 92%|█████████▏| 33570/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.25.down_proj: 92%|█████████▏| 33571/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.26.gate_proj: 92%|█████████▏| 33572/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.26.up_proj: 92%|█████████▏| 33573/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.26.down_proj: 92%|█████████▏| 33574/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.27.gate_proj: 92%|█████████▏| 33575/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.27.up_proj: 92%|█████████▏| 33576/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.27.down_proj: 92%|█████████▏| 33577/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.28.gate_proj: 92%|█████████▏| 33578/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.28.up_proj: 92%|█████████▏| 33579/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.28.down_proj: 92%|█████████▏| 33580/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.29.gate_proj: 92%|█████████▏| 33581/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.29.up_proj: 92%|█████████▏| 33582/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.29.down_proj: 92%|█████████▏| 33583/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.30.gate_proj: 92%|█████████▏| 33584/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.30.up_proj: 92%|█████████▏| 33585/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.30.down_proj: 92%|█████████▏| 33586/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.31.gate_proj: 92%|█████████▏| 33587/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.31.up_proj: 92%|█████████▏| 33588/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.31.down_proj: 92%|█████████▏| 33589/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.32.gate_proj: 92%|█████████▏| 33590/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.32.up_proj: 92%|█████████▏| 33591/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.32.down_proj: 92%|█████████▏| 33592/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.33.gate_proj: 92%|█████████▏| 33593/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.33.up_proj: 92%|█████████▏| 33594/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.33.down_proj: 92%|█████████▏| 33595/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.34.gate_proj: 92%|█████████▏| 33596/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.34.up_proj: 92%|█████████▏| 33597/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.34.down_proj: 92%|█████████▏| 33598/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.35.gate_proj: 92%|█████████▏| 33599/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.35.up_proj: 92%|█████████▏| 33600/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.35.down_proj: 92%|█████████▏| 33601/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.36.gate_proj: 92%|█████████▏| 33602/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.36.up_proj: 92%|█████████▏| 33603/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.36.down_proj: 92%|█████████▏| 33604/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.37.gate_proj: 92%|█████████▏| 33605/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.37.up_proj: 92%|█████████▏| 33606/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.37.down_proj: 92%|█████████▏| 33607/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.38.gate_proj: 92%|█████████▏| 33608/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.38.up_proj: 92%|█████████▏| 33609/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.38.down_proj: 92%|█████████▏| 33610/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.39.gate_proj: 92%|█████████▏| 33611/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.39.up_proj: 92%|█████████▏| 33612/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.39.down_proj: 92%|█████████▏| 33613/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.40.gate_proj: 92%|█████████▏| 33614/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.40.up_proj: 92%|█████████▏| 33615/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.40.down_proj: 92%|█████████▏| 33616/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.41.gate_proj: 92%|█████████▏| 33617/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.41.up_proj: 92%|█████████▏| 33618/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.41.down_proj: 92%|█████████▏| 33619/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.42.gate_proj: 92%|█████████▏| 33620/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.42.up_proj: 92%|█████████▏| 33621/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.42.down_proj: 92%|█████████▏| 33622/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.43.gate_proj: 92%|█████████▏| 33623/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.43.up_proj: 92%|█████████▏| 33624/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.43.down_proj: 92%|█████████▏| 33625/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.44.gate_proj: 92%|█████████▏| 33626/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.44.up_proj: 92%|█████████▏| 33627/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.44.down_proj: 92%|█████████▏| 33628/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.45.gate_proj: 92%|█████████▏| 33629/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.45.up_proj: 92%|█████████▏| 33630/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.45.down_proj: 92%|█████████▏| 33631/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.46.gate_proj: 92%|█████████▏| 33632/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.46.up_proj: 92%|█████████▏| 33633/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.46.down_proj: 92%|█████████▏| 33634/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.47.gate_proj: 92%|█████████▏| 33635/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.47.up_proj: 92%|█████████▏| 33636/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.47.down_proj: 92%|█████████▏| 33637/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.48.gate_proj: 92%|█████████▏| 33638/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.48.up_proj: 92%|█████████▏| 33639/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.48.down_proj: 92%|█████████▏| 33640/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.49.gate_proj: 92%|█████████▏| 33641/36566 [00:30<00:02, 1168.81it/s] packing model.layers.86.mlp.experts.49.gate_proj: 92%|█████████▏| 33642/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.49.up_proj: 92%|█████████▏| 33642/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.49.down_proj: 92%|█████████▏| 33643/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.50.gate_proj: 92%|█████████▏| 33644/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.50.up_proj: 92%|█████████▏| 33645/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.50.down_proj: 92%|█████████▏| 33646/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.51.gate_proj: 92%|█████████▏| 33647/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.51.up_proj: 92%|█████████▏| 33648/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.51.down_proj: 92%|█████████▏| 33649/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.52.gate_proj: 92%|█████████▏| 33650/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.52.up_proj: 92%|█████████▏| 33651/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.52.down_proj: 92%|█████████▏| 33652/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.53.gate_proj: 92%|█████████▏| 33653/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.53.up_proj: 92%|█████████▏| 33654/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.53.down_proj: 92%|█████████▏| 33655/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.54.gate_proj: 92%|█████████▏| 33656/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.54.up_proj: 92%|█████████▏| 33657/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.54.down_proj: 92%|█████████▏| 33658/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.55.gate_proj: 92%|█████████▏| 33659/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.55.up_proj: 92%|█████████▏| 33660/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.55.down_proj: 92%|█████████▏| 33661/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.56.gate_proj: 92%|█████████▏| 33662/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.56.up_proj: 92%|█████████▏| 33663/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.56.down_proj: 92%|█████████▏| 33664/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.57.gate_proj: 92%|█████████▏| 33665/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.57.up_proj: 92%|█████████▏| 33666/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.57.down_proj: 92%|█████████▏| 33667/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.58.gate_proj: 92%|█████████▏| 33668/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.58.up_proj: 92%|█████████▏| 33669/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.58.down_proj: 92%|█████████▏| 33670/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.59.gate_proj: 92%|█████████▏| 33671/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.59.up_proj: 92%|█████████▏| 33672/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.59.down_proj: 92%|█████████▏| 33673/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.60.gate_proj: 92%|█████████▏| 33674/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.60.up_proj: 92%|█████████▏| 33675/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.60.down_proj: 92%|█████████▏| 33676/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.61.gate_proj: 92%|█████████▏| 33677/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.61.up_proj: 92%|█████████▏| 33678/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.61.down_proj: 92%|█████████▏| 33679/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.62.gate_proj: 92%|█████████▏| 33680/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.62.up_proj: 92%|█████████▏| 33681/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.62.down_proj: 92%|█████████▏| 33682/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.63.gate_proj: 92%|█████████▏| 33683/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.63.up_proj: 92%|█████████▏| 33684/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.63.down_proj: 92%|█████████▏| 33685/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.64.gate_proj: 92%|█████████▏| 33686/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.64.up_proj: 92%|█████████▏| 33687/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.64.down_proj: 92%|█████████▏| 33688/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.65.gate_proj: 92%|█████████▏| 33689/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.65.up_proj: 92%|█████████▏| 33690/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.65.down_proj: 92%|█████████▏| 33691/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.66.gate_proj: 92%|█████████▏| 33692/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.66.up_proj: 92%|█████████▏| 33693/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.66.down_proj: 92%|█████████▏| 33694/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.67.gate_proj: 92%|█████████▏| 33695/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.67.up_proj: 92%|█████████▏| 33696/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.67.down_proj: 92%|█████████▏| 33697/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.68.gate_proj: 92%|█████████▏| 33698/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.68.up_proj: 92%|█████████▏| 33699/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.68.down_proj: 92%|█████████▏| 33700/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.69.gate_proj: 92%|█████████▏| 33701/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.69.up_proj: 92%|█████████▏| 33702/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.69.down_proj: 92%|█████████▏| 33703/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.70.gate_proj: 92%|█████████▏| 33704/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.70.up_proj: 92%|█████████▏| 33705/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.70.down_proj: 92%|█████████▏| 33706/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.71.gate_proj: 92%|█████████▏| 33707/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.71.up_proj: 92%|█████████▏| 33708/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.71.down_proj: 92%|█████████▏| 33709/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.72.gate_proj: 92%|█████████▏| 33710/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.72.up_proj: 92%|█████████▏| 33711/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.72.down_proj: 92%|█████████▏| 33712/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.73.gate_proj: 92%|█████████▏| 33713/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.73.up_proj: 92%|█████████▏| 33714/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.73.down_proj: 92%|█████████▏| 33715/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.74.gate_proj: 92%|█████████▏| 33716/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.74.up_proj: 92%|█████████▏| 33717/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.74.down_proj: 92%|█████████▏| 33718/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.75.gate_proj: 92%|█████████▏| 33719/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.75.up_proj: 92%|█████████▏| 33720/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.75.down_proj: 92%|█████████▏| 33721/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.76.gate_proj: 92%|█████████▏| 33722/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.76.up_proj: 92%|█████████▏| 33723/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.76.down_proj: 92%|█████████▏| 33724/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.77.gate_proj: 92%|█████████▏| 33725/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.77.up_proj: 92%|█████████▏| 33726/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.77.down_proj: 92%|█████████▏| 33727/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.78.gate_proj: 92%|█████████▏| 33728/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.78.up_proj: 92%|█████████▏| 33729/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.78.down_proj: 92%|█████████▏| 33730/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.79.gate_proj: 92%|█████████▏| 33731/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.79.up_proj: 92%|█████████▏| 33732/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.79.down_proj: 92%|█████████▏| 33733/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.80.gate_proj: 92%|█████████▏| 33734/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.80.up_proj: 92%|█████████▏| 33735/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.80.down_proj: 92%|█████████▏| 33736/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.81.gate_proj: 92%|█████████▏| 33737/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.81.up_proj: 92%|█████████▏| 33738/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.81.down_proj: 92%|█████████▏| 33739/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.82.gate_proj: 92%|█████████▏| 33740/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.82.up_proj: 92%|█████████▏| 33741/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.82.down_proj: 92%|█████████▏| 33742/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.83.gate_proj: 92%|█████████▏| 33743/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.83.up_proj: 92%|█████████▏| 33744/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.83.down_proj: 92%|█████████▏| 33745/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.84.gate_proj: 92%|█████████▏| 33746/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.84.up_proj: 92%|█████████▏| 33747/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.84.down_proj: 92%|█████████▏| 33748/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.85.gate_proj: 92%|█████████▏| 33749/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.85.up_proj: 92%|█████████▏| 33750/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.85.down_proj: 92%|█████████▏| 33751/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.86.gate_proj: 92%|█████████▏| 33752/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.86.up_proj: 92%|█████████▏| 33753/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.86.down_proj: 92%|█████████▏| 33754/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.87.gate_proj: 92%|█████████▏| 33755/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.87.up_proj: 92%|█████████▏| 33756/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.87.down_proj: 92%|█████████▏| 33757/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.88.gate_proj: 92%|█████████▏| 33758/36566 [00:30<00:02, 1164.04it/s] packing model.layers.86.mlp.experts.88.gate_proj: 92%|█████████▏| 33759/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.88.up_proj: 92%|█████████▏| 33759/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.88.down_proj: 92%|█████████▏| 33760/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.89.gate_proj: 92%|█████████▏| 33761/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.89.up_proj: 92%|█████████▏| 33762/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.89.down_proj: 92%|█████████▏| 33763/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.90.gate_proj: 92%|█████████▏| 33764/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.90.up_proj: 92%|█████████▏| 33765/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.90.down_proj: 92%|█████████▏| 33766/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.91.gate_proj: 92%|█████████▏| 33767/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.91.up_proj: 92%|█████████▏| 33768/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.91.down_proj: 92%|█████████▏| 33769/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.92.gate_proj: 92%|█████████▏| 33770/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.92.up_proj: 92%|█████████▏| 33771/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.92.down_proj: 92%|█████████▏| 33772/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.93.gate_proj: 92%|█████████▏| 33773/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.93.up_proj: 92%|█████████▏| 33774/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.93.down_proj: 92%|█████████▏| 33775/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.94.gate_proj: 92%|█████████▏| 33776/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.94.up_proj: 92%|█████████▏| 33777/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.94.down_proj: 92%|█████████▏| 33778/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.95.gate_proj: 92%|█████████▏| 33779/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.95.up_proj: 92%|█████████▏| 33780/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.95.down_proj: 92%|█████████▏| 33781/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.96.gate_proj: 92%|█████████▏| 33782/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.96.up_proj: 92%|█████████▏| 33783/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.96.down_proj: 92%|█████████▏| 33784/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.97.gate_proj: 92%|█████████▏| 33785/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.97.up_proj: 92%|█████████▏| 33786/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.97.down_proj: 92%|█████████▏| 33787/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.98.gate_proj: 92%|█████████▏| 33788/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.98.up_proj: 92%|█████████▏| 33789/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.98.down_proj: 92%|█████████▏| 33790/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.99.gate_proj: 92%|█████████▏| 33791/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.99.up_proj: 92%|█████████▏| 33792/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.99.down_proj: 92%|█████████▏| 33793/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.100.gate_proj: 92%|█████████▏| 33794/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.100.up_proj: 92%|█████████▏| 33795/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.100.down_proj: 92%|█████████▏| 33796/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.101.gate_proj: 92%|█████████▏| 33797/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.101.up_proj: 92%|█████████▏| 33798/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.101.down_proj: 92%|█████████▏| 33799/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.102.gate_proj: 92%|█████████▏| 33800/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.102.up_proj: 92%|█████████▏| 33801/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.102.down_proj: 92%|█████████▏| 33802/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.103.gate_proj: 92%|█████████▏| 33803/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.103.up_proj: 92%|█████████▏| 33804/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.103.down_proj: 92%|█████████▏| 33805/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.104.gate_proj: 92%|█████████▏| 33806/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.104.up_proj: 92%|█████████▏| 33807/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.104.down_proj: 92%|█████████▏| 33808/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.105.gate_proj: 92%|█████████▏| 33809/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.105.up_proj: 92%|█████████▏| 33810/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.105.down_proj: 92%|█████████▏| 33811/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.106.gate_proj: 92%|█████████▏| 33812/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.106.up_proj: 92%|█████████▏| 33813/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.106.down_proj: 92%|█████████▏| 33814/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.107.gate_proj: 92%|█████████▏| 33815/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.107.up_proj: 92%|█████████▏| 33816/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.107.down_proj: 92%|█████████▏| 33817/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.108.gate_proj: 92%|█████████▏| 33818/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.108.up_proj: 92%|█████████▏| 33819/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.108.down_proj: 92%|█████████▏| 33820/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.109.gate_proj: 92%|█████████▏| 33821/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.109.up_proj: 92%|█████████▏| 33822/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.109.down_proj: 92%|█████████▏| 33823/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.110.gate_proj: 93%|█████████▎| 33824/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.110.up_proj: 93%|█████████▎| 33825/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.110.down_proj: 93%|█████████▎| 33826/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.111.gate_proj: 93%|█████████▎| 33827/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.111.up_proj: 93%|█████████▎| 33828/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.111.down_proj: 93%|█████████▎| 33829/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.112.gate_proj: 93%|█████████▎| 33830/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.112.up_proj: 93%|█████████▎| 33831/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.112.down_proj: 93%|█████████▎| 33832/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.113.gate_proj: 93%|█████████▎| 33833/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.113.up_proj: 93%|█████████▎| 33834/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.113.down_proj: 93%|█████████▎| 33835/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.114.gate_proj: 93%|█████████▎| 33836/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.114.up_proj: 93%|█████████▎| 33837/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.114.down_proj: 93%|█████████▎| 33838/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.115.gate_proj: 93%|█████████▎| 33839/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.115.up_proj: 93%|█████████▎| 33840/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.115.down_proj: 93%|█████████▎| 33841/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.116.gate_proj: 93%|█████████▎| 33842/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.116.up_proj: 93%|█████████▎| 33843/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.116.down_proj: 93%|█████████▎| 33844/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.117.gate_proj: 93%|█████████▎| 33845/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.117.up_proj: 93%|█████████▎| 33846/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.117.down_proj: 93%|█████████▎| 33847/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.118.gate_proj: 93%|█████████▎| 33848/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.118.up_proj: 93%|█████████▎| 33849/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.118.down_proj: 93%|█████████▎| 33850/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.119.gate_proj: 93%|█████████▎| 33851/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.119.up_proj: 93%|█████████▎| 33852/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.119.down_proj: 93%|█████████▎| 33853/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.120.gate_proj: 93%|█████████▎| 33854/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.120.up_proj: 93%|█████████▎| 33855/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.120.down_proj: 93%|█████████▎| 33856/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.121.gate_proj: 93%|█████████▎| 33857/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.121.up_proj: 93%|█████████▎| 33858/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.121.down_proj: 93%|█████████▎| 33859/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.122.gate_proj: 93%|█████████▎| 33860/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.122.up_proj: 93%|█████████▎| 33861/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.122.down_proj: 93%|█████████▎| 33862/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.123.gate_proj: 93%|█████████▎| 33863/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.123.up_proj: 93%|█████████▎| 33864/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.123.down_proj: 93%|█████████▎| 33865/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.124.gate_proj: 93%|█████████▎| 33866/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.124.up_proj: 93%|█████████▎| 33867/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.124.down_proj: 93%|█████████▎| 33868/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.125.gate_proj: 93%|█████████▎| 33869/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.125.up_proj: 93%|█████████▎| 33870/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.125.down_proj: 93%|█████████▎| 33871/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.126.gate_proj: 93%|█████████▎| 33872/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.126.up_proj: 93%|█████████▎| 33873/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.126.down_proj: 93%|█████████▎| 33874/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.127.gate_proj: 93%|█████████▎| 33875/36566 [00:30<00:02, 1164.46it/s] packing model.layers.86.mlp.experts.127.gate_proj: 93%|█████████▎| 33876/36566 [00:30<00:02, 1165.52it/s] packing model.layers.86.mlp.experts.127.up_proj: 93%|█████████▎| 33876/36566 [00:30<00:02, 1165.52it/s] packing model.layers.86.mlp.experts.127.down_proj: 93%|█████████▎| 33877/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.0.gate_proj: 93%|█████████▎| 33878/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.0.up_proj: 93%|█████████▎| 33879/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.0.down_proj: 93%|█████████▎| 33880/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.1.gate_proj: 93%|█████████▎| 33881/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.1.up_proj: 93%|█████████▎| 33882/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.1.down_proj: 93%|█████████▎| 33883/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.2.gate_proj: 93%|█████████▎| 33884/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.2.up_proj: 93%|█████████▎| 33885/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.2.down_proj: 93%|█████████▎| 33886/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.3.gate_proj: 93%|█████████▎| 33887/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.3.up_proj: 93%|█████████▎| 33888/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.3.down_proj: 93%|█████████▎| 33889/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.4.gate_proj: 93%|█████████▎| 33890/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.4.up_proj: 93%|█████████▎| 33891/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.4.down_proj: 93%|█████████▎| 33892/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.5.gate_proj: 93%|█████████▎| 33893/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.5.up_proj: 93%|█████████▎| 33894/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.5.down_proj: 93%|█████████▎| 33895/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.6.gate_proj: 93%|█████████▎| 33896/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.6.up_proj: 93%|█████████▎| 33897/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.6.down_proj: 93%|█████████▎| 33898/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.7.gate_proj: 93%|█████████▎| 33899/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.7.up_proj: 93%|█████████▎| 33900/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.7.down_proj: 93%|█████████▎| 33901/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.8.gate_proj: 93%|█████████▎| 33902/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.8.up_proj: 93%|█████████▎| 33903/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.8.down_proj: 93%|█████████▎| 33904/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.9.gate_proj: 93%|█████████▎| 33905/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.9.up_proj: 93%|█████████▎| 33906/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.9.down_proj: 93%|█████████▎| 33907/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.10.gate_proj: 93%|█████████▎| 33908/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.10.up_proj: 93%|█████████▎| 33909/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.10.down_proj: 93%|█████████▎| 33910/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.11.gate_proj: 93%|█████████▎| 33911/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.11.up_proj: 93%|█████████▎| 33912/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.11.down_proj: 93%|█████████▎| 33913/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.12.gate_proj: 93%|█████████▎| 33914/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.12.up_proj: 93%|█████████▎| 33915/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.12.down_proj: 93%|█████████▎| 33916/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.13.gate_proj: 93%|█████████▎| 33917/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.13.up_proj: 93%|█████████▎| 33918/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.13.down_proj: 93%|█████████▎| 33919/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.14.gate_proj: 93%|█████████▎| 33920/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.14.up_proj: 93%|█████████▎| 33921/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.14.down_proj: 93%|█████████▎| 33922/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.15.gate_proj: 93%|█████████▎| 33923/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.15.up_proj: 93%|█████████▎| 33924/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.15.down_proj: 93%|█████████▎| 33925/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.16.gate_proj: 93%|█████████▎| 33926/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.16.up_proj: 93%|█████████▎| 33927/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.16.down_proj: 93%|█████████▎| 33928/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.17.gate_proj: 93%|█████████▎| 33929/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.17.up_proj: 93%|█████████▎| 33930/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.17.down_proj: 93%|█████████▎| 33931/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.18.gate_proj: 93%|█████████▎| 33932/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.18.up_proj: 93%|█████████▎| 33933/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.18.down_proj: 93%|█████████▎| 33934/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.19.gate_proj: 93%|█████████▎| 33935/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.19.up_proj: 93%|█████████▎| 33936/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.19.down_proj: 93%|█████████▎| 33937/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.20.gate_proj: 93%|█████████▎| 33938/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.20.up_proj: 93%|█████████▎| 33939/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.20.down_proj: 93%|█████████▎| 33940/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.21.gate_proj: 93%|█████████▎| 33941/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.21.up_proj: 93%|█████████▎| 33942/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.21.down_proj: 93%|█████████▎| 33943/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.22.gate_proj: 93%|█████████▎| 33944/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.22.up_proj: 93%|█████████▎| 33945/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.22.down_proj: 93%|█████████▎| 33946/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.23.gate_proj: 93%|█████████▎| 33947/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.23.up_proj: 93%|█████████▎| 33948/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.23.down_proj: 93%|█████████▎| 33949/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.24.gate_proj: 93%|█████████▎| 33950/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.24.up_proj: 93%|█████████▎| 33951/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.24.down_proj: 93%|█████████▎| 33952/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.25.gate_proj: 93%|█████████▎| 33953/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.25.up_proj: 93%|█████████▎| 33954/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.25.down_proj: 93%|█████████▎| 33955/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.26.gate_proj: 93%|█████████▎| 33956/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.26.up_proj: 93%|█████████▎| 33957/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.26.down_proj: 93%|█████████▎| 33958/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.27.gate_proj: 93%|█████████▎| 33959/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.27.up_proj: 93%|█████████▎| 33960/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.27.down_proj: 93%|█████████▎| 33961/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.28.gate_proj: 93%|█████████▎| 33962/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.28.up_proj: 93%|█████████▎| 33963/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.28.down_proj: 93%|█████████▎| 33964/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.29.gate_proj: 93%|█████████▎| 33965/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.29.up_proj: 93%|█████████▎| 33966/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.29.down_proj: 93%|█████████▎| 33967/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.30.gate_proj: 93%|█████████▎| 33968/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.30.up_proj: 93%|█████████▎| 33969/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.30.down_proj: 93%|█████████▎| 33970/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.31.gate_proj: 93%|█████████▎| 33971/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.31.up_proj: 93%|█████████▎| 33972/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.31.down_proj: 93%|█████████▎| 33973/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.32.gate_proj: 93%|█████████▎| 33974/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.32.up_proj: 93%|█████████▎| 33975/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.32.down_proj: 93%|█████████▎| 33976/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.33.gate_proj: 93%|█████████▎| 33977/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.33.up_proj: 93%|█████████▎| 33978/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.33.down_proj: 93%|█████████▎| 33979/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.34.gate_proj: 93%|█████████▎| 33980/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.34.up_proj: 93%|█████████▎| 33981/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.34.down_proj: 93%|█████████▎| 33982/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.35.gate_proj: 93%|█████████▎| 33983/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.35.up_proj: 93%|█████████▎| 33984/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.35.down_proj: 93%|█████████▎| 33985/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.36.gate_proj: 93%|█████████▎| 33986/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.36.up_proj: 93%|█████████▎| 33987/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.36.down_proj: 93%|█████████▎| 33988/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.37.gate_proj: 93%|█████████▎| 33989/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.37.up_proj: 93%|█████████▎| 33990/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.37.down_proj: 93%|█████████▎| 33991/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.38.gate_proj: 93%|█████████▎| 33992/36566 [00:30<00:02, 1165.52it/s] packing model.layers.87.mlp.experts.38.gate_proj: 93%|█████████▎| 33993/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.38.up_proj: 93%|█████████▎| 33993/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.38.down_proj: 93%|█████████▎| 33994/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.39.gate_proj: 93%|█████████▎| 33995/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.39.up_proj: 93%|█████████▎| 33996/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.39.down_proj: 93%|█████████▎| 33997/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.40.gate_proj: 93%|█████████▎| 33998/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.40.up_proj: 93%|█████████▎| 33999/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.40.down_proj: 93%|█████████▎| 34000/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.41.gate_proj: 93%|█████████▎| 34001/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.41.up_proj: 93%|█████████▎| 34002/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.41.down_proj: 93%|█████████▎| 34003/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.42.gate_proj: 93%|█████████▎| 34004/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.42.up_proj: 93%|█████████▎| 34005/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.42.down_proj: 93%|█████████▎| 34006/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.43.gate_proj: 93%|█████████▎| 34007/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.43.up_proj: 93%|█████████▎| 34008/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.43.down_proj: 93%|█████████▎| 34009/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.44.gate_proj: 93%|█████████▎| 34010/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.44.up_proj: 93%|█████████▎| 34011/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.44.down_proj: 93%|█████████▎| 34012/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.45.gate_proj: 93%|█████████▎| 34013/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.45.up_proj: 93%|█████████▎| 34014/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.45.down_proj: 93%|█████████▎| 34015/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.46.gate_proj: 93%|█████████▎| 34016/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.46.up_proj: 93%|█████████▎| 34017/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.46.down_proj: 93%|█████████▎| 34018/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.47.gate_proj: 93%|█████████▎| 34019/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.47.up_proj: 93%|█████████▎| 34020/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.47.down_proj: 93%|█████████▎| 34021/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.48.gate_proj: 93%|█████████▎| 34022/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.48.up_proj: 93%|█████████▎| 34023/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.48.down_proj: 93%|█████████▎| 34024/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.49.gate_proj: 93%|█████████▎| 34025/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.49.up_proj: 93%|█████████▎| 34026/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.49.down_proj: 93%|█████████▎| 34027/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.50.gate_proj: 93%|█████████▎| 34028/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.50.up_proj: 93%|█████████▎| 34029/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.50.down_proj: 93%|█████████▎| 34030/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.51.gate_proj: 93%|█████████▎| 34031/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.51.up_proj: 93%|█████████▎| 34032/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.51.down_proj: 93%|█████████▎| 34033/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.52.gate_proj: 93%|█████████▎| 34034/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.52.up_proj: 93%|█████████▎| 34035/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.52.down_proj: 93%|█████████▎| 34036/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.53.gate_proj: 93%|█████████▎| 34037/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.53.up_proj: 93%|█████████▎| 34038/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.53.down_proj: 93%|█████████▎| 34039/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.54.gate_proj: 93%|█████████▎| 34040/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.54.up_proj: 93%|█████████▎| 34041/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.54.down_proj: 93%|█████████▎| 34042/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.55.gate_proj: 93%|█████████▎| 34043/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.55.up_proj: 93%|█████████▎| 34044/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.55.down_proj: 93%|█████████▎| 34045/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.56.gate_proj: 93%|█████████▎| 34046/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.56.up_proj: 93%|█████████▎| 34047/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.56.down_proj: 93%|█████████▎| 34048/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.57.gate_proj: 93%|█████████▎| 34049/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.57.up_proj: 93%|█████████▎| 34050/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.57.down_proj: 93%|█████████▎| 34051/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.58.gate_proj: 93%|█████████▎| 34052/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.58.up_proj: 93%|█████████▎| 34053/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.58.down_proj: 93%|█████████▎| 34054/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.59.gate_proj: 93%|█████████▎| 34055/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.59.up_proj: 93%|█████████▎| 34056/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.59.down_proj: 93%|█████████▎| 34057/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.60.gate_proj: 93%|█████████▎| 34058/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.60.up_proj: 93%|█████████▎| 34059/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.60.down_proj: 93%|█████████▎| 34060/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.61.gate_proj: 93%|█████████▎| 34061/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.61.up_proj: 93%|█████████▎| 34062/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.61.down_proj: 93%|█████████▎| 34063/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.62.gate_proj: 93%|█████████▎| 34064/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.62.up_proj: 93%|█████████▎| 34065/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.62.down_proj: 93%|█████████▎| 34066/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.63.gate_proj: 93%|█████████▎| 34067/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.63.up_proj: 93%|█████████▎| 34068/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.63.down_proj: 93%|█████████▎| 34069/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.64.gate_proj: 93%|█████████▎| 34070/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.64.up_proj: 93%|█████████▎| 34071/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.64.down_proj: 93%|█████████▎| 34072/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.65.gate_proj: 93%|█████████▎| 34073/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.65.up_proj: 93%|█████████▎| 34074/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.65.down_proj: 93%|█████████▎| 34075/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.66.gate_proj: 93%|█████████▎| 34076/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.66.up_proj: 93%|█████████▎| 34077/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.66.down_proj: 93%|█████████▎| 34078/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.67.gate_proj: 93%|█████████▎| 34079/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.67.up_proj: 93%|█████████▎| 34080/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.67.down_proj: 93%|█████████▎| 34081/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.68.gate_proj: 93%|█████████▎| 34082/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.68.up_proj: 93%|█████████▎| 34083/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.68.down_proj: 93%|█████████▎| 34084/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.69.gate_proj: 93%|█████████▎| 34085/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.69.up_proj: 93%|█████████▎| 34086/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.69.down_proj: 93%|█████████▎| 34087/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.70.gate_proj: 93%|█████████▎| 34088/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.70.up_proj: 93%|█████████▎| 34089/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.70.down_proj: 93%|█████████▎| 34090/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.71.gate_proj: 93%|█████████▎| 34091/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.71.up_proj: 93%|█████████▎| 34092/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.71.down_proj: 93%|█████████▎| 34093/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.72.gate_proj: 93%|█████████▎| 34094/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.72.up_proj: 93%|█████████▎| 34095/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.72.down_proj: 93%|█████████▎| 34096/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.73.gate_proj: 93%|█████████▎| 34097/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.73.up_proj: 93%|█████████▎| 34098/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.73.down_proj: 93%|█████████▎| 34099/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.74.gate_proj: 93%|█████████▎| 34100/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.74.up_proj: 93%|█████████▎| 34101/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.74.down_proj: 93%|█████████▎| 34102/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.75.gate_proj: 93%|█████████▎| 34103/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.75.up_proj: 93%|█████████▎| 34104/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.75.down_proj: 93%|█████████▎| 34105/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.76.gate_proj: 93%|█████████▎| 34106/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.76.up_proj: 93%|█████████▎| 34107/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.76.down_proj: 93%|█████████▎| 34108/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.77.gate_proj: 93%|█████████▎| 34109/36566 [00:30<00:02, 1165.93it/s] packing model.layers.87.mlp.experts.77.gate_proj: 93%|█████████▎| 34110/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.77.up_proj: 93%|█████████▎| 34110/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.77.down_proj: 93%|█████████▎| 34111/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.78.gate_proj: 93%|█████████▎| 34112/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.78.up_proj: 93%|█████████▎| 34113/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.78.down_proj: 93%|█████████▎| 34114/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.79.gate_proj: 93%|█████████▎| 34115/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.79.up_proj: 93%|█████████▎| 34116/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.79.down_proj: 93%|█████████▎| 34117/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.80.gate_proj: 93%|█████████▎| 34118/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.80.up_proj: 93%|█████████▎| 34119/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.80.down_proj: 93%|█████████▎| 34120/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.81.gate_proj: 93%|█████████▎| 34121/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.81.up_proj: 93%|█████████▎| 34122/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.81.down_proj: 93%|█████████▎| 34123/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.82.gate_proj: 93%|█████████▎| 34124/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.82.up_proj: 93%|█████████▎| 34125/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.82.down_proj: 93%|█████████▎| 34126/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.83.gate_proj: 93%|█████████▎| 34127/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.83.up_proj: 93%|█████████▎| 34128/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.83.down_proj: 93%|█████████▎| 34129/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.84.gate_proj: 93%|█████████▎| 34130/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.84.up_proj: 93%|█████████▎| 34131/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.84.down_proj: 93%|█████████▎| 34132/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.85.gate_proj: 93%|█████████▎| 34133/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.85.up_proj: 93%|█████████▎| 34134/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.85.down_proj: 93%|█████████▎| 34135/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.86.gate_proj: 93%|█████████▎| 34136/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.86.up_proj: 93%|█████████▎| 34137/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.86.down_proj: 93%|█████████▎| 34138/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.87.gate_proj: 93%|█████████▎| 34139/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.87.up_proj: 93%|█████████▎| 34140/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.87.down_proj: 93%|█████████▎| 34141/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.88.gate_proj: 93%|█████████▎| 34142/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.88.up_proj: 93%|█████████▎| 34143/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.88.down_proj: 93%|█████████▎| 34144/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.89.gate_proj: 93%|█████████▎| 34145/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.89.up_proj: 93%|█████████▎| 34146/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.89.down_proj: 93%|█████████▎| 34147/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.90.gate_proj: 93%|█████████▎| 34148/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.90.up_proj: 93%|█████████▎| 34149/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.90.down_proj: 93%|█████████▎| 34150/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.91.gate_proj: 93%|█████████▎| 34151/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.91.up_proj: 93%|█████████▎| 34152/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.91.down_proj: 93%|█████████▎| 34153/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.92.gate_proj: 93%|█████████▎| 34154/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.92.up_proj: 93%|█████████▎| 34155/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.92.down_proj: 93%|█████████▎| 34156/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.93.gate_proj: 93%|█████████▎| 34157/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.93.up_proj: 93%|█████████▎| 34158/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.93.down_proj: 93%|█████████▎| 34159/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.94.gate_proj: 93%|█████████▎| 34160/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.94.up_proj: 93%|█████████▎| 34161/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.94.down_proj: 93%|█████████▎| 34162/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.95.gate_proj: 93%|█████████▎| 34163/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.95.up_proj: 93%|█████████▎| 34164/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.95.down_proj: 93%|█████████▎| 34165/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.96.gate_proj: 93%|█████████▎| 34166/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.96.up_proj: 93%|█████████▎| 34167/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.96.down_proj: 93%|█████████▎| 34168/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.97.gate_proj: 93%|█████████▎| 34169/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.97.up_proj: 93%|█████████▎| 34170/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.97.down_proj: 93%|█████████▎| 34171/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.98.gate_proj: 93%|█████████▎| 34172/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.98.up_proj: 93%|█████████▎| 34173/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.98.down_proj: 93%|█████████▎| 34174/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.99.gate_proj: 93%|█████████▎| 34175/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.99.up_proj: 93%|█████████▎| 34176/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.99.down_proj: 93%|█████████▎| 34177/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.100.gate_proj: 93%|█████████▎| 34178/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.100.up_proj: 93%|█████████▎| 34179/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.100.down_proj: 93%|█████████▎| 34180/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.101.gate_proj: 93%|█████████▎| 34181/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.101.up_proj: 93%|█████████▎| 34182/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.101.down_proj: 93%|█████████▎| 34183/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.102.gate_proj: 93%|█████████▎| 34184/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.102.up_proj: 93%|█████████▎| 34185/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.102.down_proj: 93%|█████████▎| 34186/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.103.gate_proj: 93%|█████████▎| 34187/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.103.up_proj: 93%|█████████▎| 34188/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.103.down_proj: 93%|█████████▎| 34189/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.104.gate_proj: 94%|█████████▎| 34190/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.104.up_proj: 94%|█████████▎| 34191/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.104.down_proj: 94%|█████████▎| 34192/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.105.gate_proj: 94%|█████████▎| 34193/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.105.up_proj: 94%|█████████▎| 34194/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.105.down_proj: 94%|█████████▎| 34195/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.106.gate_proj: 94%|█████████▎| 34196/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.106.up_proj: 94%|█████████▎| 34197/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.106.down_proj: 94%|█████████▎| 34198/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.107.gate_proj: 94%|█████████▎| 34199/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.107.up_proj: 94%|█████████▎| 34200/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.107.down_proj: 94%|█████████▎| 34201/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.108.gate_proj: 94%|█████████▎| 34202/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.108.up_proj: 94%|█████████▎| 34203/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.108.down_proj: 94%|█████████▎| 34204/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.109.gate_proj: 94%|█████████▎| 34205/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.109.up_proj: 94%|█████████▎| 34206/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.109.down_proj: 94%|█████████▎| 34207/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.110.gate_proj: 94%|█████████▎| 34208/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.110.up_proj: 94%|█████████▎| 34209/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.110.down_proj: 94%|█████████▎| 34210/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.111.gate_proj: 94%|█████████▎| 34211/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.111.up_proj: 94%|█████████▎| 34212/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.111.down_proj: 94%|█████████▎| 34213/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.112.gate_proj: 94%|█████████▎| 34214/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.112.up_proj: 94%|█████████▎| 34215/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.112.down_proj: 94%|█████████▎| 34216/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.113.gate_proj: 94%|█████████▎| 34217/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.113.up_proj: 94%|█████████▎| 34218/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.113.down_proj: 94%|█████████▎| 34219/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.114.gate_proj: 94%|█████████▎| 34220/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.114.up_proj: 94%|█████████▎| 34221/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.114.down_proj: 94%|█████████▎| 34222/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.115.gate_proj: 94%|█████████▎| 34223/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.115.up_proj: 94%|█████████▎| 34224/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.115.down_proj: 94%|█████████▎| 34225/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.116.gate_proj: 94%|█████████▎| 34226/36566 [00:30<00:02, 1166.26it/s] packing model.layers.87.mlp.experts.116.gate_proj: 94%|█████████▎| 34227/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.116.up_proj: 94%|█████████▎| 34227/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.116.down_proj: 94%|█████████▎| 34228/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.117.gate_proj: 94%|█████████▎| 34229/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.117.up_proj: 94%|█████████▎| 34230/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.117.down_proj: 94%|█████████▎| 34231/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.118.gate_proj: 94%|█████████▎| 34232/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.118.up_proj: 94%|█████████▎| 34233/36566 [00:30<00:02, 1166.29it/s] packing model.layers.87.mlp.experts.118.down_proj: 94%|█████████▎| 34234/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.119.gate_proj: 94%|█████████▎| 34235/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.119.up_proj: 94%|█████████▎| 34236/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.119.down_proj: 94%|█████████▎| 34237/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.120.gate_proj: 94%|█████████▎| 34238/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.120.up_proj: 94%|█████████▎| 34239/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.120.down_proj: 94%|█████████▎| 34240/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.121.gate_proj: 94%|█████████▎| 34241/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.121.up_proj: 94%|█████████▎| 34242/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.121.down_proj: 94%|█████████▎| 34243/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.122.gate_proj: 94%|█████████▎| 34244/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.122.up_proj: 94%|█████████▎| 34245/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.122.down_proj: 94%|█████████▎| 34246/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.123.gate_proj: 94%|█████████▎| 34247/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.123.up_proj: 94%|█████████▎| 34248/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.123.down_proj: 94%|█████████▎| 34249/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.124.gate_proj: 94%|█████████▎| 34250/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.124.up_proj: 94%|█████████▎| 34251/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.124.down_proj: 94%|█████████▎| 34252/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.125.gate_proj: 94%|█████████▎| 34253/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.125.up_proj: 94%|█████████▎| 34254/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.125.down_proj: 94%|█████████▎| 34255/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.126.gate_proj: 94%|█████████▎| 34256/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.126.up_proj: 94%|█████████▎| 34257/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.126.down_proj: 94%|█████████▎| 34258/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.127.gate_proj: 94%|█████████▎| 34259/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.127.up_proj: 94%|█████████▎| 34260/36566 [00:30<00:01, 1166.29it/s] packing model.layers.87.mlp.experts.127.down_proj: 94%|█████████▎| 34261/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.0.gate_proj: 94%|█████████▎| 34262/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.0.up_proj: 94%|█████████▎| 34263/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.0.down_proj: 94%|█████████▎| 34264/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.1.gate_proj: 94%|█████████▎| 34265/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.1.up_proj: 94%|█████████▎| 34266/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.1.down_proj: 94%|█████████▎| 34267/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.2.gate_proj: 94%|█████████▎| 34268/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.2.up_proj: 94%|█████████▎| 34269/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.2.down_proj: 94%|█████████▎| 34270/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.3.gate_proj: 94%|█████████▎| 34271/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.3.up_proj: 94%|█████████▎| 34272/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.3.down_proj: 94%|█████████▎| 34273/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.4.gate_proj: 94%|█████████▎| 34274/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.4.up_proj: 94%|█████████▎| 34275/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.4.down_proj: 94%|█████████▎| 34276/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.5.gate_proj: 94%|█████████▎| 34277/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.5.up_proj: 94%|█████████▎| 34278/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.5.down_proj: 94%|█████████▎| 34279/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.6.gate_proj: 94%|█████████▎| 34280/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.6.up_proj: 94%|█████████▍| 34281/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.6.down_proj: 94%|█████████▍| 34282/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.7.gate_proj: 94%|█████████▍| 34283/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.7.up_proj: 94%|█████████▍| 34284/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.7.down_proj: 94%|█████████▍| 34285/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.8.gate_proj: 94%|█████████▍| 34286/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.8.up_proj: 94%|█████████▍| 34287/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.8.down_proj: 94%|█████████▍| 34288/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.9.gate_proj: 94%|█████████▍| 34289/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.9.up_proj: 94%|█████████▍| 34290/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.9.down_proj: 94%|█████████▍| 34291/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.10.gate_proj: 94%|█████████▍| 34292/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.10.up_proj: 94%|█████████▍| 34293/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.10.down_proj: 94%|█████████▍| 34294/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.11.gate_proj: 94%|█████████▍| 34295/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.11.up_proj: 94%|█████████▍| 34296/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.11.down_proj: 94%|█████████▍| 34297/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.12.gate_proj: 94%|█████████▍| 34298/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.12.up_proj: 94%|█████████▍| 34299/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.12.down_proj: 94%|█████████▍| 34300/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.13.gate_proj: 94%|█████████▍| 34301/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.13.up_proj: 94%|█████████▍| 34302/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.13.down_proj: 94%|█████████▍| 34303/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.14.gate_proj: 94%|█████████▍| 34304/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.14.up_proj: 94%|█████████▍| 34305/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.14.down_proj: 94%|█████████▍| 34306/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.15.gate_proj: 94%|█████████▍| 34307/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.15.up_proj: 94%|█████████▍| 34308/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.15.down_proj: 94%|█████████▍| 34309/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.16.gate_proj: 94%|█████████▍| 34310/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.16.up_proj: 94%|█████████▍| 34311/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.16.down_proj: 94%|█████████▍| 34312/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.17.gate_proj: 94%|█████████▍| 34313/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.17.up_proj: 94%|█████████▍| 34314/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.17.down_proj: 94%|█████████▍| 34315/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.18.gate_proj: 94%|█████████▍| 34316/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.18.up_proj: 94%|█████████▍| 34317/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.18.down_proj: 94%|█████████▍| 34318/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.19.gate_proj: 94%|█████████▍| 34319/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.19.up_proj: 94%|█████████▍| 34320/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.19.down_proj: 94%|█████████▍| 34321/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.20.gate_proj: 94%|█████████▍| 34322/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.20.up_proj: 94%|█████████▍| 34323/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.20.down_proj: 94%|█████████▍| 34324/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.21.gate_proj: 94%|█████████▍| 34325/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.21.up_proj: 94%|█████████▍| 34326/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.21.down_proj: 94%|█████████▍| 34327/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.22.gate_proj: 94%|█████████▍| 34328/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.22.up_proj: 94%|█████████▍| 34329/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.22.down_proj: 94%|█████████▍| 34330/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.23.gate_proj: 94%|█████████▍| 34331/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.23.up_proj: 94%|█████████▍| 34332/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.23.down_proj: 94%|█████████▍| 34333/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.24.gate_proj: 94%|█████████▍| 34334/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.24.up_proj: 94%|█████████▍| 34335/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.24.down_proj: 94%|█████████▍| 34336/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.25.gate_proj: 94%|█████████▍| 34337/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.25.up_proj: 94%|█████████▍| 34338/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.25.down_proj: 94%|█████████▍| 34339/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.26.gate_proj: 94%|█████████▍| 34340/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.26.up_proj: 94%|█████████▍| 34341/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.26.down_proj: 94%|█████████▍| 34342/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.27.gate_proj: 94%|█████████▍| 34343/36566 [00:30<00:01, 1166.29it/s] packing model.layers.88.mlp.experts.27.gate_proj: 94%|█████████▍| 34344/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.27.up_proj: 94%|█████████▍| 34344/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.27.down_proj: 94%|█████████▍| 34345/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.28.gate_proj: 94%|█████████▍| 34346/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.28.up_proj: 94%|█████████▍| 34347/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.28.down_proj: 94%|█████████▍| 34348/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.29.gate_proj: 94%|█████████▍| 34349/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.29.up_proj: 94%|█████████▍| 34350/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.29.down_proj: 94%|█████████▍| 34351/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.30.gate_proj: 94%|█████████▍| 34352/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.30.up_proj: 94%|█████████▍| 34353/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.30.down_proj: 94%|█████████▍| 34354/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.31.gate_proj: 94%|█████████▍| 34355/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.31.up_proj: 94%|█████████▍| 34356/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.31.down_proj: 94%|█████████▍| 34357/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.32.gate_proj: 94%|█████████▍| 34358/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.32.up_proj: 94%|█████████▍| 34359/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.32.down_proj: 94%|█████████▍| 34360/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.33.gate_proj: 94%|█████████▍| 34361/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.33.up_proj: 94%|█████████▍| 34362/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.33.down_proj: 94%|█████████▍| 34363/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.34.gate_proj: 94%|█████████▍| 34364/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.34.up_proj: 94%|█████████▍| 34365/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.34.down_proj: 94%|█████████▍| 34366/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.35.gate_proj: 94%|█████████▍| 34367/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.35.up_proj: 94%|█████████▍| 34368/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.35.down_proj: 94%|█████████▍| 34369/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.36.gate_proj: 94%|█████████▍| 34370/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.36.up_proj: 94%|█████████▍| 34371/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.36.down_proj: 94%|█████████▍| 34372/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.37.gate_proj: 94%|█████████▍| 34373/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.37.up_proj: 94%|█████████▍| 34374/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.37.down_proj: 94%|█████████▍| 34375/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.38.gate_proj: 94%|█████████▍| 34376/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.38.up_proj: 94%|█████████▍| 34377/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.38.down_proj: 94%|█████████▍| 34378/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.39.gate_proj: 94%|█████████▍| 34379/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.39.up_proj: 94%|█████████▍| 34380/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.39.down_proj: 94%|█████████▍| 34381/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.40.gate_proj: 94%|█████████▍| 34382/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.40.up_proj: 94%|█████████▍| 34383/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.40.down_proj: 94%|█████████▍| 34384/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.41.gate_proj: 94%|█████████▍| 34385/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.41.up_proj: 94%|█████████▍| 34386/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.41.down_proj: 94%|█████████▍| 34387/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.42.gate_proj: 94%|█████████▍| 34388/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.42.up_proj: 94%|█████████▍| 34389/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.42.down_proj: 94%|█████████▍| 34390/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.43.gate_proj: 94%|█████████▍| 34391/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.43.up_proj: 94%|█████████▍| 34392/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.43.down_proj: 94%|█████████▍| 34393/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.44.gate_proj: 94%|█████████▍| 34394/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.44.up_proj: 94%|█████████▍| 34395/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.44.down_proj: 94%|█████████▍| 34396/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.45.gate_proj: 94%|█████████▍| 34397/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.45.up_proj: 94%|█████████▍| 34398/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.45.down_proj: 94%|█████████▍| 34399/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.46.gate_proj: 94%|█████████▍| 34400/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.46.up_proj: 94%|█████████▍| 34401/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.46.down_proj: 94%|█████████▍| 34402/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.47.gate_proj: 94%|█████████▍| 34403/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.47.up_proj: 94%|█████████▍| 34404/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.47.down_proj: 94%|█████████▍| 34405/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.48.gate_proj: 94%|█████████▍| 34406/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.48.up_proj: 94%|█████████▍| 34407/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.48.down_proj: 94%|█████████▍| 34408/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.49.gate_proj: 94%|█████████▍| 34409/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.49.up_proj: 94%|█████████▍| 34410/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.49.down_proj: 94%|█████████▍| 34411/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.50.gate_proj: 94%|█████████▍| 34412/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.50.up_proj: 94%|█████████▍| 34413/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.50.down_proj: 94%|█████████▍| 34414/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.51.gate_proj: 94%|█████████▍| 34415/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.51.up_proj: 94%|█████████▍| 34416/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.51.down_proj: 94%|█████████▍| 34417/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.52.gate_proj: 94%|█████████▍| 34418/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.52.up_proj: 94%|█████████▍| 34419/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.52.down_proj: 94%|█████████▍| 34420/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.53.gate_proj: 94%|█████████▍| 34421/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.53.up_proj: 94%|█████████▍| 34422/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.53.down_proj: 94%|█████████▍| 34423/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.54.gate_proj: 94%|█████████▍| 34424/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.54.up_proj: 94%|█████████▍| 34425/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.54.down_proj: 94%|█████████▍| 34426/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.55.gate_proj: 94%|█████████▍| 34427/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.55.up_proj: 94%|█████████▍| 34428/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.55.down_proj: 94%|█████████▍| 34429/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.56.gate_proj: 94%|█████████▍| 34430/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.56.up_proj: 94%|█████████▍| 34431/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.56.down_proj: 94%|█████████▍| 34432/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.57.gate_proj: 94%|█████████▍| 34433/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.57.up_proj: 94%|█████████▍| 34434/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.57.down_proj: 94%|█████████▍| 34435/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.58.gate_proj: 94%|█████████▍| 34436/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.58.up_proj: 94%|█████████▍| 34437/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.58.down_proj: 94%|█████████▍| 34438/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.59.gate_proj: 94%|█████████▍| 34439/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.59.up_proj: 94%|█████████▍| 34440/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.59.down_proj: 94%|█████████▍| 34441/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.60.gate_proj: 94%|█████████▍| 34442/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.60.up_proj: 94%|█████████▍| 34443/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.60.down_proj: 94%|█████████▍| 34444/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.61.gate_proj: 94%|█████████▍| 34445/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.61.up_proj: 94%|█████████▍| 34446/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.61.down_proj: 94%|█████████▍| 34447/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.62.gate_proj: 94%|█████████▍| 34448/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.62.up_proj: 94%|█████████▍| 34449/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.62.down_proj: 94%|█████████▍| 34450/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.63.gate_proj: 94%|█████████▍| 34451/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.63.up_proj: 94%|█████████▍| 34452/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.63.down_proj: 94%|█████████▍| 34453/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.64.gate_proj: 94%|█████████▍| 34454/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.64.up_proj: 94%|█████████▍| 34455/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.64.down_proj: 94%|█████████▍| 34456/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.65.gate_proj: 94%|█████████▍| 34457/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.65.up_proj: 94%|█████████▍| 34458/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.65.down_proj: 94%|█████████▍| 34459/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.66.gate_proj: 94%|█████████▍| 34460/36566 [00:30<00:01, 1164.71it/s] packing model.layers.88.mlp.experts.66.gate_proj: 94%|█████████▍| 34461/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.66.up_proj: 94%|█████████▍| 34461/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.66.down_proj: 94%|█████████▍| 34462/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.67.gate_proj: 94%|█████████▍| 34463/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.67.up_proj: 94%|█████████▍| 34464/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.67.down_proj: 94%|█████████▍| 34465/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.68.gate_proj: 94%|█████████▍| 34466/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.68.up_proj: 94%|█████████▍| 34467/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.68.down_proj: 94%|█████████▍| 34468/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.69.gate_proj: 94%|█████████▍| 34469/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.69.up_proj: 94%|█████████▍| 34470/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.69.down_proj: 94%|█████████▍| 34471/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.70.gate_proj: 94%|█████████▍| 34472/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.70.up_proj: 94%|█████████▍| 34473/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.70.down_proj: 94%|█████████▍| 34474/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.71.gate_proj: 94%|█████████▍| 34475/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.71.up_proj: 94%|█████████▍| 34476/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.71.down_proj: 94%|█████████▍| 34477/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.72.gate_proj: 94%|█████████▍| 34478/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.72.up_proj: 94%|█████████▍| 34479/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.72.down_proj: 94%|█████████▍| 34480/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.73.gate_proj: 94%|█████████▍| 34481/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.73.up_proj: 94%|█████████▍| 34482/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.73.down_proj: 94%|█████████▍| 34483/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.74.gate_proj: 94%|█████████▍| 34484/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.74.up_proj: 94%|█████████▍| 34485/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.74.down_proj: 94%|█████████▍| 34486/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.75.gate_proj: 94%|█████████▍| 34487/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.75.up_proj: 94%|█████████▍| 34488/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.75.down_proj: 94%|█████████▍| 34489/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.76.gate_proj: 94%|█████████▍| 34490/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.76.up_proj: 94%|█████████▍| 34491/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.76.down_proj: 94%|█████████▍| 34492/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.77.gate_proj: 94%|█████████▍| 34493/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.77.up_proj: 94%|█████████▍| 34494/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.77.down_proj: 94%|█████████▍| 34495/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.78.gate_proj: 94%|█████████▍| 34496/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.78.up_proj: 94%|█████████▍| 34497/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.78.down_proj: 94%|█████████▍| 34498/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.79.gate_proj: 94%|█████████▍| 34499/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.79.up_proj: 94%|█████████▍| 34500/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.79.down_proj: 94%|█████████▍| 34501/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.80.gate_proj: 94%|█████████▍| 34502/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.80.up_proj: 94%|█████████▍| 34503/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.80.down_proj: 94%|█████████▍| 34504/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.81.gate_proj: 94%|█████████▍| 34505/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.81.up_proj: 94%|█████████▍| 34506/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.81.down_proj: 94%|█████████▍| 34507/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.82.gate_proj: 94%|█████████▍| 34508/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.82.up_proj: 94%|█████████▍| 34509/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.82.down_proj: 94%|█████████▍| 34510/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.83.gate_proj: 94%|█████████▍| 34511/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.83.up_proj: 94%|█████████▍| 34512/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.83.down_proj: 94%|█████████▍| 34513/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.84.gate_proj: 94%|█████████▍| 34514/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.84.up_proj: 94%|█████████▍| 34515/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.84.down_proj: 94%|█████████▍| 34516/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.85.gate_proj: 94%|█████████▍| 34517/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.85.up_proj: 94%|█████████▍| 34518/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.85.down_proj: 94%|█████████▍| 34519/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.86.gate_proj: 94%|█████████▍| 34520/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.86.up_proj: 94%|█████████▍| 34521/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.86.down_proj: 94%|█████████▍| 34522/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.87.gate_proj: 94%|█████████▍| 34523/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.87.up_proj: 94%|█████████▍| 34524/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.87.down_proj: 94%|█████████▍| 34525/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.88.gate_proj: 94%|█████████▍| 34526/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.88.up_proj: 94%|█████████▍| 34527/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.88.down_proj: 94%|█████████▍| 34528/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.89.gate_proj: 94%|█████████▍| 34529/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.89.up_proj: 94%|█████████▍| 34530/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.89.down_proj: 94%|█████████▍| 34531/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.90.gate_proj: 94%|█████████▍| 34532/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.90.up_proj: 94%|█████████▍| 34533/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.90.down_proj: 94%|█████████▍| 34534/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.91.gate_proj: 94%|█████████▍| 34535/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.91.up_proj: 94%|█████████▍| 34536/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.91.down_proj: 94%|█████████▍| 34537/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.92.gate_proj: 94%|█████████▍| 34538/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.92.up_proj: 94%|█████████▍| 34539/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.92.down_proj: 94%|█████████▍| 34540/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.93.gate_proj: 94%|█████████▍| 34541/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.93.up_proj: 94%|█████████▍| 34542/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.93.down_proj: 94%|█████████▍| 34543/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.94.gate_proj: 94%|█████████▍| 34544/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.94.up_proj: 94%|█████████▍| 34545/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.94.down_proj: 94%|█████████▍| 34546/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.95.gate_proj: 94%|█████████▍| 34547/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.95.up_proj: 94%|█████████▍| 34548/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.95.down_proj: 94%|█████████▍| 34549/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.96.gate_proj: 94%|█████████▍| 34550/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.96.up_proj: 94%|█████████▍| 34551/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.96.down_proj: 94%|█████████▍| 34552/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.97.gate_proj: 94%|█████████▍| 34553/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.97.up_proj: 94%|█████████▍| 34554/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.97.down_proj: 95%|█████████▍| 34555/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.98.gate_proj: 95%|█████████▍| 34556/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.98.up_proj: 95%|█████████▍| 34557/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.98.down_proj: 95%|█████████▍| 34558/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.99.gate_proj: 95%|█████████▍| 34559/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.99.up_proj: 95%|█████████▍| 34560/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.99.down_proj: 95%|█████████▍| 34561/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.100.gate_proj: 95%|█████████▍| 34562/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.100.up_proj: 95%|█████████▍| 34563/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.100.down_proj: 95%|█████████▍| 34564/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.101.gate_proj: 95%|█████████▍| 34565/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.101.up_proj: 95%|█████████▍| 34566/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.101.down_proj: 95%|█████████▍| 34567/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.102.gate_proj: 95%|█████████▍| 34568/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.102.up_proj: 95%|█████████▍| 34569/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.102.down_proj: 95%|█████████▍| 34570/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.103.gate_proj: 95%|█████████▍| 34571/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.103.up_proj: 95%|█████████▍| 34572/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.103.down_proj: 95%|█████████▍| 34573/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.104.gate_proj: 95%|█████████▍| 34574/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.104.up_proj: 95%|█████████▍| 34575/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.104.down_proj: 95%|█████████▍| 34576/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.105.gate_proj: 95%|█████████▍| 34577/36566 [00:30<00:01, 1162.87it/s] packing model.layers.88.mlp.experts.105.gate_proj: 95%|█████████▍| 34578/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.105.up_proj: 95%|█████████▍| 34578/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.105.down_proj: 95%|█████████▍| 34579/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.106.gate_proj: 95%|█████████▍| 34580/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.106.up_proj: 95%|█████████▍| 34581/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.106.down_proj: 95%|█████████▍| 34582/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.107.gate_proj: 95%|█████████▍| 34583/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.107.up_proj: 95%|█████████▍| 34584/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.107.down_proj: 95%|█████████▍| 34585/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.108.gate_proj: 95%|█████████▍| 34586/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.108.up_proj: 95%|█████████▍| 34587/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.108.down_proj: 95%|█████████▍| 34588/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.109.gate_proj: 95%|█████████▍| 34589/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.109.up_proj: 95%|█████████▍| 34590/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.109.down_proj: 95%|█████████▍| 34591/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.110.gate_proj: 95%|█████████▍| 34592/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.110.up_proj: 95%|█████████▍| 34593/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.110.down_proj: 95%|█████████▍| 34594/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.111.gate_proj: 95%|█████████▍| 34595/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.111.up_proj: 95%|█████████▍| 34596/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.111.down_proj: 95%|█████████▍| 34597/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.112.gate_proj: 95%|█████████▍| 34598/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.112.up_proj: 95%|█████████▍| 34599/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.112.down_proj: 95%|█████████▍| 34600/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.113.gate_proj: 95%|█████████▍| 34601/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.113.up_proj: 95%|█████████▍| 34602/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.113.down_proj: 95%|█████████▍| 34603/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.114.gate_proj: 95%|█████████▍| 34604/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.114.up_proj: 95%|█████████▍| 34605/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.114.down_proj: 95%|█████████▍| 34606/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.115.gate_proj: 95%|█████████▍| 34607/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.115.up_proj: 95%|█████████▍| 34608/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.115.down_proj: 95%|█████████▍| 34609/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.116.gate_proj: 95%|█████████▍| 34610/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.116.up_proj: 95%|█████████▍| 34611/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.116.down_proj: 95%|█████████▍| 34612/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.117.gate_proj: 95%|█████████▍| 34613/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.117.up_proj: 95%|█████████▍| 34614/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.117.down_proj: 95%|█████████▍| 34615/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.118.gate_proj: 95%|█████████▍| 34616/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.118.up_proj: 95%|█████████▍| 34617/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.118.down_proj: 95%|█████████▍| 34618/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.119.gate_proj: 95%|█████████▍| 34619/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.119.up_proj: 95%|█████████▍| 34620/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.119.down_proj: 95%|█████████▍| 34621/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.120.gate_proj: 95%|█████████▍| 34622/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.120.up_proj: 95%|█████████▍| 34623/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.120.down_proj: 95%|█████████▍| 34624/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.121.gate_proj: 95%|█████████▍| 34625/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.121.up_proj: 95%|█████████▍| 34626/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.121.down_proj: 95%|█████████▍| 34627/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.122.gate_proj: 95%|█████████▍| 34628/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.122.up_proj: 95%|█████████▍| 34629/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.122.down_proj: 95%|█████████▍| 34630/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.123.gate_proj: 95%|█████████▍| 34631/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.123.up_proj: 95%|█████████▍| 34632/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.123.down_proj: 95%|█████████▍| 34633/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.124.gate_proj: 95%|█████████▍| 34634/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.124.up_proj: 95%|█████████▍| 34635/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.124.down_proj: 95%|█████████▍| 34636/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.125.gate_proj: 95%|█████████▍| 34637/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.125.up_proj: 95%|█████████▍| 34638/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.125.down_proj: 95%|█████████▍| 34639/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.126.gate_proj: 95%|█████████▍| 34640/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.126.up_proj: 95%|█████████▍| 34641/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.126.down_proj: 95%|█████████▍| 34642/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.127.gate_proj: 95%|█████████▍| 34643/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.127.up_proj: 95%|█████████▍| 34644/36566 [00:30<00:01, 1164.76it/s] packing model.layers.88.mlp.experts.127.down_proj: 95%|█████████▍| 34645/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.0.gate_proj: 95%|█████████▍| 34646/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.0.up_proj: 95%|█████████▍| 34647/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.0.down_proj: 95%|█████████▍| 34648/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.1.gate_proj: 95%|█████████▍| 34649/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.1.up_proj: 95%|█████████▍| 34650/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.1.down_proj: 95%|█████████▍| 34651/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.2.gate_proj: 95%|█████████▍| 34652/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.2.up_proj: 95%|█████████▍| 34653/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.2.down_proj: 95%|█████████▍| 34654/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.3.gate_proj: 95%|█████████▍| 34655/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.3.up_proj: 95%|█████████▍| 34656/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.3.down_proj: 95%|█████████▍| 34657/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.4.gate_proj: 95%|█████████▍| 34658/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.4.up_proj: 95%|█████████▍| 34659/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.4.down_proj: 95%|█████████▍| 34660/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.5.gate_proj: 95%|█████████▍| 34661/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.5.up_proj: 95%|█████████▍| 34662/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.5.down_proj: 95%|█████████▍| 34663/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.6.gate_proj: 95%|█████████▍| 34664/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.6.up_proj: 95%|█████████▍| 34665/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.6.down_proj: 95%|█████████▍| 34666/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.7.gate_proj: 95%|█████████▍| 34667/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.7.up_proj: 95%|█████████▍| 34668/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.7.down_proj: 95%|█████████▍| 34669/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.8.gate_proj: 95%|█████████▍| 34670/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.8.up_proj: 95%|█████████▍| 34671/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.8.down_proj: 95%|█████████▍| 34672/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.9.gate_proj: 95%|█████████▍| 34673/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.9.up_proj: 95%|█████████▍| 34674/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.9.down_proj: 95%|█████████▍| 34675/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.10.gate_proj: 95%|█████████▍| 34676/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.10.up_proj: 95%|█████████▍| 34677/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.10.down_proj: 95%|█████████▍| 34678/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.11.gate_proj: 95%|█████████▍| 34679/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.11.up_proj: 95%|█████████▍| 34680/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.11.down_proj: 95%|█████████▍| 34681/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.12.gate_proj: 95%|█████████▍| 34682/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.12.up_proj: 95%|█████████▍| 34683/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.12.down_proj: 95%|█████████▍| 34684/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.13.gate_proj: 95%|█████████▍| 34685/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.13.up_proj: 95%|█████████▍| 34686/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.13.down_proj: 95%|█████████▍| 34687/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.14.gate_proj: 95%|█████████▍| 34688/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.14.up_proj: 95%|█████████▍| 34689/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.14.down_proj: 95%|█████████▍| 34690/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.15.gate_proj: 95%|█████████▍| 34691/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.15.up_proj: 95%|█████████▍| 34692/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.15.down_proj: 95%|█████████▍| 34693/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.16.gate_proj: 95%|█████████▍| 34694/36566 [00:30<00:01, 1164.76it/s] packing model.layers.89.mlp.experts.16.gate_proj: 95%|█████████▍| 34695/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.16.up_proj: 95%|█████████▍| 34695/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.16.down_proj: 95%|█████████▍| 34696/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.17.gate_proj: 95%|█████████▍| 34697/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.17.up_proj: 95%|█████████▍| 34698/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.17.down_proj: 95%|█████████▍| 34699/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.18.gate_proj: 95%|█████████▍| 34700/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.18.up_proj: 95%|█████████▍| 34701/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.18.down_proj: 95%|█████████▍| 34702/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.19.gate_proj: 95%|█████████▍| 34703/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.19.up_proj: 95%|█████████▍| 34704/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.19.down_proj: 95%|█████████▍| 34705/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.20.gate_proj: 95%|█████████▍| 34706/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.20.up_proj: 95%|█████████▍| 34707/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.20.down_proj: 95%|█████████▍| 34708/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.21.gate_proj: 95%|█████████▍| 34709/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.21.up_proj: 95%|█████████▍| 34710/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.21.down_proj: 95%|█████████▍| 34711/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.22.gate_proj: 95%|█████████▍| 34712/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.22.up_proj: 95%|█████████▍| 34713/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.22.down_proj: 95%|█████████▍| 34714/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.23.gate_proj: 95%|█████████▍| 34715/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.23.up_proj: 95%|█████████▍| 34716/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.23.down_proj: 95%|█████████▍| 34717/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.24.gate_proj: 95%|█████████▍| 34718/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.24.up_proj: 95%|█████████▍| 34719/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.24.down_proj: 95%|█████████▍| 34720/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.25.gate_proj: 95%|█████████▍| 34721/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.25.up_proj: 95%|█████████▍| 34722/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.25.down_proj: 95%|█████████▍| 34723/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.26.gate_proj: 95%|█████████▍| 34724/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.26.up_proj: 95%|█████████▍| 34725/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.26.down_proj: 95%|█████████▍| 34726/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.27.gate_proj: 95%|█████████▍| 34727/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.27.up_proj: 95%|█████████▍| 34728/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.27.down_proj: 95%|█████████▍| 34729/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.28.gate_proj: 95%|█████████▍| 34730/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.28.up_proj: 95%|█████████▍| 34731/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.28.down_proj: 95%|█████████▍| 34732/36566 [00:30<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.29.gate_proj: 95%|█████████▍| 34733/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.29.up_proj: 95%|█████████▍| 34734/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.29.down_proj: 95%|█████████▍| 34735/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.30.gate_proj: 95%|█████████▍| 34736/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.30.up_proj: 95%|█████████▍| 34737/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.30.down_proj: 95%|█████████▌| 34738/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.31.gate_proj: 95%|█████████▌| 34739/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.31.up_proj: 95%|█████████▌| 34740/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.31.down_proj: 95%|█████████▌| 34741/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.32.gate_proj: 95%|█████████▌| 34742/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.32.up_proj: 95%|█████████▌| 34743/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.32.down_proj: 95%|█████████▌| 34744/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.33.gate_proj: 95%|█████████▌| 34745/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.33.up_proj: 95%|█████████▌| 34746/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.33.down_proj: 95%|█████████▌| 34747/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.34.gate_proj: 95%|█████████▌| 34748/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.34.up_proj: 95%|█████████▌| 34749/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.34.down_proj: 95%|█████████▌| 34750/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.35.gate_proj: 95%|█████████▌| 34751/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.35.up_proj: 95%|█████████▌| 34752/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.35.down_proj: 95%|█████████▌| 34753/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.36.gate_proj: 95%|█████████▌| 34754/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.36.up_proj: 95%|█████████▌| 34755/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.36.down_proj: 95%|█████████▌| 34756/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.37.gate_proj: 95%|█████████▌| 34757/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.37.up_proj: 95%|█████████▌| 34758/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.37.down_proj: 95%|█████████▌| 34759/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.38.gate_proj: 95%|█████████▌| 34760/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.38.up_proj: 95%|█████████▌| 34761/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.38.down_proj: 95%|█████████▌| 34762/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.39.gate_proj: 95%|█████████▌| 34763/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.39.up_proj: 95%|█████████▌| 34764/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.39.down_proj: 95%|█████████▌| 34765/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.40.gate_proj: 95%|█████████▌| 34766/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.40.up_proj: 95%|█████████▌| 34767/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.40.down_proj: 95%|█████████▌| 34768/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.41.gate_proj: 95%|█████████▌| 34769/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.41.up_proj: 95%|█████████▌| 34770/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.41.down_proj: 95%|█████████▌| 34771/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.42.gate_proj: 95%|█████████▌| 34772/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.42.up_proj: 95%|█████████▌| 34773/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.42.down_proj: 95%|█████████▌| 34774/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.43.gate_proj: 95%|█████████▌| 34775/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.43.up_proj: 95%|█████████▌| 34776/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.43.down_proj: 95%|█████████▌| 34777/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.44.gate_proj: 95%|█████████▌| 34778/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.44.up_proj: 95%|█████████▌| 34779/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.44.down_proj: 95%|█████████▌| 34780/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.45.gate_proj: 95%|█████████▌| 34781/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.45.up_proj: 95%|█████████▌| 34782/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.45.down_proj: 95%|█████████▌| 34783/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.46.gate_proj: 95%|█████████▌| 34784/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.46.up_proj: 95%|█████████▌| 34785/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.46.down_proj: 95%|█████████▌| 34786/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.47.gate_proj: 95%|█████████▌| 34787/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.47.up_proj: 95%|█████████▌| 34788/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.47.down_proj: 95%|█████████▌| 34789/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.48.gate_proj: 95%|█████████▌| 34790/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.48.up_proj: 95%|█████████▌| 34791/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.48.down_proj: 95%|█████████▌| 34792/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.49.gate_proj: 95%|█████████▌| 34793/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.49.up_proj: 95%|█████████▌| 34794/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.49.down_proj: 95%|█████████▌| 34795/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.50.gate_proj: 95%|█████████▌| 34796/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.50.up_proj: 95%|█████████▌| 34797/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.50.down_proj: 95%|█████████▌| 34798/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.51.gate_proj: 95%|█████████▌| 34799/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.51.up_proj: 95%|█████████▌| 34800/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.51.down_proj: 95%|█████████▌| 34801/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.52.gate_proj: 95%|█████████▌| 34802/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.52.up_proj: 95%|█████████▌| 34803/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.52.down_proj: 95%|█████████▌| 34804/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.53.gate_proj: 95%|█████████▌| 34805/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.53.up_proj: 95%|█████████▌| 34806/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.53.down_proj: 95%|█████████▌| 34807/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.54.gate_proj: 95%|█████████▌| 34808/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.54.up_proj: 95%|█████████▌| 34809/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.54.down_proj: 95%|█████████▌| 34810/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.55.gate_proj: 95%|█████████▌| 34811/36566 [00:31<00:01, 1163.89it/s] packing model.layers.89.mlp.experts.55.gate_proj: 95%|█████████▌| 34812/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.55.up_proj: 95%|█████████▌| 34812/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.55.down_proj: 95%|█████████▌| 34813/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.56.gate_proj: 95%|█████████▌| 34814/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.56.up_proj: 95%|█████████▌| 34815/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.56.down_proj: 95%|█████████▌| 34816/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.57.gate_proj: 95%|█████████▌| 34817/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.57.up_proj: 95%|█████████▌| 34818/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.57.down_proj: 95%|█████████▌| 34819/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.58.gate_proj: 95%|█████████▌| 34820/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.58.up_proj: 95%|█████████▌| 34821/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.58.down_proj: 95%|█████████▌| 34822/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.59.gate_proj: 95%|█████████▌| 34823/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.59.up_proj: 95%|█████████▌| 34824/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.59.down_proj: 95%|█████████▌| 34825/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.60.gate_proj: 95%|█████████▌| 34826/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.60.up_proj: 95%|█████████▌| 34827/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.60.down_proj: 95%|█████████▌| 34828/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.61.gate_proj: 95%|█████████▌| 34829/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.61.up_proj: 95%|█████████▌| 34830/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.61.down_proj: 95%|█████████▌| 34831/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.62.gate_proj: 95%|█████████▌| 34832/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.62.up_proj: 95%|█████████▌| 34833/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.62.down_proj: 95%|█████████▌| 34834/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.63.gate_proj: 95%|█████████▌| 34835/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.63.up_proj: 95%|█████████▌| 34836/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.63.down_proj: 95%|█████████▌| 34837/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.64.gate_proj: 95%|█████████▌| 34838/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.64.up_proj: 95%|█████████▌| 34839/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.64.down_proj: 95%|█████████▌| 34840/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.65.gate_proj: 95%|█████████▌| 34841/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.65.up_proj: 95%|█████████▌| 34842/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.65.down_proj: 95%|█████████▌| 34843/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.66.gate_proj: 95%|█████████▌| 34844/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.66.up_proj: 95%|█████████▌| 34845/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.66.down_proj: 95%|█████████▌| 34846/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.67.gate_proj: 95%|█████████▌| 34847/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.67.up_proj: 95%|█████████▌| 34848/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.67.down_proj: 95%|█████████▌| 34849/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.68.gate_proj: 95%|█████████▌| 34850/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.68.up_proj: 95%|█████████▌| 34851/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.68.down_proj: 95%|█████████▌| 34852/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.69.gate_proj: 95%|█████████▌| 34853/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.69.up_proj: 95%|█████████▌| 34854/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.69.down_proj: 95%|█████████▌| 34855/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.70.gate_proj: 95%|█████████▌| 34856/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.70.up_proj: 95%|█████████▌| 34857/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.70.down_proj: 95%|█████████▌| 34858/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.71.gate_proj: 95%|█████████▌| 34859/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.71.up_proj: 95%|█████████▌| 34860/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.71.down_proj: 95%|█████████▌| 34861/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.72.gate_proj: 95%|█████████▌| 34862/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.72.up_proj: 95%|█████████▌| 34863/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.72.down_proj: 95%|█████████▌| 34864/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.73.gate_proj: 95%|█████████▌| 34865/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.73.up_proj: 95%|█████████▌| 34866/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.73.down_proj: 95%|█████████▌| 34867/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.74.gate_proj: 95%|█████████▌| 34868/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.74.up_proj: 95%|█████████▌| 34869/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.74.down_proj: 95%|█████████▌| 34870/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.75.gate_proj: 95%|█████████▌| 34871/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.75.up_proj: 95%|█████████▌| 34872/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.75.down_proj: 95%|█████████▌| 34873/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.76.gate_proj: 95%|█████████▌| 34874/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.76.up_proj: 95%|█████████▌| 34875/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.76.down_proj: 95%|█████████▌| 34876/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.77.gate_proj: 95%|█████████▌| 34877/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.77.up_proj: 95%|█████████▌| 34878/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.77.down_proj: 95%|█████████▌| 34879/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.78.gate_proj: 95%|█████████▌| 34880/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.78.up_proj: 95%|█████████▌| 34881/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.78.down_proj: 95%|█████████▌| 34882/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.79.gate_proj: 95%|█████████▌| 34883/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.79.up_proj: 95%|█████████▌| 34884/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.79.down_proj: 95%|█████████▌| 34885/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.80.gate_proj: 95%|█████████▌| 34886/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.80.up_proj: 95%|█████████▌| 34887/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.80.down_proj: 95%|█████████▌| 34888/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.81.gate_proj: 95%|█████████▌| 34889/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.81.up_proj: 95%|█████████▌| 34890/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.81.down_proj: 95%|█████████▌| 34891/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.82.gate_proj: 95%|█████████▌| 34892/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.82.up_proj: 95%|█████████▌| 34893/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.82.down_proj: 95%|█████████▌| 34894/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.83.gate_proj: 95%|█████████▌| 34895/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.83.up_proj: 95%|█████████▌| 34896/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.83.down_proj: 95%|█████████▌| 34897/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.84.gate_proj: 95%|█████████▌| 34898/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.84.up_proj: 95%|█████████▌| 34899/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.84.down_proj: 95%|█████████▌| 34900/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.85.gate_proj: 95%|█████████▌| 34901/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.85.up_proj: 95%|█████████▌| 34902/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.85.down_proj: 95%|█████████▌| 34903/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.86.gate_proj: 95%|█████████▌| 34904/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.86.up_proj: 95%|█████████▌| 34905/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.86.down_proj: 95%|█████████▌| 34906/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.87.gate_proj: 95%|█████████▌| 34907/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.87.up_proj: 95%|█████████▌| 34908/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.87.down_proj: 95%|█████████▌| 34909/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.88.gate_proj: 95%|█████████▌| 34910/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.88.up_proj: 95%|█████████▌| 34911/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.88.down_proj: 95%|█████████▌| 34912/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.89.gate_proj: 95%|█████████▌| 34913/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.89.up_proj: 95%|█████████▌| 34914/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.89.down_proj: 95%|█████████▌| 34915/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.90.gate_proj: 95%|█████████▌| 34916/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.90.up_proj: 95%|█████████▌| 34917/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.90.down_proj: 95%|█████████▌| 34918/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.91.gate_proj: 95%|█████████▌| 34919/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.91.up_proj: 95%|█████████▌| 34920/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.91.down_proj: 96%|█████████▌| 34921/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.92.gate_proj: 96%|█████████▌| 34922/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.92.up_proj: 96%|█████████▌| 34923/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.92.down_proj: 96%|█████████▌| 34924/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.93.gate_proj: 96%|█████████▌| 34925/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.93.up_proj: 96%|█████████▌| 34926/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.93.down_proj: 96%|█████████▌| 34927/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.94.gate_proj: 96%|█████████▌| 34928/36566 [00:31<00:01, 1164.24it/s] packing model.layers.89.mlp.experts.94.gate_proj: 96%|█████████▌| 34929/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.94.up_proj: 96%|█████████▌| 34929/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.94.down_proj: 96%|█████████▌| 34930/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.95.gate_proj: 96%|█████████▌| 34931/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.95.up_proj: 96%|█████████▌| 34932/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.95.down_proj: 96%|█████████▌| 34933/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.96.gate_proj: 96%|█████████▌| 34934/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.96.up_proj: 96%|█████████▌| 34935/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.96.down_proj: 96%|█████████▌| 34936/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.97.gate_proj: 96%|█████████▌| 34937/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.97.up_proj: 96%|█████████▌| 34938/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.97.down_proj: 96%|█████████▌| 34939/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.98.gate_proj: 96%|█████████▌| 34940/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.98.up_proj: 96%|█████████▌| 34941/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.98.down_proj: 96%|█████████▌| 34942/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.99.gate_proj: 96%|█████████▌| 34943/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.99.up_proj: 96%|█████████▌| 34944/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.99.down_proj: 96%|█████████▌| 34945/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.100.gate_proj: 96%|█████████▌| 34946/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.100.up_proj: 96%|█████████▌| 34947/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.100.down_proj: 96%|█████████▌| 34948/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.101.gate_proj: 96%|█████████▌| 34949/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.101.up_proj: 96%|█████████▌| 34950/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.101.down_proj: 96%|█████████▌| 34951/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.102.gate_proj: 96%|█████████▌| 34952/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.102.up_proj: 96%|█████████▌| 34953/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.102.down_proj: 96%|█████████▌| 34954/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.103.gate_proj: 96%|█████████▌| 34955/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.103.up_proj: 96%|█████████▌| 34956/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.103.down_proj: 96%|█████████▌| 34957/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.104.gate_proj: 96%|█████████▌| 34958/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.104.up_proj: 96%|█████████▌| 34959/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.104.down_proj: 96%|█████████▌| 34960/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.105.gate_proj: 96%|█████████▌| 34961/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.105.up_proj: 96%|█████████▌| 34962/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.105.down_proj: 96%|█████████▌| 34963/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.106.gate_proj: 96%|█████████▌| 34964/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.106.up_proj: 96%|█████████▌| 34965/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.106.down_proj: 96%|█████████▌| 34966/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.107.gate_proj: 96%|█████████▌| 34967/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.107.up_proj: 96%|█████████▌| 34968/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.107.down_proj: 96%|█████████▌| 34969/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.108.gate_proj: 96%|█████████▌| 34970/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.108.up_proj: 96%|█████████▌| 34971/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.108.down_proj: 96%|█████████▌| 34972/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.109.gate_proj: 96%|█████████▌| 34973/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.109.up_proj: 96%|█████████▌| 34974/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.109.down_proj: 96%|█████████▌| 34975/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.110.gate_proj: 96%|█████████▌| 34976/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.110.up_proj: 96%|█████████▌| 34977/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.110.down_proj: 96%|█████████▌| 34978/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.111.gate_proj: 96%|█████████▌| 34979/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.111.up_proj: 96%|█████████▌| 34980/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.111.down_proj: 96%|█████████▌| 34981/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.112.gate_proj: 96%|█████████▌| 34982/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.112.up_proj: 96%|█████████▌| 34983/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.112.down_proj: 96%|█████████▌| 34984/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.113.gate_proj: 96%|█████████▌| 34985/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.113.up_proj: 96%|█████████▌| 34986/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.113.down_proj: 96%|█████████▌| 34987/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.114.gate_proj: 96%|█████████▌| 34988/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.114.up_proj: 96%|█████████▌| 34989/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.114.down_proj: 96%|█████████▌| 34990/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.115.gate_proj: 96%|█████████▌| 34991/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.115.up_proj: 96%|█████████▌| 34992/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.115.down_proj: 96%|█████████▌| 34993/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.116.gate_proj: 96%|█████████▌| 34994/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.116.up_proj: 96%|█████████▌| 34995/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.116.down_proj: 96%|█████████▌| 34996/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.117.gate_proj: 96%|█████████▌| 34997/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.117.up_proj: 96%|█████████▌| 34998/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.117.down_proj: 96%|█████████▌| 34999/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.118.gate_proj: 96%|█████████▌| 35000/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.118.up_proj: 96%|█████████▌| 35001/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.118.down_proj: 96%|█████████▌| 35002/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.119.gate_proj: 96%|█████████▌| 35003/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.119.up_proj: 96%|█████████▌| 35004/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.119.down_proj: 96%|█████████▌| 35005/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.120.gate_proj: 96%|█████████▌| 35006/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.120.up_proj: 96%|█████████▌| 35007/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.120.down_proj: 96%|█████████▌| 35008/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.121.gate_proj: 96%|█████████▌| 35009/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.121.up_proj: 96%|█████████▌| 35010/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.121.down_proj: 96%|█████████▌| 35011/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.122.gate_proj: 96%|█████████▌| 35012/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.122.up_proj: 96%|█████████▌| 35013/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.122.down_proj: 96%|█████████▌| 35014/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.123.gate_proj: 96%|█████████▌| 35015/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.123.up_proj: 96%|█████████▌| 35016/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.123.down_proj: 96%|█████████▌| 35017/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.124.gate_proj: 96%|█████████▌| 35018/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.124.up_proj: 96%|█████████▌| 35019/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.124.down_proj: 96%|█████████▌| 35020/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.125.gate_proj: 96%|█████████▌| 35021/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.125.up_proj: 96%|█████████▌| 35022/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.125.down_proj: 96%|█████████▌| 35023/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.126.gate_proj: 96%|█████████▌| 35024/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.126.up_proj: 96%|█████████▌| 35025/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.126.down_proj: 96%|█████████▌| 35026/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.127.gate_proj: 96%|█████████▌| 35027/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.127.up_proj: 96%|█████████▌| 35028/36566 [00:31<00:01, 1165.59it/s] packing model.layers.89.mlp.experts.127.down_proj: 96%|█████████▌| 35029/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.0.gate_proj: 96%|█████████▌| 35030/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.0.up_proj: 96%|█████████▌| 35031/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.0.down_proj: 96%|█████████▌| 35032/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.1.gate_proj: 96%|█████████▌| 35033/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.1.up_proj: 96%|█████████▌| 35034/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.1.down_proj: 96%|█████████▌| 35035/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.2.gate_proj: 96%|█████████▌| 35036/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.2.up_proj: 96%|█████████▌| 35037/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.2.down_proj: 96%|█████████▌| 35038/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.3.gate_proj: 96%|█████████▌| 35039/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.3.up_proj: 96%|█████████▌| 35040/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.3.down_proj: 96%|█████████▌| 35041/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.4.gate_proj: 96%|█████████▌| 35042/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.4.up_proj: 96%|█████████▌| 35043/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.4.down_proj: 96%|█████████▌| 35044/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.5.gate_proj: 96%|█████████▌| 35045/36566 [00:31<00:01, 1165.59it/s] packing model.layers.90.mlp.experts.5.gate_proj: 96%|█████████▌| 35046/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.5.up_proj: 96%|█████████▌| 35046/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.5.down_proj: 96%|█████████▌| 35047/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.6.gate_proj: 96%|█████████▌| 35048/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.6.up_proj: 96%|█████████▌| 35049/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.6.down_proj: 96%|█████████▌| 35050/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.7.gate_proj: 96%|█████████▌| 35051/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.7.up_proj: 96%|█████████▌| 35052/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.7.down_proj: 96%|█████████▌| 35053/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.8.gate_proj: 96%|█████████▌| 35054/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.8.up_proj: 96%|█████████▌| 35055/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.8.down_proj: 96%|█████████▌| 35056/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.9.gate_proj: 96%|█████████▌| 35057/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.9.up_proj: 96%|█████████▌| 35058/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.9.down_proj: 96%|█████████▌| 35059/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.10.gate_proj: 96%|█████████▌| 35060/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.10.up_proj: 96%|█████████▌| 35061/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.10.down_proj: 96%|█████████▌| 35062/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.11.gate_proj: 96%|█████████▌| 35063/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.11.up_proj: 96%|█████████▌| 35064/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.11.down_proj: 96%|█████████▌| 35065/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.12.gate_proj: 96%|█████████▌| 35066/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.12.up_proj: 96%|█████████▌| 35067/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.12.down_proj: 96%|█████████▌| 35068/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.13.gate_proj: 96%|█████████▌| 35069/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.13.up_proj: 96%|█████████▌| 35070/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.13.down_proj: 96%|█████████▌| 35071/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.14.gate_proj: 96%|█████████▌| 35072/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.14.up_proj: 96%|█████████▌| 35073/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.14.down_proj: 96%|█████████▌| 35074/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.15.gate_proj: 96%|█████████▌| 35075/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.15.up_proj: 96%|█████████▌| 35076/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.15.down_proj: 96%|█████████▌| 35077/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.16.gate_proj: 96%|█████████▌| 35078/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.16.up_proj: 96%|█████████▌| 35079/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.16.down_proj: 96%|█████████▌| 35080/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.17.gate_proj: 96%|█████████▌| 35081/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.17.up_proj: 96%|█████████▌| 35082/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.17.down_proj: 96%|█████████▌| 35083/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.18.gate_proj: 96%|█████████▌| 35084/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.18.up_proj: 96%|█████████▌| 35085/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.18.down_proj: 96%|█████████▌| 35086/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.19.gate_proj: 96%|█████████▌| 35087/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.19.up_proj: 96%|█████████▌| 35088/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.19.down_proj: 96%|█████████▌| 35089/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.20.gate_proj: 96%|█████████▌| 35090/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.20.up_proj: 96%|█████████▌| 35091/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.20.down_proj: 96%|█████████▌| 35092/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.21.gate_proj: 96%|█████████▌| 35093/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.21.up_proj: 96%|█████████▌| 35094/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.21.down_proj: 96%|█████████▌| 35095/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.22.gate_proj: 96%|█████████▌| 35096/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.22.up_proj: 96%|█████████▌| 35097/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.22.down_proj: 96%|█████████▌| 35098/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.23.gate_proj: 96%|█████████▌| 35099/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.23.up_proj: 96%|█████████▌| 35100/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.23.down_proj: 96%|█████████▌| 35101/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.24.gate_proj: 96%|█████████▌| 35102/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.24.up_proj: 96%|█████████▌| 35103/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.24.down_proj: 96%|█████████▌| 35104/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.25.gate_proj: 96%|█████████▌| 35105/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.25.up_proj: 96%|█████████▌| 35106/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.25.down_proj: 96%|█████████▌| 35107/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.26.gate_proj: 96%|█████████▌| 35108/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.26.up_proj: 96%|█████████▌| 35109/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.26.down_proj: 96%|█████████▌| 35110/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.27.gate_proj: 96%|█████████▌| 35111/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.27.up_proj: 96%|█████████▌| 35112/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.27.down_proj: 96%|█████████▌| 35113/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.28.gate_proj: 96%|█████████▌| 35114/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.28.up_proj: 96%|█████████▌| 35115/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.28.down_proj: 96%|█████████▌| 35116/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.29.gate_proj: 96%|█████████▌| 35117/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.29.up_proj: 96%|█████████▌| 35118/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.29.down_proj: 96%|█████████▌| 35119/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.30.gate_proj: 96%|█████████▌| 35120/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.30.up_proj: 96%|█████████▌| 35121/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.30.down_proj: 96%|█████████▌| 35122/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.31.gate_proj: 96%|█████████▌| 35123/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.31.up_proj: 96%|█████████▌| 35124/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.31.down_proj: 96%|█████████▌| 35125/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.32.gate_proj: 96%|█████████▌| 35126/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.32.up_proj: 96%|█████████▌| 35127/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.32.down_proj: 96%|█████████▌| 35128/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.33.gate_proj: 96%|█████████▌| 35129/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.33.up_proj: 96%|█████████▌| 35130/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.33.down_proj: 96%|█████████▌| 35131/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.34.gate_proj: 96%|█████████▌| 35132/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.34.up_proj: 96%|█████████▌| 35133/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.34.down_proj: 96%|█████████▌| 35134/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.35.gate_proj: 96%|█████████▌| 35135/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.35.up_proj: 96%|█████████▌| 35136/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.35.down_proj: 96%|█████████▌| 35137/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.36.gate_proj: 96%|█████████▌| 35138/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.36.up_proj: 96%|█████████▌| 35139/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.36.down_proj: 96%|█████████▌| 35140/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.37.gate_proj: 96%|█████████▌| 35141/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.37.up_proj: 96%|█████████▌| 35142/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.37.down_proj: 96%|█████████▌| 35143/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.38.gate_proj: 96%|█████████▌| 35144/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.38.up_proj: 96%|█████████▌| 35145/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.38.down_proj: 96%|█████████▌| 35146/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.39.gate_proj: 96%|█████████▌| 35147/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.39.up_proj: 96%|█████████▌| 35148/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.39.down_proj: 96%|█████████▌| 35149/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.40.gate_proj: 96%|█████████▌| 35150/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.40.up_proj: 96%|█████████▌| 35151/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.40.down_proj: 96%|█████████▌| 35152/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.41.gate_proj: 96%|█████████▌| 35153/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.41.up_proj: 96%|█████████▌| 35154/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.41.down_proj: 96%|█████████▌| 35155/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.42.gate_proj: 96%|█████████▌| 35156/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.42.up_proj: 96%|█████████▌| 35157/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.42.down_proj: 96%|█████████▌| 35158/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.43.gate_proj: 96%|█████████▌| 35159/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.43.up_proj: 96%|█████████▌| 35160/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.43.down_proj: 96%|█████████▌| 35161/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.44.gate_proj: 96%|█████████▌| 35162/36566 [00:31<00:01, 1165.30it/s] packing model.layers.90.mlp.experts.44.gate_proj: 96%|█████████▌| 35163/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.44.up_proj: 96%|█████████▌| 35163/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.44.down_proj: 96%|█████████▌| 35164/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.45.gate_proj: 96%|█████████▌| 35165/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.45.up_proj: 96%|█████████▌| 35166/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.45.down_proj: 96%|█████████▌| 35167/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.46.gate_proj: 96%|█████████▌| 35168/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.46.up_proj: 96%|█████████▌| 35169/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.46.down_proj: 96%|█████████▌| 35170/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.47.gate_proj: 96%|█████████▌| 35171/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.47.up_proj: 96%|█████████▌| 35172/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.47.down_proj: 96%|█████████▌| 35173/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.48.gate_proj: 96%|█████████▌| 35174/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.48.up_proj: 96%|█████████▌| 35175/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.48.down_proj: 96%|█████████▌| 35176/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.49.gate_proj: 96%|█████████▌| 35177/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.49.up_proj: 96%|█████████▌| 35178/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.49.down_proj: 96%|█████████▌| 35179/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.50.gate_proj: 96%|█████████▌| 35180/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.50.up_proj: 96%|█████████▌| 35181/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.50.down_proj: 96%|█████████▌| 35182/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.51.gate_proj: 96%|█████████▌| 35183/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.51.up_proj: 96%|█████████▌| 35184/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.51.down_proj: 96%|█████████▌| 35185/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.52.gate_proj: 96%|█████████▌| 35186/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.52.up_proj: 96%|█████████▌| 35187/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.52.down_proj: 96%|█████████▌| 35188/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.53.gate_proj: 96%|█████████▌| 35189/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.53.up_proj: 96%|█████████▌| 35190/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.53.down_proj: 96%|█████████▌| 35191/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.54.gate_proj: 96%|█████████▌| 35192/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.54.up_proj: 96%|█████████▌| 35193/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.54.down_proj: 96%|█████████▌| 35194/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.55.gate_proj: 96%|█████████▋| 35195/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.55.up_proj: 96%|█████████▋| 35196/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.55.down_proj: 96%|█████████▋| 35197/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.56.gate_proj: 96%|█████████▋| 35198/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.56.up_proj: 96%|█████████▋| 35199/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.56.down_proj: 96%|█████████▋| 35200/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.57.gate_proj: 96%|█████████▋| 35201/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.57.up_proj: 96%|█████████▋| 35202/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.57.down_proj: 96%|█████████▋| 35203/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.58.gate_proj: 96%|█████████▋| 35204/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.58.up_proj: 96%|█████████▋| 35205/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.58.down_proj: 96%|█████████▋| 35206/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.59.gate_proj: 96%|█████████▋| 35207/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.59.up_proj: 96%|█████████▋| 35208/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.59.down_proj: 96%|█████████▋| 35209/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.60.gate_proj: 96%|█████████▋| 35210/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.60.up_proj: 96%|█████████▋| 35211/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.60.down_proj: 96%|█████████▋| 35212/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.61.gate_proj: 96%|█████████▋| 35213/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.61.up_proj: 96%|█████████▋| 35214/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.61.down_proj: 96%|█████████▋| 35215/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.62.gate_proj: 96%|█████████▋| 35216/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.62.up_proj: 96%|█████████▋| 35217/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.62.down_proj: 96%|█████████▋| 35218/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.63.gate_proj: 96%|█████████▋| 35219/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.63.up_proj: 96%|█████████▋| 35220/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.63.down_proj: 96%|█████████▋| 35221/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.64.gate_proj: 96%|█████████▋| 35222/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.64.up_proj: 96%|█████████▋| 35223/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.64.down_proj: 96%|█████████▋| 35224/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.65.gate_proj: 96%|█████████▋| 35225/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.65.up_proj: 96%|█████████▋| 35226/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.65.down_proj: 96%|█████████▋| 35227/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.66.gate_proj: 96%|█████████▋| 35228/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.66.up_proj: 96%|█████████▋| 35229/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.66.down_proj: 96%|█████████▋| 35230/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.67.gate_proj: 96%|█████████▋| 35231/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.67.up_proj: 96%|█████████▋| 35232/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.67.down_proj: 96%|█████████▋| 35233/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.68.gate_proj: 96%|█████████▋| 35234/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.68.up_proj: 96%|█████████▋| 35235/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.68.down_proj: 96%|█████████▋| 35236/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.69.gate_proj: 96%|█████████▋| 35237/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.69.up_proj: 96%|█████████▋| 35238/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.69.down_proj: 96%|█████████▋| 35239/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.70.gate_proj: 96%|█████████▋| 35240/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.70.up_proj: 96%|█████████▋| 35241/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.70.down_proj: 96%|█████████▋| 35242/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.71.gate_proj: 96%|█████████▋| 35243/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.71.up_proj: 96%|█████████▋| 35244/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.71.down_proj: 96%|█████████▋| 35245/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.72.gate_proj: 96%|█████████▋| 35246/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.72.up_proj: 96%|█████████▋| 35247/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.72.down_proj: 96%|█████████▋| 35248/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.73.gate_proj: 96%|█████████▋| 35249/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.73.up_proj: 96%|█████████▋| 35250/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.73.down_proj: 96%|█████████▋| 35251/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.74.gate_proj: 96%|█████████▋| 35252/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.74.up_proj: 96%|█████████▋| 35253/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.74.down_proj: 96%|█████████▋| 35254/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.75.gate_proj: 96%|█████████▋| 35255/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.75.up_proj: 96%|█████████▋| 35256/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.75.down_proj: 96%|█████████▋| 35257/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.76.gate_proj: 96%|█████████▋| 35258/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.76.up_proj: 96%|█████████▋| 35259/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.76.down_proj: 96%|█████████▋| 35260/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.77.gate_proj: 96%|█████████▋| 35261/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.77.up_proj: 96%|█████████▋| 35262/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.77.down_proj: 96%|█████████▋| 35263/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.78.gate_proj: 96%|█████████▋| 35264/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.78.up_proj: 96%|█████████▋| 35265/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.78.down_proj: 96%|█████████▋| 35266/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.79.gate_proj: 96%|█████████▋| 35267/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.79.up_proj: 96%|█████████▋| 35268/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.79.down_proj: 96%|█████████▋| 35269/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.80.gate_proj: 96%|█████████▋| 35270/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.80.up_proj: 96%|█████████▋| 35271/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.80.down_proj: 96%|█████████▋| 35272/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.81.gate_proj: 96%|█████████▋| 35273/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.81.up_proj: 96%|█████████▋| 35274/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.81.down_proj: 96%|█████████▋| 35275/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.82.gate_proj: 96%|█████████▋| 35276/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.82.up_proj: 96%|█████████▋| 35277/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.82.down_proj: 96%|█████████▋| 35278/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.83.gate_proj: 96%|█████████▋| 35279/36566 [00:31<00:01, 1166.16it/s] packing model.layers.90.mlp.experts.83.gate_proj: 96%|█████████▋| 35280/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.83.up_proj: 96%|█████████▋| 35280/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.83.down_proj: 96%|█████████▋| 35281/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.84.gate_proj: 96%|█████████▋| 35282/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.84.up_proj: 96%|█████████▋| 35283/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.84.down_proj: 96%|█████████▋| 35284/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.85.gate_proj: 96%|█████████▋| 35285/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.85.up_proj: 96%|█████████▋| 35286/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.85.down_proj: 97%|█████████▋| 35287/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.86.gate_proj: 97%|█████████▋| 35288/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.86.up_proj: 97%|█████████▋| 35289/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.86.down_proj: 97%|█████████▋| 35290/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.87.gate_proj: 97%|█████████▋| 35291/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.87.up_proj: 97%|█████████▋| 35292/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.87.down_proj: 97%|█████████▋| 35293/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.88.gate_proj: 97%|█████████▋| 35294/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.88.up_proj: 97%|█████████▋| 35295/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.88.down_proj: 97%|█████████▋| 35296/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.89.gate_proj: 97%|█████████▋| 35297/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.89.up_proj: 97%|█████████▋| 35298/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.89.down_proj: 97%|█████████▋| 35299/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.90.gate_proj: 97%|█████████▋| 35300/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.90.up_proj: 97%|█████████▋| 35301/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.90.down_proj: 97%|█████████▋| 35302/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.91.gate_proj: 97%|█████████▋| 35303/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.91.up_proj: 97%|█████████▋| 35304/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.91.down_proj: 97%|█████████▋| 35305/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.92.gate_proj: 97%|█████████▋| 35306/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.92.up_proj: 97%|█████████▋| 35307/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.92.down_proj: 97%|█████████▋| 35308/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.93.gate_proj: 97%|█████████▋| 35309/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.93.up_proj: 97%|█████████▋| 35310/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.93.down_proj: 97%|█████████▋| 35311/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.94.gate_proj: 97%|█████████▋| 35312/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.94.up_proj: 97%|█████████▋| 35313/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.94.down_proj: 97%|█████████▋| 35314/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.95.gate_proj: 97%|█████████▋| 35315/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.95.up_proj: 97%|█████████▋| 35316/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.95.down_proj: 97%|█████████▋| 35317/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.96.gate_proj: 97%|█████████▋| 35318/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.96.up_proj: 97%|█████████▋| 35319/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.96.down_proj: 97%|█████████▋| 35320/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.97.gate_proj: 97%|█████████▋| 35321/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.97.up_proj: 97%|█████████▋| 35322/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.97.down_proj: 97%|█████████▋| 35323/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.98.gate_proj: 97%|█████████▋| 35324/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.98.up_proj: 97%|█████████▋| 35325/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.98.down_proj: 97%|█████████▋| 35326/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.99.gate_proj: 97%|█████████▋| 35327/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.99.up_proj: 97%|█████████▋| 35328/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.99.down_proj: 97%|█████████▋| 35329/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.100.gate_proj: 97%|█████████▋| 35330/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.100.up_proj: 97%|█████████▋| 35331/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.100.down_proj: 97%|█████████▋| 35332/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.101.gate_proj: 97%|█████████▋| 35333/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.101.up_proj: 97%|█████████▋| 35334/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.101.down_proj: 97%|█████████▋| 35335/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.102.gate_proj: 97%|█████████▋| 35336/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.102.up_proj: 97%|█████████▋| 35337/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.102.down_proj: 97%|█████████▋| 35338/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.103.gate_proj: 97%|█████████▋| 35339/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.103.up_proj: 97%|█████████▋| 35340/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.103.down_proj: 97%|█████████▋| 35341/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.104.gate_proj: 97%|█████████▋| 35342/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.104.up_proj: 97%|█████████▋| 35343/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.104.down_proj: 97%|█████████▋| 35344/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.105.gate_proj: 97%|█████████▋| 35345/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.105.up_proj: 97%|█████████▋| 35346/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.105.down_proj: 97%|█████████▋| 35347/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.106.gate_proj: 97%|█████████▋| 35348/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.106.up_proj: 97%|█████████▋| 35349/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.106.down_proj: 97%|█████████▋| 35350/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.107.gate_proj: 97%|█████████▋| 35351/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.107.up_proj: 97%|█████████▋| 35352/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.107.down_proj: 97%|█████████▋| 35353/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.108.gate_proj: 97%|█████████▋| 35354/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.108.up_proj: 97%|█████████▋| 35355/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.108.down_proj: 97%|█████████▋| 35356/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.109.gate_proj: 97%|█████████▋| 35357/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.109.up_proj: 97%|█████████▋| 35358/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.109.down_proj: 97%|█████████▋| 35359/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.110.gate_proj: 97%|█████████▋| 35360/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.110.up_proj: 97%|█████████▋| 35361/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.110.down_proj: 97%|█████████▋| 35362/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.111.gate_proj: 97%|█████████▋| 35363/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.111.up_proj: 97%|█████████▋| 35364/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.111.down_proj: 97%|█████████▋| 35365/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.112.gate_proj: 97%|█████████▋| 35366/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.112.up_proj: 97%|█████████▋| 35367/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.112.down_proj: 97%|█████████▋| 35368/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.113.gate_proj: 97%|█████████▋| 35369/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.113.up_proj: 97%|█████████▋| 35370/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.113.down_proj: 97%|█████████▋| 35371/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.114.gate_proj: 97%|█████████▋| 35372/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.114.up_proj: 97%|█████████▋| 35373/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.114.down_proj: 97%|█████████▋| 35374/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.115.gate_proj: 97%|█████████▋| 35375/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.115.up_proj: 97%|█████████▋| 35376/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.115.down_proj: 97%|█████████▋| 35377/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.116.gate_proj: 97%|█████████▋| 35378/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.116.up_proj: 97%|█████████▋| 35379/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.116.down_proj: 97%|█████████▋| 35380/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.117.gate_proj: 97%|█████████▋| 35381/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.117.up_proj: 97%|█████████▋| 35382/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.117.down_proj: 97%|█████████▋| 35383/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.118.gate_proj: 97%|█████████▋| 35384/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.118.up_proj: 97%|█████████▋| 35385/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.118.down_proj: 97%|█████████▋| 35386/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.119.gate_proj: 97%|█████████▋| 35387/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.119.up_proj: 97%|█████████▋| 35388/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.119.down_proj: 97%|█████████▋| 35389/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.120.gate_proj: 97%|█████████▋| 35390/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.120.up_proj: 97%|█████████▋| 35391/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.120.down_proj: 97%|█████████▋| 35392/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.121.gate_proj: 97%|█████████▋| 35393/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.121.up_proj: 97%|█████████▋| 35394/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.121.down_proj: 97%|█████████▋| 35395/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.122.gate_proj: 97%|█████████▋| 35396/36566 [00:31<00:01, 1166.95it/s] packing model.layers.90.mlp.experts.122.gate_proj: 97%|█████████▋| 35397/36566 [00:31<00:01, 1164.44it/s] packing model.layers.90.mlp.experts.122.up_proj: 97%|█████████▋| 35397/36566 [00:31<00:01, 1164.44it/s] packing model.layers.90.mlp.experts.122.down_proj: 97%|█████████▋| 35398/36566 [00:31<00:01, 1164.44it/s] packing model.layers.90.mlp.experts.123.gate_proj: 97%|█████████▋| 35399/36566 [00:31<00:01, 1164.44it/s] packing model.layers.90.mlp.experts.123.up_proj: 97%|█████████▋| 35400/36566 [00:31<00:01, 1164.44it/s] packing model.layers.90.mlp.experts.123.down_proj: 97%|█████████▋| 35401/36566 [00:31<00:01, 1164.44it/s] packing model.layers.90.mlp.experts.124.gate_proj: 97%|█████████▋| 35402/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.124.up_proj: 97%|█████████▋| 35403/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.124.down_proj: 97%|█████████▋| 35404/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.125.gate_proj: 97%|█████████▋| 35405/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.125.up_proj: 97%|█████████▋| 35406/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.125.down_proj: 97%|█████████▋| 35407/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.126.gate_proj: 97%|█████████▋| 35408/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.126.up_proj: 97%|█████████▋| 35409/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.126.down_proj: 97%|█████████▋| 35410/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.127.gate_proj: 97%|█████████▋| 35411/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.127.up_proj: 97%|█████████▋| 35412/36566 [00:31<00:00, 1164.44it/s] packing model.layers.90.mlp.experts.127.down_proj: 97%|█████████▋| 35413/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.0.gate_proj: 97%|█████████▋| 35414/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.0.up_proj: 97%|█████████▋| 35415/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.0.down_proj: 97%|█████████▋| 35416/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.1.gate_proj: 97%|█████████▋| 35417/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.1.up_proj: 97%|█████████▋| 35418/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.1.down_proj: 97%|█████████▋| 35419/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.2.gate_proj: 97%|█████████▋| 35420/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.2.up_proj: 97%|█████████▋| 35421/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.2.down_proj: 97%|█████████▋| 35422/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.3.gate_proj: 97%|█████████▋| 35423/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.3.up_proj: 97%|█████████▋| 35424/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.3.down_proj: 97%|█████████▋| 35425/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.4.gate_proj: 97%|█████████▋| 35426/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.4.up_proj: 97%|█████████▋| 35427/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.4.down_proj: 97%|█████████▋| 35428/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.5.gate_proj: 97%|█████████▋| 35429/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.5.up_proj: 97%|█████████▋| 35430/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.5.down_proj: 97%|█████████▋| 35431/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.6.gate_proj: 97%|█████████▋| 35432/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.6.up_proj: 97%|█████████▋| 35433/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.6.down_proj: 97%|█████████▋| 35434/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.7.gate_proj: 97%|█████████▋| 35435/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.7.up_proj: 97%|█████████▋| 35436/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.7.down_proj: 97%|█████████▋| 35437/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.8.gate_proj: 97%|█████████▋| 35438/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.8.up_proj: 97%|█████████▋| 35439/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.8.down_proj: 97%|█████████▋| 35440/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.9.gate_proj: 97%|█████████▋| 35441/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.9.up_proj: 97%|█████████▋| 35442/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.9.down_proj: 97%|█████████▋| 35443/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.10.gate_proj: 97%|█████████▋| 35444/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.10.up_proj: 97%|█████████▋| 35445/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.10.down_proj: 97%|█████████▋| 35446/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.11.gate_proj: 97%|█████████▋| 35447/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.11.up_proj: 97%|█████████▋| 35448/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.11.down_proj: 97%|█████████▋| 35449/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.12.gate_proj: 97%|█████████▋| 35450/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.12.up_proj: 97%|█████████▋| 35451/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.12.down_proj: 97%|█████████▋| 35452/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.13.gate_proj: 97%|█████████▋| 35453/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.13.up_proj: 97%|█████████▋| 35454/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.13.down_proj: 97%|█████████▋| 35455/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.14.gate_proj: 97%|█████████▋| 35456/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.14.up_proj: 97%|█████████▋| 35457/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.14.down_proj: 97%|█████████▋| 35458/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.15.gate_proj: 97%|█████████▋| 35459/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.15.up_proj: 97%|█████████▋| 35460/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.15.down_proj: 97%|█████████▋| 35461/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.16.gate_proj: 97%|█████████▋| 35462/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.16.up_proj: 97%|█████████▋| 35463/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.16.down_proj: 97%|█████████▋| 35464/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.17.gate_proj: 97%|█████████▋| 35465/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.17.up_proj: 97%|█████████▋| 35466/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.17.down_proj: 97%|█████████▋| 35467/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.18.gate_proj: 97%|█████████▋| 35468/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.18.up_proj: 97%|█████████▋| 35469/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.18.down_proj: 97%|█████████▋| 35470/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.19.gate_proj: 97%|█████████▋| 35471/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.19.up_proj: 97%|█████████▋| 35472/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.19.down_proj: 97%|█████████▋| 35473/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.20.gate_proj: 97%|█████████▋| 35474/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.20.up_proj: 97%|█████████▋| 35475/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.20.down_proj: 97%|█████████▋| 35476/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.21.gate_proj: 97%|█████████▋| 35477/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.21.up_proj: 97%|█████████▋| 35478/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.21.down_proj: 97%|█████████▋| 35479/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.22.gate_proj: 97%|█████████▋| 35480/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.22.up_proj: 97%|█████████▋| 35481/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.22.down_proj: 97%|█████████▋| 35482/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.23.gate_proj: 97%|█████████▋| 35483/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.23.up_proj: 97%|█████████▋| 35484/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.23.down_proj: 97%|█████████▋| 35485/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.24.gate_proj: 97%|█████████▋| 35486/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.24.up_proj: 97%|█████████▋| 35487/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.24.down_proj: 97%|█████████▋| 35488/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.25.gate_proj: 97%|█████████▋| 35489/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.25.up_proj: 97%|█████████▋| 35490/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.25.down_proj: 97%|█████████▋| 35491/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.26.gate_proj: 97%|█████████▋| 35492/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.26.up_proj: 97%|█████████▋| 35493/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.26.down_proj: 97%|█████████▋| 35494/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.27.gate_proj: 97%|█████████▋| 35495/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.27.up_proj: 97%|█████████▋| 35496/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.27.down_proj: 97%|█████████▋| 35497/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.28.gate_proj: 97%|█████████▋| 35498/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.28.up_proj: 97%|█████████▋| 35499/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.28.down_proj: 97%|█████████▋| 35500/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.29.gate_proj: 97%|█████████▋| 35501/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.29.up_proj: 97%|█████████▋| 35502/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.29.down_proj: 97%|█████████▋| 35503/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.30.gate_proj: 97%|█████████▋| 35504/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.30.up_proj: 97%|█████████▋| 35505/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.30.down_proj: 97%|█████████▋| 35506/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.31.gate_proj: 97%|█████████▋| 35507/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.31.up_proj: 97%|█████████▋| 35508/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.31.down_proj: 97%|█████████▋| 35509/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.32.gate_proj: 97%|█████████▋| 35510/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.32.up_proj: 97%|█████████▋| 35511/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.32.down_proj: 97%|█████████▋| 35512/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.33.gate_proj: 97%|█████████▋| 35513/36566 [00:31<00:00, 1164.44it/s] packing model.layers.91.mlp.experts.33.gate_proj: 97%|█████████▋| 35514/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.33.up_proj: 97%|█████████▋| 35514/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.33.down_proj: 97%|█████████▋| 35515/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.34.gate_proj: 97%|█████████▋| 35516/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.34.up_proj: 97%|█████████▋| 35517/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.34.down_proj: 97%|█████████▋| 35518/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.35.gate_proj: 97%|█████████▋| 35519/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.35.up_proj: 97%|█████████▋| 35520/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.35.down_proj: 97%|█████████▋| 35521/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.36.gate_proj: 97%|█████████▋| 35522/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.36.up_proj: 97%|█████████▋| 35523/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.36.down_proj: 97%|█████████▋| 35524/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.37.gate_proj: 97%|█████████▋| 35525/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.37.up_proj: 97%|█████████▋| 35526/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.37.down_proj: 97%|█████████▋| 35527/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.38.gate_proj: 97%|█████████▋| 35528/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.38.up_proj: 97%|█████████▋| 35529/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.38.down_proj: 97%|█████████▋| 35530/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.39.gate_proj: 97%|█████████▋| 35531/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.39.up_proj: 97%|█████████▋| 35532/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.39.down_proj: 97%|█████████▋| 35533/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.40.gate_proj: 97%|█████████▋| 35534/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.40.up_proj: 97%|█████████▋| 35535/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.40.down_proj: 97%|█████████▋| 35536/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.41.gate_proj: 97%|█████████▋| 35537/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.41.up_proj: 97%|█████████▋| 35538/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.41.down_proj: 97%|█████████▋| 35539/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.42.gate_proj: 97%|█████████▋| 35540/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.42.up_proj: 97%|█████████▋| 35541/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.42.down_proj: 97%|█████████▋| 35542/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.43.gate_proj: 97%|█████████▋| 35543/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.43.up_proj: 97%|█████████▋| 35544/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.43.down_proj: 97%|█████████▋| 35545/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.44.gate_proj: 97%|█████████▋| 35546/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.44.up_proj: 97%|█████████▋| 35547/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.44.down_proj: 97%|█████████▋| 35548/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.45.gate_proj: 97%|█████████▋| 35549/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.45.up_proj: 97%|█████████▋| 35550/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.45.down_proj: 97%|█████████▋| 35551/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.46.gate_proj: 97%|█████████▋| 35552/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.46.up_proj: 97%|█████████▋| 35553/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.46.down_proj: 97%|█████████▋| 35554/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.47.gate_proj: 97%|█████████▋| 35555/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.47.up_proj: 97%|█████████▋| 35556/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.47.down_proj: 97%|█████████▋| 35557/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.48.gate_proj: 97%|█████████▋| 35558/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.48.up_proj: 97%|█████████▋| 35559/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.48.down_proj: 97%|█████████▋| 35560/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.49.gate_proj: 97%|█████████▋| 35561/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.49.up_proj: 97%|█████████▋| 35562/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.49.down_proj: 97%|█████████▋| 35563/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.50.gate_proj: 97%|█████████▋| 35564/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.50.up_proj: 97%|█████████▋| 35565/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.50.down_proj: 97%|█████████▋| 35566/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.51.gate_proj: 97%|█████████▋| 35567/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.51.up_proj: 97%|█████████▋| 35568/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.51.down_proj: 97%|█████████▋| 35569/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.52.gate_proj: 97%|█████████▋| 35570/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.52.up_proj: 97%|█████████▋| 35571/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.52.down_proj: 97%|█████████▋| 35572/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.53.gate_proj: 97%|█████████▋| 35573/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.53.up_proj: 97%|█████████▋| 35574/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.53.down_proj: 97%|█████████▋| 35575/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.54.gate_proj: 97%|█████████▋| 35576/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.54.up_proj: 97%|█████████▋| 35577/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.54.down_proj: 97%|█████████▋| 35578/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.55.gate_proj: 97%|█████████▋| 35579/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.55.up_proj: 97%|█████████▋| 35580/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.55.down_proj: 97%|█████████▋| 35581/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.56.gate_proj: 97%|█████████▋| 35582/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.56.up_proj: 97%|█████████▋| 35583/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.56.down_proj: 97%|█████████▋| 35584/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.57.gate_proj: 97%|█████████▋| 35585/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.57.up_proj: 97%|█████████▋| 35586/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.57.down_proj: 97%|█████████▋| 35587/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.58.gate_proj: 97%|█████████▋| 35588/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.58.up_proj: 97%|█████████▋| 35589/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.58.down_proj: 97%|█████████▋| 35590/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.59.gate_proj: 97%|█████████▋| 35591/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.59.up_proj: 97%|█████████▋| 35592/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.59.down_proj: 97%|█████████▋| 35593/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.60.gate_proj: 97%|█████████▋| 35594/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.60.up_proj: 97%|█████████▋| 35595/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.60.down_proj: 97%|█████████▋| 35596/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.61.gate_proj: 97%|█████████▋| 35597/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.61.up_proj: 97%|█████████▋| 35598/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.61.down_proj: 97%|█████████▋| 35599/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.62.gate_proj: 97%|█████████▋| 35600/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.62.up_proj: 97%|█████████▋| 35601/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.62.down_proj: 97%|█████████▋| 35602/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.63.gate_proj: 97%|█████████▋| 35603/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.63.up_proj: 97%|█████████▋| 35604/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.63.down_proj: 97%|█████████▋| 35605/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.64.gate_proj: 97%|█████████▋| 35606/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.64.up_proj: 97%|█████████▋| 35607/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.64.down_proj: 97%|█████████▋| 35608/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.65.gate_proj: 97%|█████████▋| 35609/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.65.up_proj: 97%|█████████▋| 35610/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.65.down_proj: 97%|█████████▋| 35611/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.66.gate_proj: 97%|█████████▋| 35612/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.66.up_proj: 97%|█████████▋| 35613/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.66.down_proj: 97%|█████████▋| 35614/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.67.gate_proj: 97%|█████████▋| 35615/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.67.up_proj: 97%|█████████▋| 35616/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.67.down_proj: 97%|█████████▋| 35617/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.68.gate_proj: 97%|█████████▋| 35618/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.68.up_proj: 97%|█████████▋| 35619/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.68.down_proj: 97%|█████████▋| 35620/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.69.gate_proj: 97%|█████████▋| 35621/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.69.up_proj: 97%|█████████▋| 35622/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.69.down_proj: 97%|█████████▋| 35623/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.70.gate_proj: 97%|█████████▋| 35624/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.70.up_proj: 97%|█████████▋| 35625/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.70.down_proj: 97%|█████████▋| 35626/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.71.gate_proj: 97%|█████████▋| 35627/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.71.up_proj: 97%|█████████▋| 35628/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.71.down_proj: 97%|█████████▋| 35629/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.72.gate_proj: 97%|█████████▋| 35630/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.72.up_proj: 97%|█████████▋| 35631/36566 [00:31<00:00, 1164.18it/s] packing model.layers.91.mlp.experts.72.up_proj: 97%|█████████▋| 35632/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.72.down_proj: 97%|█████████▋| 35632/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.73.gate_proj: 97%|█████████▋| 35633/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.73.up_proj: 97%|█████████▋| 35634/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.73.down_proj: 97%|█████████▋| 35635/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.74.gate_proj: 97%|█████████▋| 35636/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.74.up_proj: 97%|█████████▋| 35637/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.74.down_proj: 97%|█████████▋| 35638/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.75.gate_proj: 97%|█████████▋| 35639/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.75.up_proj: 97%|█████████▋| 35640/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.75.down_proj: 97%|█████████▋| 35641/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.76.gate_proj: 97%|█████████▋| 35642/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.76.up_proj: 97%|█████████▋| 35643/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.76.down_proj: 97%|█████████▋| 35644/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.77.gate_proj: 97%|█████████▋| 35645/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.77.up_proj: 97%|█████████▋| 35646/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.77.down_proj: 97%|█████████▋| 35647/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.78.gate_proj: 97%|█████████▋| 35648/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.78.up_proj: 97%|█████████▋| 35649/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.78.down_proj: 97%|█████████▋| 35650/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.79.gate_proj: 97%|█████████▋| 35651/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.79.up_proj: 98%|█████████▊| 35652/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.79.down_proj: 98%|█████████▊| 35653/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.80.gate_proj: 98%|█████████▊| 35654/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.80.up_proj: 98%|█████████▊| 35655/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.80.down_proj: 98%|█████████▊| 35656/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.81.gate_proj: 98%|█████████▊| 35657/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.81.up_proj: 98%|█████████▊| 35658/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.81.down_proj: 98%|█████████▊| 35659/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.82.gate_proj: 98%|█████████▊| 35660/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.82.up_proj: 98%|█████████▊| 35661/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.82.down_proj: 98%|█████████▊| 35662/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.83.gate_proj: 98%|█████████▊| 35663/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.83.up_proj: 98%|█████████▊| 35664/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.83.down_proj: 98%|█████████▊| 35665/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.84.gate_proj: 98%|█████████▊| 35666/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.84.up_proj: 98%|█████████▊| 35667/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.84.down_proj: 98%|█████████▊| 35668/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.85.gate_proj: 98%|█████████▊| 35669/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.85.up_proj: 98%|█████████▊| 35670/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.85.down_proj: 98%|█████████▊| 35671/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.86.gate_proj: 98%|█████████▊| 35672/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.86.up_proj: 98%|█████████▊| 35673/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.86.down_proj: 98%|█████████▊| 35674/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.87.gate_proj: 98%|█████████▊| 35675/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.87.up_proj: 98%|█████████▊| 35676/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.87.down_proj: 98%|█████████▊| 35677/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.88.gate_proj: 98%|█████████▊| 35678/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.88.up_proj: 98%|█████████▊| 35679/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.88.down_proj: 98%|█████████▊| 35680/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.89.gate_proj: 98%|█████████▊| 35681/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.89.up_proj: 98%|█████████▊| 35682/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.89.down_proj: 98%|█████████▊| 35683/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.90.gate_proj: 98%|█████████▊| 35684/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.90.up_proj: 98%|█████████▊| 35685/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.90.down_proj: 98%|█████████▊| 35686/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.91.gate_proj: 98%|█████████▊| 35687/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.91.up_proj: 98%|█████████▊| 35688/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.91.down_proj: 98%|█████████▊| 35689/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.92.gate_proj: 98%|█████████▊| 35690/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.92.up_proj: 98%|█████████▊| 35691/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.92.down_proj: 98%|█████████▊| 35692/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.93.gate_proj: 98%|█████████▊| 35693/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.93.up_proj: 98%|█████████▊| 35694/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.93.down_proj: 98%|█████████▊| 35695/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.94.gate_proj: 98%|█████████▊| 35696/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.94.up_proj: 98%|█████████▊| 35697/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.94.down_proj: 98%|█████████▊| 35698/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.95.gate_proj: 98%|█████████▊| 35699/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.95.up_proj: 98%|█████████▊| 35700/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.95.down_proj: 98%|█████████▊| 35701/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.96.gate_proj: 98%|█████████▊| 35702/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.96.up_proj: 98%|█████████▊| 35703/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.96.down_proj: 98%|█████████▊| 35704/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.97.gate_proj: 98%|█████████▊| 35705/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.97.up_proj: 98%|█████████▊| 35706/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.97.down_proj: 98%|█████████▊| 35707/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.98.gate_proj: 98%|█████████▊| 35708/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.98.up_proj: 98%|█████████▊| 35709/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.98.down_proj: 98%|█████████▊| 35710/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.99.gate_proj: 98%|█████████▊| 35711/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.99.up_proj: 98%|█████████▊| 35712/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.99.down_proj: 98%|█████████▊| 35713/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.100.gate_proj: 98%|█████████▊| 35714/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.100.up_proj: 98%|█████████▊| 35715/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.100.down_proj: 98%|█████████▊| 35716/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.101.gate_proj: 98%|█████████▊| 35717/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.101.up_proj: 98%|█████████▊| 35718/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.101.down_proj: 98%|█████████▊| 35719/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.102.gate_proj: 98%|█████████▊| 35720/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.102.up_proj: 98%|█████████▊| 35721/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.102.down_proj: 98%|█████████▊| 35722/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.103.gate_proj: 98%|█████████▊| 35723/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.103.up_proj: 98%|█████████▊| 35724/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.103.down_proj: 98%|█████████▊| 35725/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.104.gate_proj: 98%|█████████▊| 35726/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.104.up_proj: 98%|█████████▊| 35727/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.104.down_proj: 98%|█████████▊| 35728/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.105.gate_proj: 98%|█████████▊| 35729/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.105.up_proj: 98%|█████████▊| 35730/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.105.down_proj: 98%|█████████▊| 35731/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.106.gate_proj: 98%|█████████▊| 35732/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.106.up_proj: 98%|█████████▊| 35733/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.106.down_proj: 98%|█████████▊| 35734/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.107.gate_proj: 98%|█████████▊| 35735/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.107.up_proj: 98%|█████████▊| 35736/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.107.down_proj: 98%|█████████▊| 35737/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.108.gate_proj: 98%|█████████▊| 35738/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.108.up_proj: 98%|█████████▊| 35739/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.108.down_proj: 98%|█████████▊| 35740/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.109.gate_proj: 98%|█████████▊| 35741/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.109.up_proj: 98%|█████████▊| 35742/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.109.down_proj: 98%|█████████▊| 35743/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.110.gate_proj: 98%|█████████▊| 35744/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.110.up_proj: 98%|█████████▊| 35745/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.110.down_proj: 98%|█████████▊| 35746/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.111.gate_proj: 98%|█████████▊| 35747/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.111.up_proj: 98%|█████████▊| 35748/36566 [00:31<00:00, 1167.22it/s] packing model.layers.91.mlp.experts.111.up_proj: 98%|█████████▊| 35749/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.111.down_proj: 98%|█████████▊| 35749/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.112.gate_proj: 98%|█████████▊| 35750/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.112.up_proj: 98%|█████████▊| 35751/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.112.down_proj: 98%|█████████▊| 35752/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.113.gate_proj: 98%|█████████▊| 35753/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.113.up_proj: 98%|█████████▊| 35754/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.113.down_proj: 98%|█████████▊| 35755/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.114.gate_proj: 98%|█████████▊| 35756/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.114.up_proj: 98%|█████████▊| 35757/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.114.down_proj: 98%|█████████▊| 35758/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.115.gate_proj: 98%|█████████▊| 35759/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.115.up_proj: 98%|█████████▊| 35760/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.115.down_proj: 98%|█████████▊| 35761/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.116.gate_proj: 98%|█████████▊| 35762/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.116.up_proj: 98%|█████████▊| 35763/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.116.down_proj: 98%|█████████▊| 35764/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.117.gate_proj: 98%|█████████▊| 35765/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.117.up_proj: 98%|█████████▊| 35766/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.117.down_proj: 98%|█████████▊| 35767/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.118.gate_proj: 98%|█████████▊| 35768/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.118.up_proj: 98%|█████████▊| 35769/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.118.down_proj: 98%|█████████▊| 35770/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.119.gate_proj: 98%|█████████▊| 35771/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.119.up_proj: 98%|█████████▊| 35772/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.119.down_proj: 98%|█████████▊| 35773/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.120.gate_proj: 98%|█████████▊| 35774/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.120.up_proj: 98%|█████████▊| 35775/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.120.down_proj: 98%|█████████▊| 35776/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.121.gate_proj: 98%|█████████▊| 35777/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.121.up_proj: 98%|█████████▊| 35778/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.121.down_proj: 98%|█████████▊| 35779/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.122.gate_proj: 98%|█████████▊| 35780/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.122.up_proj: 98%|█████████▊| 35781/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.122.down_proj: 98%|█████████▊| 35782/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.123.gate_proj: 98%|█████████▊| 35783/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.123.up_proj: 98%|█████████▊| 35784/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.123.down_proj: 98%|█████████▊| 35785/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.124.gate_proj: 98%|█████████▊| 35786/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.124.up_proj: 98%|█████████▊| 35787/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.124.down_proj: 98%|█████████▊| 35788/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.125.gate_proj: 98%|█████████▊| 35789/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.125.up_proj: 98%|█████████▊| 35790/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.125.down_proj: 98%|█████████▊| 35791/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.126.gate_proj: 98%|█████████▊| 35792/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.126.up_proj: 98%|█████████▊| 35793/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.126.down_proj: 98%|█████████▊| 35794/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.127.gate_proj: 98%|█████████▊| 35795/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.127.up_proj: 98%|█████████▊| 35796/36566 [00:31<00:00, 1166.89it/s] packing model.layers.91.mlp.experts.127.down_proj: 98%|█████████▊| 35797/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.0.gate_proj: 98%|█████████▊| 35798/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.0.up_proj: 98%|█████████▊| 35799/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.0.down_proj: 98%|█████████▊| 35800/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.1.gate_proj: 98%|█████████▊| 35801/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.1.up_proj: 98%|█████████▊| 35802/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.1.down_proj: 98%|█████████▊| 35803/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.2.gate_proj: 98%|█████████▊| 35804/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.2.up_proj: 98%|█████████▊| 35805/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.2.down_proj: 98%|█████████▊| 35806/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.3.gate_proj: 98%|█████████▊| 35807/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.3.up_proj: 98%|█████████▊| 35808/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.3.down_proj: 98%|█████████▊| 35809/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.4.gate_proj: 98%|█████████▊| 35810/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.4.up_proj: 98%|█████████▊| 35811/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.4.down_proj: 98%|█████████▊| 35812/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.5.gate_proj: 98%|█████████▊| 35813/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.5.up_proj: 98%|█████████▊| 35814/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.5.down_proj: 98%|█████████▊| 35815/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.6.gate_proj: 98%|█████████▊| 35816/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.6.up_proj: 98%|█████████▊| 35817/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.6.down_proj: 98%|█████████▊| 35818/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.7.gate_proj: 98%|█████████▊| 35819/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.7.up_proj: 98%|█████████▊| 35820/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.7.down_proj: 98%|█████████▊| 35821/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.8.gate_proj: 98%|█████████▊| 35822/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.8.up_proj: 98%|█████████▊| 35823/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.8.down_proj: 98%|█████████▊| 35824/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.9.gate_proj: 98%|█████████▊| 35825/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.9.up_proj: 98%|█████████▊| 35826/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.9.down_proj: 98%|█████████▊| 35827/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.10.gate_proj: 98%|█████████▊| 35828/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.10.up_proj: 98%|█████████▊| 35829/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.10.down_proj: 98%|█████████▊| 35830/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.11.gate_proj: 98%|█████████▊| 35831/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.11.up_proj: 98%|█████████▊| 35832/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.11.down_proj: 98%|█████████▊| 35833/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.12.gate_proj: 98%|█████████▊| 35834/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.12.up_proj: 98%|█████████▊| 35835/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.12.down_proj: 98%|█████████▊| 35836/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.13.gate_proj: 98%|█████████▊| 35837/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.13.up_proj: 98%|█████████▊| 35838/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.13.down_proj: 98%|█████████▊| 35839/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.14.gate_proj: 98%|█████████▊| 35840/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.14.up_proj: 98%|█████████▊| 35841/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.14.down_proj: 98%|█████████▊| 35842/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.15.gate_proj: 98%|█████████▊| 35843/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.15.up_proj: 98%|█████████▊| 35844/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.15.down_proj: 98%|█████████▊| 35845/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.16.gate_proj: 98%|█████████▊| 35846/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.16.up_proj: 98%|█████████▊| 35847/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.16.down_proj: 98%|█████████▊| 35848/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.17.gate_proj: 98%|█████████▊| 35849/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.17.up_proj: 98%|█████████▊| 35850/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.17.down_proj: 98%|█████████▊| 35851/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.18.gate_proj: 98%|█████████▊| 35852/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.18.up_proj: 98%|█████████▊| 35853/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.18.down_proj: 98%|█████████▊| 35854/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.19.gate_proj: 98%|█████████▊| 35855/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.19.up_proj: 98%|█████████▊| 35856/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.19.down_proj: 98%|█████████▊| 35857/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.20.gate_proj: 98%|█████████▊| 35858/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.20.up_proj: 98%|█████████▊| 35859/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.20.down_proj: 98%|█████████▊| 35860/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.21.gate_proj: 98%|█████████▊| 35861/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.21.up_proj: 98%|█████████▊| 35862/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.21.down_proj: 98%|█████████▊| 35863/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.22.gate_proj: 98%|█████████▊| 35864/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.22.up_proj: 98%|█████████▊| 35865/36566 [00:31<00:00, 1166.89it/s] packing model.layers.92.mlp.experts.22.up_proj: 98%|█████████▊| 35866/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.22.down_proj: 98%|█████████▊| 35866/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.23.gate_proj: 98%|█████████▊| 35867/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.23.up_proj: 98%|█████████▊| 35868/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.23.down_proj: 98%|█████████▊| 35869/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.24.gate_proj: 98%|█████████▊| 35870/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.24.up_proj: 98%|█████████▊| 35871/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.24.down_proj: 98%|█████████▊| 35872/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.25.gate_proj: 98%|█████████▊| 35873/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.25.up_proj: 98%|█████████▊| 35874/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.25.down_proj: 98%|█████████▊| 35875/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.26.gate_proj: 98%|█████████▊| 35876/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.26.up_proj: 98%|█████████▊| 35877/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.26.down_proj: 98%|█████████▊| 35878/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.27.gate_proj: 98%|█████████▊| 35879/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.27.up_proj: 98%|█████████▊| 35880/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.27.down_proj: 98%|█████████▊| 35881/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.28.gate_proj: 98%|█████████▊| 35882/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.28.up_proj: 98%|█████████▊| 35883/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.28.down_proj: 98%|█████████▊| 35884/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.29.gate_proj: 98%|█████████▊| 35885/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.29.up_proj: 98%|█████████▊| 35886/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.29.down_proj: 98%|█████████▊| 35887/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.30.gate_proj: 98%|█████████▊| 35888/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.30.up_proj: 98%|█████████▊| 35889/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.30.down_proj: 98%|█████████▊| 35890/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.31.gate_proj: 98%|█████████▊| 35891/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.31.up_proj: 98%|█████████▊| 35892/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.31.down_proj: 98%|█████████▊| 35893/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.32.gate_proj: 98%|█████████▊| 35894/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.32.up_proj: 98%|█████████▊| 35895/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.32.down_proj: 98%|█████████▊| 35896/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.33.gate_proj: 98%|█████████▊| 35897/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.33.up_proj: 98%|█████████▊| 35898/36566 [00:31<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.33.down_proj: 98%|█████████▊| 35899/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.34.gate_proj: 98%|█████████▊| 35900/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.34.up_proj: 98%|█████████▊| 35901/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.34.down_proj: 98%|█████████▊| 35902/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.35.gate_proj: 98%|█████████▊| 35903/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.35.up_proj: 98%|█████████▊| 35904/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.35.down_proj: 98%|█████████▊| 35905/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.36.gate_proj: 98%|█████████▊| 35906/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.36.up_proj: 98%|█████████▊| 35907/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.36.down_proj: 98%|█████████▊| 35908/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.37.gate_proj: 98%|█████████▊| 35909/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.37.up_proj: 98%|█████████▊| 35910/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.37.down_proj: 98%|█████████▊| 35911/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.38.gate_proj: 98%|█████████▊| 35912/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.38.up_proj: 98%|█████████▊| 35913/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.38.down_proj: 98%|█████████▊| 35914/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.39.gate_proj: 98%|█████████▊| 35915/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.39.up_proj: 98%|█████████▊| 35916/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.39.down_proj: 98%|█████████▊| 35917/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.40.gate_proj: 98%|█████████▊| 35918/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.40.up_proj: 98%|█████████▊| 35919/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.40.down_proj: 98%|█████████▊| 35920/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.41.gate_proj: 98%|█████████▊| 35921/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.41.up_proj: 98%|█████████▊| 35922/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.41.down_proj: 98%|█████████▊| 35923/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.42.gate_proj: 98%|█████████▊| 35924/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.42.up_proj: 98%|█████████▊| 35925/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.42.down_proj: 98%|█████████▊| 35926/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.43.gate_proj: 98%|█████████▊| 35927/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.43.up_proj: 98%|█████████▊| 35928/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.43.down_proj: 98%|█████████▊| 35929/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.44.gate_proj: 98%|█████████▊| 35930/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.44.up_proj: 98%|█████████▊| 35931/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.44.down_proj: 98%|█████████▊| 35932/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.45.gate_proj: 98%|█████████▊| 35933/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.45.up_proj: 98%|█████████▊| 35934/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.45.down_proj: 98%|█████████▊| 35935/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.46.gate_proj: 98%|█████████▊| 35936/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.46.up_proj: 98%|█████████▊| 35937/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.46.down_proj: 98%|█████████▊| 35938/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.47.gate_proj: 98%|█████████▊| 35939/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.47.up_proj: 98%|█████████▊| 35940/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.47.down_proj: 98%|█████████▊| 35941/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.48.gate_proj: 98%|█████████▊| 35942/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.48.up_proj: 98%|█████████▊| 35943/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.48.down_proj: 98%|█████████▊| 35944/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.49.gate_proj: 98%|█████████▊| 35945/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.49.up_proj: 98%|█████████▊| 35946/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.49.down_proj: 98%|█████████▊| 35947/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.50.gate_proj: 98%|█████████▊| 35948/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.50.up_proj: 98%|█████████▊| 35949/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.50.down_proj: 98%|█████████▊| 35950/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.51.gate_proj: 98%|█████████▊| 35951/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.51.up_proj: 98%|█████████▊| 35952/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.51.down_proj: 98%|█████████▊| 35953/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.52.gate_proj: 98%|█████████▊| 35954/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.52.up_proj: 98%|█████████▊| 35955/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.52.down_proj: 98%|█████████▊| 35956/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.53.gate_proj: 98%|█████████▊| 35957/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.53.up_proj: 98%|█████████▊| 35958/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.53.down_proj: 98%|█████████▊| 35959/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.54.gate_proj: 98%|█████████▊| 35960/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.54.up_proj: 98%|█████████▊| 35961/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.54.down_proj: 98%|█████████▊| 35962/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.55.gate_proj: 98%|█████████▊| 35963/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.55.up_proj: 98%|█████████▊| 35964/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.55.down_proj: 98%|█████████▊| 35965/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.56.gate_proj: 98%|█████████▊| 35966/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.56.up_proj: 98%|█████████▊| 35967/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.56.down_proj: 98%|█████████▊| 35968/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.57.gate_proj: 98%|█████████▊| 35969/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.57.up_proj: 98%|█████████▊| 35970/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.57.down_proj: 98%|█████████▊| 35971/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.58.gate_proj: 98%|█████████▊| 35972/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.58.up_proj: 98%|█████████▊| 35973/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.58.down_proj: 98%|█████████▊| 35974/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.59.gate_proj: 98%|█████████▊| 35975/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.59.up_proj: 98%|█████████▊| 35976/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.59.down_proj: 98%|█████████▊| 35977/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.60.gate_proj: 98%|█████████▊| 35978/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.60.up_proj: 98%|█████████▊| 35979/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.60.down_proj: 98%|█████████▊| 35980/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.61.gate_proj: 98%|█████████▊| 35981/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.61.up_proj: 98%|█████████▊| 35982/36566 [00:32<00:00, 1166.25it/s] packing model.layers.92.mlp.experts.61.up_proj: 98%|█████████▊| 35983/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.61.down_proj: 98%|█████████▊| 35983/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.62.gate_proj: 98%|█████████▊| 35984/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.62.up_proj: 98%|█████████▊| 35985/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.62.down_proj: 98%|█████████▊| 35986/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.63.gate_proj: 98%|█████████▊| 35987/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.63.up_proj: 98%|█████████▊| 35988/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.63.down_proj: 98%|█████████▊| 35989/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.64.gate_proj: 98%|█████████▊| 35990/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.64.up_proj: 98%|█████████▊| 35991/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.64.down_proj: 98%|█████████▊| 35992/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.65.gate_proj: 98%|█████████▊| 35993/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.65.up_proj: 98%|█████████▊| 35994/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.65.down_proj: 98%|█████████▊| 35995/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.66.gate_proj: 98%|█████████▊| 35996/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.66.up_proj: 98%|█████████▊| 35997/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.66.down_proj: 98%|█████████▊| 35998/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.67.gate_proj: 98%|█████████▊| 35999/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.67.up_proj: 98%|█████████▊| 36000/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.67.down_proj: 98%|█████████▊| 36001/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.68.gate_proj: 98%|█████████▊| 36002/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.68.up_proj: 98%|█████████▊| 36003/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.68.down_proj: 98%|█████████▊| 36004/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.69.gate_proj: 98%|█████████▊| 36005/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.69.up_proj: 98%|█████████▊| 36006/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.69.down_proj: 98%|█████████▊| 36007/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.70.gate_proj: 98%|█████████▊| 36008/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.70.up_proj: 98%|█████████▊| 36009/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.70.down_proj: 98%|█████████▊| 36010/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.71.gate_proj: 98%|█████████▊| 36011/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.71.up_proj: 98%|█████████▊| 36012/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.71.down_proj: 98%|█████████▊| 36013/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.72.gate_proj: 98%|█████████▊| 36014/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.72.up_proj: 98%|█████████▊| 36015/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.72.down_proj: 98%|█████████▊| 36016/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.73.gate_proj: 98%|█████████▊| 36017/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.73.up_proj: 99%|█████████▊| 36018/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.73.down_proj: 99%|█████████▊| 36019/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.74.gate_proj: 99%|█████████▊| 36020/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.74.up_proj: 99%|█████████▊| 36021/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.74.down_proj: 99%|█████████▊| 36022/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.75.gate_proj: 99%|█████████▊| 36023/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.75.up_proj: 99%|█████████▊| 36024/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.75.down_proj: 99%|█████████▊| 36025/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.76.gate_proj: 99%|█████████▊| 36026/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.76.up_proj: 99%|█████████▊| 36027/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.76.down_proj: 99%|█████████▊| 36028/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.77.gate_proj: 99%|█████████▊| 36029/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.77.up_proj: 99%|█████████▊| 36030/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.77.down_proj: 99%|█████████▊| 36031/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.78.gate_proj: 99%|█████████▊| 36032/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.78.up_proj: 99%|█████████▊| 36033/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.78.down_proj: 99%|█████████▊| 36034/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.79.gate_proj: 99%|█████████▊| 36035/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.79.up_proj: 99%|█████████▊| 36036/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.79.down_proj: 99%|█████████▊| 36037/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.80.gate_proj: 99%|█████████▊| 36038/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.80.up_proj: 99%|█████████▊| 36039/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.80.down_proj: 99%|█████████▊| 36040/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.81.gate_proj: 99%|█████████▊| 36041/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.81.up_proj: 99%|█████████▊| 36042/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.81.down_proj: 99%|█████████▊| 36043/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.82.gate_proj: 99%|█████████▊| 36044/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.82.up_proj: 99%|█████████▊| 36045/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.82.down_proj: 99%|█████████▊| 36046/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.83.gate_proj: 99%|█████████▊| 36047/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.83.up_proj: 99%|█████████▊| 36048/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.83.down_proj: 99%|█████████▊| 36049/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.84.gate_proj: 99%|█████████▊| 36050/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.84.up_proj: 99%|█████████▊| 36051/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.84.down_proj: 99%|█████████▊| 36052/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.85.gate_proj: 99%|█████████▊| 36053/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.85.up_proj: 99%|█████████▊| 36054/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.85.down_proj: 99%|█████████▊| 36055/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.86.gate_proj: 99%|█████████▊| 36056/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.86.up_proj: 99%|█████████▊| 36057/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.86.down_proj: 99%|█████████▊| 36058/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.87.gate_proj: 99%|█████████▊| 36059/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.87.up_proj: 99%|█████████▊| 36060/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.87.down_proj: 99%|█████████▊| 36061/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.88.gate_proj: 99%|█████████▊| 36062/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.88.up_proj: 99%|█████████▊| 36063/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.88.down_proj: 99%|█████████▊| 36064/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.89.gate_proj: 99%|█████████▊| 36065/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.89.up_proj: 99%|█████████▊| 36066/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.89.down_proj: 99%|█████████▊| 36067/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.90.gate_proj: 99%|█████████▊| 36068/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.90.up_proj: 99%|█████████▊| 36069/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.90.down_proj: 99%|█████████▊| 36070/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.91.gate_proj: 99%|█████████▊| 36071/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.91.up_proj: 99%|█████████▊| 36072/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.91.down_proj: 99%|█████████▊| 36073/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.92.gate_proj: 99%|█████████▊| 36074/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.92.up_proj: 99%|█████████▊| 36075/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.92.down_proj: 99%|█████████▊| 36076/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.93.gate_proj: 99%|█████████▊| 36077/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.93.up_proj: 99%|█████████▊| 36078/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.93.down_proj: 99%|█████████▊| 36079/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.94.gate_proj: 99%|█████████▊| 36080/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.94.up_proj: 99%|█████████▊| 36081/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.94.down_proj: 99%|█████████▊| 36082/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.95.gate_proj: 99%|█████████▊| 36083/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.95.up_proj: 99%|█████████▊| 36084/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.95.down_proj: 99%|█████████▊| 36085/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.96.gate_proj: 99%|█████████▊| 36086/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.96.up_proj: 99%|█████████▊| 36087/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.96.down_proj: 99%|█████████▊| 36088/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.97.gate_proj: 99%|█████████▊| 36089/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.97.up_proj: 99%|█████████▊| 36090/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.97.down_proj: 99%|█████████▊| 36091/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.98.gate_proj: 99%|█████████▊| 36092/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.98.up_proj: 99%|█████████▊| 36093/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.98.down_proj: 99%|█████████▊| 36094/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.99.gate_proj: 99%|█████████▊| 36095/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.99.up_proj: 99%|█████████▊| 36096/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.99.down_proj: 99%|█████████▊| 36097/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.100.gate_proj: 99%|█████████▊| 36098/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.100.up_proj: 99%|█████████▊| 36099/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.100.down_proj: 99%|█████████▊| 36100/36566 [00:32<00:00, 1167.22it/s] packing model.layers.92.mlp.experts.100.down_proj: 99%|█████████▊| 36101/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.101.gate_proj: 99%|█████████▊| 36101/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.101.up_proj: 99%|█████████▊| 36102/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.101.down_proj: 99%|█████████▊| 36103/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.102.gate_proj: 99%|█████████▊| 36104/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.102.up_proj: 99%|█████████▊| 36105/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.102.down_proj: 99%|█████████▊| 36106/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.103.gate_proj: 99%|█████████▊| 36107/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.103.up_proj: 99%|█████████▊| 36108/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.103.down_proj: 99%|█████████▉| 36109/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.104.gate_proj: 99%|█████████▉| 36110/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.104.up_proj: 99%|█████████▉| 36111/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.104.down_proj: 99%|█████████▉| 36112/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.105.gate_proj: 99%|█████████▉| 36113/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.105.up_proj: 99%|█████████▉| 36114/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.105.down_proj: 99%|█████████▉| 36115/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.106.gate_proj: 99%|█████████▉| 36116/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.106.up_proj: 99%|█████████▉| 36117/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.106.down_proj: 99%|█████████▉| 36118/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.107.gate_proj: 99%|█████████▉| 36119/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.107.up_proj: 99%|█████████▉| 36120/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.107.down_proj: 99%|█████████▉| 36121/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.108.gate_proj: 99%|█████████▉| 36122/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.108.up_proj: 99%|█████████▉| 36123/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.108.down_proj: 99%|█████████▉| 36124/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.109.gate_proj: 99%|█████████▉| 36125/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.109.up_proj: 99%|█████████▉| 36126/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.109.down_proj: 99%|█████████▉| 36127/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.110.gate_proj: 99%|█████████▉| 36128/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.110.up_proj: 99%|█████████▉| 36129/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.110.down_proj: 99%|█████████▉| 36130/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.111.gate_proj: 99%|█████████▉| 36131/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.111.up_proj: 99%|█████████▉| 36132/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.111.down_proj: 99%|█████████▉| 36133/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.112.gate_proj: 99%|█████████▉| 36134/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.112.up_proj: 99%|█████████▉| 36135/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.112.down_proj: 99%|█████████▉| 36136/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.113.gate_proj: 99%|█████████▉| 36137/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.113.up_proj: 99%|█████████▉| 36138/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.113.down_proj: 99%|█████████▉| 36139/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.114.gate_proj: 99%|█████████▉| 36140/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.114.up_proj: 99%|█████████▉| 36141/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.114.down_proj: 99%|█████████▉| 36142/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.115.gate_proj: 99%|█████████▉| 36143/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.115.up_proj: 99%|█████████▉| 36144/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.115.down_proj: 99%|█████████▉| 36145/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.116.gate_proj: 99%|█████████▉| 36146/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.116.up_proj: 99%|█████████▉| 36147/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.116.down_proj: 99%|█████████▉| 36148/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.117.gate_proj: 99%|█████████▉| 36149/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.117.up_proj: 99%|█████████▉| 36150/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.117.down_proj: 99%|█████████▉| 36151/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.118.gate_proj: 99%|█████████▉| 36152/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.118.up_proj: 99%|█████████▉| 36153/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.118.down_proj: 99%|█████████▉| 36154/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.119.gate_proj: 99%|█████████▉| 36155/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.119.up_proj: 99%|█████████▉| 36156/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.119.down_proj: 99%|█████████▉| 36157/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.120.gate_proj: 99%|█████████▉| 36158/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.120.up_proj: 99%|█████████▉| 36159/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.120.down_proj: 99%|█████████▉| 36160/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.121.gate_proj: 99%|█████████▉| 36161/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.121.up_proj: 99%|█████████▉| 36162/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.121.down_proj: 99%|█████████▉| 36163/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.122.gate_proj: 99%|█████████▉| 36164/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.122.up_proj: 99%|█████████▉| 36165/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.122.down_proj: 99%|█████████▉| 36166/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.123.gate_proj: 99%|█████████▉| 36167/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.123.up_proj: 99%|█████████▉| 36168/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.123.down_proj: 99%|█████████▉| 36169/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.124.gate_proj: 99%|█████████▉| 36170/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.124.up_proj: 99%|█████████▉| 36171/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.124.down_proj: 99%|█████████▉| 36172/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.125.gate_proj: 99%|█████████▉| 36173/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.125.up_proj: 99%|█████████▉| 36174/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.125.down_proj: 99%|█████████▉| 36175/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.126.gate_proj: 99%|█████████▉| 36176/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.126.up_proj: 99%|█████████▉| 36177/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.126.down_proj: 99%|█████████▉| 36178/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.127.gate_proj: 99%|█████████▉| 36179/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.127.up_proj: 99%|█████████▉| 36180/36566 [00:32<00:00, 1169.27it/s] packing model.layers.92.mlp.experts.127.down_proj: 99%|█████████▉| 36181/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.0.gate_proj: 99%|█████████▉| 36182/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.0.up_proj: 99%|█████████▉| 36183/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.0.down_proj: 99%|█████████▉| 36184/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.1.gate_proj: 99%|█████████▉| 36185/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.1.up_proj: 99%|█████████▉| 36186/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.1.down_proj: 99%|█████████▉| 36187/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.2.gate_proj: 99%|█████████▉| 36188/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.2.up_proj: 99%|█████████▉| 36189/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.2.down_proj: 99%|█████████▉| 36190/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.3.gate_proj: 99%|█████████▉| 36191/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.3.up_proj: 99%|█████████▉| 36192/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.3.down_proj: 99%|█████████▉| 36193/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.4.gate_proj: 99%|█████████▉| 36194/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.4.up_proj: 99%|█████████▉| 36195/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.4.down_proj: 99%|█████████▉| 36196/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.5.gate_proj: 99%|█████████▉| 36197/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.5.up_proj: 99%|█████████▉| 36198/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.5.down_proj: 99%|█████████▉| 36199/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.6.gate_proj: 99%|█████████▉| 36200/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.6.up_proj: 99%|█████████▉| 36201/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.6.down_proj: 99%|█████████▉| 36202/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.7.gate_proj: 99%|█████████▉| 36203/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.7.up_proj: 99%|█████████▉| 36204/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.7.down_proj: 99%|█████████▉| 36205/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.8.gate_proj: 99%|█████████▉| 36206/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.8.up_proj: 99%|█████████▉| 36207/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.8.down_proj: 99%|█████████▉| 36208/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.9.gate_proj: 99%|█████████▉| 36209/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.9.up_proj: 99%|█████████▉| 36210/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.9.down_proj: 99%|█████████▉| 36211/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.10.gate_proj: 99%|█████████▉| 36212/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.10.up_proj: 99%|█████████▉| 36213/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.10.down_proj: 99%|█████████▉| 36214/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.11.gate_proj: 99%|█████████▉| 36215/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.11.up_proj: 99%|█████████▉| 36216/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.11.down_proj: 99%|█████████▉| 36217/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.12.gate_proj: 99%|█████████▉| 36218/36566 [00:32<00:00, 1169.27it/s] packing model.layers.93.mlp.experts.12.gate_proj: 99%|█████████▉| 36219/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.12.up_proj: 99%|█████████▉| 36219/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.12.down_proj: 99%|█████████▉| 36220/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.13.gate_proj: 99%|█████████▉| 36221/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.13.up_proj: 99%|█████████▉| 36222/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.13.down_proj: 99%|█████████▉| 36223/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.14.gate_proj: 99%|█████████▉| 36224/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.14.up_proj: 99%|█████████▉| 36225/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.14.down_proj: 99%|█████████▉| 36226/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.15.gate_proj: 99%|█████████▉| 36227/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.15.up_proj: 99%|█████████▉| 36228/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.15.down_proj: 99%|█████████▉| 36229/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.16.gate_proj: 99%|█████████▉| 36230/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.16.up_proj: 99%|█████████▉| 36231/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.16.down_proj: 99%|█████████▉| 36232/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.17.gate_proj: 99%|█████████▉| 36233/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.17.up_proj: 99%|█████████▉| 36234/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.17.down_proj: 99%|█████████▉| 36235/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.18.gate_proj: 99%|█████████▉| 36236/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.18.up_proj: 99%|█████████▉| 36237/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.18.down_proj: 99%|█████████▉| 36238/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.19.gate_proj: 99%|█████████▉| 36239/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.19.up_proj: 99%|█████████▉| 36240/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.19.down_proj: 99%|█████████▉| 36241/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.20.gate_proj: 99%|█████████▉| 36242/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.20.up_proj: 99%|█████████▉| 36243/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.20.down_proj: 99%|█████████▉| 36244/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.21.gate_proj: 99%|█████████▉| 36245/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.21.up_proj: 99%|█████████▉| 36246/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.21.down_proj: 99%|█████████▉| 36247/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.22.gate_proj: 99%|█████████▉| 36248/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.22.up_proj: 99%|█████████▉| 36249/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.22.down_proj: 99%|█████████▉| 36250/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.23.gate_proj: 99%|█████████▉| 36251/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.23.up_proj: 99%|█████████▉| 36252/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.23.down_proj: 99%|█████████▉| 36253/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.24.gate_proj: 99%|█████████▉| 36254/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.24.up_proj: 99%|█████████▉| 36255/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.24.down_proj: 99%|█████████▉| 36256/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.25.gate_proj: 99%|█████████▉| 36257/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.25.up_proj: 99%|█████████▉| 36258/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.25.down_proj: 99%|█████████▉| 36259/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.26.gate_proj: 99%|█████████▉| 36260/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.26.up_proj: 99%|█████████▉| 36261/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.26.down_proj: 99%|█████████▉| 36262/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.27.gate_proj: 99%|█████████▉| 36263/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.27.up_proj: 99%|█████████▉| 36264/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.27.down_proj: 99%|█████████▉| 36265/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.28.gate_proj: 99%|█████████▉| 36266/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.28.up_proj: 99%|█████████▉| 36267/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.28.down_proj: 99%|█████████▉| 36268/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.29.gate_proj: 99%|█████████▉| 36269/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.29.up_proj: 99%|█████████▉| 36270/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.29.down_proj: 99%|█████████▉| 36271/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.30.gate_proj: 99%|█████████▉| 36272/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.30.up_proj: 99%|█████████▉| 36273/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.30.down_proj: 99%|█████████▉| 36274/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.31.gate_proj: 99%|█████████▉| 36275/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.31.up_proj: 99%|█████████▉| 36276/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.31.down_proj: 99%|█████████▉| 36277/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.32.gate_proj: 99%|█████████▉| 36278/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.32.up_proj: 99%|█████████▉| 36279/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.32.down_proj: 99%|█████████▉| 36280/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.33.gate_proj: 99%|█████████▉| 36281/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.33.up_proj: 99%|█████████▉| 36282/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.33.down_proj: 99%|█████████▉| 36283/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.34.gate_proj: 99%|█████████▉| 36284/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.34.up_proj: 99%|█████████▉| 36285/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.34.down_proj: 99%|█████████▉| 36286/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.35.gate_proj: 99%|█████████▉| 36287/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.35.up_proj: 99%|█████████▉| 36288/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.35.down_proj: 99%|█████████▉| 36289/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.36.gate_proj: 99%|█████████▉| 36290/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.36.up_proj: 99%|█████████▉| 36291/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.36.down_proj: 99%|█████████▉| 36292/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.37.gate_proj: 99%|█████████▉| 36293/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.37.up_proj: 99%|█████████▉| 36294/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.37.down_proj: 99%|█████████▉| 36295/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.38.gate_proj: 99%|█████████▉| 36296/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.38.up_proj: 99%|█████████▉| 36297/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.38.down_proj: 99%|█████████▉| 36298/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.39.gate_proj: 99%|█████████▉| 36299/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.39.up_proj: 99%|█████████▉| 36300/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.39.down_proj: 99%|█████████▉| 36301/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.40.gate_proj: 99%|█████████▉| 36302/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.40.up_proj: 99%|█████████▉| 36303/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.40.down_proj: 99%|█████████▉| 36304/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.41.gate_proj: 99%|█████████▉| 36305/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.41.up_proj: 99%|█████████▉| 36306/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.41.down_proj: 99%|█████████▉| 36307/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.42.gate_proj: 99%|█████████▉| 36308/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.42.up_proj: 99%|█████████▉| 36309/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.42.down_proj: 99%|█████████▉| 36310/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.43.gate_proj: 99%|█████████▉| 36311/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.43.up_proj: 99%|█████████▉| 36312/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.43.down_proj: 99%|█████████▉| 36313/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.44.gate_proj: 99%|█████████▉| 36314/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.44.up_proj: 99%|█████████▉| 36315/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.44.down_proj: 99%|█████████▉| 36316/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.45.gate_proj: 99%|█████████▉| 36317/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.45.up_proj: 99%|█████████▉| 36318/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.45.down_proj: 99%|█████████▉| 36319/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.46.gate_proj: 99%|█████████▉| 36320/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.46.up_proj: 99%|█████████▉| 36321/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.46.down_proj: 99%|█████████▉| 36322/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.47.gate_proj: 99%|█████████▉| 36323/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.47.up_proj: 99%|█████████▉| 36324/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.47.down_proj: 99%|█████████▉| 36325/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.48.gate_proj: 99%|█████████▉| 36326/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.48.up_proj: 99%|█████████▉| 36327/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.48.down_proj: 99%|█████████▉| 36328/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.49.gate_proj: 99%|█████████▉| 36329/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.49.up_proj: 99%|█████████▉| 36330/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.49.down_proj: 99%|█████████▉| 36331/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.50.gate_proj: 99%|█████████▉| 36332/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.50.up_proj: 99%|█████████▉| 36333/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.50.down_proj: 99%|█████████▉| 36334/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.51.gate_proj: 99%|█████████▉| 36335/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.51.up_proj: 99%|█████████▉| 36336/36566 [00:32<00:00, 1171.04it/s] packing model.layers.93.mlp.experts.51.up_proj: 99%|█████████▉| 36337/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.51.down_proj: 99%|█████████▉| 36337/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.52.gate_proj: 99%|█████████▉| 36338/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.52.up_proj: 99%|█████████▉| 36339/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.52.down_proj: 99%|█████████▉| 36340/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.53.gate_proj: 99%|█████████▉| 36341/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.53.up_proj: 99%|█████████▉| 36342/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.53.down_proj: 99%|█████████▉| 36343/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.54.gate_proj: 99%|█████████▉| 36344/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.54.up_proj: 99%|█████████▉| 36345/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.54.down_proj: 99%|█████████▉| 36346/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.55.gate_proj: 99%|█████████▉| 36347/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.55.up_proj: 99%|█████████▉| 36348/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.55.down_proj: 99%|█████████▉| 36349/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.56.gate_proj: 99%|█████████▉| 36350/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.56.up_proj: 99%|█████████▉| 36351/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.56.down_proj: 99%|█████████▉| 36352/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.57.gate_proj: 99%|█████████▉| 36353/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.57.up_proj: 99%|█████████▉| 36354/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.57.down_proj: 99%|█████████▉| 36355/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.58.gate_proj: 99%|█████████▉| 36356/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.58.up_proj: 99%|█████████▉| 36357/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.58.down_proj: 99%|█████████▉| 36358/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.59.gate_proj: 99%|█████████▉| 36359/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.59.up_proj: 99%|█████████▉| 36360/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.59.down_proj: 99%|█████████▉| 36361/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.60.gate_proj: 99%|█████████▉| 36362/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.60.up_proj: 99%|█████████▉| 36363/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.60.down_proj: 99%|█████████▉| 36364/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.61.gate_proj: 99%|█████████▉| 36365/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.61.up_proj: 99%|█████████▉| 36366/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.61.down_proj: 99%|█████████▉| 36367/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.62.gate_proj: 99%|█████████▉| 36368/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.62.up_proj: 99%|█████████▉| 36369/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.62.down_proj: 99%|█████████▉| 36370/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.63.gate_proj: 99%|█████████▉| 36371/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.63.up_proj: 99%|█████████▉| 36372/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.63.down_proj: 99%|█████████▉| 36373/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.64.gate_proj: 99%|█████████▉| 36374/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.64.up_proj: 99%|█████████▉| 36375/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.64.down_proj: 99%|█████████▉| 36376/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.65.gate_proj: 99%|█████████▉| 36377/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.65.up_proj: 99%|█████████▉| 36378/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.65.down_proj: 99%|█████████▉| 36379/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.66.gate_proj: 99%|█████████▉| 36380/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.66.up_proj: 99%|█████████▉| 36381/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.66.down_proj: 99%|█████████▉| 36382/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.67.gate_proj: 99%|█████████▉| 36383/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.67.up_proj: 100%|█████████▉| 36384/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.67.down_proj: 100%|█████████▉| 36385/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.68.gate_proj: 100%|█████████▉| 36386/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.68.up_proj: 100%|█████████▉| 36387/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.68.down_proj: 100%|█████████▉| 36388/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.69.gate_proj: 100%|█████████▉| 36389/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.69.up_proj: 100%|█████████▉| 36390/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.69.down_proj: 100%|█████████▉| 36391/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.70.gate_proj: 100%|█████████▉| 36392/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.70.up_proj: 100%|█████████▉| 36393/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.70.down_proj: 100%|█████████▉| 36394/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.71.gate_proj: 100%|█████████▉| 36395/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.71.up_proj: 100%|█████████▉| 36396/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.71.down_proj: 100%|█████████▉| 36397/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.72.gate_proj: 100%|█████████▉| 36398/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.72.up_proj: 100%|█████████▉| 36399/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.72.down_proj: 100%|█████████▉| 36400/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.73.gate_proj: 100%|█████████▉| 36401/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.73.up_proj: 100%|█████████▉| 36402/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.73.down_proj: 100%|█████████▉| 36403/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.74.gate_proj: 100%|█████████▉| 36404/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.74.up_proj: 100%|█████████▉| 36405/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.74.down_proj: 100%|█████████▉| 36406/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.75.gate_proj: 100%|█████████▉| 36407/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.75.up_proj: 100%|█████████▉| 36408/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.75.down_proj: 100%|█████████▉| 36409/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.76.gate_proj: 100%|█████████▉| 36410/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.76.up_proj: 100%|█████████▉| 36411/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.76.down_proj: 100%|█████████▉| 36412/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.77.gate_proj: 100%|█████████▉| 36413/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.77.up_proj: 100%|█████████▉| 36414/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.77.down_proj: 100%|█████████▉| 36415/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.78.gate_proj: 100%|█████████▉| 36416/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.78.up_proj: 100%|█████████▉| 36417/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.78.down_proj: 100%|█████████▉| 36418/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.79.gate_proj: 100%|█████████▉| 36419/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.79.up_proj: 100%|█████████▉| 36420/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.79.down_proj: 100%|█████████▉| 36421/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.80.gate_proj: 100%|█████████▉| 36422/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.80.up_proj: 100%|█████████▉| 36423/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.80.down_proj: 100%|█████████▉| 36424/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.81.gate_proj: 100%|█████████▉| 36425/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.81.up_proj: 100%|█████████▉| 36426/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.81.down_proj: 100%|█████████▉| 36427/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.82.gate_proj: 100%|█████████▉| 36428/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.82.up_proj: 100%|█████████▉| 36429/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.82.down_proj: 100%|█████████▉| 36430/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.83.gate_proj: 100%|█████████▉| 36431/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.83.up_proj: 100%|█████████▉| 36432/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.83.down_proj: 100%|█████████▉| 36433/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.84.gate_proj: 100%|█████████▉| 36434/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.84.up_proj: 100%|█████████▉| 36435/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.84.down_proj: 100%|█████████▉| 36436/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.85.gate_proj: 100%|█████████▉| 36437/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.85.up_proj: 100%|█████████▉| 36438/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.85.down_proj: 100%|█████████▉| 36439/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.86.gate_proj: 100%|█████████▉| 36440/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.86.up_proj: 100%|█████████▉| 36441/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.86.down_proj: 100%|█████████▉| 36442/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.87.gate_proj: 100%|█████████▉| 36443/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.87.up_proj: 100%|█████████▉| 36444/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.87.down_proj: 100%|█████████▉| 36445/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.88.gate_proj: 100%|█████████▉| 36446/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.88.up_proj: 100%|█████████▉| 36447/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.88.down_proj: 100%|█████████▉| 36448/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.89.gate_proj: 100%|█████████▉| 36449/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.89.up_proj: 100%|█████████▉| 36450/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.89.down_proj: 100%|█████████▉| 36451/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.90.gate_proj: 100%|█████████▉| 36452/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.90.up_proj: 100%|█████████▉| 36453/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.90.down_proj: 100%|█████████▉| 36454/36566 [00:32<00:00, 1172.61it/s] packing model.layers.93.mlp.experts.90.down_proj: 100%|█████████▉| 36455/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.91.gate_proj: 100%|█████████▉| 36455/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.91.up_proj: 100%|█████████▉| 36456/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.91.down_proj: 100%|█████████▉| 36457/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.92.gate_proj: 100%|█████████▉| 36458/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.92.up_proj: 100%|█████████▉| 36459/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.92.down_proj: 100%|█████████▉| 36460/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.93.gate_proj: 100%|█████████▉| 36461/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.93.up_proj: 100%|█████████▉| 36462/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.93.down_proj: 100%|█████████▉| 36463/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.94.gate_proj: 100%|█████████▉| 36464/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.94.up_proj: 100%|█████████▉| 36465/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.94.down_proj: 100%|█████████▉| 36466/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.95.gate_proj: 100%|█████████▉| 36467/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.95.up_proj: 100%|█████████▉| 36468/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.95.down_proj: 100%|█████████▉| 36469/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.96.gate_proj: 100%|█████████▉| 36470/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.96.up_proj: 100%|█████████▉| 36471/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.96.down_proj: 100%|█████████▉| 36472/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.97.gate_proj: 100%|█████████▉| 36473/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.97.up_proj: 100%|█████████▉| 36474/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.97.down_proj: 100%|█████████▉| 36475/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.98.gate_proj: 100%|█████████▉| 36476/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.98.up_proj: 100%|█████████▉| 36477/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.98.down_proj: 100%|█████████▉| 36478/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.99.gate_proj: 100%|█████████▉| 36479/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.99.up_proj: 100%|█████████▉| 36480/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.99.down_proj: 100%|█████████▉| 36481/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.100.gate_proj: 100%|█████████▉| 36482/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.100.up_proj: 100%|█████████▉| 36483/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.100.down_proj: 100%|█████████▉| 36484/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.101.gate_proj: 100%|█████████▉| 36485/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.101.up_proj: 100%|█████████▉| 36486/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.101.down_proj: 100%|█████████▉| 36487/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.102.gate_proj: 100%|█████████▉| 36488/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.102.up_proj: 100%|█████████▉| 36489/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.102.down_proj: 100%|█████████▉| 36490/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.103.gate_proj: 100%|█████████▉| 36491/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.103.up_proj: 100%|█████████▉| 36492/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.103.down_proj: 100%|█████████▉| 36493/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.104.gate_proj: 100%|█████████▉| 36494/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.104.up_proj: 100%|█████████▉| 36495/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.104.down_proj: 100%|█████████▉| 36496/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.105.gate_proj: 100%|█████████▉| 36497/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.105.up_proj: 100%|█████████▉| 36498/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.105.down_proj: 100%|█████████▉| 36499/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.106.gate_proj: 100%|█████████▉| 36500/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.106.up_proj: 100%|█████████▉| 36501/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.106.down_proj: 100%|█████████▉| 36502/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.107.gate_proj: 100%|█████████▉| 36503/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.107.up_proj: 100%|█████████▉| 36504/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.107.down_proj: 100%|█████████▉| 36505/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.108.gate_proj: 100%|█████████▉| 36506/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.108.up_proj: 100%|█████████▉| 36507/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.108.down_proj: 100%|█████████▉| 36508/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.109.gate_proj: 100%|█████████▉| 36509/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.109.up_proj: 100%|█████████▉| 36510/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.109.down_proj: 100%|█████████▉| 36511/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.110.gate_proj: 100%|█████████▉| 36512/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.110.up_proj: 100%|█████████▉| 36513/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.110.down_proj: 100%|█████████▉| 36514/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.111.gate_proj: 100%|█████████▉| 36515/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.111.up_proj: 100%|█████████▉| 36516/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.111.down_proj: 100%|█████████▉| 36517/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.112.gate_proj: 100%|█████████▉| 36518/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.112.up_proj: 100%|█████████▉| 36519/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.112.down_proj: 100%|█████████▉| 36520/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.113.gate_proj: 100%|█████████▉| 36521/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.113.up_proj: 100%|█████████▉| 36522/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.113.down_proj: 100%|█████████▉| 36523/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.114.gate_proj: 100%|█████████▉| 36524/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.114.up_proj: 100%|█████████▉| 36525/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.114.down_proj: 100%|█████████▉| 36526/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.115.gate_proj: 100%|█████████▉| 36527/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.115.up_proj: 100%|█████████▉| 36528/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.115.down_proj: 100%|█████████▉| 36529/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.116.gate_proj: 100%|█████████▉| 36530/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.116.up_proj: 100%|█████████▉| 36531/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.116.down_proj: 100%|█████████▉| 36532/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.117.gate_proj: 100%|█████████▉| 36533/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.117.up_proj: 100%|█████████▉| 36534/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.117.down_proj: 100%|█████████▉| 36535/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.118.gate_proj: 100%|█████████▉| 36536/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.118.up_proj: 100%|█████████▉| 36537/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.118.down_proj: 100%|█████████▉| 36538/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.119.gate_proj: 100%|█████████▉| 36539/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.119.up_proj: 100%|█████████▉| 36540/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.119.down_proj: 100%|█████████▉| 36541/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.120.gate_proj: 100%|█████████▉| 36542/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.120.up_proj: 100%|█████████▉| 36543/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.120.down_proj: 100%|█████████▉| 36544/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.121.gate_proj: 100%|█████████▉| 36545/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.121.up_proj: 100%|█████████▉| 36546/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.121.down_proj: 100%|█████████▉| 36547/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.122.gate_proj: 100%|█████████▉| 36548/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.122.up_proj: 100%|█████████▉| 36549/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.122.down_proj: 100%|█████████▉| 36550/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.123.gate_proj: 100%|█████████▉| 36551/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.123.up_proj: 100%|█████████▉| 36552/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.123.down_proj: 100%|█████████▉| 36553/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.124.gate_proj: 100%|█████████▉| 36554/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.124.up_proj: 100%|█████████▉| 36555/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.124.down_proj: 100%|█████████▉| 36556/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.125.gate_proj: 100%|█████████▉| 36557/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.125.up_proj: 100%|█████████▉| 36558/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.125.down_proj: 100%|█████████▉| 36559/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.126.gate_proj: 100%|█████████▉| 36560/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.126.up_proj: 100%|█████████▉| 36561/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.126.down_proj: 100%|█████████▉| 36562/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.127.gate_proj: 100%|█████████▉| 36563/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.127.up_proj: 100%|█████████▉| 36564/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.127.down_proj: 100%|█████████▉| 36565/36566 [00:32<00:00, 1171.41it/s] packing model.layers.93.mlp.experts.127.down_proj: 100%|██████████| 36566/36566 [00:32<00:00, 1122.68it/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Checking if ChaiML/Qwen3-235B-A22B-Instruct-2507-W4A16 already exists in ChaiML
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Creating repo ChaiML/Qwen3-235B-A22B-Instruct-2507-W4A16 and uploading /dev/shm/model_output to it
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Recovering from metadata files: 0%| | 0/38 [00:00<?, ?it/s] Recovering from metadata files: 100%|██████████| 38/38 [00:00<00:00, 8440.14it/s]
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ---------- 2026-02-05 16:22:37 (0:00:00) ----------
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Files: hashed 11/38 (26.1M/131.9G) | pre-uploaded: 0/1 (0.0/131.9G) (+27 unsure) | committed: 0/38 (0.0/131.9G) | ignored: 0
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Workers: hashing: 27 | get upload mode: 0 | pre-uploading: 1 | committing: 0 | waiting: 98
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ---------------------------------------------------
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Processing Files (0 / 0) : | | 0.00B / 0.00B
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : | | 0.00B / 0.00B 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB  Processing Files (1 / 1) : 100%|██████████| 11.4MB / 11.4MB, 19.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB  Processing Files (1 / 1) : 100%|██████████| 11.4MB / 11.4MB, 11.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : | | 0.00B / 0.00B, 0.00B/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB
qwen-qwen3-235b-a22b-i-47730-v23-uploader: Processing Files (0 / 0) : | | 0.00B / 0.00B
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : | | 0.00B / 0.00B 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 0%| | 73.3kB / 1.93GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 0%| | 73.3kB / 1.93GB  Processing Files (0 / 1) : 0%| | 73.3kB / 1.93GB, ???B/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 2%|▏ | 42.2MB / 1.93GB  Processing Files (0 / 1) : 2%|▏ | 42.2MB / 1.93GB, 211MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 63%|██████▎ | 42.1MB / 67.1MB, 211MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 5%|▌ | 102MB / 1.93GB  Processing Files (0 / 1) : 5%|▌ | 102MB / 1.93GB, 254MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 76%|███████▌ | 102MB / 134MB, 254MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 10%|█ | 196MB / 1.93GB  Processing Files (0 / 1) : 10%|█ | 196MB / 1.93GB, 326MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 195MB / 201MB, 326MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 13%|█▎ | 255MB / 1.93GB  Processing Files (0 / 1) : 13%|█▎ | 255MB / 1.93GB, 319MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 255MB / 268MB, 319MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 15%|█▍ | 281MB / 1.93GB  Processing Files (0 / 1) : 15%|█▍ | 281MB / 1.93GB, 281MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 84%|████████▍ | 281MB / 335MB, 281MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 20%|█▉ | 380MB / 1.93GB  Processing Files (0 / 1) : 20%|█▉ | 380MB / 1.93GB, 317MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 380MB / 402MB, 317MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 21%|██ | 404MB / 1.93GB  Processing Files (0 / 1) : 21%|██ | 404MB / 1.93GB, 289MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 86%|████████▌ | 404MB / 469MB, 289MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 25%|██▌ | 487MB / 1.93GB  Processing Files (0 / 1) : 25%|██▌ | 487MB / 1.93GB, 304MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 91%|█████████ | 487MB / 536MB, 304MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 28%|██▊ | 535MB / 1.93GB  Processing Files (0 / 1) : 28%|██▊ | 535MB / 1.93GB, 297MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 89%|████████▊ | 535MB / 603MB, 297MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 31%|███ | 602MB / 1.93GB  Processing Files (0 / 1) : 31%|███ | 602MB / 1.93GB, 301MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 90%|████████▉ | 602MB / 671MB, 301MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 35%|███▍ | 669MB / 1.93GB  Processing Files (0 / 1) : 35%|███▍ | 669MB / 1.93GB, 304MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 669MB / 671MB, 304MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 35%|███▍ | 670MB / 1.93GB  Processing Files (0 / 1) : 35%|███▍ | 670MB / 1.93GB, 279MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 670MB / 671MB, 279MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 38%|███▊ | 737MB / 1.93GB  Processing Files (0 / 1) : 38%|███▊ | 737MB / 1.93GB, 283MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 670MB / 671MB, 258MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 42%|████▏ | 813MB / 1.93GB  Processing Files (0 / 1) : 42%|████▏ | 813MB / 1.93GB, 290MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 670MB / 671MB, 239MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 46%|████▌ | 888MB / 1.93GB  Processing Files (0 / 1) : 46%|████▌ | 888MB / 1.93GB, 296MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 50%|████▉ | 964MB / 1.93GB  Processing Files (0 / 1) : 50%|████▉ | 964MB / 1.93GB, 301MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|██████████| 671MB / 671MB, 210MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0027-of-00027.safetensors: 54%|█████▍ | 1.04GB / 1.93GB  Processing Files (0 / 1) : 54%|█████▍ | 1.04GB / 1.93GB, 306MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 19%|█▉ | 949MB / 4.98GB  Processing Files (0 / 1) : 19%|█▉ | 949MB / 4.98GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 939MB / 1.01GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB  Processing Files (0 / 1) : 16%|█▌ | 805MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 805MB / 872MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 14%|█▎ | 683MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 14%|█▎ | 684MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 13%|█▎ | 671MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 14%|█▎ | 685MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 15%|█▍ | 738MB / 5.00GB  Processing Files (0 / 1) : 15%|█▍ | 738MB / 5.00GB, 59.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 738MB / 805MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 18%|█▊ | 875MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 875MB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 871MB / 939MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 19%|█▉ | 949MB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 14%|█▎ | 683MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 14%|█▎ | 684MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 13%|█▎ | 671MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 15%|█▌ | 758MB / 5.00GB  Processing Files (0 / 1) : 15%|█▌ | 758MB / 5.00GB, 61.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 737MB / 738MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB  Processing Files (0 / 1) : 16%|█▌ | 805MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 805MB / 872MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 18%|█▊ | 876MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 876MB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 871MB / 939MB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 19%|█▉ | 949MB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 14%|█▎ | 683MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 14%|█▎ | 684MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 13%|█▎ | 671MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 15%|█▌ | 758MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 18%|█▊ | 876MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 19%|█▉ | 949MB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 15%|█▌ | 751MB / 5.00GB  Processing Files (0 / 1) : 15%|█▌ | 751MB / 5.00GB, 67.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 737MB / 738MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 14%|█▎ | 684MB / 5.00GB  Processing Files (0 / 1) : 14%|█▎ | 684MB / 5.00GB, 60.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 91%|█████████ | 671MB / 738MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 13%|█▎ | 671MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 15%|█▌ | 758MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 18%|█▊ | 876MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 19%|█▉ | 950MB / 4.98GB  Processing Files (0 / 1) : 19%|█▉ | 950MB / 4.98GB, 60.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 939MB / 1.01GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB  Processing Files (0 / 1) : 16%|█▌ | 805MB / 5.00GB, 59.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 805MB / 872MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 15%|█▌ | 752MB / 5.00GB  Processing Files (0 / 1) : 15%|█▌ | 752MB / 5.00GB, 67.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 15%|█▌ | 753MB / 5.00GB  Processing Files (0 / 1) : 15%|█▌ | 753MB / 5.00GB, 67.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 737MB / 805MB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 15%|█▍ | 738MB / 5.00GB  Processing Files (0 / 1) : 15%|█▍ | 738MB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 737MB / 738MB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 15%|█▌ | 758MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 18%|█▊ | 876MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 20%|██ | 1.02GB / 4.98GB  Processing Files (0 / 1) : 20%|██ | 1.02GB / 4.98GB, 66.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB  Processing Files (0 / 1) : 17%|█▋ | 872MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 871MB / 939MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 15%|█▌ | 752MB / 5.00GB  Processing Files (0 / 1) : 15%|█▌ | 752MB / 5.00GB, 67.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 737MB / 805MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 15%|█▌ | 753MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 15%|█▍ | 738MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 15%|█▌ | 758MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB  Processing Files (0 / 1) : 17%|█▋ | 872MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 871MB / 872MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 19%|█▉ | 943MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 943MB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 938MB / 939MB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 20%|██ | 1.02GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 15%|█▌ | 752MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 15%|█▌ | 753MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 15%|█▍ | 738MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 17%|█▋ | 836MB / 5.00GB  Processing Files (0 / 1) : 17%|█▋ | 836MB / 5.00GB, 62.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 804MB / 872MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 19%|█▉ | 943MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 20%|██ | 1.02GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 15%|█▌ | 752MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 15%|█▌ | 753MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 15%|█▍ | 738MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 17%|█▋ | 836MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 19%|█▉ | 943MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 20%|██ | 1.02GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 16%|█▋ | 821MB / 5.00GB  Processing Files (0 / 1) : 16%|█▋ | 821MB / 5.00GB, 67.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 805MB / 872MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 16%|█▋ | 821MB / 5.00GB  Processing Files (0 / 1) : 16%|█▋ | 821MB / 5.00GB, 67.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 804MB / 805MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 15%|█▍ | 738MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 17%|█▋ | 836MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 19%|█▉ | 943MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 22%|██▏ | 1.08GB / 4.98GB  Processing Files (0 / 1) : 22%|██▏ | 1.08GB / 4.98GB, 66.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 1.05GB / 1.07GB, 63.9MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 16%|█▋ | 821MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 16%|█▋ | 822MB / 5.00GB  Processing Files (0 / 1) : 16%|█▋ | 822MB / 5.00GB, 67.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB  Processing Files (0 / 1) : 16%|█▌ | 805MB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 805MB / 872MB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 17%|█▋ | 836MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 19%|█▉ | 943MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 22%|██▏ | 1.10GB / 4.98GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 4.98GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 939MB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 939MB / 1.01GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 16%|█▋ | 821MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 16%|█▋ | 822MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 18%|█▊ | 908MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 908MB / 5.00GB, 62.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 872MB / 872MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 939MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 938MB / 1.01GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB  Processing Files (0 / 1) : 20%|██ | 1.01GB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 22%|██▏ | 1.10GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 16%|█▋ | 821MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 16%|█▋ | 822MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 18%|█▊ | 909MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 909MB / 5.00GB, 62.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 22%|██▏ | 1.10GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 18%|█▊ | 888MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 888MB / 5.00GB, 67.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 871MB / 872MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 16%|█▋ | 822MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 18%|█▊ | 909MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 22%|██▏ | 1.10GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 18%|█▊ | 888MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 888MB / 5.00GB, 67.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 16%|█▋ | 822MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 16%|█▌ | 805MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 18%|█▊ | 909MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 22%|██▏ | 1.10GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 18%|█▊ | 888MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 18%|█▊ | 891MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 891MB / 5.00GB, 67.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 871MB / 939MB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB  Processing Files (0 / 1) : 17%|█▋ | 872MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 871MB / 939MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 18%|█▊ | 909MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 939MB / 5.00GB, 59.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 939MB / 1.01GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 23%|██▎ | 1.16GB / 4.98GB  Processing Files (0 / 1) : 23%|██▎ | 1.16GB / 4.98GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB  Processing Files (0 / 1) : 20%|██ | 1.01GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▎| 1.01GB / 1.07GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 18%|█▊ | 888MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 18%|█▊ | 891MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 18%|█▊ | 909MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 909MB / 5.00GB, 62.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 872MB / 939MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB  Processing Files (0 / 1) : 20%|██ | 1.01GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.01GB / 1.01GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 22%|██▏ | 1.08GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.08GB / 5.00GB, 66.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 23%|██▎ | 1.16GB / 4.98GB  Processing Files (0 / 1) : 23%|██▎ | 1.16GB / 4.98GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 18%|█▊ | 888MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 18%|█▊ | 891MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 20%|█▉ | 978MB / 5.00GB  Processing Files (0 / 1) : 20%|█▉ | 978MB / 5.00GB, 69.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 938MB / 1.01GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 22%|██▏ | 1.08GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 23%|██▎ | 1.16GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 19%|█▉ | 964MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 964MB / 5.00GB, 68.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 938MB / 939MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 18%|█▊ | 891MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 20%|█▉ | 978MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 22%|██▏ | 1.08GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 23%|██▎ | 1.16GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 19%|█▉ | 965MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 965MB / 5.00GB, 68.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 18%|█▊ | 891MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 17%|█▋ | 872MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 20%|█▉ | 978MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 22%|██▏ | 1.08GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 23%|██▎ | 1.16GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 19%|█▉ | 965MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 19%|█▉ | 961MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 961MB / 5.00GB, 67.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 939MB / 1.01GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 19%|█▉ | 938MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 938MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 938MB / 939MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 20%|█▉ | 978MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 22%|██▏ | 1.08GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.08GB / 5.00GB, 59.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 25%|██▍ | 1.23GB / 4.98GB  Processing Files (0 / 1) : 25%|██▍ | 1.23GB / 4.98GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.21GB / 1.21GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB  Processing Files (0 / 1) : 21%|██▏ | 1.07GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 19%|█▉ | 965MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 19%|█▉ | 961MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 939MB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 938MB / 1.01GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 21%|██ | 1.05GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.05GB / 5.00GB, 76.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.01GB / 1.01GB, 72.3MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB  Processing Files (0 / 1) : 21%|██▏ | 1.07GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 23%|██▎ | 1.15GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.15GB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.14GB / 1.14GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 25%|██▍ | 1.23GB / 4.98GB  Processing Files (0 / 1) : 25%|██▍ | 1.23GB / 4.98GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 19%|█▉ | 965MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 19%|█▉ | 961MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 21%|██ | 1.05GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.05GB / 5.00GB, 69.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 23%|██▎ | 1.15GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.15GB / 5.00GB, 66.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 25%|██▍ | 1.23GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 19%|█▉ | 965MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 19%|█▉ | 961MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 21%|██ | 1.05GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 23%|██▎ | 1.15GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 25%|██▍ | 1.23GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.03GB / 5.00GB, 68.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.01GB / 1.01GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.03GB / 5.00GB, 67.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.01GB / 1.01GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 19%|█▉ | 939MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 21%|██ | 1.05GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 23%|██▎ | 1.15GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 25%|██▍ | 1.23GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 5.00GB, 62.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 1.10GB / 1.14GB, 62.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.03GB / 5.00GB, 68.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.03GB / 5.00GB, 67.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB  Processing Files (0 / 1) : 20%|██ | 1.01GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▎| 1.01GB / 1.07GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 21%|██ | 1.05GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 23%|██▎ | 1.15GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 26%|██▌ | 1.27GB / 4.98GB  Processing Files (0 / 1) : 26%|██▌ | 1.27GB / 4.98GB, 65.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 1.25GB / 1.27GB, 63.4MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.14GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 21%|██ | 1.05GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.05GB / 5.00GB, 69.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.14GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 66.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.21GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 26%|██▌ | 1.30GB / 4.98GB  Processing Files (0 / 1) : 26%|██▌ | 1.30GB / 4.98GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.27GB / 1.34GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 22%|██▏ | 1.12GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.12GB / 5.00GB, 69.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 66.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 26%|██▌ | 1.30GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 22%|██▏ | 1.08GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.08GB / 5.00GB, 65.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 1.05GB / 1.07GB, 63.4MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 20%|██ | 1.01GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 22%|██▏ | 1.12GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 26%|██▌ | 1.30GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 5.00GB, 68.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 5.00GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.07GB / 1.07GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB  Processing Files (0 / 1) : 21%|██▏ | 1.07GB / 5.00GB, 65.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.07GB / 1.07GB, 65.5MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 22%|██▏ | 1.12GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 26%|██▌ | 1.30GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB  Processing Files (0 / 1) : 21%|██▏ | 1.07GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 22%|██▏ | 1.12GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 26%|██▌ | 1.30GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 22%|██▏ | 1.12GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 24%|██▍ | 1.20GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.20GB / 5.00GB, 66.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 99%|█████████▉| 1.19GB / 1.21GB, 66.5MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 27%|██▋ | 1.37GB / 4.98GB  Processing Files (0 / 1) : 27%|██▋ | 1.37GB / 4.98GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.34GB / 1.34GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 22%|██▏ | 1.12GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.12GB / 5.00GB, 64.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 60.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 27%|██▋ | 1.37GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 5.00GB, 61.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 5.00GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 24%|██▎ | 1.19GB / 5.00GB  Processing Files (0 / 1) : 24%|██▎ | 1.19GB / 5.00GB, 69.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 26%|██▌ | 1.28GB / 5.00GB  Processing Files (0 / 1) : 26%|██▌ | 1.28GB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.27GB / 1.34GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 27%|██▋ | 1.37GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.17GB / 5.00GB, 68.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 24%|██▎ | 1.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 26%|██▌ | 1.28GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 27%|██▋ | 1.37GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 21%|██▏ | 1.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 24%|██▎ | 1.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 26%|██▌ | 1.28GB / 5.00GB  Processing Files (0 / 1) : 26%|██▌ | 1.28GB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.27GB / 1.34GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 27%|██▋ | 1.37GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 59.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.17GB / 5.00GB, 68.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.14GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.14GB / 1.14GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 24%|██▎ | 1.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 26%|██▌ | 1.28GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 27%|██▋ | 1.37GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB  Processing Files (0 / 1) : 25%|██▌ | 1.27GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.27GB / 1.27GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 24%|██▎ | 1.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 59.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 26%|██▌ | 1.28GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 29%|██▉ | 1.44GB / 4.98GB  Processing Files (0 / 1) : 29%|██▉ | 1.44GB / 4.98GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.41GB / 1.48GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.17GB / 5.00GB, 68.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 24%|██▎ | 1.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB  Processing Files (0 / 1) : 25%|██▌ | 1.27GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.27GB / 1.34GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 26%|██▌ | 1.28GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 29%|██▉ | 1.44GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 25%|██▌ | 1.26GB / 5.00GB  Processing Files (0 / 1) : 25%|██▌ | 1.26GB / 5.00GB, 69.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 26%|██▌ | 1.28GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 29%|██▉ | 1.44GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.17GB / 5.00GB, 61.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 23%|██▎ | 1.14GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.14GB / 5.00GB, 59.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 25%|██▌ | 1.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 27%|██▋ | 1.35GB / 5.00GB  Processing Files (0 / 1) : 27%|██▋ | 1.35GB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.34GB / 1.41GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 29%|██▉ | 1.44GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 26%|██▌ | 1.27GB / 5.00GB  Processing Files (0 / 1) : 26%|██▌ | 1.27GB / 5.00GB, 59.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.27GB / 1.34GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB  Processing Files (0 / 1) : 25%|██▍ | 1.24GB / 5.00GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB  Processing Files (0 / 1) : 25%|██▍ | 1.24GB / 5.00GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.21GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.21GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 25%|██▌ | 1.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 27%|██▋ | 1.35GB / 5.00GB  Processing Files (0 / 1) : 27%|██▋ | 1.35GB / 5.00GB, 59.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.34GB / 1.41GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 29%|██▉ | 1.44GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 26%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 25%|██▌ | 1.26GB / 5.00GB  Processing Files (0 / 1) : 25%|██▌ | 1.26GB / 5.00GB, 69.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB  Processing Files (0 / 1) : 27%|██▋ | 1.34GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.34GB / 1.34GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 27%|██▋ | 1.35GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 30%|███ | 1.51GB / 4.98GB  Processing Files (0 / 1) : 30%|███ | 1.51GB / 4.98GB, 68.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 96%|█████████▌| 1.47GB / 1.54GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB  Processing Files (0 / 1) : 27%|██▋ | 1.34GB / 5.00GB, 65.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.34GB / 1.41GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 25%|██▌ | 1.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 27%|██▋ | 1.35GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 30%|███ | 1.51GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 25%|██▌ | 1.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 27%|██▋ | 1.35GB / 5.00GB  Processing Files (0 / 1) : 27%|██▋ | 1.35GB / 5.00GB, 59.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.34GB / 1.41GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 30%|███ | 1.51GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB  Processing Files (0 / 1) : 26%|██▌ | 1.31GB / 5.00GB, 67.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.27GB / 1.27GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 25%|██▍ | 1.24GB / 5.00GB  Processing Files (0 / 1) : 25%|██▍ | 1.24GB / 5.00GB, 61.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 26%|██▋ | 1.32GB / 5.00GB  Processing Files (0 / 1) : 26%|██▋ | 1.32GB / 5.00GB, 69.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.27GB / 1.27GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 28%|██▊ | 1.42GB / 5.00GB  Processing Files (0 / 1) : 28%|██▊ | 1.42GB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.41GB / 1.41GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 30%|███ | 1.51GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB  Processing Files (0 / 1) : 26%|██▌ | 1.31GB / 5.00GB, 67.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB  Processing Files (0 / 1) : 26%|██▌ | 1.31GB / 5.00GB, 67.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.27GB / 1.34GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 24%|██▍ | 1.21GB / 5.00GB  Processing Files (0 / 1) : 24%|██▍ | 1.21GB / 5.00GB, 59.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.21GB / 1.27GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB  Processing Files (0 / 1) : 27%|██▋ | 1.34GB / 5.00GB, 70.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 28%|██▊ | 1.42GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 30%|███ | 1.51GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB  Processing Files (0 / 1) : 27%|██▋ | 1.34GB / 5.00GB, 59.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.34GB / 1.41GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB  Processing Files (0 / 1) : 25%|██▌ | 1.27GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▍| 1.27GB / 1.34GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 28%|██▊ | 1.42GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 32%|███▏ | 1.57GB / 4.98GB  Processing Files (0 / 1) : 32%|███▏ | 1.57GB / 4.98GB, 68.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 96%|█████████▌| 1.54GB / 1.61GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 28%|██▊ | 1.42GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 32%|███▏ | 1.57GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 28%|██▊ | 1.42GB / 5.00GB  Processing Files (0 / 1) : 28%|██▊ | 1.42GB / 5.00GB, 59.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.41GB / 1.48GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0011-of-00027.safetensors: 32%|███▏ | 1.57GB / 4.98GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0017-of-00027.safetensors: 28%|██▊ | 1.41GB / 5.00GB  Processing Files (0 / 1) : 28%|██▊ | 1.41GB / 5.00GB, 66.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.41GB / 1.48GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0009-of-00027.safetensors: 28%|██▊ | 1.38GB / 5.00GB  Processing Files (0 / 1) : 28%|██▊ | 1.38GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.34GB / 1.34GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0005-of-00027.safetensors: 26%|██▌ | 1.31GB / 5.00GB  Processing Files (0 / 1) : 26%|██▌ | 1.31GB / 5.00GB, 67.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.27GB / 1.34GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0014-of-00027.safetensors: 25%|██▌ | 1.27GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0008-of-00027.safetensors: 27%|██▋ | 1.34GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0021-of-00027.safetensors: 28%|██▊ | 1.41GB / 5.00GB  Processing Files (0 / 1) : 28%|██▊ | 1.41GB / 5.00GB, 65.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 95%|█████████▌| 1.41GB / 1.48GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0020-of-00027.safetensors: 28%|██▊ | 1.42GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 52%|█████▏ | 2.60GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 52%|█████▏ | 2.59GB / 5.00GB  Processing Files (0 / 1) : 52%|█████▏ | 2.59GB / 5.00GB, 67.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.48GB / 2.55GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 48%|████▊ | 2.42GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 53%|█████▎ | 2.63GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.63GB / 5.00GB, 67.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.48GB / 2.48GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 10%|▉ | 487MB / 5.00GB  Processing Files (0 / 1) : 10%|▉ | 487MB / 5.00GB, 47.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 88%|████████▊ | 469MB / 536MB, 46.0MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▋ | 2.82GB / 5.00GB, 68.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.62GB / 2.68GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 52%|█████▏ | 2.60GB / 5.00GB  Processing Files (0 / 1) : 52%|█████▏ | 2.60GB / 5.00GB, 63.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.48GB / 2.55GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 52%|█████▏ | 2.59GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 53%|█████▎ | 2.64GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 48%|████▊ | 2.42GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.64GB / 5.00GB, 69.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 10%|▉ | 487MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 52%|█████▏ | 2.60GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 52%|█████▏ | 2.59GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 53%|█████▎ | 2.64GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 48%|████▊ | 2.42GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.64GB / 5.00GB, 62.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.48GB / 2.55GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 11%|█ | 554MB / 5.00GB  Processing Files (0 / 1) : 11%|█ | 554MB / 5.00GB, 54.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 536MB / 536MB, 52.5MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.90GB / 5.00GB, 70.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.75GB / 2.75GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 52%|█████▏ | 2.60GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 52%|█████▏ | 2.59GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 48%|████▊ | 2.42GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 53%|█████▎ | 2.64GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 11%|█ | 554MB / 5.00GB  Processing Files (0 / 1) : 11%|█ | 554MB / 5.00GB, 54.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.90GB / 5.00GB, 63.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.66GB / 5.00GB, 63.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.55GB / 2.55GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 52%|█████▏ | 2.59GB / 5.00GB  Processing Files (0 / 1) : 52%|█████▏ | 2.59GB / 5.00GB, 60.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.48GB / 2.55GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 53%|█████▎ | 2.64GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 50%|████▉ | 2.48GB / 5.00GB  Processing Files (0 / 1) : 50%|████▉ | 2.48GB / 5.00GB, 66.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.35GB / 2.35GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 11%|█ | 554MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.90GB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▋ | 2.82GB / 5.00GB, 62.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.62GB / 2.68GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.66GB / 5.00GB, 63.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.66GB / 5.00GB, 67.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.55GB / 2.62GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 50%|████▉ | 2.49GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 53%|█████▎ | 2.64GB / 5.00GB  Processing Files (0 / 1) : 50%|████▉ | 2.49GB / 5.00GB, 66.6MB/s Processing Files (0 / 1) : 53%|█████▎ | 2.64GB / 5.00GB, 62.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.48GB / 2.55GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 11%|█ | 554MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 50%|████▉ | 2.49GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▍ | 2.73GB / 5.00GB, 70.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 99%|█████████▉| 2.53GB / 2.55GB, 64.4MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 11%|█ | 555MB / 5.00GB  Processing Files (0 / 1) : 11%|█ | 555MB / 5.00GB, 54.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 89%|████████▉ | 536MB / 603MB, 52.6MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.90GB / 5.00GB, 59.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.89GB / 5.00GB, 68.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.68GB / 2.75GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 55%|█████▍ | 2.75GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 50%|████▉ | 2.49GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▍ | 2.75GB / 5.00GB, 71.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.55GB / 2.62GB, 64.0MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 11%|█ | 555MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 55%|█████▍ | 2.75GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 50%|████▉ | 2.49GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 12%|█▏ | 624MB / 5.00GB  Processing Files (0 / 1) : 12%|█▏ | 624MB / 5.00GB, 60.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 90%|████████▉ | 603MB / 671MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.97GB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.88GB / 2.88GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.97GB / 5.00GB, 63.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▍ | 2.73GB / 5.00GB, 63.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.61GB / 2.68GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.66GB / 5.00GB, 60.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.55GB / 2.62GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 55%|█████▍ | 2.75GB / 5.00GB  Processing Files (0 / 1) : 51%|█████ | 2.55GB / 5.00GB, 66.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.41GB / 2.41GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 12%|█▏ | 624MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.97GB / 5.00GB, 59.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 53%|█████▎ | 2.66GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB  Processing Files (0 / 1) : 51%|█████ | 2.55GB / 5.00GB, 66.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 55%|█████▍ | 2.75GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▍ | 2.75GB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.55GB / 2.62GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 12%|█▏ | 624MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.96GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.75GB / 2.75GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▍ | 2.73GB / 5.00GB, 67.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.62GB / 2.68GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 55%|█████▍ | 2.75GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 12%|█▏ | 624MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 56%|█████▋ | 2.81GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▋ | 2.81GB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.61GB / 2.62GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 12%|█▏ | 624MB / 5.00GB  Processing Files (0 / 1) : 12%|█▏ | 624MB / 5.00GB, 60.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 90%|████████▉ | 603MB / 671MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 56%|█████▋ | 2.81GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB  Processing Files (0 / 1) : 51%|█████ | 2.55GB / 5.00GB, 66.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.41GB / 2.48GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 14%|█▍ | 692MB / 5.00GB  Processing Files (0 / 1) : 14%|█▍ | 692MB / 5.00GB, 60.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 91%|█████████ | 670MB / 738MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.97GB / 5.00GB, 59.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB  Processing Files (0 / 1) : 61%|██████ | 3.04GB / 5.00GB, 70.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 56%|█████▌ | 2.80GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▌ | 2.80GB / 5.00GB, 69.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.68GB / 2.75GB, 65.6MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 56%|█████▋ | 2.81GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 14%|█▍ | 692MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 60%|██████ | 3.01GB / 5.00GB  Processing Files (0 / 1) : 60%|██████ | 3.01GB / 5.00GB, 64.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 99%|█████████▉| 2.92GB / 2.95GB, 63.0MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.96GB / 5.00GB, 61.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.75GB / 2.82GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 56%|█████▌ | 2.80GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 56%|█████▋ | 2.81GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 14%|█▍ | 692MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 61%|██████ | 3.06GB / 5.00GB  Processing Files (0 / 1) : 61%|██████ | 3.06GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.95GB / 3.02GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 56%|█████▌ | 2.80GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 55%|█████▍ | 2.73GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 56%|█████▋ | 2.81GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 51%|█████ | 2.55GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 14%|█▍ | 692MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 61%|██████ | 3.06GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 56%|█████▌ | 2.80GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 56%|█████▌ | 2.79GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▌ | 2.79GB / 5.00GB, 60.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.68GB / 2.68GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 53%|█████▎ | 2.62GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 56%|█████▋ | 2.81GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.62GB / 5.00GB, 66.7MB/s Processing Files (0 / 1) : 56%|█████▋ | 2.81GB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.48GB / 2.55GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.62GB / 2.68GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 14%|█▍ | 693MB / 5.00GB  Processing Files (0 / 1) : 14%|█▍ | 693MB / 5.00GB, 60.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 91%|█████████ | 671MB / 738MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 61%|██████ | 3.06GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.10GB / 5.00GB, 70.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.95GB / 2.95GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 61%|██████ | 3.02GB / 5.00GB  Processing Files (0 / 1) : 61%|██████ | 3.02GB / 5.00GB, 63.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 61.0MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 56%|█████▌ | 2.80GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▌ | 2.80GB / 5.00GB, 62.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.68GB / 2.75GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 56%|█████▌ | 2.79GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▌ | 2.79GB / 5.00GB, 60.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.68GB / 2.68GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 58%|█████▊ | 2.88GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 53%|█████▎ | 2.62GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.88GB / 5.00GB, 72.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.68GB / 2.75GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 15%|█▌ | 761MB / 5.00GB  Processing Files (0 / 1) : 15%|█▌ | 761MB / 5.00GB, 66.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 737MB / 805MB, 65.3MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 61%|██████ | 3.06GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 61%|██████ | 3.02GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 56%|█████▌ | 2.80GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 56%|█████▌ | 2.79GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 53%|█████▎ | 2.62GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 58%|█████▊ | 2.88GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 15%|█▌ | 761MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 61%|██████ | 3.06GB / 5.00GB  Processing Files (0 / 1) : 61%|██████ | 3.06GB / 5.00GB, 61.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.95GB / 3.02GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.11GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.11GB / 5.00GB, 71.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 61%|██████ | 3.02GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 57%|█████▋ | 2.87GB / 5.00GB  Processing Files (0 / 1) : 57%|█████▋ | 2.87GB / 5.00GB, 69.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.75GB / 2.82GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▋ | 2.82GB / 5.00GB, 63.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 58%|█████▊ | 2.88GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 53%|█████▎ | 2.62GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 15%|█▌ | 761MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 61%|██████ | 3.06GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.11GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.11GB / 5.00GB, 64.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 61%|██████ | 3.02GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 57%|█████▋ | 2.87GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 53%|█████▎ | 2.63GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 58%|█████▊ | 2.88GB / 5.00GB  Processing Files (0 / 1) : 53%|█████▎ | 2.63GB / 5.00GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.48GB / 2.55GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 15%|█▌ | 761MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 63%|██████▎ | 3.13GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.13GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.02GB / 3.08GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.11GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 61%|██████ | 3.02GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 57%|█████▋ | 2.87GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 56%|█████▋ | 2.82GB / 5.00GB  Processing Files (0 / 1) : 56%|█████▋ | 2.82GB / 5.00GB, 63.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.68GB / 2.75GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 54%|█████▍ | 2.69GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 59%|█████▉ | 2.95GB / 5.00GB  Processing Files (0 / 1) : 54%|█████▍ | 2.69GB / 5.00GB, 66.9MB/s Processing Files (0 / 1) : 59%|█████▉ | 2.95GB / 5.00GB, 72.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.55GB / 2.62GB, 59.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.75GB / 2.75GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 15%|█▌ | 761MB / 5.00GB  Processing Files (0 / 1) : 15%|█▌ | 761MB / 5.00GB, 60.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 92%|█████████▏| 738MB / 805MB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 63%|██████▎ | 3.13GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.11GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.11GB / 5.00GB, 64.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.95GB / 3.02GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.09GB / 5.00GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 57%|█████▋ | 2.87GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.89GB / 5.00GB, 69.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.75GB / 2.75GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 54%|█████▍ | 2.69GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 59%|█████▉ | 2.95GB / 5.00GB  Processing Files (0 / 1) : 54%|█████▍ | 2.69GB / 5.00GB, 66.9MB/s Processing Files (0 / 1) : 59%|█████▉ | 2.95GB / 5.00GB, 72.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.55GB / 2.62GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.75GB / 2.82GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 17%|█▋ | 828MB / 5.00GB  Processing Files (0 / 1) : 17%|█▋ | 828MB / 5.00GB, 66.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 805MB / 805MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 63%|██████▎ | 3.13GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.11GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.09GB / 5.00GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 59%|█████▊ | 2.93GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▊ | 2.93GB / 5.00GB, 69.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.89GB / 5.00GB, 69.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 59%|█████▉ | 2.95GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 54%|█████▍ | 2.69GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 17%|█▋ | 828MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 63%|██████▎ | 3.13GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 62%|██████▏ | 3.11GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 59%|█████▊ | 2.93GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 54%|█████▍ | 2.69GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 59%|█████▉ | 2.95GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 17%|█▋ | 828MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 64%|██████▍ | 3.19GB / 5.00GB  Processing Files (0 / 1) : 64%|██████▍ | 3.19GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.08GB / 3.08GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 64%|██████▎ | 3.18GB / 5.00GB  Processing Files (0 / 1) : 64%|██████▎ | 3.18GB / 5.00GB, 71.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.02GB / 3.08GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 59%|█████▊ | 2.93GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 59%|█████▉ | 2.95GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 55%|█████▌ | 2.76GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▌ | 2.76GB / 5.00GB, 73.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.62GB / 2.62GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 17%|█▋ | 828MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 64%|██████▍ | 3.19GB / 5.00GB  Processing Files (0 / 1) : 64%|██████▍ | 3.19GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 64%|██████▎ | 3.18GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.09GB / 5.00GB, 61.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 59%|█████▊ | 2.93GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 55%|█████▌ | 2.76GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 59%|█████▉ | 2.95GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▌ | 2.76GB / 5.00GB, 73.5MB/s Processing Files (0 / 1) : 59%|█████▉ | 2.95GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.75GB / 2.82GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 17%|█▋ | 828MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 64%|██████▍ | 3.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 64%|██████▎ | 3.18GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.16GB / 5.00GB, 67.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.95GB / 3.02GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 59%|█████▊ | 2.93GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 58%|█████▊ | 2.89GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.89GB / 5.00GB, 63.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.75GB / 2.82GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 55%|█████▌ | 2.76GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 60%|██████ | 3.02GB / 5.00GB  Processing Files (0 / 1) : 60%|██████ | 3.02GB / 5.00GB, 73.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 18%|█▊ | 895MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 895MB / 5.00GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 871MB / 872MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 64%|██████▍ | 3.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 64%|██████▎ | 3.18GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 60%|█████▉ | 2.99GB / 5.00GB  Processing Files (0 / 1) : 60%|█████▉ | 2.99GB / 5.00GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.87GB / 2.88GB, 64.4MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.96GB / 5.00GB, 63.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 60%|██████ | 3.02GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 55%|█████▌ | 2.76GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 18%|█▊ | 896MB / 5.00GB  Processing Files (0 / 1) : 18%|█▊ | 896MB / 5.00GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 871MB / 939MB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 64%|██████▍ | 3.19GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 64%|██████▎ | 3.18GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 60%|██████ | 3.00GB / 5.00GB  Processing Files (0 / 1) : 60%|██████ | 3.00GB / 5.00GB, 69.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 55%|█████▌ | 2.76GB / 5.00GB  Processing Files (0 / 1) : 55%|█████▌ | 2.76GB / 5.00GB, 66.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 97%|█████████▋| 2.62GB / 2.68GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 60%|██████ | 3.02GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 18%|█▊ | 896MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 65%|██████▌ | 3.26GB / 5.00GB  Processing Files (0 / 1) : 65%|██████▌ | 3.26GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.15GB / 3.15GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 65%|██████▍ | 3.25GB / 5.00GB  Processing Files (0 / 1) : 65%|██████▍ | 3.25GB / 5.00GB, 71.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.08GB / 3.15GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 60%|██████ | 3.00GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 60%|██████ | 3.02GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB  Processing Files (0 / 1) : 57%|█████▋ | 2.83GB / 5.00GB, 73.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.68GB / 2.75GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 18%|█▊ | 896MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 65%|██████▌ | 3.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 65%|██████▍ | 3.25GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB  Processing Files (0 / 1) : 65%|██████▍ | 3.23GB / 5.00GB, 67.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.02GB / 3.08GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 60%|██████ | 3.00GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 59%|█████▉ | 2.96GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.09GB / 5.00GB, 73.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 18%|█▊ | 896MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 65%|██████▌ | 3.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 65%|██████▍ | 3.25GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 60%|██████ | 3.00GB / 5.00GB  Processing Files (0 / 1) : 60%|██████ | 3.00GB / 5.00GB, 62.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 61%|██████ | 3.03GB / 5.00GB  Processing Files (0 / 1) : 61%|██████ | 3.03GB / 5.00GB, 69.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.88GB / 2.88GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 19%|█▉ | 964MB / 5.00GB  Processing Files (0 / 1) : 19%|█▉ | 964MB / 5.00GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 93%|█████████▎| 938MB / 1.01GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 65%|██████▌ | 3.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 65%|██████▍ | 3.25GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 61%|██████▏ | 3.07GB / 5.00GB  Processing Files (0 / 1) : 61%|██████▏ | 3.07GB / 5.00GB, 69.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.95GB / 3.02GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 61%|██████ | 3.03GB / 5.00GB  Processing Files (0 / 1) : 61%|██████ | 3.03GB / 5.00GB, 63.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 57%|█████▋ | 2.83GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 19%|█▉ | 964MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 65%|██████▌ | 3.26GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 66%|██████▋ | 3.32GB / 5.00GB  Processing Files (0 / 1) : 66%|██████▋ | 3.32GB / 5.00GB, 70.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.15GB / 3.22GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 61%|██████▏ | 3.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 61%|██████ | 3.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB  Processing Files (0 / 1) : 58%|█████▊ | 2.90GB / 5.00GB, 68.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.75GB / 2.75GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 62%|██████▏ | 3.09GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 19%|█▉ | 964MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 67%|██████▋ | 3.33GB / 5.00GB  Processing Files (0 / 1) : 67%|██████▋ | 3.33GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.22GB / 3.29GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 66%|██████▋ | 3.32GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 66%|██████▌ | 3.29GB / 5.00GB  Processing Files (0 / 1) : 66%|██████▌ | 3.29GB / 5.00GB, 66.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.08GB / 3.08GB, 65.6MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 61%|██████▏ | 3.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 61%|██████ | 3.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.16GB / 5.00GB, 73.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.95GB / 2.95GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 19%|█▉ | 964MB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 67%|██████▋ | 3.33GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 66%|██████▋ | 3.32GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 66%|██████▌ | 3.29GB / 5.00GB  Processing Files (0 / 1) : 66%|██████▌ | 3.29GB / 5.00GB, 66.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.08GB / 3.15GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 61%|██████▏ | 3.07GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 61%|██████ | 3.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.16GB / 5.00GB, 73.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB  Processing Files (0 / 1) : 21%|██ | 1.03GB / 5.00GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 1.01GB / 1.01GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 67%|██████▋ | 3.33GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 66%|██████▋ | 3.32GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 66%|██████▌ | 3.29GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.10GB / 5.00GB, 65.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 99%|█████████▊| 2.98GB / 3.02GB, 62.0MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB  Processing Files (0 / 1) : 62%|██████▏ | 3.10GB / 5.00GB, 69.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.95GB / 3.02GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 58%|█████▊ | 2.90GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 67%|██████▋ | 3.33GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 67%|██████▋ | 3.37GB / 5.00GB  Processing Files (0 / 1) : 67%|██████▋ | 3.37GB / 5.00GB, 69.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 99%|█████████▉| 3.20GB / 3.22GB, 64.1MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 66%|██████▌ | 3.29GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 63%|██████▎ | 3.14GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.14GB / 5.00GB, 69.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.02GB / 3.08GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.97GB / 5.00GB, 67.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 2.82GB / 2.82GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 63%|██████▎ | 3.16GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 68%|██████▊ | 3.40GB / 5.00GB  Processing Files (0 / 1) : 68%|██████▊ | 3.40GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.29GB / 3.35GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 68%|██████▊ | 3.39GB / 5.00GB  Processing Files (0 / 1) : 68%|██████▊ | 3.39GB / 5.00GB, 71.1MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.22GB / 3.29GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 66%|██████▋ | 3.32GB / 5.00GB  Processing Files (0 / 1) : 66%|██████▋ | 3.32GB / 5.00GB, 61.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 99%|█████████▊| 3.11GB / 3.15GB, 61.5MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 63%|██████▎ | 3.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB  Processing Files (0 / 1) : 65%|██████▍ | 3.23GB / 5.00GB, 73.1MB/s Processing Files (0 / 1) : 59%|█████▉ | 2.97GB / 5.00GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.02GB / 3.02GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 68%|██████▊ | 3.40GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 68%|██████▊ | 3.39GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 67%|██████▋ | 3.36GB / 5.00GB  Processing Files (0 / 1) : 67%|██████▋ | 3.36GB / 5.00GB, 66.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.15GB / 3.22GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 63%|██████▎ | 3.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB  Processing Files (0 / 1) : 65%|██████▍ | 3.23GB / 5.00GB, 73.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 21%|██ | 1.03GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 68%|██████▊ | 3.40GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 68%|██████▊ | 3.39GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 67%|██████▋ | 3.36GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 63%|██████▎ | 3.14GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.14GB / 5.00GB, 69.2MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.02GB / 3.08GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 62%|██████▏ | 3.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 5.00GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 68%|██████▊ | 3.40GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 68%|██████▊ | 3.39GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 67%|██████▋ | 3.36GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 63%|██████▎ | 3.14GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 63%|██████▎ | 3.17GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.17GB / 5.00GB, 69.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.02GB / 3.02GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 68%|██████▊ | 3.40GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 68%|██████▊ | 3.39GB / 5.00GB  Processing Files (0 / 1) : 68%|██████▊ | 3.39GB / 5.00GB, 61.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.22GB / 3.29GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 67%|██████▋ | 3.36GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 64%|██████▍ | 3.20GB / 5.00GB  Processing Files (0 / 1) : 64%|██████▍ | 3.20GB / 5.00GB, 68.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.08GB / 3.08GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 63%|██████▎ | 3.17GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.17GB / 5.00GB, 69.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 59%|█████▉ | 2.97GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB  Processing Files (0 / 1) : 59%|█████▉ | 2.97GB / 5.00GB, 61.3MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.82GB / 2.88GB, 59.2MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 69%|██████▉ | 3.45GB / 5.00GB  Processing Files (0 / 1) : 69%|██████▉ | 3.45GB / 5.00GB, 73.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.34GB / 3.35GB, 70.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB  Processing Files (0 / 1) : 69%|██████▉ | 3.46GB / 5.00GB, 68.9MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.29GB / 3.29GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 67%|██████▋ | 3.36GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 64%|██████▍ | 3.20GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 63%|██████▎ | 3.17GB / 5.00GB  Processing Files (0 / 1) : 63%|██████▎ | 3.17GB / 5.00GB, 69.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.02GB / 3.08GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB  Processing Files (0 / 1) : 61%|██████ | 3.04GB / 5.00GB, 68.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 2.88GB / 2.95GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB  Processing Files (0 / 1) : 22%|██▏ | 1.10GB / 5.00GB, 66.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.07GB / 1.14GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB  Processing Files (0 / 1) : 69%|██████▉ | 3.46GB / 5.00GB, 68.5MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.35GB / 3.42GB, 65.8MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 67%|██████▋ | 3.37GB / 5.00GB  Processing Files (0 / 1) : 67%|██████▋ | 3.37GB / 5.00GB, 67.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.16GB / 3.22GB, 66.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 64%|██████▍ | 3.20GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 63%|██████▎ | 3.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 22%|██▏ | 1.10GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 69%|██████▊ | 3.43GB / 5.00GB  Processing Files (0 / 1) : 69%|██████▊ | 3.43GB / 5.00GB, 65.8MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.22GB / 3.29GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 64%|██████▍ | 3.20GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 63%|██████▎ | 3.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 66%|██████▌ | 3.30GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB  Processing Files (0 / 1) : 66%|██████▌ | 3.30GB / 5.00GB, 73.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.08GB / 3.15GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB  Processing Files (0 / 1) : 23%|██▎ | 1.17GB / 5.00GB, 66.7MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 69%|██████▊ | 3.43GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 64%|██████▍ | 3.20GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB  Processing Files (0 / 1) : 65%|██████▍ | 3.23GB / 5.00GB, 69.6MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.08GB / 3.15GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 66%|██████▌ | 3.30GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 69%|██████▉ | 3.46GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 69%|██████▊ | 3.43GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0023-of-00027.safetensors: 65%|██████▌ | 3.27GB / 5.00GB  Processing Files (0 / 1) : 65%|██████▌ | 3.27GB / 5.00GB, 66.0MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 98%|█████████▊| 3.15GB / 3.22GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0010-of-00027.safetensors: 65%|██████▍ | 3.23GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0006-of-00027.safetensors: 61%|██████ | 3.04GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0007-of-00027.safetensors: 66%|██████▌ | 3.30GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0016-of-00027.safetensors: 23%|██▎ | 1.17GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0024-of-00027.safetensors: 71%|███████ | 3.53GB / 5.00GB  Processing Files (0 / 1) : 71%|███████ | 3.53GB / 5.00GB, 74.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.41GB / 3.42GB, 71.6MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0018-of-00027.safetensors: 71%|███████ | 3.53GB / 5.00GB  Processing Files (0 / 1) : 71%|███████ | 3.53GB / 5.00GB, 68.4MB/s
qwen-qwen3-235b-a22b-i-47730-v23-uploader: New Data Upload : 100%|█████████▉| 3.35GB / 3.35GB, 65.7MB/s 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: ...0003-of-00027.safetensors: 69%|██████▊ | 3.43GB / 5.00GB 
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00027-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00008-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00018-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00006-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00026-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00016-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00003-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00012-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00004-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00015-of-00027.safetensors
HTTP Request: %s %s "%s %d %s"
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00023-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00007-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00021-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00009-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00014-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00013-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00010-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00020-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00024-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00022-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00019-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00005-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00017-of-00027.safetensors
qwen-qwen3-235b-a22b-i-47730-v23-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/qwen-qwen3-235b-a22b-i-47730-v23/model-00011-of-00027.safetensors
Job qwen-qwen3-235b-a22b-i-47730-v23-uploader completed after 5247.67s with status: succeeded
Stopping job with name qwen-qwen3-235b-a22b-i-47730-v23-uploader
Pipeline stage VLLMUploader completed in 5248.96s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.45s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service qwen-qwen3-235b-a22b-i-47730-v23
Waiting for inference service qwen-qwen3-235b-a22b-i-47730-v23 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service qwen-qwen3-235b-a22b-i-47730-v23 ready after 463.27662444114685s
Pipeline stage VLLMDeployer completed in 465.77s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.331535577774048s
Received healthy response to inference request in 2.041447877883911s
Received healthy response to inference request in 2.1593239307403564s
Received healthy response to inference request in 2.6767399311065674s
Received healthy response to inference request in 1.9983768463134766s
Received healthy response to inference request in 2.013521671295166s
Received healthy response to inference request in 1.853475570678711s
Received healthy response to inference request in 1.96169114112854s
Received healthy response to inference request in 1.7510850429534912s
Received healthy response to inference request in 1.9556772708892822s
Received healthy response to inference request in 2.1168160438537598s
Received healthy response to inference request in 1.9126927852630615s
Received healthy response to inference request in 1.8278617858886719s
Received healthy response to inference request in 2.058478355407715s
Received healthy response to inference request in 2.0192599296569824s
Received healthy response to inference request in 1.8858263492584229s
Received healthy response to inference request in 1.7875945568084717s
Received healthy response to inference request in 1.9194433689117432s
Received healthy response to inference request in 1.9884777069091797s
Received healthy response to inference request in 1.868238925933838s
Received healthy response to inference request in 1.9771103858947754s
Received healthy response to inference request in 2.40083646774292s
Received healthy response to inference request in 2.0009303092956543s
Received healthy response to inference request in 1.9230942726135254s
Received healthy response to inference request in 2.533473253250122s
Received healthy response to inference request in 1.8873710632324219s
Received healthy response to inference request in 1.9112176895141602s
Received healthy response to inference request in 2.1409552097320557s
Received healthy response to inference request in 1.814589023590088s
Received healthy response to inference request in 1.8779292106628418s
30 requests
0 failed requests
5th percentile: 1.7997420668601989
10th percentile: 1.8265345096588135
20th percentile: 1.875991153717041
30th percentile: 1.9040637016296387
40th percentile: 1.9216339111328125
50th percentile: 1.9694007635116577
60th percentile: 1.9993982315063477
70th percentile: 2.025916314125061
80th percentile: 2.121643877029419
90th percentile: 2.338465666770935
95th percentile: 2.473786699771881
99th percentile: 2.635192594528198
mean time: 2.0198357184727986
Pipeline stage StressChecker completed in 87.64s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.76s
Shutdown handler de-registered
qwen-qwen3-235b-a22b-i_47730_v23 status is now deployed due to DeploymentManager action
qwen-qwen3-235b-a22b-i_47730_v23 status is now torndown due to DeploymentManager action