chaiml-muster-v0e-lr1e5_71769

developer_uid: zonemercy
submission_id: chaiml-muster-v0e-lr1e5_71769_v1
model_name: chaiml-muster-v0e-lr1e5_71769_v1
model_group: ChaiML/muster-v0e-lr1e5e
status: torndown
timestamp: 2026-02-12T22:01:27+00:00
num_battles: 10727
num_wins: 6121
celo_rating: 1355.38
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v0e-lr1e5ep2r64g4b01
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v0e-lr1e5_71769_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v0e-lr1e5ep2r64g4b01
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-09
win_ratio: 0.5706162021068332
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</think>', '</s>', '<|im_end|>', '<|assistant|>', '<|user|>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v0e-lr1e5-71769-v1-uploader
Waiting for job on chaiml-muster-v0e-lr1e5-71769-v1-uploader to finish
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Using quantization_mode: w4a16
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Checking if ChaiML/muster-v0e-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Downloading snapshot of ChaiML/muster-v0e-lr1e5ep2r64g4b01...
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Fetching 107 files:   0%|          | 0/107 [00:00<?, ?it/s]
Fetching 107 files:   1%|          | 1/107 [00:00<00:30,  3.50it/s]
Fetching 107 files:   7%|▋         | 8/107 [00:16<03:28,  2.10s/it]
Fetching 107 files:   9%|▉         | 10/107 [00:17<02:44,  1.69s/it]
Fetching 107 files:  12%|█▏        | 13/107 [00:18<01:46,  1.14s/it]
Fetching 107 files:  14%|█▍        | 15/107 [00:18<01:18,  1.17it/s]
Fetching 107 files:  15%|█▍        | 16/107 [00:27<03:16,  2.16s/it]
Fetching 107 files:  16%|█▌        | 17/107 [00:28<03:03,  2.04s/it]
Fetching 107 files:  17%|█▋        | 18/107 [00:32<03:32,  2.38s/it]
Fetching 107 files:  18%|█▊        | 19/107 [00:32<02:47,  1.91s/it]
Fetching 107 files:  19%|█▊        | 20/107 [00:33<02:11,  1.51s/it]
Fetching 107 files:  20%|█▉        | 21/107 [00:33<01:53,  1.32s/it]
Fetching 107 files:  21%|██        | 22/107 [00:34<01:29,  1.06s/it]
Fetching 107 files:  21%|██▏       | 23/107 [00:34<01:10,  1.19it/s]
Fetching 107 files:  22%|██▏       | 24/107 [00:42<04:03,  2.94s/it]
Fetching 107 files:  23%|██▎       | 25/107 [00:45<03:55,  2.87s/it]
Fetching 107 files:  24%|██▍       | 26/107 [00:49<04:11,  3.11s/it]
Fetching 107 files:  25%|██▌       | 27/107 [00:50<03:28,  2.60s/it]
Fetching 107 files:  26%|██▌       | 28/107 [00:51<02:40,  2.03s/it]
Fetching 107 files:  27%|██▋       | 29/107 [00:51<01:57,  1.51s/it]
Fetching 107 files:  28%|██▊       | 30/107 [00:52<01:57,  1.52s/it]
Fetching 107 files:  30%|██▉       | 32/107 [00:58<02:45,  2.20s/it]
Fetching 107 files:  31%|███       | 33/107 [01:00<02:28,  2.00s/it]
Fetching 107 files:  32%|███▏      | 34/107 [01:03<02:43,  2.24s/it]
Fetching 107 files:  33%|███▎      | 35/107 [01:05<02:38,  2.21s/it]
Fetching 107 files:  34%|███▎      | 36/107 [01:08<02:49,  2.39s/it]
Fetching 107 files:  37%|███▋      | 40/107 [01:13<01:55,  1.72s/it]
Fetching 107 files:  38%|███▊      | 41/107 [01:14<01:45,  1.60s/it]
Fetching 107 files:  39%|███▉      | 42/107 [01:17<01:58,  1.83s/it]
Fetching 107 files:  40%|████      | 43/107 [01:19<02:04,  1.94s/it]
Fetching 107 files:  41%|████      | 44/107 [01:20<01:46,  1.69s/it]
Fetching 107 files:  42%|████▏     | 45/107 [01:23<02:09,  2.09s/it]
Fetching 107 files:  43%|████▎     | 46/107 [01:24<01:38,  1.61s/it]
Fetching 107 files:  45%|████▍     | 48/107 [01:28<01:45,  1.78s/it]
Fetching 107 files:  46%|████▌     | 49/107 [01:29<01:32,  1.59s/it]
Fetching 107 files:  47%|████▋     | 50/107 [01:31<01:42,  1.79s/it]
Fetching 107 files:  48%|████▊     | 51/107 [01:34<01:56,  2.08s/it]
Fetching 107 files:  49%|████▊     | 52/107 [01:34<01:25,  1.55s/it]
Fetching 107 files:  50%|████▉     | 53/107 [01:38<02:00,  2.23s/it]
Fetching 107 files:  50%|█████     | 54/107 [01:38<01:31,  1.74s/it]
Fetching 107 files:  51%|█████▏    | 55/107 [01:39<01:08,  1.31s/it]
Fetching 107 files:  52%|█████▏    | 56/107 [01:42<01:37,  1.92s/it]
Fetching 107 files:  53%|█████▎    | 57/107 [01:43<01:20,  1.60s/it]
Fetching 107 files:  54%|█████▍    | 58/107 [01:45<01:21,  1.67s/it]
Fetching 107 files:  55%|█████▌    | 59/107 [01:49<02:02,  2.55s/it]
Fetching 107 files:  57%|█████▋    | 61/107 [01:54<01:47,  2.34s/it]
Fetching 107 files:  58%|█████▊    | 62/107 [01:55<01:34,  2.09s/it]
Fetching 107 files:  60%|█████▉    | 64/107 [01:56<01:06,  1.55s/it]
Fetching 107 files:  61%|██████    | 65/107 [01:57<00:56,  1.35s/it]
Fetching 107 files:  62%|██████▏   | 66/107 [01:59<00:55,  1.36s/it]
Fetching 107 files:  63%|██████▎   | 67/107 [02:04<01:35,  2.38s/it]
Fetching 107 files:  64%|██████▎   | 68/107 [02:10<02:15,  3.47s/it]
Fetching 107 files:  67%|██████▋   | 72/107 [02:10<00:48,  1.38s/it]
Fetching 107 files:  68%|██████▊   | 73/107 [02:12<00:45,  1.35s/it]
Fetching 107 files:  69%|██████▉   | 74/107 [02:13<00:48,  1.46s/it]
Fetching 107 files:  70%|███████   | 75/107 [02:18<01:09,  2.17s/it]
Fetching 107 files:  71%|███████   | 76/107 [02:21<01:16,  2.47s/it]
Fetching 107 files:  72%|███████▏  | 77/107 [02:23<01:06,  2.20s/it]
Fetching 107 files:  73%|███████▎  | 78/107 [02:25<01:02,  2.16s/it]
Fetching 107 files:  74%|███████▍  | 79/107 [02:27<00:59,  2.12s/it]
Fetching 107 files:  77%|███████▋  | 82/107 [02:28<00:27,  1.11s/it]
Fetching 107 files:  78%|███████▊  | 83/107 [02:32<00:39,  1.66s/it]
Fetching 107 files:  79%|███████▊  | 84/107 [02:35<00:45,  1.99s/it]
Fetching 107 files:  79%|███████▉  | 85/107 [02:39<00:54,  2.47s/it]
Fetching 107 files:  80%|████████  | 86/107 [02:49<01:33,  4.44s/it]
Fetching 107 files:  81%|████████▏ | 87/107 [02:53<01:26,  4.30s/it]
Fetching 107 files:  87%|████████▋ | 93/107 [02:54<00:20,  1.45s/it]
Fetching 107 files:  88%|████████▊ | 94/107 [02:55<00:17,  1.33s/it]
Fetching 107 files:  89%|████████▉ | 95/107 [02:56<00:17,  1.43s/it]
Fetching 107 files:  90%|████████▉ | 96/107 [02:57<00:13,  1.24s/it]
Fetching 107 files:  91%|█████████ | 97/107 [03:00<00:16,  1.62s/it]
Fetching 107 files:  92%|█████████▏| 98/107 [03:02<00:15,  1.77s/it]
Fetching 107 files:  93%|█████████▎| 99/107 [03:03<00:11,  1.43s/it]
Fetching 107 files:  93%|█████████▎| 100/107 [03:03<00:08,  1.19s/it]
Fetching 107 files:  94%|█████████▍| 101/107 [03:04<00:05,  1.02it/s]
Fetching 107 files: 100%|██████████| 107/107 [03:04<00:00,  1.72s/it]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Downloaded in 184.090s
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Applying quantization...
chaiml-muster-v0e-lr1e5-71769-v1-uploader: [33;1m2026-02-09 10:17:52 WARNING modeling_utils.py L4670: `torch_dtype` is deprecated! Use `dtype` instead![0m
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Loading checkpoint shards:   0%|          | 0/95 [00:00<?, ?it/s]
Loading checkpoint shards:   1%|          | 1/95 [00:00<00:27,  3.41it/s]
Loading checkpoint shards:   2%|▏         | 2/95 [00:00<00:41,  2.25it/s]
Loading checkpoint shards:   3%|▎         | 3/95 [00:01<00:38,  2.42it/s]
Loading checkpoint shards:   4%|▍         | 4/95 [00:01<00:40,  2.22it/s]
Loading checkpoint shards:   5%|▌         | 5/95 [00:01<00:31,  2.90it/s]
Loading checkpoint shards:   6%|▋         | 6/95 [00:01<00:23,  3.75it/s]
Loading checkpoint shards:   7%|▋         | 7/95 [00:02<00:20,  4.30it/s]
Loading checkpoint shards:   8%|▊         | 8/95 [00:02<00:17,  5.10it/s]
Loading checkpoint shards:  14%|█▎        | 13/95 [00:02<00:06, 13.48it/s]
Loading checkpoint shards:  19%|█▉        | 18/95 [00:02<00:03, 21.08it/s]
Loading checkpoint shards:  24%|██▍       | 23/95 [00:02<00:02, 27.55it/s]
Loading checkpoint shards:  29%|██▉       | 28/95 [00:02<00:02, 32.87it/s]
Loading checkpoint shards:  35%|███▍      | 33/95 [00:02<00:01, 37.10it/s]
Loading checkpoint shards:  40%|████      | 38/95 [00:02<00:01, 40.35it/s]
Loading checkpoint shards:  45%|████▌     | 43/95 [00:02<00:01, 42.71it/s]
Loading checkpoint shards:  51%|█████     | 48/95 [00:03<00:01, 44.54it/s]
Loading checkpoint shards:  56%|█████▌    | 53/95 [00:03<00:00, 45.17it/s]
Loading checkpoint shards:  61%|██████    | 58/95 [00:03<00:00, 46.25it/s]
Loading checkpoint shards:  66%|██████▋   | 63/95 [00:03<00:00, 47.08it/s]
Loading checkpoint shards:  72%|███████▏  | 68/95 [00:03<00:00, 47.65it/s]
Loading checkpoint shards:  77%|███████▋  | 73/95 [00:03<00:00, 48.11it/s]
Loading checkpoint shards:  82%|████████▏ | 78/95 [00:03<00:00, 48.34it/s]
Loading checkpoint shards:  87%|████████▋ | 83/95 [00:03<00:00, 48.53it/s]
Loading checkpoint shards:  93%|█████████▎| 88/95 [00:03<00:00, 48.69it/s]
Loading checkpoint shards:  98%|█████████▊| 93/95 [00:04<00:00, 48.62it/s]
Loading checkpoint shards: 100%|██████████| 95/95 [00:04<00:00, 23.48it/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: [38;20m2026-02-09 10:18:04 INFO base.py L366: using torch.bfloat16 for quantization tuning[0m
chaiml-muster-v0e-lr1e5-71769-v1-uploader: [38;20m2026-02-09 10:18:08 INFO base.py L1145: start to compute imatrix[0m
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Generating train split:   0%|          | 0/10000 [00:00<?, ? examples/s]
Generating train split: 100%|██████████| 10000/10000 [00:00<00:00, 57519.96 examples/s]
Generating train split: 100%|██████████| 10000/10000 [00:00<00:00, 56635.01 examples/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Map:   0%|          | 0/10000 [00:00<?, ? examples/s]
Map:  10%|█         | 1000/10000 [00:00<00:04, 1967.70 examples/s]
Map:  20%|██        | 2000/10000 [00:01<00:04, 1681.73 examples/s]
Map:  30%|███       | 3000/10000 [00:04<00:13, 510.55 examples/s] 
Map:  40%|████      | 4000/10000 [00:05<00:08, 728.08 examples/s]
Map:  50%|█████     | 5000/10000 [00:05<00:05, 933.53 examples/s]
Map:  60%|██████    | 6000/10000 [00:06<00:03, 1142.55 examples/s]
Map:  70%|███████   | 7000/10000 [00:07<00:02, 1082.46 examples/s]
Map:  80%|████████  | 8000/10000 [00:07<00:01, 1186.38 examples/s]
Map:  90%|█████████ | 9000/10000 [00:08<00:00, 1301.72 examples/s]
Map: 100%|██████████| 10000/10000 [00:09<00:00, 1170.20 examples/s]
Map: 100%|██████████| 10000/10000 [00:09<00:00, 1040.92 examples/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Filter:   0%|          | 0/10000 [00:00<?, ? examples/s]
Filter:  10%|█         | 1000/10000 [00:00<00:03, 2920.29 examples/s]
Filter:  20%|██        | 2000/10000 [00:00<00:02, 2977.32 examples/s]
Filter:  30%|███       | 3000/10000 [00:01<00:02, 2901.28 examples/s]
Filter:  40%|████      | 4000/10000 [00:01<00:02, 2931.68 examples/s]
Filter:  50%|█████     | 5000/10000 [00:01<00:01, 2921.50 examples/s]
Filter:  60%|██████    | 6000/10000 [00:02<00:01, 2922.01 examples/s]
Filter:  70%|███████   | 7000/10000 [00:02<00:01, 2918.57 examples/s]
Filter:  80%|████████  | 8000/10000 [00:02<00:00, 2921.46 examples/s]
Filter:  90%|█████████ | 9000/10000 [00:03<00:00, 2927.65 examples/s]
Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2960.10 examples/s]
Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2935.34 examples/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Casting the dataset:   0%|          | 0/1216 [00:00<?, ? examples/s]
Casting the dataset:  82%|████████▏ | 1000/1216 [00:01<00:00, 511.68 examples/s]
Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 514.47 examples/s]
Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 513.25 examples/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Map:   0%|          | 0/10000 [00:00<?, ? examples/s]
Map:  10%|█         | 1000/10000 [00:00<00:06, 1305.47 examples/s]
Map:  20%|██        | 2000/10000 [00:01<00:05, 1447.60 examples/s]
Map:  30%|███       | 3000/10000 [00:04<00:11, 603.35 examples/s] 
Map:  40%|████      | 4000/10000 [00:04<00:07, 840.47 examples/s]
Map:  50%|█████     | 5000/10000 [00:05<00:04, 1052.89 examples/s]
Map:  60%|██████    | 6000/10000 [00:05<00:03, 1268.69 examples/s]
Map:  70%|███████   | 7000/10000 [00:06<00:02, 1152.77 examples/s]
Map:  80%|████████  | 8000/10000 [00:07<00:01, 1266.14 examples/s]
Map:  90%|█████████ | 9000/10000 [00:07<00:00, 1372.27 examples/s]
Map: 100%|██████████| 10000/10000 [00:08<00:00, 1323.44 examples/s]
Map: 100%|██████████| 10000/10000 [00:08<00:00, 1141.64 examples/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Filter:   0%|          | 0/10000 [00:00<?, ? examples/s]
Filter:  10%|█         | 1000/10000 [00:00<00:03, 2875.77 examples/s]
Filter:  20%|██        | 2000/10000 [00:00<00:02, 2950.74 examples/s]
Filter:  30%|███       | 3000/10000 [00:01<00:02, 2887.52 examples/s]
Filter:  40%|████      | 4000/10000 [00:01<00:02, 2920.47 examples/s]
Filter:  50%|█████     | 5000/10000 [00:01<00:01, 2908.92 examples/s]
Filter:  60%|██████    | 6000/10000 [00:02<00:01, 2862.21 examples/s]
Filter:  70%|███████   | 7000/10000 [00:02<00:01, 2867.74 examples/s]
Filter:  80%|████████  | 8000/10000 [00:02<00:00, 2875.04 examples/s]
Filter:  90%|█████████ | 9000/10000 [00:03<00:00, 2896.29 examples/s]
Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2938.27 examples/s]
Filter: 100%|██████████| 10000/10000 [00:03<00:00, 2905.12 examples/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Casting the dataset:   0%|          | 0/1216 [00:00<?, ? examples/s]
Casting the dataset:  82%|████████▏ | 1000/1216 [00:01<00:00, 521.32 examples/s]
Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 525.14 examples/s]
Casting the dataset: 100%|██████████| 1216/1216 [00:02<00:00, 523.66 examples/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  0%|          | 0/94 [00:00<?, ?it/s]
Quantizing model.layers.0:   0%|          | 0/94 [00:00<?, ?it/s]W0209 10:19:10.320000 7 torch/_dynamo/convert_frame.py:1358] [6/8] torch._dynamo hit config.recompile_limit (8)
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:10.320000 7 torch/_dynamo/convert_frame.py:1358] [6/8]    function: 'forward' (/usr/local/lib/python3.12/dist-packages/transformers/models/qwen3_moe/modeling_qwen3_moe.py:208)
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:10.320000 7 torch/_dynamo/convert_frame.py:1358] [6/8]    last reason: 6/7: self._modules['up_proj'].imatrix_cnt == 1345             # module.imatrix_cnt += input.shape[0]  # auto_round/compressors/base.py:1179 in get_imatrix_hook (HINT: torch.compile considers integer attributes of the nn.Module to be static. If you are observing recompilation, you might want to make this integer dynamic using torch._dynamo.config.allow_unspec_int_on_nn_module = True, or convert this integer into a tensor.)
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:10.320000 7 torch/_dynamo/convert_frame.py:1358] [6/8] To log all recompilation reasons, use TORCH_LOGS="recompiles".
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:10.320000 7 torch/_dynamo/convert_frame.py:1358] [6/8] To diagnose recompilation issues, see https://pytorch.org/docs/main/torch.compiler_troubleshooting.html
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:13.291000 7 torch/_dynamo/convert_frame.py:1358] [3/8] torch._dynamo hit config.recompile_limit (8)
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:13.291000 7 torch/_dynamo/convert_frame.py:1358] [3/8]    function: 'forward' (/usr/local/lib/python3.12/dist-packages/transformers/models/qwen3_moe/modeling_qwen3_moe.py:305)
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:13.291000 7 torch/_dynamo/convert_frame.py:1358] [3/8]    last reason: 3/7: self._modules['self_attn']._modules['k_proj'].imatrix_cnt == 56  # module.imatrix_cnt += input.shape[0]  # auto_round/compressors/base.py:1179 in get_imatrix_hook (HINT: torch.compile considers integer attributes of the nn.Module to be static. If you are observing recompilation, you might want to make this integer dynamic using torch._dynamo.config.allow_unspec_int_on_nn_module = True, or convert this integer into a tensor.)
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:13.291000 7 torch/_dynamo/convert_frame.py:1358] [3/8] To log all recompilation reasons, use TORCH_LOGS="recompiles".
chaiml-muster-v0e-lr1e5-71769-v1-uploader: W0209 10:19:13.291000 7 torch/_dynamo/convert_frame.py:1358] [3/8] To diagnose recompilation issues, see https://pytorch.org/docs/main/torch.compiler_troubleshooting.html
chaiml-muster-v0e-lr1e5-71769-v1-uploader: [33;1m2026-02-09 10:19:31 WARNING gguf.py L297: please use more data via setting `nsamples` to improve accuracy as calibration activations contain 0[0m
HTTP Request: %s %s "%s %d %s"
Retrying (%r) after connection broken by '%r': %s
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Unable to record family friendly update due to error: Invalid JSON input: Expecting value: line 1 column 1 (char 0)
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-muster-v0c-lr1e5e_3996_v3: HTTPConnectionPool(host='chaiml-muster-v0c-lr1e5e-3996-v3-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission function_genen_2026-01-12: ('http://guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com/models/chaiml-02f4-69d4-linear-w01_v8/predict', '{"detail":"1 validation error for RuntimeResponse\\npredictions\\n  Field required [type=missing, input_value={\'detail\': \'[Errno 104] Connection reset by peer\'}, input_type=dict]\\n    For further information visit https://errors.pydantic.dev/2.12/v/missing"}')
Failed to get response for submission chaiml-muster-v0d-lr1e5_93728_v3: HTTPConnectionPool(host='chaiml-muster-v0d-lr1e5-93728-v3-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
HTTP Request: %s %s "%s %d %s"
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
HTTP Request: %s %s "%s %d %s"
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Quantizing model.layers.0:   1%|          | 1/94 [01:35<2:27:51, 95.39s/it]
Quantizing model.layers.1:   1%|          | 1/94 [01:35<2:27:51, 95.39s/it]
Quantizing model.layers.1:   2%|▏         | 2/94 [02:24<1:44:46, 68.33s/it]
Quantizing model.layers.2:   2%|▏         | 2/94 [02:24<1:44:46, 68.33s/it]
Quantizing model.layers.2:   3%|▎         | 3/94 [03:13<1:30:15, 59.51s/it]
Quantizing model.layers.3:   3%|▎         | 3/94 [03:13<1:30:15, 59.51s/it]
Quantizing model.layers.3:   4%|▍         | 4/94 [04:02<1:22:41, 55.13s/it]
Quantizing model.layers.4:   4%|▍         | 4/94 [04:02<1:22:41, 55.13s/it]
Quantizing model.layers.4:   5%|▌         | 5/94 [04:51<1:18:53, 53.18s/it]
Quantizing model.layers.5:   5%|▌         | 5/94 [04:51<1:18:53, 53.18s/it]
Quantizing model.layers.5:   6%|▋         | 6/94 [05:42<1:16:38, 52.26s/it]
Quantizing model.layers.6:   6%|▋         | 6/94 [05:42<1:16:38, 52.26s/it]
Quantizing model.layers.6:   7%|▋         | 7/94 [06:32<1:14:48, 51.59s/it]
Quantizing model.layers.7:   7%|▋         | 7/94 [06:32<1:14:48, 51.59s/it]
Quantizing model.layers.7:   9%|▊         | 8/94 [07:22<1:13:07, 51.02s/it]
Quantizing model.layers.8:   9%|▊         | 8/94 [07:22<1:13:07, 51.02s/it]
Quantizing model.layers.8:  10%|▉         | 9/94 [08:11<1:11:24, 50.41s/it]
Quantizing model.layers.9:  10%|▉         | 9/94 [08:11<1:11:24, 50.41s/it]
Quantizing model.layers.9:  11%|█         | 10/94 [08:59<1:09:25, 49.59s/it]
Quantizing model.layers.10:  11%|█         | 10/94 [08:59<1:09:25, 49.59s/it]
Quantizing model.layers.10:  12%|█▏        | 11/94 [09:48<1:08:31, 49.53s/it]
Quantizing model.layers.11:  12%|█▏        | 11/94 [09:48<1:08:31, 49.53s/it]
Quantizing model.layers.11:  13%|█▎        | 12/94 [10:37<1:07:25, 49.33s/it]
Quantizing model.layers.12:  13%|█▎        | 12/94 [10:37<1:07:25, 49.33s/it]
Quantizing model.layers.12:  14%|█▍        | 13/94 [11:26<1:06:22, 49.17s/it]
Quantizing model.layers.13:  14%|█▍        | 13/94 [11:26<1:06:22, 49.17s/it]
Quantizing model.layers.13:  15%|█▍        | 14/94 [12:14<1:05:10, 48.88s/it]
Quantizing model.layers.14:  15%|█▍        | 14/94 [12:14<1:05:10, 48.88s/it]
Quantizing model.layers.14:  16%|█▌        | 15/94 [13:03<1:04:35, 49.06s/it]
Quantizing model.layers.15:  16%|█▌        | 15/94 [13:03<1:04:35, 49.06s/it]
Quantizing model.layers.15:  17%|█▋        | 16/94 [13:51<1:03:08, 48.57s/it]
Quantizing model.layers.16:  17%|█▋        | 16/94 [13:51<1:03:08, 48.57s/it]
Quantizing model.layers.16:  18%|█▊        | 17/94 [14:36<1:00:48, 47.38s/it]
Quantizing model.layers.17:  18%|█▊        | 17/94 [14:36<1:00:48, 47.38s/it]
Quantizing model.layers.17:  19%|█▉        | 18/94 [15:20<58:43, 46.36s/it]  
Quantizing model.layers.18:  19%|█▉        | 18/94 [15:20<58:43, 46.36s/it]
Quantizing model.layers.18:  20%|██        | 19/94 [16:03<57:02, 45.63s/it]
Quantizing model.layers.19:  20%|██        | 19/94 [16:03<57:02, 45.63s/it]
Quantizing model.layers.19:  21%|██▏       | 20/94 [16:47<55:36, 45.09s/it]
Quantizing model.layers.20:  21%|██▏       | 20/94 [16:47<55:36, 45.09s/it]
Quantizing model.layers.20:  22%|██▏       | 21/94 [17:31<54:24, 44.72s/it]
Quantizing model.layers.21:  22%|██▏       | 21/94 [17:31<54:24, 44.72s/it]
Quantizing model.layers.21:  23%|██▎       | 22/94 [18:15<53:16, 44.40s/it]
Quantizing model.layers.22:  23%|██▎       | 22/94 [18:15<53:16, 44.40s/it]
Quantizing model.layers.22:  24%|██▍       | 23/94 [18:58<52:11, 44.11s/it]
Quantizing model.layers.23:  24%|██▍       | 23/94 [18:58<52:11, 44.11s/it]
Quantizing model.layers.23:  26%|██▌       | 24/94 [19:42<51:22, 44.03s/it]
Quantizing model.layers.24:  26%|██▌       | 24/94 [19:42<51:22, 44.03s/it]
Quantizing model.layers.24:  27%|██▋       | 25/94 [20:26<50:39, 44.05s/it]
Quantizing model.layers.25:  27%|██▋       | 25/94 [20:26<50:39, 44.05s/it]
Quantizing model.layers.25:  28%|██▊       | 26/94 [21:10<49:52, 44.01s/it]
Quantizing model.layers.26:  28%|██▊       | 26/94 [21:10<49:52, 44.01s/it]
Quantizing model.layers.26:  29%|██▊       | 27/94 [21:54<49:07, 43.99s/it]
Quantizing model.layers.27:  29%|██▊       | 27/94 [21:54<49:07, 43.99s/it]
Quantizing model.layers.27:  30%|██▉       | 28/94 [22:38<48:19, 43.93s/it]
Quantizing model.layers.28:  30%|██▉       | 28/94 [22:38<48:19, 43.93s/it]
Quantizing model.layers.28:  31%|███       | 29/94 [23:21<47:21, 43.72s/it]
Quantizing model.layers.29:  31%|███       | 29/94 [23:21<47:21, 43.72s/it]
Quantizing model.layers.29:  32%|███▏      | 30/94 [24:04<46:28, 43.58s/it]
Quantizing model.layers.30:  32%|███▏      | 30/94 [24:04<46:28, 43.58s/it]
Quantizing model.layers.30:  33%|███▎      | 31/94 [24:48<45:46, 43.60s/it]
Quantizing model.layers.31:  33%|███▎      | 31/94 [24:48<45:46, 43.60s/it]
Quantizing model.layers.31:  34%|███▍      | 32/94 [25:31<44:54, 43.45s/it]
Quantizing model.layers.32:  34%|███▍      | 32/94 [25:31<44:54, 43.45s/it]
Quantizing model.layers.32:  35%|███▌      | 33/94 [26:14<44:08, 43.42s/it]
Quantizing model.layers.33:  35%|███▌      | 33/94 [26:14<44:08, 43.42s/it]
Quantizing model.layers.33:  36%|███▌      | 34/94 [26:58<43:23, 43.39s/it]
Quantizing model.layers.34:  36%|███▌      | 34/94 [26:58<43:23, 43.39s/it]
Quantizing model.layers.34:  37%|███▋      | 35/94 [27:41<42:37, 43.35s/it]
Quantizing model.layers.35:  37%|███▋      | 35/94 [27:41<42:37, 43.35s/it]
Quantizing model.layers.35:  38%|███▊      | 36/94 [28:24<41:56, 43.38s/it]
Quantizing model.layers.36:  38%|███▊      | 36/94 [28:24<41:56, 43.38s/it]
Quantizing model.layers.36:  39%|███▉      | 37/94 [29:08<41:15, 43.43s/it]
Quantizing model.layers.37:  39%|███▉      | 37/94 [29:08<41:15, 43.43s/it]
Quantizing model.layers.37:  40%|████      | 38/94 [29:52<40:38, 43.55s/it]
Quantizing model.layers.38:  40%|████      | 38/94 [29:52<40:38, 43.55s/it]
Quantizing model.layers.38:  41%|████▏     | 39/94 [30:36<40:00, 43.65s/it]
Quantizing model.layers.39:  41%|████▏     | 39/94 [30:36<40:00, 43.65s/it]
Quantizing model.layers.39:  43%|████▎     | 40/94 [31:20<39:19, 43.70s/it]
Quantizing model.layers.40:  43%|████▎     | 40/94 [31:20<39:19, 43.70s/it]
Quantizing model.layers.40:  44%|████▎     | 41/94 [32:05<38:56, 44.09s/it]
Quantizing model.layers.41:  44%|████▎     | 41/94 [32:05<38:56, 44.09s/it]
Quantizing model.layers.41:  45%|████▍     | 42/94 [32:49<38:11, 44.06s/it]
Quantizing model.layers.42:  45%|████▍     | 42/94 [32:49<38:11, 44.06s/it]
Quantizing model.layers.42:  46%|████▌     | 43/94 [33:32<37:12, 43.77s/it]
Quantizing model.layers.43:  46%|████▌     | 43/94 [33:32<37:12, 43.77s/it]
Quantizing model.layers.43:  47%|████▋     | 44/94 [34:15<36:17, 43.56s/it]
Quantizing model.layers.44:  47%|████▋     | 44/94 [34:15<36:17, 43.56s/it]
Quantizing model.layers.44:  48%|████▊     | 45/94 [34:58<35:28, 43.44s/it]
Quantizing model.layers.45:  48%|████▊     | 45/94 [34:58<35:28, 43.44s/it]
Quantizing model.layers.45:  49%|████▉     | 46/94 [35:41<34:43, 43.40s/it]
Quantizing model.layers.46:  49%|████▉     | 46/94 [35:41<34:43, 43.40s/it]
Quantizing model.layers.46:  50%|█████     | 47/94 [36:25<34:01, 43.44s/it]
Quantizing model.layers.47:  50%|█████     | 47/94 [36:25<34:01, 43.44s/it]
Quantizing model.layers.47:  51%|█████     | 48/94 [37:09<33:27, 43.64s/it]
Quantizing model.layers.48:  51%|█████     | 48/94 [37:09<33:27, 43.64s/it]
Quantizing model.layers.48:  52%|█████▏    | 49/94 [37:53<32:50, 43.78s/it]
Quantizing model.layers.49:  52%|█████▏    | 49/94 [37:53<32:50, 43.78s/it]
Quantizing model.layers.49:  53%|█████▎    | 50/94 [38:37<32:11, 43.90s/it]
Quantizing model.layers.50:  53%|█████▎    | 50/94 [38:37<32:11, 43.90s/it]
Quantizing model.layers.50:  54%|█████▍    | 51/94 [39:21<31:31, 44.00s/it]
Quantizing model.layers.51:  54%|█████▍    | 51/94 [39:21<31:31, 44.00s/it]
Quantizing model.layers.51:  55%|█████▌    | 52/94 [40:05<30:50, 44.07s/it]
Quantizing model.layers.52:  55%|█████▌    | 52/94 [40:05<30:50, 44.07s/it]
Quantizing model.layers.52:  56%|█████▋    | 53/94 [40:50<30:06, 44.07s/it]
Quantizing model.layers.53:  56%|█████▋    | 53/94 [40:50<30:06, 44.07s/it]
Quantizing model.layers.53:  57%|█████▋    | 54/94 [41:34<29:22, 44.06s/it]
Quantizing model.layers.54:  57%|█████▋    | 54/94 [41:34<29:22, 44.06s/it]
Quantizing model.layers.54:  59%|█████▊    | 55/94 [42:18<28:39, 44.08s/it]
Quantizing model.layers.55:  59%|█████▊    | 55/94 [42:18<28:39, 44.08s/it]
Quantizing model.layers.55:  60%|█████▉    | 56/94 [43:02<28:02, 44.28s/it]
Quantizing model.layers.56:  60%|█████▉    | 56/94 [43:02<28:02, 44.28s/it]
Quantizing model.layers.56:  61%|██████    | 57/94 [43:46<27:08, 44.00s/it]
Quantizing model.layers.57:  61%|██████    | 57/94 [43:46<27:08, 44.00s/it]
Quantizing model.layers.57:  62%|██████▏   | 58/94 [44:29<26:17, 43.82s/it]
Quantizing model.layers.58:  62%|██████▏   | 58/94 [44:29<26:17, 43.82s/it]
Quantizing model.layers.58:  63%|██████▎   | 59/94 [45:13<25:28, 43.68s/it]
Quantizing model.layers.59:  63%|██████▎   | 59/94 [45:13<25:28, 43.68s/it]
Quantizing model.layers.59:  64%|██████▍   | 60/94 [45:56<24:39, 43.53s/it]
Quantizing model.layers.60:  64%|██████▍   | 60/94 [45:56<24:39, 43.53s/it]
Quantizing model.layers.60:  65%|██████▍   | 61/94 [46:39<23:53, 43.45s/it]
Quantizing model.layers.61:  65%|██████▍   | 61/94 [46:39<23:53, 43.45s/it]
Quantizing model.layers.61:  66%|██████▌   | 62/94 [47:22<23:08, 43.40s/it]
Quantizing model.layers.62:  66%|██████▌   | 62/94 [47:22<23:08, 43.40s/it]
Quantizing model.layers.62:  67%|██████▋   | 63/94 [48:05<22:22, 43.31s/it]
Quantizing model.layers.63:  67%|██████▋   | 63/94 [48:05<22:22, 43.31s/it]
Quantizing model.layers.63:  68%|██████▊   | 64/94 [48:49<21:37, 43.24s/it]
Quantizing model.layers.64:  68%|██████▊   | 64/94 [48:49<21:37, 43.24s/it]
Quantizing model.layers.64:  69%|██████▉   | 65/94 [49:32<20:52, 43.19s/it]
Quantizing model.layers.65:  69%|██████▉   | 65/94 [49:32<20:52, 43.19s/it]
Quantizing model.layers.65:  70%|███████   | 66/94 [50:15<20:08, 43.17s/it]
Quantizing model.layers.66:  70%|███████   | 66/94 [50:15<20:08, 43.17s/it]
Quantizing model.layers.66:  71%|███████▏  | 67/94 [50:59<19:32, 43.43s/it]
Quantizing model.layers.67:  71%|███████▏  | 67/94 [50:59<19:32, 43.43s/it]
Quantizing model.layers.67:  72%|███████▏  | 68/94 [51:43<18:51, 43.54s/it]
Quantizing model.layers.68:  72%|███████▏  | 68/94 [51:43<18:51, 43.54s/it]
Quantizing model.layers.68:  73%|███████▎  | 69/94 [52:26<18:11, 43.64s/it]
Quantizing model.layers.69:  73%|███████▎  | 69/94 [52:26<18:11, 43.64s/it]
Quantizing model.layers.69:  74%|███████▍  | 70/94 [53:10<17:29, 43.74s/it]
Quantizing model.layers.70:  74%|███████▍  | 70/94 [53:10<17:29, 43.74s/it]
Quantizing model.layers.70:  76%|███████▌  | 71/94 [53:54<16:47, 43.80s/it]
Quantizing model.layers.71:  76%|███████▌  | 71/94 [53:54<16:47, 43.80s/it]
Quantizing model.layers.71:  77%|███████▋  | 72/94 [54:38<16:04, 43.82s/it]
Quantizing model.layers.72:  77%|███████▋  | 72/94 [54:38<16:04, 43.82s/it]
Quantizing model.layers.72:  78%|███████▊  | 73/94 [55:22<15:21, 43.86s/it]
Quantizing model.layers.73:  78%|███████▊  | 73/94 [55:22<15:21, 43.86s/it]
Quantizing model.layers.73:  79%|███████▊  | 74/94 [56:06<14:37, 43.86s/it]
Quantizing model.layers.74:  79%|███████▊  | 74/94 [56:06<14:37, 43.86s/it]
Quantizing model.layers.74:  80%|███████▉  | 75/94 [56:50<13:54, 43.91s/it]
Quantizing model.layers.75:  80%|███████▉  | 75/94 [56:50<13:54, 43.91s/it]
Quantizing model.layers.75:  81%|████████  | 76/94 [57:34<13:10, 43.94s/it]
Quantizing model.layers.76:  81%|████████  | 76/94 [57:34<13:10, 43.94s/it]
Quantizing model.layers.76:  82%|████████▏ | 77/94 [58:18<12:26, 43.93s/it]
Quantizing model.layers.77:  82%|████████▏ | 77/94 [58:18<12:26, 43.93s/it]
Quantizing model.layers.77:  83%|████████▎ | 78/94 [59:02<11:43, 43.98s/it]
Quantizing model.layers.78:  83%|████████▎ | 78/94 [59:02<11:43, 43.98s/it]
Quantizing model.layers.78:  84%|████████▍ | 79/94 [59:46<11:00, 44.01s/it]
Quantizing model.layers.79:  84%|████████▍ | 79/94 [59:46<11:00, 44.01s/it]
Quantizing model.layers.79:  85%|████████▌ | 80/94 [1:00:30<10:15, 43.99s/it]
Quantizing model.layers.80:  85%|████████▌ | 80/94 [1:00:30<10:15, 43.99s/it]
Quantizing model.layers.80:  86%|████████▌ | 81/94 [1:01:14<09:31, 43.98s/it]
Quantizing model.layers.81:  86%|████████▌ | 81/94 [1:01:14<09:31, 43.98s/it]
Quantizing model.layers.81:  87%|████████▋ | 82/94 [1:01:58<08:47, 43.98s/it]
Quantizing model.layers.82:  87%|████████▋ | 82/94 [1:01:58<08:47, 43.98s/it]
Quantizing model.layers.82:  88%|████████▊ | 83/94 [1:02:42<08:03, 43.99s/it]
Quantizing model.layers.83:  88%|████████▊ | 83/94 [1:02:42<08:03, 43.99s/it]
Quantizing model.layers.83:  89%|████████▉ | 84/94 [1:03:25<07:17, 43.77s/it]
Quantizing model.layers.84:  89%|████████▉ | 84/94 [1:03:25<07:17, 43.77s/it]
Quantizing model.layers.84:  90%|█████████ | 85/94 [1:04:09<06:32, 43.64s/it]
Quantizing model.layers.85:  90%|█████████ | 85/94 [1:04:09<06:32, 43.64s/it]
Quantizing model.layers.85:  91%|█████████▏| 86/94 [1:04:52<05:48, 43.56s/it]
Quantizing model.layers.86:  91%|█████████▏| 86/94 [1:04:52<05:48, 43.56s/it]
Quantizing model.layers.86:  93%|█████████▎| 87/94 [1:05:35<05:04, 43.45s/it]
Quantizing model.layers.87:  93%|█████████▎| 87/94 [1:05:35<05:04, 43.45s/it]
Quantizing model.layers.87:  94%|█████████▎| 88/94 [1:06:18<04:20, 43.42s/it]
Quantizing model.layers.88:  94%|█████████▎| 88/94 [1:06:18<04:20, 43.42s/it]
Quantizing model.layers.88:  95%|█████████▍| 89/94 [1:07:02<03:36, 43.38s/it]
Quantizing model.layers.89:  95%|█████████▍| 89/94 [1:07:02<03:36, 43.38s/it]
Quantizing model.layers.89:  96%|█████████▌| 90/94 [1:07:45<02:53, 43.32s/it]
Quantizing model.layers.90:  96%|█████████▌| 90/94 [1:07:45<02:53, 43.32s/it]
Quantizing model.layers.90:  97%|█████████▋| 91/94 [1:08:29<02:10, 43.46s/it]
Quantizing model.layers.91:  97%|█████████▋| 91/94 [1:08:29<02:10, 43.46s/it]
Quantizing model.layers.91:  98%|█████████▊| 92/94 [1:09:12<01:26, 43.40s/it]
Quantizing model.layers.92:  98%|█████████▊| 92/94 [1:09:12<01:26, 43.40s/it]
Quantizing model.layers.92:  99%|█████████▉| 93/94 [1:09:55<00:43, 43.39s/it]
Quantizing model.layers.93:  99%|█████████▉| 93/94 [1:09:55<00:43, 43.39s/it]
Quantizing model.layers.93: 100%|██████████| 94/94 [1:10:39<00:00, 43.37s/it]
Quantizing model.layers.93: 100%|██████████| 94/94 [1:10:39<00:00, 45.10s/it]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  0%|          | 0/36566 [00:00<?, ?it/s]
packing model.layers.0.mlp.gate:   0%|          | 0/36566 [00:00<?, ?it/s]
packing model.layers.0.mlp.gate:   0%|          | 1/36566 [00:01<10:55:26,  1.08s/it]
packing model.layers.1.mlp.gate:   0%|          | 1/36566 [00:01<10:55:26,  1.08s/it]
packing model.layers.2.mlp.gate:   0%|          | 2/36566 [00:01<10:55:25,  1.08s/it]
packing model.layers.3.mlp.gate:   0%|          | 3/36566 [00:01<10:55:24,  1.08s/it]
packing model.layers.4.mlp.gate:   0%|          | 4/36566 [00:01<10:55:23,  1.08s/it]
packing model.layers.5.mlp.gate:   0%|          | 5/36566 [00:01<10:55:22,  1.08s/it]
packing model.layers.6.mlp.gate:   0%|          | 6/36566 [00:01<10:55:20,  1.08s/it]
packing model.layers.7.mlp.gate:   0%|          | 7/36566 [00:01<10:55:19,  1.08s/it]
packing model.layers.8.mlp.gate:   0%|          | 8/36566 [00:01<10:55:18,  1.08s/it]
packing model.layers.9.mlp.gate:   0%|          | 9/36566 [00:01<10:55:17,  1.08s/it]
packing model.layers.10.mlp.gate:   0%|          | 10/36566 [00:01<10:55:16,  1.08s/it]
packing model.layers.11.mlp.gate:   0%|          | 11/36566 [00:01<10:55:15,  1.08s/it]
packing model.layers.12.mlp.gate:   0%|          | 12/36566 [00:01<10:55:14,  1.08s/it]
packing model.layers.13.mlp.gate:   0%|          | 13/36566 [00:01<10:55:13,  1.08s/it]
packing model.layers.14.mlp.gate:   0%|          | 14/36566 [00:01<10:55:12,  1.08s/it]
packing model.layers.15.mlp.gate:   0%|          | 15/36566 [00:01<10:55:11,  1.08s/it]
packing model.layers.16.mlp.gate:   0%|          | 16/36566 [00:01<10:55:10,  1.08s/it]
packing model.layers.17.mlp.gate:   0%|          | 17/36566 [00:01<10:55:09,  1.08s/it]
packing model.layers.18.mlp.gate:   0%|          | 18/36566 [00:01<10:55:08,  1.08s/it]
packing model.layers.19.mlp.gate:   0%|          | 19/36566 [00:01<10:55:06,  1.08s/it]
packing model.layers.20.mlp.gate:   0%|          | 20/36566 [00:01<10:55:05,  1.08s/it]
packing model.layers.21.mlp.gate:   0%|          | 21/36566 [00:01<10:55:04,  1.08s/it]
packing model.layers.22.mlp.gate:   0%|          | 22/36566 [00:01<10:55:03,  1.08s/it]
packing model.layers.23.mlp.gate:   0%|          | 23/36566 [00:01<10:55:02,  1.08s/it]
packing model.layers.24.mlp.gate:   0%|          | 24/36566 [00:01<10:55:01,  1.08s/it]
packing model.layers.25.mlp.gate:   0%|          | 25/36566 [00:01<10:55:00,  1.08s/it]
packing model.layers.26.mlp.gate:   0%|          | 26/36566 [00:01<10:54:59,  1.08s/it]
packing model.layers.27.mlp.gate:   0%|          | 27/36566 [00:01<10:54:58,  1.08s/it]
packing model.layers.28.mlp.gate:   0%|          | 28/36566 [00:01<10:54:57,  1.08s/it]
packing model.layers.29.mlp.gate:   0%|          | 29/36566 [00:01<10:54:56,  1.08s/it]
packing model.layers.30.mlp.gate:   0%|          | 30/36566 [00:01<10:54:55,  1.08s/it]
packing model.layers.31.mlp.gate:   0%|          | 31/36566 [00:01<10:54:54,  1.08s/it]
packing model.layers.32.mlp.gate:   0%|          | 32/36566 [00:01<10:54:52,  1.08s/it]
packing model.layers.33.mlp.gate:   0%|          | 33/36566 [00:01<10:54:51,  1.08s/it]
packing model.layers.34.mlp.gate:   0%|          | 34/36566 [00:01<10:54:50,  1.08s/it]
packing model.layers.35.mlp.gate:   0%|          | 35/36566 [00:01<10:54:49,  1.08s/it]
packing model.layers.36.mlp.gate:   0%|          | 36/36566 [00:01<10:54:48,  1.08s/it]
packing model.layers.37.mlp.gate:   0%|          | 37/36566 [00:01<10:54:47,  1.08s/it]
packing model.layers.38.mlp.gate:   0%|          | 38/36566 [00:01<10:54:46,  1.08s/it]
packing model.layers.39.mlp.gate:   0%|          | 39/36566 [00:01<10:54:45,  1.08s/it]
packing model.layers.40.mlp.gate:   0%|          | 40/36566 [00:01<10:54:44,  1.08s/it]
packing model.layers.41.mlp.gate:   0%|          | 41/36566 [00:01<10:54:43,  1.08s/it]
packing model.layers.42.mlp.gate:   0%|          | 42/36566 [00:01<10:54:42,  1.08s/it]
packing model.layers.43.mlp.gate:   0%|          | 43/36566 [00:01<10:54:41,  1.08s/it]
packing model.layers.44.mlp.gate:   0%|          | 44/36566 [00:01<10:54:40,  1.08s/it]
packing model.layers.45.mlp.gate:   0%|          | 45/36566 [00:01<10:54:38,  1.08s/it]
packing model.layers.46.mlp.gate:   0%|          | 46/36566 [00:01<10:54:37,  1.08s/it]
packing model.layers.47.mlp.gate:   0%|          | 47/36566 [00:01<10:54:36,  1.08s/it]
packing model.layers.48.mlp.gate:   0%|          | 48/36566 [00:01<10:54:35,  1.08s/it]
packing model.layers.49.mlp.gate:   0%|          | 49/36566 [00:01<10:54:34,  1.08s/it]
packing model.layers.50.mlp.gate:   0%|          | 50/36566 [00:01<10:54:33,  1.08s/it]
packing model.layers.51.mlp.gate:   0%|          | 51/36566 [00:01<10:54:32,  1.08s/it]
packing model.layers.52.mlp.gate:   0%|          | 52/36566 [00:01<10:54:31,  1.08s/it]
packing model.layers.53.mlp.gate:   0%|          | 53/36566 [00:01<10:54:30,  1.08s/it]
packing model.layers.54.mlp.gate:   0%|          | 54/36566 [00:01<10:54:29,  1.08s/it]
packing model.layers.55.mlp.gate:   0%|          | 55/36566 [00:01<10:54:28,  1.08s/it]
packing model.layers.56.mlp.gate:   0%|          | 56/36566 [00:01<10:54:27,  1.08s/it]
packing model.layers.57.mlp.gate:   0%|          | 57/36566 [00:01<10:54:26,  1.08s/it]
packing model.layers.58.mlp.gate:   0%|          | 58/36566 [00:01<10:54:24,  1.08s/it]
packing model.layers.59.mlp.gate:   0%|          | 59/36566 [00:01<10:54:23,  1.08s/it]
packing model.layers.60.mlp.gate:   0%|          | 60/36566 [00:01<10:54:22,  1.08s/it]
packing model.layers.61.mlp.gate:   0%|          | 61/36566 [00:01<10:54:21,  1.08s/it]
packing model.layers.62.mlp.gate:   0%|          | 62/36566 [00:01<10:54:20,  1.08s/it]
packing model.layers.63.mlp.gate:   0%|          | 63/36566 [00:01<10:54:19,  1.08s/it]
packing model.layers.64.mlp.gate:   0%|          | 64/36566 [00:01<10:54:18,  1.08s/it]
packing model.layers.65.mlp.gate:   0%|          | 65/36566 [00:01<10:54:17,  1.08s/it]
packing model.layers.66.mlp.gate:   0%|          | 66/36566 [00:01<10:54:16,  1.08s/it]
packing model.layers.67.mlp.gate:   0%|          | 67/36566 [00:01<10:54:15,  1.08s/it]
packing model.layers.68.mlp.gate:   0%|          | 68/36566 [00:01<10:54:14,  1.08s/it]
packing model.layers.69.mlp.gate:   0%|          | 69/36566 [00:01<10:54:13,  1.08s/it]
packing model.layers.70.mlp.gate:   0%|          | 70/36566 [00:01<10:54:12,  1.08s/it]
packing model.layers.71.mlp.gate:   0%|          | 71/36566 [00:01<10:54:11,  1.08s/it]
packing model.layers.72.mlp.gate:   0%|          | 72/36566 [00:01<10:54:09,  1.08s/it]
packing model.layers.73.mlp.gate:   0%|          | 73/36566 [00:01<10:54:08,  1.08s/it]
packing model.layers.74.mlp.gate:   0%|          | 74/36566 [00:01<10:54:07,  1.08s/it]
packing model.layers.75.mlp.gate:   0%|          | 75/36566 [00:01<10:54:06,  1.08s/it]
packing model.layers.76.mlp.gate:   0%|          | 76/36566 [00:01<10:54:05,  1.08s/it]
packing model.layers.77.mlp.gate:   0%|          | 77/36566 [00:01<10:54:04,  1.08s/it]
packing model.layers.78.mlp.gate:   0%|          | 78/36566 [00:01<10:54:03,  1.08s/it]
packing model.layers.79.mlp.gate:   0%|          | 79/36566 [00:01<10:54:02,  1.08s/it]
packing model.layers.80.mlp.gate:   0%|          | 80/36566 [00:01<10:54:01,  1.08s/it]
packing model.layers.81.mlp.gate:   0%|          | 81/36566 [00:01<10:54:00,  1.08s/it]
packing model.layers.82.mlp.gate:   0%|          | 82/36566 [00:01<10:53:59,  1.08s/it]
packing model.layers.83.mlp.gate:   0%|          | 83/36566 [00:01<10:53:58,  1.08s/it]
packing model.layers.84.mlp.gate:   0%|          | 84/36566 [00:01<10:53:57,  1.08s/it]
packing model.layers.85.mlp.gate:   0%|          | 85/36566 [00:01<10:53:55,  1.08s/it]
packing model.layers.86.mlp.gate:   0%|          | 86/36566 [00:01<10:53:54,  1.08s/it]
packing model.layers.87.mlp.gate:   0%|          | 87/36566 [00:01<10:53:53,  1.08s/it]
packing model.layers.88.mlp.gate:   0%|          | 88/36566 [00:01<10:53:52,  1.08s/it]
packing model.layers.89.mlp.gate:   0%|          | 89/36566 [00:01<10:53:51,  1.08s/it]
packing model.layers.90.mlp.gate:   0%|          | 90/36566 [00:01<10:53:50,  1.08s/it]
packing model.layers.91.mlp.gate:   0%|          | 91/36566 [00:01<10:53:49,  1.08s/it]
packing model.layers.92.mlp.gate:   0%|          | 92/36566 [00:01<10:53:48,  1.08s/it]
packing model.layers.93.mlp.gate:   0%|          | 93/36566 [00:01<10:53:47,  1.08s/it]
packing model.layers.0.self_attn.k_proj:   0%|          | 94/36566 [00:01<10:53:46,  1.08s/it]
packing model.layers.1.self_attn.k_proj:   0%|          | 95/36566 [00:01<10:53:45,  1.08s/it]
packing model.layers.2.self_attn.k_proj:   0%|          | 96/36566 [00:01<10:53:44,  1.08s/it]
packing model.layers.3.self_attn.k_proj:   0%|          | 97/36566 [00:01<10:53:43,  1.08s/it]
packing model.layers.4.self_attn.k_proj:   0%|          | 98/36566 [00:01<10:53:41,  1.08s/it]
packing model.layers.5.self_attn.k_proj:   0%|          | 99/36566 [00:01<10:53:40,  1.08s/it]
packing model.layers.6.self_attn.k_proj:   0%|          | 100/36566 [00:01<10:53:39,  1.08s/it]
packing model.layers.7.self_attn.k_proj:   0%|          | 101/36566 [00:01<10:53:38,  1.08s/it]
packing model.layers.8.self_attn.k_proj:   0%|          | 102/36566 [00:01<10:53:37,  1.08s/it]
packing model.layers.9.self_attn.k_proj:   0%|          | 103/36566 [00:01<10:53:36,  1.08s/it]
packing model.layers.10.self_attn.k_proj:   0%|          | 104/36566 [00:01<10:53:35,  1.08s/it]
packing model.layers.11.self_attn.k_proj:   0%|          | 105/36566 [00:01<10:53:34,  1.08s/it]
packing model.layers.12.self_attn.k_proj:   0%|          | 106/36566 [00:01<10:53:33,  1.08s/it]
packing model.layers.13.self_attn.k_proj:   0%|          | 107/36566 [00:01<10:53:32,  1.08s/it]
packing model.layers.14.self_attn.k_proj:   0%|          | 108/36566 [00:01<10:53:31,  1.08s/it]
packing model.layers.15.self_attn.k_proj:   0%|          | 109/36566 [00:01<10:53:30,  1.08s/it]
packing model.layers.16.self_attn.k_proj:   0%|          | 110/36566 [00:01<10:53:29,  1.08s/it]
packing model.layers.17.self_attn.k_proj:   0%|          | 111/36566 [00:01<10:53:27,  1.08s/it]
packing model.layers.18.self_attn.k_proj:   0%|          | 112/36566 [00:01<10:53:26,  1.08s/it]
packing model.layers.19.self_attn.k_proj:   0%|          | 113/36566 [00:01<10:53:25,  1.08s/it]
packing model.layers.20.self_attn.k_proj:   0%|          | 114/36566 [00:01<10:53:24,  1.08s/it]
packing model.layers.21.self_attn.k_proj:   0%|          | 115/36566 [00:01<10:53:23,  1.08s/it]
packing model.layers.21.self_attn.k_proj:   0%|          | 116/36566 [00:01<04:28, 135.61it/s]  
packing model.layers.22.self_attn.k_proj:   0%|          | 116/36566 [00:01<04:28, 135.61it/s]
packing model.layers.23.self_attn.k_proj:   0%|          | 117/36566 [00:01<04:28, 135.61it/s]
packing model.layers.24.self_attn.k_proj:   0%|          | 118/36566 [00:01<04:28, 135.61it/s]
packing model.layers.25.self_attn.k_proj:   0%|          | 119/36566 [00:01<04:28, 135.61it/s]
packing model.layers.26.self_attn.k_proj:   0%|          | 120/36566 [00:01<04:28, 135.61it/s]
packing model.layers.27.self_attn.k_proj:   0%|          | 121/36566 [00:01<04:28, 135.61it/s]
packing model.layers.28.self_attn.k_proj:   0%|          | 122/36566 [00:01<04:28, 135.61it/s]
packing model.layers.29.self_attn.k_proj:   0%|          | 123/36566 [00:01<04:28, 135.61it/s]
packing model.layers.30.self_attn.k_proj:   0%|          | 124/36566 [00:01<04:28, 135.61it/s]
packing model.layers.31.self_attn.k_proj:   0%|          | 125/36566 [00:01<04:28, 135.61it/s]
packing model.layers.32.self_attn.k_proj:   0%|          | 126/36566 [00:01<04:28, 135.61it/s]
packing model.layers.33.self_attn.k_proj:   0%|          | 127/36566 [00:01<04:28, 135.61it/s]
packing model.layers.34.self_attn.k_proj:   0%|          | 128/36566 [00:01<04:28, 135.61it/s]
packing model.layers.35.self_attn.k_proj:   0%|          | 129/36566 [00:01<04:28, 135.61it/s]
packing model.layers.36.self_attn.k_proj:   0%|          | 130/36566 [00:01<04:28, 135.61it/s]
packing model.layers.37.self_attn.k_proj:   0%|          | 131/36566 [00:01<04:28, 135.61it/s]
packing model.layers.38.self_attn.k_proj:   0%|          | 132/36566 [00:01<04:28, 135.61it/s]
packing model.layers.39.self_attn.k_proj:   0%|          | 133/36566 [00:01<04:28, 135.61it/s]
packing model.layers.40.self_attn.k_proj:   0%|          | 134/36566 [00:01<04:28, 135.61it/s]
packing model.layers.41.self_attn.k_proj:   0%|          | 135/36566 [00:01<04:28, 135.61it/s]
packing model.layers.42.self_attn.k_proj:   0%|          | 136/36566 [00:01<04:28, 135.61it/s]
packing model.layers.43.self_attn.k_proj:   0%|          | 137/36566 [00:01<04:28, 135.61it/s]
packing model.layers.44.self_attn.k_proj:   0%|          | 138/36566 [00:01<04:28, 135.61it/s]
packing model.layers.45.self_attn.k_proj:   0%|          | 139/36566 [00:01<04:28, 135.61it/s]
packing model.layers.46.self_attn.k_proj:   0%|          | 140/36566 [00:01<04:28, 135.61it/s]
packing model.layers.47.self_attn.k_proj:   0%|          | 141/36566 [00:01<04:28, 135.61it/s]
packing model.layers.48.self_attn.k_proj:   0%|          | 142/36566 [00:01<04:28, 135.61it/s]
packing model.layers.49.self_attn.k_proj:   0%|          | 143/36566 [00:01<04:28, 135.61it/s]
packing model.layers.50.self_attn.k_proj:   0%|          | 144/36566 [00:01<04:28, 135.61it/s]
packing model.layers.51.self_attn.k_proj:   0%|          | 145/36566 [00:01<04:28, 135.61it/s]
packing model.layers.52.self_attn.k_proj:   0%|          | 146/36566 [00:01<04:28, 135.61it/s]
packing model.layers.53.self_attn.k_proj:   0%|          | 147/36566 [00:01<04:28, 135.61it/s]
packing model.layers.54.self_attn.k_proj:   0%|          | 148/36566 [00:01<04:28, 135.61it/s]
packing model.layers.55.self_attn.k_proj:   0%|          | 149/36566 [00:01<04:28, 135.61it/s]
packing model.layers.56.self_attn.k_proj:   0%|          | 150/36566 [00:01<04:28, 135.61it/s]
packing model.layers.57.self_attn.k_proj:   0%|          | 151/36566 [00:01<04:28, 135.61it/s]
packing model.layers.58.self_attn.k_proj:   0%|          | 152/36566 [00:01<04:28, 135.61it/s]
packing model.layers.59.self_attn.k_proj:   0%|          | 153/36566 [00:01<04:28, 135.61it/s]
packing model.layers.60.self_attn.k_proj:   0%|          | 154/36566 [00:01<04:28, 135.61it/s]
packing model.layers.61.self_attn.k_proj:   0%|          | 155/36566 [00:01<04:28, 135.61it/s]
packing model.layers.62.self_attn.k_proj:   0%|          | 156/36566 [00:01<04:28, 135.61it/s]
packing model.layers.63.self_attn.k_proj:   0%|          | 157/36566 [00:01<04:28, 135.61it/s]
packing model.layers.64.self_attn.k_proj:   0%|          | 158/36566 [00:01<04:28, 135.61it/s]
packing model.layers.65.self_attn.k_proj:   0%|          | 159/36566 [00:01<04:28, 135.61it/s]
packing model.layers.66.self_attn.k_proj:   0%|          | 160/36566 [00:01<04:28, 135.61it/s]
packing model.layers.67.self_attn.k_proj:   0%|          | 161/36566 [00:01<04:28, 135.61it/s]
packing model.layers.68.self_attn.k_proj:   0%|          | 162/36566 [00:01<04:28, 135.61it/s]
packing model.layers.69.self_attn.k_proj:   0%|          | 163/36566 [00:01<04:28, 135.61it/s]
packing model.layers.70.self_attn.k_proj:   0%|          | 164/36566 [00:01<04:28, 135.61it/s]
packing model.layers.71.self_attn.k_proj:   0%|          | 165/36566 [00:01<04:28, 135.61it/s]
packing model.layers.72.self_attn.k_proj:   0%|          | 166/36566 [00:01<04:28, 135.61it/s]
packing model.layers.73.self_attn.k_proj:   0%|          | 167/36566 [00:01<04:28, 135.61it/s]
packing model.layers.74.self_attn.k_proj:   0%|          | 168/36566 [00:01<04:28, 135.61it/s]
packing model.layers.75.self_attn.k_proj:   0%|          | 169/36566 [00:01<04:28, 135.61it/s]
packing model.layers.76.self_attn.k_proj:   0%|          | 170/36566 [00:01<04:28, 135.61it/s]
packing model.layers.77.self_attn.k_proj:   0%|          | 171/36566 [00:01<04:28, 135.61it/s]
packing model.layers.78.self_attn.k_proj:   0%|          | 172/36566 [00:01<04:28, 135.61it/s]
packing model.layers.79.self_attn.k_proj:   0%|          | 173/36566 [00:01<04:28, 135.61it/s]
packing model.layers.80.self_attn.k_proj:   0%|          | 174/36566 [00:01<04:28, 135.61it/s]
packing model.layers.81.self_attn.k_proj:   0%|          | 175/36566 [00:01<04:28, 135.61it/s]
packing model.layers.82.self_attn.k_proj:   0%|          | 176/36566 [00:01<04:28, 135.61it/s]
packing model.layers.83.self_attn.k_proj:   0%|          | 177/36566 [00:01<04:28, 135.61it/s]
packing model.layers.84.self_attn.k_proj:   0%|          | 178/36566 [00:01<04:28, 135.61it/s]
packing model.layers.85.self_attn.k_proj:   0%|          | 179/36566 [00:01<04:28, 135.61it/s]
packing model.layers.86.self_attn.k_proj:   0%|          | 180/36566 [00:01<04:28, 135.61it/s]
packing model.layers.87.self_attn.k_proj:   0%|          | 181/36566 [00:01<04:28, 135.61it/s]
packing model.layers.88.self_attn.k_proj:   0%|          | 182/36566 [00:01<04:28, 135.61it/s]
packing model.layers.89.self_attn.k_proj:   1%|          | 183/36566 [00:01<04:28, 135.61it/s]
packing model.layers.90.self_attn.k_proj:   1%|          | 184/36566 [00:01<04:28, 135.61it/s]
packing model.layers.91.self_attn.k_proj:   1%|          | 185/36566 [00:01<04:28, 135.61it/s]
packing model.layers.92.self_attn.k_proj:   1%|          | 186/36566 [00:01<04:28, 135.61it/s]
packing model.layers.93.self_attn.k_proj:   1%|          | 187/36566 [00:01<04:28, 135.61it/s]
packing model.layers.0.self_attn.o_proj:   1%|          | 188/36566 [00:01<04:28, 135.61it/s] 
packing model.layers.1.self_attn.o_proj:   1%|          | 189/36566 [00:01<04:28, 135.61it/s]
packing model.layers.2.self_attn.o_proj:   1%|          | 190/36566 [00:01<04:28, 135.61it/s]
packing model.layers.3.self_attn.o_proj:   1%|          | 191/36566 [00:01<04:28, 135.61it/s]
packing model.layers.4.self_attn.o_proj:   1%|          | 192/36566 [00:01<04:28, 135.61it/s]
packing model.layers.5.self_attn.o_proj:   1%|          | 193/36566 [00:01<04:28, 135.61it/s]
packing model.layers.6.self_attn.o_proj:   1%|          | 194/36566 [00:01<04:28, 135.61it/s]
packing model.layers.7.self_attn.o_proj:   1%|          | 195/36566 [00:01<04:28, 135.61it/s]
packing model.layers.8.self_attn.o_proj:   1%|          | 196/36566 [00:01<04:28, 135.61it/s]
packing model.layers.9.self_attn.o_proj:   1%|          | 197/36566 [00:01<04:28, 135.61it/s]
packing model.layers.10.self_attn.o_proj:   1%|          | 198/36566 [00:01<04:28, 135.61it/s]
packing model.layers.11.self_attn.o_proj:   1%|          | 199/36566 [00:01<04:28, 135.61it/s]
packing model.layers.12.self_attn.o_proj:   1%|          | 200/36566 [00:01<04:28, 135.61it/s]
packing model.layers.13.self_attn.o_proj:   1%|          | 201/36566 [00:01<04:28, 135.61it/s]
packing model.layers.14.self_attn.o_proj:   1%|          | 202/36566 [00:01<04:28, 135.61it/s]
packing model.layers.15.self_attn.o_proj:   1%|          | 203/36566 [00:01<04:28, 135.61it/s]
packing model.layers.16.self_attn.o_proj:   1%|          | 204/36566 [00:01<04:28, 135.61it/s]
packing model.layers.17.self_attn.o_proj:   1%|          | 205/36566 [00:01<04:28, 135.61it/s]
packing model.layers.18.self_attn.o_proj:   1%|          | 206/36566 [00:01<04:28, 135.61it/s]
packing model.layers.19.self_attn.o_proj:   1%|          | 207/36566 [00:01<04:28, 135.61it/s]
packing model.layers.20.self_attn.o_proj:   1%|          | 208/36566 [00:01<04:28, 135.61it/s]
packing model.layers.21.self_attn.o_proj:   1%|          | 209/36566 [00:01<04:28, 135.61it/s]
packing model.layers.22.self_attn.o_proj:   1%|          | 210/36566 [00:01<04:28, 135.61it/s]
packing model.layers.23.self_attn.o_proj:   1%|          | 211/36566 [00:01<04:28, 135.61it/s]
packing model.layers.24.self_attn.o_proj:   1%|          | 212/36566 [00:01<04:28, 135.61it/s]
packing model.layers.25.self_attn.o_proj:   1%|          | 213/36566 [00:01<04:28, 135.61it/s]
packing model.layers.26.self_attn.o_proj:   1%|          | 214/36566 [00:01<04:28, 135.61it/s]
packing model.layers.27.self_attn.o_proj:   1%|          | 215/36566 [00:01<04:28, 135.61it/s]
packing model.layers.28.self_attn.o_proj:   1%|          | 216/36566 [00:01<04:28, 135.61it/s]
packing model.layers.29.self_attn.o_proj:   1%|          | 217/36566 [00:01<04:28, 135.61it/s]
packing model.layers.30.self_attn.o_proj:   1%|          | 218/36566 [00:01<04:28, 135.61it/s]
packing model.layers.31.self_attn.o_proj:   1%|          | 219/36566 [00:01<04:28, 135.61it/s]
packing model.layers.32.self_attn.o_proj:   1%|          | 220/36566 [00:01<04:28, 135.61it/s]
packing model.layers.33.self_attn.o_proj:   1%|          | 221/36566 [00:01<04:28, 135.61it/s]
packing model.layers.34.self_attn.o_proj:   1%|          | 222/36566 [00:01<04:28, 135.61it/s]
packing model.layers.35.self_attn.o_proj:   1%|          | 223/36566 [00:01<04:28, 135.61it/s]
packing model.layers.36.self_attn.o_proj:   1%|          | 224/36566 [00:01<04:27, 135.61it/s]
packing model.layers.37.self_attn.o_proj:   1%|          | 225/36566 [00:01<04:27, 135.61it/s]
packing model.layers.38.self_attn.o_proj:   1%|          | 226/36566 [00:01<04:27, 135.61it/s]
packing model.layers.39.self_attn.o_proj:   1%|          | 227/36566 [00:01<04:27, 135.61it/s]
packing model.layers.40.self_attn.o_proj:   1%|          | 228/36566 [00:01<04:27, 135.61it/s]
packing model.layers.41.self_attn.o_proj:   1%|          | 229/36566 [00:01<04:27, 135.61it/s]
packing model.layers.42.self_attn.o_proj:   1%|          | 230/36566 [00:01<04:27, 135.61it/s]
packing model.layers.43.self_attn.o_proj:   1%|          | 231/36566 [00:01<04:27, 135.61it/s]
packing model.layers.44.self_attn.o_proj:   1%|          | 232/36566 [00:01<04:27, 135.61it/s]
packing model.layers.44.self_attn.o_proj:   1%|          | 233/36566 [00:01<02:08, 283.67it/s]
packing model.layers.45.self_attn.o_proj:   1%|          | 233/36566 [00:01<02:08, 283.67it/s]
packing model.layers.46.self_attn.o_proj:   1%|          | 234/36566 [00:01<02:08, 283.67it/s]
packing model.layers.47.self_attn.o_proj:   1%|          | 235/36566 [00:01<02:08, 283.67it/s]
packing model.layers.48.self_attn.o_proj:   1%|          | 236/36566 [00:01<02:08, 283.67it/s]
packing model.layers.49.self_attn.o_proj:   1%|          | 237/36566 [00:01<02:08, 283.67it/s]
packing model.layers.50.self_attn.o_proj:   1%|          | 238/36566 [00:01<02:08, 283.67it/s]
packing model.layers.51.self_attn.o_proj:   1%|          | 239/36566 [00:01<02:08, 283.67it/s]
packing model.layers.52.self_attn.o_proj:   1%|          | 240/36566 [00:01<02:08, 283.67it/s]
packing model.layers.53.self_attn.o_proj:   1%|          | 241/36566 [00:01<02:08, 283.67it/s]
packing model.layers.54.self_attn.o_proj:   1%|          | 242/36566 [00:01<02:08, 283.67it/s]
packing model.layers.55.self_attn.o_proj:   1%|          | 243/36566 [00:01<02:08, 283.67it/s]
packing model.layers.56.self_attn.o_proj:   1%|          | 244/36566 [00:01<02:08, 283.67it/s]
packing model.layers.57.self_attn.o_proj:   1%|          | 245/36566 [00:01<02:08, 283.67it/s]
packing model.layers.58.self_attn.o_proj:   1%|          | 246/36566 [00:01<02:08, 283.67it/s]
packing model.layers.59.self_attn.o_proj:   1%|          | 247/36566 [00:01<02:08, 283.67it/s]
packing model.layers.60.self_attn.o_proj:   1%|          | 248/36566 [00:01<02:08, 283.67it/s]
packing model.layers.61.self_attn.o_proj:   1%|          | 249/36566 [00:01<02:08, 283.67it/s]
packing model.layers.62.self_attn.o_proj:   1%|          | 250/36566 [00:01<02:08, 283.67it/s]
packing model.layers.63.self_attn.o_proj:   1%|          | 251/36566 [00:01<02:08, 283.67it/s]
packing model.layers.64.self_attn.o_proj:   1%|          | 252/36566 [00:01<02:08, 283.67it/s]
packing model.layers.65.self_attn.o_proj:   1%|          | 253/36566 [00:01<02:08, 283.67it/s]
packing model.layers.66.self_attn.o_proj:   1%|          | 254/36566 [00:01<02:08, 283.67it/s]
packing model.layers.67.self_attn.o_proj:   1%|          | 255/36566 [00:01<02:08, 283.67it/s]
packing model.layers.68.self_attn.o_proj:   1%|          | 256/36566 [00:01<02:07, 283.67it/s]
packing model.layers.69.self_attn.o_proj:   1%|          | 257/36566 [00:01<02:07, 283.67it/s]
packing model.layers.70.self_attn.o_proj:   1%|          | 258/36566 [00:01<02:07, 283.67it/s]
packing model.layers.71.self_attn.o_proj:   1%|          | 259/36566 [00:01<02:07, 283.67it/s]
packing model.layers.72.self_attn.o_proj:   1%|          | 260/36566 [00:01<02:07, 283.67it/s]
packing model.layers.73.self_attn.o_proj:   1%|          | 261/36566 [00:01<02:07, 283.67it/s]
packing model.layers.74.self_attn.o_proj:   1%|          | 262/36566 [00:01<02:07, 283.67it/s]
packing model.layers.75.self_attn.o_proj:   1%|          | 263/36566 [00:01<02:07, 283.67it/s]
packing model.layers.76.self_attn.o_proj:   1%|          | 264/36566 [00:01<02:07, 283.67it/s]
packing model.layers.77.self_attn.o_proj:   1%|          | 265/36566 [00:01<02:07, 283.67it/s]
packing model.layers.78.self_attn.o_proj:   1%|          | 266/36566 [00:01<02:07, 283.67it/s]
packing model.layers.79.self_attn.o_proj:   1%|          | 267/36566 [00:01<02:07, 283.67it/s]
packing model.layers.80.self_attn.o_proj:   1%|          | 268/36566 [00:01<02:07, 283.67it/s]
packing model.layers.81.self_attn.o_proj:   1%|          | 269/36566 [00:01<02:07, 283.67it/s]
packing model.layers.82.self_attn.o_proj:   1%|          | 270/36566 [00:01<02:07, 283.67it/s]
packing model.layers.83.self_attn.o_proj:   1%|          | 271/36566 [00:01<02:07, 283.67it/s]
packing model.layers.84.self_attn.o_proj:   1%|          | 272/36566 [00:01<02:07, 283.67it/s]
packing model.layers.85.self_attn.o_proj:   1%|          | 273/36566 [00:01<02:07, 283.67it/s]
packing model.layers.86.self_attn.o_proj:   1%|          | 274/36566 [00:01<02:07, 283.67it/s]
packing model.layers.87.self_attn.o_proj:   1%|          | 275/36566 [00:01<02:07, 283.67it/s]
packing model.layers.88.self_attn.o_proj:   1%|          | 276/36566 [00:01<02:07, 283.67it/s]
packing model.layers.89.self_attn.o_proj:   1%|          | 277/36566 [00:01<02:07, 283.67it/s]
packing model.layers.90.self_attn.o_proj:   1%|          | 278/36566 [00:01<02:07, 283.67it/s]
packing model.layers.91.self_attn.o_proj:   1%|          | 279/36566 [00:01<02:07, 283.67it/s]
packing model.layers.92.self_attn.o_proj:   1%|          | 280/36566 [00:01<02:07, 283.67it/s]
packing model.layers.93.self_attn.o_proj:   1%|          | 281/36566 [00:01<02:07, 283.67it/s]
packing model.layers.0.self_attn.q_proj:   1%|          | 282/36566 [00:01<02:07, 283.67it/s] 
packing model.layers.1.self_attn.q_proj:   1%|          | 283/36566 [00:01<02:07, 283.67it/s]
packing model.layers.2.self_attn.q_proj:   1%|          | 284/36566 [00:01<02:07, 283.67it/s]
packing model.layers.3.self_attn.q_proj:   1%|          | 285/36566 [00:01<02:07, 283.67it/s]
packing model.layers.4.self_attn.q_proj:   1%|          | 286/36566 [00:01<02:07, 283.67it/s]
packing model.layers.5.self_attn.q_proj:   1%|          | 287/36566 [00:01<02:07, 283.67it/s]
packing model.layers.6.self_attn.q_proj:   1%|          | 288/36566 [00:01<02:07, 283.67it/s]
packing model.layers.7.self_attn.q_proj:   1%|          | 289/36566 [00:01<02:07, 283.67it/s]
packing model.layers.8.self_attn.q_proj:   1%|          | 290/36566 [00:01<02:07, 283.67it/s]
packing model.layers.9.self_attn.q_proj:   1%|          | 291/36566 [00:01<02:07, 283.67it/s]
packing model.layers.10.self_attn.q_proj:   1%|          | 292/36566 [00:01<02:07, 283.67it/s]
packing model.layers.11.self_attn.q_proj:   1%|          | 293/36566 [00:01<02:07, 283.67it/s]
packing model.layers.12.self_attn.q_proj:   1%|          | 294/36566 [00:01<02:07, 283.67it/s]
packing model.layers.13.self_attn.q_proj:   1%|          | 295/36566 [00:01<02:07, 283.67it/s]
packing model.layers.14.self_attn.q_proj:   1%|          | 296/36566 [00:01<02:07, 283.67it/s]
packing model.layers.15.self_attn.q_proj:   1%|          | 297/36566 [00:01<02:07, 283.67it/s]
packing model.layers.16.self_attn.q_proj:   1%|          | 298/36566 [00:01<02:07, 283.67it/s]
packing model.layers.17.self_attn.q_proj:   1%|          | 299/36566 [00:01<02:07, 283.67it/s]
packing model.layers.18.self_attn.q_proj:   1%|          | 300/36566 [00:01<02:07, 283.67it/s]
packing model.layers.19.self_attn.q_proj:   1%|          | 301/36566 [00:01<02:07, 283.67it/s]
packing model.layers.20.self_attn.q_proj:   1%|          | 302/36566 [00:01<02:07, 283.67it/s]
packing model.layers.21.self_attn.q_proj:   1%|          | 303/36566 [00:01<02:07, 283.67it/s]
packing model.layers.22.self_attn.q_proj:   1%|          | 304/36566 [00:01<02:07, 283.67it/s]
packing model.layers.23.self_attn.q_proj:   1%|          | 305/36566 [00:01<02:07, 283.67it/s]
packing model.layers.24.self_attn.q_proj:   1%|          | 306/36566 [00:01<02:07, 283.67it/s]
packing model.layers.25.self_attn.q_proj:   1%|          | 307/36566 [00:01<02:07, 283.67it/s]
packing model.layers.26.self_attn.q_proj:   1%|          | 308/36566 [00:01<02:07, 283.67it/s]
packing model.layers.27.self_attn.q_proj:   1%|          | 309/36566 [00:01<02:07, 283.67it/s]
packing model.layers.28.self_attn.q_proj:   1%|          | 310/36566 [00:01<02:07, 283.67it/s]
packing model.layers.29.self_attn.q_proj:   1%|          | 311/36566 [00:01<02:07, 283.67it/s]
packing model.layers.30.self_attn.q_proj:   1%|          | 312/36566 [00:01<02:07, 283.67it/s]
packing model.layers.31.self_attn.q_proj:   1%|          | 313/36566 [00:01<02:07, 283.67it/s]
packing model.layers.32.self_attn.q_proj:   1%|          | 314/36566 [00:01<02:07, 283.67it/s]
packing model.layers.33.self_attn.q_proj:   1%|          | 315/36566 [00:01<02:07, 283.67it/s]
packing model.layers.34.self_attn.q_proj:   1%|          | 316/36566 [00:01<02:07, 283.67it/s]
packing model.layers.35.self_attn.q_proj:   1%|          | 317/36566 [00:01<02:07, 283.67it/s]
packing model.layers.36.self_attn.q_proj:   1%|          | 318/36566 [00:01<02:07, 283.67it/s]
packing model.layers.37.self_attn.q_proj:   1%|          | 319/36566 [00:01<02:07, 283.67it/s]
packing model.layers.38.self_attn.q_proj:   1%|          | 320/36566 [00:01<02:07, 283.67it/s]
packing model.layers.39.self_attn.q_proj:   1%|          | 321/36566 [00:01<02:07, 283.67it/s]
packing model.layers.40.self_attn.q_proj:   1%|          | 322/36566 [00:01<02:07, 283.67it/s]
packing model.layers.41.self_attn.q_proj:   1%|          | 323/36566 [00:01<02:07, 283.67it/s]
packing model.layers.42.self_attn.q_proj:   1%|          | 324/36566 [00:01<02:07, 283.67it/s]
packing model.layers.43.self_attn.q_proj:   1%|          | 325/36566 [00:01<02:07, 283.67it/s]
packing model.layers.44.self_attn.q_proj:   1%|          | 326/36566 [00:01<02:07, 283.67it/s]
packing model.layers.45.self_attn.q_proj:   1%|          | 327/36566 [00:01<02:07, 283.67it/s]
packing model.layers.46.self_attn.q_proj:   1%|          | 328/36566 [00:01<02:07, 283.67it/s]
packing model.layers.47.self_attn.q_proj:   1%|          | 329/36566 [00:01<02:07, 283.67it/s]
packing model.layers.48.self_attn.q_proj:   1%|          | 330/36566 [00:01<02:07, 283.67it/s]
packing model.layers.49.self_attn.q_proj:   1%|          | 331/36566 [00:01<02:07, 283.67it/s]
packing model.layers.50.self_attn.q_proj:   1%|          | 332/36566 [00:01<02:07, 283.67it/s]
packing model.layers.51.self_attn.q_proj:   1%|          | 333/36566 [00:01<02:07, 283.67it/s]
packing model.layers.52.self_attn.q_proj:   1%|          | 334/36566 [00:01<02:07, 283.67it/s]
packing model.layers.53.self_attn.q_proj:   1%|          | 335/36566 [00:01<02:07, 283.67it/s]
packing model.layers.54.self_attn.q_proj:   1%|          | 336/36566 [00:01<02:07, 283.67it/s]
packing model.layers.55.self_attn.q_proj:   1%|          | 337/36566 [00:01<02:07, 283.67it/s]
packing model.layers.56.self_attn.q_proj:   1%|          | 338/36566 [00:01<02:07, 283.67it/s]
packing model.layers.57.self_attn.q_proj:   1%|          | 339/36566 [00:01<02:07, 283.67it/s]
packing model.layers.58.self_attn.q_proj:   1%|          | 340/36566 [00:01<02:07, 283.67it/s]
packing model.layers.59.self_attn.q_proj:   1%|          | 341/36566 [00:01<02:07, 283.67it/s]
packing model.layers.60.self_attn.q_proj:   1%|          | 342/36566 [00:01<02:07, 283.67it/s]
packing model.layers.61.self_attn.q_proj:   1%|          | 343/36566 [00:01<02:07, 283.67it/s]
packing model.layers.62.self_attn.q_proj:   1%|          | 344/36566 [00:01<02:07, 283.67it/s]
packing model.layers.63.self_attn.q_proj:   1%|          | 345/36566 [00:01<02:07, 283.67it/s]
packing model.layers.64.self_attn.q_proj:   1%|          | 346/36566 [00:01<02:07, 283.67it/s]
packing model.layers.65.self_attn.q_proj:   1%|          | 347/36566 [00:01<02:07, 283.67it/s]
packing model.layers.66.self_attn.q_proj:   1%|          | 348/36566 [00:01<02:07, 283.67it/s]
packing model.layers.67.self_attn.q_proj:   1%|          | 349/36566 [00:01<02:07, 283.67it/s]
packing model.layers.68.self_attn.q_proj:   1%|          | 350/36566 [00:01<02:07, 283.67it/s]
packing model.layers.68.self_attn.q_proj:   1%|          | 351/36566 [00:01<01:23, 435.59it/s]
packing model.layers.69.self_attn.q_proj:   1%|          | 351/36566 [00:01<01:23, 435.59it/s]
packing model.layers.70.self_attn.q_proj:   1%|          | 352/36566 [00:01<01:23, 435.59it/s]
packing model.layers.71.self_attn.q_proj:   1%|          | 353/36566 [00:01<01:23, 435.59it/s]
packing model.layers.72.self_attn.q_proj:   1%|          | 354/36566 [00:01<01:23, 435.59it/s]
packing model.layers.73.self_attn.q_proj:   1%|          | 355/36566 [00:01<01:23, 435.59it/s]
packing model.layers.74.self_attn.q_proj:   1%|          | 356/36566 [00:01<01:23, 435.59it/s]
packing model.layers.75.self_attn.q_proj:   1%|          | 357/36566 [00:01<01:23, 435.59it/s]
packing model.layers.76.self_attn.q_proj:   1%|          | 358/36566 [00:01<01:23, 435.59it/s]
packing model.layers.77.self_attn.q_proj:   1%|          | 359/36566 [00:01<01:23, 435.59it/s]
packing model.layers.78.self_attn.q_proj:   1%|          | 360/36566 [00:01<01:23, 435.59it/s]
packing model.layers.79.self_attn.q_proj:   1%|          | 361/36566 [00:01<01:23, 435.59it/s]
packing model.layers.80.self_attn.q_proj:   1%|          | 362/36566 [00:01<01:23, 435.59it/s]
packing model.layers.81.self_attn.q_proj:   1%|          | 363/36566 [00:01<01:23, 435.59it/s]
packing model.layers.82.self_attn.q_proj:   1%|          | 364/36566 [00:01<01:23, 435.59it/s]
packing model.layers.83.self_attn.q_proj:   1%|          | 365/36566 [00:01<01:23, 435.59it/s]
packing model.layers.84.self_attn.q_proj:   1%|          | 366/36566 [00:01<01:23, 435.59it/s]
packing model.layers.85.self_attn.q_proj:   1%|          | 367/36566 [00:01<01:23, 435.59it/s]
packing model.layers.86.self_attn.q_proj:   1%|          | 368/36566 [00:01<01:23, 435.59it/s]
packing model.layers.87.self_attn.q_proj:   1%|          | 369/36566 [00:01<01:23, 435.59it/s]
packing model.layers.88.self_attn.q_proj:   1%|          | 370/36566 [00:01<01:23, 435.59it/s]
packing model.layers.89.self_attn.q_proj:   1%|          | 371/36566 [00:01<01:23, 435.59it/s]
packing model.layers.90.self_attn.q_proj:   1%|          | 372/36566 [00:01<01:23, 435.59it/s]
packing model.layers.91.self_attn.q_proj:   1%|          | 373/36566 [00:01<01:23, 435.59it/s]
packing model.layers.92.self_attn.q_proj:   1%|          | 374/36566 [00:01<01:23, 435.59it/s]
packing model.layers.93.self_attn.q_proj:   1%|          | 375/36566 [00:01<01:23, 435.59it/s]
packing model.layers.0.self_attn.v_proj:   1%|          | 376/36566 [00:01<01:23, 435.59it/s] 
packing model.layers.1.self_attn.v_proj:   1%|          | 377/36566 [00:01<01:23, 435.59it/s]
packing model.layers.2.self_attn.v_proj:   1%|          | 378/36566 [00:01<01:23, 435.59it/s]
packing model.layers.3.self_attn.v_proj:   1%|          | 379/36566 [00:01<01:23, 435.59it/s]
packing model.layers.4.self_attn.v_proj:   1%|          | 380/36566 [00:01<01:23, 435.59it/s]
packing model.layers.5.self_attn.v_proj:   1%|          | 381/36566 [00:01<01:23, 435.59it/s]
packing model.layers.6.self_attn.v_proj:   1%|          | 382/36566 [00:01<01:23, 435.59it/s]
packing model.layers.7.self_attn.v_proj:   1%|          | 383/36566 [00:01<01:23, 435.59it/s]
packing model.layers.8.self_attn.v_proj:   1%|          | 384/36566 [00:01<01:23, 435.59it/s]
packing model.layers.9.self_attn.v_proj:   1%|          | 385/36566 [00:01<01:23, 435.59it/s]
packing model.layers.10.self_attn.v_proj:   1%|          | 386/36566 [00:01<01:23, 435.59it/s]
packing model.layers.11.self_attn.v_proj:   1%|          | 387/36566 [00:01<01:23, 435.59it/s]
packing model.layers.12.self_attn.v_proj:   1%|          | 388/36566 [00:01<01:23, 435.59it/s]
packing model.layers.13.self_attn.v_proj:   1%|          | 389/36566 [00:01<01:23, 435.59it/s]
packing model.layers.14.self_attn.v_proj:   1%|          | 390/36566 [00:01<01:23, 435.59it/s]
packing model.layers.15.self_attn.v_proj:   1%|          | 391/36566 [00:01<01:23, 435.59it/s]
packing model.layers.16.self_attn.v_proj:   1%|          | 392/36566 [00:01<01:23, 435.59it/s]
packing model.layers.17.self_attn.v_proj:   1%|          | 393/36566 [00:01<01:23, 435.59it/s]
packing model.layers.18.self_attn.v_proj:   1%|          | 394/36566 [00:01<01:23, 435.59it/s]
packing model.layers.19.self_attn.v_proj:   1%|          | 395/36566 [00:01<01:23, 435.59it/s]
packing model.layers.20.self_attn.v_proj:   1%|          | 396/36566 [00:01<01:23, 435.59it/s]
packing model.layers.21.self_attn.v_proj:   1%|          | 397/36566 [00:01<01:23, 435.59it/s]
packing model.layers.22.self_attn.v_proj:   1%|          | 398/36566 [00:01<01:23, 435.59it/s]
packing model.layers.23.self_attn.v_proj:   1%|          | 399/36566 [00:01<01:23, 435.59it/s]
packing model.layers.24.self_attn.v_proj:   1%|          | 400/36566 [00:01<01:23, 435.59it/s]
packing model.layers.25.self_attn.v_proj:   1%|          | 401/36566 [00:01<01:23, 435.59it/s]
packing model.layers.26.self_attn.v_proj:   1%|          | 402/36566 [00:01<01:23, 435.59it/s]
packing model.layers.27.self_attn.v_proj:   1%|          | 403/36566 [00:01<01:23, 435.59it/s]
packing model.layers.28.self_attn.v_proj:   1%|          | 404/36566 [00:01<01:23, 435.59it/s]
packing model.layers.29.self_attn.v_proj:   1%|          | 405/36566 [00:01<01:23, 435.59it/s]
packing model.layers.30.self_attn.v_proj:   1%|          | 406/36566 [00:01<01:23, 435.59it/s]
packing model.layers.31.self_attn.v_proj:   1%|          | 407/36566 [00:01<01:23, 435.59it/s]
packing model.layers.32.self_attn.v_proj:   1%|          | 408/36566 [00:01<01:23, 435.59it/s]
packing model.layers.33.self_attn.v_proj:   1%|          | 409/36566 [00:01<01:23, 435.59it/s]
packing model.layers.34.self_attn.v_proj:   1%|          | 410/36566 [00:01<01:23, 435.59it/s]
packing model.layers.35.self_attn.v_proj:   1%|          | 411/36566 [00:01<01:23, 435.59it/s]
packing model.layers.36.self_attn.v_proj:   1%|          | 412/36566 [00:01<01:23, 435.59it/s]
packing model.layers.37.self_attn.v_proj:   1%|          | 413/36566 [00:01<01:22, 435.59it/s]
packing model.layers.38.self_attn.v_proj:   1%|          | 414/36566 [00:01<01:22, 435.59it/s]
packing model.layers.39.self_attn.v_proj:   1%|          | 415/36566 [00:01<01:22, 435.59it/s]
packing model.layers.40.self_attn.v_proj:   1%|          | 416/36566 [00:01<01:22, 435.59it/s]
packing model.layers.41.self_attn.v_proj:   1%|          | 417/36566 [00:01<01:22, 435.59it/s]
packing model.layers.42.self_attn.v_proj:   1%|          | 418/36566 [00:01<01:22, 435.59it/s]
packing model.layers.43.self_attn.v_proj:   1%|          | 419/36566 [00:01<01:22, 435.59it/s]
packing model.layers.44.self_attn.v_proj:   1%|          | 420/36566 [00:01<01:22, 435.59it/s]
packing model.layers.45.self_attn.v_proj:   1%|          | 421/36566 [00:01<01:22, 435.59it/s]
packing model.layers.46.self_attn.v_proj:   1%|          | 422/36566 [00:01<01:22, 435.59it/s]
packing model.layers.47.self_attn.v_proj:   1%|          | 423/36566 [00:01<01:22, 435.59it/s]
packing model.layers.48.self_attn.v_proj:   1%|          | 424/36566 [00:01<01:22, 435.59it/s]
packing model.layers.49.self_attn.v_proj:   1%|          | 425/36566 [00:01<01:22, 435.59it/s]
packing model.layers.50.self_attn.v_proj:   1%|          | 426/36566 [00:01<01:22, 435.59it/s]
packing model.layers.51.self_attn.v_proj:   1%|          | 427/36566 [00:01<01:22, 435.59it/s]
packing model.layers.52.self_attn.v_proj:   1%|          | 428/36566 [00:01<01:22, 435.59it/s]
packing model.layers.53.self_attn.v_proj:   1%|          | 429/36566 [00:01<01:22, 435.59it/s]
packing model.layers.54.self_attn.v_proj:   1%|          | 430/36566 [00:01<01:22, 435.59it/s]
packing model.layers.55.self_attn.v_proj:   1%|          | 431/36566 [00:01<01:22, 435.59it/s]
packing model.layers.56.self_attn.v_proj:   1%|          | 432/36566 [00:01<01:22, 435.59it/s]
packing model.layers.57.self_attn.v_proj:   1%|          | 433/36566 [00:01<01:22, 435.59it/s]
packing model.layers.58.self_attn.v_proj:   1%|          | 434/36566 [00:01<01:22, 435.59it/s]
packing model.layers.59.self_attn.v_proj:   1%|          | 435/36566 [00:01<01:22, 435.59it/s]
packing model.layers.60.self_attn.v_proj:   1%|          | 436/36566 [00:01<01:22, 435.59it/s]
packing model.layers.61.self_attn.v_proj:   1%|          | 437/36566 [00:01<01:22, 435.59it/s]
packing model.layers.62.self_attn.v_proj:   1%|          | 438/36566 [00:01<01:22, 435.59it/s]
packing model.layers.63.self_attn.v_proj:   1%|          | 439/36566 [00:01<01:22, 435.59it/s]
packing model.layers.64.self_attn.v_proj:   1%|          | 440/36566 [00:01<01:22, 435.59it/s]
packing model.layers.65.self_attn.v_proj:   1%|          | 441/36566 [00:01<01:22, 435.59it/s]
packing model.layers.66.self_attn.v_proj:   1%|          | 442/36566 [00:01<01:22, 435.59it/s]
packing model.layers.67.self_attn.v_proj:   1%|          | 443/36566 [00:01<01:22, 435.59it/s]
packing model.layers.68.self_attn.v_proj:   1%|          | 444/36566 [00:01<01:22, 435.59it/s]
packing model.layers.69.self_attn.v_proj:   1%|          | 445/36566 [00:01<01:22, 435.59it/s]
packing model.layers.70.self_attn.v_proj:   1%|          | 446/36566 [00:01<01:22, 435.59it/s]
packing model.layers.71.self_attn.v_proj:   1%|          | 447/36566 [00:01<01:22, 435.59it/s]
packing model.layers.72.self_attn.v_proj:   1%|          | 448/36566 [00:01<01:22, 435.59it/s]
packing model.layers.73.self_attn.v_proj:   1%|          | 449/36566 [00:01<01:22, 435.59it/s]
packing model.layers.74.self_attn.v_proj:   1%|          | 450/36566 [00:01<01:22, 435.59it/s]
packing model.layers.75.self_attn.v_proj:   1%|          | 451/36566 [00:01<01:22, 435.59it/s]
packing model.layers.76.self_attn.v_proj:   1%|          | 452/36566 [00:01<01:22, 435.59it/s]
packing model.layers.77.self_attn.v_proj:   1%|          | 453/36566 [00:01<01:22, 435.59it/s]
packing model.layers.78.self_attn.v_proj:   1%|          | 454/36566 [00:01<01:22, 435.59it/s]
packing model.layers.79.self_attn.v_proj:   1%|          | 455/36566 [00:01<01:22, 435.59it/s]
packing model.layers.80.self_attn.v_proj:   1%|          | 456/36566 [00:01<01:22, 435.59it/s]
packing model.layers.81.self_attn.v_proj:   1%|          | 457/36566 [00:01<01:22, 435.59it/s]
packing model.layers.82.self_attn.v_proj:   1%|▏         | 458/36566 [00:01<01:22, 435.59it/s]
packing model.layers.83.self_attn.v_proj:   1%|▏         | 459/36566 [00:01<01:22, 435.59it/s]
packing model.layers.84.self_attn.v_proj:   1%|▏         | 460/36566 [00:01<01:22, 435.59it/s]
packing model.layers.85.self_attn.v_proj:   1%|▏         | 461/36566 [00:01<01:22, 435.59it/s]
packing model.layers.86.self_attn.v_proj:   1%|▏         | 462/36566 [00:01<01:22, 435.59it/s]
packing model.layers.87.self_attn.v_proj:   1%|▏         | 463/36566 [00:01<01:22, 435.59it/s]
packing model.layers.88.self_attn.v_proj:   1%|▏         | 464/36566 [00:01<01:22, 435.59it/s]
packing model.layers.89.self_attn.v_proj:   1%|▏         | 465/36566 [00:01<01:22, 435.59it/s]
packing model.layers.90.self_attn.v_proj:   1%|▏         | 466/36566 [00:01<01:22, 435.59it/s]
packing model.layers.91.self_attn.v_proj:   1%|▏         | 467/36566 [00:01<01:22, 435.59it/s]
packing model.layers.92.self_attn.v_proj:   1%|▏         | 468/36566 [00:01<01:22, 435.59it/s]
packing model.layers.92.self_attn.v_proj:   1%|▏         | 469/36566 [00:01<01:02, 580.09it/s]
packing model.layers.93.self_attn.v_proj:   1%|▏         | 469/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.0.gate_proj:   1%|▏         | 470/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.0.up_proj:   1%|▏         | 471/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.0.down_proj:   1%|▏         | 472/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.1.gate_proj:   1%|▏         | 473/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.1.up_proj:   1%|▏         | 474/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.1.down_proj:   1%|▏         | 475/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.2.gate_proj:   1%|▏         | 476/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.2.up_proj:   1%|▏         | 477/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.2.down_proj:   1%|▏         | 478/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.3.gate_proj:   1%|▏         | 479/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.3.up_proj:   1%|▏         | 480/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.3.down_proj:   1%|▏         | 481/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.4.gate_proj:   1%|▏         | 482/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.4.up_proj:   1%|▏         | 483/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.4.down_proj:   1%|▏         | 484/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.5.gate_proj:   1%|▏         | 485/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.5.up_proj:   1%|▏         | 486/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.5.down_proj:   1%|▏         | 487/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.6.gate_proj:   1%|▏         | 488/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.6.up_proj:   1%|▏         | 489/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.6.down_proj:   1%|▏         | 490/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.7.gate_proj:   1%|▏         | 491/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.7.up_proj:   1%|▏         | 492/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.7.down_proj:   1%|▏         | 493/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.8.gate_proj:   1%|▏         | 494/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.8.up_proj:   1%|▏         | 495/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.8.down_proj:   1%|▏         | 496/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.9.gate_proj:   1%|▏         | 497/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.9.up_proj:   1%|▏         | 498/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.9.down_proj:   1%|▏         | 499/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.10.gate_proj:   1%|▏         | 500/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.10.up_proj:   1%|▏         | 501/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.10.down_proj:   1%|▏         | 502/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.11.gate_proj:   1%|▏         | 503/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.11.up_proj:   1%|▏         | 504/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.11.down_proj:   1%|▏         | 505/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.12.gate_proj:   1%|▏         | 506/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.12.up_proj:   1%|▏         | 507/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.12.down_proj:   1%|▏         | 508/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.13.gate_proj:   1%|▏         | 509/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.13.up_proj:   1%|▏         | 510/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.13.down_proj:   1%|▏         | 511/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.14.gate_proj:   1%|▏         | 512/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.14.up_proj:   1%|▏         | 513/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.14.down_proj:   1%|▏         | 514/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.15.gate_proj:   1%|▏         | 515/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.15.up_proj:   1%|▏         | 516/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.15.down_proj:   1%|▏         | 517/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.16.gate_proj:   1%|▏         | 518/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.16.up_proj:   1%|▏         | 519/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.16.down_proj:   1%|▏         | 520/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.17.gate_proj:   1%|▏         | 521/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.17.up_proj:   1%|▏         | 522/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.17.down_proj:   1%|▏         | 523/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.18.gate_proj:   1%|▏         | 524/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.18.up_proj:   1%|▏         | 525/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.18.down_proj:   1%|▏         | 526/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.19.gate_proj:   1%|▏         | 527/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.19.up_proj:   1%|▏         | 528/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.19.down_proj:   1%|▏         | 529/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.20.gate_proj:   1%|▏         | 530/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.20.up_proj:   1%|▏         | 531/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.20.down_proj:   1%|▏         | 532/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.21.gate_proj:   1%|▏         | 533/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.21.up_proj:   1%|▏         | 534/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.21.down_proj:   1%|▏         | 535/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.22.gate_proj:   1%|▏         | 536/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.22.up_proj:   1%|▏         | 537/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.22.down_proj:   1%|▏         | 538/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.23.gate_proj:   1%|▏         | 539/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.23.up_proj:   1%|▏         | 540/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.23.down_proj:   1%|▏         | 541/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.24.gate_proj:   1%|▏         | 542/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.24.up_proj:   1%|▏         | 543/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.24.down_proj:   1%|▏         | 544/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.25.gate_proj:   1%|▏         | 545/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.25.up_proj:   1%|▏         | 546/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.25.down_proj:   1%|▏         | 547/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.26.gate_proj:   1%|▏         | 548/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.26.up_proj:   2%|▏         | 549/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.26.down_proj:   2%|▏         | 550/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.27.gate_proj:   2%|▏         | 551/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.27.up_proj:   2%|▏         | 552/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.27.down_proj:   2%|▏         | 553/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.28.gate_proj:   2%|▏         | 554/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.28.up_proj:   2%|▏         | 555/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.28.down_proj:   2%|▏         | 556/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.29.gate_proj:   2%|▏         | 557/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.29.up_proj:   2%|▏         | 558/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.29.down_proj:   2%|▏         | 559/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.30.gate_proj:   2%|▏         | 560/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.30.up_proj:   2%|▏         | 561/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.30.down_proj:   2%|▏         | 562/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.31.gate_proj:   2%|▏         | 563/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.31.up_proj:   2%|▏         | 564/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.31.down_proj:   2%|▏         | 565/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.32.gate_proj:   2%|▏         | 566/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.32.up_proj:   2%|▏         | 567/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.32.down_proj:   2%|▏         | 568/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.33.gate_proj:   2%|▏         | 569/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.33.up_proj:   2%|▏         | 570/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.33.down_proj:   2%|▏         | 571/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.34.gate_proj:   2%|▏         | 572/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.34.up_proj:   2%|▏         | 573/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.34.down_proj:   2%|▏         | 574/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.35.gate_proj:   2%|▏         | 575/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.35.up_proj:   2%|▏         | 576/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.35.down_proj:   2%|▏         | 577/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.36.gate_proj:   2%|▏         | 578/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.36.up_proj:   2%|▏         | 579/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.36.down_proj:   2%|▏         | 580/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.37.gate_proj:   2%|▏         | 581/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.37.up_proj:   2%|▏         | 582/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.37.down_proj:   2%|▏         | 583/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.38.gate_proj:   2%|▏         | 584/36566 [00:01<01:02, 580.09it/s]
packing model.layers.0.mlp.experts.38.up_proj:   2%|▏         | 585/36566 [00:01<01:02, 580.09it/s]  
packing model.layers.0.mlp.experts.38.up_proj:   2%|▏         | 586/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.38.down_proj:   2%|▏         | 586/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.39.gate_proj:   2%|▏         | 587/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.39.up_proj:   2%|▏         | 588/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.39.down_proj:   2%|▏         | 589/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.40.gate_proj:   2%|▏         | 590/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.40.up_proj:   2%|▏         | 591/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.40.down_proj:   2%|▏         | 592/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.41.gate_proj:   2%|▏         | 593/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.41.up_proj:   2%|▏         | 594/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.41.down_proj:   2%|▏         | 595/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.42.gate_proj:   2%|▏         | 596/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.42.up_proj:   2%|▏         | 597/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.42.down_proj:   2%|▏         | 598/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.43.gate_proj:   2%|▏         | 599/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.43.up_proj:   2%|▏         | 600/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.43.down_proj:   2%|▏         | 601/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.44.gate_proj:   2%|▏         | 602/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.44.up_proj:   2%|▏         | 603/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.44.down_proj:   2%|▏         | 604/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.45.gate_proj:   2%|▏         | 605/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.45.up_proj:   2%|▏         | 606/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.45.down_proj:   2%|▏         | 607/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.46.gate_proj:   2%|▏         | 608/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.46.up_proj:   2%|▏         | 609/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.46.down_proj:   2%|▏         | 610/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.47.gate_proj:   2%|▏         | 611/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.47.up_proj:   2%|▏         | 612/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.47.down_proj:   2%|▏         | 613/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.48.gate_proj:   2%|▏         | 614/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.48.up_proj:   2%|▏         | 615/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.48.down_proj:   2%|▏         | 616/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.49.gate_proj:   2%|▏         | 617/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.49.up_proj:   2%|▏         | 618/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.49.down_proj:   2%|▏         | 619/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.50.gate_proj:   2%|▏         | 620/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.50.up_proj:   2%|▏         | 621/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.50.down_proj:   2%|▏         | 622/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.51.gate_proj:   2%|▏         | 623/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.51.up_proj:   2%|▏         | 624/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.51.down_proj:   2%|▏         | 625/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.52.gate_proj:   2%|▏         | 626/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.52.up_proj:   2%|▏         | 627/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.52.down_proj:   2%|▏         | 628/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.53.gate_proj:   2%|▏         | 629/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.53.up_proj:   2%|▏         | 630/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.53.down_proj:   2%|▏         | 631/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.54.gate_proj:   2%|▏         | 632/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.54.up_proj:   2%|▏         | 633/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.54.down_proj:   2%|▏         | 634/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.55.gate_proj:   2%|▏         | 635/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.55.up_proj:   2%|▏         | 636/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.55.down_proj:   2%|▏         | 637/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.56.gate_proj:   2%|▏         | 638/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.56.up_proj:   2%|▏         | 639/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.56.down_proj:   2%|▏         | 640/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.57.gate_proj:   2%|▏         | 641/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.57.up_proj:   2%|▏         | 642/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.57.down_proj:   2%|▏         | 643/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.58.gate_proj:   2%|▏         | 644/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.58.up_proj:   2%|▏         | 645/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.58.down_proj:   2%|▏         | 646/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.59.gate_proj:   2%|▏         | 647/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.59.up_proj:   2%|▏         | 648/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.59.down_proj:   2%|▏         | 649/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.60.gate_proj:   2%|▏         | 650/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.60.up_proj:   2%|▏         | 651/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.60.down_proj:   2%|▏         | 652/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.61.gate_proj:   2%|▏         | 653/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.61.up_proj:   2%|▏         | 654/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.61.down_proj:   2%|▏         | 655/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.62.gate_proj:   2%|▏         | 656/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.62.up_proj:   2%|▏         | 657/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.62.down_proj:   2%|▏         | 658/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.63.gate_proj:   2%|▏         | 659/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.63.up_proj:   2%|▏         | 660/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.63.down_proj:   2%|▏         | 661/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.64.gate_proj:   2%|▏         | 662/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.64.up_proj:   2%|▏         | 663/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.64.down_proj:   2%|▏         | 664/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.65.gate_proj:   2%|▏         | 665/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.65.up_proj:   2%|▏         | 666/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.65.down_proj:   2%|▏         | 667/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.66.gate_proj:   2%|▏         | 668/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.66.up_proj:   2%|▏         | 669/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.66.down_proj:   2%|▏         | 670/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.67.gate_proj:   2%|▏         | 671/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.67.up_proj:   2%|▏         | 672/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.67.down_proj:   2%|▏         | 673/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.68.gate_proj:   2%|▏         | 674/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.68.up_proj:   2%|▏         | 675/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.68.down_proj:   2%|▏         | 676/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.69.gate_proj:   2%|▏         | 677/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.69.up_proj:   2%|▏         | 678/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.69.down_proj:   2%|▏         | 679/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.70.gate_proj:   2%|▏         | 680/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.70.up_proj:   2%|▏         | 681/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.70.down_proj:   2%|▏         | 682/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.71.gate_proj:   2%|▏         | 683/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.71.up_proj:   2%|▏         | 684/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.71.down_proj:   2%|▏         | 685/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.72.gate_proj:   2%|▏         | 686/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.72.up_proj:   2%|▏         | 687/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.72.down_proj:   2%|▏         | 688/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.73.gate_proj:   2%|▏         | 689/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.73.up_proj:   2%|▏         | 690/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.73.down_proj:   2%|▏         | 691/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.74.gate_proj:   2%|▏         | 692/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.74.up_proj:   2%|▏         | 693/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.74.down_proj:   2%|▏         | 694/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.75.gate_proj:   2%|▏         | 695/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.75.up_proj:   2%|▏         | 696/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.75.down_proj:   2%|▏         | 697/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.76.gate_proj:   2%|▏         | 698/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.76.up_proj:   2%|▏         | 699/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.76.down_proj:   2%|▏         | 700/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.77.gate_proj:   2%|▏         | 701/36566 [00:01<00:50, 707.84it/s]
packing model.layers.0.mlp.experts.77.up_proj:   2%|▏         | 702/36566 [00:01<00:50, 707.84it/s]  
packing model.layers.0.mlp.experts.77.up_proj:   2%|▏         | 703/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.77.down_proj:   2%|▏         | 703/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.78.gate_proj:   2%|▏         | 704/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.78.up_proj:   2%|▏         | 705/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.78.down_proj:   2%|▏         | 706/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.79.gate_proj:   2%|▏         | 707/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.79.up_proj:   2%|▏         | 708/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.79.down_proj:   2%|▏         | 709/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.80.gate_proj:   2%|▏         | 710/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.80.up_proj:   2%|▏         | 711/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.80.down_proj:   2%|▏         | 712/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.81.gate_proj:   2%|▏         | 713/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.81.up_proj:   2%|▏         | 714/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.81.down_proj:   2%|▏         | 715/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.82.gate_proj:   2%|▏         | 716/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.82.up_proj:   2%|▏         | 717/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.82.down_proj:   2%|▏         | 718/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.83.gate_proj:   2%|▏         | 719/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.83.up_proj:   2%|▏         | 720/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.83.down_proj:   2%|▏         | 721/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.84.gate_proj:   2%|▏         | 722/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.84.up_proj:   2%|▏         | 723/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.84.down_proj:   2%|▏         | 724/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.85.gate_proj:   2%|▏         | 725/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.85.up_proj:   2%|▏         | 726/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.85.down_proj:   2%|▏         | 727/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.86.gate_proj:   2%|▏         | 728/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.86.up_proj:   2%|▏         | 729/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.86.down_proj:   2%|▏         | 730/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.87.gate_proj:   2%|▏         | 731/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.87.up_proj:   2%|▏         | 732/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.87.down_proj:   2%|▏         | 733/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.88.gate_proj:   2%|▏         | 734/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.88.up_proj:   2%|▏         | 735/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.88.down_proj:   2%|▏         | 736/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.89.gate_proj:   2%|▏         | 737/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.89.up_proj:   2%|▏         | 738/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.89.down_proj:   2%|▏         | 739/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.90.gate_proj:   2%|▏         | 740/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.90.up_proj:   2%|▏         | 741/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.90.down_proj:   2%|▏         | 742/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.91.gate_proj:   2%|▏         | 743/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.91.up_proj:   2%|▏         | 744/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.91.down_proj:   2%|▏         | 745/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.92.gate_proj:   2%|▏         | 746/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.92.up_proj:   2%|▏         | 747/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.92.down_proj:   2%|▏         | 748/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.93.gate_proj:   2%|▏         | 749/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.93.up_proj:   2%|▏         | 750/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.93.down_proj:   2%|▏         | 751/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.94.gate_proj:   2%|▏         | 752/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.94.up_proj:   2%|▏         | 753/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.94.down_proj:   2%|▏         | 754/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.95.gate_proj:   2%|▏         | 755/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.95.up_proj:   2%|▏         | 756/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.95.down_proj:   2%|▏         | 757/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.96.gate_proj:   2%|▏         | 758/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.96.up_proj:   2%|▏         | 759/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.96.down_proj:   2%|▏         | 760/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.97.gate_proj:   2%|▏         | 761/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.97.up_proj:   2%|▏         | 762/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.97.down_proj:   2%|▏         | 763/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.98.gate_proj:   2%|▏         | 764/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.98.up_proj:   2%|▏         | 765/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.98.down_proj:   2%|▏         | 766/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.99.gate_proj:   2%|▏         | 767/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.99.up_proj:   2%|▏         | 768/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.99.down_proj:   2%|▏         | 769/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.100.gate_proj:   2%|▏         | 770/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.100.up_proj:   2%|▏         | 771/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.100.down_proj:   2%|▏         | 772/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.101.gate_proj:   2%|▏         | 773/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.101.up_proj:   2%|▏         | 774/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.101.down_proj:   2%|▏         | 775/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.102.gate_proj:   2%|▏         | 776/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.102.up_proj:   2%|▏         | 777/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.102.down_proj:   2%|▏         | 778/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.103.gate_proj:   2%|▏         | 779/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.103.up_proj:   2%|▏         | 780/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.103.down_proj:   2%|▏         | 781/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.104.gate_proj:   2%|▏         | 782/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.104.up_proj:   2%|▏         | 783/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.104.down_proj:   2%|▏         | 784/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.105.gate_proj:   2%|▏         | 785/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.105.up_proj:   2%|▏         | 786/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.105.down_proj:   2%|▏         | 787/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.106.gate_proj:   2%|▏         | 788/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.106.up_proj:   2%|▏         | 789/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.106.down_proj:   2%|▏         | 790/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.107.gate_proj:   2%|▏         | 791/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.107.up_proj:   2%|▏         | 792/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.107.down_proj:   2%|▏         | 793/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.108.gate_proj:   2%|▏         | 794/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.108.up_proj:   2%|▏         | 795/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.108.down_proj:   2%|▏         | 796/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.109.gate_proj:   2%|▏         | 797/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.109.up_proj:   2%|▏         | 798/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.109.down_proj:   2%|▏         | 799/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.110.gate_proj:   2%|▏         | 800/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.110.up_proj:   2%|▏         | 801/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.110.down_proj:   2%|▏         | 802/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.111.gate_proj:   2%|▏         | 803/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.111.up_proj:   2%|▏         | 804/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.111.down_proj:   2%|▏         | 805/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.112.gate_proj:   2%|▏         | 806/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.112.up_proj:   2%|▏         | 807/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.112.down_proj:   2%|▏         | 808/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.113.gate_proj:   2%|▏         | 809/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.113.up_proj:   2%|▏         | 810/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.113.down_proj:   2%|▏         | 811/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.114.gate_proj:   2%|▏         | 812/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.114.up_proj:   2%|▏         | 813/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.114.down_proj:   2%|▏         | 814/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.115.gate_proj:   2%|▏         | 815/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.115.up_proj:   2%|▏         | 816/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.115.down_proj:   2%|▏         | 817/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.116.gate_proj:   2%|▏         | 818/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.116.up_proj:   2%|▏         | 819/36566 [00:01<00:43, 816.32it/s]  
packing model.layers.0.mlp.experts.116.down_proj:   2%|▏         | 820/36566 [00:01<00:43, 816.32it/s]
packing model.layers.0.mlp.experts.116.down_proj:   2%|▏         | 821/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.117.gate_proj:   2%|▏         | 821/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.117.up_proj:   2%|▏         | 822/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.117.down_proj:   2%|▏         | 823/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.118.gate_proj:   2%|▏         | 824/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.118.up_proj:   2%|▏         | 825/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.118.down_proj:   2%|▏         | 826/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.119.gate_proj:   2%|▏         | 827/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.119.up_proj:   2%|▏         | 828/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.119.down_proj:   2%|▏         | 829/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.120.gate_proj:   2%|▏         | 830/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.120.up_proj:   2%|▏         | 831/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.120.down_proj:   2%|▏         | 832/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.121.gate_proj:   2%|▏         | 833/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.121.up_proj:   2%|▏         | 834/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.121.down_proj:   2%|▏         | 835/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.122.gate_proj:   2%|▏         | 836/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.122.up_proj:   2%|▏         | 837/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.122.down_proj:   2%|▏         | 838/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.123.gate_proj:   2%|▏         | 839/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.123.up_proj:   2%|▏         | 840/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.123.down_proj:   2%|▏         | 841/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.124.gate_proj:   2%|▏         | 842/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.124.up_proj:   2%|▏         | 843/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.124.down_proj:   2%|▏         | 844/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.125.gate_proj:   2%|▏         | 845/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.125.up_proj:   2%|▏         | 846/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.125.down_proj:   2%|▏         | 847/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.126.gate_proj:   2%|▏         | 848/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.126.up_proj:   2%|▏         | 849/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.126.down_proj:   2%|▏         | 850/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.127.gate_proj:   2%|▏         | 851/36566 [00:01<00:39, 907.19it/s]
packing model.layers.0.mlp.experts.127.up_proj:   2%|▏         | 852/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.0.mlp.experts.127.down_proj:   2%|▏         | 853/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.0.gate_proj:   2%|▏         | 854/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.0.up_proj:   2%|▏         | 855/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.0.down_proj:   2%|▏         | 856/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.1.gate_proj:   2%|▏         | 857/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.1.up_proj:   2%|▏         | 858/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.1.down_proj:   2%|▏         | 859/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.2.gate_proj:   2%|▏         | 860/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.2.up_proj:   2%|▏         | 861/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.2.down_proj:   2%|▏         | 862/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.3.gate_proj:   2%|▏         | 863/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.3.up_proj:   2%|▏         | 864/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.3.down_proj:   2%|▏         | 865/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.4.gate_proj:   2%|▏         | 866/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.4.up_proj:   2%|▏         | 867/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.4.down_proj:   2%|▏         | 868/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.5.gate_proj:   2%|▏         | 869/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.5.up_proj:   2%|▏         | 870/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.5.down_proj:   2%|▏         | 871/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.6.gate_proj:   2%|▏         | 872/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.6.up_proj:   2%|▏         | 873/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.6.down_proj:   2%|▏         | 874/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.7.gate_proj:   2%|▏         | 875/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.7.up_proj:   2%|▏         | 876/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.7.down_proj:   2%|▏         | 877/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.8.gate_proj:   2%|▏         | 878/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.8.up_proj:   2%|▏         | 879/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.8.down_proj:   2%|▏         | 880/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.9.gate_proj:   2%|▏         | 881/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.9.up_proj:   2%|▏         | 882/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.9.down_proj:   2%|▏         | 883/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.10.gate_proj:   2%|▏         | 884/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.10.up_proj:   2%|▏         | 885/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.10.down_proj:   2%|▏         | 886/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.11.gate_proj:   2%|▏         | 887/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.11.up_proj:   2%|▏         | 888/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.11.down_proj:   2%|▏         | 889/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.12.gate_proj:   2%|▏         | 890/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.12.up_proj:   2%|▏         | 891/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.12.down_proj:   2%|▏         | 892/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.13.gate_proj:   2%|▏         | 893/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.13.up_proj:   2%|▏         | 894/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.13.down_proj:   2%|▏         | 895/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.14.gate_proj:   2%|▏         | 896/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.14.up_proj:   2%|▏         | 897/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.14.down_proj:   2%|▏         | 898/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.15.gate_proj:   2%|▏         | 899/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.15.up_proj:   2%|▏         | 900/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.15.down_proj:   2%|▏         | 901/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.16.gate_proj:   2%|▏         | 902/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.16.up_proj:   2%|▏         | 903/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.16.down_proj:   2%|▏         | 904/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.17.gate_proj:   2%|▏         | 905/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.17.up_proj:   2%|▏         | 906/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.17.down_proj:   2%|▏         | 907/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.18.gate_proj:   2%|▏         | 908/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.18.up_proj:   2%|▏         | 909/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.18.down_proj:   2%|▏         | 910/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.19.gate_proj:   2%|▏         | 911/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.19.up_proj:   2%|▏         | 912/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.19.down_proj:   2%|▏         | 913/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.20.gate_proj:   2%|▏         | 914/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.20.up_proj:   3%|▎         | 915/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.20.down_proj:   3%|▎         | 916/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.21.gate_proj:   3%|▎         | 917/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.21.up_proj:   3%|▎         | 918/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.21.down_proj:   3%|▎         | 919/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.22.gate_proj:   3%|▎         | 920/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.22.up_proj:   3%|▎         | 921/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.22.down_proj:   3%|▎         | 922/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.23.gate_proj:   3%|▎         | 923/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.23.up_proj:   3%|▎         | 924/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.23.down_proj:   3%|▎         | 925/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.24.gate_proj:   3%|▎         | 926/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.24.up_proj:   3%|▎         | 927/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.24.down_proj:   3%|▎         | 928/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.25.gate_proj:   3%|▎         | 929/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.25.up_proj:   3%|▎         | 930/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.25.down_proj:   3%|▎         | 931/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.26.gate_proj:   3%|▎         | 932/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.26.up_proj:   3%|▎         | 933/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.26.down_proj:   3%|▎         | 934/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.27.gate_proj:   3%|▎         | 935/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.27.up_proj:   3%|▎         | 936/36566 [00:01<00:39, 907.19it/s]  
packing model.layers.1.mlp.experts.27.down_proj:   3%|▎         | 937/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.28.gate_proj:   3%|▎         | 938/36566 [00:01<00:39, 907.19it/s]
packing model.layers.1.mlp.experts.28.gate_proj:   3%|▎         | 939/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.28.up_proj:   3%|▎         | 939/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.28.down_proj:   3%|▎         | 940/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.29.gate_proj:   3%|▎         | 941/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.29.up_proj:   3%|▎         | 942/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.29.down_proj:   3%|▎         | 943/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.30.gate_proj:   3%|▎         | 944/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.30.up_proj:   3%|▎         | 945/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.30.down_proj:   3%|▎         | 946/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.31.gate_proj:   3%|▎         | 947/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.31.up_proj:   3%|▎         | 948/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.31.down_proj:   3%|▎         | 949/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.32.gate_proj:   3%|▎         | 950/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.32.up_proj:   3%|▎         | 951/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.32.down_proj:   3%|▎         | 952/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.33.gate_proj:   3%|▎         | 953/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.33.up_proj:   3%|▎         | 954/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.33.down_proj:   3%|▎         | 955/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.34.gate_proj:   3%|▎         | 956/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.34.up_proj:   3%|▎         | 957/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.34.down_proj:   3%|▎         | 958/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.35.gate_proj:   3%|▎         | 959/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.35.up_proj:   3%|▎         | 960/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.35.down_proj:   3%|▎         | 961/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.36.gate_proj:   3%|▎         | 962/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.36.up_proj:   3%|▎         | 963/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.36.down_proj:   3%|▎         | 964/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.37.gate_proj:   3%|▎         | 965/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.37.up_proj:   3%|▎         | 966/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.37.down_proj:   3%|▎         | 967/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.38.gate_proj:   3%|▎         | 968/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.38.up_proj:   3%|▎         | 969/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.38.down_proj:   3%|▎         | 970/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.39.gate_proj:   3%|▎         | 971/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.39.up_proj:   3%|▎         | 972/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.39.down_proj:   3%|▎         | 973/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.40.gate_proj:   3%|▎         | 974/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.40.up_proj:   3%|▎         | 975/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.40.down_proj:   3%|▎         | 976/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.41.gate_proj:   3%|▎         | 977/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.41.up_proj:   3%|▎         | 978/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.41.down_proj:   3%|▎         | 979/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.42.gate_proj:   3%|▎         | 980/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.42.up_proj:   3%|▎         | 981/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.42.down_proj:   3%|▎         | 982/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.43.gate_proj:   3%|▎         | 983/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.43.up_proj:   3%|▎         | 984/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.43.down_proj:   3%|▎         | 985/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.44.gate_proj:   3%|▎         | 986/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.44.up_proj:   3%|▎         | 987/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.44.down_proj:   3%|▎         | 988/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.45.gate_proj:   3%|▎         | 989/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.45.up_proj:   3%|▎         | 990/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.45.down_proj:   3%|▎         | 991/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.46.gate_proj:   3%|▎         | 992/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.46.up_proj:   3%|▎         | 993/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.46.down_proj:   3%|▎         | 994/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.47.gate_proj:   3%|▎         | 995/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.47.up_proj:   3%|▎         | 996/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.47.down_proj:   3%|▎         | 997/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.48.gate_proj:   3%|▎         | 998/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.48.up_proj:   3%|▎         | 999/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.48.down_proj:   3%|▎         | 1000/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.49.gate_proj:   3%|▎         | 1001/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.49.up_proj:   3%|▎         | 1002/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.49.down_proj:   3%|▎         | 1003/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.50.gate_proj:   3%|▎         | 1004/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.50.up_proj:   3%|▎         | 1005/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.50.down_proj:   3%|▎         | 1006/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.51.gate_proj:   3%|▎         | 1007/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.51.up_proj:   3%|▎         | 1008/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.51.down_proj:   3%|▎         | 1009/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.52.gate_proj:   3%|▎         | 1010/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.52.up_proj:   3%|▎         | 1011/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.52.down_proj:   3%|▎         | 1012/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.53.gate_proj:   3%|▎         | 1013/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.53.up_proj:   3%|▎         | 1014/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.53.down_proj:   3%|▎         | 1015/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.54.gate_proj:   3%|▎         | 1016/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.54.up_proj:   3%|▎         | 1017/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.54.down_proj:   3%|▎         | 1018/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.55.gate_proj:   3%|▎         | 1019/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.55.up_proj:   3%|▎         | 1020/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.55.down_proj:   3%|▎         | 1021/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.56.gate_proj:   3%|▎         | 1022/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.56.up_proj:   3%|▎         | 1023/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.56.down_proj:   3%|▎         | 1024/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.57.gate_proj:   3%|▎         | 1025/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.57.up_proj:   3%|▎         | 1026/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.57.down_proj:   3%|▎         | 1027/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.58.gate_proj:   3%|▎         | 1028/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.58.up_proj:   3%|▎         | 1029/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.58.down_proj:   3%|▎         | 1030/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.59.gate_proj:   3%|▎         | 1031/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.59.up_proj:   3%|▎         | 1032/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.59.down_proj:   3%|▎         | 1033/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.60.gate_proj:   3%|▎         | 1034/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.60.up_proj:   3%|▎         | 1035/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.60.down_proj:   3%|▎         | 1036/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.61.gate_proj:   3%|▎         | 1037/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.61.up_proj:   3%|▎         | 1038/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.61.down_proj:   3%|▎         | 1039/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.62.gate_proj:   3%|▎         | 1040/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.62.up_proj:   3%|▎         | 1041/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.62.down_proj:   3%|▎         | 1042/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.63.gate_proj:   3%|▎         | 1043/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.63.up_proj:   3%|▎         | 1044/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.63.down_proj:   3%|▎         | 1045/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.64.gate_proj:   3%|▎         | 1046/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.64.up_proj:   3%|▎         | 1047/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.64.down_proj:   3%|▎         | 1048/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.65.gate_proj:   3%|▎         | 1049/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.65.up_proj:   3%|▎         | 1050/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.65.down_proj:   3%|▎         | 1051/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.66.gate_proj:   3%|▎         | 1052/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.66.up_proj:   3%|▎         | 1053/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.66.down_proj:   3%|▎         | 1054/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.67.gate_proj:   3%|▎         | 1055/36566 [00:01<00:36, 977.75it/s]
packing model.layers.1.mlp.experts.67.up_proj:   3%|▎         | 1056/36566 [00:01<00:36, 977.75it/s]  
packing model.layers.1.mlp.experts.67.up_proj:   3%|▎         | 1057/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.67.down_proj:   3%|▎         | 1057/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.68.gate_proj:   3%|▎         | 1058/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.68.up_proj:   3%|▎         | 1059/36566 [00:01<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.68.down_proj:   3%|▎         | 1060/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.69.gate_proj:   3%|▎         | 1061/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.69.up_proj:   3%|▎         | 1062/36566 [00:01<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.69.down_proj:   3%|▎         | 1063/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.70.gate_proj:   3%|▎         | 1064/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.70.up_proj:   3%|▎         | 1065/36566 [00:01<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.70.down_proj:   3%|▎         | 1066/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.71.gate_proj:   3%|▎         | 1067/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.71.up_proj:   3%|▎         | 1068/36566 [00:01<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.71.down_proj:   3%|▎         | 1069/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.72.gate_proj:   3%|▎         | 1070/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.72.up_proj:   3%|▎         | 1071/36566 [00:01<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.72.down_proj:   3%|▎         | 1072/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.73.gate_proj:   3%|▎         | 1073/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.73.up_proj:   3%|▎         | 1074/36566 [00:01<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.73.down_proj:   3%|▎         | 1075/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.74.gate_proj:   3%|▎         | 1076/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.74.up_proj:   3%|▎         | 1077/36566 [00:01<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.74.down_proj:   3%|▎         | 1078/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.75.gate_proj:   3%|▎         | 1079/36566 [00:01<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.75.up_proj:   3%|▎         | 1080/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.75.down_proj:   3%|▎         | 1081/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.76.gate_proj:   3%|▎         | 1082/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.76.up_proj:   3%|▎         | 1083/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.76.down_proj:   3%|▎         | 1084/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.77.gate_proj:   3%|▎         | 1085/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.77.up_proj:   3%|▎         | 1086/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.77.down_proj:   3%|▎         | 1087/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.78.gate_proj:   3%|▎         | 1088/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.78.up_proj:   3%|▎         | 1089/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.78.down_proj:   3%|▎         | 1090/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.79.gate_proj:   3%|▎         | 1091/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.79.up_proj:   3%|▎         | 1092/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.79.down_proj:   3%|▎         | 1093/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.80.gate_proj:   3%|▎         | 1094/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.80.up_proj:   3%|▎         | 1095/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.80.down_proj:   3%|▎         | 1096/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.81.gate_proj:   3%|▎         | 1097/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.81.up_proj:   3%|▎         | 1098/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.81.down_proj:   3%|▎         | 1099/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.82.gate_proj:   3%|▎         | 1100/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.82.up_proj:   3%|▎         | 1101/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.82.down_proj:   3%|▎         | 1102/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.83.gate_proj:   3%|▎         | 1103/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.83.up_proj:   3%|▎         | 1104/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.83.down_proj:   3%|▎         | 1105/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.84.gate_proj:   3%|▎         | 1106/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.84.up_proj:   3%|▎         | 1107/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.84.down_proj:   3%|▎         | 1108/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.85.gate_proj:   3%|▎         | 1109/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.85.up_proj:   3%|▎         | 1110/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.85.down_proj:   3%|▎         | 1111/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.86.gate_proj:   3%|▎         | 1112/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.86.up_proj:   3%|▎         | 1113/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.86.down_proj:   3%|▎         | 1114/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.87.gate_proj:   3%|▎         | 1115/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.87.up_proj:   3%|▎         | 1116/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.87.down_proj:   3%|▎         | 1117/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.88.gate_proj:   3%|▎         | 1118/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.88.up_proj:   3%|▎         | 1119/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.88.down_proj:   3%|▎         | 1120/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.89.gate_proj:   3%|▎         | 1121/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.89.up_proj:   3%|▎         | 1122/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.89.down_proj:   3%|▎         | 1123/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.90.gate_proj:   3%|▎         | 1124/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.90.up_proj:   3%|▎         | 1125/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.90.down_proj:   3%|▎         | 1126/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.91.gate_proj:   3%|▎         | 1127/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.91.up_proj:   3%|▎         | 1128/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.91.down_proj:   3%|▎         | 1129/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.92.gate_proj:   3%|▎         | 1130/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.92.up_proj:   3%|▎         | 1131/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.92.down_proj:   3%|▎         | 1132/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.93.gate_proj:   3%|▎         | 1133/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.93.up_proj:   3%|▎         | 1134/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.93.down_proj:   3%|▎         | 1135/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.94.gate_proj:   3%|▎         | 1136/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.94.up_proj:   3%|▎         | 1137/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.94.down_proj:   3%|▎         | 1138/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.95.gate_proj:   3%|▎         | 1139/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.95.up_proj:   3%|▎         | 1140/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.95.down_proj:   3%|▎         | 1141/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.96.gate_proj:   3%|▎         | 1142/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.96.up_proj:   3%|▎         | 1143/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.96.down_proj:   3%|▎         | 1144/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.97.gate_proj:   3%|▎         | 1145/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.97.up_proj:   3%|▎         | 1146/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.97.down_proj:   3%|▎         | 1147/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.98.gate_proj:   3%|▎         | 1148/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.98.up_proj:   3%|▎         | 1149/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.98.down_proj:   3%|▎         | 1150/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.99.gate_proj:   3%|▎         | 1151/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.99.up_proj:   3%|▎         | 1152/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.99.down_proj:   3%|▎         | 1153/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.100.gate_proj:   3%|▎         | 1154/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.100.up_proj:   3%|▎         | 1155/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.100.down_proj:   3%|▎         | 1156/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.101.gate_proj:   3%|▎         | 1157/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.101.up_proj:   3%|▎         | 1158/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.101.down_proj:   3%|▎         | 1159/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.102.gate_proj:   3%|▎         | 1160/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.102.up_proj:   3%|▎         | 1161/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.102.down_proj:   3%|▎         | 1162/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.103.gate_proj:   3%|▎         | 1163/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.103.up_proj:   3%|▎         | 1164/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.103.down_proj:   3%|▎         | 1165/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.104.gate_proj:   3%|▎         | 1166/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.104.up_proj:   3%|▎         | 1167/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.104.down_proj:   3%|▎         | 1168/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.105.gate_proj:   3%|▎         | 1169/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.105.up_proj:   3%|▎         | 1170/36566 [00:02<00:34, 1031.70it/s]  
packing model.layers.1.mlp.experts.105.down_proj:   3%|▎         | 1171/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.106.gate_proj:   3%|▎         | 1172/36566 [00:02<00:34, 1031.70it/s]
packing model.layers.1.mlp.experts.106.gate_proj:   3%|▎         | 1173/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.106.up_proj:   3%|▎         | 1173/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.106.down_proj:   3%|▎         | 1174/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.107.gate_proj:   3%|▎         | 1175/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.107.up_proj:   3%|▎         | 1176/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.107.down_proj:   3%|▎         | 1177/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.108.gate_proj:   3%|▎         | 1178/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.108.up_proj:   3%|▎         | 1179/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.108.down_proj:   3%|▎         | 1180/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.109.gate_proj:   3%|▎         | 1181/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.109.up_proj:   3%|▎         | 1182/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.109.down_proj:   3%|▎         | 1183/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.110.gate_proj:   3%|▎         | 1184/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.110.up_proj:   3%|▎         | 1185/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.110.down_proj:   3%|▎         | 1186/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.111.gate_proj:   3%|▎         | 1187/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.111.up_proj:   3%|▎         | 1188/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.111.down_proj:   3%|▎         | 1189/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.112.gate_proj:   3%|▎         | 1190/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.112.up_proj:   3%|▎         | 1191/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.112.down_proj:   3%|▎         | 1192/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.113.gate_proj:   3%|▎         | 1193/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.113.up_proj:   3%|▎         | 1194/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.113.down_proj:   3%|▎         | 1195/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.114.gate_proj:   3%|▎         | 1196/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.114.up_proj:   3%|▎         | 1197/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.114.down_proj:   3%|▎         | 1198/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.115.gate_proj:   3%|▎         | 1199/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.115.up_proj:   3%|▎         | 1200/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.115.down_proj:   3%|▎         | 1201/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.116.gate_proj:   3%|▎         | 1202/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.116.up_proj:   3%|▎         | 1203/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.116.down_proj:   3%|▎         | 1204/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.117.gate_proj:   3%|▎         | 1205/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.117.up_proj:   3%|▎         | 1206/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.117.down_proj:   3%|▎         | 1207/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.118.gate_proj:   3%|▎         | 1208/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.118.up_proj:   3%|▎         | 1209/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.118.down_proj:   3%|▎         | 1210/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.119.gate_proj:   3%|▎         | 1211/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.119.up_proj:   3%|▎         | 1212/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.119.down_proj:   3%|▎         | 1213/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.120.gate_proj:   3%|▎         | 1214/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.120.up_proj:   3%|▎         | 1215/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.120.down_proj:   3%|▎         | 1216/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.121.gate_proj:   3%|▎         | 1217/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.121.up_proj:   3%|▎         | 1218/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.121.down_proj:   3%|▎         | 1219/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.122.gate_proj:   3%|▎         | 1220/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.122.up_proj:   3%|▎         | 1221/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.122.down_proj:   3%|▎         | 1222/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.123.gate_proj:   3%|▎         | 1223/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.123.up_proj:   3%|▎         | 1224/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.123.down_proj:   3%|▎         | 1225/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.124.gate_proj:   3%|▎         | 1226/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.124.up_proj:   3%|▎         | 1227/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.124.down_proj:   3%|▎         | 1228/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.125.gate_proj:   3%|▎         | 1229/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.125.up_proj:   3%|▎         | 1230/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.125.down_proj:   3%|▎         | 1231/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.126.gate_proj:   3%|▎         | 1232/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.126.up_proj:   3%|▎         | 1233/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.126.down_proj:   3%|▎         | 1234/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.127.gate_proj:   3%|▎         | 1235/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.1.mlp.experts.127.up_proj:   3%|▎         | 1236/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.1.mlp.experts.127.down_proj:   3%|▎         | 1237/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.0.gate_proj:   3%|▎         | 1238/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.0.up_proj:   3%|▎         | 1239/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.0.down_proj:   3%|▎         | 1240/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.1.gate_proj:   3%|▎         | 1241/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.1.up_proj:   3%|▎         | 1242/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.1.down_proj:   3%|▎         | 1243/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.2.gate_proj:   3%|▎         | 1244/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.2.up_proj:   3%|▎         | 1245/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.2.down_proj:   3%|▎         | 1246/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.3.gate_proj:   3%|▎         | 1247/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.3.up_proj:   3%|▎         | 1248/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.3.down_proj:   3%|▎         | 1249/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.4.gate_proj:   3%|▎         | 1250/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.4.up_proj:   3%|▎         | 1251/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.4.down_proj:   3%|▎         | 1252/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.5.gate_proj:   3%|▎         | 1253/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.5.up_proj:   3%|▎         | 1254/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.5.down_proj:   3%|▎         | 1255/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.6.gate_proj:   3%|▎         | 1256/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.6.up_proj:   3%|▎         | 1257/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.6.down_proj:   3%|▎         | 1258/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.7.gate_proj:   3%|▎         | 1259/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.7.up_proj:   3%|▎         | 1260/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.7.down_proj:   3%|▎         | 1261/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.8.gate_proj:   3%|▎         | 1262/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.8.up_proj:   3%|▎         | 1263/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.8.down_proj:   3%|▎         | 1264/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.9.gate_proj:   3%|▎         | 1265/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.9.up_proj:   3%|▎         | 1266/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.9.down_proj:   3%|▎         | 1267/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.10.gate_proj:   3%|▎         | 1268/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.10.up_proj:   3%|▎         | 1269/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.10.down_proj:   3%|▎         | 1270/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.11.gate_proj:   3%|▎         | 1271/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.11.up_proj:   3%|▎         | 1272/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.11.down_proj:   3%|▎         | 1273/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.12.gate_proj:   3%|▎         | 1274/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.12.up_proj:   3%|▎         | 1275/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.12.down_proj:   3%|▎         | 1276/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.13.gate_proj:   3%|▎         | 1277/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.13.up_proj:   3%|▎         | 1278/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.13.down_proj:   3%|▎         | 1279/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.14.gate_proj:   4%|▎         | 1280/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.14.up_proj:   4%|▎         | 1281/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.14.down_proj:   4%|▎         | 1282/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.15.gate_proj:   4%|▎         | 1283/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.15.up_proj:   4%|▎         | 1284/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.15.down_proj:   4%|▎         | 1285/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.16.gate_proj:   4%|▎         | 1286/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.16.up_proj:   4%|▎         | 1287/36566 [00:02<00:33, 1065.96it/s]  
packing model.layers.2.mlp.experts.16.down_proj:   4%|▎         | 1288/36566 [00:02<00:33, 1065.96it/s]
packing model.layers.2.mlp.experts.16.down_proj:   4%|▎         | 1289/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.17.gate_proj:   4%|▎         | 1289/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.17.up_proj:   4%|▎         | 1290/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.17.down_proj:   4%|▎         | 1291/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.18.gate_proj:   4%|▎         | 1292/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.18.up_proj:   4%|▎         | 1293/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.18.down_proj:   4%|▎         | 1294/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.19.gate_proj:   4%|▎         | 1295/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.19.up_proj:   4%|▎         | 1296/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.19.down_proj:   4%|▎         | 1297/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.20.gate_proj:   4%|▎         | 1298/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.20.up_proj:   4%|▎         | 1299/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.20.down_proj:   4%|▎         | 1300/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.21.gate_proj:   4%|▎         | 1301/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.21.up_proj:   4%|▎         | 1302/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.21.down_proj:   4%|▎         | 1303/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.22.gate_proj:   4%|▎         | 1304/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.22.up_proj:   4%|▎         | 1305/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.22.down_proj:   4%|▎         | 1306/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.23.gate_proj:   4%|▎         | 1307/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.23.up_proj:   4%|▎         | 1308/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.23.down_proj:   4%|▎         | 1309/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.24.gate_proj:   4%|▎         | 1310/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.24.up_proj:   4%|▎         | 1311/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.24.down_proj:   4%|▎         | 1312/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.25.gate_proj:   4%|▎         | 1313/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.25.up_proj:   4%|▎         | 1314/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.25.down_proj:   4%|▎         | 1315/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.26.gate_proj:   4%|▎         | 1316/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.26.up_proj:   4%|▎         | 1317/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.26.down_proj:   4%|▎         | 1318/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.27.gate_proj:   4%|▎         | 1319/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.27.up_proj:   4%|▎         | 1320/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.27.down_proj:   4%|▎         | 1321/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.28.gate_proj:   4%|▎         | 1322/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.28.up_proj:   4%|▎         | 1323/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.28.down_proj:   4%|▎         | 1324/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.29.gate_proj:   4%|▎         | 1325/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.29.up_proj:   4%|▎         | 1326/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.29.down_proj:   4%|▎         | 1327/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.30.gate_proj:   4%|▎         | 1328/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.30.up_proj:   4%|▎         | 1329/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.30.down_proj:   4%|▎         | 1330/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.31.gate_proj:   4%|▎         | 1331/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.31.up_proj:   4%|▎         | 1332/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.31.down_proj:   4%|▎         | 1333/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.32.gate_proj:   4%|▎         | 1334/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.32.up_proj:   4%|▎         | 1335/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.32.down_proj:   4%|▎         | 1336/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.33.gate_proj:   4%|▎         | 1337/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.33.up_proj:   4%|▎         | 1338/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.33.down_proj:   4%|▎         | 1339/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.34.gate_proj:   4%|▎         | 1340/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.34.up_proj:   4%|▎         | 1341/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.34.down_proj:   4%|▎         | 1342/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.35.gate_proj:   4%|▎         | 1343/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.35.up_proj:   4%|▎         | 1344/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.35.down_proj:   4%|▎         | 1345/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.36.gate_proj:   4%|▎         | 1346/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.36.up_proj:   4%|▎         | 1347/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.36.down_proj:   4%|▎         | 1348/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.37.gate_proj:   4%|▎         | 1349/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.37.up_proj:   4%|▎         | 1350/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.37.down_proj:   4%|▎         | 1351/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.38.gate_proj:   4%|▎         | 1352/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.38.up_proj:   4%|▎         | 1353/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.38.down_proj:   4%|▎         | 1354/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.39.gate_proj:   4%|▎         | 1355/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.39.up_proj:   4%|▎         | 1356/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.39.down_proj:   4%|▎         | 1357/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.40.gate_proj:   4%|▎         | 1358/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.40.up_proj:   4%|▎         | 1359/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.40.down_proj:   4%|▎         | 1360/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.41.gate_proj:   4%|▎         | 1361/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.41.up_proj:   4%|▎         | 1362/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.41.down_proj:   4%|▎         | 1363/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.42.gate_proj:   4%|▎         | 1364/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.42.up_proj:   4%|▎         | 1365/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.42.down_proj:   4%|▎         | 1366/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.43.gate_proj:   4%|▎         | 1367/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.43.up_proj:   4%|▎         | 1368/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.43.down_proj:   4%|▎         | 1369/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.44.gate_proj:   4%|▎         | 1370/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.44.up_proj:   4%|▎         | 1371/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.44.down_proj:   4%|▍         | 1372/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.45.gate_proj:   4%|▍         | 1373/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.45.up_proj:   4%|▍         | 1374/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.45.down_proj:   4%|▍         | 1375/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.46.gate_proj:   4%|▍         | 1376/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.46.up_proj:   4%|▍         | 1377/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.46.down_proj:   4%|▍         | 1378/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.47.gate_proj:   4%|▍         | 1379/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.47.up_proj:   4%|▍         | 1380/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.47.down_proj:   4%|▍         | 1381/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.48.gate_proj:   4%|▍         | 1382/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.48.up_proj:   4%|▍         | 1383/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.48.down_proj:   4%|▍         | 1384/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.49.gate_proj:   4%|▍         | 1385/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.49.up_proj:   4%|▍         | 1386/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.49.down_proj:   4%|▍         | 1387/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.50.gate_proj:   4%|▍         | 1388/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.50.up_proj:   4%|▍         | 1389/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.50.down_proj:   4%|▍         | 1390/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.51.gate_proj:   4%|▍         | 1391/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.51.up_proj:   4%|▍         | 1392/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.51.down_proj:   4%|▍         | 1393/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.52.gate_proj:   4%|▍         | 1394/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.52.up_proj:   4%|▍         | 1395/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.52.down_proj:   4%|▍         | 1396/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.53.gate_proj:   4%|▍         | 1397/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.53.up_proj:   4%|▍         | 1398/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.53.down_proj:   4%|▍         | 1399/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.54.gate_proj:   4%|▍         | 1400/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.54.up_proj:   4%|▍         | 1401/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.54.down_proj:   4%|▍         | 1402/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.55.gate_proj:   4%|▍         | 1403/36566 [00:02<00:32, 1091.63it/s]
packing model.layers.2.mlp.experts.55.up_proj:   4%|▍         | 1404/36566 [00:02<00:32, 1091.63it/s]  
packing model.layers.2.mlp.experts.55.up_proj:   4%|▍         | 1405/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.55.down_proj:   4%|▍         | 1405/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.56.gate_proj:   4%|▍         | 1406/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.56.up_proj:   4%|▍         | 1407/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.56.down_proj:   4%|▍         | 1408/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.57.gate_proj:   4%|▍         | 1409/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.57.up_proj:   4%|▍         | 1410/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.57.down_proj:   4%|▍         | 1411/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.58.gate_proj:   4%|▍         | 1412/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.58.up_proj:   4%|▍         | 1413/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.58.down_proj:   4%|▍         | 1414/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.59.gate_proj:   4%|▍         | 1415/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.59.up_proj:   4%|▍         | 1416/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.59.down_proj:   4%|▍         | 1417/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.60.gate_proj:   4%|▍         | 1418/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.60.up_proj:   4%|▍         | 1419/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.60.down_proj:   4%|▍         | 1420/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.61.gate_proj:   4%|▍         | 1421/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.61.up_proj:   4%|▍         | 1422/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.61.down_proj:   4%|▍         | 1423/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.62.gate_proj:   4%|▍         | 1424/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.62.up_proj:   4%|▍         | 1425/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.62.down_proj:   4%|▍         | 1426/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.63.gate_proj:   4%|▍         | 1427/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.63.up_proj:   4%|▍         | 1428/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.63.down_proj:   4%|▍         | 1429/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.64.gate_proj:   4%|▍         | 1430/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.64.up_proj:   4%|▍         | 1431/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.64.down_proj:   4%|▍         | 1432/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.65.gate_proj:   4%|▍         | 1433/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.65.up_proj:   4%|▍         | 1434/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.65.down_proj:   4%|▍         | 1435/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.66.gate_proj:   4%|▍         | 1436/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.66.up_proj:   4%|▍         | 1437/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.66.down_proj:   4%|▍         | 1438/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.67.gate_proj:   4%|▍         | 1439/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.67.up_proj:   4%|▍         | 1440/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.67.down_proj:   4%|▍         | 1441/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.68.gate_proj:   4%|▍         | 1442/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.68.up_proj:   4%|▍         | 1443/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.68.down_proj:   4%|▍         | 1444/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.69.gate_proj:   4%|▍         | 1445/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.69.up_proj:   4%|▍         | 1446/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.69.down_proj:   4%|▍         | 1447/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.70.gate_proj:   4%|▍         | 1448/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.70.up_proj:   4%|▍         | 1449/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.70.down_proj:   4%|▍         | 1450/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.71.gate_proj:   4%|▍         | 1451/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.71.up_proj:   4%|▍         | 1452/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.71.down_proj:   4%|▍         | 1453/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.72.gate_proj:   4%|▍         | 1454/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.72.up_proj:   4%|▍         | 1455/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.72.down_proj:   4%|▍         | 1456/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.73.gate_proj:   4%|▍         | 1457/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.73.up_proj:   4%|▍         | 1458/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.73.down_proj:   4%|▍         | 1459/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.74.gate_proj:   4%|▍         | 1460/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.74.up_proj:   4%|▍         | 1461/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.74.down_proj:   4%|▍         | 1462/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.75.gate_proj:   4%|▍         | 1463/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.75.up_proj:   4%|▍         | 1464/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.75.down_proj:   4%|▍         | 1465/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.76.gate_proj:   4%|▍         | 1466/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.76.up_proj:   4%|▍         | 1467/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.76.down_proj:   4%|▍         | 1468/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.77.gate_proj:   4%|▍         | 1469/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.77.up_proj:   4%|▍         | 1470/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.77.down_proj:   4%|▍         | 1471/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.78.gate_proj:   4%|▍         | 1472/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.78.up_proj:   4%|▍         | 1473/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.78.down_proj:   4%|▍         | 1474/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.79.gate_proj:   4%|▍         | 1475/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.79.up_proj:   4%|▍         | 1476/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.79.down_proj:   4%|▍         | 1477/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.80.gate_proj:   4%|▍         | 1478/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.80.up_proj:   4%|▍         | 1479/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.80.down_proj:   4%|▍         | 1480/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.81.gate_proj:   4%|▍         | 1481/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.81.up_proj:   4%|▍         | 1482/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.81.down_proj:   4%|▍         | 1483/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.82.gate_proj:   4%|▍         | 1484/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.82.up_proj:   4%|▍         | 1485/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.82.down_proj:   4%|▍         | 1486/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.83.gate_proj:   4%|▍         | 1487/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.83.up_proj:   4%|▍         | 1488/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.83.down_proj:   4%|▍         | 1489/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.84.gate_proj:   4%|▍         | 1490/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.84.up_proj:   4%|▍         | 1491/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.84.down_proj:   4%|▍         | 1492/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.85.gate_proj:   4%|▍         | 1493/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.85.up_proj:   4%|▍         | 1494/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.85.down_proj:   4%|▍         | 1495/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.86.gate_proj:   4%|▍         | 1496/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.86.up_proj:   4%|▍         | 1497/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.86.down_proj:   4%|▍         | 1498/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.87.gate_proj:   4%|▍         | 1499/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.87.up_proj:   4%|▍         | 1500/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.87.down_proj:   4%|▍         | 1501/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.88.gate_proj:   4%|▍         | 1502/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.88.up_proj:   4%|▍         | 1503/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.88.down_proj:   4%|▍         | 1504/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.89.gate_proj:   4%|▍         | 1505/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.89.up_proj:   4%|▍         | 1506/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.89.down_proj:   4%|▍         | 1507/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.90.gate_proj:   4%|▍         | 1508/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.90.up_proj:   4%|▍         | 1509/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.90.down_proj:   4%|▍         | 1510/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.91.gate_proj:   4%|▍         | 1511/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.91.up_proj:   4%|▍         | 1512/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.91.down_proj:   4%|▍         | 1513/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.92.gate_proj:   4%|▍         | 1514/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.92.up_proj:   4%|▍         | 1515/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.92.down_proj:   4%|▍         | 1516/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.93.gate_proj:   4%|▍         | 1517/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.93.up_proj:   4%|▍         | 1518/36566 [00:02<00:31, 1111.04it/s]  
packing model.layers.2.mlp.experts.93.down_proj:   4%|▍         | 1519/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.94.gate_proj:   4%|▍         | 1520/36566 [00:02<00:31, 1111.04it/s]
packing model.layers.2.mlp.experts.94.gate_proj:   4%|▍         | 1521/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.94.up_proj:   4%|▍         | 1521/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.94.down_proj:   4%|▍         | 1522/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.95.gate_proj:   4%|▍         | 1523/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.95.up_proj:   4%|▍         | 1524/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.95.down_proj:   4%|▍         | 1525/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.96.gate_proj:   4%|▍         | 1526/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.96.up_proj:   4%|▍         | 1527/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.96.down_proj:   4%|▍         | 1528/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.97.gate_proj:   4%|▍         | 1529/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.97.up_proj:   4%|▍         | 1530/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.97.down_proj:   4%|▍         | 1531/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.98.gate_proj:   4%|▍         | 1532/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.98.up_proj:   4%|▍         | 1533/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.98.down_proj:   4%|▍         | 1534/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.99.gate_proj:   4%|▍         | 1535/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.99.up_proj:   4%|▍         | 1536/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.99.down_proj:   4%|▍         | 1537/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.100.gate_proj:   4%|▍         | 1538/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.100.up_proj:   4%|▍         | 1539/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.100.down_proj:   4%|▍         | 1540/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.101.gate_proj:   4%|▍         | 1541/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.101.up_proj:   4%|▍         | 1542/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.101.down_proj:   4%|▍         | 1543/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.102.gate_proj:   4%|▍         | 1544/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.102.up_proj:   4%|▍         | 1545/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.102.down_proj:   4%|▍         | 1546/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.103.gate_proj:   4%|▍         | 1547/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.103.up_proj:   4%|▍         | 1548/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.103.down_proj:   4%|▍         | 1549/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.104.gate_proj:   4%|▍         | 1550/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.104.up_proj:   4%|▍         | 1551/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.104.down_proj:   4%|▍         | 1552/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.105.gate_proj:   4%|▍         | 1553/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.105.up_proj:   4%|▍         | 1554/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.105.down_proj:   4%|▍         | 1555/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.106.gate_proj:   4%|▍         | 1556/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.106.up_proj:   4%|▍         | 1557/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.106.down_proj:   4%|▍         | 1558/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.107.gate_proj:   4%|▍         | 1559/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.107.up_proj:   4%|▍         | 1560/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.107.down_proj:   4%|▍         | 1561/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.108.gate_proj:   4%|▍         | 1562/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.108.up_proj:   4%|▍         | 1563/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.108.down_proj:   4%|▍         | 1564/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.109.gate_proj:   4%|▍         | 1565/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.109.up_proj:   4%|▍         | 1566/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.109.down_proj:   4%|▍         | 1567/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.110.gate_proj:   4%|▍         | 1568/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.110.up_proj:   4%|▍         | 1569/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.110.down_proj:   4%|▍         | 1570/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.111.gate_proj:   4%|▍         | 1571/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.111.up_proj:   4%|▍         | 1572/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.111.down_proj:   4%|▍         | 1573/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.112.gate_proj:   4%|▍         | 1574/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.112.up_proj:   4%|▍         | 1575/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.112.down_proj:   4%|▍         | 1576/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.113.gate_proj:   4%|▍         | 1577/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.113.up_proj:   4%|▍         | 1578/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.113.down_proj:   4%|▍         | 1579/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.114.gate_proj:   4%|▍         | 1580/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.114.up_proj:   4%|▍         | 1581/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.114.down_proj:   4%|▍         | 1582/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.115.gate_proj:   4%|▍         | 1583/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.115.up_proj:   4%|▍         | 1584/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.115.down_proj:   4%|▍         | 1585/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.116.gate_proj:   4%|▍         | 1586/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.116.up_proj:   4%|▍         | 1587/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.116.down_proj:   4%|▍         | 1588/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.117.gate_proj:   4%|▍         | 1589/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.117.up_proj:   4%|▍         | 1590/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.117.down_proj:   4%|▍         | 1591/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.118.gate_proj:   4%|▍         | 1592/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.118.up_proj:   4%|▍         | 1593/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.118.down_proj:   4%|▍         | 1594/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.119.gate_proj:   4%|▍         | 1595/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.119.up_proj:   4%|▍         | 1596/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.119.down_proj:   4%|▍         | 1597/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.120.gate_proj:   4%|▍         | 1598/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.120.up_proj:   4%|▍         | 1599/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.120.down_proj:   4%|▍         | 1600/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.121.gate_proj:   4%|▍         | 1601/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.121.up_proj:   4%|▍         | 1602/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.121.down_proj:   4%|▍         | 1603/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.122.gate_proj:   4%|▍         | 1604/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.122.up_proj:   4%|▍         | 1605/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.122.down_proj:   4%|▍         | 1606/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.123.gate_proj:   4%|▍         | 1607/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.123.up_proj:   4%|▍         | 1608/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.123.down_proj:   4%|▍         | 1609/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.124.gate_proj:   4%|▍         | 1610/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.124.up_proj:   4%|▍         | 1611/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.124.down_proj:   4%|▍         | 1612/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.125.gate_proj:   4%|▍         | 1613/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.125.up_proj:   4%|▍         | 1614/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.125.down_proj:   4%|▍         | 1615/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.126.gate_proj:   4%|▍         | 1616/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.126.up_proj:   4%|▍         | 1617/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.126.down_proj:   4%|▍         | 1618/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.127.gate_proj:   4%|▍         | 1619/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.2.mlp.experts.127.up_proj:   4%|▍         | 1620/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.2.mlp.experts.127.down_proj:   4%|▍         | 1621/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.0.gate_proj:   4%|▍         | 1622/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.3.mlp.experts.0.up_proj:   4%|▍         | 1623/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.3.mlp.experts.0.down_proj:   4%|▍         | 1624/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.1.gate_proj:   4%|▍         | 1625/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.1.up_proj:   4%|▍         | 1626/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.3.mlp.experts.1.down_proj:   4%|▍         | 1627/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.2.gate_proj:   4%|▍         | 1628/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.2.up_proj:   4%|▍         | 1629/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.3.mlp.experts.2.down_proj:   4%|▍         | 1630/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.3.gate_proj:   4%|▍         | 1631/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.3.up_proj:   4%|▍         | 1632/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.3.mlp.experts.3.down_proj:   4%|▍         | 1633/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.4.gate_proj:   4%|▍         | 1634/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.4.up_proj:   4%|▍         | 1635/36566 [00:02<00:31, 1119.48it/s]  
packing model.layers.3.mlp.experts.4.down_proj:   4%|▍         | 1636/36566 [00:02<00:31, 1119.48it/s]
packing model.layers.3.mlp.experts.4.down_proj:   4%|▍         | 1637/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.5.gate_proj:   4%|▍         | 1637/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.5.up_proj:   4%|▍         | 1638/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.5.down_proj:   4%|▍         | 1639/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.6.gate_proj:   4%|▍         | 1640/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.6.up_proj:   4%|▍         | 1641/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.6.down_proj:   4%|▍         | 1642/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.7.gate_proj:   4%|▍         | 1643/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.7.up_proj:   4%|▍         | 1644/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.7.down_proj:   4%|▍         | 1645/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.8.gate_proj:   5%|▍         | 1646/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.8.up_proj:   5%|▍         | 1647/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.8.down_proj:   5%|▍         | 1648/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.9.gate_proj:   5%|▍         | 1649/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.9.up_proj:   5%|▍         | 1650/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.9.down_proj:   5%|▍         | 1651/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.10.gate_proj:   5%|▍         | 1652/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.10.up_proj:   5%|▍         | 1653/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.10.down_proj:   5%|▍         | 1654/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.11.gate_proj:   5%|▍         | 1655/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.11.up_proj:   5%|▍         | 1656/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.11.down_proj:   5%|▍         | 1657/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.12.gate_proj:   5%|▍         | 1658/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.12.up_proj:   5%|▍         | 1659/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.12.down_proj:   5%|▍         | 1660/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.13.gate_proj:   5%|▍         | 1661/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.13.up_proj:   5%|▍         | 1662/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.13.down_proj:   5%|▍         | 1663/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.14.gate_proj:   5%|▍         | 1664/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.14.up_proj:   5%|▍         | 1665/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.14.down_proj:   5%|▍         | 1666/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.15.gate_proj:   5%|▍         | 1667/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.15.up_proj:   5%|▍         | 1668/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.15.down_proj:   5%|▍         | 1669/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.16.gate_proj:   5%|▍         | 1670/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.16.up_proj:   5%|▍         | 1671/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.16.down_proj:   5%|▍         | 1672/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.17.gate_proj:   5%|▍         | 1673/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.17.up_proj:   5%|▍         | 1674/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.17.down_proj:   5%|▍         | 1675/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.18.gate_proj:   5%|▍         | 1676/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.18.up_proj:   5%|▍         | 1677/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.18.down_proj:   5%|▍         | 1678/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.19.gate_proj:   5%|▍         | 1679/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.19.up_proj:   5%|▍         | 1680/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.19.down_proj:   5%|▍         | 1681/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.20.gate_proj:   5%|▍         | 1682/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.20.up_proj:   5%|▍         | 1683/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.20.down_proj:   5%|▍         | 1684/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.21.gate_proj:   5%|▍         | 1685/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.21.up_proj:   5%|▍         | 1686/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.21.down_proj:   5%|▍         | 1687/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.22.gate_proj:   5%|▍         | 1688/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.22.up_proj:   5%|▍         | 1689/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.22.down_proj:   5%|▍         | 1690/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.23.gate_proj:   5%|▍         | 1691/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.23.up_proj:   5%|▍         | 1692/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.23.down_proj:   5%|▍         | 1693/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.24.gate_proj:   5%|▍         | 1694/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.24.up_proj:   5%|▍         | 1695/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.24.down_proj:   5%|▍         | 1696/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.25.gate_proj:   5%|▍         | 1697/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.25.up_proj:   5%|▍         | 1698/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.25.down_proj:   5%|▍         | 1699/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.26.gate_proj:   5%|▍         | 1700/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.26.up_proj:   5%|▍         | 1701/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.26.down_proj:   5%|▍         | 1702/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.27.gate_proj:   5%|▍         | 1703/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.27.up_proj:   5%|▍         | 1704/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.27.down_proj:   5%|▍         | 1705/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.28.gate_proj:   5%|▍         | 1706/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.28.up_proj:   5%|▍         | 1707/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.28.down_proj:   5%|▍         | 1708/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.29.gate_proj:   5%|▍         | 1709/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.29.up_proj:   5%|▍         | 1710/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.29.down_proj:   5%|▍         | 1711/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.30.gate_proj:   5%|▍         | 1712/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.30.up_proj:   5%|▍         | 1713/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.30.down_proj:   5%|▍         | 1714/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.31.gate_proj:   5%|▍         | 1715/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.31.up_proj:   5%|▍         | 1716/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.31.down_proj:   5%|▍         | 1717/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.32.gate_proj:   5%|▍         | 1718/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.32.up_proj:   5%|▍         | 1719/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.32.down_proj:   5%|▍         | 1720/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.33.gate_proj:   5%|▍         | 1721/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.33.up_proj:   5%|▍         | 1722/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.33.down_proj:   5%|▍         | 1723/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.34.gate_proj:   5%|▍         | 1724/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.34.up_proj:   5%|▍         | 1725/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.34.down_proj:   5%|▍         | 1726/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.35.gate_proj:   5%|▍         | 1727/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.35.up_proj:   5%|▍         | 1728/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.35.down_proj:   5%|▍         | 1729/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.36.gate_proj:   5%|▍         | 1730/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.36.up_proj:   5%|▍         | 1731/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.36.down_proj:   5%|▍         | 1732/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.37.gate_proj:   5%|▍         | 1733/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.37.up_proj:   5%|▍         | 1734/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.37.down_proj:   5%|▍         | 1735/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.38.gate_proj:   5%|▍         | 1736/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.38.up_proj:   5%|▍         | 1737/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.38.down_proj:   5%|▍         | 1738/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.39.gate_proj:   5%|▍         | 1739/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.39.up_proj:   5%|▍         | 1740/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.39.down_proj:   5%|▍         | 1741/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.40.gate_proj:   5%|▍         | 1742/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.40.up_proj:   5%|▍         | 1743/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.40.down_proj:   5%|▍         | 1744/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.41.gate_proj:   5%|▍         | 1745/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.41.up_proj:   5%|▍         | 1746/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.41.down_proj:   5%|▍         | 1747/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.42.gate_proj:   5%|▍         | 1748/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.42.up_proj:   5%|▍         | 1749/36566 [00:02<00:31, 1113.42it/s]  
packing model.layers.3.mlp.experts.42.down_proj:   5%|▍         | 1750/36566 [00:02<00:31, 1113.42it/s]
packing model.layers.3.mlp.experts.42.down_proj:   5%|▍         | 1751/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.43.gate_proj:   5%|▍         | 1751/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.43.up_proj:   5%|▍         | 1752/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.43.down_proj:   5%|▍         | 1753/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.44.gate_proj:   5%|▍         | 1754/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.44.up_proj:   5%|▍         | 1755/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.44.down_proj:   5%|▍         | 1756/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.45.gate_proj:   5%|▍         | 1757/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.45.up_proj:   5%|▍         | 1758/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.45.down_proj:   5%|▍         | 1759/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.46.gate_proj:   5%|▍         | 1760/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.46.up_proj:   5%|▍         | 1761/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.46.down_proj:   5%|▍         | 1762/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.47.gate_proj:   5%|▍         | 1763/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.47.up_proj:   5%|▍         | 1764/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.47.down_proj:   5%|▍         | 1765/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.48.gate_proj:   5%|▍         | 1766/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.48.up_proj:   5%|▍         | 1767/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.48.down_proj:   5%|▍         | 1768/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.49.gate_proj:   5%|▍         | 1769/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.49.up_proj:   5%|▍         | 1770/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.49.down_proj:   5%|▍         | 1771/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.50.gate_proj:   5%|▍         | 1772/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.50.up_proj:   5%|▍         | 1773/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.50.down_proj:   5%|▍         | 1774/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.51.gate_proj:   5%|▍         | 1775/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.51.up_proj:   5%|▍         | 1776/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.51.down_proj:   5%|▍         | 1777/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.52.gate_proj:   5%|▍         | 1778/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.52.up_proj:   5%|▍         | 1779/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.52.down_proj:   5%|▍         | 1780/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.53.gate_proj:   5%|▍         | 1781/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.53.up_proj:   5%|▍         | 1782/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.53.down_proj:   5%|▍         | 1783/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.54.gate_proj:   5%|▍         | 1784/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.54.up_proj:   5%|▍         | 1785/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.54.down_proj:   5%|▍         | 1786/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.55.gate_proj:   5%|▍         | 1787/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.55.up_proj:   5%|▍         | 1788/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.55.down_proj:   5%|▍         | 1789/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.56.gate_proj:   5%|▍         | 1790/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.56.up_proj:   5%|▍         | 1791/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.56.down_proj:   5%|▍         | 1792/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.57.gate_proj:   5%|▍         | 1793/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.57.up_proj:   5%|▍         | 1794/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.57.down_proj:   5%|▍         | 1795/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.58.gate_proj:   5%|▍         | 1796/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.58.up_proj:   5%|▍         | 1797/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.58.down_proj:   5%|▍         | 1798/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.59.gate_proj:   5%|▍         | 1799/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.59.up_proj:   5%|▍         | 1800/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.59.down_proj:   5%|▍         | 1801/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.60.gate_proj:   5%|▍         | 1802/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.60.up_proj:   5%|▍         | 1803/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.60.down_proj:   5%|▍         | 1804/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.61.gate_proj:   5%|▍         | 1805/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.61.up_proj:   5%|▍         | 1806/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.61.down_proj:   5%|▍         | 1807/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.62.gate_proj:   5%|▍         | 1808/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.62.up_proj:   5%|▍         | 1809/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.62.down_proj:   5%|▍         | 1810/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.63.gate_proj:   5%|▍         | 1811/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.63.up_proj:   5%|▍         | 1812/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.63.down_proj:   5%|▍         | 1813/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.64.gate_proj:   5%|▍         | 1814/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.64.up_proj:   5%|▍         | 1815/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.64.down_proj:   5%|▍         | 1816/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.65.gate_proj:   5%|▍         | 1817/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.65.up_proj:   5%|▍         | 1818/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.65.down_proj:   5%|▍         | 1819/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.66.gate_proj:   5%|▍         | 1820/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.66.up_proj:   5%|▍         | 1821/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.66.down_proj:   5%|▍         | 1822/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.67.gate_proj:   5%|▍         | 1823/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.67.up_proj:   5%|▍         | 1824/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.67.down_proj:   5%|▍         | 1825/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.68.gate_proj:   5%|▍         | 1826/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.68.up_proj:   5%|▍         | 1827/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.68.down_proj:   5%|▍         | 1828/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.69.gate_proj:   5%|▌         | 1829/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.69.up_proj:   5%|▌         | 1830/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.69.down_proj:   5%|▌         | 1831/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.70.gate_proj:   5%|▌         | 1832/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.70.up_proj:   5%|▌         | 1833/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.70.down_proj:   5%|▌         | 1834/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.71.gate_proj:   5%|▌         | 1835/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.71.up_proj:   5%|▌         | 1836/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.71.down_proj:   5%|▌         | 1837/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.72.gate_proj:   5%|▌         | 1838/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.72.up_proj:   5%|▌         | 1839/36566 [00:02<00:31, 1120.14it/s]  
packing model.layers.3.mlp.experts.72.down_proj:   5%|▌         | 1840/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.73.gate_proj:   5%|▌         | 1841/36566 [00:02<00:31, 1120.14it/s]
packing model.layers.3.mlp.experts.73.up_proj:   5%|▌         | 1842/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.73.down_proj:   5%|▌         | 1843/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.74.gate_proj:   5%|▌         | 1844/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.74.up_proj:   5%|▌         | 1845/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.74.down_proj:   5%|▌         | 1846/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.75.gate_proj:   5%|▌         | 1847/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.75.up_proj:   5%|▌         | 1848/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.75.down_proj:   5%|▌         | 1849/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.76.gate_proj:   5%|▌         | 1850/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.76.up_proj:   5%|▌         | 1851/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.76.down_proj:   5%|▌         | 1852/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.77.gate_proj:   5%|▌         | 1853/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.77.up_proj:   5%|▌         | 1854/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.77.down_proj:   5%|▌         | 1855/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.78.gate_proj:   5%|▌         | 1856/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.78.up_proj:   5%|▌         | 1857/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.78.down_proj:   5%|▌         | 1858/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.79.gate_proj:   5%|▌         | 1859/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.79.up_proj:   5%|▌         | 1860/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.79.down_proj:   5%|▌         | 1861/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.80.gate_proj:   5%|▌         | 1862/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.80.up_proj:   5%|▌         | 1863/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.80.down_proj:   5%|▌         | 1864/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.81.gate_proj:   5%|▌         | 1865/36566 [00:02<00:30, 1120.14it/s]
packing model.layers.3.mlp.experts.81.up_proj:   5%|▌         | 1866/36566 [00:02<00:30, 1120.14it/s]  
packing model.layers.3.mlp.experts.81.up_proj:   5%|▌         | 1867/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.81.down_proj:   5%|▌         | 1867/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.82.gate_proj:   5%|▌         | 1868/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.82.up_proj:   5%|▌         | 1869/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.82.down_proj:   5%|▌         | 1870/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.83.gate_proj:   5%|▌         | 1871/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.83.up_proj:   5%|▌         | 1872/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.83.down_proj:   5%|▌         | 1873/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.84.gate_proj:   5%|▌         | 1874/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.84.up_proj:   5%|▌         | 1875/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.84.down_proj:   5%|▌         | 1876/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.85.gate_proj:   5%|▌         | 1877/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.85.up_proj:   5%|▌         | 1878/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.85.down_proj:   5%|▌         | 1879/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.86.gate_proj:   5%|▌         | 1880/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.86.up_proj:   5%|▌         | 1881/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.86.down_proj:   5%|▌         | 1882/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.87.gate_proj:   5%|▌         | 1883/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.87.up_proj:   5%|▌         | 1884/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.87.down_proj:   5%|▌         | 1885/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.88.gate_proj:   5%|▌         | 1886/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.88.up_proj:   5%|▌         | 1887/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.88.down_proj:   5%|▌         | 1888/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.89.gate_proj:   5%|▌         | 1889/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.89.up_proj:   5%|▌         | 1890/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.89.down_proj:   5%|▌         | 1891/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.90.gate_proj:   5%|▌         | 1892/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.90.up_proj:   5%|▌         | 1893/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.90.down_proj:   5%|▌         | 1894/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.91.gate_proj:   5%|▌         | 1895/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.91.up_proj:   5%|▌         | 1896/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.91.down_proj:   5%|▌         | 1897/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.92.gate_proj:   5%|▌         | 1898/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.92.up_proj:   5%|▌         | 1899/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.92.down_proj:   5%|▌         | 1900/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.93.gate_proj:   5%|▌         | 1901/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.93.up_proj:   5%|▌         | 1902/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.93.down_proj:   5%|▌         | 1903/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.94.gate_proj:   5%|▌         | 1904/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.94.up_proj:   5%|▌         | 1905/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.94.down_proj:   5%|▌         | 1906/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.95.gate_proj:   5%|▌         | 1907/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.95.up_proj:   5%|▌         | 1908/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.95.down_proj:   5%|▌         | 1909/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.96.gate_proj:   5%|▌         | 1910/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.96.up_proj:   5%|▌         | 1911/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.96.down_proj:   5%|▌         | 1912/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.97.gate_proj:   5%|▌         | 1913/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.97.up_proj:   5%|▌         | 1914/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.97.down_proj:   5%|▌         | 1915/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.98.gate_proj:   5%|▌         | 1916/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.98.up_proj:   5%|▌         | 1917/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.98.down_proj:   5%|▌         | 1918/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.99.gate_proj:   5%|▌         | 1919/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.99.up_proj:   5%|▌         | 1920/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.99.down_proj:   5%|▌         | 1921/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.100.gate_proj:   5%|▌         | 1922/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.100.up_proj:   5%|▌         | 1923/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.100.down_proj:   5%|▌         | 1924/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.101.gate_proj:   5%|▌         | 1925/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.101.up_proj:   5%|▌         | 1926/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.101.down_proj:   5%|▌         | 1927/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.102.gate_proj:   5%|▌         | 1928/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.102.up_proj:   5%|▌         | 1929/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.102.down_proj:   5%|▌         | 1930/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.103.gate_proj:   5%|▌         | 1931/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.103.up_proj:   5%|▌         | 1932/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.103.down_proj:   5%|▌         | 1933/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.104.gate_proj:   5%|▌         | 1934/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.104.up_proj:   5%|▌         | 1935/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.104.down_proj:   5%|▌         | 1936/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.105.gate_proj:   5%|▌         | 1937/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.105.up_proj:   5%|▌         | 1938/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.105.down_proj:   5%|▌         | 1939/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.106.gate_proj:   5%|▌         | 1940/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.106.up_proj:   5%|▌         | 1941/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.106.down_proj:   5%|▌         | 1942/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.107.gate_proj:   5%|▌         | 1943/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.107.up_proj:   5%|▌         | 1944/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.107.down_proj:   5%|▌         | 1945/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.108.gate_proj:   5%|▌         | 1946/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.108.up_proj:   5%|▌         | 1947/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.108.down_proj:   5%|▌         | 1948/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.109.gate_proj:   5%|▌         | 1949/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.109.up_proj:   5%|▌         | 1950/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.109.down_proj:   5%|▌         | 1951/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.110.gate_proj:   5%|▌         | 1952/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.110.up_proj:   5%|▌         | 1953/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.110.down_proj:   5%|▌         | 1954/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.111.gate_proj:   5%|▌         | 1955/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.111.up_proj:   5%|▌         | 1956/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.111.down_proj:   5%|▌         | 1957/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.112.gate_proj:   5%|▌         | 1958/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.112.up_proj:   5%|▌         | 1959/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.112.down_proj:   5%|▌         | 1960/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.113.gate_proj:   5%|▌         | 1961/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.113.up_proj:   5%|▌         | 1962/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.113.down_proj:   5%|▌         | 1963/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.114.gate_proj:   5%|▌         | 1964/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.114.up_proj:   5%|▌         | 1965/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.114.down_proj:   5%|▌         | 1966/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.115.gate_proj:   5%|▌         | 1967/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.115.up_proj:   5%|▌         | 1968/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.115.down_proj:   5%|▌         | 1969/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.116.gate_proj:   5%|▌         | 1970/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.116.up_proj:   5%|▌         | 1971/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.116.down_proj:   5%|▌         | 1972/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.117.gate_proj:   5%|▌         | 1973/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.117.up_proj:   5%|▌         | 1974/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.117.down_proj:   5%|▌         | 1975/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.118.gate_proj:   5%|▌         | 1976/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.118.up_proj:   5%|▌         | 1977/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.118.down_proj:   5%|▌         | 1978/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.119.gate_proj:   5%|▌         | 1979/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.119.up_proj:   5%|▌         | 1980/36566 [00:02<00:30, 1129.58it/s]  
packing model.layers.3.mlp.experts.119.down_proj:   5%|▌         | 1981/36566 [00:02<00:30, 1129.58it/s]
packing model.layers.3.mlp.experts.119.down_proj:   5%|▌         | 1982/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.120.gate_proj:   5%|▌         | 1982/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.120.up_proj:   5%|▌         | 1983/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.120.down_proj:   5%|▌         | 1984/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.121.gate_proj:   5%|▌         | 1985/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.121.up_proj:   5%|▌         | 1986/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.121.down_proj:   5%|▌         | 1987/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.122.gate_proj:   5%|▌         | 1988/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.122.up_proj:   5%|▌         | 1989/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.122.down_proj:   5%|▌         | 1990/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.123.gate_proj:   5%|▌         | 1991/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.123.up_proj:   5%|▌         | 1992/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.123.down_proj:   5%|▌         | 1993/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.124.gate_proj:   5%|▌         | 1994/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.124.up_proj:   5%|▌         | 1995/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.124.down_proj:   5%|▌         | 1996/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.125.gate_proj:   5%|▌         | 1997/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.125.up_proj:   5%|▌         | 1998/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.125.down_proj:   5%|▌         | 1999/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.126.gate_proj:   5%|▌         | 2000/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.126.up_proj:   5%|▌         | 2001/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.126.down_proj:   5%|▌         | 2002/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.127.gate_proj:   5%|▌         | 2003/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.3.mlp.experts.127.up_proj:   5%|▌         | 2004/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.3.mlp.experts.127.down_proj:   5%|▌         | 2005/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.0.gate_proj:   5%|▌         | 2006/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.0.up_proj:   5%|▌         | 2007/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.0.down_proj:   5%|▌         | 2008/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.1.gate_proj:   5%|▌         | 2009/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.1.up_proj:   5%|▌         | 2010/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.1.down_proj:   5%|▌         | 2011/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.2.gate_proj:   6%|▌         | 2012/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.2.up_proj:   6%|▌         | 2013/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.2.down_proj:   6%|▌         | 2014/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.3.gate_proj:   6%|▌         | 2015/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.3.up_proj:   6%|▌         | 2016/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.3.down_proj:   6%|▌         | 2017/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.4.gate_proj:   6%|▌         | 2018/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.4.up_proj:   6%|▌         | 2019/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.4.down_proj:   6%|▌         | 2020/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.5.gate_proj:   6%|▌         | 2021/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.5.up_proj:   6%|▌         | 2022/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.5.down_proj:   6%|▌         | 2023/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.6.gate_proj:   6%|▌         | 2024/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.6.up_proj:   6%|▌         | 2025/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.6.down_proj:   6%|▌         | 2026/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.7.gate_proj:   6%|▌         | 2027/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.7.up_proj:   6%|▌         | 2028/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.7.down_proj:   6%|▌         | 2029/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.8.gate_proj:   6%|▌         | 2030/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.8.up_proj:   6%|▌         | 2031/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.8.down_proj:   6%|▌         | 2032/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.9.gate_proj:   6%|▌         | 2033/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.9.up_proj:   6%|▌         | 2034/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.9.down_proj:   6%|▌         | 2035/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.10.gate_proj:   6%|▌         | 2036/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.10.up_proj:   6%|▌         | 2037/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.10.down_proj:   6%|▌         | 2038/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.11.gate_proj:   6%|▌         | 2039/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.11.up_proj:   6%|▌         | 2040/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.11.down_proj:   6%|▌         | 2041/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.12.gate_proj:   6%|▌         | 2042/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.12.up_proj:   6%|▌         | 2043/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.12.down_proj:   6%|▌         | 2044/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.13.gate_proj:   6%|▌         | 2045/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.13.up_proj:   6%|▌         | 2046/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.13.down_proj:   6%|▌         | 2047/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.14.gate_proj:   6%|▌         | 2048/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.14.up_proj:   6%|▌         | 2049/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.14.down_proj:   6%|▌         | 2050/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.15.gate_proj:   6%|▌         | 2051/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.15.up_proj:   6%|▌         | 2052/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.15.down_proj:   6%|▌         | 2053/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.16.gate_proj:   6%|▌         | 2054/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.16.up_proj:   6%|▌         | 2055/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.16.down_proj:   6%|▌         | 2056/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.17.gate_proj:   6%|▌         | 2057/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.17.up_proj:   6%|▌         | 2058/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.17.down_proj:   6%|▌         | 2059/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.18.gate_proj:   6%|▌         | 2060/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.18.up_proj:   6%|▌         | 2061/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.18.down_proj:   6%|▌         | 2062/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.19.gate_proj:   6%|▌         | 2063/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.19.up_proj:   6%|▌         | 2064/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.19.down_proj:   6%|▌         | 2065/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.20.gate_proj:   6%|▌         | 2066/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.20.up_proj:   6%|▌         | 2067/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.20.down_proj:   6%|▌         | 2068/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.21.gate_proj:   6%|▌         | 2069/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.21.up_proj:   6%|▌         | 2070/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.21.down_proj:   6%|▌         | 2071/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.22.gate_proj:   6%|▌         | 2072/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.22.up_proj:   6%|▌         | 2073/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.22.down_proj:   6%|▌         | 2074/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.23.gate_proj:   6%|▌         | 2075/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.23.up_proj:   6%|▌         | 2076/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.23.down_proj:   6%|▌         | 2077/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.24.gate_proj:   6%|▌         | 2078/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.24.up_proj:   6%|▌         | 2079/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.24.down_proj:   6%|▌         | 2080/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.25.gate_proj:   6%|▌         | 2081/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.25.up_proj:   6%|▌         | 2082/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.25.down_proj:   6%|▌         | 2083/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.26.gate_proj:   6%|▌         | 2084/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.26.up_proj:   6%|▌         | 2085/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.26.down_proj:   6%|▌         | 2086/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.27.gate_proj:   6%|▌         | 2087/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.27.up_proj:   6%|▌         | 2088/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.27.down_proj:   6%|▌         | 2089/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.28.gate_proj:   6%|▌         | 2090/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.28.up_proj:   6%|▌         | 2091/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.28.down_proj:   6%|▌         | 2092/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.29.gate_proj:   6%|▌         | 2093/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.29.up_proj:   6%|▌         | 2094/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.29.down_proj:   6%|▌         | 2095/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.30.gate_proj:   6%|▌         | 2096/36566 [00:02<00:30, 1135.47it/s]
packing model.layers.4.mlp.experts.30.up_proj:   6%|▌         | 2097/36566 [00:02<00:30, 1135.47it/s]  
packing model.layers.4.mlp.experts.30.up_proj:   6%|▌         | 2098/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.30.down_proj:   6%|▌         | 2098/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.31.gate_proj:   6%|▌         | 2099/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.31.up_proj:   6%|▌         | 2100/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.31.down_proj:   6%|▌         | 2101/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.32.gate_proj:   6%|▌         | 2102/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.32.up_proj:   6%|▌         | 2103/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.32.down_proj:   6%|▌         | 2104/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.33.gate_proj:   6%|▌         | 2105/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.33.up_proj:   6%|▌         | 2106/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.33.down_proj:   6%|▌         | 2107/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.34.gate_proj:   6%|▌         | 2108/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.34.up_proj:   6%|▌         | 2109/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.34.down_proj:   6%|▌         | 2110/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.35.gate_proj:   6%|▌         | 2111/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.35.up_proj:   6%|▌         | 2112/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.35.down_proj:   6%|▌         | 2113/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.36.gate_proj:   6%|▌         | 2114/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.36.up_proj:   6%|▌         | 2115/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.36.down_proj:   6%|▌         | 2116/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.37.gate_proj:   6%|▌         | 2117/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.37.up_proj:   6%|▌         | 2118/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.37.down_proj:   6%|▌         | 2119/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.38.gate_proj:   6%|▌         | 2120/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.38.up_proj:   6%|▌         | 2121/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.38.down_proj:   6%|▌         | 2122/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.39.gate_proj:   6%|▌         | 2123/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.39.up_proj:   6%|▌         | 2124/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.39.down_proj:   6%|▌         | 2125/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.40.gate_proj:   6%|▌         | 2126/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.40.up_proj:   6%|▌         | 2127/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.40.down_proj:   6%|▌         | 2128/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.41.gate_proj:   6%|▌         | 2129/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.41.up_proj:   6%|▌         | 2130/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.41.down_proj:   6%|▌         | 2131/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.42.gate_proj:   6%|▌         | 2132/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.42.up_proj:   6%|▌         | 2133/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.42.down_proj:   6%|▌         | 2134/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.43.gate_proj:   6%|▌         | 2135/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.43.up_proj:   6%|▌         | 2136/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.43.down_proj:   6%|▌         | 2137/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.44.gate_proj:   6%|▌         | 2138/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.44.up_proj:   6%|▌         | 2139/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.44.down_proj:   6%|▌         | 2140/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.45.gate_proj:   6%|▌         | 2141/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.45.up_proj:   6%|▌         | 2142/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.45.down_proj:   6%|▌         | 2143/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.46.gate_proj:   6%|▌         | 2144/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.46.up_proj:   6%|▌         | 2145/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.46.down_proj:   6%|▌         | 2146/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.47.gate_proj:   6%|▌         | 2147/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.47.up_proj:   6%|▌         | 2148/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.47.down_proj:   6%|▌         | 2149/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.48.gate_proj:   6%|▌         | 2150/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.48.up_proj:   6%|▌         | 2151/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.48.down_proj:   6%|▌         | 2152/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.49.gate_proj:   6%|▌         | 2153/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.49.up_proj:   6%|▌         | 2154/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.49.down_proj:   6%|▌         | 2155/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.50.gate_proj:   6%|▌         | 2156/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.50.up_proj:   6%|▌         | 2157/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.50.down_proj:   6%|▌         | 2158/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.51.gate_proj:   6%|▌         | 2159/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.51.up_proj:   6%|▌         | 2160/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.51.down_proj:   6%|▌         | 2161/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.52.gate_proj:   6%|▌         | 2162/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.52.up_proj:   6%|▌         | 2163/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.52.down_proj:   6%|▌         | 2164/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.53.gate_proj:   6%|▌         | 2165/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.53.up_proj:   6%|▌         | 2166/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.53.down_proj:   6%|▌         | 2167/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.54.gate_proj:   6%|▌         | 2168/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.54.up_proj:   6%|▌         | 2169/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.54.down_proj:   6%|▌         | 2170/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.55.gate_proj:   6%|▌         | 2171/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.55.up_proj:   6%|▌         | 2172/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.55.down_proj:   6%|▌         | 2173/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.56.gate_proj:   6%|▌         | 2174/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.56.up_proj:   6%|▌         | 2175/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.56.down_proj:   6%|▌         | 2176/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.57.gate_proj:   6%|▌         | 2177/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.57.up_proj:   6%|▌         | 2178/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.57.down_proj:   6%|▌         | 2179/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.58.gate_proj:   6%|▌         | 2180/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.58.up_proj:   6%|▌         | 2181/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.58.down_proj:   6%|▌         | 2182/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.59.gate_proj:   6%|▌         | 2183/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.59.up_proj:   6%|▌         | 2184/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.59.down_proj:   6%|▌         | 2185/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.60.gate_proj:   6%|▌         | 2186/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.60.up_proj:   6%|▌         | 2187/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.60.down_proj:   6%|▌         | 2188/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.61.gate_proj:   6%|▌         | 2189/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.61.up_proj:   6%|▌         | 2190/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.61.down_proj:   6%|▌         | 2191/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.62.gate_proj:   6%|▌         | 2192/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.62.up_proj:   6%|▌         | 2193/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.62.down_proj:   6%|▌         | 2194/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.63.gate_proj:   6%|▌         | 2195/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.63.up_proj:   6%|▌         | 2196/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.63.down_proj:   6%|▌         | 2197/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.64.gate_proj:   6%|▌         | 2198/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.64.up_proj:   6%|▌         | 2199/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.64.down_proj:   6%|▌         | 2200/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.65.gate_proj:   6%|▌         | 2201/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.65.up_proj:   6%|▌         | 2202/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.65.down_proj:   6%|▌         | 2203/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.66.gate_proj:   6%|▌         | 2204/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.66.up_proj:   6%|▌         | 2205/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.66.down_proj:   6%|▌         | 2206/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.67.gate_proj:   6%|▌         | 2207/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.67.up_proj:   6%|▌         | 2208/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.67.down_proj:   6%|▌         | 2209/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.68.gate_proj:   6%|▌         | 2210/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.68.up_proj:   6%|▌         | 2211/36566 [00:02<00:30, 1139.83it/s]  
packing model.layers.4.mlp.experts.68.down_proj:   6%|▌         | 2212/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.69.gate_proj:   6%|▌         | 2213/36566 [00:02<00:30, 1139.83it/s]
packing model.layers.4.mlp.experts.69.gate_proj:   6%|▌         | 2214/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.69.up_proj:   6%|▌         | 2214/36566 [00:02<00:30, 1144.63it/s]  
packing model.layers.4.mlp.experts.69.down_proj:   6%|▌         | 2215/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.70.gate_proj:   6%|▌         | 2216/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.70.up_proj:   6%|▌         | 2217/36566 [00:02<00:30, 1144.63it/s]  
packing model.layers.4.mlp.experts.70.down_proj:   6%|▌         | 2218/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.71.gate_proj:   6%|▌         | 2219/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.71.up_proj:   6%|▌         | 2220/36566 [00:02<00:30, 1144.63it/s]  
packing model.layers.4.mlp.experts.71.down_proj:   6%|▌         | 2221/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.72.gate_proj:   6%|▌         | 2222/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.72.up_proj:   6%|▌         | 2223/36566 [00:02<00:30, 1144.63it/s]  
packing model.layers.4.mlp.experts.72.down_proj:   6%|▌         | 2224/36566 [00:02<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.73.gate_proj:   6%|▌         | 2225/36566 [00:03<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.73.up_proj:   6%|▌         | 2226/36566 [00:03<00:30, 1144.63it/s]  
packing model.layers.4.mlp.experts.73.down_proj:   6%|▌         | 2227/36566 [00:03<00:30, 1144.63it/s]
packing model.layers.4.mlp.experts.74.gate_proj:   6%|▌         | 2228/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.74.up_proj:   6%|▌         | 2229/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.74.down_proj:   6%|▌         | 2230/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.75.gate_proj:   6%|▌         | 2231/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.75.up_proj:   6%|▌         | 2232/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.75.down_proj:   6%|▌         | 2233/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.76.gate_proj:   6%|▌         | 2234/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.76.up_proj:   6%|▌         | 2235/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.76.down_proj:   6%|▌         | 2236/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.77.gate_proj:   6%|▌         | 2237/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.77.up_proj:   6%|▌         | 2238/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.77.down_proj:   6%|▌         | 2239/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.78.gate_proj:   6%|▌         | 2240/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.78.up_proj:   6%|▌         | 2241/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.78.down_proj:   6%|▌         | 2242/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.79.gate_proj:   6%|▌         | 2243/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.79.up_proj:   6%|▌         | 2244/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.79.down_proj:   6%|▌         | 2245/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.80.gate_proj:   6%|▌         | 2246/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.80.up_proj:   6%|▌         | 2247/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.80.down_proj:   6%|▌         | 2248/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.81.gate_proj:   6%|▌         | 2249/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.81.up_proj:   6%|▌         | 2250/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.81.down_proj:   6%|▌         | 2251/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.82.gate_proj:   6%|▌         | 2252/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.82.up_proj:   6%|▌         | 2253/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.82.down_proj:   6%|▌         | 2254/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.83.gate_proj:   6%|▌         | 2255/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.83.up_proj:   6%|▌         | 2256/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.83.down_proj:   6%|▌         | 2257/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.84.gate_proj:   6%|▌         | 2258/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.84.up_proj:   6%|▌         | 2259/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.84.down_proj:   6%|▌         | 2260/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.85.gate_proj:   6%|▌         | 2261/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.85.up_proj:   6%|▌         | 2262/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.85.down_proj:   6%|▌         | 2263/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.86.gate_proj:   6%|▌         | 2264/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.86.up_proj:   6%|▌         | 2265/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.86.down_proj:   6%|▌         | 2266/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.87.gate_proj:   6%|▌         | 2267/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.87.up_proj:   6%|▌         | 2268/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.87.down_proj:   6%|▌         | 2269/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.88.gate_proj:   6%|▌         | 2270/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.88.up_proj:   6%|▌         | 2271/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.88.down_proj:   6%|▌         | 2272/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.89.gate_proj:   6%|▌         | 2273/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.89.up_proj:   6%|▌         | 2274/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.89.down_proj:   6%|▌         | 2275/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.90.gate_proj:   6%|▌         | 2276/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.90.up_proj:   6%|▌         | 2277/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.90.down_proj:   6%|▌         | 2278/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.91.gate_proj:   6%|▌         | 2279/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.91.up_proj:   6%|▌         | 2280/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.91.down_proj:   6%|▌         | 2281/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.92.gate_proj:   6%|▌         | 2282/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.92.up_proj:   6%|▌         | 2283/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.92.down_proj:   6%|▌         | 2284/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.93.gate_proj:   6%|▌         | 2285/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.93.up_proj:   6%|▋         | 2286/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.93.down_proj:   6%|▋         | 2287/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.94.gate_proj:   6%|▋         | 2288/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.94.up_proj:   6%|▋         | 2289/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.94.down_proj:   6%|▋         | 2290/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.95.gate_proj:   6%|▋         | 2291/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.95.up_proj:   6%|▋         | 2292/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.95.down_proj:   6%|▋         | 2293/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.96.gate_proj:   6%|▋         | 2294/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.96.up_proj:   6%|▋         | 2295/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.96.down_proj:   6%|▋         | 2296/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.97.gate_proj:   6%|▋         | 2297/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.97.up_proj:   6%|▋         | 2298/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.97.down_proj:   6%|▋         | 2299/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.98.gate_proj:   6%|▋         | 2300/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.98.up_proj:   6%|▋         | 2301/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.98.down_proj:   6%|▋         | 2302/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.99.gate_proj:   6%|▋         | 2303/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.99.up_proj:   6%|▋         | 2304/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.99.down_proj:   6%|▋         | 2305/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.100.gate_proj:   6%|▋         | 2306/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.100.up_proj:   6%|▋         | 2307/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.100.down_proj:   6%|▋         | 2308/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.101.gate_proj:   6%|▋         | 2309/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.101.up_proj:   6%|▋         | 2310/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.101.down_proj:   6%|▋         | 2311/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.102.gate_proj:   6%|▋         | 2312/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.102.up_proj:   6%|▋         | 2313/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.102.down_proj:   6%|▋         | 2314/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.103.gate_proj:   6%|▋         | 2315/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.103.up_proj:   6%|▋         | 2316/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.103.down_proj:   6%|▋         | 2317/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.104.gate_proj:   6%|▋         | 2318/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.104.up_proj:   6%|▋         | 2319/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.104.down_proj:   6%|▋         | 2320/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.105.gate_proj:   6%|▋         | 2321/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.105.up_proj:   6%|▋         | 2322/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.105.down_proj:   6%|▋         | 2323/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.106.gate_proj:   6%|▋         | 2324/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.106.up_proj:   6%|▋         | 2325/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.106.down_proj:   6%|▋         | 2326/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.107.gate_proj:   6%|▋         | 2327/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.107.up_proj:   6%|▋         | 2328/36566 [00:03<00:29, 1144.63it/s]  
packing model.layers.4.mlp.experts.107.down_proj:   6%|▋         | 2329/36566 [00:03<00:29, 1144.63it/s]
packing model.layers.4.mlp.experts.107.down_proj:   6%|▋         | 2330/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.108.gate_proj:   6%|▋         | 2330/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.108.up_proj:   6%|▋         | 2331/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.108.down_proj:   6%|▋         | 2332/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.109.gate_proj:   6%|▋         | 2333/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.109.up_proj:   6%|▋         | 2334/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.109.down_proj:   6%|▋         | 2335/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.110.gate_proj:   6%|▋         | 2336/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.110.up_proj:   6%|▋         | 2337/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.110.down_proj:   6%|▋         | 2338/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.111.gate_proj:   6%|▋         | 2339/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.111.up_proj:   6%|▋         | 2340/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.111.down_proj:   6%|▋         | 2341/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.112.gate_proj:   6%|▋         | 2342/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.112.up_proj:   6%|▋         | 2343/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.112.down_proj:   6%|▋         | 2344/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.113.gate_proj:   6%|▋         | 2345/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.113.up_proj:   6%|▋         | 2346/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.113.down_proj:   6%|▋         | 2347/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.114.gate_proj:   6%|▋         | 2348/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.114.up_proj:   6%|▋         | 2349/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.114.down_proj:   6%|▋         | 2350/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.115.gate_proj:   6%|▋         | 2351/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.115.up_proj:   6%|▋         | 2352/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.115.down_proj:   6%|▋         | 2353/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.116.gate_proj:   6%|▋         | 2354/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.116.up_proj:   6%|▋         | 2355/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.116.down_proj:   6%|▋         | 2356/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.117.gate_proj:   6%|▋         | 2357/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.117.up_proj:   6%|▋         | 2358/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.117.down_proj:   6%|▋         | 2359/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.118.gate_proj:   6%|▋         | 2360/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.118.up_proj:   6%|▋         | 2361/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.118.down_proj:   6%|▋         | 2362/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.119.gate_proj:   6%|▋         | 2363/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.119.up_proj:   6%|▋         | 2364/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.119.down_proj:   6%|▋         | 2365/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.120.gate_proj:   6%|▋         | 2366/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.120.up_proj:   6%|▋         | 2367/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.120.down_proj:   6%|▋         | 2368/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.121.gate_proj:   6%|▋         | 2369/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.121.up_proj:   6%|▋         | 2370/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.121.down_proj:   6%|▋         | 2371/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.122.gate_proj:   6%|▋         | 2372/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.122.up_proj:   6%|▋         | 2373/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.122.down_proj:   6%|▋         | 2374/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.123.gate_proj:   6%|▋         | 2375/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.123.up_proj:   6%|▋         | 2376/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.123.down_proj:   7%|▋         | 2377/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.124.gate_proj:   7%|▋         | 2378/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.124.up_proj:   7%|▋         | 2379/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.124.down_proj:   7%|▋         | 2380/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.125.gate_proj:   7%|▋         | 2381/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.125.up_proj:   7%|▋         | 2382/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.125.down_proj:   7%|▋         | 2383/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.126.gate_proj:   7%|▋         | 2384/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.126.up_proj:   7%|▋         | 2385/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.126.down_proj:   7%|▋         | 2386/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.127.gate_proj:   7%|▋         | 2387/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.4.mlp.experts.127.up_proj:   7%|▋         | 2388/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.4.mlp.experts.127.down_proj:   7%|▋         | 2389/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.0.gate_proj:   7%|▋         | 2390/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.0.up_proj:   7%|▋         | 2391/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.0.down_proj:   7%|▋         | 2392/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.1.gate_proj:   7%|▋         | 2393/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.1.up_proj:   7%|▋         | 2394/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.1.down_proj:   7%|▋         | 2395/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.2.gate_proj:   7%|▋         | 2396/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.2.up_proj:   7%|▋         | 2397/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.2.down_proj:   7%|▋         | 2398/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.3.gate_proj:   7%|▋         | 2399/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.3.up_proj:   7%|▋         | 2400/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.3.down_proj:   7%|▋         | 2401/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.4.gate_proj:   7%|▋         | 2402/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.4.up_proj:   7%|▋         | 2403/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.4.down_proj:   7%|▋         | 2404/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.5.gate_proj:   7%|▋         | 2405/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.5.up_proj:   7%|▋         | 2406/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.5.down_proj:   7%|▋         | 2407/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.6.gate_proj:   7%|▋         | 2408/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.6.up_proj:   7%|▋         | 2409/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.6.down_proj:   7%|▋         | 2410/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.7.gate_proj:   7%|▋         | 2411/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.7.up_proj:   7%|▋         | 2412/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.7.down_proj:   7%|▋         | 2413/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.8.gate_proj:   7%|▋         | 2414/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.8.up_proj:   7%|▋         | 2415/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.8.down_proj:   7%|▋         | 2416/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.9.gate_proj:   7%|▋         | 2417/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.9.up_proj:   7%|▋         | 2418/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.9.down_proj:   7%|▋         | 2419/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.10.gate_proj:   7%|▋         | 2420/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.10.up_proj:   7%|▋         | 2421/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.10.down_proj:   7%|▋         | 2422/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.11.gate_proj:   7%|▋         | 2423/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.11.up_proj:   7%|▋         | 2424/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.11.down_proj:   7%|▋         | 2425/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.12.gate_proj:   7%|▋         | 2426/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.12.up_proj:   7%|▋         | 2427/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.12.down_proj:   7%|▋         | 2428/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.13.gate_proj:   7%|▋         | 2429/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.13.up_proj:   7%|▋         | 2430/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.13.down_proj:   7%|▋         | 2431/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.14.gate_proj:   7%|▋         | 2432/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.14.up_proj:   7%|▋         | 2433/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.14.down_proj:   7%|▋         | 2434/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.15.gate_proj:   7%|▋         | 2435/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.15.up_proj:   7%|▋         | 2436/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.15.down_proj:   7%|▋         | 2437/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.16.gate_proj:   7%|▋         | 2438/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.16.up_proj:   7%|▋         | 2439/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.16.down_proj:   7%|▋         | 2440/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.17.gate_proj:   7%|▋         | 2441/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.17.up_proj:   7%|▋         | 2442/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.17.down_proj:   7%|▋         | 2443/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.18.gate_proj:   7%|▋         | 2444/36566 [00:03<00:29, 1146.56it/s]
packing model.layers.5.mlp.experts.18.up_proj:   7%|▋         | 2445/36566 [00:03<00:29, 1146.56it/s]  
packing model.layers.5.mlp.experts.18.up_proj:   7%|▋         | 2446/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.18.down_proj:   7%|▋         | 2446/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.19.gate_proj:   7%|▋         | 2447/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.19.up_proj:   7%|▋         | 2448/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.19.down_proj:   7%|▋         | 2449/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.20.gate_proj:   7%|▋         | 2450/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.20.up_proj:   7%|▋         | 2451/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.20.down_proj:   7%|▋         | 2452/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.21.gate_proj:   7%|▋         | 2453/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.21.up_proj:   7%|▋         | 2454/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.21.down_proj:   7%|▋         | 2455/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.22.gate_proj:   7%|▋         | 2456/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.22.up_proj:   7%|▋         | 2457/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.22.down_proj:   7%|▋         | 2458/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.23.gate_proj:   7%|▋         | 2459/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.23.up_proj:   7%|▋         | 2460/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.23.down_proj:   7%|▋         | 2461/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.24.gate_proj:   7%|▋         | 2462/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.24.up_proj:   7%|▋         | 2463/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.24.down_proj:   7%|▋         | 2464/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.25.gate_proj:   7%|▋         | 2465/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.25.up_proj:   7%|▋         | 2466/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.25.down_proj:   7%|▋         | 2467/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.26.gate_proj:   7%|▋         | 2468/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.26.up_proj:   7%|▋         | 2469/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.26.down_proj:   7%|▋         | 2470/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.27.gate_proj:   7%|▋         | 2471/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.27.up_proj:   7%|▋         | 2472/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.27.down_proj:   7%|▋         | 2473/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.28.gate_proj:   7%|▋         | 2474/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.28.up_proj:   7%|▋         | 2475/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.28.down_proj:   7%|▋         | 2476/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.29.gate_proj:   7%|▋         | 2477/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.29.up_proj:   7%|▋         | 2478/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.29.down_proj:   7%|▋         | 2479/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.30.gate_proj:   7%|▋         | 2480/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.30.up_proj:   7%|▋         | 2481/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.30.down_proj:   7%|▋         | 2482/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.31.gate_proj:   7%|▋         | 2483/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.31.up_proj:   7%|▋         | 2484/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.31.down_proj:   7%|▋         | 2485/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.32.gate_proj:   7%|▋         | 2486/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.32.up_proj:   7%|▋         | 2487/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.32.down_proj:   7%|▋         | 2488/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.33.gate_proj:   7%|▋         | 2489/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.33.up_proj:   7%|▋         | 2490/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.33.down_proj:   7%|▋         | 2491/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.34.gate_proj:   7%|▋         | 2492/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.34.up_proj:   7%|▋         | 2493/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.34.down_proj:   7%|▋         | 2494/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.35.gate_proj:   7%|▋         | 2495/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.35.up_proj:   7%|▋         | 2496/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.35.down_proj:   7%|▋         | 2497/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.36.gate_proj:   7%|▋         | 2498/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.36.up_proj:   7%|▋         | 2499/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.36.down_proj:   7%|▋         | 2500/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.37.gate_proj:   7%|▋         | 2501/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.37.up_proj:   7%|▋         | 2502/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.37.down_proj:   7%|▋         | 2503/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.38.gate_proj:   7%|▋         | 2504/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.38.up_proj:   7%|▋         | 2505/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.38.down_proj:   7%|▋         | 2506/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.39.gate_proj:   7%|▋         | 2507/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.39.up_proj:   7%|▋         | 2508/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.39.down_proj:   7%|▋         | 2509/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.40.gate_proj:   7%|▋         | 2510/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.40.up_proj:   7%|▋         | 2511/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.40.down_proj:   7%|▋         | 2512/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.41.gate_proj:   7%|▋         | 2513/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.41.up_proj:   7%|▋         | 2514/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.41.down_proj:   7%|▋         | 2515/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.42.gate_proj:   7%|▋         | 2516/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.42.up_proj:   7%|▋         | 2517/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.42.down_proj:   7%|▋         | 2518/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.43.gate_proj:   7%|▋         | 2519/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.43.up_proj:   7%|▋         | 2520/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.43.down_proj:   7%|▋         | 2521/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.44.gate_proj:   7%|▋         | 2522/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.44.up_proj:   7%|▋         | 2523/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.44.down_proj:   7%|▋         | 2524/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.45.gate_proj:   7%|▋         | 2525/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.45.up_proj:   7%|▋         | 2526/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.45.down_proj:   7%|▋         | 2527/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.46.gate_proj:   7%|▋         | 2528/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.46.up_proj:   7%|▋         | 2529/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.46.down_proj:   7%|▋         | 2530/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.47.gate_proj:   7%|▋         | 2531/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.47.up_proj:   7%|▋         | 2532/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.47.down_proj:   7%|▋         | 2533/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.48.gate_proj:   7%|▋         | 2534/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.48.up_proj:   7%|▋         | 2535/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.48.down_proj:   7%|▋         | 2536/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.49.gate_proj:   7%|▋         | 2537/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.49.up_proj:   7%|▋         | 2538/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.49.down_proj:   7%|▋         | 2539/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.50.gate_proj:   7%|▋         | 2540/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.50.up_proj:   7%|▋         | 2541/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.50.down_proj:   7%|▋         | 2542/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.51.gate_proj:   7%|▋         | 2543/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.51.up_proj:   7%|▋         | 2544/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.51.down_proj:   7%|▋         | 2545/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.52.gate_proj:   7%|▋         | 2546/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.52.up_proj:   7%|▋         | 2547/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.52.down_proj:   7%|▋         | 2548/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.53.gate_proj:   7%|▋         | 2549/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.53.up_proj:   7%|▋         | 2550/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.53.down_proj:   7%|▋         | 2551/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.54.gate_proj:   7%|▋         | 2552/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.54.up_proj:   7%|▋         | 2553/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.54.down_proj:   7%|▋         | 2554/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.55.gate_proj:   7%|▋         | 2555/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.55.up_proj:   7%|▋         | 2556/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.55.down_proj:   7%|▋         | 2557/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.56.gate_proj:   7%|▋         | 2558/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.56.up_proj:   7%|▋         | 2559/36566 [00:03<00:29, 1148.45it/s]  
packing model.layers.5.mlp.experts.56.down_proj:   7%|▋         | 2560/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.57.gate_proj:   7%|▋         | 2561/36566 [00:03<00:29, 1148.45it/s]
packing model.layers.5.mlp.experts.57.gate_proj:   7%|▋         | 2562/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.57.up_proj:   7%|▋         | 2562/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.57.down_proj:   7%|▋         | 2563/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.58.gate_proj:   7%|▋         | 2564/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.58.up_proj:   7%|▋         | 2565/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.58.down_proj:   7%|▋         | 2566/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.59.gate_proj:   7%|▋         | 2567/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.59.up_proj:   7%|▋         | 2568/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.59.down_proj:   7%|▋         | 2569/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.60.gate_proj:   7%|▋         | 2570/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.60.up_proj:   7%|▋         | 2571/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.60.down_proj:   7%|▋         | 2572/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.61.gate_proj:   7%|▋         | 2573/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.61.up_proj:   7%|▋         | 2574/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.61.down_proj:   7%|▋         | 2575/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.62.gate_proj:   7%|▋         | 2576/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.62.up_proj:   7%|▋         | 2577/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.62.down_proj:   7%|▋         | 2578/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.63.gate_proj:   7%|▋         | 2579/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.63.up_proj:   7%|▋         | 2580/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.63.down_proj:   7%|▋         | 2581/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.64.gate_proj:   7%|▋         | 2582/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.64.up_proj:   7%|▋         | 2583/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.64.down_proj:   7%|▋         | 2584/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.65.gate_proj:   7%|▋         | 2585/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.65.up_proj:   7%|▋         | 2586/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.65.down_proj:   7%|▋         | 2587/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.66.gate_proj:   7%|▋         | 2588/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.66.up_proj:   7%|▋         | 2589/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.66.down_proj:   7%|▋         | 2590/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.67.gate_proj:   7%|▋         | 2591/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.67.up_proj:   7%|▋         | 2592/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.67.down_proj:   7%|▋         | 2593/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.68.gate_proj:   7%|▋         | 2594/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.68.up_proj:   7%|▋         | 2595/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.68.down_proj:   7%|▋         | 2596/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.69.gate_proj:   7%|▋         | 2597/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.69.up_proj:   7%|▋         | 2598/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.69.down_proj:   7%|▋         | 2599/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.70.gate_proj:   7%|▋         | 2600/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.70.up_proj:   7%|▋         | 2601/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.70.down_proj:   7%|▋         | 2602/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.71.gate_proj:   7%|▋         | 2603/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.71.up_proj:   7%|▋         | 2604/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.71.down_proj:   7%|▋         | 2605/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.72.gate_proj:   7%|▋         | 2606/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.72.up_proj:   7%|▋         | 2607/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.72.down_proj:   7%|▋         | 2608/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.73.gate_proj:   7%|▋         | 2609/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.73.up_proj:   7%|▋         | 2610/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.73.down_proj:   7%|▋         | 2611/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.74.gate_proj:   7%|▋         | 2612/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.74.up_proj:   7%|▋         | 2613/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.74.down_proj:   7%|▋         | 2614/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.75.gate_proj:   7%|▋         | 2615/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.75.up_proj:   7%|▋         | 2616/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.75.down_proj:   7%|▋         | 2617/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.76.gate_proj:   7%|▋         | 2618/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.76.up_proj:   7%|▋         | 2619/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.76.down_proj:   7%|▋         | 2620/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.77.gate_proj:   7%|▋         | 2621/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.77.up_proj:   7%|▋         | 2622/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.77.down_proj:   7%|▋         | 2623/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.78.gate_proj:   7%|▋         | 2624/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.78.up_proj:   7%|▋         | 2625/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.78.down_proj:   7%|▋         | 2626/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.79.gate_proj:   7%|▋         | 2627/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.79.up_proj:   7%|▋         | 2628/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.79.down_proj:   7%|▋         | 2629/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.80.gate_proj:   7%|▋         | 2630/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.80.up_proj:   7%|▋         | 2631/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.80.down_proj:   7%|▋         | 2632/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.81.gate_proj:   7%|▋         | 2633/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.81.up_proj:   7%|▋         | 2634/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.81.down_proj:   7%|▋         | 2635/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.82.gate_proj:   7%|▋         | 2636/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.82.up_proj:   7%|▋         | 2637/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.82.down_proj:   7%|▋         | 2638/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.83.gate_proj:   7%|▋         | 2639/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.83.up_proj:   7%|▋         | 2640/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.83.down_proj:   7%|▋         | 2641/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.84.gate_proj:   7%|▋         | 2642/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.84.up_proj:   7%|▋         | 2643/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.84.down_proj:   7%|▋         | 2644/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.85.gate_proj:   7%|▋         | 2645/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.85.up_proj:   7%|▋         | 2646/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.85.down_proj:   7%|▋         | 2647/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.86.gate_proj:   7%|▋         | 2648/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.86.up_proj:   7%|▋         | 2649/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.86.down_proj:   7%|▋         | 2650/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.87.gate_proj:   7%|▋         | 2651/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.87.up_proj:   7%|▋         | 2652/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.87.down_proj:   7%|▋         | 2653/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.88.gate_proj:   7%|▋         | 2654/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.88.up_proj:   7%|▋         | 2655/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.88.down_proj:   7%|▋         | 2656/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.89.gate_proj:   7%|▋         | 2657/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.89.up_proj:   7%|▋         | 2658/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.89.down_proj:   7%|▋         | 2659/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.90.gate_proj:   7%|▋         | 2660/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.90.up_proj:   7%|▋         | 2661/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.90.down_proj:   7%|▋         | 2662/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.91.gate_proj:   7%|▋         | 2663/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.91.up_proj:   7%|▋         | 2664/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.91.down_proj:   7%|▋         | 2665/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.92.gate_proj:   7%|▋         | 2666/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.92.up_proj:   7%|▋         | 2667/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.92.down_proj:   7%|▋         | 2668/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.93.gate_proj:   7%|▋         | 2669/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.93.up_proj:   7%|▋         | 2670/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.93.down_proj:   7%|▋         | 2671/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.94.gate_proj:   7%|▋         | 2672/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.94.up_proj:   7%|▋         | 2673/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.94.down_proj:   7%|▋         | 2674/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.95.gate_proj:   7%|▋         | 2675/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.95.up_proj:   7%|▋         | 2676/36566 [00:03<00:29, 1148.80it/s]  
packing model.layers.5.mlp.experts.95.down_proj:   7%|▋         | 2677/36566 [00:03<00:29, 1148.80it/s]
packing model.layers.5.mlp.experts.95.down_proj:   7%|▋         | 2678/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.96.gate_proj:   7%|▋         | 2678/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.96.up_proj:   7%|▋         | 2679/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.96.down_proj:   7%|▋         | 2680/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.97.gate_proj:   7%|▋         | 2681/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.97.up_proj:   7%|▋         | 2682/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.97.down_proj:   7%|▋         | 2683/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.98.gate_proj:   7%|▋         | 2684/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.98.up_proj:   7%|▋         | 2685/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.98.down_proj:   7%|▋         | 2686/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.99.gate_proj:   7%|▋         | 2687/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.99.up_proj:   7%|▋         | 2688/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.99.down_proj:   7%|▋         | 2689/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.100.gate_proj:   7%|▋         | 2690/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.100.up_proj:   7%|▋         | 2691/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.100.down_proj:   7%|▋         | 2692/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.101.gate_proj:   7%|▋         | 2693/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.101.up_proj:   7%|▋         | 2694/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.101.down_proj:   7%|▋         | 2695/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.102.gate_proj:   7%|▋         | 2696/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.102.up_proj:   7%|▋         | 2697/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.102.down_proj:   7%|▋         | 2698/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.103.gate_proj:   7%|▋         | 2699/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.103.up_proj:   7%|▋         | 2700/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.103.down_proj:   7%|▋         | 2701/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.104.gate_proj:   7%|▋         | 2702/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.104.up_proj:   7%|▋         | 2703/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.104.down_proj:   7%|▋         | 2704/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.105.gate_proj:   7%|▋         | 2705/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.105.up_proj:   7%|▋         | 2706/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.105.down_proj:   7%|▋         | 2707/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.106.gate_proj:   7%|▋         | 2708/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.106.up_proj:   7%|▋         | 2709/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.106.down_proj:   7%|▋         | 2710/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.107.gate_proj:   7%|▋         | 2711/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.107.up_proj:   7%|▋         | 2712/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.107.down_proj:   7%|▋         | 2713/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.108.gate_proj:   7%|▋         | 2714/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.108.up_proj:   7%|▋         | 2715/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.108.down_proj:   7%|▋         | 2716/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.109.gate_proj:   7%|▋         | 2717/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.109.up_proj:   7%|▋         | 2718/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.109.down_proj:   7%|▋         | 2719/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.110.gate_proj:   7%|▋         | 2720/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.110.up_proj:   7%|▋         | 2721/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.110.down_proj:   7%|▋         | 2722/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.111.gate_proj:   7%|▋         | 2723/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.111.up_proj:   7%|▋         | 2724/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.111.down_proj:   7%|▋         | 2725/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.112.gate_proj:   7%|▋         | 2726/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.112.up_proj:   7%|▋         | 2727/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.112.down_proj:   7%|▋         | 2728/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.113.gate_proj:   7%|▋         | 2729/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.113.up_proj:   7%|▋         | 2730/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.113.down_proj:   7%|▋         | 2731/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.114.gate_proj:   7%|▋         | 2732/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.114.up_proj:   7%|▋         | 2733/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.114.down_proj:   7%|▋         | 2734/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.115.gate_proj:   7%|▋         | 2735/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.115.up_proj:   7%|▋         | 2736/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.115.down_proj:   7%|▋         | 2737/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.116.gate_proj:   7%|▋         | 2738/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.116.up_proj:   7%|▋         | 2739/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.116.down_proj:   7%|▋         | 2740/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.117.gate_proj:   7%|▋         | 2741/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.117.up_proj:   7%|▋         | 2742/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.117.down_proj:   8%|▊         | 2743/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.118.gate_proj:   8%|▊         | 2744/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.118.up_proj:   8%|▊         | 2745/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.118.down_proj:   8%|▊         | 2746/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.119.gate_proj:   8%|▊         | 2747/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.119.up_proj:   8%|▊         | 2748/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.119.down_proj:   8%|▊         | 2749/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.120.gate_proj:   8%|▊         | 2750/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.120.up_proj:   8%|▊         | 2751/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.120.down_proj:   8%|▊         | 2752/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.121.gate_proj:   8%|▊         | 2753/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.121.up_proj:   8%|▊         | 2754/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.121.down_proj:   8%|▊         | 2755/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.122.gate_proj:   8%|▊         | 2756/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.122.up_proj:   8%|▊         | 2757/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.122.down_proj:   8%|▊         | 2758/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.123.gate_proj:   8%|▊         | 2759/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.123.up_proj:   8%|▊         | 2760/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.123.down_proj:   8%|▊         | 2761/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.124.gate_proj:   8%|▊         | 2762/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.124.up_proj:   8%|▊         | 2763/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.124.down_proj:   8%|▊         | 2764/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.125.gate_proj:   8%|▊         | 2765/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.125.up_proj:   8%|▊         | 2766/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.125.down_proj:   8%|▊         | 2767/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.126.gate_proj:   8%|▊         | 2768/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.126.up_proj:   8%|▊         | 2769/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.126.down_proj:   8%|▊         | 2770/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.127.gate_proj:   8%|▊         | 2771/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.5.mlp.experts.127.up_proj:   8%|▊         | 2772/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.5.mlp.experts.127.down_proj:   8%|▊         | 2773/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.0.gate_proj:   8%|▊         | 2774/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.0.up_proj:   8%|▊         | 2775/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.0.down_proj:   8%|▊         | 2776/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.1.gate_proj:   8%|▊         | 2777/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.1.up_proj:   8%|▊         | 2778/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.1.down_proj:   8%|▊         | 2779/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.2.gate_proj:   8%|▊         | 2780/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.2.up_proj:   8%|▊         | 2781/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.2.down_proj:   8%|▊         | 2782/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.3.gate_proj:   8%|▊         | 2783/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.3.up_proj:   8%|▊         | 2784/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.3.down_proj:   8%|▊         | 2785/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.4.gate_proj:   8%|▊         | 2786/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.4.up_proj:   8%|▊         | 2787/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.4.down_proj:   8%|▊         | 2788/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.5.gate_proj:   8%|▊         | 2789/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.5.up_proj:   8%|▊         | 2790/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.5.down_proj:   8%|▊         | 2791/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.6.gate_proj:   8%|▊         | 2792/36566 [00:03<00:29, 1149.90it/s]
packing model.layers.6.mlp.experts.6.up_proj:   8%|▊         | 2793/36566 [00:03<00:29, 1149.90it/s]  
packing model.layers.6.mlp.experts.6.up_proj:   8%|▊         | 2794/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.6.down_proj:   8%|▊         | 2794/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.7.gate_proj:   8%|▊         | 2795/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.7.up_proj:   8%|▊         | 2796/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.7.down_proj:   8%|▊         | 2797/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.8.gate_proj:   8%|▊         | 2798/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.8.up_proj:   8%|▊         | 2799/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.8.down_proj:   8%|▊         | 2800/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.9.gate_proj:   8%|▊         | 2801/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.9.up_proj:   8%|▊         | 2802/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.9.down_proj:   8%|▊         | 2803/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.10.gate_proj:   8%|▊         | 2804/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.10.up_proj:   8%|▊         | 2805/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.10.down_proj:   8%|▊         | 2806/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.11.gate_proj:   8%|▊         | 2807/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.11.up_proj:   8%|▊         | 2808/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.11.down_proj:   8%|▊         | 2809/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.12.gate_proj:   8%|▊         | 2810/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.12.up_proj:   8%|▊         | 2811/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.12.down_proj:   8%|▊         | 2812/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.13.gate_proj:   8%|▊         | 2813/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.13.up_proj:   8%|▊         | 2814/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.13.down_proj:   8%|▊         | 2815/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.14.gate_proj:   8%|▊         | 2816/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.14.up_proj:   8%|▊         | 2817/36566 [00:03<00:29, 1152.48it/s]  
packing model.layers.6.mlp.experts.14.down_proj:   8%|▊         | 2818/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp.experts.15.gate_proj:   8%|▊         | 2819/36566 [00:03<00:29, 1152.48it/s]
packing model.layers.6.mlp
chaiml-muster-v0e-lr1e5-71769-v1-uploader: ing model.layers.8.mlp.experts.14.down_proj:  10%|▉         | 3586/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.15.gate_proj:  10%|▉         | 3587/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.15.up_proj:  10%|▉         | 3588/36566 [00:04<00:28, 1154.11it/s]  
packing model.layers.8.mlp.experts.15.down_proj:  10%|▉         | 3589/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.16.gate_proj:  10%|▉         | 3590/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.16.up_proj:  10%|▉         | 3591/36566 [00:04<00:28, 1154.11it/s]  
packing model.layers.8.mlp.experts.16.down_proj:  10%|▉         | 3592/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.17.gate_proj:  10%|▉         | 3593/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.17.up_proj:  10%|▉         | 3594/36566 [00:04<00:28, 1154.11it/s]  
packing model.layers.8.mlp.experts.17.down_proj:  10%|▉         | 3595/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.18.gate_proj:  10%|▉         | 3596/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.18.up_proj:  10%|▉         | 3597/36566 [00:04<00:28, 1154.11it/s]  
packing model.layers.8.mlp.experts.18.down_proj:  10%|▉         | 3598/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.19.gate_proj:  10%|▉         | 3599/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.19.up_proj:  10%|▉         | 3600/36566 [00:04<00:28, 1154.11it/s]  
packing model.layers.8.mlp.experts.19.down_proj:  10%|▉         | 3601/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.20.gate_proj:  10%|▉         | 3602/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.20.up_proj:  10%|▉         | 3603/36566 [00:04<00:28, 1154.11it/s]  
packing model.layers.8.mlp.experts.20.down_proj:  10%|▉         | 3604/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.21.gate_proj:  10%|▉         | 3605/36566 [00:04<00:28, 1154.11it/s]
packing model.layers.8.mlp.experts.21.gate_proj:  10%|▉         | 3606/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.21.up_proj:  10%|▉         | 3606/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.21.down_proj:  10%|▉         | 3607/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.22.gate_proj:  10%|▉         | 3608/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.22.up_proj:  10%|▉         | 3609/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.22.down_proj:  10%|▉         | 3610/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.23.gate_proj:  10%|▉         | 3611/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.23.up_proj:  10%|▉         | 3612/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.23.down_proj:  10%|▉         | 3613/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.24.gate_proj:  10%|▉         | 3614/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.24.up_proj:  10%|▉         | 3615/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.24.down_proj:  10%|▉         | 3616/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.25.gate_proj:  10%|▉         | 3617/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.25.up_proj:  10%|▉         | 3618/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.25.down_proj:  10%|▉         | 3619/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.26.gate_proj:  10%|▉         | 3620/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.26.up_proj:  10%|▉         | 3621/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.26.down_proj:  10%|▉         | 3622/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.27.gate_proj:  10%|▉         | 3623/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.27.up_proj:  10%|▉         | 3624/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.27.down_proj:  10%|▉         | 3625/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.28.gate_proj:  10%|▉         | 3626/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.28.up_proj:  10%|▉         | 3627/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.28.down_proj:  10%|▉         | 3628/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.29.gate_proj:  10%|▉         | 3629/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.29.up_proj:  10%|▉         | 3630/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.29.down_proj:  10%|▉         | 3631/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.30.gate_proj:  10%|▉         | 3632/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.30.up_proj:  10%|▉         | 3633/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.30.down_proj:  10%|▉         | 3634/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.31.gate_proj:  10%|▉         | 3635/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.31.up_proj:  10%|▉         | 3636/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.31.down_proj:  10%|▉         | 3637/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.32.gate_proj:  10%|▉         | 3638/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.32.up_proj:  10%|▉         | 3639/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.32.down_proj:  10%|▉         | 3640/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.33.gate_proj:  10%|▉         | 3641/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.33.up_proj:  10%|▉         | 3642/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.33.down_proj:  10%|▉         | 3643/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.34.gate_proj:  10%|▉         | 3644/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.34.up_proj:  10%|▉         | 3645/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.34.down_proj:  10%|▉         | 3646/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.35.gate_proj:  10%|▉         | 3647/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.35.up_proj:  10%|▉         | 3648/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.35.down_proj:  10%|▉         | 3649/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.36.gate_proj:  10%|▉         | 3650/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.36.up_proj:  10%|▉         | 3651/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.36.down_proj:  10%|▉         | 3652/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.37.gate_proj:  10%|▉         | 3653/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.37.up_proj:  10%|▉         | 3654/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.37.down_proj:  10%|▉         | 3655/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.38.gate_proj:  10%|▉         | 3656/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.38.up_proj:  10%|█         | 3657/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.38.down_proj:  10%|█         | 3658/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.39.gate_proj:  10%|█         | 3659/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.39.up_proj:  10%|█         | 3660/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.39.down_proj:  10%|█         | 3661/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.40.gate_proj:  10%|█         | 3662/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.40.up_proj:  10%|█         | 3663/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.40.down_proj:  10%|█         | 3664/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.41.gate_proj:  10%|█         | 3665/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.41.up_proj:  10%|█         | 3666/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.41.down_proj:  10%|█         | 3667/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.42.gate_proj:  10%|█         | 3668/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.42.up_proj:  10%|█         | 3669/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.42.down_proj:  10%|█         | 3670/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.43.gate_proj:  10%|█         | 3671/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.43.up_proj:  10%|█         | 3672/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.43.down_proj:  10%|█         | 3673/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.44.gate_proj:  10%|█         | 3674/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.44.up_proj:  10%|█         | 3675/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.44.down_proj:  10%|█         | 3676/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.45.gate_proj:  10%|█         | 3677/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.45.up_proj:  10%|█         | 3678/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.45.down_proj:  10%|█         | 3679/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.46.gate_proj:  10%|█         | 3680/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.46.up_proj:  10%|█         | 3681/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.46.down_proj:  10%|█         | 3682/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.47.gate_proj:  10%|█         | 3683/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.47.up_proj:  10%|█         | 3684/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.47.down_proj:  10%|█         | 3685/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.48.gate_proj:  10%|█         | 3686/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.48.up_proj:  10%|█         | 3687/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.48.down_proj:  10%|█         | 3688/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.49.gate_proj:  10%|█         | 3689/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.49.up_proj:  10%|█         | 3690/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.49.down_proj:  10%|█         | 3691/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.50.gate_proj:  10%|█         | 3692/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.50.up_proj:  10%|█         | 3693/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.50.down_proj:  10%|█         | 3694/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.51.gate_proj:  10%|█         | 3695/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.51.up_proj:  10%|█         | 3696/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.51.down_proj:  10%|█         | 3697/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.52.gate_proj:  10%|█         | 3698/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.52.up_proj:  10%|█         | 3699/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.52.down_proj:  10%|█         | 3700/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.53.gate_proj:  10%|█         | 3701/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.53.up_proj:  10%|█         | 3702/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.53.down_proj:  10%|█         | 3703/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.54.gate_proj:  10%|█         | 3704/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.54.up_proj:  10%|█         | 3705/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.54.down_proj:  10%|█         | 3706/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.55.gate_proj:  10%|█         | 3707/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.55.up_proj:  10%|█         | 3708/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.55.down_proj:  10%|█         | 3709/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.56.gate_proj:  10%|█         | 3710/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.56.up_proj:  10%|█         | 3711/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.56.down_proj:  10%|█         | 3712/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.57.gate_proj:  10%|█         | 3713/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.57.up_proj:  10%|█         | 3714/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.57.down_proj:  10%|█         | 3715/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.58.gate_proj:  10%|█         | 3716/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.58.up_proj:  10%|█         | 3717/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.58.down_proj:  10%|█         | 3718/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.59.gate_proj:  10%|█         | 3719/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.59.up_proj:  10%|█         | 3720/36566 [00:04<00:28, 1154.56it/s]  
packing model.layers.8.mlp.experts.59.down_proj:  10%|█         | 3721/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.60.gate_proj:  10%|█         | 3722/36566 [00:04<00:28, 1154.56it/s]
packing model.layers.8.mlp.experts.60.gate_proj:  10%|█         | 3723/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.60.up_proj:  10%|█         | 3723/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.60.down_proj:  10%|█         | 3724/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.61.gate_proj:  10%|█         | 3725/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.61.up_proj:  10%|█         | 3726/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.61.down_proj:  10%|█         | 3727/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.62.gate_proj:  10%|█         | 3728/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.62.up_proj:  10%|█         | 3729/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.62.down_proj:  10%|█         | 3730/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.63.gate_proj:  10%|█         | 3731/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.63.up_proj:  10%|█         | 3732/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.63.down_proj:  10%|█         | 3733/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.64.gate_proj:  10%|█         | 3734/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.64.up_proj:  10%|█         | 3735/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.64.down_proj:  10%|█         | 3736/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.65.gate_proj:  10%|█         | 3737/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.65.up_proj:  10%|█         | 3738/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.65.down_proj:  10%|█         | 3739/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.66.gate_proj:  10%|█         | 3740/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.66.up_proj:  10%|█         | 3741/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.66.down_proj:  10%|█         | 3742/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.67.gate_proj:  10%|█         | 3743/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.67.up_proj:  10%|█         | 3744/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.67.down_proj:  10%|█         | 3745/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.68.gate_proj:  10%|█         | 3746/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.68.up_proj:  10%|█         | 3747/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.68.down_proj:  10%|█         | 3748/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.69.gate_proj:  10%|█         | 3749/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.69.up_proj:  10%|█         | 3750/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.69.down_proj:  10%|█         | 3751/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.70.gate_proj:  10%|█         | 3752/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.70.up_proj:  10%|█         | 3753/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.70.down_proj:  10%|█         | 3754/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.71.gate_proj:  10%|█         | 3755/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.71.up_proj:  10%|█         | 3756/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.71.down_proj:  10%|█         | 3757/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.72.gate_proj:  10%|█         | 3758/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.72.up_proj:  10%|█         | 3759/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.72.down_proj:  10%|█         | 3760/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.73.gate_proj:  10%|█         | 3761/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.73.up_proj:  10%|█         | 3762/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.73.down_proj:  10%|█         | 3763/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.74.gate_proj:  10%|█         | 3764/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.74.up_proj:  10%|█         | 3765/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.74.down_proj:  10%|█         | 3766/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.75.gate_proj:  10%|█         | 3767/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.75.up_proj:  10%|█         | 3768/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.75.down_proj:  10%|█         | 3769/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.76.gate_proj:  10%|█         | 3770/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.76.up_proj:  10%|█         | 3771/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.76.down_proj:  10%|█         | 3772/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.77.gate_proj:  10%|█         | 3773/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.77.up_proj:  10%|█         | 3774/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.77.down_proj:  10%|█         | 3775/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.78.gate_proj:  10%|█         | 3776/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.78.up_proj:  10%|█         | 3777/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.78.down_proj:  10%|█         | 3778/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.79.gate_proj:  10%|█         | 3779/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.79.up_proj:  10%|█         | 3780/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.79.down_proj:  10%|█         | 3781/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.80.gate_proj:  10%|█         | 3782/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.80.up_proj:  10%|█         | 3783/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.80.down_proj:  10%|█         | 3784/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.81.gate_proj:  10%|█         | 3785/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.81.up_proj:  10%|█         | 3786/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.81.down_proj:  10%|█         | 3787/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.82.gate_proj:  10%|█         | 3788/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.82.up_proj:  10%|█         | 3789/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.82.down_proj:  10%|█         | 3790/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.83.gate_proj:  10%|█         | 3791/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.83.up_proj:  10%|█         | 3792/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.83.down_proj:  10%|█         | 3793/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.84.gate_proj:  10%|█         | 3794/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.84.up_proj:  10%|█         | 3795/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.84.down_proj:  10%|█         | 3796/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.85.gate_proj:  10%|█         | 3797/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.85.up_proj:  10%|█         | 3798/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.85.down_proj:  10%|█         | 3799/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.86.gate_proj:  10%|█         | 3800/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.86.up_proj:  10%|█         | 3801/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.86.down_proj:  10%|█         | 3802/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.87.gate_proj:  10%|█         | 3803/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.87.up_proj:  10%|█         | 3804/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.87.down_proj:  10%|█         | 3805/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.88.gate_proj:  10%|█         | 3806/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.88.up_proj:  10%|█         | 3807/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.88.down_proj:  10%|█         | 3808/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.89.gate_proj:  10%|█         | 3809/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.89.up_proj:  10%|█         | 3810/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.89.down_proj:  10%|█         | 3811/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.90.gate_proj:  10%|█         | 3812/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.90.up_proj:  10%|█         | 3813/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.90.down_proj:  10%|█         | 3814/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.91.gate_proj:  10%|█         | 3815/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.91.up_proj:  10%|█         | 3816/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.91.down_proj:  10%|█         | 3817/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.92.gate_proj:  10%|█         | 3818/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.92.up_proj:  10%|█         | 3819/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.92.down_proj:  10%|█         | 3820/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.93.gate_proj:  10%|█         | 3821/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.93.up_proj:  10%|█         | 3822/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.93.down_proj:  10%|█         | 3823/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.94.gate_proj:  10%|█         | 3824/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.94.up_proj:  10%|█         | 3825/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.94.down_proj:  10%|█         | 3826/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.95.gate_proj:  10%|█         | 3827/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.95.up_proj:  10%|█         | 3828/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.95.down_proj:  10%|█         | 3829/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.96.gate_proj:  10%|█         | 3830/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.96.up_proj:  10%|█         | 3831/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.96.down_proj:  10%|█         | 3832/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.97.gate_proj:  10%|█         | 3833/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.97.up_proj:  10%|█         | 3834/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.97.down_proj:  10%|█         | 3835/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.98.gate_proj:  10%|█         | 3836/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.98.up_proj:  10%|█         | 3837/36566 [00:04<00:28, 1156.66it/s]  
packing model.layers.8.mlp.experts.98.down_proj:  10%|█         | 3838/36566 [00:04<00:28, 1156.66it/s]
packing model.layers.8.mlp.experts.98.down_proj:  10%|█         | 3839/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.99.gate_proj:  10%|█         | 3839/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.99.up_proj:  11%|█         | 3840/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.99.down_proj:  11%|█         | 3841/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.100.gate_proj:  11%|█         | 3842/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.100.up_proj:  11%|█         | 3843/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.100.down_proj:  11%|█         | 3844/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.101.gate_proj:  11%|█         | 3845/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.101.up_proj:  11%|█         | 3846/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.101.down_proj:  11%|█         | 3847/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.102.gate_proj:  11%|█         | 3848/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.102.up_proj:  11%|█         | 3849/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.102.down_proj:  11%|█         | 3850/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.103.gate_proj:  11%|█         | 3851/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.103.up_proj:  11%|█         | 3852/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.103.down_proj:  11%|█         | 3853/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.104.gate_proj:  11%|█         | 3854/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.104.up_proj:  11%|█         | 3855/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.104.down_proj:  11%|█         | 3856/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.105.gate_proj:  11%|█         | 3857/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.105.up_proj:  11%|█         | 3858/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.105.down_proj:  11%|█         | 3859/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.106.gate_proj:  11%|█         | 3860/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.106.up_proj:  11%|█         | 3861/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.106.down_proj:  11%|█         | 3862/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.107.gate_proj:  11%|█         | 3863/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.107.up_proj:  11%|█         | 3864/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.107.down_proj:  11%|█         | 3865/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.108.gate_proj:  11%|█         | 3866/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.108.up_proj:  11%|█         | 3867/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.108.down_proj:  11%|█         | 3868/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.109.gate_proj:  11%|█         | 3869/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.109.up_proj:  11%|█         | 3870/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.109.down_proj:  11%|█         | 3871/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.110.gate_proj:  11%|█         | 3872/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.110.up_proj:  11%|█         | 3873/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.110.down_proj:  11%|█         | 3874/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.111.gate_proj:  11%|█         | 3875/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.111.up_proj:  11%|█         | 3876/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.111.down_proj:  11%|█         | 3877/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.112.gate_proj:  11%|█         | 3878/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.112.up_proj:  11%|█         | 3879/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.112.down_proj:  11%|█         | 3880/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.113.gate_proj:  11%|█         | 3881/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.113.up_proj:  11%|█         | 3882/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.113.down_proj:  11%|█         | 3883/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.114.gate_proj:  11%|█         | 3884/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.114.up_proj:  11%|█         | 3885/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.114.down_proj:  11%|█         | 3886/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.115.gate_proj:  11%|█         | 3887/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.115.up_proj:  11%|█         | 3888/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.115.down_proj:  11%|█         | 3889/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.116.gate_proj:  11%|█         | 3890/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.116.up_proj:  11%|█         | 3891/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.116.down_proj:  11%|█         | 3892/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.117.gate_proj:  11%|█         | 3893/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.117.up_proj:  11%|█         | 3894/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.117.down_proj:  11%|█         | 3895/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.118.gate_proj:  11%|█         | 3896/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.118.up_proj:  11%|█         | 3897/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.118.down_proj:  11%|█         | 3898/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.119.gate_proj:  11%|█         | 3899/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.119.up_proj:  11%|█         | 3900/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.119.down_proj:  11%|█         | 3901/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.120.gate_proj:  11%|█         | 3902/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.120.up_proj:  11%|█         | 3903/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.120.down_proj:  11%|█         | 3904/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.121.gate_proj:  11%|█         | 3905/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.121.up_proj:  11%|█         | 3906/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.121.down_proj:  11%|█         | 3907/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.122.gate_proj:  11%|█         | 3908/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.122.up_proj:  11%|█         | 3909/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.122.down_proj:  11%|█         | 3910/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.123.gate_proj:  11%|█         | 3911/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.123.up_proj:  11%|█         | 3912/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.123.down_proj:  11%|█         | 3913/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.124.gate_proj:  11%|█         | 3914/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.124.up_proj:  11%|█         | 3915/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.124.down_proj:  11%|█         | 3916/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.125.gate_proj:  11%|█         | 3917/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.125.up_proj:  11%|█         | 3918/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.125.down_proj:  11%|█         | 3919/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.126.gate_proj:  11%|█         | 3920/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.126.up_proj:  11%|█         | 3921/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.126.down_proj:  11%|█         | 3922/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.127.gate_proj:  11%|█         | 3923/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.8.mlp.experts.127.up_proj:  11%|█         | 3924/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.8.mlp.experts.127.down_proj:  11%|█         | 3925/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.0.gate_proj:  11%|█         | 3926/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.0.up_proj:  11%|█         | 3927/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.0.down_proj:  11%|█         | 3928/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.1.gate_proj:  11%|█         | 3929/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.1.up_proj:  11%|█         | 3930/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.1.down_proj:  11%|█         | 3931/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.2.gate_proj:  11%|█         | 3932/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.2.up_proj:  11%|█         | 3933/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.2.down_proj:  11%|█         | 3934/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.3.gate_proj:  11%|█         | 3935/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.3.up_proj:  11%|█         | 3936/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.3.down_proj:  11%|█         | 3937/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.4.gate_proj:  11%|█         | 3938/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.4.up_proj:  11%|█         | 3939/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.4.down_proj:  11%|█         | 3940/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.5.gate_proj:  11%|█         | 3941/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.5.up_proj:  11%|█         | 3942/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.5.down_proj:  11%|█         | 3943/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.6.gate_proj:  11%|█         | 3944/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.6.up_proj:  11%|█         | 3945/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.6.down_proj:  11%|█         | 3946/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.7.gate_proj:  11%|█         | 3947/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.7.up_proj:  11%|█         | 3948/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.7.down_proj:  11%|█         | 3949/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.8.gate_proj:  11%|█         | 3950/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.8.up_proj:  11%|█         | 3951/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.8.down_proj:  11%|█         | 3952/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.9.gate_proj:  11%|█         | 3953/36566 [00:04<00:28, 1157.44it/s]
packing model.layers.9.mlp.experts.9.up_proj:  11%|█         | 3954/36566 [00:04<00:28, 1157.44it/s]  
packing model.layers.9.mlp.experts.9.up_proj:  11%|█         | 3955/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.9.down_proj:  11%|█         | 3955/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.10.gate_proj:  11%|█         | 3956/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.10.up_proj:  11%|█         | 3957/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.10.down_proj:  11%|█         | 3958/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.11.gate_proj:  11%|█         | 3959/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.11.up_proj:  11%|█         | 3960/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.11.down_proj:  11%|█         | 3961/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.12.gate_proj:  11%|█         | 3962/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.12.up_proj:  11%|█         | 3963/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.12.down_proj:  11%|█         | 3964/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.13.gate_proj:  11%|█         | 3965/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.13.up_proj:  11%|█         | 3966/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.13.down_proj:  11%|█         | 3967/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.14.gate_proj:  11%|█         | 3968/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.14.up_proj:  11%|█         | 3969/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.14.down_proj:  11%|█         | 3970/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.15.gate_proj:  11%|█         | 3971/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.15.up_proj:  11%|█         | 3972/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.15.down_proj:  11%|█         | 3973/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.16.gate_proj:  11%|█         | 3974/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.16.up_proj:  11%|█         | 3975/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.16.down_proj:  11%|█         | 3976/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.17.gate_proj:  11%|█         | 3977/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.17.up_proj:  11%|█         | 3978/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.17.down_proj:  11%|█         | 3979/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.18.gate_proj:  11%|█         | 3980/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.18.up_proj:  11%|█         | 3981/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.18.down_proj:  11%|█         | 3982/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.19.gate_proj:  11%|█         | 3983/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.19.up_proj:  11%|█         | 3984/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.19.down_proj:  11%|█         | 3985/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.20.gate_proj:  11%|█         | 3986/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.20.up_proj:  11%|█         | 3987/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.20.down_proj:  11%|█         | 3988/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.21.gate_proj:  11%|█         | 3989/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.21.up_proj:  11%|█         | 3990/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.21.down_proj:  11%|█         | 3991/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.22.gate_proj:  11%|█         | 3992/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.22.up_proj:  11%|█         | 3993/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.22.down_proj:  11%|█         | 3994/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.23.gate_proj:  11%|█         | 3995/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.23.up_proj:  11%|█         | 3996/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.23.down_proj:  11%|█         | 3997/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.24.gate_proj:  11%|█         | 3998/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.24.up_proj:  11%|█         | 3999/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.24.down_proj:  11%|█         | 4000/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.25.gate_proj:  11%|█         | 4001/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.25.up_proj:  11%|█         | 4002/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.25.down_proj:  11%|█         | 4003/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.26.gate_proj:  11%|█         | 4004/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.26.up_proj:  11%|█         | 4005/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.26.down_proj:  11%|█         | 4006/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.27.gate_proj:  11%|█         | 4007/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.27.up_proj:  11%|█         | 4008/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.27.down_proj:  11%|█         | 4009/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.28.gate_proj:  11%|█         | 4010/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.28.up_proj:  11%|█         | 4011/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.28.down_proj:  11%|█         | 4012/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.29.gate_proj:  11%|█         | 4013/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.29.up_proj:  11%|█         | 4014/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.29.down_proj:  11%|█         | 4015/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.30.gate_proj:  11%|█         | 4016/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.30.up_proj:  11%|█         | 4017/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.30.down_proj:  11%|█         | 4018/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.31.gate_proj:  11%|█         | 4019/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.31.up_proj:  11%|█         | 4020/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.31.down_proj:  11%|█         | 4021/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.32.gate_proj:  11%|█         | 4022/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.32.up_proj:  11%|█         | 4023/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.32.down_proj:  11%|█         | 4024/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.33.gate_proj:  11%|█         | 4025/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.33.up_proj:  11%|█         | 4026/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.33.down_proj:  11%|█         | 4027/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.34.gate_proj:  11%|█         | 4028/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.34.up_proj:  11%|█         | 4029/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.34.down_proj:  11%|█         | 4030/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.35.gate_proj:  11%|█         | 4031/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.35.up_proj:  11%|█         | 4032/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.35.down_proj:  11%|█         | 4033/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.36.gate_proj:  11%|█         | 4034/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.36.up_proj:  11%|█         | 4035/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.36.down_proj:  11%|█         | 4036/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.37.gate_proj:  11%|█         | 4037/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.37.up_proj:  11%|█         | 4038/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.37.down_proj:  11%|█         | 4039/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.38.gate_proj:  11%|█         | 4040/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.38.up_proj:  11%|█         | 4041/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.38.down_proj:  11%|█         | 4042/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.39.gate_proj:  11%|█         | 4043/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.39.up_proj:  11%|█         | 4044/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.39.down_proj:  11%|█         | 4045/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.40.gate_proj:  11%|█         | 4046/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.40.up_proj:  11%|█         | 4047/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.40.down_proj:  11%|█         | 4048/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.41.gate_proj:  11%|█         | 4049/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.41.up_proj:  11%|█         | 4050/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.41.down_proj:  11%|█         | 4051/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.42.gate_proj:  11%|█         | 4052/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.42.up_proj:  11%|█         | 4053/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.42.down_proj:  11%|█         | 4054/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.43.gate_proj:  11%|█         | 4055/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.43.up_proj:  11%|█         | 4056/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.43.down_proj:  11%|█         | 4057/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.44.gate_proj:  11%|█         | 4058/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.44.up_proj:  11%|█         | 4059/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.44.down_proj:  11%|█         | 4060/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.45.gate_proj:  11%|█         | 4061/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.45.up_proj:  11%|█         | 4062/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.45.down_proj:  11%|█         | 4063/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.46.gate_proj:  11%|█         | 4064/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.46.up_proj:  11%|█         | 4065/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.46.down_proj:  11%|█         | 4066/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.47.gate_proj:  11%|█         | 4067/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.47.up_proj:  11%|█         | 4068/36566 [00:04<00:28, 1157.41it/s]  
packing model.layers.9.mlp.experts.47.down_proj:  11%|█         | 4069/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.48.gate_proj:  11%|█         | 4070/36566 [00:04<00:28, 1157.41it/s]
packing model.layers.9.mlp.experts.48.gate_proj:  11%|█         | 4071/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.48.up_proj:  11%|█         | 4071/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.48.down_proj:  11%|█         | 4072/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.49.gate_proj:  11%|█         | 4073/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.49.up_proj:  11%|█         | 4074/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.49.down_proj:  11%|█         | 4075/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.50.gate_proj:  11%|█         | 4076/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.50.up_proj:  11%|█         | 4077/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.50.down_proj:  11%|█         | 4078/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.51.gate_proj:  11%|█         | 4079/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.51.up_proj:  11%|█         | 4080/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.51.down_proj:  11%|█         | 4081/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.52.gate_proj:  11%|█         | 4082/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.52.up_proj:  11%|█         | 4083/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.52.down_proj:  11%|█         | 4084/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.53.gate_proj:  11%|█         | 4085/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.53.up_proj:  11%|█         | 4086/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.53.down_proj:  11%|█         | 4087/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.54.gate_proj:  11%|█         | 4088/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.54.up_proj:  11%|█         | 4089/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.54.down_proj:  11%|█         | 4090/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.55.gate_proj:  11%|█         | 4091/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.55.up_proj:  11%|█         | 4092/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.55.down_proj:  11%|█         | 4093/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.56.gate_proj:  11%|█         | 4094/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.56.up_proj:  11%|█         | 4095/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.56.down_proj:  11%|█         | 4096/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.57.gate_proj:  11%|█         | 4097/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.57.up_proj:  11%|█         | 4098/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.57.down_proj:  11%|█         | 4099/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.58.gate_proj:  11%|█         | 4100/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.58.up_proj:  11%|█         | 4101/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.58.down_proj:  11%|█         | 4102/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.59.gate_proj:  11%|█         | 4103/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.59.up_proj:  11%|█         | 4104/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.59.down_proj:  11%|█         | 4105/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.60.gate_proj:  11%|█         | 4106/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.60.up_proj:  11%|█         | 4107/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.60.down_proj:  11%|█         | 4108/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.61.gate_proj:  11%|█         | 4109/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.61.up_proj:  11%|█         | 4110/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.61.down_proj:  11%|█         | 4111/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.62.gate_proj:  11%|█         | 4112/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.62.up_proj:  11%|█         | 4113/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.62.down_proj:  11%|█▏        | 4114/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.63.gate_proj:  11%|█▏        | 4115/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.63.up_proj:  11%|█▏        | 4116/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.63.down_proj:  11%|█▏        | 4117/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.64.gate_proj:  11%|█▏        | 4118/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.64.up_proj:  11%|█▏        | 4119/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.64.down_proj:  11%|█▏        | 4120/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.65.gate_proj:  11%|█▏        | 4121/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.65.up_proj:  11%|█▏        | 4122/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.65.down_proj:  11%|█▏        | 4123/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.66.gate_proj:  11%|█▏        | 4124/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.66.up_proj:  11%|█▏        | 4125/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.66.down_proj:  11%|█▏        | 4126/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.67.gate_proj:  11%|█▏        | 4127/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.67.up_proj:  11%|█▏        | 4128/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.67.down_proj:  11%|█▏        | 4129/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.68.gate_proj:  11%|█▏        | 4130/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.68.up_proj:  11%|█▏        | 4131/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.68.down_proj:  11%|█▏        | 4132/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.69.gate_proj:  11%|█▏        | 4133/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.69.up_proj:  11%|█▏        | 4134/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.69.down_proj:  11%|█▏        | 4135/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.70.gate_proj:  11%|█▏        | 4136/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.70.up_proj:  11%|█▏        | 4137/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.70.down_proj:  11%|█▏        | 4138/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.71.gate_proj:  11%|█▏        | 4139/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.71.up_proj:  11%|█▏        | 4140/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.71.down_proj:  11%|█▏        | 4141/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.72.gate_proj:  11%|█▏        | 4142/36566 [00:04<00:28, 1157.94it/s]
packing model.layers.9.mlp.experts.72.up_proj:  11%|█▏        | 4143/36566 [00:04<00:28, 1157.94it/s]  
packing model.layers.9.mlp.experts.72.down_proj:  11%|█▏        | 4144/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.73.gate_proj:  11%|█▏        | 4145/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.73.up_proj:  11%|█▏        | 4146/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.73.down_proj:  11%|█▏        | 4147/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.74.gate_proj:  11%|█▏        | 4148/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.74.up_proj:  11%|█▏        | 4149/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.74.down_proj:  11%|█▏        | 4150/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.75.gate_proj:  11%|█▏        | 4151/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.75.up_proj:  11%|█▏        | 4152/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.75.down_proj:  11%|█▏        | 4153/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.76.gate_proj:  11%|█▏        | 4154/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.76.up_proj:  11%|█▏        | 4155/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.76.down_proj:  11%|█▏        | 4156/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.77.gate_proj:  11%|█▏        | 4157/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.77.up_proj:  11%|█▏        | 4158/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.77.down_proj:  11%|█▏        | 4159/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.78.gate_proj:  11%|█▏        | 4160/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.78.up_proj:  11%|█▏        | 4161/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.78.down_proj:  11%|█▏        | 4162/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.79.gate_proj:  11%|█▏        | 4163/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.79.up_proj:  11%|█▏        | 4164/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.79.down_proj:  11%|█▏        | 4165/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.80.gate_proj:  11%|█▏        | 4166/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.80.up_proj:  11%|█▏        | 4167/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.80.down_proj:  11%|█▏        | 4168/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.81.gate_proj:  11%|█▏        | 4169/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.81.up_proj:  11%|█▏        | 4170/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.81.down_proj:  11%|█▏        | 4171/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.82.gate_proj:  11%|█▏        | 4172/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.82.up_proj:  11%|█▏        | 4173/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.82.down_proj:  11%|█▏        | 4174/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.83.gate_proj:  11%|█▏        | 4175/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.83.up_proj:  11%|█▏        | 4176/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.83.down_proj:  11%|█▏        | 4177/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.84.gate_proj:  11%|█▏        | 4178/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.84.up_proj:  11%|█▏        | 4179/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.84.down_proj:  11%|█▏        | 4180/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.85.gate_proj:  11%|█▏        | 4181/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.85.up_proj:  11%|█▏        | 4182/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.85.down_proj:  11%|█▏        | 4183/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.86.gate_proj:  11%|█▏        | 4184/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.86.up_proj:  11%|█▏        | 4185/36566 [00:04<00:27, 1157.94it/s]  
packing model.layers.9.mlp.experts.86.down_proj:  11%|█▏        | 4186/36566 [00:04<00:27, 1157.94it/s]
packing model.layers.9.mlp.experts.86.down_proj:  11%|█▏        | 4187/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.87.gate_proj:  11%|█▏        | 4187/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.87.up_proj:  11%|█▏        | 4188/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.87.down_proj:  11%|█▏        | 4189/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.88.gate_proj:  11%|█▏        | 4190/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.88.up_proj:  11%|█▏        | 4191/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.88.down_proj:  11%|█▏        | 4192/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.89.gate_proj:  11%|█▏        | 4193/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.89.up_proj:  11%|█▏        | 4194/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.89.down_proj:  11%|█▏        | 4195/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.90.gate_proj:  11%|█▏        | 4196/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.90.up_proj:  11%|█▏        | 4197/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.90.down_proj:  11%|█▏        | 4198/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.91.gate_proj:  11%|█▏        | 4199/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.91.up_proj:  11%|█▏        | 4200/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.91.down_proj:  11%|█▏        | 4201/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.92.gate_proj:  11%|█▏        | 4202/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.92.up_proj:  11%|█▏        | 4203/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.92.down_proj:  11%|█▏        | 4204/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.93.gate_proj:  11%|█▏        | 4205/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.93.up_proj:  12%|█▏        | 4206/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.93.down_proj:  12%|█▏        | 4207/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.94.gate_proj:  12%|█▏        | 4208/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.94.up_proj:  12%|█▏        | 4209/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.94.down_proj:  12%|█▏        | 4210/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.95.gate_proj:  12%|█▏        | 4211/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.95.up_proj:  12%|█▏        | 4212/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.95.down_proj:  12%|█▏        | 4213/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.96.gate_proj:  12%|█▏        | 4214/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.96.up_proj:  12%|█▏        | 4215/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.96.down_proj:  12%|█▏        | 4216/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.97.gate_proj:  12%|█▏        | 4217/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.97.up_proj:  12%|█▏        | 4218/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.97.down_proj:  12%|█▏        | 4219/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.98.gate_proj:  12%|█▏        | 4220/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.98.up_proj:  12%|█▏        | 4221/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.98.down_proj:  12%|█▏        | 4222/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.99.gate_proj:  12%|█▏        | 4223/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.99.up_proj:  12%|█▏        | 4224/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.99.down_proj:  12%|█▏        | 4225/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.100.gate_proj:  12%|█▏        | 4226/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.100.up_proj:  12%|█▏        | 4227/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.100.down_proj:  12%|█▏        | 4228/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.101.gate_proj:  12%|█▏        | 4229/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.101.up_proj:  12%|█▏        | 4230/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.101.down_proj:  12%|█▏        | 4231/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.102.gate_proj:  12%|█▏        | 4232/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.102.up_proj:  12%|█▏        | 4233/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.102.down_proj:  12%|█▏        | 4234/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.103.gate_proj:  12%|█▏        | 4235/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.103.up_proj:  12%|█▏        | 4236/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.103.down_proj:  12%|█▏        | 4237/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.104.gate_proj:  12%|█▏        | 4238/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.104.up_proj:  12%|█▏        | 4239/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.104.down_proj:  12%|█▏        | 4240/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.105.gate_proj:  12%|█▏        | 4241/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.105.up_proj:  12%|█▏        | 4242/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.105.down_proj:  12%|█▏        | 4243/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.106.gate_proj:  12%|█▏        | 4244/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.106.up_proj:  12%|█▏        | 4245/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.106.down_proj:  12%|█▏        | 4246/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.107.gate_proj:  12%|█▏        | 4247/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.107.up_proj:  12%|█▏        | 4248/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.107.down_proj:  12%|█▏        | 4249/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.108.gate_proj:  12%|█▏        | 4250/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.108.up_proj:  12%|█▏        | 4251/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.108.down_proj:  12%|█▏        | 4252/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.109.gate_proj:  12%|█▏        | 4253/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.109.up_proj:  12%|█▏        | 4254/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.109.down_proj:  12%|█▏        | 4255/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.110.gate_proj:  12%|█▏        | 4256/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.110.up_proj:  12%|█▏        | 4257/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.110.down_proj:  12%|█▏        | 4258/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.111.gate_proj:  12%|█▏        | 4259/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.111.up_proj:  12%|█▏        | 4260/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.111.down_proj:  12%|█▏        | 4261/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.112.gate_proj:  12%|█▏        | 4262/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.112.up_proj:  12%|█▏        | 4263/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.112.down_proj:  12%|█▏        | 4264/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.113.gate_proj:  12%|█▏        | 4265/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.113.up_proj:  12%|█▏        | 4266/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.113.down_proj:  12%|█▏        | 4267/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.114.gate_proj:  12%|█▏        | 4268/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.114.up_proj:  12%|█▏        | 4269/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.114.down_proj:  12%|█▏        | 4270/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.115.gate_proj:  12%|█▏        | 4271/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.115.up_proj:  12%|█▏        | 4272/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.115.down_proj:  12%|█▏        | 4273/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.116.gate_proj:  12%|█▏        | 4274/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.116.up_proj:  12%|█▏        | 4275/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.116.down_proj:  12%|█▏        | 4276/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.117.gate_proj:  12%|█▏        | 4277/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.117.up_proj:  12%|█▏        | 4278/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.117.down_proj:  12%|█▏        | 4279/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.118.gate_proj:  12%|█▏        | 4280/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.118.up_proj:  12%|█▏        | 4281/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.118.down_proj:  12%|█▏        | 4282/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.119.gate_proj:  12%|█▏        | 4283/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.119.up_proj:  12%|█▏        | 4284/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.119.down_proj:  12%|█▏        | 4285/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.120.gate_proj:  12%|█▏        | 4286/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.120.up_proj:  12%|█▏        | 4287/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.120.down_proj:  12%|█▏        | 4288/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.121.gate_proj:  12%|█▏        | 4289/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.121.up_proj:  12%|█▏        | 4290/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.121.down_proj:  12%|█▏        | 4291/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.122.gate_proj:  12%|█▏        | 4292/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.122.up_proj:  12%|█▏        | 4293/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.122.down_proj:  12%|█▏        | 4294/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.123.gate_proj:  12%|█▏        | 4295/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.123.up_proj:  12%|█▏        | 4296/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.123.down_proj:  12%|█▏        | 4297/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.124.gate_proj:  12%|█▏        | 4298/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.124.up_proj:  12%|█▏        | 4299/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.124.down_proj:  12%|█▏        | 4300/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.125.gate_proj:  12%|█▏        | 4301/36566 [00:04<00:27, 1156.57it/s]
packing model.layers.9.mlp.experts.125.up_proj:  12%|█▏        | 4302/36566 [00:04<00:27, 1156.57it/s]  
packing model.layers.9.mlp.experts.125.up_proj:  12%|█▏        | 4303/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.9.mlp.experts.125.down_proj:  12%|█▏        | 4303/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.9.mlp.experts.126.gate_proj:  12%|█▏        | 4304/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.9.mlp.experts.126.up_proj:  12%|█▏        | 4305/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.9.mlp.experts.126.down_proj:  12%|█▏        | 4306/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.9.mlp.experts.127.gate_proj:  12%|█▏        | 4307/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.9.mlp.experts.127.up_proj:  12%|█▏        | 4308/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.9.mlp.experts.127.down_proj:  12%|█▏        | 4309/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.0.gate_proj:  12%|█▏        | 4310/36566 [00:04<00:27, 1157.11it/s] 
packing model.layers.10.mlp.experts.0.up_proj:  12%|█▏        | 4311/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.0.down_proj:  12%|█▏        | 4312/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.1.gate_proj:  12%|█▏        | 4313/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.1.up_proj:  12%|█▏        | 4314/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.1.down_proj:  12%|█▏        | 4315/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.2.gate_proj:  12%|█▏        | 4316/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.2.up_proj:  12%|█▏        | 4317/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.2.down_proj:  12%|█▏        | 4318/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.3.gate_proj:  12%|█▏        | 4319/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.3.up_proj:  12%|█▏        | 4320/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.3.down_proj:  12%|█▏        | 4321/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.4.gate_proj:  12%|█▏        | 4322/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.4.up_proj:  12%|█▏        | 4323/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.4.down_proj:  12%|█▏        | 4324/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.5.gate_proj:  12%|█▏        | 4325/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.5.up_proj:  12%|█▏        | 4326/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.5.down_proj:  12%|█▏        | 4327/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.6.gate_proj:  12%|█▏        | 4328/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.6.up_proj:  12%|█▏        | 4329/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.6.down_proj:  12%|█▏        | 4330/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.7.gate_proj:  12%|█▏        | 4331/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.7.up_proj:  12%|█▏        | 4332/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.7.down_proj:  12%|█▏        | 4333/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.8.gate_proj:  12%|█▏        | 4334/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.8.up_proj:  12%|█▏        | 4335/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.8.down_proj:  12%|█▏        | 4336/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.9.gate_proj:  12%|█▏        | 4337/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.9.up_proj:  12%|█▏        | 4338/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.9.down_proj:  12%|█▏        | 4339/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.10.gate_proj:  12%|█▏        | 4340/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.10.up_proj:  12%|█▏        | 4341/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.10.down_proj:  12%|█▏        | 4342/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.11.gate_proj:  12%|█▏        | 4343/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.11.up_proj:  12%|█▏        | 4344/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.11.down_proj:  12%|█▏        | 4345/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.12.gate_proj:  12%|█▏        | 4346/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.12.up_proj:  12%|█▏        | 4347/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.12.down_proj:  12%|█▏        | 4348/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.13.gate_proj:  12%|█▏        | 4349/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.13.up_proj:  12%|█▏        | 4350/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.13.down_proj:  12%|█▏        | 4351/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.14.gate_proj:  12%|█▏        | 4352/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.14.up_proj:  12%|█▏        | 4353/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.14.down_proj:  12%|█▏        | 4354/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.15.gate_proj:  12%|█▏        | 4355/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.15.up_proj:  12%|█▏        | 4356/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.15.down_proj:  12%|█▏        | 4357/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.16.gate_proj:  12%|█▏        | 4358/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.16.up_proj:  12%|█▏        | 4359/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.16.down_proj:  12%|█▏        | 4360/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.17.gate_proj:  12%|█▏        | 4361/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.17.up_proj:  12%|█▏        | 4362/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.17.down_proj:  12%|█▏        | 4363/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.18.gate_proj:  12%|█▏        | 4364/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.18.up_proj:  12%|█▏        | 4365/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.18.down_proj:  12%|█▏        | 4366/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.19.gate_proj:  12%|█▏        | 4367/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.19.up_proj:  12%|█▏        | 4368/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.19.down_proj:  12%|█▏        | 4369/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.20.gate_proj:  12%|█▏        | 4370/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.20.up_proj:  12%|█▏        | 4371/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.20.down_proj:  12%|█▏        | 4372/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.21.gate_proj:  12%|█▏        | 4373/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.21.up_proj:  12%|█▏        | 4374/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.21.down_proj:  12%|█▏        | 4375/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.22.gate_proj:  12%|█▏        | 4376/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.22.up_proj:  12%|█▏        | 4377/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.22.down_proj:  12%|█▏        | 4378/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.23.gate_proj:  12%|█▏        | 4379/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.23.up_proj:  12%|█▏        | 4380/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.23.down_proj:  12%|█▏        | 4381/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.24.gate_proj:  12%|█▏        | 4382/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.24.up_proj:  12%|█▏        | 4383/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.24.down_proj:  12%|█▏        | 4384/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.25.gate_proj:  12%|█▏        | 4385/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.25.up_proj:  12%|█▏        | 4386/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.25.down_proj:  12%|█▏        | 4387/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.26.gate_proj:  12%|█▏        | 4388/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.26.up_proj:  12%|█▏        | 4389/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.26.down_proj:  12%|█▏        | 4390/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.27.gate_proj:  12%|█▏        | 4391/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.27.up_proj:  12%|█▏        | 4392/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.27.down_proj:  12%|█▏        | 4393/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.28.gate_proj:  12%|█▏        | 4394/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.28.up_proj:  12%|█▏        | 4395/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.28.down_proj:  12%|█▏        | 4396/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.29.gate_proj:  12%|█▏        | 4397/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.29.up_proj:  12%|█▏        | 4398/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.29.down_proj:  12%|█▏        | 4399/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.30.gate_proj:  12%|█▏        | 4400/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.30.up_proj:  12%|█▏        | 4401/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.30.down_proj:  12%|█▏        | 4402/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.31.gate_proj:  12%|█▏        | 4403/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.31.up_proj:  12%|█▏        | 4404/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.31.down_proj:  12%|█▏        | 4405/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.32.gate_proj:  12%|█▏        | 4406/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.32.up_proj:  12%|█▏        | 4407/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.32.down_proj:  12%|█▏        | 4408/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.33.gate_proj:  12%|█▏        | 4409/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.33.up_proj:  12%|█▏        | 4410/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.33.down_proj:  12%|█▏        | 4411/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.34.gate_proj:  12%|█▏        | 4412/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.34.up_proj:  12%|█▏        | 4413/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.34.down_proj:  12%|█▏        | 4414/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.35.gate_proj:  12%|█▏        | 4415/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.35.up_proj:  12%|█▏        | 4416/36566 [00:04<00:27, 1157.11it/s]  
packing model.layers.10.mlp.experts.35.down_proj:  12%|█▏        | 4417/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.36.gate_proj:  12%|█▏        | 4418/36566 [00:04<00:27, 1157.11it/s]
packing model.layers.10.mlp.experts.36.gate_proj:  12%|█▏        | 4419/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.36.up_proj:  12%|█▏        | 4419/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.36.down_proj:  12%|█▏        | 4420/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.37.gate_proj:  12%|█▏        | 4421/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.37.up_proj:  12%|█▏        | 4422/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.37.down_proj:  12%|█▏        | 4423/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.38.gate_proj:  12%|█▏        | 4424/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.38.up_proj:  12%|█▏        | 4425/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.38.down_proj:  12%|█▏        | 4426/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.39.gate_proj:  12%|█▏        | 4427/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.39.up_proj:  12%|█▏        | 4428/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.39.down_proj:  12%|█▏        | 4429/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.40.gate_proj:  12%|█▏        | 4430/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.40.up_proj:  12%|█▏        | 4431/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.40.down_proj:  12%|█▏        | 4432/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.41.gate_proj:  12%|█▏        | 4433/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.41.up_proj:  12%|█▏        | 4434/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.41.down_proj:  12%|█▏        | 4435/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.42.gate_proj:  12%|█▏        | 4436/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.42.up_proj:  12%|█▏        | 4437/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.42.down_proj:  12%|█▏        | 4438/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.43.gate_proj:  12%|█▏        | 4439/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.43.up_proj:  12%|█▏        | 4440/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.43.down_proj:  12%|█▏        | 4441/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.44.gate_proj:  12%|█▏        | 4442/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.44.up_proj:  12%|█▏        | 4443/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.44.down_proj:  12%|█▏        | 4444/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.45.gate_proj:  12%|█▏        | 4445/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.45.up_proj:  12%|█▏        | 4446/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.45.down_proj:  12%|█▏        | 4447/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.46.gate_proj:  12%|█▏        | 4448/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.46.up_proj:  12%|█▏        | 4449/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.46.down_proj:  12%|█▏        | 4450/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.47.gate_proj:  12%|█▏        | 4451/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.47.up_proj:  12%|█▏        | 4452/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.47.down_proj:  12%|█▏        | 4453/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.48.gate_proj:  12%|█▏        | 4454/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.48.up_proj:  12%|█▏        | 4455/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.48.down_proj:  12%|█▏        | 4456/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.49.gate_proj:  12%|█▏        | 4457/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.49.up_proj:  12%|█▏        | 4458/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.49.down_proj:  12%|█▏        | 4459/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.50.gate_proj:  12%|█▏        | 4460/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.50.up_proj:  12%|█▏        | 4461/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.50.down_proj:  12%|█▏        | 4462/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.51.gate_proj:  12%|█▏        | 4463/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.51.up_proj:  12%|█▏        | 4464/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.51.down_proj:  12%|█▏        | 4465/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.52.gate_proj:  12%|█▏        | 4466/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.52.up_proj:  12%|█▏        | 4467/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.52.down_proj:  12%|█▏        | 4468/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.53.gate_proj:  12%|█▏        | 4469/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.53.up_proj:  12%|█▏        | 4470/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.53.down_proj:  12%|█▏        | 4471/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.54.gate_proj:  12%|█▏        | 4472/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.54.up_proj:  12%|█▏        | 4473/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.54.down_proj:  12%|█▏        | 4474/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.55.gate_proj:  12%|█▏        | 4475/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.55.up_proj:  12%|█▏        | 4476/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.55.down_proj:  12%|█▏        | 4477/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.56.gate_proj:  12%|█▏        | 4478/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.56.up_proj:  12%|█▏        | 4479/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.56.down_proj:  12%|█▏        | 4480/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.57.gate_proj:  12%|█▏        | 4481/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.57.up_proj:  12%|█▏        | 4482/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.57.down_proj:  12%|█▏        | 4483/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.58.gate_proj:  12%|█▏        | 4484/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.58.up_proj:  12%|█▏        | 4485/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.58.down_proj:  12%|█▏        | 4486/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.59.gate_proj:  12%|█▏        | 4487/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.59.up_proj:  12%|█▏        | 4488/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.59.down_proj:  12%|█▏        | 4489/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.60.gate_proj:  12%|█▏        | 4490/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.60.up_proj:  12%|█▏        | 4491/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.60.down_proj:  12%|█▏        | 4492/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.61.gate_proj:  12%|█▏        | 4493/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.61.up_proj:  12%|█▏        | 4494/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.61.down_proj:  12%|█▏        | 4495/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.62.gate_proj:  12%|█▏        | 4496/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.62.up_proj:  12%|█▏        | 4497/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.62.down_proj:  12%|█▏        | 4498/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.63.gate_proj:  12%|█▏        | 4499/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.63.up_proj:  12%|█▏        | 4500/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.63.down_proj:  12%|█▏        | 4501/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.64.gate_proj:  12%|█▏        | 4502/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.64.up_proj:  12%|█▏        | 4503/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.64.down_proj:  12%|█▏        | 4504/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.65.gate_proj:  12%|█▏        | 4505/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.65.up_proj:  12%|█▏        | 4506/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.65.down_proj:  12%|█▏        | 4507/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.66.gate_proj:  12%|█▏        | 4508/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.66.up_proj:  12%|█▏        | 4509/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.66.down_proj:  12%|█▏        | 4510/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.67.gate_proj:  12%|█▏        | 4511/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.67.up_proj:  12%|█▏        | 4512/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.67.down_proj:  12%|█▏        | 4513/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.68.gate_proj:  12%|█▏        | 4514/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.68.up_proj:  12%|█▏        | 4515/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.68.down_proj:  12%|█▏        | 4516/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.69.gate_proj:  12%|█▏        | 4517/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.69.up_proj:  12%|█▏        | 4518/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.69.down_proj:  12%|█▏        | 4519/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.70.gate_proj:  12%|█▏        | 4520/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.70.up_proj:  12%|█▏        | 4521/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.70.down_proj:  12%|█▏        | 4522/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.71.gate_proj:  12%|█▏        | 4523/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.71.up_proj:  12%|█▏        | 4524/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.71.down_proj:  12%|█▏        | 4525/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.72.gate_proj:  12%|█▏        | 4526/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.72.up_proj:  12%|█▏        | 4527/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.72.down_proj:  12%|█▏        | 4528/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.73.gate_proj:  12%|█▏        | 4529/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.73.up_proj:  12%|█▏        | 4530/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.73.down_proj:  12%|█▏        | 4531/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.74.gate_proj:  12%|█▏        | 4532/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.74.up_proj:  12%|█▏        | 4533/36566 [00:04<00:27, 1157.87it/s]  
packing model.layers.10.mlp.experts.74.down_proj:  12%|█▏        | 4534/36566 [00:04<00:27, 1157.87it/s]
packing model.layers.10.mlp.experts.74.down_proj:  12%|█▏        | 4535/36566 [00:04<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.75.gate_proj:  12%|█▏        | 4535/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.75.up_proj:  12%|█▏        | 4536/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.75.down_proj:  12%|█▏        | 4537/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.76.gate_proj:  12%|█▏        | 4538/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.76.up_proj:  12%|█▏        | 4539/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.76.down_proj:  12%|█▏        | 4540/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.77.gate_proj:  12%|█▏        | 4541/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.77.up_proj:  12%|█▏        | 4542/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.77.down_proj:  12%|█▏        | 4543/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.78.gate_proj:  12%|█▏        | 4544/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.78.up_proj:  12%|█▏        | 4545/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.78.down_proj:  12%|█▏        | 4546/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.79.gate_proj:  12%|█▏        | 4547/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.79.up_proj:  12%|█▏        | 4548/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.79.down_proj:  12%|█▏        | 4549/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.80.gate_proj:  12%|█▏        | 4550/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.80.up_proj:  12%|█▏        | 4551/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.80.down_proj:  12%|█▏        | 4552/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.81.gate_proj:  12%|█▏        | 4553/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.81.up_proj:  12%|█▏        | 4554/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.81.down_proj:  12%|█▏        | 4555/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.82.gate_proj:  12%|█▏        | 4556/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.82.up_proj:  12%|█▏        | 4557/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.82.down_proj:  12%|█▏        | 4558/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.83.gate_proj:  12%|█▏        | 4559/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.83.up_proj:  12%|█▏        | 4560/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.83.down_proj:  12%|█▏        | 4561/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.84.gate_proj:  12%|█▏        | 4562/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.84.up_proj:  12%|█▏        | 4563/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.84.down_proj:  12%|█▏        | 4564/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.85.gate_proj:  12%|█▏        | 4565/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.85.up_proj:  12%|█▏        | 4566/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.85.down_proj:  12%|█▏        | 4567/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.86.gate_proj:  12%|█▏        | 4568/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.86.up_proj:  12%|█▏        | 4569/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.86.down_proj:  12%|█▏        | 4570/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.87.gate_proj:  13%|█▎        | 4571/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.87.up_proj:  13%|█▎        | 4572/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.87.down_proj:  13%|█▎        | 4573/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.88.gate_proj:  13%|█▎        | 4574/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.88.up_proj:  13%|█▎        | 4575/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.88.down_proj:  13%|█▎        | 4576/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.89.gate_proj:  13%|█▎        | 4577/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.89.up_proj:  13%|█▎        | 4578/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.89.down_proj:  13%|█▎        | 4579/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.90.gate_proj:  13%|█▎        | 4580/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.90.up_proj:  13%|█▎        | 4581/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.90.down_proj:  13%|█▎        | 4582/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.91.gate_proj:  13%|█▎        | 4583/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.91.up_proj:  13%|█▎        | 4584/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.91.down_proj:  13%|█▎        | 4585/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.92.gate_proj:  13%|█▎        | 4586/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.92.up_proj:  13%|█▎        | 4587/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.92.down_proj:  13%|█▎        | 4588/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.93.gate_proj:  13%|█▎        | 4589/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.93.up_proj:  13%|█▎        | 4590/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.93.down_proj:  13%|█▎        | 4591/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.94.gate_proj:  13%|█▎        | 4592/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.94.up_proj:  13%|█▎        | 4593/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.94.down_proj:  13%|█▎        | 4594/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.95.gate_proj:  13%|█▎        | 4595/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.95.up_proj:  13%|█▎        | 4596/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.95.down_proj:  13%|█▎        | 4597/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.96.gate_proj:  13%|█▎        | 4598/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.96.up_proj:  13%|█▎        | 4599/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.96.down_proj:  13%|█▎        | 4600/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.97.gate_proj:  13%|█▎        | 4601/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.97.up_proj:  13%|█▎        | 4602/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.97.down_proj:  13%|█▎        | 4603/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.98.gate_proj:  13%|█▎        | 4604/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.98.up_proj:  13%|█▎        | 4605/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.98.down_proj:  13%|█▎        | 4606/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.99.gate_proj:  13%|█▎        | 4607/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.99.up_proj:  13%|█▎        | 4608/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.99.down_proj:  13%|█▎        | 4609/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.100.gate_proj:  13%|█▎        | 4610/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.100.up_proj:  13%|█▎        | 4611/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.100.down_proj:  13%|█▎        | 4612/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.101.gate_proj:  13%|█▎        | 4613/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.101.up_proj:  13%|█▎        | 4614/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.101.down_proj:  13%|█▎        | 4615/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.102.gate_proj:  13%|█▎        | 4616/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.102.up_proj:  13%|█▎        | 4617/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.102.down_proj:  13%|█▎        | 4618/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.103.gate_proj:  13%|█▎        | 4619/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.103.up_proj:  13%|█▎        | 4620/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.103.down_proj:  13%|█▎        | 4621/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.104.gate_proj:  13%|█▎        | 4622/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.104.up_proj:  13%|█▎        | 4623/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.104.down_proj:  13%|█▎        | 4624/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.105.gate_proj:  13%|█▎        | 4625/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.105.up_proj:  13%|█▎        | 4626/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.105.down_proj:  13%|█▎        | 4627/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.106.gate_proj:  13%|█▎        | 4628/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.106.up_proj:  13%|█▎        | 4629/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.106.down_proj:  13%|█▎        | 4630/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.107.gate_proj:  13%|█▎        | 4631/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.107.up_proj:  13%|█▎        | 4632/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.107.down_proj:  13%|█▎        | 4633/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.108.gate_proj:  13%|█▎        | 4634/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.108.up_proj:  13%|█▎        | 4635/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.108.down_proj:  13%|█▎        | 4636/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.109.gate_proj:  13%|█▎        | 4637/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.109.up_proj:  13%|█▎        | 4638/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.109.down_proj:  13%|█▎        | 4639/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.110.gate_proj:  13%|█▎        | 4640/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.110.up_proj:  13%|█▎        | 4641/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.110.down_proj:  13%|█▎        | 4642/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.111.gate_proj:  13%|█▎        | 4643/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.111.up_proj:  13%|█▎        | 4644/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.111.down_proj:  13%|█▎        | 4645/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.112.gate_proj:  13%|█▎        | 4646/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.112.up_proj:  13%|█▎        | 4647/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.112.down_proj:  13%|█▎        | 4648/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.113.gate_proj:  13%|█▎        | 4649/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.113.up_proj:  13%|█▎        | 4650/36566 [00:05<00:27, 1156.92it/s]  
packing model.layers.10.mlp.experts.113.down_proj:  13%|█▎        | 4651/36566 [00:05<00:27, 1156.92it/s]
packing model.layers.10.mlp.experts.113.down_proj:  13%|█▎        | 4652/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.114.gate_proj:  13%|█▎        | 4652/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.114.up_proj:  13%|█▎        | 4653/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.114.down_proj:  13%|█▎        | 4654/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.115.gate_proj:  13%|█▎        | 4655/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.115.up_proj:  13%|█▎        | 4656/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.115.down_proj:  13%|█▎        | 4657/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.116.gate_proj:  13%|█▎        | 4658/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.116.up_proj:  13%|█▎        | 4659/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.116.down_proj:  13%|█▎        | 4660/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.117.gate_proj:  13%|█▎        | 4661/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.117.up_proj:  13%|█▎        | 4662/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.117.down_proj:  13%|█▎        | 4663/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.118.gate_proj:  13%|█▎        | 4664/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.118.up_proj:  13%|█▎        | 4665/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.118.down_proj:  13%|█▎        | 4666/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.119.gate_proj:  13%|█▎        | 4667/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.119.up_proj:  13%|█▎        | 4668/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.119.down_proj:  13%|█▎        | 4669/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.120.gate_proj:  13%|█▎        | 4670/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.120.up_proj:  13%|█▎        | 4671/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.120.down_proj:  13%|█▎        | 4672/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.121.gate_proj:  13%|█▎        | 4673/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.121.up_proj:  13%|█▎        | 4674/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.121.down_proj:  13%|█▎        | 4675/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.122.gate_proj:  13%|█▎        | 4676/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.122.up_proj:  13%|█▎        | 4677/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.122.down_proj:  13%|█▎        | 4678/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.123.gate_proj:  13%|█▎        | 4679/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.123.up_proj:  13%|█▎        | 4680/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.123.down_proj:  13%|█▎        | 4681/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.124.gate_proj:  13%|█▎        | 4682/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.124.up_proj:  13%|█▎        | 4683/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.124.down_proj:  13%|█▎        | 4684/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.125.gate_proj:  13%|█▎        | 4685/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.125.up_proj:  13%|█▎        | 4686/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.125.down_proj:  13%|█▎        | 4687/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.126.gate_proj:  13%|█▎        | 4688/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.126.up_proj:  13%|█▎        | 4689/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.126.down_proj:  13%|█▎        | 4690/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.127.gate_proj:  13%|█▎        | 4691/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.10.mlp.experts.127.up_proj:  13%|█▎        | 4692/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.10.mlp.experts.127.down_proj:  13%|█▎        | 4693/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.0.gate_proj:  13%|█▎        | 4694/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.0.up_proj:  13%|█▎        | 4695/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.0.down_proj:  13%|█▎        | 4696/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.1.gate_proj:  13%|█▎        | 4697/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.1.up_proj:  13%|█▎        | 4698/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.1.down_proj:  13%|█▎        | 4699/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.2.gate_proj:  13%|█▎        | 4700/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.2.up_proj:  13%|█▎        | 4701/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.2.down_proj:  13%|█▎        | 4702/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.3.gate_proj:  13%|█▎        | 4703/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.3.up_proj:  13%|█▎        | 4704/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.3.down_proj:  13%|█▎        | 4705/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.4.gate_proj:  13%|█▎        | 4706/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.4.up_proj:  13%|█▎        | 4707/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.4.down_proj:  13%|█▎        | 4708/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.5.gate_proj:  13%|█▎        | 4709/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.5.up_proj:  13%|█▎        | 4710/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.5.down_proj:  13%|█▎        | 4711/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.6.gate_proj:  13%|█▎        | 4712/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.6.up_proj:  13%|█▎        | 4713/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.6.down_proj:  13%|█▎        | 4714/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.7.gate_proj:  13%|█▎        | 4715/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.7.up_proj:  13%|█▎        | 4716/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.7.down_proj:  13%|█▎        | 4717/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.8.gate_proj:  13%|█▎        | 4718/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.8.up_proj:  13%|█▎        | 4719/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.8.down_proj:  13%|█▎        | 4720/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.9.gate_proj:  13%|█▎        | 4721/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.9.up_proj:  13%|█▎        | 4722/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.9.down_proj:  13%|█▎        | 4723/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.10.gate_proj:  13%|█▎        | 4724/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.10.up_proj:  13%|█▎        | 4725/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.10.down_proj:  13%|█▎        | 4726/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.11.gate_proj:  13%|█▎        | 4727/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.11.up_proj:  13%|█▎        | 4728/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.11.down_proj:  13%|█▎        | 4729/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.12.gate_proj:  13%|█▎        | 4730/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.12.up_proj:  13%|█▎        | 4731/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.12.down_proj:  13%|█▎        | 4732/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.13.gate_proj:  13%|█▎        | 4733/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.13.up_proj:  13%|█▎        | 4734/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.13.down_proj:  13%|█▎        | 4735/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.14.gate_proj:  13%|█▎        | 4736/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.14.up_proj:  13%|█▎        | 4737/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.14.down_proj:  13%|█▎        | 4738/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.15.gate_proj:  13%|█▎        | 4739/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.15.up_proj:  13%|█▎        | 4740/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.15.down_proj:  13%|█▎        | 4741/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.16.gate_proj:  13%|█▎        | 4742/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.16.up_proj:  13%|█▎        | 4743/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.16.down_proj:  13%|█▎        | 4744/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.17.gate_proj:  13%|█▎        | 4745/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.17.up_proj:  13%|█▎        | 4746/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.17.down_proj:  13%|█▎        | 4747/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.18.gate_proj:  13%|█▎        | 4748/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.18.up_proj:  13%|█▎        | 4749/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.18.down_proj:  13%|█▎        | 4750/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.19.gate_proj:  13%|█▎        | 4751/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.19.up_proj:  13%|█▎        | 4752/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.19.down_proj:  13%|█▎        | 4753/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.20.gate_proj:  13%|█▎        | 4754/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.20.up_proj:  13%|█▎        | 4755/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.20.down_proj:  13%|█▎        | 4756/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.21.gate_proj:  13%|█▎        | 4757/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.21.up_proj:  13%|█▎        | 4758/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.21.down_proj:  13%|█▎        | 4759/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.22.gate_proj:  13%|█▎        | 4760/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.22.up_proj:  13%|█▎        | 4761/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.22.down_proj:  13%|█▎        | 4762/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.23.gate_proj:  13%|█▎        | 4763/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.23.up_proj:  13%|█▎        | 4764/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.23.down_proj:  13%|█▎        | 4765/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.24.gate_proj:  13%|█▎        | 4766/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.24.up_proj:  13%|█▎        | 4767/36566 [00:05<00:27, 1157.82it/s]  
packing model.layers.11.mlp.experts.24.down_proj:  13%|█▎        | 4768/36566 [00:05<00:27, 1157.82it/s]
packing model.layers.11.mlp.experts.24.down_proj:  13%|█▎        | 4769/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.25.gate_proj:  13%|█▎        | 4769/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.25.up_proj:  13%|█▎        | 4770/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.25.down_proj:  13%|█▎        | 4771/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.26.gate_proj:  13%|█▎        | 4772/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.26.up_proj:  13%|█▎        | 4773/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.26.down_proj:  13%|█▎        | 4774/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.27.gate_proj:  13%|█▎        | 4775/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.27.up_proj:  13%|█▎        | 4776/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.27.down_proj:  13%|█▎        | 4777/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.28.gate_proj:  13%|█▎        | 4778/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.28.up_proj:  13%|█▎        | 4779/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.28.down_proj:  13%|█▎        | 4780/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.29.gate_proj:  13%|█▎        | 4781/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.29.up_proj:  13%|█▎        | 4782/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.29.down_proj:  13%|█▎        | 4783/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.30.gate_proj:  13%|█▎        | 4784/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.30.up_proj:  13%|█▎        | 4785/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.30.down_proj:  13%|█▎        | 4786/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.31.gate_proj:  13%|█▎        | 4787/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.31.up_proj:  13%|█▎        | 4788/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.31.down_proj:  13%|█▎        | 4789/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.32.gate_proj:  13%|█▎        | 4790/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.32.up_proj:  13%|█▎        | 4791/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.32.down_proj:  13%|█▎        | 4792/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.33.gate_proj:  13%|█▎        | 4793/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.33.up_proj:  13%|█▎        | 4794/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.33.down_proj:  13%|█▎        | 4795/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.34.gate_proj:  13%|█▎        | 4796/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.34.up_proj:  13%|█▎        | 4797/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.34.down_proj:  13%|█▎        | 4798/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.35.gate_proj:  13%|█▎        | 4799/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.35.up_proj:  13%|█▎        | 4800/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.35.down_proj:  13%|█▎        | 4801/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.36.gate_proj:  13%|█▎        | 4802/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.36.up_proj:  13%|█▎        | 4803/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.36.down_proj:  13%|█▎        | 4804/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.37.gate_proj:  13%|█▎        | 4805/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.37.up_proj:  13%|█▎        | 4806/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.37.down_proj:  13%|█▎        | 4807/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.38.gate_proj:  13%|█▎        | 4808/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.38.up_proj:  13%|█▎        | 4809/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.38.down_proj:  13%|█▎        | 4810/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.39.gate_proj:  13%|█▎        | 4811/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.39.up_proj:  13%|█▎        | 4812/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.39.down_proj:  13%|█▎        | 4813/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.40.gate_proj:  13%|█▎        | 4814/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.40.up_proj:  13%|█▎        | 4815/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.40.down_proj:  13%|█▎        | 4816/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.41.gate_proj:  13%|█▎        | 4817/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.41.up_proj:  13%|█▎        | 4818/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.41.down_proj:  13%|█▎        | 4819/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.42.gate_proj:  13%|█▎        | 4820/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.42.up_proj:  13%|█▎        | 4821/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.42.down_proj:  13%|█▎        | 4822/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.43.gate_proj:  13%|█▎        | 4823/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.43.up_proj:  13%|█▎        | 4824/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.43.down_proj:  13%|█▎        | 4825/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.44.gate_proj:  13%|█▎        | 4826/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.44.up_proj:  13%|█▎        | 4827/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.44.down_proj:  13%|█▎        | 4828/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.45.gate_proj:  13%|█▎        | 4829/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.45.up_proj:  13%|█▎        | 4830/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.45.down_proj:  13%|█▎        | 4831/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.46.gate_proj:  13%|█▎        | 4832/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.46.up_proj:  13%|█▎        | 4833/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.46.down_proj:  13%|█▎        | 4834/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.47.gate_proj:  13%|█▎        | 4835/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.47.up_proj:  13%|█▎        | 4836/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.47.down_proj:  13%|█▎        | 4837/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.48.gate_proj:  13%|█▎        | 4838/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.48.up_proj:  13%|█▎        | 4839/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.48.down_proj:  13%|█▎        | 4840/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.49.gate_proj:  13%|█▎        | 4841/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.49.up_proj:  13%|█▎        | 4842/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.49.down_proj:  13%|█▎        | 4843/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.50.gate_proj:  13%|█▎        | 4844/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.50.up_proj:  13%|█▎        | 4845/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.50.down_proj:  13%|█▎        | 4846/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.51.gate_proj:  13%|█▎        | 4847/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.51.up_proj:  13%|█▎        | 4848/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.51.down_proj:  13%|█▎        | 4849/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.52.gate_proj:  13%|█▎        | 4850/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.52.up_proj:  13%|█▎        | 4851/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.52.down_proj:  13%|█▎        | 4852/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.53.gate_proj:  13%|█▎        | 4853/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.53.up_proj:  13%|█▎        | 4854/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.53.down_proj:  13%|█▎        | 4855/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.54.gate_proj:  13%|█▎        | 4856/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.54.up_proj:  13%|█▎        | 4857/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.54.down_proj:  13%|█▎        | 4858/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.55.gate_proj:  13%|█▎        | 4859/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.55.up_proj:  13%|█▎        | 4860/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.55.down_proj:  13%|█▎        | 4861/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.56.gate_proj:  13%|█▎        | 4862/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.56.up_proj:  13%|█▎        | 4863/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.56.down_proj:  13%|█▎        | 4864/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.57.gate_proj:  13%|█▎        | 4865/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.57.up_proj:  13%|█▎        | 4866/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.57.down_proj:  13%|█▎        | 4867/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.58.gate_proj:  13%|█▎        | 4868/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.58.up_proj:  13%|█▎        | 4869/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.58.down_proj:  13%|█▎        | 4870/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.59.gate_proj:  13%|█▎        | 4871/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.59.up_proj:  13%|█▎        | 4872/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.59.down_proj:  13%|█▎        | 4873/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.60.gate_proj:  13%|█▎        | 4874/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.60.up_proj:  13%|█▎        | 4875/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.60.down_proj:  13%|█▎        | 4876/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.61.gate_proj:  13%|█▎        | 4877/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.61.up_proj:  13%|█▎        | 4878/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.61.down_proj:  13%|█▎        | 4879/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.62.gate_proj:  13%|█▎        | 4880/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.62.up_proj:  13%|█▎        | 4881/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.62.down_proj:  13%|█▎        | 4882/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.63.gate_proj:  13%|█▎        | 4883/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.63.up_proj:  13%|█▎        | 4884/36566 [00:05<00:27, 1160.34it/s]  
packing model.layers.11.mlp.experts.63.down_proj:  13%|█▎        | 4885/36566 [00:05<00:27, 1160.34it/s]
packing model.layers.11.mlp.experts.63.down_proj:  13%|█▎        | 4886/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.64.gate_proj:  13%|█▎        | 4886/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.64.up_proj:  13%|█▎        | 4887/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.64.down_proj:  13%|█▎        | 4888/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.65.gate_proj:  13%|█▎        | 4889/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.65.up_proj:  13%|█▎        | 4890/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.65.down_proj:  13%|█▎        | 4891/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.66.gate_proj:  13%|█▎        | 4892/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.66.up_proj:  13%|█▎        | 4893/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.66.down_proj:  13%|█▎        | 4894/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.67.gate_proj:  13%|█▎        | 4895/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.67.up_proj:  13%|█▎        | 4896/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.67.down_proj:  13%|█▎        | 4897/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.68.gate_proj:  13%|█▎        | 4898/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.68.up_proj:  13%|█▎        | 4899/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.68.down_proj:  13%|█▎        | 4900/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.69.gate_proj:  13%|█▎        | 4901/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.69.up_proj:  13%|█▎        | 4902/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.69.down_proj:  13%|█▎        | 4903/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.70.gate_proj:  13%|█▎        | 4904/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.70.up_proj:  13%|█▎        | 4905/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.70.down_proj:  13%|█▎        | 4906/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.71.gate_proj:  13%|█▎        | 4907/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.71.up_proj:  13%|█▎        | 4908/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.71.down_proj:  13%|█▎        | 4909/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.72.gate_proj:  13%|█▎        | 4910/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.72.up_proj:  13%|█▎        | 4911/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.72.down_proj:  13%|█▎        | 4912/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.73.gate_proj:  13%|█▎        | 4913/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.73.up_proj:  13%|█▎        | 4914/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.73.down_proj:  13%|█▎        | 4915/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.74.gate_proj:  13%|█▎        | 4916/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.74.up_proj:  13%|█▎        | 4917/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.74.down_proj:  13%|█▎        | 4918/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.75.gate_proj:  13%|█▎        | 4919/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.75.up_proj:  13%|█▎        | 4920/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.75.down_proj:  13%|█▎        | 4921/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.76.gate_proj:  13%|█▎        | 4922/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.76.up_proj:  13%|█▎        | 4923/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.76.down_proj:  13%|█▎        | 4924/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.77.gate_proj:  13%|█▎        | 4925/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.77.up_proj:  13%|█▎        | 4926/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.77.down_proj:  13%|█▎        | 4927/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.78.gate_proj:  13%|█▎        | 4928/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.78.up_proj:  13%|█▎        | 4929/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.78.down_proj:  13%|█▎        | 4930/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.79.gate_proj:  13%|█▎        | 4931/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.79.up_proj:  13%|█▎        | 4932/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.79.down_proj:  13%|█▎        | 4933/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.80.gate_proj:  13%|█▎        | 4934/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.80.up_proj:  13%|█▎        | 4935/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.80.down_proj:  13%|█▎        | 4936/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.81.gate_proj:  14%|█▎        | 4937/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.81.up_proj:  14%|█▎        | 4938/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.81.down_proj:  14%|█▎        | 4939/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.82.gate_proj:  14%|█▎        | 4940/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.82.up_proj:  14%|█▎        | 4941/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.82.down_proj:  14%|█▎        | 4942/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.83.gate_proj:  14%|█▎        | 4943/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.83.up_proj:  14%|█▎        | 4944/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.83.down_proj:  14%|█▎        | 4945/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.84.gate_proj:  14%|█▎        | 4946/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.84.up_proj:  14%|█▎        | 4947/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.84.down_proj:  14%|█▎        | 4948/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.85.gate_proj:  14%|█▎        | 4949/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.85.up_proj:  14%|█▎        | 4950/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.85.down_proj:  14%|█▎        | 4951/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.86.gate_proj:  14%|█▎        | 4952/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.86.up_proj:  14%|█▎        | 4953/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.86.down_proj:  14%|█▎        | 4954/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.87.gate_proj:  14%|█▎        | 4955/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.87.up_proj:  14%|█▎        | 4956/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.87.down_proj:  14%|█▎        | 4957/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.88.gate_proj:  14%|█▎        | 4958/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.88.up_proj:  14%|█▎        | 4959/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.88.down_proj:  14%|█▎        | 4960/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.89.gate_proj:  14%|█▎        | 4961/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.89.up_proj:  14%|█▎        | 4962/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.89.down_proj:  14%|█▎        | 4963/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.90.gate_proj:  14%|█▎        | 4964/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.90.up_proj:  14%|█▎        | 4965/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.90.down_proj:  14%|█▎        | 4966/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.91.gate_proj:  14%|█▎        | 4967/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.91.up_proj:  14%|█▎        | 4968/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.91.down_proj:  14%|█▎        | 4969/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.92.gate_proj:  14%|█▎        | 4970/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.92.up_proj:  14%|█▎        | 4971/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.92.down_proj:  14%|█▎        | 4972/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.93.gate_proj:  14%|█▎        | 4973/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.93.up_proj:  14%|█▎        | 4974/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.93.down_proj:  14%|█▎        | 4975/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.94.gate_proj:  14%|█▎        | 4976/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.94.up_proj:  14%|█▎        | 4977/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.94.down_proj:  14%|█▎        | 4978/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.95.gate_proj:  14%|█▎        | 4979/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.95.up_proj:  14%|█▎        | 4980/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.95.down_proj:  14%|█▎        | 4981/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.96.gate_proj:  14%|█▎        | 4982/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.96.up_proj:  14%|█▎        | 4983/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.96.down_proj:  14%|█▎        | 4984/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.97.gate_proj:  14%|█▎        | 4985/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.97.up_proj:  14%|█▎        | 4986/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.97.down_proj:  14%|█▎        | 4987/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.98.gate_proj:  14%|█▎        | 4988/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.98.up_proj:  14%|█▎        | 4989/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.98.down_proj:  14%|█▎        | 4990/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.99.gate_proj:  14%|█▎        | 4991/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.99.up_proj:  14%|█▎        | 4992/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.99.down_proj:  14%|█▎        | 4993/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.100.gate_proj:  14%|█▎        | 4994/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.100.up_proj:  14%|█▎        | 4995/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.100.down_proj:  14%|█▎        | 4996/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.101.gate_proj:  14%|█▎        | 4997/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.101.up_proj:  14%|█▎        | 4998/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.101.down_proj:  14%|█▎        | 4999/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.102.gate_proj:  14%|█▎        | 5000/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.102.up_proj:  14%|█▎        | 5001/36566 [00:05<00:27, 1162.35it/s]  
packing model.layers.11.mlp.experts.102.down_proj:  14%|█▎        | 5002/36566 [00:05<00:27, 1162.35it/s]
packing model.layers.11.mlp.experts.102.down_proj:  14%|█▎        | 5003/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.103.gate_proj:  14%|█▎        | 5003/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.103.up_proj:  14%|█▎        | 5004/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.103.down_proj:  14%|█▎        | 5005/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.104.gate_proj:  14%|█▎        | 5006/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.104.up_proj:  14%|█▎        | 5007/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.104.down_proj:  14%|█▎        | 5008/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.105.gate_proj:  14%|█▎        | 5009/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.105.up_proj:  14%|█▎        | 5010/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.105.down_proj:  14%|█▎        | 5011/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.106.gate_proj:  14%|█▎        | 5012/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.106.up_proj:  14%|█▎        | 5013/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.106.down_proj:  14%|█▎        | 5014/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.107.gate_proj:  14%|█▎        | 5015/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.107.up_proj:  14%|█▎        | 5016/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.107.down_proj:  14%|█▎        | 5017/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.108.gate_proj:  14%|█▎        | 5018/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.108.up_proj:  14%|█▎        | 5019/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.108.down_proj:  14%|█▎        | 5020/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.109.gate_proj:  14%|█▎        | 5021/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.109.up_proj:  14%|█▎        | 5022/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.109.down_proj:  14%|█▎        | 5023/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.110.gate_proj:  14%|█▎        | 5024/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.110.up_proj:  14%|█▎        | 5025/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.110.down_proj:  14%|█▎        | 5026/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.111.gate_proj:  14%|█▎        | 5027/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.111.up_proj:  14%|█▍        | 5028/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.111.down_proj:  14%|█▍        | 5029/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.112.gate_proj:  14%|█▍        | 5030/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.112.up_proj:  14%|█▍        | 5031/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.112.down_proj:  14%|█▍        | 5032/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.113.gate_proj:  14%|█▍        | 5033/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.113.up_proj:  14%|█▍        | 5034/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.113.down_proj:  14%|█▍        | 5035/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.114.gate_proj:  14%|█▍        | 5036/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.114.up_proj:  14%|█▍        | 5037/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.114.down_proj:  14%|█▍        | 5038/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.115.gate_proj:  14%|█▍        | 5039/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.115.up_proj:  14%|█▍        | 5040/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.115.down_proj:  14%|█▍        | 5041/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.116.gate_proj:  14%|█▍        | 5042/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.116.up_proj:  14%|█▍        | 5043/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.116.down_proj:  14%|█▍        | 5044/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.117.gate_proj:  14%|█▍        | 5045/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.117.up_proj:  14%|█▍        | 5046/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.117.down_proj:  14%|█▍        | 5047/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.118.gate_proj:  14%|█▍        | 5048/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.118.up_proj:  14%|█▍        | 5049/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.118.down_proj:  14%|█▍        | 5050/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.119.gate_proj:  14%|█▍        | 5051/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.119.up_proj:  14%|█▍        | 5052/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.119.down_proj:  14%|█▍        | 5053/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.120.gate_proj:  14%|█▍        | 5054/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.120.up_proj:  14%|█▍        | 5055/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.120.down_proj:  14%|█▍        | 5056/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.121.gate_proj:  14%|█▍        | 5057/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.121.up_proj:  14%|█▍        | 5058/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.121.down_proj:  14%|█▍        | 5059/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.122.gate_proj:  14%|█▍        | 5060/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.122.up_proj:  14%|█▍        | 5061/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.122.down_proj:  14%|█▍        | 5062/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.123.gate_proj:  14%|█▍        | 5063/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.123.up_proj:  14%|█▍        | 5064/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.123.down_proj:  14%|█▍        | 5065/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.124.gate_proj:  14%|█▍        | 5066/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.124.up_proj:  14%|█▍        | 5067/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.124.down_proj:  14%|█▍        | 5068/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.125.gate_proj:  14%|█▍        | 5069/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.125.up_proj:  14%|█▍        | 5070/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.125.down_proj:  14%|█▍        | 5071/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.126.gate_proj:  14%|█▍        | 5072/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.126.up_proj:  14%|█▍        | 5073/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.126.down_proj:  14%|█▍        | 5074/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.127.gate_proj:  14%|█▍        | 5075/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.11.mlp.experts.127.up_proj:  14%|█▍        | 5076/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.11.mlp.experts.127.down_proj:  14%|█▍        | 5077/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.0.gate_proj:  14%|█▍        | 5078/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.0.up_proj:  14%|█▍        | 5079/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.0.down_proj:  14%|█▍        | 5080/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.1.gate_proj:  14%|█▍        | 5081/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.1.up_proj:  14%|█▍        | 5082/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.1.down_proj:  14%|█▍        | 5083/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.2.gate_proj:  14%|█▍        | 5084/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.2.up_proj:  14%|█▍        | 5085/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.2.down_proj:  14%|█▍        | 5086/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.3.gate_proj:  14%|█▍        | 5087/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.3.up_proj:  14%|█▍        | 5088/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.3.down_proj:  14%|█▍        | 5089/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.4.gate_proj:  14%|█▍        | 5090/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.4.up_proj:  14%|█▍        | 5091/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.4.down_proj:  14%|█▍        | 5092/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.5.gate_proj:  14%|█▍        | 5093/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.5.up_proj:  14%|█▍        | 5094/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.5.down_proj:  14%|█▍        | 5095/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.6.gate_proj:  14%|█▍        | 5096/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.6.up_proj:  14%|█▍        | 5097/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.6.down_proj:  14%|█▍        | 5098/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.7.gate_proj:  14%|█▍        | 5099/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.7.up_proj:  14%|█▍        | 5100/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.7.down_proj:  14%|█▍        | 5101/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.8.gate_proj:  14%|█▍        | 5102/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.8.up_proj:  14%|█▍        | 5103/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.8.down_proj:  14%|█▍        | 5104/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.9.gate_proj:  14%|█▍        | 5105/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.9.up_proj:  14%|█▍        | 5106/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.9.down_proj:  14%|█▍        | 5107/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.10.gate_proj:  14%|█▍        | 5108/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.10.up_proj:  14%|█▍        | 5109/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.10.down_proj:  14%|█▍        | 5110/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.11.gate_proj:  14%|█▍        | 5111/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.11.up_proj:  14%|█▍        | 5112/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.11.down_proj:  14%|█▍        | 5113/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.12.gate_proj:  14%|█▍        | 5114/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.12.up_proj:  14%|█▍        | 5115/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.12.down_proj:  14%|█▍        | 5116/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.13.gate_proj:  14%|█▍        | 5117/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.13.up_proj:  14%|█▍        | 5118/36566 [00:05<00:27, 1163.53it/s]  
packing model.layers.12.mlp.experts.13.down_proj:  14%|█▍        | 5119/36566 [00:05<00:27, 1163.53it/s]
packing model.layers.12.mlp.experts.13.down_proj:  14%|█▍        | 5120/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.14.gate_proj:  14%|█▍        | 5120/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.14.up_proj:  14%|█▍        | 5121/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.14.down_proj:  14%|█▍        | 5122/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.15.gate_proj:  14%|█▍        | 5123/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.15.up_proj:  14%|█▍        | 5124/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.15.down_proj:  14%|█▍        | 5125/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.16.gate_proj:  14%|█▍        | 5126/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.16.up_proj:  14%|█▍        | 5127/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.16.down_proj:  14%|█▍        | 5128/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.17.gate_proj:  14%|█▍        | 5129/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.17.up_proj:  14%|█▍        | 5130/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.17.down_proj:  14%|█▍        | 5131/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.18.gate_proj:  14%|█▍        | 5132/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.18.up_proj:  14%|█▍        | 5133/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.18.down_proj:  14%|█▍        | 5134/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.19.gate_proj:  14%|█▍        | 5135/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.19.up_proj:  14%|█▍        | 5136/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.19.down_proj:  14%|█▍        | 5137/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.20.gate_proj:  14%|█▍        | 5138/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.20.up_proj:  14%|█▍        | 5139/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.20.down_proj:  14%|█▍        | 5140/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.21.gate_proj:  14%|█▍        | 5141/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.21.up_proj:  14%|█▍        | 5142/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.21.down_proj:  14%|█▍        | 5143/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.22.gate_proj:  14%|█▍        | 5144/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.22.up_proj:  14%|█▍        | 5145/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.22.down_proj:  14%|█▍        | 5146/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.23.gate_proj:  14%|█▍        | 5147/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.23.up_proj:  14%|█▍        | 5148/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.23.down_proj:  14%|█▍        | 5149/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.24.gate_proj:  14%|█▍        | 5150/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.24.up_proj:  14%|█▍        | 5151/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.24.down_proj:  14%|█▍        | 5152/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.25.gate_proj:  14%|█▍        | 5153/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.25.up_proj:  14%|█▍        | 5154/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.25.down_proj:  14%|█▍        | 5155/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.26.gate_proj:  14%|█▍        | 5156/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.26.up_proj:  14%|█▍        | 5157/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.26.down_proj:  14%|█▍        | 5158/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.27.gate_proj:  14%|█▍        | 5159/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.27.up_proj:  14%|█▍        | 5160/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.27.down_proj:  14%|█▍        | 5161/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.28.gate_proj:  14%|█▍        | 5162/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.28.up_proj:  14%|█▍        | 5163/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.28.down_proj:  14%|█▍        | 5164/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.29.gate_proj:  14%|█▍        | 5165/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.29.up_proj:  14%|█▍        | 5166/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.29.down_proj:  14%|█▍        | 5167/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.30.gate_proj:  14%|█▍        | 5168/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.30.up_proj:  14%|█▍        | 5169/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.30.down_proj:  14%|█▍        | 5170/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.31.gate_proj:  14%|█▍        | 5171/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.31.up_proj:  14%|█▍        | 5172/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.31.down_proj:  14%|█▍        | 5173/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.32.gate_proj:  14%|█▍        | 5174/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.32.up_proj:  14%|█▍        | 5175/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.32.down_proj:  14%|█▍        | 5176/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.33.gate_proj:  14%|█▍        | 5177/36566 [00:05<00:27, 1162.51it/s]
packing model.layers.12.mlp.experts.33.up_proj:  14%|█▍        | 5178/36566 [00:05<00:27, 1162.51it/s]  
packing model.layers.12.mlp.experts.33.down_proj:  14%|█▍        | 5179/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.34.gate_proj:  14%|█▍        | 5180/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.34.up_proj:  14%|█▍        | 5181/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.34.down_proj:  14%|█▍        | 5182/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.35.gate_proj:  14%|█▍        | 5183/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.35.up_proj:  14%|█▍        | 5184/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.35.down_proj:  14%|█▍        | 5185/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.36.gate_proj:  14%|█▍        | 5186/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.36.up_proj:  14%|█▍        | 5187/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.36.down_proj:  14%|█▍        | 5188/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.37.gate_proj:  14%|█▍        | 5189/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.37.up_proj:  14%|█▍        | 5190/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.37.down_proj:  14%|█▍        | 5191/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.38.gate_proj:  14%|█▍        | 5192/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.38.up_proj:  14%|█▍        | 5193/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.38.down_proj:  14%|█▍        | 5194/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.39.gate_proj:  14%|█▍        | 5195/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.39.up_proj:  14%|█▍        | 5196/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.39.down_proj:  14%|█▍        | 5197/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.40.gate_proj:  14%|█▍        | 5198/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.40.up_proj:  14%|█▍        | 5199/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.40.down_proj:  14%|█▍        | 5200/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.41.gate_proj:  14%|█▍        | 5201/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.41.up_proj:  14%|█▍        | 5202/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.41.down_proj:  14%|█▍        | 5203/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.42.gate_proj:  14%|█▍        | 5204/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.42.up_proj:  14%|█▍        | 5205/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.42.down_proj:  14%|█▍        | 5206/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.43.gate_proj:  14%|█▍        | 5207/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.43.up_proj:  14%|█▍        | 5208/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.43.down_proj:  14%|█▍        | 5209/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.44.gate_proj:  14%|█▍        | 5210/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.44.up_proj:  14%|█▍        | 5211/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.44.down_proj:  14%|█▍        | 5212/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.45.gate_proj:  14%|█▍        | 5213/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.45.up_proj:  14%|█▍        | 5214/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.45.down_proj:  14%|█▍        | 5215/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.46.gate_proj:  14%|█▍        | 5216/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.46.up_proj:  14%|█▍        | 5217/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.46.down_proj:  14%|█▍        | 5218/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.47.gate_proj:  14%|█▍        | 5219/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.47.up_proj:  14%|█▍        | 5220/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.47.down_proj:  14%|█▍        | 5221/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.48.gate_proj:  14%|█▍        | 5222/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.48.up_proj:  14%|█▍        | 5223/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.48.down_proj:  14%|█▍        | 5224/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.49.gate_proj:  14%|█▍        | 5225/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.49.up_proj:  14%|█▍        | 5226/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.49.down_proj:  14%|█▍        | 5227/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.50.gate_proj:  14%|█▍        | 5228/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.50.up_proj:  14%|█▍        | 5229/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.50.down_proj:  14%|█▍        | 5230/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.51.gate_proj:  14%|█▍        | 5231/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.51.up_proj:  14%|█▍        | 5232/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.51.down_proj:  14%|█▍        | 5233/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.52.gate_proj:  14%|█▍        | 5234/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.52.up_proj:  14%|█▍        | 5235/36566 [00:05<00:26, 1162.51it/s]  
packing model.layers.12.mlp.experts.52.down_proj:  14%|█▍        | 5236/36566 [00:05<00:26, 1162.51it/s]
packing model.layers.12.mlp.experts.52.down_proj:  14%|█▍        | 5237/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.53.gate_proj:  14%|█▍        | 5237/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.53.up_proj:  14%|█▍        | 5238/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.53.down_proj:  14%|█▍        | 5239/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.54.gate_proj:  14%|█▍        | 5240/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.54.up_proj:  14%|█▍        | 5241/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.54.down_proj:  14%|█▍        | 5242/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.55.gate_proj:  14%|█▍        | 5243/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.55.up_proj:  14%|█▍        | 5244/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.55.down_proj:  14%|█▍        | 5245/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.56.gate_proj:  14%|█▍        | 5246/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.56.up_proj:  14%|█▍        | 5247/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.56.down_proj:  14%|█▍        | 5248/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.57.gate_proj:  14%|█▍        | 5249/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.57.up_proj:  14%|█▍        | 5250/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.57.down_proj:  14%|█▍        | 5251/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.58.gate_proj:  14%|█▍        | 5252/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.58.up_proj:  14%|█▍        | 5253/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.58.down_proj:  14%|█▍        | 5254/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.59.gate_proj:  14%|█▍        | 5255/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.59.up_proj:  14%|█▍        | 5256/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.59.down_proj:  14%|█▍        | 5257/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.60.gate_proj:  14%|█▍        | 5258/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.60.up_proj:  14%|█▍        | 5259/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.60.down_proj:  14%|█▍        | 5260/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.61.gate_proj:  14%|█▍        | 5261/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.61.up_proj:  14%|█▍        | 5262/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.61.down_proj:  14%|█▍        | 5263/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.62.gate_proj:  14%|█▍        | 5264/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.62.up_proj:  14%|█▍        | 5265/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.62.down_proj:  14%|█▍        | 5266/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.63.gate_proj:  14%|█▍        | 5267/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.63.up_proj:  14%|█▍        | 5268/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.63.down_proj:  14%|█▍        | 5269/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.64.gate_proj:  14%|█▍        | 5270/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.64.up_proj:  14%|█▍        | 5271/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.64.down_proj:  14%|█▍        | 5272/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.65.gate_proj:  14%|█▍        | 5273/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.65.up_proj:  14%|█▍        | 5274/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.65.down_proj:  14%|█▍        | 5275/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.66.gate_proj:  14%|█▍        | 5276/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.66.up_proj:  14%|█▍        | 5277/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.66.down_proj:  14%|█▍        | 5278/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.67.gate_proj:  14%|█▍        | 5279/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.67.up_proj:  14%|█▍        | 5280/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.67.down_proj:  14%|█▍        | 5281/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.68.gate_proj:  14%|█▍        | 5282/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.68.up_proj:  14%|█▍        | 5283/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.68.down_proj:  14%|█▍        | 5284/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.69.gate_proj:  14%|█▍        | 5285/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.69.up_proj:  14%|█▍        | 5286/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.69.down_proj:  14%|█▍        | 5287/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.70.gate_proj:  14%|█▍        | 5288/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.70.up_proj:  14%|█▍        | 5289/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.70.down_proj:  14%|█▍        | 5290/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.71.gate_proj:  14%|█▍        | 5291/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.71.up_proj:  14%|█▍        | 5292/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.71.down_proj:  14%|█▍        | 5293/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.72.gate_proj:  14%|█▍        | 5294/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.72.up_proj:  14%|█▍        | 5295/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.72.down_proj:  14%|█▍        | 5296/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.73.gate_proj:  14%|█▍        | 5297/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.73.up_proj:  14%|█▍        | 5298/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.73.down_proj:  14%|█▍        | 5299/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.74.gate_proj:  14%|█▍        | 5300/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.74.up_proj:  14%|█▍        | 5301/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.74.down_proj:  14%|█▍        | 5302/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.75.gate_proj:  15%|█▍        | 5303/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.75.up_proj:  15%|█▍        | 5304/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.75.down_proj:  15%|█▍        | 5305/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.76.gate_proj:  15%|█▍        | 5306/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.76.up_proj:  15%|█▍        | 5307/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.76.down_proj:  15%|█▍        | 5308/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.77.gate_proj:  15%|█▍        | 5309/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.77.up_proj:  15%|█▍        | 5310/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.77.down_proj:  15%|█▍        | 5311/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.78.gate_proj:  15%|█▍        | 5312/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.78.up_proj:  15%|█▍        | 5313/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.78.down_proj:  15%|█▍        | 5314/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.79.gate_proj:  15%|█▍        | 5315/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.79.up_proj:  15%|█▍        | 5316/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.79.down_proj:  15%|█▍        | 5317/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.80.gate_proj:  15%|█▍        | 5318/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.80.up_proj:  15%|█▍        | 5319/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.80.down_proj:  15%|█▍        | 5320/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.81.gate_proj:  15%|█▍        | 5321/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.81.up_proj:  15%|█▍        | 5322/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.81.down_proj:  15%|█▍        | 5323/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.82.gate_proj:  15%|█▍        | 5324/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.82.up_proj:  15%|█▍        | 5325/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.82.down_proj:  15%|█▍        | 5326/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.83.gate_proj:  15%|█▍        | 5327/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.83.up_proj:  15%|█▍        | 5328/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.83.down_proj:  15%|█▍        | 5329/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.84.gate_proj:  15%|█▍        | 5330/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.84.up_proj:  15%|█▍        | 5331/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.84.down_proj:  15%|█▍        | 5332/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.85.gate_proj:  15%|█▍        | 5333/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.85.up_proj:  15%|█▍        | 5334/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.85.down_proj:  15%|█▍        | 5335/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.86.gate_proj:  15%|█▍        | 5336/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.86.up_proj:  15%|█▍        | 5337/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.86.down_proj:  15%|█▍        | 5338/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.87.gate_proj:  15%|█▍        | 5339/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.87.up_proj:  15%|█▍        | 5340/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.87.down_proj:  15%|█▍        | 5341/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.88.gate_proj:  15%|█▍        | 5342/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.88.up_proj:  15%|█▍        | 5343/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.88.down_proj:  15%|█▍        | 5344/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.89.gate_proj:  15%|█▍        | 5345/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.89.up_proj:  15%|█▍        | 5346/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.89.down_proj:  15%|█▍        | 5347/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.90.gate_proj:  15%|█▍        | 5348/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.90.up_proj:  15%|█▍        | 5349/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.90.down_proj:  15%|█▍        | 5350/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.91.gate_proj:  15%|█▍        | 5351/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.91.up_proj:  15%|█▍        | 5352/36566 [00:05<00:26, 1164.46it/s]  
packing model.layers.12.mlp.experts.91.down_proj:  15%|█▍        | 5353/36566 [00:05<00:26, 1164.46it/s]
packing model.layers.12.mlp.experts.91.down_proj:  15%|█▍        | 5354/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.92.gate_proj:  15%|█▍        | 5354/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.92.up_proj:  15%|█▍        | 5355/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.92.down_proj:  15%|█▍        | 5356/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.93.gate_proj:  15%|█▍        | 5357/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.93.up_proj:  15%|█▍        | 5358/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.93.down_proj:  15%|█▍        | 5359/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.94.gate_proj:  15%|█▍        | 5360/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.94.up_proj:  15%|█▍        | 5361/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.94.down_proj:  15%|█▍        | 5362/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.95.gate_proj:  15%|█▍        | 5363/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.95.up_proj:  15%|█▍        | 5364/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.95.down_proj:  15%|█▍        | 5365/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.96.gate_proj:  15%|█▍        | 5366/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.96.up_proj:  15%|█▍        | 5367/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.96.down_proj:  15%|█▍        | 5368/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.97.gate_proj:  15%|█▍        | 5369/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.97.up_proj:  15%|█▍        | 5370/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.97.down_proj:  15%|█▍        | 5371/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.98.gate_proj:  15%|█▍        | 5372/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.98.up_proj:  15%|█▍        | 5373/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.98.down_proj:  15%|█▍        | 5374/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.99.gate_proj:  15%|█▍        | 5375/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.99.up_proj:  15%|█▍        | 5376/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.99.down_proj:  15%|█▍        | 5377/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.100.gate_proj:  15%|█▍        | 5378/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.100.up_proj:  15%|█▍        | 5379/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.100.down_proj:  15%|█▍        | 5380/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.101.gate_proj:  15%|█▍        | 5381/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.101.up_proj:  15%|█▍        | 5382/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.101.down_proj:  15%|█▍        | 5383/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.102.gate_proj:  15%|█▍        | 5384/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.102.up_proj:  15%|█▍        | 5385/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.102.down_proj:  15%|█▍        | 5386/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.103.gate_proj:  15%|█▍        | 5387/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.103.up_proj:  15%|█▍        | 5388/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.103.down_proj:  15%|█▍        | 5389/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.104.gate_proj:  15%|█▍        | 5390/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.104.up_proj:  15%|█▍        | 5391/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.104.down_proj:  15%|█▍        | 5392/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.105.gate_proj:  15%|█▍        | 5393/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.105.up_proj:  15%|█▍        | 5394/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.105.down_proj:  15%|█▍        | 5395/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.106.gate_proj:  15%|█▍        | 5396/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.106.up_proj:  15%|█▍        | 5397/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.106.down_proj:  15%|█▍        | 5398/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.107.gate_proj:  15%|█▍        | 5399/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.107.up_proj:  15%|█▍        | 5400/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.107.down_proj:  15%|█▍        | 5401/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.108.gate_proj:  15%|█▍        | 5402/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.108.up_proj:  15%|█▍        | 5403/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.108.down_proj:  15%|█▍        | 5404/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.109.gate_proj:  15%|█▍        | 5405/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.109.up_proj:  15%|█▍        | 5406/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.109.down_proj:  15%|█▍        | 5407/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.110.gate_proj:  15%|█▍        | 5408/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.110.up_proj:  15%|█▍        | 5409/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.110.down_proj:  15%|█▍        | 5410/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.111.gate_proj:  15%|█▍        | 5411/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.111.up_proj:  15%|█▍        | 5412/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.111.down_proj:  15%|█▍        | 5413/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.112.gate_proj:  15%|█▍        | 5414/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.112.up_proj:  15%|█▍        | 5415/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.112.down_proj:  15%|█▍        | 5416/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.113.gate_proj:  15%|█▍        | 5417/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.113.up_proj:  15%|█▍        | 5418/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.113.down_proj:  15%|█▍        | 5419/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.114.gate_proj:  15%|█▍        | 5420/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.114.up_proj:  15%|█▍        | 5421/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.114.down_proj:  15%|█▍        | 5422/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.115.gate_proj:  15%|█▍        | 5423/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.115.up_proj:  15%|█▍        | 5424/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.115.down_proj:  15%|█▍        | 5425/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.116.gate_proj:  15%|█▍        | 5426/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.116.up_proj:  15%|█▍        | 5427/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.116.down_proj:  15%|█▍        | 5428/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.117.gate_proj:  15%|█▍        | 5429/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.117.up_proj:  15%|█▍        | 5430/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.117.down_proj:  15%|█▍        | 5431/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.118.gate_proj:  15%|█▍        | 5432/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.118.up_proj:  15%|█▍        | 5433/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.118.down_proj:  15%|█▍        | 5434/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.119.gate_proj:  15%|█▍        | 5435/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.119.up_proj:  15%|█▍        | 5436/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.119.down_proj:  15%|█▍        | 5437/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.120.gate_proj:  15%|█▍        | 5438/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.120.up_proj:  15%|█▍        | 5439/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.120.down_proj:  15%|█▍        | 5440/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.121.gate_proj:  15%|█▍        | 5441/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.121.up_proj:  15%|█▍        | 5442/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.121.down_proj:  15%|█▍        | 5443/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.122.gate_proj:  15%|█▍        | 5444/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.122.up_proj:  15%|█▍        | 5445/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.122.down_proj:  15%|█▍        | 5446/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.123.gate_proj:  15%|█▍        | 5447/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.123.up_proj:  15%|█▍        | 5448/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.123.down_proj:  15%|█▍        | 5449/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.124.gate_proj:  15%|█▍        | 5450/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.124.up_proj:  15%|█▍        | 5451/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.124.down_proj:  15%|█▍        | 5452/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.125.gate_proj:  15%|█▍        | 5453/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.125.up_proj:  15%|█▍        | 5454/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.125.down_proj:  15%|█▍        | 5455/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.126.gate_proj:  15%|█▍        | 5456/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.126.up_proj:  15%|█▍        | 5457/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.126.down_proj:  15%|█▍        | 5458/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.127.gate_proj:  15%|█▍        | 5459/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.12.mlp.experts.127.up_proj:  15%|█▍        | 5460/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.12.mlp.experts.127.down_proj:  15%|█▍        | 5461/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.13.mlp.experts.0.gate_proj:  15%|█▍        | 5462/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.13.mlp.experts.0.up_proj:  15%|█▍        | 5463/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.13.mlp.experts.0.down_proj:  15%|█▍        | 5464/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.13.mlp.experts.1.gate_proj:  15%|█▍        | 5465/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.13.mlp.experts.1.up_proj:  15%|█▍        | 5466/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.13.mlp.experts.1.down_proj:  15%|█▍        | 5467/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.13.mlp.experts.2.gate_proj:  15%|█▍        | 5468/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.13.mlp.experts.2.up_proj:  15%|█▍        | 5469/36566 [00:05<00:26, 1157.08it/s]  
packing model.layers.13.mlp.experts.2.down_proj:  15%|█▍        | 5470/36566 [00:05<00:26, 1157.08it/s]
packing model.layers.13.mlp.experts.2.down_proj:  15%|█▍        | 5471/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.3.gate_proj:  15%|█▍        | 5471/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.3.up_proj:  15%|█▍        | 5472/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.3.down_proj:  15%|█▍        | 5473/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.4.gate_proj:  15%|█▍        | 5474/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.4.up_proj:  15%|█▍        | 5475/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.4.down_proj:  15%|█▍        | 5476/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.5.gate_proj:  15%|█▍        | 5477/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.5.up_proj:  15%|█▍        | 5478/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.5.down_proj:  15%|█▍        | 5479/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.6.gate_proj:  15%|█▍        | 5480/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.6.up_proj:  15%|█▍        | 5481/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.6.down_proj:  15%|█▍        | 5482/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.7.gate_proj:  15%|█▍        | 5483/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.7.up_proj:  15%|█▍        | 5484/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.7.down_proj:  15%|█▌        | 5485/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.8.gate_proj:  15%|█▌        | 5486/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.8.up_proj:  15%|█▌        | 5487/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.8.down_proj:  15%|█▌        | 5488/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.9.gate_proj:  15%|█▌        | 5489/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.9.up_proj:  15%|█▌        | 5490/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.9.down_proj:  15%|█▌        | 5491/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.10.gate_proj:  15%|█▌        | 5492/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.10.up_proj:  15%|█▌        | 5493/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.10.down_proj:  15%|█▌        | 5494/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.11.gate_proj:  15%|█▌        | 5495/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.11.up_proj:  15%|█▌        | 5496/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.11.down_proj:  15%|█▌        | 5497/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.12.gate_proj:  15%|█▌        | 5498/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.12.up_proj:  15%|█▌        | 5499/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.12.down_proj:  15%|█▌        | 5500/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.13.gate_proj:  15%|█▌        | 5501/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.13.up_proj:  15%|█▌        | 5502/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.13.down_proj:  15%|█▌        | 5503/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.14.gate_proj:  15%|█▌        | 5504/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.14.up_proj:  15%|█▌        | 5505/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.14.down_proj:  15%|█▌        | 5506/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.15.gate_proj:  15%|█▌        | 5507/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.15.up_proj:  15%|█▌        | 5508/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.15.down_proj:  15%|█▌        | 5509/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.16.gate_proj:  15%|█▌        | 5510/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.16.up_proj:  15%|█▌        | 5511/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.16.down_proj:  15%|█▌        | 5512/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.17.gate_proj:  15%|█▌        | 5513/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.17.up_proj:  15%|█▌        | 5514/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.17.down_proj:  15%|█▌        | 5515/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.18.gate_proj:  15%|█▌        | 5516/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.18.up_proj:  15%|█▌        | 5517/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.18.down_proj:  15%|█▌        | 5518/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.19.gate_proj:  15%|█▌        | 5519/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.19.up_proj:  15%|█▌        | 5520/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.19.down_proj:  15%|█▌        | 5521/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.20.gate_proj:  15%|█▌        | 5522/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.20.up_proj:  15%|█▌        | 5523/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.20.down_proj:  15%|█▌        | 5524/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.21.gate_proj:  15%|█▌        | 5525/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.21.up_proj:  15%|█▌        | 5526/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.21.down_proj:  15%|█▌        | 5527/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.22.gate_proj:  15%|█▌        | 5528/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.22.up_proj:  15%|█▌        | 5529/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.22.down_proj:  15%|█▌        | 5530/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.23.gate_proj:  15%|█▌        | 5531/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.23.up_proj:  15%|█▌        | 5532/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.23.down_proj:  15%|█▌        | 5533/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.24.gate_proj:  15%|█▌        | 5534/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.24.up_proj:  15%|█▌        | 5535/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.24.down_proj:  15%|█▌        | 5536/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.25.gate_proj:  15%|█▌        | 5537/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.25.up_proj:  15%|█▌        | 5538/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.25.down_proj:  15%|█▌        | 5539/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.26.gate_proj:  15%|█▌        | 5540/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.26.up_proj:  15%|█▌        | 5541/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.26.down_proj:  15%|█▌        | 5542/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.27.gate_proj:  15%|█▌        | 5543/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.27.up_proj:  15%|█▌        | 5544/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.27.down_proj:  15%|█▌        | 5545/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.28.gate_proj:  15%|█▌        | 5546/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.28.up_proj:  15%|█▌        | 5547/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.28.down_proj:  15%|█▌        | 5548/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.29.gate_proj:  15%|█▌        | 5549/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.29.up_proj:  15%|█▌        | 5550/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.29.down_proj:  15%|█▌        | 5551/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.30.gate_proj:  15%|█▌        | 5552/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.30.up_proj:  15%|█▌        | 5553/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.30.down_proj:  15%|█▌        | 5554/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.31.gate_proj:  15%|█▌        | 5555/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.31.up_proj:  15%|█▌        | 5556/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.31.down_proj:  15%|█▌        | 5557/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.32.gate_proj:  15%|█▌        | 5558/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.32.up_proj:  15%|█▌        | 5559/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.32.down_proj:  15%|█▌        | 5560/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.33.gate_proj:  15%|█▌        | 5561/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.33.up_proj:  15%|█▌        | 5562/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.33.down_proj:  15%|█▌        | 5563/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.34.gate_proj:  15%|█▌        | 5564/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.34.up_proj:  15%|█▌        | 5565/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.34.down_proj:  15%|█▌        | 5566/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.35.gate_proj:  15%|█▌        | 5567/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.35.up_proj:  15%|█▌        | 5568/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.35.down_proj:  15%|█▌        | 5569/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.36.gate_proj:  15%|█▌        | 5570/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.36.up_proj:  15%|█▌        | 5571/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.36.down_proj:  15%|█▌        | 5572/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.37.gate_proj:  15%|█▌        | 5573/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.37.up_proj:  15%|█▌        | 5574/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.37.down_proj:  15%|█▌        | 5575/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.38.gate_proj:  15%|█▌        | 5576/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.38.up_proj:  15%|█▌        | 5577/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.38.down_proj:  15%|█▌        | 5578/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.39.gate_proj:  15%|█▌        | 5579/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.39.up_proj:  15%|█▌        | 5580/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.39.down_proj:  15%|█▌        | 5581/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.40.gate_proj:  15%|█▌        | 5582/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.40.up_proj:  15%|█▌        | 5583/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.40.down_proj:  15%|█▌        | 5584/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.41.gate_proj:  15%|█▌        | 5585/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.41.up_proj:  15%|█▌        | 5586/36566 [00:05<00:26, 1159.42it/s]  
packing model.layers.13.mlp.experts.41.down_proj:  15%|█▌        | 5587/36566 [00:05<00:26, 1159.42it/s]
packing model.layers.13.mlp.experts.41.down_proj:  15%|█▌        | 5588/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.42.gate_proj:  15%|█▌        | 5588/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.42.up_proj:  15%|█▌        | 5589/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.42.down_proj:  15%|█▌        | 5590/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.43.gate_proj:  15%|█▌        | 5591/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.43.up_proj:  15%|█▌        | 5592/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.43.down_proj:  15%|█▌        | 5593/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.44.gate_proj:  15%|█▌        | 5594/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.44.up_proj:  15%|█▌        | 5595/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.44.down_proj:  15%|█▌        | 5596/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.45.gate_proj:  15%|█▌        | 5597/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.45.up_proj:  15%|█▌        | 5598/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.45.down_proj:  15%|█▌        | 5599/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.46.gate_proj:  15%|█▌        | 5600/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.46.up_proj:  15%|█▌        | 5601/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.46.down_proj:  15%|█▌        | 5602/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.47.gate_proj:  15%|█▌        | 5603/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.47.up_proj:  15%|█▌        | 5604/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.47.down_proj:  15%|█▌        | 5605/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.48.gate_proj:  15%|█▌        | 5606/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.48.up_proj:  15%|█▌        | 5607/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.48.down_proj:  15%|█▌        | 5608/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.49.gate_proj:  15%|█▌        | 5609/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.49.up_proj:  15%|█▌        | 5610/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.49.down_proj:  15%|█▌        | 5611/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.50.gate_proj:  15%|█▌        | 5612/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.50.up_proj:  15%|█▌        | 5613/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.50.down_proj:  15%|█▌        | 5614/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.51.gate_proj:  15%|█▌        | 5615/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.51.up_proj:  15%|█▌        | 5616/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.51.down_proj:  15%|█▌        | 5617/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.52.gate_proj:  15%|█▌        | 5618/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.52.up_proj:  15%|█▌        | 5619/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.52.down_proj:  15%|█▌        | 5620/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.53.gate_proj:  15%|█▌        | 5621/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.53.up_proj:  15%|█▌        | 5622/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.53.down_proj:  15%|█▌        | 5623/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.54.gate_proj:  15%|█▌        | 5624/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.54.up_proj:  15%|█▌        | 5625/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.54.down_proj:  15%|█▌        | 5626/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.55.gate_proj:  15%|█▌        | 5627/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.55.up_proj:  15%|█▌        | 5628/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.55.down_proj:  15%|█▌        | 5629/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.56.gate_proj:  15%|█▌        | 5630/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.56.up_proj:  15%|█▌        | 5631/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.56.down_proj:  15%|█▌        | 5632/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.57.gate_proj:  15%|█▌        | 5633/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.57.up_proj:  15%|█▌        | 5634/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.57.down_proj:  15%|█▌        | 5635/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.58.gate_proj:  15%|█▌        | 5636/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.58.up_proj:  15%|█▌        | 5637/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.58.down_proj:  15%|█▌        | 5638/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.59.gate_proj:  15%|█▌        | 5639/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.59.up_proj:  15%|█▌        | 5640/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.59.down_proj:  15%|█▌        | 5641/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.60.gate_proj:  15%|█▌        | 5642/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.60.up_proj:  15%|█▌        | 5643/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.60.down_proj:  15%|█▌        | 5644/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.61.gate_proj:  15%|█▌        | 5645/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.61.up_proj:  15%|█▌        | 5646/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.61.down_proj:  15%|█▌        | 5647/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.62.gate_proj:  15%|█▌        | 5648/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.62.up_proj:  15%|█▌        | 5649/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.62.down_proj:  15%|█▌        | 5650/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.63.gate_proj:  15%|█▌        | 5651/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.63.up_proj:  15%|█▌        | 5652/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.63.down_proj:  15%|█▌        | 5653/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.64.gate_proj:  15%|█▌        | 5654/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.64.up_proj:  15%|█▌        | 5655/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.64.down_proj:  15%|█▌        | 5656/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.65.gate_proj:  15%|█▌        | 5657/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.65.up_proj:  15%|█▌        | 5658/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.65.down_proj:  15%|█▌        | 5659/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.66.gate_proj:  15%|█▌        | 5660/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.66.up_proj:  15%|█▌        | 5661/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.66.down_proj:  15%|█▌        | 5662/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.67.gate_proj:  15%|█▌        | 5663/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.67.up_proj:  15%|█▌        | 5664/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.67.down_proj:  15%|█▌        | 5665/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.68.gate_proj:  15%|█▌        | 5666/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.68.up_proj:  15%|█▌        | 5667/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.68.down_proj:  16%|█▌        | 5668/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.69.gate_proj:  16%|█▌        | 5669/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.69.up_proj:  16%|█▌        | 5670/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.69.down_proj:  16%|█▌        | 5671/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.70.gate_proj:  16%|█▌        | 5672/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.70.up_proj:  16%|█▌        | 5673/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.70.down_proj:  16%|█▌        | 5674/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.71.gate_proj:  16%|█▌        | 5675/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.71.up_proj:  16%|█▌        | 5676/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.71.down_proj:  16%|█▌        | 5677/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.72.gate_proj:  16%|█▌        | 5678/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.72.up_proj:  16%|█▌        | 5679/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.72.down_proj:  16%|█▌        | 5680/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.73.gate_proj:  16%|█▌        | 5681/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.73.up_proj:  16%|█▌        | 5682/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.73.down_proj:  16%|█▌        | 5683/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.74.gate_proj:  16%|█▌        | 5684/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.74.up_proj:  16%|█▌        | 5685/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.74.down_proj:  16%|█▌        | 5686/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.75.gate_proj:  16%|█▌        | 5687/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.75.up_proj:  16%|█▌        | 5688/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.75.down_proj:  16%|█▌        | 5689/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.76.gate_proj:  16%|█▌        | 5690/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.76.up_proj:  16%|█▌        | 5691/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.76.down_proj:  16%|█▌        | 5692/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.77.gate_proj:  16%|█▌        | 5693/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.77.up_proj:  16%|█▌        | 5694/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.77.down_proj:  16%|█▌        | 5695/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.78.gate_proj:  16%|█▌        | 5696/36566 [00:05<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.78.up_proj:  16%|█▌        | 5697/36566 [00:05<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.78.down_proj:  16%|█▌        | 5698/36566 [00:06<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.79.gate_proj:  16%|█▌        | 5699/36566 [00:06<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.79.up_proj:  16%|█▌        | 5700/36566 [00:06<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.79.down_proj:  16%|█▌        | 5701/36566 [00:06<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.80.gate_proj:  16%|█▌        | 5702/36566 [00:06<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.80.up_proj:  16%|█▌        | 5703/36566 [00:06<00:26, 1161.97it/s]  
packing model.layers.13.mlp.experts.80.down_proj:  16%|█▌        | 5704/36566 [00:06<00:26, 1161.97it/s]
packing model.layers.13.mlp.experts.80.down_proj:  16%|█▌        | 5705/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.81.gate_proj:  16%|█▌        | 5705/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.81.up_proj:  16%|█▌        | 5706/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.81.down_proj:  16%|█▌        | 5707/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.82.gate_proj:  16%|█▌        | 5708/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.82.up_proj:  16%|█▌        | 5709/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.82.down_proj:  16%|█▌        | 5710/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.83.gate_proj:  16%|█▌        | 5711/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.83.up_proj:  16%|█▌        | 5712/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.83.down_proj:  16%|█▌        | 5713/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.84.gate_proj:  16%|█▌        | 5714/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.84.up_proj:  16%|█▌        | 5715/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.84.down_proj:  16%|█▌        | 5716/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.85.gate_proj:  16%|█▌        | 5717/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.85.up_proj:  16%|█▌        | 5718/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.85.down_proj:  16%|█▌        | 5719/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.86.gate_proj:  16%|█▌        | 5720/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.86.up_proj:  16%|█▌        | 5721/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.86.down_proj:  16%|█▌        | 5722/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.87.gate_proj:  16%|█▌        | 5723/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.87.up_proj:  16%|█▌        | 5724/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.87.down_proj:  16%|█▌        | 5725/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.88.gate_proj:  16%|█▌        | 5726/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.88.up_proj:  16%|█▌        | 5727/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.88.down_proj:  16%|█▌        | 5728/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.89.gate_proj:  16%|█▌        | 5729/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.89.up_proj:  16%|█▌        | 5730/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.89.down_proj:  16%|█▌        | 5731/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.90.gate_proj:  16%|█▌        | 5732/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.90.up_proj:  16%|█▌        | 5733/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.90.down_proj:  16%|█▌        | 5734/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.91.gate_proj:  16%|█▌        | 5735/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.91.up_proj:  16%|█▌        | 5736/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.91.down_proj:  16%|█▌        | 5737/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.92.gate_proj:  16%|█▌        | 5738/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.92.up_proj:  16%|█▌        | 5739/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.92.down_proj:  16%|█▌        | 5740/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.93.gate_proj:  16%|█▌        | 5741/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.93.up_proj:  16%|█▌        | 5742/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.93.down_proj:  16%|█▌        | 5743/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.94.gate_proj:  16%|█▌        | 5744/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.94.up_proj:  16%|█▌        | 5745/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.94.down_proj:  16%|█▌        | 5746/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.95.gate_proj:  16%|█▌        | 5747/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.95.up_proj:  16%|█▌        | 5748/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.95.down_proj:  16%|█▌        | 5749/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.96.gate_proj:  16%|█▌        | 5750/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.96.up_proj:  16%|█▌        | 5751/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.96.down_proj:  16%|█▌        | 5752/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.97.gate_proj:  16%|█▌        | 5753/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.97.up_proj:  16%|█▌        | 5754/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.97.down_proj:  16%|█▌        | 5755/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.98.gate_proj:  16%|█▌        | 5756/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.98.up_proj:  16%|█▌        | 5757/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.98.down_proj:  16%|█▌        | 5758/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.99.gate_proj:  16%|█▌        | 5759/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.99.up_proj:  16%|█▌        | 5760/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.99.down_proj:  16%|█▌        | 5761/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.100.gate_proj:  16%|█▌        | 5762/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.100.up_proj:  16%|█▌        | 5763/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.100.down_proj:  16%|█▌        | 5764/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.101.gate_proj:  16%|█▌        | 5765/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.101.up_proj:  16%|█▌        | 5766/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.101.down_proj:  16%|█▌        | 5767/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.102.gate_proj:  16%|█▌        | 5768/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.102.up_proj:  16%|█▌        | 5769/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.102.down_proj:  16%|█▌        | 5770/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.103.gate_proj:  16%|█▌        | 5771/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.103.up_proj:  16%|█▌        | 5772/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.103.down_proj:  16%|█▌        | 5773/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.104.gate_proj:  16%|█▌        | 5774/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.104.up_proj:  16%|█▌        | 5775/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.104.down_proj:  16%|█▌        | 5776/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.105.gate_proj:  16%|█▌        | 5777/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.105.up_proj:  16%|█▌        | 5778/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.105.down_proj:  16%|█▌        | 5779/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.106.gate_proj:  16%|█▌        | 5780/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.106.up_proj:  16%|█▌        | 5781/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.106.down_proj:  16%|█▌        | 5782/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.107.gate_proj:  16%|█▌        | 5783/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.107.up_proj:  16%|█▌        | 5784/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.107.down_proj:  16%|█▌        | 5785/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.108.gate_proj:  16%|█▌        | 5786/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.108.up_proj:  16%|█▌        | 5787/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.108.down_proj:  16%|█▌        | 5788/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.109.gate_proj:  16%|█▌        | 5789/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.109.up_proj:  16%|█▌        | 5790/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.109.down_proj:  16%|█▌        | 5791/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.110.gate_proj:  16%|█▌        | 5792/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.110.up_proj:  16%|█▌        | 5793/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.110.down_proj:  16%|█▌        | 5794/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.111.gate_proj:  16%|█▌        | 5795/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.111.up_proj:  16%|█▌        | 5796/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.111.down_proj:  16%|█▌        | 5797/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.112.gate_proj:  16%|█▌        | 5798/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.112.up_proj:  16%|█▌        | 5799/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.112.down_proj:  16%|█▌        | 5800/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.113.gate_proj:  16%|█▌        | 5801/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.113.up_proj:  16%|█▌        | 5802/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.113.down_proj:  16%|█▌        | 5803/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.114.gate_proj:  16%|█▌        | 5804/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.114.up_proj:  16%|█▌        | 5805/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.114.down_proj:  16%|█▌        | 5806/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.115.gate_proj:  16%|█▌        | 5807/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.115.up_proj:  16%|█▌        | 5808/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.115.down_proj:  16%|█▌        | 5809/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.116.gate_proj:  16%|█▌        | 5810/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.116.up_proj:  16%|█▌        | 5811/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.116.down_proj:  16%|█▌        | 5812/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.117.gate_proj:  16%|█▌        | 5813/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.117.up_proj:  16%|█▌        | 5814/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.117.down_proj:  16%|█▌        | 5815/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.118.gate_proj:  16%|█▌        | 5816/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.118.up_proj:  16%|█▌        | 5817/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.118.down_proj:  16%|█▌        | 5818/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.119.gate_proj:  16%|█▌        | 5819/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.119.up_proj:  16%|█▌        | 5820/36566 [00:06<00:26, 1162.79it/s]  
packing model.layers.13.mlp.experts.119.down_proj:  16%|█▌        | 5821/36566 [00:06<00:26, 1162.79it/s]
packing model.layers.13.mlp.experts.119.down_proj:  16%|█▌        | 5822/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.120.gate_proj:  16%|█▌        | 5822/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.120.up_proj:  16%|█▌        | 5823/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.120.down_proj:  16%|█▌        | 5824/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.121.gate_proj:  16%|█▌        | 5825/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.121.up_proj:  16%|█▌        | 5826/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.121.down_proj:  16%|█▌        | 5827/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.122.gate_proj:  16%|█▌        | 5828/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.122.up_proj:  16%|█▌        | 5829/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.122.down_proj:  16%|█▌        | 5830/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.123.gate_proj:  16%|█▌        | 5831/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.123.up_proj:  16%|█▌        | 5832/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.123.down_proj:  16%|█▌        | 5833/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.124.gate_proj:  16%|█▌        | 5834/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.124.up_proj:  16%|█▌        | 5835/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.124.down_proj:  16%|█▌        | 5836/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.125.gate_proj:  16%|█▌        | 5837/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.125.up_proj:  16%|█▌        | 5838/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.125.down_proj:  16%|█▌        | 5839/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.126.gate_proj:  16%|█▌        | 5840/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.126.up_proj:  16%|█▌        | 5841/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.126.down_proj:  16%|█▌        | 5842/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.127.gate_proj:  16%|█▌        | 5843/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.13.mlp.experts.127.up_proj:  16%|█▌        | 5844/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.13.mlp.experts.127.down_proj:  16%|█▌        | 5845/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.0.gate_proj:  16%|█▌        | 5846/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.0.up_proj:  16%|█▌        | 5847/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.0.down_proj:  16%|█▌        | 5848/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.1.gate_proj:  16%|█▌        | 5849/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.1.up_proj:  16%|█▌        | 5850/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.1.down_proj:  16%|█▌        | 5851/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.2.gate_proj:  16%|█▌        | 5852/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.2.up_proj:  16%|█▌        | 5853/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.2.down_proj:  16%|█▌        | 5854/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.3.gate_proj:  16%|█▌        | 5855/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.3.up_proj:  16%|█▌        | 5856/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.3.down_proj:  16%|█▌        | 5857/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.4.gate_proj:  16%|█▌        | 5858/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.4.up_proj:  16%|█▌        | 5859/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.4.down_proj:  16%|█▌        | 5860/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.5.gate_proj:  16%|█▌        | 5861/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.5.up_proj:  16%|█▌        | 5862/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.5.down_proj:  16%|█▌        | 5863/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.6.gate_proj:  16%|█▌        | 5864/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.6.up_proj:  16%|█▌        | 5865/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.6.down_proj:  16%|█▌        | 5866/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.7.gate_proj:  16%|█▌        | 5867/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.7.up_proj:  16%|█▌        | 5868/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.7.down_proj:  16%|█▌        | 5869/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.8.gate_proj:  16%|█▌        | 5870/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.8.up_proj:  16%|█▌        | 5871/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.8.down_proj:  16%|█▌        | 5872/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.9.gate_proj:  16%|█▌        | 5873/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.9.up_proj:  16%|█▌        | 5874/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.9.down_proj:  16%|█▌        | 5875/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.10.gate_proj:  16%|█▌        | 5876/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.10.up_proj:  16%|█▌        | 5877/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.10.down_proj:  16%|█▌        | 5878/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.11.gate_proj:  16%|█▌        | 5879/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.11.up_proj:  16%|█▌        | 5880/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.11.down_proj:  16%|█▌        | 5881/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.12.gate_proj:  16%|█▌        | 5882/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.12.up_proj:  16%|█▌        | 5883/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.12.down_proj:  16%|█▌        | 5884/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.13.gate_proj:  16%|█▌        | 5885/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.13.up_proj:  16%|█▌        | 5886/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.13.down_proj:  16%|█▌        | 5887/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.14.gate_proj:  16%|█▌        | 5888/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.14.up_proj:  16%|█▌        | 5889/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.14.down_proj:  16%|█▌        | 5890/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.15.gate_proj:  16%|█▌        | 5891/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.15.up_proj:  16%|█▌        | 5892/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.15.down_proj:  16%|█▌        | 5893/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.16.gate_proj:  16%|█▌        | 5894/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.16.up_proj:  16%|█▌        | 5895/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.16.down_proj:  16%|█▌        | 5896/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.17.gate_proj:  16%|█▌        | 5897/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.17.up_proj:  16%|█▌        | 5898/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.17.down_proj:  16%|█▌        | 5899/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.18.gate_proj:  16%|█▌        | 5900/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.18.up_proj:  16%|█▌        | 5901/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.18.down_proj:  16%|█▌        | 5902/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.19.gate_proj:  16%|█▌        | 5903/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.19.up_proj:  16%|█▌        | 5904/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.19.down_proj:  16%|█▌        | 5905/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.20.gate_proj:  16%|█▌        | 5906/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.20.up_proj:  16%|█▌        | 5907/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.20.down_proj:  16%|█▌        | 5908/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.21.gate_proj:  16%|█▌        | 5909/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.21.up_proj:  16%|█▌        | 5910/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.21.down_proj:  16%|█▌        | 5911/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.22.gate_proj:  16%|█▌        | 5912/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.22.up_proj:  16%|█▌        | 5913/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.22.down_proj:  16%|█▌        | 5914/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.23.gate_proj:  16%|█▌        | 5915/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.23.up_proj:  16%|█▌        | 5916/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.23.down_proj:  16%|█▌        | 5917/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.24.gate_proj:  16%|█▌        | 5918/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.24.up_proj:  16%|█▌        | 5919/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.24.down_proj:  16%|█▌        | 5920/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.25.gate_proj:  16%|█▌        | 5921/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.25.up_proj:  16%|█▌        | 5922/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.25.down_proj:  16%|█▌        | 5923/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.26.gate_proj:  16%|█▌        | 5924/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.26.up_proj:  16%|█▌        | 5925/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.26.down_proj:  16%|█▌        | 5926/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.27.gate_proj:  16%|█▌        | 5927/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.27.up_proj:  16%|█▌        | 5928/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.27.down_proj:  16%|█▌        | 5929/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.28.gate_proj:  16%|█▌        | 5930/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.28.up_proj:  16%|█▌        | 5931/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.28.down_proj:  16%|█▌        | 5932/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.29.gate_proj:  16%|█▌        | 5933/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.29.up_proj:  16%|█▌        | 5934/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.29.down_proj:  16%|█▌        | 5935/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.30.gate_proj:  16%|█▌        | 5936/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.30.up_proj:  16%|█▌        | 5937/36566 [00:06<00:26, 1161.32it/s]  
packing model.layers.14.mlp.experts.30.down_proj:  16%|█▌        | 5938/36566 [00:06<00:26, 1161.32it/s]
packing model.layers.14.mlp.experts.30.down_proj:  16%|█▌        | 5939/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.31.gate_proj:  16%|█▌        | 5939/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.31.up_proj:  16%|█▌        | 5940/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.31.down_proj:  16%|█▌        | 5941/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.32.gate_proj:  16%|█▋        | 5942/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.32.up_proj:  16%|█▋        | 5943/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.32.down_proj:  16%|█▋        | 5944/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.33.gate_proj:  16%|█▋        | 5945/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.33.up_proj:  16%|█▋        | 5946/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.33.down_proj:  16%|█▋        | 5947/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.34.gate_proj:  16%|█▋        | 5948/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.34.up_proj:  16%|█▋        | 5949/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.34.down_proj:  16%|█▋        | 5950/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.35.gate_proj:  16%|█▋        | 5951/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.35.up_proj:  16%|█▋        | 5952/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.35.down_proj:  16%|█▋        | 5953/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.36.gate_proj:  16%|█▋        | 5954/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.36.up_proj:  16%|█▋        | 5955/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.36.down_proj:  16%|█▋        | 5956/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.37.gate_proj:  16%|█▋        | 5957/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.37.up_proj:  16%|█▋        | 5958/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.37.down_proj:  16%|█▋        | 5959/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.38.gate_proj:  16%|█▋        | 5960/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.38.up_proj:  16%|█▋        | 5961/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.38.down_proj:  16%|█▋        | 5962/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.39.gate_proj:  16%|█▋        | 5963/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.39.up_proj:  16%|█▋        | 5964/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.39.down_proj:  16%|█▋        | 5965/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.40.gate_proj:  16%|█▋        | 5966/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.40.up_proj:  16%|█▋        | 5967/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.40.down_proj:  16%|█▋        | 5968/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.41.gate_proj:  16%|█▋        | 5969/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.41.up_proj:  16%|█▋        | 5970/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.41.down_proj:  16%|█▋        | 5971/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.42.gate_proj:  16%|█▋        | 5972/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.42.up_proj:  16%|█▋        | 5973/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.42.down_proj:  16%|█▋        | 5974/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.43.gate_proj:  16%|█▋        | 5975/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.43.up_proj:  16%|█▋        | 5976/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.43.down_proj:  16%|█▋        | 5977/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.44.gate_proj:  16%|█▋        | 5978/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.44.up_proj:  16%|█▋        | 5979/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.44.down_proj:  16%|█▋        | 5980/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.45.gate_proj:  16%|█▋        | 5981/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.45.up_proj:  16%|█▋        | 5982/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.45.down_proj:  16%|█▋        | 5983/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.46.gate_proj:  16%|█▋        | 5984/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.46.up_proj:  16%|█▋        | 5985/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.46.down_proj:  16%|█▋        | 5986/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.47.gate_proj:  16%|█▋        | 5987/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.47.up_proj:  16%|█▋        | 5988/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.47.down_proj:  16%|█▋        | 5989/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.48.gate_proj:  16%|█▋        | 5990/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.48.up_proj:  16%|█▋        | 5991/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.48.down_proj:  16%|█▋        | 5992/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.49.gate_proj:  16%|█▋        | 5993/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.49.up_proj:  16%|█▋        | 5994/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.49.down_proj:  16%|█▋        | 5995/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.50.gate_proj:  16%|█▋        | 5996/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.50.up_proj:  16%|█▋        | 5997/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.50.down_proj:  16%|█▋        | 5998/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.51.gate_proj:  16%|█▋        | 5999/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.51.up_proj:  16%|█▋        | 6000/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.51.down_proj:  16%|█▋        | 6001/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.52.gate_proj:  16%|█▋        | 6002/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.52.up_proj:  16%|█▋        | 6003/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.52.down_proj:  16%|█▋        | 6004/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.53.gate_proj:  16%|█▋        | 6005/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.53.up_proj:  16%|█▋        | 6006/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.53.down_proj:  16%|█▋        | 6007/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.54.gate_proj:  16%|█▋        | 6008/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.54.up_proj:  16%|█▋        | 6009/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.54.down_proj:  16%|█▋        | 6010/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.55.gate_proj:  16%|█▋        | 6011/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.55.up_proj:  16%|█▋        | 6012/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.55.down_proj:  16%|█▋        | 6013/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.56.gate_proj:  16%|█▋        | 6014/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.56.up_proj:  16%|█▋        | 6015/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.56.down_proj:  16%|█▋        | 6016/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.57.gate_proj:  16%|█▋        | 6017/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.57.up_proj:  16%|█▋        | 6018/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.57.down_proj:  16%|█▋        | 6019/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.58.gate_proj:  16%|█▋        | 6020/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.58.up_proj:  16%|█▋        | 6021/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.58.down_proj:  16%|█▋        | 6022/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.59.gate_proj:  16%|█▋        | 6023/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.59.up_proj:  16%|█▋        | 6024/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.59.down_proj:  16%|█▋        | 6025/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.60.gate_proj:  16%|█▋        | 6026/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.60.up_proj:  16%|█▋        | 6027/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.60.down_proj:  16%|█▋        | 6028/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.61.gate_proj:  16%|█▋        | 6029/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.61.up_proj:  16%|█▋        | 6030/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.61.down_proj:  16%|█▋        | 6031/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.62.gate_proj:  16%|█▋        | 6032/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.62.up_proj:  16%|█▋        | 6033/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.62.down_proj:  17%|█▋        | 6034/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.63.gate_proj:  17%|█▋        | 6035/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.63.up_proj:  17%|█▋        | 6036/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.63.down_proj:  17%|█▋        | 6037/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.64.gate_proj:  17%|█▋        | 6038/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.64.up_proj:  17%|█▋        | 6039/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.64.down_proj:  17%|█▋        | 6040/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.65.gate_proj:  17%|█▋        | 6041/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.65.up_proj:  17%|█▋        | 6042/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.65.down_proj:  17%|█▋        | 6043/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.66.gate_proj:  17%|█▋        | 6044/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.66.up_proj:  17%|█▋        | 6045/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.66.down_proj:  17%|█▋        | 6046/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.67.gate_proj:  17%|█▋        | 6047/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.67.up_proj:  17%|█▋        | 6048/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.67.down_proj:  17%|█▋        | 6049/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.68.gate_proj:  17%|█▋        | 6050/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.68.up_proj:  17%|█▋        | 6051/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.68.down_proj:  17%|█▋        | 6052/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.69.gate_proj:  17%|█▋        | 6053/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.69.up_proj:  17%|█▋        | 6054/36566 [00:06<00:26, 1161.42it/s]  
packing model.layers.14.mlp.experts.69.down_proj:  17%|█▋        | 6055/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.70.gate_proj:  17%|█▋        | 6056/36566 [00:06<00:26, 1161.42it/s]
packing model.layers.14.mlp.experts.70.gate_proj:  17%|█▋        | 6057/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.70.up_proj:  17%|█▋        | 6057/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.70.down_proj:  17%|█▋        | 6058/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.71.gate_proj:  17%|█▋        | 6059/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.71.up_proj:  17%|█▋        | 6060/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.71.down_proj:  17%|█▋        | 6061/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.72.gate_proj:  17%|█▋        | 6062/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.72.up_proj:  17%|█▋        | 6063/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.72.down_proj:  17%|█▋        | 6064/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.73.gate_proj:  17%|█▋        | 6065/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.73.up_proj:  17%|█▋        | 6066/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.73.down_proj:  17%|█▋        | 6067/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.74.gate_proj:  17%|█▋        | 6068/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.74.up_proj:  17%|█▋        | 6069/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.74.down_proj:  17%|█▋        | 6070/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.75.gate_proj:  17%|█▋        | 6071/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.75.up_proj:  17%|█▋        | 6072/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.75.down_proj:  17%|█▋        | 6073/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.76.gate_proj:  17%|█▋        | 6074/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.76.up_proj:  17%|█▋        | 6075/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.76.down_proj:  17%|█▋        | 6076/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.77.gate_proj:  17%|█▋        | 6077/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.77.up_proj:  17%|█▋        | 6078/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.77.down_proj:  17%|█▋        | 6079/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.78.gate_proj:  17%|█▋        | 6080/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.78.up_proj:  17%|█▋        | 6081/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.78.down_proj:  17%|█▋        | 6082/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.79.gate_proj:  17%|█▋        | 6083/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.79.up_proj:  17%|█▋        | 6084/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.79.down_proj:  17%|█▋        | 6085/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.80.gate_proj:  17%|█▋        | 6086/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.80.up_proj:  17%|█▋        | 6087/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.80.down_proj:  17%|█▋        | 6088/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.81.gate_proj:  17%|█▋        | 6089/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.81.up_proj:  17%|█▋        | 6090/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.81.down_proj:  17%|█▋        | 6091/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.82.gate_proj:  17%|█▋        | 6092/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.82.up_proj:  17%|█▋        | 6093/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.82.down_proj:  17%|█▋        | 6094/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.83.gate_proj:  17%|█▋        | 6095/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.83.up_proj:  17%|█▋        | 6096/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.83.down_proj:  17%|█▋        | 6097/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.84.gate_proj:  17%|█▋        | 6098/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.84.up_proj:  17%|█▋        | 6099/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.84.down_proj:  17%|█▋        | 6100/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.85.gate_proj:  17%|█▋        | 6101/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.85.up_proj:  17%|█▋        | 6102/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.85.down_proj:  17%|█▋        | 6103/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.86.gate_proj:  17%|█▋        | 6104/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.86.up_proj:  17%|█▋        | 6105/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.86.down_proj:  17%|█▋        | 6106/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.87.gate_proj:  17%|█▋        | 6107/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.87.up_proj:  17%|█▋        | 6108/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.87.down_proj:  17%|█▋        | 6109/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.88.gate_proj:  17%|█▋        | 6110/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.88.up_proj:  17%|█▋        | 6111/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.88.down_proj:  17%|█▋        | 6112/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.89.gate_proj:  17%|█▋        | 6113/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.89.up_proj:  17%|█▋        | 6114/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.89.down_proj:  17%|█▋        | 6115/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.90.gate_proj:  17%|█▋        | 6116/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.90.up_proj:  17%|█▋        | 6117/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.90.down_proj:  17%|█▋        | 6118/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.91.gate_proj:  17%|█▋        | 6119/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.91.up_proj:  17%|█▋        | 6120/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.91.down_proj:  17%|█▋        | 6121/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.92.gate_proj:  17%|█▋        | 6122/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.92.up_proj:  17%|█▋        | 6123/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.92.down_proj:  17%|█▋        | 6124/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.93.gate_proj:  17%|█▋        | 6125/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.93.up_proj:  17%|█▋        | 6126/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.93.down_proj:  17%|█▋        | 6127/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.94.gate_proj:  17%|█▋        | 6128/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.94.up_proj:  17%|█▋        | 6129/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.94.down_proj:  17%|█▋        | 6130/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.95.gate_proj:  17%|█▋        | 6131/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.95.up_proj:  17%|█▋        | 6132/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.95.down_proj:  17%|█▋        | 6133/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.96.gate_proj:  17%|█▋        | 6134/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.96.up_proj:  17%|█▋        | 6135/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.96.down_proj:  17%|█▋        | 6136/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.97.gate_proj:  17%|█▋        | 6137/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.97.up_proj:  17%|█▋        | 6138/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.97.down_proj:  17%|█▋        | 6139/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.98.gate_proj:  17%|█▋        | 6140/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.98.up_proj:  17%|█▋        | 6141/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.98.down_proj:  17%|█▋        | 6142/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.99.gate_proj:  17%|█▋        | 6143/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.99.up_proj:  17%|█▋        | 6144/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.99.down_proj:  17%|█▋        | 6145/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.100.gate_proj:  17%|█▋        | 6146/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.100.up_proj:  17%|█▋        | 6147/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.100.down_proj:  17%|█▋        | 6148/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.101.gate_proj:  17%|█▋        | 6149/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.101.up_proj:  17%|█▋        | 6150/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.101.down_proj:  17%|█▋        | 6151/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.102.gate_proj:  17%|█▋        | 6152/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.102.up_proj:  17%|█▋        | 6153/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.102.down_proj:  17%|█▋        | 6154/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.103.gate_proj:  17%|█▋        | 6155/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.103.up_proj:  17%|█▋        | 6156/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.103.down_proj:  17%|█▋        | 6157/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.104.gate_proj:  17%|█▋        | 6158/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.104.up_proj:  17%|█▋        | 6159/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.104.down_proj:  17%|█▋        | 6160/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.105.gate_proj:  17%|█▋        | 6161/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.105.up_proj:  17%|█▋        | 6162/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.105.down_proj:  17%|█▋        | 6163/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.106.gate_proj:  17%|█▋        | 6164/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.106.up_proj:  17%|█▋        | 6165/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.106.down_proj:  17%|█▋        | 6166/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.107.gate_proj:  17%|█▋        | 6167/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.107.up_proj:  17%|█▋        | 6168/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.107.down_proj:  17%|█▋        | 6169/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.108.gate_proj:  17%|█▋        | 6170/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.108.up_proj:  17%|█▋        | 6171/36566 [00:06<00:26, 1164.86it/s]  
packing model.layers.14.mlp.experts.108.down_proj:  17%|█▋        | 6172/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.109.gate_proj:  17%|█▋        | 6173/36566 [00:06<00:26, 1164.86it/s]
packing model.layers.14.mlp.experts.109.gate_proj:  17%|█▋        | 6174/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.109.up_proj:  17%|█▋        | 6174/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.109.down_proj:  17%|█▋        | 6175/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.110.gate_proj:  17%|█▋        | 6176/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.110.up_proj:  17%|█▋        | 6177/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.110.down_proj:  17%|█▋        | 6178/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.111.gate_proj:  17%|█▋        | 6179/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.111.up_proj:  17%|█▋        | 6180/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.111.down_proj:  17%|█▋        | 6181/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.112.gate_proj:  17%|█▋        | 6182/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.112.up_proj:  17%|█▋        | 6183/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.112.down_proj:  17%|█▋        | 6184/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.113.gate_proj:  17%|█▋        | 6185/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.113.up_proj:  17%|█▋        | 6186/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.113.down_proj:  17%|█▋        | 6187/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.114.gate_proj:  17%|█▋        | 6188/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.114.up_proj:  17%|█▋        | 6189/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.114.down_proj:  17%|█▋        | 6190/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.115.gate_proj:  17%|█▋        | 6191/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.115.up_proj:  17%|█▋        | 6192/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.115.down_proj:  17%|█▋        | 6193/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.116.gate_proj:  17%|█▋        | 6194/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.116.up_proj:  17%|█▋        | 6195/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.116.down_proj:  17%|█▋        | 6196/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.117.gate_proj:  17%|█▋        | 6197/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.117.up_proj:  17%|█▋        | 6198/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.117.down_proj:  17%|█▋        | 6199/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.118.gate_proj:  17%|█▋        | 6200/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.118.up_proj:  17%|█▋        | 6201/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.118.down_proj:  17%|█▋        | 6202/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.119.gate_proj:  17%|█▋        | 6203/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.119.up_proj:  17%|█▋        | 6204/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.119.down_proj:  17%|█▋        | 6205/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.120.gate_proj:  17%|█▋        | 6206/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.120.up_proj:  17%|█▋        | 6207/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.120.down_proj:  17%|█▋        | 6208/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.121.gate_proj:  17%|█▋        | 6209/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.121.up_proj:  17%|█▋        | 6210/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.121.down_proj:  17%|█▋        | 6211/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.122.gate_proj:  17%|█▋        | 6212/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.122.up_proj:  17%|█▋        | 6213/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.122.down_proj:  17%|█▋        | 6214/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.123.gate_proj:  17%|█▋        | 6215/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.123.up_proj:  17%|█▋        | 6216/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.123.down_proj:  17%|█▋        | 6217/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.124.gate_proj:  17%|█▋        | 6218/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.124.up_proj:  17%|█▋        | 6219/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.124.down_proj:  17%|█▋        | 6220/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.125.gate_proj:  17%|█▋        | 6221/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.125.up_proj:  17%|█▋        | 6222/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.125.down_proj:  17%|█▋        | 6223/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.126.gate_proj:  17%|█▋        | 6224/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.126.up_proj:  17%|█▋        | 6225/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.126.down_proj:  17%|█▋        | 6226/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.127.gate_proj:  17%|█▋        | 6227/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.14.mlp.experts.127.up_proj:  17%|█▋        | 6228/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.14.mlp.experts.127.down_proj:  17%|█▋        | 6229/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.0.gate_proj:  17%|█▋        | 6230/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.0.up_proj:  17%|█▋        | 6231/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.0.down_proj:  17%|█▋        | 6232/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.1.gate_proj:  17%|█▋        | 6233/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.1.up_proj:  17%|█▋        | 6234/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.1.down_proj:  17%|█▋        | 6235/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.2.gate_proj:  17%|█▋        | 6236/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.2.up_proj:  17%|█▋        | 6237/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.2.down_proj:  17%|█▋        | 6238/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.3.gate_proj:  17%|█▋        | 6239/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.3.up_proj:  17%|█▋        | 6240/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.3.down_proj:  17%|█▋        | 6241/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.4.gate_proj:  17%|█▋        | 6242/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.4.up_proj:  17%|█▋        | 6243/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.4.down_proj:  17%|█▋        | 6244/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.5.gate_proj:  17%|█▋        | 6245/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.5.up_proj:  17%|█▋        | 6246/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.5.down_proj:  17%|█▋        | 6247/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.6.gate_proj:  17%|█▋        | 6248/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.6.up_proj:  17%|█▋        | 6249/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.6.down_proj:  17%|█▋        | 6250/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.7.gate_proj:  17%|█▋        | 6251/36566 [00:06<00:26, 1165.91it/s]
packing model.layers.15.mlp.experts.7.up_proj:  17%|█▋        | 6252/36566 [00:06<00:26, 1165.91it/s]  
packing model.layers.15.mlp.experts.7.down_proj:  17%|█▋        | 6253/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.8.gate_proj:  17%|█▋        | 6254/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.8.up_proj:  17%|█▋        | 6255/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.8.down_proj:  17%|█▋        | 6256/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.9.gate_proj:  17%|█▋        | 6257/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.9.up_proj:  17%|█▋        | 6258/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.9.down_proj:  17%|█▋        | 6259/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.10.gate_proj:  17%|█▋        | 6260/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.10.up_proj:  17%|█▋        | 6261/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.10.down_proj:  17%|█▋        | 6262/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.11.gate_proj:  17%|█▋        | 6263/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.11.up_proj:  17%|█▋        | 6264/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.11.down_proj:  17%|█▋        | 6265/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.12.gate_proj:  17%|█▋        | 6266/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.12.up_proj:  17%|█▋        | 6267/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.12.down_proj:  17%|█▋        | 6268/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.13.gate_proj:  17%|█▋        | 6269/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.13.up_proj:  17%|█▋        | 6270/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.13.down_proj:  17%|█▋        | 6271/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.14.gate_proj:  17%|█▋        | 6272/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.14.up_proj:  17%|█▋        | 6273/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.14.down_proj:  17%|█▋        | 6274/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.15.gate_proj:  17%|█▋        | 6275/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.15.up_proj:  17%|█▋        | 6276/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.15.down_proj:  17%|█▋        | 6277/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.16.gate_proj:  17%|█▋        | 6278/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.16.up_proj:  17%|█▋        | 6279/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.16.down_proj:  17%|█▋        | 6280/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.17.gate_proj:  17%|█▋        | 6281/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.17.up_proj:  17%|█▋        | 6282/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.17.down_proj:  17%|█▋        | 6283/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.18.gate_proj:  17%|█▋        | 6284/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.18.up_proj:  17%|█▋        | 6285/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.18.down_proj:  17%|█▋        | 6286/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.19.gate_proj:  17%|█▋        | 6287/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.19.up_proj:  17%|█▋        | 6288/36566 [00:06<00:25, 1165.91it/s]  
packing model.layers.15.mlp.experts.19.down_proj:  17%|█▋        | 6289/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.20.gate_proj:  17%|█▋        | 6290/36566 [00:06<00:25, 1165.91it/s]
packing model.layers.15.mlp.experts.20.gate_proj:  17%|█▋        | 6291/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.20.up_proj:  17%|█▋        | 6291/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.20.down_proj:  17%|█▋        | 6292/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.21.gate_proj:  17%|█▋        | 6293/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.21.up_proj:  17%|█▋        | 6294/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.21.down_proj:  17%|█▋        | 6295/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.22.gate_proj:  17%|█▋        | 6296/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.22.up_proj:  17%|█▋        | 6297/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.22.down_proj:  17%|█▋        | 6298/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.23.gate_proj:  17%|█▋        | 6299/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.23.up_proj:  17%|█▋        | 6300/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.23.down_proj:  17%|█▋        | 6301/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.24.gate_proj:  17%|█▋        | 6302/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.24.up_proj:  17%|█▋        | 6303/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.24.down_proj:  17%|█▋        | 6304/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.25.gate_proj:  17%|█▋        | 6305/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.25.up_proj:  17%|█▋        | 6306/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.25.down_proj:  17%|█▋        | 6307/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.26.gate_proj:  17%|█▋        | 6308/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.26.up_proj:  17%|█▋        | 6309/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.26.down_proj:  17%|█▋        | 6310/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.27.gate_proj:  17%|█▋        | 6311/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.27.up_proj:  17%|█▋        | 6312/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.27.down_proj:  17%|█▋        | 6313/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.28.gate_proj:  17%|█▋        | 6314/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.28.up_proj:  17%|█▋        | 6315/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.28.down_proj:  17%|█▋        | 6316/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.29.gate_proj:  17%|█▋        | 6317/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.29.up_proj:  17%|█▋        | 6318/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.29.down_proj:  17%|█▋        | 6319/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.30.gate_proj:  17%|█▋        | 6320/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.30.up_proj:  17%|█▋        | 6321/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.30.down_proj:  17%|█▋        | 6322/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.31.gate_proj:  17%|█▋        | 6323/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.31.up_proj:  17%|█▋        | 6324/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.31.down_proj:  17%|█▋        | 6325/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.32.gate_proj:  17%|█▋        | 6326/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.32.up_proj:  17%|█▋        | 6327/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.32.down_proj:  17%|█▋        | 6328/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.33.gate_proj:  17%|█▋        | 6329/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.33.up_proj:  17%|█▋        | 6330/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.33.down_proj:  17%|█▋        | 6331/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.34.gate_proj:  17%|█▋        | 6332/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.34.up_proj:  17%|█▋        | 6333/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.34.down_proj:  17%|█▋        | 6334/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.35.gate_proj:  17%|█▋        | 6335/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.35.up_proj:  17%|█▋        | 6336/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.35.down_proj:  17%|█▋        | 6337/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.36.gate_proj:  17%|█▋        | 6338/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.36.up_proj:  17%|█▋        | 6339/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.36.down_proj:  17%|█▋        | 6340/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.37.gate_proj:  17%|█▋        | 6341/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.37.up_proj:  17%|█▋        | 6342/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.37.down_proj:  17%|█▋        | 6343/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.38.gate_proj:  17%|█▋        | 6344/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.38.up_proj:  17%|█▋        | 6345/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.38.down_proj:  17%|█▋        | 6346/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.39.gate_proj:  17%|█▋        | 6347/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.39.up_proj:  17%|█▋        | 6348/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.39.down_proj:  17%|█▋        | 6349/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.40.gate_proj:  17%|█▋        | 6350/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.40.up_proj:  17%|█▋        | 6351/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.40.down_proj:  17%|█▋        | 6352/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.41.gate_proj:  17%|█▋        | 6353/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.41.up_proj:  17%|█▋        | 6354/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.41.down_proj:  17%|█▋        | 6355/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.42.gate_proj:  17%|█▋        | 6356/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.42.up_proj:  17%|█▋        | 6357/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.42.down_proj:  17%|█▋        | 6358/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.43.gate_proj:  17%|█▋        | 6359/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.43.up_proj:  17%|█▋        | 6360/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.43.down_proj:  17%|█▋        | 6361/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.44.gate_proj:  17%|█▋        | 6362/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.44.up_proj:  17%|█▋        | 6363/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.44.down_proj:  17%|█▋        | 6364/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.45.gate_proj:  17%|█▋        | 6365/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.45.up_proj:  17%|█▋        | 6366/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.45.down_proj:  17%|█▋        | 6367/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.46.gate_proj:  17%|█▋        | 6368/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.46.up_proj:  17%|█▋        | 6369/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.46.down_proj:  17%|█▋        | 6370/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.47.gate_proj:  17%|█▋        | 6371/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.47.up_proj:  17%|█▋        | 6372/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.47.down_proj:  17%|█▋        | 6373/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.48.gate_proj:  17%|█▋        | 6374/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.48.up_proj:  17%|█▋        | 6375/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.48.down_proj:  17%|█▋        | 6376/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.49.gate_proj:  17%|█▋        | 6377/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.49.up_proj:  17%|█▋        | 6378/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.49.down_proj:  17%|█▋        | 6379/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.50.gate_proj:  17%|█▋        | 6380/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.50.up_proj:  17%|█▋        | 6381/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.50.down_proj:  17%|█▋        | 6382/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.51.gate_proj:  17%|█▋        | 6383/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.51.up_proj:  17%|█▋        | 6384/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.51.down_proj:  17%|█▋        | 6385/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.52.gate_proj:  17%|█▋        | 6386/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.52.up_proj:  17%|█▋        | 6387/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.52.down_proj:  17%|█▋        | 6388/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.53.gate_proj:  17%|█▋        | 6389/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.53.up_proj:  17%|█▋        | 6390/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.53.down_proj:  17%|█▋        | 6391/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.54.gate_proj:  17%|█▋        | 6392/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.54.up_proj:  17%|█▋        | 6393/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.54.down_proj:  17%|█▋        | 6394/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.55.gate_proj:  17%|█▋        | 6395/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.55.up_proj:  17%|█▋        | 6396/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.55.down_proj:  17%|█▋        | 6397/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.56.gate_proj:  17%|█▋        | 6398/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.56.up_proj:  17%|█▋        | 6399/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.56.down_proj:  18%|█▊        | 6400/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.57.gate_proj:  18%|█▊        | 6401/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.57.up_proj:  18%|█▊        | 6402/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.57.down_proj:  18%|█▊        | 6403/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.58.gate_proj:  18%|█▊        | 6404/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.58.up_proj:  18%|█▊        | 6405/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.58.down_proj:  18%|█▊        | 6406/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.59.gate_proj:  18%|█▊        | 6407/36566 [00:06<00:25, 1165.66it/s]
packing model.layers.15.mlp.experts.59.up_proj:  18%|█▊        | 6408/36566 [00:06<00:25, 1165.66it/s]  
packing model.layers.15.mlp.experts.59.up_proj:  18%|█▊        | 6409/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.59.down_proj:  18%|█▊        | 6409/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.60.gate_proj:  18%|█▊        | 6410/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.60.up_proj:  18%|█▊        | 6411/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.60.down_proj:  18%|█▊        | 6412/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.61.gate_proj:  18%|█▊        | 6413/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.61.up_proj:  18%|█▊        | 6414/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.61.down_proj:  18%|█▊        | 6415/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.62.gate_proj:  18%|█▊        | 6416/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.62.up_proj:  18%|█▊        | 6417/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.62.down_proj:  18%|█▊        | 6418/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.63.gate_proj:  18%|█▊        | 6419/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.63.up_proj:  18%|█▊        | 6420/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.63.down_proj:  18%|█▊        | 6421/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.64.gate_proj:  18%|█▊        | 6422/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.64.up_proj:  18%|█▊        | 6423/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.64.down_proj:  18%|█▊        | 6424/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.65.gate_proj:  18%|█▊        | 6425/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.65.up_proj:  18%|█▊        | 6426/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.65.down_proj:  18%|█▊        | 6427/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.66.gate_proj:  18%|█▊        | 6428/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.66.up_proj:  18%|█▊        | 6429/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.66.down_proj:  18%|█▊        | 6430/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.67.gate_proj:  18%|█▊        | 6431/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.67.up_proj:  18%|█▊        | 6432/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.67.down_proj:  18%|█▊        | 6433/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.68.gate_proj:  18%|█▊        | 6434/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.68.up_proj:  18%|█▊        | 6435/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.68.down_proj:  18%|█▊        | 6436/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.69.gate_proj:  18%|█▊        | 6437/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.69.up_proj:  18%|█▊        | 6438/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.69.down_proj:  18%|█▊        | 6439/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.70.gate_proj:  18%|█▊        | 6440/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.70.up_proj:  18%|█▊        | 6441/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.70.down_proj:  18%|█▊        | 6442/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.71.gate_proj:  18%|█▊        | 6443/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.71.up_proj:  18%|█▊        | 6444/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.71.down_proj:  18%|█▊        | 6445/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.72.gate_proj:  18%|█▊        | 6446/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.72.up_proj:  18%|█▊        | 6447/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.72.down_proj:  18%|█▊        | 6448/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.73.gate_proj:  18%|█▊        | 6449/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.73.up_proj:  18%|█▊        | 6450/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.73.down_proj:  18%|█▊        | 6451/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.74.gate_proj:  18%|█▊        | 6452/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.74.up_proj:  18%|█▊        | 6453/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.74.down_proj:  18%|█▊        | 6454/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.75.gate_proj:  18%|█▊        | 6455/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.75.up_proj:  18%|█▊        | 6456/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.75.down_proj:  18%|█▊        | 6457/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.76.gate_proj:  18%|█▊        | 6458/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.76.up_proj:  18%|█▊        | 6459/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.76.down_proj:  18%|█▊        | 6460/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.77.gate_proj:  18%|█▊        | 6461/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.77.up_proj:  18%|█▊        | 6462/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.77.down_proj:  18%|█▊        | 6463/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.78.gate_proj:  18%|█▊        | 6464/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.78.up_proj:  18%|█▊        | 6465/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.78.down_proj:  18%|█▊        | 6466/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.79.gate_proj:  18%|█▊        | 6467/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.79.up_proj:  18%|█▊        | 6468/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.79.down_proj:  18%|█▊        | 6469/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.80.gate_proj:  18%|█▊        | 6470/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.80.up_proj:  18%|█▊        | 6471/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.80.down_proj:  18%|█▊        | 6472/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.81.gate_proj:  18%|█▊        | 6473/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.81.up_proj:  18%|█▊        | 6474/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.81.down_proj:  18%|█▊        | 6475/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.82.gate_proj:  18%|█▊        | 6476/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.82.up_proj:  18%|█▊        | 6477/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.82.down_proj:  18%|█▊        | 6478/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.83.gate_proj:  18%|█▊        | 6479/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.83.up_proj:  18%|█▊        | 6480/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.83.down_proj:  18%|█▊        | 6481/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.84.gate_proj:  18%|█▊        | 6482/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.84.up_proj:  18%|█▊        | 6483/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.84.down_proj:  18%|█▊        | 6484/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.85.gate_proj:  18%|█▊        | 6485/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.85.up_proj:  18%|█▊        | 6486/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.85.down_proj:  18%|█▊        | 6487/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.86.gate_proj:  18%|█▊        | 6488/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.86.up_proj:  18%|█▊        | 6489/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.86.down_proj:  18%|█▊        | 6490/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.87.gate_proj:  18%|█▊        | 6491/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.87.up_proj:  18%|█▊        | 6492/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.87.down_proj:  18%|█▊        | 6493/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.88.gate_proj:  18%|█▊        | 6494/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.88.up_proj:  18%|█▊        | 6495/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.88.down_proj:  18%|█▊        | 6496/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.89.gate_proj:  18%|█▊        | 6497/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.89.up_proj:  18%|█▊        | 6498/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.89.down_proj:  18%|█▊        | 6499/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.90.gate_proj:  18%|█▊        | 6500/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.90.up_proj:  18%|█▊        | 6501/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.90.down_proj:  18%|█▊        | 6502/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.91.gate_proj:  18%|█▊        | 6503/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.91.up_proj:  18%|█▊        | 6504/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.91.down_proj:  18%|█▊        | 6505/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.92.gate_proj:  18%|█▊        | 6506/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.92.up_proj:  18%|█▊        | 6507/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.92.down_proj:  18%|█▊        | 6508/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.93.gate_proj:  18%|█▊        | 6509/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.93.up_proj:  18%|█▊        | 6510/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.93.down_proj:  18%|█▊        | 6511/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.94.gate_proj:  18%|█▊        | 6512/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.94.up_proj:  18%|█▊        | 6513/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.94.down_proj:  18%|█▊        | 6514/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.95.gate_proj:  18%|█▊        | 6515/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.95.up_proj:  18%|█▊        | 6516/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.95.down_proj:  18%|█▊        | 6517/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.96.gate_proj:  18%|█▊        | 6518/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.96.up_proj:  18%|█▊        | 6519/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.96.down_proj:  18%|█▊        | 6520/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.97.gate_proj:  18%|█▊        | 6521/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.97.up_proj:  18%|█▊        | 6522/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.97.down_proj:  18%|█▊        | 6523/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.98.gate_proj:  18%|█▊        | 6524/36566 [00:06<00:25, 1167.25it/s]
packing model.layers.15.mlp.experts.98.up_proj:  18%|█▊        | 6525/36566 [00:06<00:25, 1167.25it/s]  
packing model.layers.15.mlp.experts.98.up_proj:  18%|█▊        | 6526/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.98.down_proj:  18%|█▊        | 6526/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.99.gate_proj:  18%|█▊        | 6527/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.99.up_proj:  18%|█▊        | 6528/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.99.down_proj:  18%|█▊        | 6529/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.100.gate_proj:  18%|█▊        | 6530/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.100.up_proj:  18%|█▊        | 6531/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.100.down_proj:  18%|█▊        | 6532/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.101.gate_proj:  18%|█▊        | 6533/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.101.up_proj:  18%|█▊        | 6534/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.101.down_proj:  18%|█▊        | 6535/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.102.gate_proj:  18%|█▊        | 6536/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.102.up_proj:  18%|█▊        | 6537/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.102.down_proj:  18%|█▊        | 6538/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.103.gate_proj:  18%|█▊        | 6539/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.103.up_proj:  18%|█▊        | 6540/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.103.down_proj:  18%|█▊        | 6541/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.104.gate_proj:  18%|█▊        | 6542/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.104.up_proj:  18%|█▊        | 6543/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.104.down_proj:  18%|█▊        | 6544/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.105.gate_proj:  18%|█▊        | 6545/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.105.up_proj:  18%|█▊        | 6546/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.105.down_proj:  18%|█▊        | 6547/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.106.gate_proj:  18%|█▊        | 6548/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.106.up_proj:  18%|█▊        | 6549/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.106.down_proj:  18%|█▊        | 6550/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.107.gate_proj:  18%|█▊        | 6551/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.107.up_proj:  18%|█▊        | 6552/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.107.down_proj:  18%|█▊        | 6553/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.108.gate_proj:  18%|█▊        | 6554/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.108.up_proj:  18%|█▊        | 6555/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.108.down_proj:  18%|█▊        | 6556/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.109.gate_proj:  18%|█▊        | 6557/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.109.up_proj:  18%|█▊        | 6558/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.109.down_proj:  18%|█▊        | 6559/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.110.gate_proj:  18%|█▊        | 6560/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.110.up_proj:  18%|█▊        | 6561/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.110.down_proj:  18%|█▊        | 6562/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.111.gate_proj:  18%|█▊        | 6563/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.111.up_proj:  18%|█▊        | 6564/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.111.down_proj:  18%|█▊        | 6565/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.112.gate_proj:  18%|█▊        | 6566/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.112.up_proj:  18%|█▊        | 6567/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.112.down_proj:  18%|█▊        | 6568/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.113.gate_proj:  18%|█▊        | 6569/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.113.up_proj:  18%|█▊        | 6570/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.113.down_proj:  18%|█▊        | 6571/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.114.gate_proj:  18%|█▊        | 6572/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.114.up_proj:  18%|█▊        | 6573/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.114.down_proj:  18%|█▊        | 6574/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.115.gate_proj:  18%|█▊        | 6575/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.115.up_proj:  18%|█▊        | 6576/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.115.down_proj:  18%|█▊        | 6577/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.116.gate_proj:  18%|█▊        | 6578/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.116.up_proj:  18%|█▊        | 6579/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.116.down_proj:  18%|█▊        | 6580/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.117.gate_proj:  18%|█▊        | 6581/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.117.up_proj:  18%|█▊        | 6582/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.117.down_proj:  18%|█▊        | 6583/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.118.gate_proj:  18%|█▊        | 6584/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.118.up_proj:  18%|█▊        | 6585/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.118.down_proj:  18%|█▊        | 6586/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.119.gate_proj:  18%|█▊        | 6587/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.119.up_proj:  18%|█▊        | 6588/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.119.down_proj:  18%|█▊        | 6589/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.120.gate_proj:  18%|█▊        | 6590/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.120.up_proj:  18%|█▊        | 6591/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.120.down_proj:  18%|█▊        | 6592/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.121.gate_proj:  18%|█▊        | 6593/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.121.up_proj:  18%|█▊        | 6594/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.121.down_proj:  18%|█▊        | 6595/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.122.gate_proj:  18%|█▊        | 6596/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.122.up_proj:  18%|█▊        | 6597/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.122.down_proj:  18%|█▊        | 6598/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.123.gate_proj:  18%|█▊        | 6599/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.123.up_proj:  18%|█▊        | 6600/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.123.down_proj:  18%|█▊        | 6601/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.124.gate_proj:  18%|█▊        | 6602/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.124.up_proj:  18%|█▊        | 6603/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.124.down_proj:  18%|█▊        | 6604/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.125.gate_proj:  18%|█▊        | 6605/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.125.up_proj:  18%|█▊        | 6606/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.125.down_proj:  18%|█▊        | 6607/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.126.gate_proj:  18%|█▊        | 6608/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.126.up_proj:  18%|█▊        | 6609/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.126.down_proj:  18%|█▊        | 6610/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.127.gate_proj:  18%|█▊        | 6611/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.15.mlp.experts.127.up_proj:  18%|█▊        | 6612/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.15.mlp.experts.127.down_proj:  18%|█▊        | 6613/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.0.gate_proj:  18%|█▊        | 6614/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.0.up_proj:  18%|█▊        | 6615/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.0.down_proj:  18%|█▊        | 6616/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.1.gate_proj:  18%|█▊        | 6617/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.1.up_proj:  18%|█▊        | 6618/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.1.down_proj:  18%|█▊        | 6619/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.2.gate_proj:  18%|█▊        | 6620/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.2.up_proj:  18%|█▊        | 6621/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.2.down_proj:  18%|█▊        | 6622/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.3.gate_proj:  18%|█▊        | 6623/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.3.up_proj:  18%|█▊        | 6624/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.3.down_proj:  18%|█▊        | 6625/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.4.gate_proj:  18%|█▊        | 6626/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.4.up_proj:  18%|█▊        | 6627/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.4.down_proj:  18%|█▊        | 6628/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.5.gate_proj:  18%|█▊        | 6629/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.5.up_proj:  18%|█▊        | 6630/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.5.down_proj:  18%|█▊        | 6631/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.6.gate_proj:  18%|█▊        | 6632/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.6.up_proj:  18%|█▊        | 6633/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.6.down_proj:  18%|█▊        | 6634/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.7.gate_proj:  18%|█▊        | 6635/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.7.up_proj:  18%|█▊        | 6636/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.7.down_proj:  18%|█▊        | 6637/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.8.gate_proj:  18%|█▊        | 6638/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.8.up_proj:  18%|█▊        | 6639/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.8.down_proj:  18%|█▊        | 6640/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.9.gate_proj:  18%|█▊        | 6641/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.9.up_proj:  18%|█▊        | 6642/36566 [00:06<00:25, 1167.48it/s]  
packing model.layers.16.mlp.experts.9.down_proj:  18%|█▊        | 6643/36566 [00:06<00:25, 1167.48it/s]
packing model.layers.16.mlp.experts.9.down_proj:  18%|█▊        | 6644/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.10.gate_proj:  18%|█▊        | 6644/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.10.up_proj:  18%|█▊        | 6645/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.10.down_proj:  18%|█▊        | 6646/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.11.gate_proj:  18%|█▊        | 6647/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.11.up_proj:  18%|█▊        | 6648/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.11.down_proj:  18%|█▊        | 6649/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.12.gate_proj:  18%|█▊        | 6650/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.12.up_proj:  18%|█▊        | 6651/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.12.down_proj:  18%|█▊        | 6652/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.13.gate_proj:  18%|█▊        | 6653/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.13.up_proj:  18%|█▊        | 6654/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.13.down_proj:  18%|█▊        | 6655/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.14.gate_proj:  18%|█▊        | 6656/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.14.up_proj:  18%|█▊        | 6657/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.14.down_proj:  18%|█▊        | 6658/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.15.gate_proj:  18%|█▊        | 6659/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.15.up_proj:  18%|█▊        | 6660/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.15.down_proj:  18%|█▊        | 6661/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.16.gate_proj:  18%|█▊        | 6662/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.16.up_proj:  18%|█▊        | 6663/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.16.down_proj:  18%|█▊        | 6664/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.17.gate_proj:  18%|█▊        | 6665/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.17.up_proj:  18%|█▊        | 6666/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.17.down_proj:  18%|█▊        | 6667/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.18.gate_proj:  18%|█▊        | 6668/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.18.up_proj:  18%|█▊        | 6669/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.18.down_proj:  18%|█▊        | 6670/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.19.gate_proj:  18%|█▊        | 6671/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.19.up_proj:  18%|█▊        | 6672/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.19.down_proj:  18%|█▊        | 6673/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.20.gate_proj:  18%|█▊        | 6674/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.20.up_proj:  18%|█▊        | 6675/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.20.down_proj:  18%|█▊        | 6676/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.21.gate_proj:  18%|█▊        | 6677/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.21.up_proj:  18%|█▊        | 6678/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.21.down_proj:  18%|█▊        | 6679/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.22.gate_proj:  18%|█▊        | 6680/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.22.up_proj:  18%|█▊        | 6681/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.22.down_proj:  18%|█▊        | 6682/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.23.gate_proj:  18%|█▊        | 6683/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.23.up_proj:  18%|█▊        | 6684/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.23.down_proj:  18%|█▊        | 6685/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.24.gate_proj:  18%|█▊        | 6686/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.24.up_proj:  18%|█▊        | 6687/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.24.down_proj:  18%|█▊        | 6688/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.25.gate_proj:  18%|█▊        | 6689/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.25.up_proj:  18%|█▊        | 6690/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.25.down_proj:  18%|█▊        | 6691/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.26.gate_proj:  18%|█▊        | 6692/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.26.up_proj:  18%|█▊        | 6693/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.26.down_proj:  18%|█▊        | 6694/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.27.gate_proj:  18%|█▊        | 6695/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.27.up_proj:  18%|█▊        | 6696/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.27.down_proj:  18%|█▊        | 6697/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.28.gate_proj:  18%|█▊        | 6698/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.28.up_proj:  18%|█▊        | 6699/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.28.down_proj:  18%|█▊        | 6700/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.29.gate_proj:  18%|█▊        | 6701/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.29.up_proj:  18%|█▊        | 6702/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.29.down_proj:  18%|█▊        | 6703/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.30.gate_proj:  18%|█▊        | 6704/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.30.up_proj:  18%|█▊        | 6705/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.30.down_proj:  18%|█▊        | 6706/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.31.gate_proj:  18%|█▊        | 6707/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.31.up_proj:  18%|█▊        | 6708/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.31.down_proj:  18%|█▊        | 6709/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.32.gate_proj:  18%|█▊        | 6710/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.32.up_proj:  18%|█▊        | 6711/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.32.down_proj:  18%|█▊        | 6712/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.33.gate_proj:  18%|█▊        | 6713/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.33.up_proj:  18%|█▊        | 6714/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.33.down_proj:  18%|█▊        | 6715/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.34.gate_proj:  18%|█▊        | 6716/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.34.up_proj:  18%|█▊        | 6717/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.34.down_proj:  18%|█▊        | 6718/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.35.gate_proj:  18%|█▊        | 6719/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.35.up_proj:  18%|█▊        | 6720/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.35.down_proj:  18%|█▊        | 6721/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.36.gate_proj:  18%|█▊        | 6722/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.36.up_proj:  18%|█▊        | 6723/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.36.down_proj:  18%|█▊        | 6724/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.37.gate_proj:  18%|█▊        | 6725/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.37.up_proj:  18%|█▊        | 6726/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.37.down_proj:  18%|█▊        | 6727/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.38.gate_proj:  18%|█▊        | 6728/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.38.up_proj:  18%|█▊        | 6729/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.38.down_proj:  18%|█▊        | 6730/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.39.gate_proj:  18%|█▊        | 6731/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.39.up_proj:  18%|█▊        | 6732/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.39.down_proj:  18%|█▊        | 6733/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.40.gate_proj:  18%|█▊        | 6734/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.40.up_proj:  18%|█▊        | 6735/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.40.down_proj:  18%|█▊        | 6736/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.41.gate_proj:  18%|█▊        | 6737/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.41.up_proj:  18%|█▊        | 6738/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.41.down_proj:  18%|█▊        | 6739/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.42.gate_proj:  18%|█▊        | 6740/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.42.up_proj:  18%|█▊        | 6741/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.42.down_proj:  18%|█▊        | 6742/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.43.gate_proj:  18%|█▊        | 6743/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.43.up_proj:  18%|█▊        | 6744/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.43.down_proj:  18%|█▊        | 6745/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.44.gate_proj:  18%|█▊        | 6746/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.44.up_proj:  18%|█▊        | 6747/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.44.down_proj:  18%|█▊        | 6748/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.45.gate_proj:  18%|█▊        | 6749/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.45.up_proj:  18%|█▊        | 6750/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.45.down_proj:  18%|█▊        | 6751/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.46.gate_proj:  18%|█▊        | 6752/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.46.up_proj:  18%|█▊        | 6753/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.46.down_proj:  18%|█▊        | 6754/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.47.gate_proj:  18%|█▊        | 6755/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.47.up_proj:  18%|█▊        | 6756/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.47.down_proj:  18%|█▊        | 6757/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.48.gate_proj:  18%|█▊        | 6758/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.48.up_proj:  18%|█▊        | 6759/36566 [00:06<00:25, 1168.48it/s]  
packing model.layers.16.mlp.experts.48.down_proj:  18%|█▊        | 6760/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.49.gate_proj:  18%|█▊        | 6761/36566 [00:06<00:25, 1168.48it/s]
packing model.layers.16.mlp.experts.49.gate_proj:  18%|█▊        | 6762/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.49.up_proj:  18%|█▊        | 6762/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.49.down_proj:  18%|█▊        | 6763/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.50.gate_proj:  18%|█▊        | 6764/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.50.up_proj:  19%|█▊        | 6765/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.50.down_proj:  19%|█▊        | 6766/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.51.gate_proj:  19%|█▊        | 6767/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.51.up_proj:  19%|█▊        | 6768/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.51.down_proj:  19%|█▊        | 6769/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.52.gate_proj:  19%|█▊        | 6770/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.52.up_proj:  19%|█▊        | 6771/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.52.down_proj:  19%|█▊        | 6772/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.53.gate_proj:  19%|█▊        | 6773/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.53.up_proj:  19%|█▊        | 6774/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.53.down_proj:  19%|█▊        | 6775/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.54.gate_proj:  19%|█▊        | 6776/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.54.up_proj:  19%|█▊        | 6777/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.54.down_proj:  19%|█▊        | 6778/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.55.gate_proj:  19%|█▊        | 6779/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.55.up_proj:  19%|█▊        | 6780/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.55.down_proj:  19%|█▊        | 6781/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.56.gate_proj:  19%|█▊        | 6782/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.56.up_proj:  19%|█▊        | 6783/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.56.down_proj:  19%|█▊        | 6784/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.57.gate_proj:  19%|█▊        | 6785/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.57.up_proj:  19%|█▊        | 6786/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.57.down_proj:  19%|█▊        | 6787/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.58.gate_proj:  19%|█▊        | 6788/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.58.up_proj:  19%|█▊        | 6789/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.58.down_proj:  19%|█▊        | 6790/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.59.gate_proj:  19%|█▊        | 6791/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.59.up_proj:  19%|█▊        | 6792/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.59.down_proj:  19%|█▊        | 6793/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.60.gate_proj:  19%|█▊        | 6794/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.60.up_proj:  19%|█▊        | 6795/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.60.down_proj:  19%|█▊        | 6796/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.61.gate_proj:  19%|█▊        | 6797/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.61.up_proj:  19%|█▊        | 6798/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.61.down_proj:  19%|█▊        | 6799/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.62.gate_proj:  19%|█▊        | 6800/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.62.up_proj:  19%|█▊        | 6801/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.62.down_proj:  19%|█▊        | 6802/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.63.gate_proj:  19%|█▊        | 6803/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.63.up_proj:  19%|█▊        | 6804/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.63.down_proj:  19%|█▊        | 6805/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.64.gate_proj:  19%|█▊        | 6806/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.64.up_proj:  19%|█▊        | 6807/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.64.down_proj:  19%|█▊        | 6808/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.65.gate_proj:  19%|█▊        | 6809/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.65.up_proj:  19%|█▊        | 6810/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.65.down_proj:  19%|█▊        | 6811/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.66.gate_proj:  19%|█▊        | 6812/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.66.up_proj:  19%|█▊        | 6813/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.66.down_proj:  19%|█▊        | 6814/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.67.gate_proj:  19%|█▊        | 6815/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.67.up_proj:  19%|█▊        | 6816/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.67.down_proj:  19%|█▊        | 6817/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.68.gate_proj:  19%|█▊        | 6818/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.68.up_proj:  19%|█▊        | 6819/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.68.down_proj:  19%|█▊        | 6820/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.69.gate_proj:  19%|█▊        | 6821/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.69.up_proj:  19%|█▊        | 6822/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.69.down_proj:  19%|█▊        | 6823/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.70.gate_proj:  19%|█▊        | 6824/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.70.up_proj:  19%|█▊        | 6825/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.70.down_proj:  19%|█▊        | 6826/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.71.gate_proj:  19%|█▊        | 6827/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.71.up_proj:  19%|█▊        | 6828/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.71.down_proj:  19%|█▊        | 6829/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.72.gate_proj:  19%|█▊        | 6830/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.72.up_proj:  19%|█▊        | 6831/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.72.down_proj:  19%|█▊        | 6832/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.73.gate_proj:  19%|█▊        | 6833/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.73.up_proj:  19%|█▊        | 6834/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.73.down_proj:  19%|█▊        | 6835/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.74.gate_proj:  19%|█▊        | 6836/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.74.up_proj:  19%|█▊        | 6837/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.74.down_proj:  19%|█▊        | 6838/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.75.gate_proj:  19%|█▊        | 6839/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.75.up_proj:  19%|█▊        | 6840/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.75.down_proj:  19%|█▊        | 6841/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.76.gate_proj:  19%|█▊        | 6842/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.76.up_proj:  19%|█▊        | 6843/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.76.down_proj:  19%|█▊        | 6844/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.77.gate_proj:  19%|█▊        | 6845/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.77.up_proj:  19%|█▊        | 6846/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.77.down_proj:  19%|█▊        | 6847/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.78.gate_proj:  19%|█▊        | 6848/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.78.up_proj:  19%|█▊        | 6849/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.78.down_proj:  19%|█▊        | 6850/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.79.gate_proj:  19%|█▊        | 6851/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.79.up_proj:  19%|█▊        | 6852/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.79.down_proj:  19%|█▊        | 6853/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.80.gate_proj:  19%|█▊        | 6854/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.80.up_proj:  19%|█▊        | 6855/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.80.down_proj:  19%|█▊        | 6856/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.81.gate_proj:  19%|█▉        | 6857/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.81.up_proj:  19%|█▉        | 6858/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.81.down_proj:  19%|█▉        | 6859/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.82.gate_proj:  19%|█▉        | 6860/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.82.up_proj:  19%|█▉        | 6861/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.82.down_proj:  19%|█▉        | 6862/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.83.gate_proj:  19%|█▉        | 6863/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.83.up_proj:  19%|█▉        | 6864/36566 [00:06<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.83.down_proj:  19%|█▉        | 6865/36566 [00:06<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.84.gate_proj:  19%|█▉        | 6866/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.84.up_proj:  19%|█▉        | 6867/36566 [00:07<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.84.down_proj:  19%|█▉        | 6868/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.85.gate_proj:  19%|█▉        | 6869/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.85.up_proj:  19%|█▉        | 6870/36566 [00:07<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.85.down_proj:  19%|█▉        | 6871/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.86.gate_proj:  19%|█▉        | 6872/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.86.up_proj:  19%|█▉        | 6873/36566 [00:07<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.86.down_proj:  19%|█▉        | 6874/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.87.gate_proj:  19%|█▉        | 6875/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.87.up_proj:  19%|█▉        | 6876/36566 [00:07<00:25, 1169.78it/s]  
packing model.layers.16.mlp.experts.87.down_proj:  19%|█▉        | 6877/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.88.gate_proj:  19%|█▉        | 6878/36566 [00:07<00:25, 1169.78it/s]
packing model.layers.16.mlp.experts.88.gate_proj:  19%|█▉        | 6879/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.88.up_proj:  19%|█▉        | 6879/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.88.down_proj:  19%|█▉        | 6880/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.89.gate_proj:  19%|█▉        | 6881/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.89.up_proj:  19%|█▉        | 6882/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.89.down_proj:  19%|█▉        | 6883/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.90.gate_proj:  19%|█▉        | 6884/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.90.up_proj:  19%|█▉        | 6885/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.90.down_proj:  19%|█▉        | 6886/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.91.gate_proj:  19%|█▉        | 6887/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.91.up_proj:  19%|█▉        | 6888/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.91.down_proj:  19%|█▉        | 6889/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.92.gate_proj:  19%|█▉        | 6890/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.92.up_proj:  19%|█▉        | 6891/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.92.down_proj:  19%|█▉        | 6892/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.93.gate_proj:  19%|█▉        | 6893/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.93.up_proj:  19%|█▉        | 6894/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.93.down_proj:  19%|█▉        | 6895/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.94.gate_proj:  19%|█▉        | 6896/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.94.up_proj:  19%|█▉        | 6897/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.94.down_proj:  19%|█▉        | 6898/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.95.gate_proj:  19%|█▉        | 6899/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.95.up_proj:  19%|█▉        | 6900/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.95.down_proj:  19%|█▉        | 6901/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.96.gate_proj:  19%|█▉        | 6902/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.96.up_proj:  19%|█▉        | 6903/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.96.down_proj:  19%|█▉        | 6904/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.97.gate_proj:  19%|█▉        | 6905/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.97.up_proj:  19%|█▉        | 6906/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.97.down_proj:  19%|█▉        | 6907/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.98.gate_proj:  19%|█▉        | 6908/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.98.up_proj:  19%|█▉        | 6909/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.98.down_proj:  19%|█▉        | 6910/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.99.gate_proj:  19%|█▉        | 6911/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.99.up_proj:  19%|█▉        | 6912/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.99.down_proj:  19%|█▉        | 6913/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.100.gate_proj:  19%|█▉        | 6914/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.100.up_proj:  19%|█▉        | 6915/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.100.down_proj:  19%|█▉        | 6916/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.101.gate_proj:  19%|█▉        | 6917/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.101.up_proj:  19%|█▉        | 6918/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.101.down_proj:  19%|█▉        | 6919/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.102.gate_proj:  19%|█▉        | 6920/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.102.up_proj:  19%|█▉        | 6921/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.102.down_proj:  19%|█▉        | 6922/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.103.gate_proj:  19%|█▉        | 6923/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.103.up_proj:  19%|█▉        | 6924/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.103.down_proj:  19%|█▉        | 6925/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.104.gate_proj:  19%|█▉        | 6926/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.104.up_proj:  19%|█▉        | 6927/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.104.down_proj:  19%|█▉        | 6928/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.105.gate_proj:  19%|█▉        | 6929/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.105.up_proj:  19%|█▉        | 6930/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.105.down_proj:  19%|█▉        | 6931/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.106.gate_proj:  19%|█▉        | 6932/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.106.up_proj:  19%|█▉        | 6933/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.106.down_proj:  19%|█▉        | 6934/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.107.gate_proj:  19%|█▉        | 6935/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.107.up_proj:  19%|█▉        | 6936/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.107.down_proj:  19%|█▉        | 6937/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.108.gate_proj:  19%|█▉        | 6938/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.108.up_proj:  19%|█▉        | 6939/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.108.down_proj:  19%|█▉        | 6940/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.109.gate_proj:  19%|█▉        | 6941/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.109.up_proj:  19%|█▉        | 6942/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.109.down_proj:  19%|█▉        | 6943/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.110.gate_proj:  19%|█▉        | 6944/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.110.up_proj:  19%|█▉        | 6945/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.110.down_proj:  19%|█▉        | 6946/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.111.gate_proj:  19%|█▉        | 6947/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.111.up_proj:  19%|█▉        | 6948/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.111.down_proj:  19%|█▉        | 6949/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.112.gate_proj:  19%|█▉        | 6950/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.112.up_proj:  19%|█▉        | 6951/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.112.down_proj:  19%|█▉        | 6952/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.113.gate_proj:  19%|█▉        | 6953/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.113.up_proj:  19%|█▉        | 6954/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.113.down_proj:  19%|█▉        | 6955/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.114.gate_proj:  19%|█▉        | 6956/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.114.up_proj:  19%|█▉        | 6957/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.114.down_proj:  19%|█▉        | 6958/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.115.gate_proj:  19%|█▉        | 6959/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.115.up_proj:  19%|█▉        | 6960/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.115.down_proj:  19%|█▉        | 6961/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.116.gate_proj:  19%|█▉        | 6962/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.116.up_proj:  19%|█▉        | 6963/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.116.down_proj:  19%|█▉        | 6964/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.117.gate_proj:  19%|█▉        | 6965/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.117.up_proj:  19%|█▉        | 6966/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.117.down_proj:  19%|█▉        | 6967/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.118.gate_proj:  19%|█▉        | 6968/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.118.up_proj:  19%|█▉        | 6969/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.118.down_proj:  19%|█▉        | 6970/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.119.gate_proj:  19%|█▉        | 6971/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.119.up_proj:  19%|█▉        | 6972/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.119.down_proj:  19%|█▉        | 6973/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.120.gate_proj:  19%|█▉        | 6974/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.120.up_proj:  19%|█▉        | 6975/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.120.down_proj:  19%|█▉        | 6976/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.121.gate_proj:  19%|█▉        | 6977/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.121.up_proj:  19%|█▉        | 6978/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.121.down_proj:  19%|█▉        | 6979/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.122.gate_proj:  19%|█▉        | 6980/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.122.up_proj:  19%|█▉        | 6981/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.122.down_proj:  19%|█▉        | 6982/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.123.gate_proj:  19%|█▉        | 6983/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.123.up_proj:  19%|█▉        | 6984/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.123.down_proj:  19%|█▉        | 6985/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.124.gate_proj:  19%|█▉        | 6986/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.124.up_proj:  19%|█▉        | 6987/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.124.down_proj:  19%|█▉        | 6988/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.125.gate_proj:  19%|█▉        | 6989/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.125.up_proj:  19%|█▉        | 6990/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.125.down_proj:  19%|█▉        | 6991/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.126.gate_proj:  19%|█▉        | 6992/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.126.up_proj:  19%|█▉        | 6993/36566 [00:07<00:25, 1169.54it/s]  
packing model.layers.16.mlp.experts.126.down_proj:  19%|█▉        | 6994/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.127.gate_proj:  19%|█▉        | 6995/36566 [00:07<00:25, 1169.54it/s]
packing model.layers.16.mlp.experts.127.gate_proj:  19%|█▉        | 6996/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.16.mlp.experts.127.up_proj:  19%|█▉        | 6996/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.16.mlp.experts.127.down_proj:  19%|█▉        | 6997/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.0.gate_proj:  19%|█▉        | 6998/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.0.up_proj:  19%|█▉        | 6999/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.0.down_proj:  19%|█▉        | 7000/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.1.gate_proj:  19%|█▉        | 7001/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.1.up_proj:  19%|█▉        | 7002/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.1.down_proj:  19%|█▉        | 7003/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.2.gate_proj:  19%|█▉        | 7004/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.2.up_proj:  19%|█▉        | 7005/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.2.down_proj:  19%|█▉        | 7006/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.3.gate_proj:  19%|█▉        | 7007/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.3.up_proj:  19%|█▉        | 7008/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.3.down_proj:  19%|█▉        | 7009/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.4.gate_proj:  19%|█▉        | 7010/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.4.up_proj:  19%|█▉        | 7011/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.4.down_proj:  19%|█▉        | 7012/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.5.gate_proj:  19%|█▉        | 7013/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.5.up_proj:  19%|█▉        | 7014/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.5.down_proj:  19%|█▉        | 7015/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.6.gate_proj:  19%|█▉        | 7016/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.6.up_proj:  19%|█▉        | 7017/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.6.down_proj:  19%|█▉        | 7018/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.7.gate_proj:  19%|█▉        | 7019/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.7.up_proj:  19%|█▉        | 7020/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.7.down_proj:  19%|█▉        | 7021/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.8.gate_proj:  19%|█▉        | 7022/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.8.up_proj:  19%|█▉        | 7023/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.8.down_proj:  19%|█▉        | 7024/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.9.gate_proj:  19%|█▉        | 7025/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.9.up_proj:  19%|█▉        | 7026/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.9.down_proj:  19%|█▉        | 7027/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.10.gate_proj:  19%|█▉        | 7028/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.10.up_proj:  19%|█▉        | 7029/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.10.down_proj:  19%|█▉        | 7030/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.11.gate_proj:  19%|█▉        | 7031/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.11.up_proj:  19%|█▉        | 7032/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.11.down_proj:  19%|█▉        | 7033/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.12.gate_proj:  19%|█▉        | 7034/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.12.up_proj:  19%|█▉        | 7035/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.12.down_proj:  19%|█▉        | 7036/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.13.gate_proj:  19%|█▉        | 7037/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.13.up_proj:  19%|█▉        | 7038/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.13.down_proj:  19%|█▉        | 7039/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.14.gate_proj:  19%|█▉        | 7040/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.14.up_proj:  19%|█▉        | 7041/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.14.down_proj:  19%|█▉        | 7042/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.15.gate_proj:  19%|█▉        | 7043/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.15.up_proj:  19%|█▉        | 7044/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.15.down_proj:  19%|█▉        | 7045/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.16.gate_proj:  19%|█▉        | 7046/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.16.up_proj:  19%|█▉        | 7047/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.16.down_proj:  19%|█▉        | 7048/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.17.gate_proj:  19%|█▉        | 7049/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.17.up_proj:  19%|█▉        | 7050/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.17.down_proj:  19%|█▉        | 7051/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.18.gate_proj:  19%|█▉        | 7052/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.18.up_proj:  19%|█▉        | 7053/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.18.down_proj:  19%|█▉        | 7054/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.19.gate_proj:  19%|█▉        | 7055/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.19.up_proj:  19%|█▉        | 7056/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.19.down_proj:  19%|█▉        | 7057/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.20.gate_proj:  19%|█▉        | 7058/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.20.up_proj:  19%|█▉        | 7059/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.20.down_proj:  19%|█▉        | 7060/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.21.gate_proj:  19%|█▉        | 7061/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.21.up_proj:  19%|█▉        | 7062/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.21.down_proj:  19%|█▉        | 7063/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.22.gate_proj:  19%|█▉        | 7064/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.22.up_proj:  19%|█▉        | 7065/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.22.down_proj:  19%|█▉        | 7066/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.23.gate_proj:  19%|█▉        | 7067/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.23.up_proj:  19%|█▉        | 7068/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.23.down_proj:  19%|█▉        | 7069/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.24.gate_proj:  19%|█▉        | 7070/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.24.up_proj:  19%|█▉        | 7071/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.24.down_proj:  19%|█▉        | 7072/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.25.gate_proj:  19%|█▉        | 7073/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.25.up_proj:  19%|█▉        | 7074/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.25.down_proj:  19%|█▉        | 7075/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.26.gate_proj:  19%|█▉        | 7076/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.26.up_proj:  19%|█▉        | 7077/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.26.down_proj:  19%|█▉        | 7078/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.27.gate_proj:  19%|█▉        | 7079/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.27.up_proj:  19%|█▉        | 7080/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.27.down_proj:  19%|█▉        | 7081/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.28.gate_proj:  19%|█▉        | 7082/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.28.up_proj:  19%|█▉        | 7083/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.28.down_proj:  19%|█▉        | 7084/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.29.gate_proj:  19%|█▉        | 7085/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.29.up_proj:  19%|█▉        | 7086/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.29.down_proj:  19%|█▉        | 7087/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.30.gate_proj:  19%|█▉        | 7088/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.30.up_proj:  19%|█▉        | 7089/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.30.down_proj:  19%|█▉        | 7090/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.31.gate_proj:  19%|█▉        | 7091/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.31.up_proj:  19%|█▉        | 7092/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.31.down_proj:  19%|█▉        | 7093/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.32.gate_proj:  19%|█▉        | 7094/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.32.up_proj:  19%|█▉        | 7095/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.32.down_proj:  19%|█▉        | 7096/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.33.gate_proj:  19%|█▉        | 7097/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.33.up_proj:  19%|█▉        | 7098/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.33.down_proj:  19%|█▉        | 7099/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.34.gate_proj:  19%|█▉        | 7100/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.34.up_proj:  19%|█▉        | 7101/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.34.down_proj:  19%|█▉        | 7102/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.35.gate_proj:  19%|█▉        | 7103/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.35.up_proj:  19%|█▉        | 7104/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.35.down_proj:  19%|█▉        | 7105/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.36.gate_proj:  19%|█▉        | 7106/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.36.up_proj:  19%|█▉        | 7107/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.36.down_proj:  19%|█▉        | 7108/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.37.gate_proj:  19%|█▉        | 7109/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.37.up_proj:  19%|█▉        | 7110/36566 [00:07<00:25, 1166.23it/s]  
packing model.layers.17.mlp.experts.37.down_proj:  19%|█▉        | 7111/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.38.gate_proj:  19%|█▉        | 7112/36566 [00:07<00:25, 1166.23it/s]
packing model.layers.17.mlp.experts.38.gate_proj:  19%|█▉        | 7113/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.38.up_proj:  19%|█▉        | 7113/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.38.down_proj:  19%|█▉        | 7114/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.39.gate_proj:  19%|█▉        | 7115/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.39.up_proj:  19%|█▉        | 7116/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.39.down_proj:  19%|█▉        | 7117/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.40.gate_proj:  19%|█▉        | 7118/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.40.up_proj:  19%|█▉        | 7119/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.40.down_proj:  19%|█▉        | 7120/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.41.gate_proj:  19%|█▉        | 7121/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.41.up_proj:  19%|█▉        | 7122/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.41.down_proj:  19%|█▉        | 7123/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.42.gate_proj:  19%|█▉        | 7124/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.42.up_proj:  19%|█▉        | 7125/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.42.down_proj:  19%|█▉        | 7126/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.43.gate_proj:  19%|█▉        | 7127/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.43.up_proj:  19%|█▉        | 7128/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.43.down_proj:  19%|█▉        | 7129/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.44.gate_proj:  19%|█▉        | 7130/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.44.up_proj:  20%|█▉        | 7131/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.44.down_proj:  20%|█▉        | 7132/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.45.gate_proj:  20%|█▉        | 7133/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.45.up_proj:  20%|█▉        | 7134/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.45.down_proj:  20%|█▉        | 7135/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.46.gate_proj:  20%|█▉        | 7136/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.46.up_proj:  20%|█▉        | 7137/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.46.down_proj:  20%|█▉        | 7138/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.47.gate_proj:  20%|█▉        | 7139/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.47.up_proj:  20%|█▉        | 7140/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.47.down_proj:  20%|█▉        | 7141/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.48.gate_proj:  20%|█▉        | 7142/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.48.up_proj:  20%|█▉        | 7143/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.48.down_proj:  20%|█▉        | 7144/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.49.gate_proj:  20%|█▉        | 7145/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.49.up_proj:  20%|█▉        | 7146/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.49.down_proj:  20%|█▉        | 7147/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.50.gate_proj:  20%|█▉        | 7148/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.50.up_proj:  20%|█▉        | 7149/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.50.down_proj:  20%|█▉        | 7150/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.51.gate_proj:  20%|█▉        | 7151/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.51.up_proj:  20%|█▉        | 7152/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.51.down_proj:  20%|█▉        | 7153/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.52.gate_proj:  20%|█▉        | 7154/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.52.up_proj:  20%|█▉        | 7155/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.52.down_proj:  20%|█▉        | 7156/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.53.gate_proj:  20%|█▉        | 7157/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.53.up_proj:  20%|█▉        | 7158/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.53.down_proj:  20%|█▉        | 7159/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.54.gate_proj:  20%|█▉        | 7160/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.54.up_proj:  20%|█▉        | 7161/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.54.down_proj:  20%|█▉        | 7162/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.55.gate_proj:  20%|█▉        | 7163/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.55.up_proj:  20%|█▉        | 7164/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.55.down_proj:  20%|█▉        | 7165/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.56.gate_proj:  20%|█▉        | 7166/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.56.up_proj:  20%|█▉        | 7167/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.56.down_proj:  20%|█▉        | 7168/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.57.gate_proj:  20%|█▉        | 7169/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.57.up_proj:  20%|█▉        | 7170/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.57.down_proj:  20%|█▉        | 7171/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.58.gate_proj:  20%|█▉        | 7172/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.58.up_proj:  20%|█▉        | 7173/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.58.down_proj:  20%|█▉        | 7174/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.59.gate_proj:  20%|█▉        | 7175/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.59.up_proj:  20%|█▉        | 7176/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.59.down_proj:  20%|█▉        | 7177/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.60.gate_proj:  20%|█▉        | 7178/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.60.up_proj:  20%|█▉        | 7179/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.60.down_proj:  20%|█▉        | 7180/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.61.gate_proj:  20%|█▉        | 7181/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.61.up_proj:  20%|█▉        | 7182/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.61.down_proj:  20%|█▉        | 7183/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.62.gate_proj:  20%|█▉        | 7184/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.62.up_proj:  20%|█▉        | 7185/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.62.down_proj:  20%|█▉        | 7186/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.63.gate_proj:  20%|█▉        | 7187/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.63.up_proj:  20%|█▉        | 7188/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.63.down_proj:  20%|█▉        | 7189/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.64.gate_proj:  20%|█▉        | 7190/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.64.up_proj:  20%|█▉        | 7191/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.64.down_proj:  20%|█▉        | 7192/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.65.gate_proj:  20%|█▉        | 7193/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.65.up_proj:  20%|█▉        | 7194/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.65.down_proj:  20%|█▉        | 7195/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.66.gate_proj:  20%|█▉        | 7196/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.66.up_proj:  20%|█▉        | 7197/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.66.down_proj:  20%|█▉        | 7198/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.67.gate_proj:  20%|█▉        | 7199/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.67.up_proj:  20%|█▉        | 7200/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.67.down_proj:  20%|█▉        | 7201/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.68.gate_proj:  20%|█▉        | 7202/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.68.up_proj:  20%|█▉        | 7203/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.68.down_proj:  20%|█▉        | 7204/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.69.gate_proj:  20%|█▉        | 7205/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.69.up_proj:  20%|█▉        | 7206/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.69.down_proj:  20%|█▉        | 7207/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.70.gate_proj:  20%|█▉        | 7208/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.70.up_proj:  20%|█▉        | 7209/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.70.down_proj:  20%|█▉        | 7210/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.71.gate_proj:  20%|█▉        | 7211/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.71.up_proj:  20%|█▉        | 7212/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.71.down_proj:  20%|█▉        | 7213/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.72.gate_proj:  20%|█▉        | 7214/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.72.up_proj:  20%|█▉        | 7215/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.72.down_proj:  20%|█▉        | 7216/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.73.gate_proj:  20%|█▉        | 7217/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.73.up_proj:  20%|█▉        | 7218/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.73.down_proj:  20%|█▉        | 7219/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.74.gate_proj:  20%|█▉        | 7220/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.74.up_proj:  20%|█▉        | 7221/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.74.down_proj:  20%|█▉        | 7222/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.75.gate_proj:  20%|█▉        | 7223/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.75.up_proj:  20%|█▉        | 7224/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.75.down_proj:  20%|█▉        | 7225/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.76.gate_proj:  20%|█▉        | 7226/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.76.up_proj:  20%|█▉        | 7227/36566 [00:07<00:25, 1158.59it/s]  
packing model.layers.17.mlp.experts.76.down_proj:  20%|█▉        | 7228/36566 [00:07<00:25, 1158.59it/s]
packing model.layers.17.mlp.experts.76.down_proj:  20%|█▉        | 7229/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.77.gate_proj:  20%|█▉        | 7229/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.77.up_proj:  20%|█▉        | 7230/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.77.down_proj:  20%|█▉        | 7231/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.78.gate_proj:  20%|█▉        | 7232/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.78.up_proj:  20%|█▉        | 7233/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.78.down_proj:  20%|█▉        | 7234/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.79.gate_proj:  20%|█▉        | 7235/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.79.up_proj:  20%|█▉        | 7236/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.79.down_proj:  20%|█▉        | 7237/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.80.gate_proj:  20%|█▉        | 7238/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.80.up_proj:  20%|█▉        | 7239/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.80.down_proj:  20%|█▉        | 7240/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.81.gate_proj:  20%|█▉        | 7241/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.81.up_proj:  20%|█▉        | 7242/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.81.down_proj:  20%|█▉        | 7243/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.82.gate_proj:  20%|█▉        | 7244/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.82.up_proj:  20%|█▉        | 7245/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.82.down_proj:  20%|█▉        | 7246/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.83.gate_proj:  20%|█▉        | 7247/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.83.up_proj:  20%|█▉        | 7248/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.83.down_proj:  20%|█▉        | 7249/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.84.gate_proj:  20%|█▉        | 7250/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.84.up_proj:  20%|█▉        | 7251/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.84.down_proj:  20%|█▉        | 7252/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.85.gate_proj:  20%|█▉        | 7253/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.85.up_proj:  20%|█▉        | 7254/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.85.down_proj:  20%|█▉        | 7255/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.86.gate_proj:  20%|█▉        | 7256/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.86.up_proj:  20%|█▉        | 7257/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.86.down_proj:  20%|█▉        | 7258/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.87.gate_proj:  20%|█▉        | 7259/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.87.up_proj:  20%|█▉        | 7260/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.87.down_proj:  20%|█▉        | 7261/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.88.gate_proj:  20%|█▉        | 7262/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.88.up_proj:  20%|█▉        | 7263/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.88.down_proj:  20%|█▉        | 7264/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.89.gate_proj:  20%|█▉        | 7265/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.89.up_proj:  20%|█▉        | 7266/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.89.down_proj:  20%|█▉        | 7267/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.90.gate_proj:  20%|█▉        | 7268/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.90.up_proj:  20%|█▉        | 7269/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.90.down_proj:  20%|█▉        | 7270/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.91.gate_proj:  20%|█▉        | 7271/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.91.up_proj:  20%|█▉        | 7272/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.91.down_proj:  20%|█▉        | 7273/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.92.gate_proj:  20%|█▉        | 7274/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.92.up_proj:  20%|█▉        | 7275/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.92.down_proj:  20%|█▉        | 7276/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.93.gate_proj:  20%|█▉        | 7277/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.93.up_proj:  20%|█▉        | 7278/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.93.down_proj:  20%|█▉        | 7279/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.94.gate_proj:  20%|█▉        | 7280/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.94.up_proj:  20%|█▉        | 7281/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.94.down_proj:  20%|█▉        | 7282/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.95.gate_proj:  20%|█▉        | 7283/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.95.up_proj:  20%|█▉        | 7284/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.95.down_proj:  20%|█▉        | 7285/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.96.gate_proj:  20%|█▉        | 7286/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.96.up_proj:  20%|█▉        | 7287/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.96.down_proj:  20%|█▉        | 7288/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.97.gate_proj:  20%|█▉        | 7289/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.97.up_proj:  20%|█▉        | 7290/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.97.down_proj:  20%|█▉        | 7291/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.98.gate_proj:  20%|█▉        | 7292/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.98.up_proj:  20%|█▉        | 7293/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.98.down_proj:  20%|█▉        | 7294/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.99.gate_proj:  20%|█▉        | 7295/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.99.up_proj:  20%|█▉        | 7296/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.99.down_proj:  20%|█▉        | 7297/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.100.gate_proj:  20%|█▉        | 7298/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.100.up_proj:  20%|█▉        | 7299/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.100.down_proj:  20%|█▉        | 7300/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.101.gate_proj:  20%|█▉        | 7301/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.101.up_proj:  20%|█▉        | 7302/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.101.down_proj:  20%|█▉        | 7303/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.102.gate_proj:  20%|█▉        | 7304/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.102.up_proj:  20%|█▉        | 7305/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.102.down_proj:  20%|█▉        | 7306/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.103.gate_proj:  20%|█▉        | 7307/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.103.up_proj:  20%|█▉        | 7308/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.103.down_proj:  20%|█▉        | 7309/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.104.gate_proj:  20%|█▉        | 7310/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.104.up_proj:  20%|█▉        | 7311/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.104.down_proj:  20%|█▉        | 7312/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.105.gate_proj:  20%|█▉        | 7313/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.105.up_proj:  20%|██        | 7314/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.105.down_proj:  20%|██        | 7315/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.106.gate_proj:  20%|██        | 7316/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.106.up_proj:  20%|██        | 7317/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.106.down_proj:  20%|██        | 7318/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.107.gate_proj:  20%|██        | 7319/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.107.up_proj:  20%|██        | 7320/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.107.down_proj:  20%|██        | 7321/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.108.gate_proj:  20%|██        | 7322/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.108.up_proj:  20%|██        | 7323/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.108.down_proj:  20%|██        | 7324/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.109.gate_proj:  20%|██        | 7325/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.109.up_proj:  20%|██        | 7326/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.109.down_proj:  20%|██        | 7327/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.110.gate_proj:  20%|██        | 7328/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.110.up_proj:  20%|██        | 7329/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.110.down_proj:  20%|██        | 7330/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.111.gate_proj:  20%|██        | 7331/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.111.up_proj:  20%|██        | 7332/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.111.down_proj:  20%|██        | 7333/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.112.gate_proj:  20%|██        | 7334/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.112.up_proj:  20%|██        | 7335/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.112.down_proj:  20%|██        | 7336/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.113.gate_proj:  20%|██        | 7337/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.113.up_proj:  20%|██        | 7338/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.113.down_proj:  20%|██        | 7339/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.114.gate_proj:  20%|██        | 7340/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.114.up_proj:  20%|██        | 7341/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.114.down_proj:  20%|██        | 7342/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.115.gate_proj:  20%|██        | 7343/36566 [00:07<00:25, 1152.14it/s]
packing model.layers.17.mlp.experts.115.up_proj:  20%|██        | 7344/36566 [00:07<00:25, 1152.14it/s]  
packing model.layers.17.mlp.experts.115.up_proj:  20%|██        | 7345/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.115.down_proj:  20%|██        | 7345/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.116.gate_proj:  20%|██        | 7346/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.116.up_proj:  20%|██        | 7347/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.116.down_proj:  20%|██        | 7348/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.117.gate_proj:  20%|██        | 7349/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.117.up_proj:  20%|██        | 7350/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.117.down_proj:  20%|██        | 7351/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.118.gate_proj:  20%|██        | 7352/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.118.up_proj:  20%|██        | 7353/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.118.down_proj:  20%|██        | 7354/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.119.gate_proj:  20%|██        | 7355/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.119.up_proj:  20%|██        | 7356/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.119.down_proj:  20%|██        | 7357/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.120.gate_proj:  20%|██        | 7358/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.120.up_proj:  20%|██        | 7359/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.120.down_proj:  20%|██        | 7360/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.121.gate_proj:  20%|██        | 7361/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.121.up_proj:  20%|██        | 7362/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.121.down_proj:  20%|██        | 7363/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.122.gate_proj:  20%|██        | 7364/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.122.up_proj:  20%|██        | 7365/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.122.down_proj:  20%|██        | 7366/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.123.gate_proj:  20%|██        | 7367/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.123.up_proj:  20%|██        | 7368/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.123.down_proj:  20%|██        | 7369/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.124.gate_proj:  20%|██        | 7370/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.124.up_proj:  20%|██        | 7371/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.124.down_proj:  20%|██        | 7372/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.125.gate_proj:  20%|██        | 7373/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.125.up_proj:  20%|██        | 7374/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.125.down_proj:  20%|██        | 7375/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.126.gate_proj:  20%|██        | 7376/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.126.up_proj:  20%|██        | 7377/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.126.down_proj:  20%|██        | 7378/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.127.gate_proj:  20%|██        | 7379/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.17.mlp.experts.127.up_proj:  20%|██        | 7380/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.17.mlp.experts.127.down_proj:  20%|██        | 7381/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.0.gate_proj:  20%|██        | 7382/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.0.up_proj:  20%|██        | 7383/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.0.down_proj:  20%|██        | 7384/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.1.gate_proj:  20%|██        | 7385/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.1.up_proj:  20%|██        | 7386/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.1.down_proj:  20%|██        | 7387/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.2.gate_proj:  20%|██        | 7388/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.2.up_proj:  20%|██        | 7389/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.2.down_proj:  20%|██        | 7390/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.3.gate_proj:  20%|██        | 7391/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.3.up_proj:  20%|██        | 7392/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.3.down_proj:  20%|██        | 7393/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.4.gate_proj:  20%|██        | 7394/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.4.up_proj:  20%|██        | 7395/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.4.down_proj:  20%|██        | 7396/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.5.gate_proj:  20%|██        | 7397/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.5.up_proj:  20%|██        | 7398/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.5.down_proj:  20%|██        | 7399/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.6.gate_proj:  20%|██        | 7400/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.6.up_proj:  20%|██        | 7401/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.6.down_proj:  20%|██        | 7402/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.7.gate_proj:  20%|██        | 7403/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.7.up_proj:  20%|██        | 7404/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.7.down_proj:  20%|██        | 7405/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.8.gate_proj:  20%|██        | 7406/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.8.up_proj:  20%|██        | 7407/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.8.down_proj:  20%|██        | 7408/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.9.gate_proj:  20%|██        | 7409/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.9.up_proj:  20%|██        | 7410/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.9.down_proj:  20%|██        | 7411/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.10.gate_proj:  20%|██        | 7412/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.10.up_proj:  20%|██        | 7413/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.10.down_proj:  20%|██        | 7414/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.11.gate_proj:  20%|██        | 7415/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.11.up_proj:  20%|██        | 7416/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.11.down_proj:  20%|██        | 7417/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.12.gate_proj:  20%|██        | 7418/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.12.up_proj:  20%|██        | 7419/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.12.down_proj:  20%|██        | 7420/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.13.gate_proj:  20%|██        | 7421/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.13.up_proj:  20%|██        | 7422/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.13.down_proj:  20%|██        | 7423/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.14.gate_proj:  20%|██        | 7424/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.14.up_proj:  20%|██        | 7425/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.14.down_proj:  20%|██        | 7426/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.15.gate_proj:  20%|██        | 7427/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.15.up_proj:  20%|██        | 7428/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.15.down_proj:  20%|██        | 7429/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.16.gate_proj:  20%|██        | 7430/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.16.up_proj:  20%|██        | 7431/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.16.down_proj:  20%|██        | 7432/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.17.gate_proj:  20%|██        | 7433/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.17.up_proj:  20%|██        | 7434/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.17.down_proj:  20%|██        | 7435/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.18.gate_proj:  20%|██        | 7436/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.18.up_proj:  20%|██        | 7437/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.18.down_proj:  20%|██        | 7438/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.19.gate_proj:  20%|██        | 7439/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.19.up_proj:  20%|██        | 7440/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.19.down_proj:  20%|██        | 7441/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.20.gate_proj:  20%|██        | 7442/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.20.up_proj:  20%|██        | 7443/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.20.down_proj:  20%|██        | 7444/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.21.gate_proj:  20%|██        | 7445/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.21.up_proj:  20%|██        | 7446/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.21.down_proj:  20%|██        | 7447/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.22.gate_proj:  20%|██        | 7448/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.22.up_proj:  20%|██        | 7449/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.22.down_proj:  20%|██        | 7450/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.23.gate_proj:  20%|██        | 7451/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.23.up_proj:  20%|██        | 7452/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.23.down_proj:  20%|██        | 7453/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.24.gate_proj:  20%|██        | 7454/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.24.up_proj:  20%|██        | 7455/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.24.down_proj:  20%|██        | 7456/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.25.gate_proj:  20%|██        | 7457/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.25.up_proj:  20%|██        | 7458/36566 [00:07<00:25, 1150.97it/s]  
packing model.layers.18.mlp.experts.25.down_proj:  20%|██        | 7459/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.26.gate_proj:  20%|██        | 7460/36566 [00:07<00:25, 1150.97it/s]
packing model.layers.18.mlp.experts.26.gate_proj:  20%|██        | 7461/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.26.up_proj:  20%|██        | 7461/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.26.down_proj:  20%|██        | 7462/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.27.gate_proj:  20%|██        | 7463/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.27.up_proj:  20%|██        | 7464/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.27.down_proj:  20%|██        | 7465/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.28.gate_proj:  20%|██        | 7466/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.28.up_proj:  20%|██        | 7467/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.28.down_proj:  20%|██        | 7468/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.29.gate_proj:  20%|██        | 7469/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.29.up_proj:  20%|██        | 7470/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.29.down_proj:  20%|██        | 7471/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.30.gate_proj:  20%|██        | 7472/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.30.up_proj:  20%|██        | 7473/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.30.down_proj:  20%|██        | 7474/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.31.gate_proj:  20%|██        | 7475/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.31.up_proj:  20%|██        | 7476/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.31.down_proj:  20%|██        | 7477/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.32.gate_proj:  20%|██        | 7478/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.32.up_proj:  20%|██        | 7479/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.32.down_proj:  20%|██        | 7480/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.33.gate_proj:  20%|██        | 7481/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.33.up_proj:  20%|██        | 7482/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.33.down_proj:  20%|██        | 7483/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.34.gate_proj:  20%|██        | 7484/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.34.up_proj:  20%|██        | 7485/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.34.down_proj:  20%|██        | 7486/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.35.gate_proj:  20%|██        | 7487/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.35.up_proj:  20%|██        | 7488/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.35.down_proj:  20%|██        | 7489/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.36.gate_proj:  20%|██        | 7490/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.36.up_proj:  20%|██        | 7491/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.36.down_proj:  20%|██        | 7492/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.37.gate_proj:  20%|██        | 7493/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.37.up_proj:  20%|██        | 7494/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.37.down_proj:  20%|██        | 7495/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.38.gate_proj:  20%|██        | 7496/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.38.up_proj:  21%|██        | 7497/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.38.down_proj:  21%|██        | 7498/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.39.gate_proj:  21%|██        | 7499/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.39.up_proj:  21%|██        | 7500/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.39.down_proj:  21%|██        | 7501/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.40.gate_proj:  21%|██        | 7502/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.40.up_proj:  21%|██        | 7503/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.40.down_proj:  21%|██        | 7504/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.41.gate_proj:  21%|██        | 7505/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.41.up_proj:  21%|██        | 7506/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.41.down_proj:  21%|██        | 7507/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.42.gate_proj:  21%|██        | 7508/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.42.up_proj:  21%|██        | 7509/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.42.down_proj:  21%|██        | 7510/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.43.gate_proj:  21%|██        | 7511/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.43.up_proj:  21%|██        | 7512/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.43.down_proj:  21%|██        | 7513/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.44.gate_proj:  21%|██        | 7514/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.44.up_proj:  21%|██        | 7515/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.44.down_proj:  21%|██        | 7516/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.45.gate_proj:  21%|██        | 7517/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.45.up_proj:  21%|██        | 7518/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.45.down_proj:  21%|██        | 7519/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.46.gate_proj:  21%|██        | 7520/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.46.up_proj:  21%|██        | 7521/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.46.down_proj:  21%|██        | 7522/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.47.gate_proj:  21%|██        | 7523/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.47.up_proj:  21%|██        | 7524/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.47.down_proj:  21%|██        | 7525/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.48.gate_proj:  21%|██        | 7526/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.48.up_proj:  21%|██        | 7527/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.48.down_proj:  21%|██        | 7528/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.49.gate_proj:  21%|██        | 7529/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.49.up_proj:  21%|██        | 7530/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.49.down_proj:  21%|██        | 7531/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.50.gate_proj:  21%|██        | 7532/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.50.up_proj:  21%|██        | 7533/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.50.down_proj:  21%|██        | 7534/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.51.gate_proj:  21%|██        | 7535/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.51.up_proj:  21%|██        | 7536/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.51.down_proj:  21%|██        | 7537/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.52.gate_proj:  21%|██        | 7538/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.52.up_proj:  21%|██        | 7539/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.52.down_proj:  21%|██        | 7540/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.53.gate_proj:  21%|██        | 7541/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.53.up_proj:  21%|██        | 7542/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.53.down_proj:  21%|██        | 7543/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.54.gate_proj:  21%|██        | 7544/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.54.up_proj:  21%|██        | 7545/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.54.down_proj:  21%|██        | 7546/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.55.gate_proj:  21%|██        | 7547/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.55.up_proj:  21%|██        | 7548/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.55.down_proj:  21%|██        | 7549/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.56.gate_proj:  21%|██        | 7550/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.56.up_proj:  21%|██        | 7551/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.56.down_proj:  21%|██        | 7552/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.57.gate_proj:  21%|██        | 7553/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.57.up_proj:  21%|██        | 7554/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.57.down_proj:  21%|██        | 7555/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.58.gate_proj:  21%|██        | 7556/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.58.up_proj:  21%|██        | 7557/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.58.down_proj:  21%|██        | 7558/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.59.gate_proj:  21%|██        | 7559/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.59.up_proj:  21%|██        | 7560/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.59.down_proj:  21%|██        | 7561/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.60.gate_proj:  21%|██        | 7562/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.60.up_proj:  21%|██        | 7563/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.60.down_proj:  21%|██        | 7564/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.61.gate_proj:  21%|██        | 7565/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.61.up_proj:  21%|██        | 7566/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.61.down_proj:  21%|██        | 7567/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.62.gate_proj:  21%|██        | 7568/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.62.up_proj:  21%|██        | 7569/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.62.down_proj:  21%|██        | 7570/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.63.gate_proj:  21%|██        | 7571/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.63.up_proj:  21%|██        | 7572/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.63.down_proj:  21%|██        | 7573/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.64.gate_proj:  21%|██        | 7574/36566 [00:07<00:25, 1149.18it/s]
packing model.layers.18.mlp.experts.64.up_proj:  21%|██        | 7575/36566 [00:07<00:25, 1149.18it/s]  
packing model.layers.18.mlp.experts.64.up_proj:  21%|██        | 7576/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.64.down_proj:  21%|██        | 7576/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.65.gate_proj:  21%|██        | 7577/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.65.up_proj:  21%|██        | 7578/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.65.down_proj:  21%|██        | 7579/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.66.gate_proj:  21%|██        | 7580/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.66.up_proj:  21%|██        | 7581/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.66.down_proj:  21%|██        | 7582/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.67.gate_proj:  21%|██        | 7583/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.67.up_proj:  21%|██        | 7584/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.67.down_proj:  21%|██        | 7585/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.68.gate_proj:  21%|██        | 7586/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.68.up_proj:  21%|██        | 7587/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.68.down_proj:  21%|██        | 7588/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.69.gate_proj:  21%|██        | 7589/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.69.up_proj:  21%|██        | 7590/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.69.down_proj:  21%|██        | 7591/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.70.gate_proj:  21%|██        | 7592/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.70.up_proj:  21%|██        | 7593/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.70.down_proj:  21%|██        | 7594/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.71.gate_proj:  21%|██        | 7595/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.71.up_proj:  21%|██        | 7596/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.71.down_proj:  21%|██        | 7597/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.72.gate_proj:  21%|██        | 7598/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.72.up_proj:  21%|██        | 7599/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.72.down_proj:  21%|██        | 7600/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.73.gate_proj:  21%|██        | 7601/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.73.up_proj:  21%|██        | 7602/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.73.down_proj:  21%|██        | 7603/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.74.gate_proj:  21%|██        | 7604/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.74.up_proj:  21%|██        | 7605/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.74.down_proj:  21%|██        | 7606/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.75.gate_proj:  21%|██        | 7607/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.75.up_proj:  21%|██        | 7608/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.75.down_proj:  21%|██        | 7609/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.76.gate_proj:  21%|██        | 7610/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.76.up_proj:  21%|██        | 7611/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.76.down_proj:  21%|██        | 7612/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.77.gate_proj:  21%|██        | 7613/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.77.up_proj:  21%|██        | 7614/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.77.down_proj:  21%|██        | 7615/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.78.gate_proj:  21%|██        | 7616/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.78.up_proj:  21%|██        | 7617/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.78.down_proj:  21%|██        | 7618/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.79.gate_proj:  21%|██        | 7619/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.79.up_proj:  21%|██        | 7620/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.79.down_proj:  21%|██        | 7621/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.80.gate_proj:  21%|██        | 7622/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.80.up_proj:  21%|██        | 7623/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.80.down_proj:  21%|██        | 7624/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.81.gate_proj:  21%|██        | 7625/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.81.up_proj:  21%|██        | 7626/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.81.down_proj:  21%|██        | 7627/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.82.gate_proj:  21%|██        | 7628/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.82.up_proj:  21%|██        | 7629/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.82.down_proj:  21%|██        | 7630/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.83.gate_proj:  21%|██        | 7631/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.83.up_proj:  21%|██        | 7632/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.83.down_proj:  21%|██        | 7633/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.84.gate_proj:  21%|██        | 7634/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.84.up_proj:  21%|██        | 7635/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.84.down_proj:  21%|██        | 7636/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.85.gate_proj:  21%|██        | 7637/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.85.up_proj:  21%|██        | 7638/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.85.down_proj:  21%|██        | 7639/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.86.gate_proj:  21%|██        | 7640/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.86.up_proj:  21%|██        | 7641/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.86.down_proj:  21%|██        | 7642/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.87.gate_proj:  21%|██        | 7643/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.87.up_proj:  21%|██        | 7644/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.87.down_proj:  21%|██        | 7645/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.88.gate_proj:  21%|██        | 7646/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.88.up_proj:  21%|██        | 7647/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.88.down_proj:  21%|██        | 7648/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.89.gate_proj:  21%|██        | 7649/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.89.up_proj:  21%|██        | 7650/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.89.down_proj:  21%|██        | 7651/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.90.gate_proj:  21%|██        | 7652/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.90.up_proj:  21%|██        | 7653/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.90.down_proj:  21%|██        | 7654/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.91.gate_proj:  21%|██        | 7655/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.91.up_proj:  21%|██        | 7656/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.91.down_proj:  21%|██        | 7657/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.92.gate_proj:  21%|██        | 7658/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.92.up_proj:  21%|██        | 7659/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.92.down_proj:  21%|██        | 7660/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.93.gate_proj:  21%|██        | 7661/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.93.up_proj:  21%|██        | 7662/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.93.down_proj:  21%|██        | 7663/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.94.gate_proj:  21%|██        | 7664/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.94.up_proj:  21%|██        | 7665/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.94.down_proj:  21%|██        | 7666/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.95.gate_proj:  21%|██        | 7667/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.95.up_proj:  21%|██        | 7668/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.95.down_proj:  21%|██        | 7669/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.96.gate_proj:  21%|██        | 7670/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.96.up_proj:  21%|██        | 7671/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.96.down_proj:  21%|██        | 7672/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.97.gate_proj:  21%|██        | 7673/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.97.up_proj:  21%|██        | 7674/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.97.down_proj:  21%|██        | 7675/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.98.gate_proj:  21%|██        | 7676/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.98.up_proj:  21%|██        | 7677/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.98.down_proj:  21%|██        | 7678/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.99.gate_proj:  21%|██        | 7679/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.99.up_proj:  21%|██        | 7680/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.99.down_proj:  21%|██        | 7681/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.100.gate_proj:  21%|██        | 7682/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.100.up_proj:  21%|██        | 7683/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.100.down_proj:  21%|██        | 7684/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.101.gate_proj:  21%|██        | 7685/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.101.up_proj:  21%|██        | 7686/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.101.down_proj:  21%|██        | 7687/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.102.gate_proj:  21%|██        | 7688/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.102.up_proj:  21%|██        | 7689/36566 [00:07<00:25, 1147.53it/s]  
packing model.layers.18.mlp.experts.102.down_proj:  21%|██        | 7690/36566 [00:07<00:25, 1147.53it/s]
packing model.layers.18.mlp.experts.102.down_proj:  21%|██        | 7691/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.103.gate_proj:  21%|██        | 7691/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.103.up_proj:  21%|██        | 7692/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.103.down_proj:  21%|██        | 7693/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.104.gate_proj:  21%|██        | 7694/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.104.up_proj:  21%|██        | 7695/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.104.down_proj:  21%|██        | 7696/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.105.gate_proj:  21%|██        | 7697/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.105.up_proj:  21%|██        | 7698/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.105.down_proj:  21%|██        | 7699/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.106.gate_proj:  21%|██        | 7700/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.106.up_proj:  21%|██        | 7701/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.106.down_proj:  21%|██        | 7702/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.107.gate_proj:  21%|██        | 7703/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.107.up_proj:  21%|██        | 7704/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.107.down_proj:  21%|██        | 7705/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.108.gate_proj:  21%|██        | 7706/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.108.up_proj:  21%|██        | 7707/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.108.down_proj:  21%|██        | 7708/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.109.gate_proj:  21%|██        | 7709/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.109.up_proj:  21%|██        | 7710/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.109.down_proj:  21%|██        | 7711/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.110.gate_proj:  21%|██        | 7712/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.110.up_proj:  21%|██        | 7713/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.110.down_proj:  21%|██        | 7714/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.111.gate_proj:  21%|██        | 7715/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.111.up_proj:  21%|██        | 7716/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.111.down_proj:  21%|██        | 7717/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.112.gate_proj:  21%|██        | 7718/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.112.up_proj:  21%|██        | 7719/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.112.down_proj:  21%|██        | 7720/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.113.gate_proj:  21%|██        | 7721/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.113.up_proj:  21%|██        | 7722/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.113.down_proj:  21%|██        | 7723/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.114.gate_proj:  21%|██        | 7724/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.114.up_proj:  21%|██        | 7725/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.114.down_proj:  21%|██        | 7726/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.115.gate_proj:  21%|██        | 7727/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.115.up_proj:  21%|██        | 7728/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.115.down_proj:  21%|██        | 7729/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.116.gate_proj:  21%|██        | 7730/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.116.up_proj:  21%|██        | 7731/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.116.down_proj:  21%|██        | 7732/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.117.gate_proj:  21%|██        | 7733/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.117.up_proj:  21%|██        | 7734/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.117.down_proj:  21%|██        | 7735/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.118.gate_proj:  21%|██        | 7736/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.118.up_proj:  21%|██        | 7737/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.118.down_proj:  21%|██        | 7738/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.119.gate_proj:  21%|██        | 7739/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.119.up_proj:  21%|██        | 7740/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.119.down_proj:  21%|██        | 7741/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.120.gate_proj:  21%|██        | 7742/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.120.up_proj:  21%|██        | 7743/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.120.down_proj:  21%|██        | 7744/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.121.gate_proj:  21%|██        | 7745/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.121.up_proj:  21%|██        | 7746/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.121.down_proj:  21%|██        | 7747/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.122.gate_proj:  21%|██        | 7748/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.122.up_proj:  21%|██        | 7749/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.122.down_proj:  21%|██        | 7750/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.123.gate_proj:  21%|██        | 7751/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.123.up_proj:  21%|██        | 7752/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.123.down_proj:  21%|██        | 7753/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.124.gate_proj:  21%|██        | 7754/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.124.up_proj:  21%|██        | 7755/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.124.down_proj:  21%|██        | 7756/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.125.gate_proj:  21%|██        | 7757/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.125.up_proj:  21%|██        | 7758/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.125.down_proj:  21%|██        | 7759/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.126.gate_proj:  21%|██        | 7760/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.126.up_proj:  21%|██        | 7761/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.126.down_proj:  21%|██        | 7762/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.127.gate_proj:  21%|██        | 7763/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.18.mlp.experts.127.up_proj:  21%|██        | 7764/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.18.mlp.experts.127.down_proj:  21%|██        | 7765/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.0.gate_proj:  21%|██        | 7766/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.0.up_proj:  21%|██        | 7767/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.0.down_proj:  21%|██        | 7768/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.1.gate_proj:  21%|██        | 7769/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.1.up_proj:  21%|██        | 7770/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.1.down_proj:  21%|██▏       | 7771/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.2.gate_proj:  21%|██▏       | 7772/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.2.up_proj:  21%|██▏       | 7773/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.2.down_proj:  21%|██▏       | 7774/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.3.gate_proj:  21%|██▏       | 7775/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.3.up_proj:  21%|██▏       | 7776/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.3.down_proj:  21%|██▏       | 7777/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.4.gate_proj:  21%|██▏       | 7778/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.4.up_proj:  21%|██▏       | 7779/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.4.down_proj:  21%|██▏       | 7780/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.5.gate_proj:  21%|██▏       | 7781/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.5.up_proj:  21%|██▏       | 7782/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.5.down_proj:  21%|██▏       | 7783/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.6.gate_proj:  21%|██▏       | 7784/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.6.up_proj:  21%|██▏       | 7785/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.6.down_proj:  21%|██▏       | 7786/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.7.gate_proj:  21%|██▏       | 7787/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.7.up_proj:  21%|██▏       | 7788/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.7.down_proj:  21%|██▏       | 7789/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.8.gate_proj:  21%|██▏       | 7790/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.8.up_proj:  21%|██▏       | 7791/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.8.down_proj:  21%|██▏       | 7792/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.9.gate_proj:  21%|██▏       | 7793/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.9.up_proj:  21%|██▏       | 7794/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.9.down_proj:  21%|██▏       | 7795/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.10.gate_proj:  21%|██▏       | 7796/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.10.up_proj:  21%|██▏       | 7797/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.10.down_proj:  21%|██▏       | 7798/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.11.gate_proj:  21%|██▏       | 7799/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.11.up_proj:  21%|██▏       | 7800/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.11.down_proj:  21%|██▏       | 7801/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.12.gate_proj:  21%|██▏       | 7802/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.12.up_proj:  21%|██▏       | 7803/36566 [00:07<00:25, 1146.80it/s]  
packing model.layers.19.mlp.experts.12.down_proj:  21%|██▏       | 7804/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.13.gate_proj:  21%|██▏       | 7805/36566 [00:07<00:25, 1146.80it/s]
packing model.layers.19.mlp.experts.13.gate_proj:  21%|██▏       | 7806/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.13.up_proj:  21%|██▏       | 7806/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.13.down_proj:  21%|██▏       | 7807/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.14.gate_proj:  21%|██▏       | 7808/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.14.up_proj:  21%|██▏       | 7809/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.14.down_proj:  21%|██▏       | 7810/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.15.gate_proj:  21%|██▏       | 7811/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.15.up_proj:  21%|██▏       | 7812/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.15.down_proj:  21%|██▏       | 7813/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.16.gate_proj:  21%|██▏       | 7814/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.16.up_proj:  21%|██▏       | 7815/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.16.down_proj:  21%|██▏       | 7816/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.17.gate_proj:  21%|██▏       | 7817/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.17.up_proj:  21%|██▏       | 7818/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.17.down_proj:  21%|██▏       | 7819/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.18.gate_proj:  21%|██▏       | 7820/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.18.up_proj:  21%|██▏       | 7821/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.18.down_proj:  21%|██▏       | 7822/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.19.gate_proj:  21%|██▏       | 7823/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.19.up_proj:  21%|██▏       | 7824/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.19.down_proj:  21%|██▏       | 7825/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.20.gate_proj:  21%|██▏       | 7826/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.20.up_proj:  21%|██▏       | 7827/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.20.down_proj:  21%|██▏       | 7828/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.21.gate_proj:  21%|██▏       | 7829/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.21.up_proj:  21%|██▏       | 7830/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.21.down_proj:  21%|██▏       | 7831/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.22.gate_proj:  21%|██▏       | 7832/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.22.up_proj:  21%|██▏       | 7833/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.22.down_proj:  21%|██▏       | 7834/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.23.gate_proj:  21%|██▏       | 7835/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.23.up_proj:  21%|██▏       | 7836/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.23.down_proj:  21%|██▏       | 7837/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.24.gate_proj:  21%|██▏       | 7838/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.24.up_proj:  21%|██▏       | 7839/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.24.down_proj:  21%|██▏       | 7840/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.25.gate_proj:  21%|██▏       | 7841/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.25.up_proj:  21%|██▏       | 7842/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.25.down_proj:  21%|██▏       | 7843/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.26.gate_proj:  21%|██▏       | 7844/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.26.up_proj:  21%|██▏       | 7845/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.26.down_proj:  21%|██▏       | 7846/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.27.gate_proj:  21%|██▏       | 7847/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.27.up_proj:  21%|██▏       | 7848/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.27.down_proj:  21%|██▏       | 7849/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.28.gate_proj:  21%|██▏       | 7850/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.28.up_proj:  21%|██▏       | 7851/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.28.down_proj:  21%|██▏       | 7852/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.29.gate_proj:  21%|██▏       | 7853/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.29.up_proj:  21%|██▏       | 7854/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.29.down_proj:  21%|██▏       | 7855/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.30.gate_proj:  21%|██▏       | 7856/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.30.up_proj:  21%|██▏       | 7857/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.30.down_proj:  21%|██▏       | 7858/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.31.gate_proj:  21%|██▏       | 7859/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.31.up_proj:  21%|██▏       | 7860/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.31.down_proj:  21%|██▏       | 7861/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.32.gate_proj:  22%|██▏       | 7862/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.32.up_proj:  22%|██▏       | 7863/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.32.down_proj:  22%|██▏       | 7864/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.33.gate_proj:  22%|██▏       | 7865/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.33.up_proj:  22%|██▏       | 7866/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.33.down_proj:  22%|██▏       | 7867/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.34.gate_proj:  22%|██▏       | 7868/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.34.up_proj:  22%|██▏       | 7869/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.34.down_proj:  22%|██▏       | 7870/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.35.gate_proj:  22%|██▏       | 7871/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.35.up_proj:  22%|██▏       | 7872/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.35.down_proj:  22%|██▏       | 7873/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.36.gate_proj:  22%|██▏       | 7874/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.36.up_proj:  22%|██▏       | 7875/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.36.down_proj:  22%|██▏       | 7876/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.37.gate_proj:  22%|██▏       | 7877/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.37.up_proj:  22%|██▏       | 7878/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.37.down_proj:  22%|██▏       | 7879/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.38.gate_proj:  22%|██▏       | 7880/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.38.up_proj:  22%|██▏       | 7881/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.38.down_proj:  22%|██▏       | 7882/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.39.gate_proj:  22%|██▏       | 7883/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.39.up_proj:  22%|██▏       | 7884/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.39.down_proj:  22%|██▏       | 7885/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.40.gate_proj:  22%|██▏       | 7886/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.40.up_proj:  22%|██▏       | 7887/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.40.down_proj:  22%|██▏       | 7888/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.41.gate_proj:  22%|██▏       | 7889/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.41.up_proj:  22%|██▏       | 7890/36566 [00:07<00:25, 1146.97it/s]  
packing model.layers.19.mlp.experts.41.down_proj:  22%|██▏       | 7891/36566 [00:07<00:25, 1146.97it/s]
packing model.layers.19.mlp.experts.42.gate_proj:  22%|██▏       | 7892/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.42.up_proj:  22%|██▏       | 7893/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.42.down_proj:  22%|██▏       | 7894/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.43.gate_proj:  22%|██▏       | 7895/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.43.up_proj:  22%|██▏       | 7896/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.43.down_proj:  22%|██▏       | 7897/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.44.gate_proj:  22%|██▏       | 7898/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.44.up_proj:  22%|██▏       | 7899/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.44.down_proj:  22%|██▏       | 7900/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.45.gate_proj:  22%|██▏       | 7901/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.45.up_proj:  22%|██▏       | 7902/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.45.down_proj:  22%|██▏       | 7903/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.46.gate_proj:  22%|██▏       | 7904/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.46.up_proj:  22%|██▏       | 7905/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.46.down_proj:  22%|██▏       | 7906/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.47.gate_proj:  22%|██▏       | 7907/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.47.up_proj:  22%|██▏       | 7908/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.47.down_proj:  22%|██▏       | 7909/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.48.gate_proj:  22%|██▏       | 7910/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.48.up_proj:  22%|██▏       | 7911/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.48.down_proj:  22%|██▏       | 7912/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.49.gate_proj:  22%|██▏       | 7913/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.49.up_proj:  22%|██▏       | 7914/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.49.down_proj:  22%|██▏       | 7915/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.50.gate_proj:  22%|██▏       | 7916/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.50.up_proj:  22%|██▏       | 7917/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.50.down_proj:  22%|██▏       | 7918/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.51.gate_proj:  22%|██▏       | 7919/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.51.up_proj:  22%|██▏       | 7920/36566 [00:07<00:24, 1146.97it/s]  
packing model.layers.19.mlp.experts.51.down_proj:  22%|██▏       | 7921/36566 [00:07<00:24, 1146.97it/s]
packing model.layers.19.mlp.experts.51.down_proj:  22%|██▏       | 7922/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.52.gate_proj:  22%|██▏       | 7922/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.52.up_proj:  22%|██▏       | 7923/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.52.down_proj:  22%|██▏       | 7924/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.53.gate_proj:  22%|██▏       | 7925/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.53.up_proj:  22%|██▏       | 7926/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.53.down_proj:  22%|██▏       | 7927/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.54.gate_proj:  22%|██▏       | 7928/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.54.up_proj:  22%|██▏       | 7929/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.54.down_proj:  22%|██▏       | 7930/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.55.gate_proj:  22%|██▏       | 7931/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.55.up_proj:  22%|██▏       | 7932/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.55.down_proj:  22%|██▏       | 7933/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.56.gate_proj:  22%|██▏       | 7934/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.56.up_proj:  22%|██▏       | 7935/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.56.down_proj:  22%|██▏       | 7936/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.57.gate_proj:  22%|██▏       | 7937/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.57.up_proj:  22%|██▏       | 7938/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.57.down_proj:  22%|██▏       | 7939/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.58.gate_proj:  22%|██▏       | 7940/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.58.up_proj:  22%|██▏       | 7941/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.58.down_proj:  22%|██▏       | 7942/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.59.gate_proj:  22%|██▏       | 7943/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.59.up_proj:  22%|██▏       | 7944/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.59.down_proj:  22%|██▏       | 7945/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.60.gate_proj:  22%|██▏       | 7946/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.60.up_proj:  22%|██▏       | 7947/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.60.down_proj:  22%|██▏       | 7948/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.61.gate_proj:  22%|██▏       | 7949/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.61.up_proj:  22%|██▏       | 7950/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.61.down_proj:  22%|██▏       | 7951/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.62.gate_proj:  22%|██▏       | 7952/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.62.up_proj:  22%|██▏       | 7953/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.62.down_proj:  22%|██▏       | 7954/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.63.gate_proj:  22%|██▏       | 7955/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.63.up_proj:  22%|██▏       | 7956/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.63.down_proj:  22%|██▏       | 7957/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.64.gate_proj:  22%|██▏       | 7958/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.64.up_proj:  22%|██▏       | 7959/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.64.down_proj:  22%|██▏       | 7960/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.65.gate_proj:  22%|██▏       | 7961/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.65.up_proj:  22%|██▏       | 7962/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.65.down_proj:  22%|██▏       | 7963/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.66.gate_proj:  22%|██▏       | 7964/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.66.up_proj:  22%|██▏       | 7965/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.66.down_proj:  22%|██▏       | 7966/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.67.gate_proj:  22%|██▏       | 7967/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.67.up_proj:  22%|██▏       | 7968/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.67.down_proj:  22%|██▏       | 7969/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.68.gate_proj:  22%|██▏       | 7970/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.68.up_proj:  22%|██▏       | 7971/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.68.down_proj:  22%|██▏       | 7972/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.69.gate_proj:  22%|██▏       | 7973/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.69.up_proj:  22%|██▏       | 7974/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.69.down_proj:  22%|██▏       | 7975/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.70.gate_proj:  22%|██▏       | 7976/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.70.up_proj:  22%|██▏       | 7977/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.70.down_proj:  22%|██▏       | 7978/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.71.gate_proj:  22%|██▏       | 7979/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.71.up_proj:  22%|██▏       | 7980/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.71.down_proj:  22%|██▏       | 7981/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.72.gate_proj:  22%|██▏       | 7982/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.72.up_proj:  22%|██▏       | 7983/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.72.down_proj:  22%|██▏       | 7984/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.73.gate_proj:  22%|██▏       | 7985/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.73.up_proj:  22%|██▏       | 7986/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.73.down_proj:  22%|██▏       | 7987/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.74.gate_proj:  22%|██▏       | 7988/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.74.up_proj:  22%|██▏       | 7989/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.74.down_proj:  22%|██▏       | 7990/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.75.gate_proj:  22%|██▏       | 7991/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.75.up_proj:  22%|██▏       | 7992/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.75.down_proj:  22%|██▏       | 7993/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.76.gate_proj:  22%|██▏       | 7994/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.76.up_proj:  22%|██▏       | 7995/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.76.down_proj:  22%|██▏       | 7996/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.77.gate_proj:  22%|██▏       | 7997/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.77.up_proj:  22%|██▏       | 7998/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.77.down_proj:  22%|██▏       | 7999/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.78.gate_proj:  22%|██▏       | 8000/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.78.up_proj:  22%|██▏       | 8001/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.78.down_proj:  22%|██▏       | 8002/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.79.gate_proj:  22%|██▏       | 8003/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.79.up_proj:  22%|██▏       | 8004/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.79.down_proj:  22%|██▏       | 8005/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.80.gate_proj:  22%|██▏       | 8006/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.80.up_proj:  22%|██▏       | 8007/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.80.down_proj:  22%|██▏       | 8008/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.81.gate_proj:  22%|██▏       | 8009/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.81.up_proj:  22%|██▏       | 8010/36566 [00:07<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.81.down_proj:  22%|██▏       | 8011/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.82.gate_proj:  22%|██▏       | 8012/36566 [00:07<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.82.up_proj:  22%|██▏       | 8013/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.82.down_proj:  22%|██▏       | 8014/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.83.gate_proj:  22%|██▏       | 8015/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.83.up_proj:  22%|██▏       | 8016/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.83.down_proj:  22%|██▏       | 8017/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.84.gate_proj:  22%|██▏       | 8018/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.84.up_proj:  22%|██▏       | 8019/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.84.down_proj:  22%|██▏       | 8020/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.85.gate_proj:  22%|██▏       | 8021/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.85.up_proj:  22%|██▏       | 8022/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.85.down_proj:  22%|██▏       | 8023/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.86.gate_proj:  22%|██▏       | 8024/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.86.up_proj:  22%|██▏       | 8025/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.86.down_proj:  22%|██▏       | 8026/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.87.gate_proj:  22%|██▏       | 8027/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.87.up_proj:  22%|██▏       | 8028/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.87.down_proj:  22%|██▏       | 8029/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.88.gate_proj:  22%|██▏       | 8030/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.88.up_proj:  22%|██▏       | 8031/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.88.down_proj:  22%|██▏       | 8032/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.89.gate_proj:  22%|██▏       | 8033/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.89.up_proj:  22%|██▏       | 8034/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.89.down_proj:  22%|██▏       | 8035/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.90.gate_proj:  22%|██▏       | 8036/36566 [00:08<00:24, 1147.96it/s]
packing model.layers.19.mlp.experts.90.up_proj:  22%|██▏       | 8037/36566 [00:08<00:24, 1147.96it/s]  
packing model.layers.19.mlp.experts.90.up_proj:  22%|██▏       | 8038/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.90.down_proj:  22%|██▏       | 8038/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.91.gate_proj:  22%|██▏       | 8039/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.91.up_proj:  22%|██▏       | 8040/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.91.down_proj:  22%|██▏       | 8041/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.92.gate_proj:  22%|██▏       | 8042/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.92.up_proj:  22%|██▏       | 8043/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.92.down_proj:  22%|██▏       | 8044/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.93.gate_proj:  22%|██▏       | 8045/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.93.up_proj:  22%|██▏       | 8046/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.93.down_proj:  22%|██▏       | 8047/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.94.gate_proj:  22%|██▏       | 8048/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.94.up_proj:  22%|██▏       | 8049/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.94.down_proj:  22%|██▏       | 8050/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.95.gate_proj:  22%|██▏       | 8051/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.95.up_proj:  22%|██▏       | 8052/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.95.down_proj:  22%|██▏       | 8053/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.96.gate_proj:  22%|██▏       | 8054/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.96.up_proj:  22%|██▏       | 8055/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.96.down_proj:  22%|██▏       | 8056/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.97.gate_proj:  22%|██▏       | 8057/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.97.up_proj:  22%|██▏       | 8058/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.97.down_proj:  22%|██▏       | 8059/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.98.gate_proj:  22%|██▏       | 8060/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.98.up_proj:  22%|██▏       | 8061/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.98.down_proj:  22%|██▏       | 8062/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.99.gate_proj:  22%|██▏       | 8063/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.99.up_proj:  22%|██▏       | 8064/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.99.down_proj:  22%|██▏       | 8065/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.100.gate_proj:  22%|██▏       | 8066/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.100.up_proj:  22%|██▏       | 8067/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.100.down_proj:  22%|██▏       | 8068/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.101.gate_proj:  22%|██▏       | 8069/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.101.up_proj:  22%|██▏       | 8070/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.101.down_proj:  22%|██▏       | 8071/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.102.gate_proj:  22%|██▏       | 8072/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.102.up_proj:  22%|██▏       | 8073/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.102.down_proj:  22%|██▏       | 8074/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.103.gate_proj:  22%|██▏       | 8075/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.103.up_proj:  22%|██▏       | 8076/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.103.down_proj:  22%|██▏       | 8077/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.104.gate_proj:  22%|██▏       | 8078/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.104.up_proj:  22%|██▏       | 8079/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.104.down_proj:  22%|██▏       | 8080/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.105.gate_proj:  22%|██▏       | 8081/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.105.up_proj:  22%|██▏       | 8082/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.105.down_proj:  22%|██▏       | 8083/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.106.gate_proj:  22%|██▏       | 8084/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.106.up_proj:  22%|██▏       | 8085/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.106.down_proj:  22%|██▏       | 8086/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.107.gate_proj:  22%|██▏       | 8087/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.107.up_proj:  22%|██▏       | 8088/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.107.down_proj:  22%|██▏       | 8089/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.108.gate_proj:  22%|██▏       | 8090/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.108.up_proj:  22%|██▏       | 8091/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.108.down_proj:  22%|██▏       | 8092/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.109.gate_proj:  22%|██▏       | 8093/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.109.up_proj:  22%|██▏       | 8094/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.109.down_proj:  22%|██▏       | 8095/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.110.gate_proj:  22%|██▏       | 8096/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.110.up_proj:  22%|██▏       | 8097/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.110.down_proj:  22%|██▏       | 8098/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.111.gate_proj:  22%|██▏       | 8099/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.111.up_proj:  22%|██▏       | 8100/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.111.down_proj:  22%|██▏       | 8101/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.112.gate_proj:  22%|██▏       | 8102/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.112.up_proj:  22%|██▏       | 8103/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.112.down_proj:  22%|██▏       | 8104/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.113.gate_proj:  22%|██▏       | 8105/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.113.up_proj:  22%|██▏       | 8106/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.113.down_proj:  22%|██▏       | 8107/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.114.gate_proj:  22%|██▏       | 8108/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.114.up_proj:  22%|██▏       | 8109/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.114.down_proj:  22%|██▏       | 8110/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.115.gate_proj:  22%|██▏       | 8111/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.115.up_proj:  22%|██▏       | 8112/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.115.down_proj:  22%|██▏       | 8113/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.116.gate_proj:  22%|██▏       | 8114/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.116.up_proj:  22%|██▏       | 8115/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.116.down_proj:  22%|██▏       | 8116/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.117.gate_proj:  22%|██▏       | 8117/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.117.up_proj:  22%|██▏       | 8118/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.117.down_proj:  22%|██▏       | 8119/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.118.gate_proj:  22%|██▏       | 8120/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.118.up_proj:  22%|██▏       | 8121/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.118.down_proj:  22%|██▏       | 8122/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.119.gate_proj:  22%|██▏       | 8123/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.119.up_proj:  22%|██▏       | 8124/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.119.down_proj:  22%|██▏       | 8125/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.120.gate_proj:  22%|██▏       | 8126/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.120.up_proj:  22%|██▏       | 8127/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.120.down_proj:  22%|██▏       | 8128/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.121.gate_proj:  22%|██▏       | 8129/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.121.up_proj:  22%|██▏       | 8130/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.121.down_proj:  22%|██▏       | 8131/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.122.gate_proj:  22%|██▏       | 8132/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.122.up_proj:  22%|██▏       | 8133/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.122.down_proj:  22%|██▏       | 8134/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.123.gate_proj:  22%|██▏       | 8135/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.123.up_proj:  22%|██▏       | 8136/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.123.down_proj:  22%|██▏       | 8137/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.124.gate_proj:  22%|██▏       | 8138/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.124.up_proj:  22%|██▏       | 8139/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.124.down_proj:  22%|██▏       | 8140/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.125.gate_proj:  22%|██▏       | 8141/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.125.up_proj:  22%|██▏       | 8142/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.125.down_proj:  22%|██▏       | 8143/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.126.gate_proj:  22%|██▏       | 8144/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.126.up_proj:  22%|██▏       | 8145/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.126.down_proj:  22%|██▏       | 8146/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.127.gate_proj:  22%|██▏       | 8147/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.19.mlp.experts.127.up_proj:  22%|██▏       | 8148/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.19.mlp.experts.127.down_proj:  22%|██▏       | 8149/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.20.mlp.experts.0.gate_proj:  22%|██▏       | 8150/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.20.mlp.experts.0.up_proj:  22%|██▏       | 8151/36566 [00:08<00:24, 1150.18it/s]  
packing model.layers.20.mlp.experts.0.down_proj:  22%|██▏       | 8152/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.20.mlp.experts.1.gate_proj:  22%|██▏       | 8153/36566 [00:08<00:24, 1150.18it/s]
packing model.layers.20.mlp.experts.1.gate_proj:  22%|██▏       | 8154/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.1.up_proj:  22%|██▏       | 8154/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.1.down_proj:  22%|██▏       | 8155/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.2.gate_proj:  22%|██▏       | 8156/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.2.up_proj:  22%|██▏       | 8157/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.2.down_proj:  22%|██▏       | 8158/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.3.gate_proj:  22%|██▏       | 8159/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.3.up_proj:  22%|██▏       | 8160/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.3.down_proj:  22%|██▏       | 8161/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.4.gate_proj:  22%|██▏       | 8162/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.4.up_proj:  22%|██▏       | 8163/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.4.down_proj:  22%|██▏       | 8164/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.5.gate_proj:  22%|██▏       | 8165/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.5.up_proj:  22%|██▏       | 8166/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.5.down_proj:  22%|██▏       | 8167/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.6.gate_proj:  22%|██▏       | 8168/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.6.up_proj:  22%|██▏       | 8169/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.6.down_proj:  22%|██▏       | 8170/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.7.gate_proj:  22%|██▏       | 8171/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.7.up_proj:  22%|██▏       | 8172/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.7.down_proj:  22%|██▏       | 8173/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.8.gate_proj:  22%|██▏       | 8174/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.8.up_proj:  22%|██▏       | 8175/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.8.down_proj:  22%|██▏       | 8176/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.9.gate_proj:  22%|██▏       | 8177/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.9.up_proj:  22%|██▏       | 8178/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.9.down_proj:  22%|██▏       | 8179/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.10.gate_proj:  22%|██▏       | 8180/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.10.up_proj:  22%|██▏       | 8181/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.10.down_proj:  22%|██▏       | 8182/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.11.gate_proj:  22%|██▏       | 8183/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.11.up_proj:  22%|██▏       | 8184/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.11.down_proj:  22%|██▏       | 8185/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.12.gate_proj:  22%|██▏       | 8186/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.12.up_proj:  22%|██▏       | 8187/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.12.down_proj:  22%|██▏       | 8188/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.13.gate_proj:  22%|██▏       | 8189/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.13.up_proj:  22%|██▏       | 8190/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.13.down_proj:  22%|██▏       | 8191/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.14.gate_proj:  22%|██▏       | 8192/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.14.up_proj:  22%|██▏       | 8193/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.14.down_proj:  22%|██▏       | 8194/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.15.gate_proj:  22%|██▏       | 8195/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.15.up_proj:  22%|██▏       | 8196/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.15.down_proj:  22%|██▏       | 8197/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.16.gate_proj:  22%|██▏       | 8198/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.16.up_proj:  22%|██▏       | 8199/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.16.down_proj:  22%|██▏       | 8200/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.17.gate_proj:  22%|██▏       | 8201/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.17.up_proj:  22%|██▏       | 8202/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.17.down_proj:  22%|██▏       | 8203/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.18.gate_proj:  22%|██▏       | 8204/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.18.up_proj:  22%|██▏       | 8205/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.18.down_proj:  22%|██▏       | 8206/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.19.gate_proj:  22%|██▏       | 8207/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.19.up_proj:  22%|██▏       | 8208/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.19.down_proj:  22%|██▏       | 8209/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.20.gate_proj:  22%|██▏       | 8210/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.20.up_proj:  22%|██▏       | 8211/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.20.down_proj:  22%|██▏       | 8212/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.21.gate_proj:  22%|██▏       | 8213/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.21.up_proj:  22%|██▏       | 8214/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.21.down_proj:  22%|██▏       | 8215/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.22.gate_proj:  22%|██▏       | 8216/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.22.up_proj:  22%|██▏       | 8217/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.22.down_proj:  22%|██▏       | 8218/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.23.gate_proj:  22%|██▏       | 8219/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.23.up_proj:  22%|██▏       | 8220/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.23.down_proj:  22%|██▏       | 8221/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.24.gate_proj:  22%|██▏       | 8222/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.24.up_proj:  22%|██▏       | 8223/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.24.down_proj:  22%|██▏       | 8224/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.25.gate_proj:  22%|██▏       | 8225/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.25.up_proj:  22%|██▏       | 8226/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.25.down_proj:  22%|██▏       | 8227/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.26.gate_proj:  23%|██▎       | 8228/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.26.up_proj:  23%|██▎       | 8229/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.26.down_proj:  23%|██▎       | 8230/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.27.gate_proj:  23%|██▎       | 8231/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.27.up_proj:  23%|██▎       | 8232/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.27.down_proj:  23%|██▎       | 8233/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.28.gate_proj:  23%|██▎       | 8234/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.28.up_proj:  23%|██▎       | 8235/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.28.down_proj:  23%|██▎       | 8236/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.29.gate_proj:  23%|██▎       | 8237/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.29.up_proj:  23%|██▎       | 8238/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.29.down_proj:  23%|██▎       | 8239/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.30.gate_proj:  23%|██▎       | 8240/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.30.up_proj:  23%|██▎       | 8241/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.30.down_proj:  23%|██▎       | 8242/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.31.gate_proj:  23%|██▎       | 8243/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.31.up_proj:  23%|██▎       | 8244/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.31.down_proj:  23%|██▎       | 8245/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.32.gate_proj:  23%|██▎       | 8246/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.32.up_proj:  23%|██▎       | 8247/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.32.down_proj:  23%|██▎       | 8248/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.33.gate_proj:  23%|██▎       | 8249/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.33.up_proj:  23%|██▎       | 8250/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.33.down_proj:  23%|██▎       | 8251/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.34.gate_proj:  23%|██▎       | 8252/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.34.up_proj:  23%|██▎       | 8253/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.34.down_proj:  23%|██▎       | 8254/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.35.gate_proj:  23%|██▎       | 8255/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.35.up_proj:  23%|██▎       | 8256/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.35.down_proj:  23%|██▎       | 8257/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.36.gate_proj:  23%|██▎       | 8258/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.36.up_proj:  23%|██▎       | 8259/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.36.down_proj:  23%|██▎       | 8260/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.37.gate_proj:  23%|██▎       | 8261/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.37.up_proj:  23%|██▎       | 8262/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.37.down_proj:  23%|██▎       | 8263/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.38.gate_proj:  23%|██▎       | 8264/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.38.up_proj:  23%|██▎       | 8265/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.38.down_proj:  23%|██▎       | 8266/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.39.gate_proj:  23%|██▎       | 8267/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.39.up_proj:  23%|██▎       | 8268/36566 [00:08<00:24, 1150.20it/s]  
packing model.layers.20.mlp.experts.39.down_proj:  23%|██▎       | 8269/36566 [00:08<00:24, 1150.20it/s]
packing model.layers.20.mlp.experts.39.down_proj:  23%|██▎       | 8270/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.40.gate_proj:  23%|██▎       | 8270/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.40.up_proj:  23%|██▎       | 8271/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.40.down_proj:  23%|██▎       | 8272/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.41.gate_proj:  23%|██▎       | 8273/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.41.up_proj:  23%|██▎       | 8274/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.41.down_proj:  23%|██▎       | 8275/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.42.gate_proj:  23%|██▎       | 8276/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.42.up_proj:  23%|██▎       | 8277/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.42.down_proj:  23%|██▎       | 8278/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.43.gate_proj:  23%|██▎       | 8279/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.43.up_proj:  23%|██▎       | 8280/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.43.down_proj:  23%|██▎       | 8281/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.44.gate_proj:  23%|██▎       | 8282/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.44.up_proj:  23%|██▎       | 8283/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.44.down_proj:  23%|██▎       | 8284/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.45.gate_proj:  23%|██▎       | 8285/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.45.up_proj:  23%|██▎       | 8286/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.45.down_proj:  23%|██▎       | 8287/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.46.gate_proj:  23%|██▎       | 8288/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.46.up_proj:  23%|██▎       | 8289/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.46.down_proj:  23%|██▎       | 8290/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.47.gate_proj:  23%|██▎       | 8291/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.47.up_proj:  23%|██▎       | 8292/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.47.down_proj:  23%|██▎       | 8293/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.48.gate_proj:  23%|██▎       | 8294/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.48.up_proj:  23%|██▎       | 8295/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.48.down_proj:  23%|██▎       | 8296/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.49.gate_proj:  23%|██▎       | 8297/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.49.up_proj:  23%|██▎       | 8298/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.49.down_proj:  23%|██▎       | 8299/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.50.gate_proj:  23%|██▎       | 8300/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.50.up_proj:  23%|██▎       | 8301/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.50.down_proj:  23%|██▎       | 8302/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.51.gate_proj:  23%|██▎       | 8303/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.51.up_proj:  23%|██▎       | 8304/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.51.down_proj:  23%|██▎       | 8305/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.52.gate_proj:  23%|██▎       | 8306/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.52.up_proj:  23%|██▎       | 8307/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.52.down_proj:  23%|██▎       | 8308/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.53.gate_proj:  23%|██▎       | 8309/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.53.up_proj:  23%|██▎       | 8310/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.53.down_proj:  23%|██▎       | 8311/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.54.gate_proj:  23%|██▎       | 8312/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.54.up_proj:  23%|██▎       | 8313/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.54.down_proj:  23%|██▎       | 8314/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.55.gate_proj:  23%|██▎       | 8315/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.55.up_proj:  23%|██▎       | 8316/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.55.down_proj:  23%|██▎       | 8317/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.56.gate_proj:  23%|██▎       | 8318/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.56.up_proj:  23%|██▎       | 8319/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.56.down_proj:  23%|██▎       | 8320/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.57.gate_proj:  23%|██▎       | 8321/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.57.up_proj:  23%|██▎       | 8322/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.57.down_proj:  23%|██▎       | 8323/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.58.gate_proj:  23%|██▎       | 8324/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.58.up_proj:  23%|██▎       | 8325/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.58.down_proj:  23%|██▎       | 8326/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.59.gate_proj:  23%|██▎       | 8327/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.59.up_proj:  23%|██▎       | 8328/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.59.down_proj:  23%|██▎       | 8329/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.60.gate_proj:  23%|██▎       | 8330/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.60.up_proj:  23%|██▎       | 8331/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.60.down_proj:  23%|██▎       | 8332/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.61.gate_proj:  23%|██▎       | 8333/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.61.up_proj:  23%|██▎       | 8334/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.61.down_proj:  23%|██▎       | 8335/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.62.gate_proj:  23%|██▎       | 8336/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.62.up_proj:  23%|██▎       | 8337/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.62.down_proj:  23%|██▎       | 8338/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.63.gate_proj:  23%|██▎       | 8339/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.63.up_proj:  23%|██▎       | 8340/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.63.down_proj:  23%|██▎       | 8341/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.64.gate_proj:  23%|██▎       | 8342/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.64.up_proj:  23%|██▎       | 8343/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.64.down_proj:  23%|██▎       | 8344/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.65.gate_proj:  23%|██▎       | 8345/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.65.up_proj:  23%|██▎       | 8346/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.65.down_proj:  23%|██▎       | 8347/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.66.gate_proj:  23%|██▎       | 8348/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.66.up_proj:  23%|██▎       | 8349/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.66.down_proj:  23%|██▎       | 8350/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.67.gate_proj:  23%|██▎       | 8351/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.67.up_proj:  23%|██▎       | 8352/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.67.down_proj:  23%|██▎       | 8353/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.68.gate_proj:  23%|██▎       | 8354/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.68.up_proj:  23%|██▎       | 8355/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.68.down_proj:  23%|██▎       | 8356/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.69.gate_proj:  23%|██▎       | 8357/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.69.up_proj:  23%|██▎       | 8358/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.69.down_proj:  23%|██▎       | 8359/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.70.gate_proj:  23%|██▎       | 8360/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.70.up_proj:  23%|██▎       | 8361/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.70.down_proj:  23%|██▎       | 8362/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.71.gate_proj:  23%|██▎       | 8363/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.71.up_proj:  23%|██▎       | 8364/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.71.down_proj:  23%|██▎       | 8365/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.72.gate_proj:  23%|██▎       | 8366/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.72.up_proj:  23%|██▎       | 8367/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.72.down_proj:  23%|██▎       | 8368/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.73.gate_proj:  23%|██▎       | 8369/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.73.up_proj:  23%|██▎       | 8370/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.73.down_proj:  23%|██▎       | 8371/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.74.gate_proj:  23%|██▎       | 8372/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.74.up_proj:  23%|██▎       | 8373/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.74.down_proj:  23%|██▎       | 8374/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.75.gate_proj:  23%|██▎       | 8375/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.75.up_proj:  23%|██▎       | 8376/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.75.down_proj:  23%|██▎       | 8377/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.76.gate_proj:  23%|██▎       | 8378/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.76.up_proj:  23%|██▎       | 8379/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.76.down_proj:  23%|██▎       | 8380/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.77.gate_proj:  23%|██▎       | 8381/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.77.up_proj:  23%|██▎       | 8382/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.77.down_proj:  23%|██▎       | 8383/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.78.gate_proj:  23%|██▎       | 8384/36566 [00:08<00:24, 1152.16it/s]
packing model.layers.20.mlp.experts.78.up_proj:  23%|██▎       | 8385/36566 [00:08<00:24, 1152.16it/s]  
packing model.layers.20.mlp.experts.78.up_proj:  23%|██▎       | 8386/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.78.down_proj:  23%|██▎       | 8386/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.79.gate_proj:  23%|██▎       | 8387/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.79.up_proj:  23%|██▎       | 8388/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.79.down_proj:  23%|██▎       | 8389/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.80.gate_proj:  23%|██▎       | 8390/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.80.up_proj:  23%|██▎       | 8391/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.80.down_proj:  23%|██▎       | 8392/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.81.gate_proj:  23%|██▎       | 8393/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.81.up_proj:  23%|██▎       | 8394/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.81.down_proj:  23%|██▎       | 8395/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.82.gate_proj:  23%|██▎       | 8396/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.82.up_proj:  23%|██▎       | 8397/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.82.down_proj:  23%|██▎       | 8398/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.83.gate_proj:  23%|██▎       | 8399/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.83.up_proj:  23%|██▎       | 8400/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.83.down_proj:  23%|██▎       | 8401/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.84.gate_proj:  23%|██▎       | 8402/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.84.up_proj:  23%|██▎       | 8403/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.84.down_proj:  23%|██▎       | 8404/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.85.gate_proj:  23%|██▎       | 8405/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.85.up_proj:  23%|██▎       | 8406/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.85.down_proj:  23%|██▎       | 8407/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.86.gate_proj:  23%|██▎       | 8408/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.86.up_proj:  23%|██▎       | 8409/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.86.down_proj:  23%|██▎       | 8410/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.87.gate_proj:  23%|██▎       | 8411/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.87.up_proj:  23%|██▎       | 8412/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.87.down_proj:  23%|██▎       | 8413/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.88.gate_proj:  23%|██▎       | 8414/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.88.up_proj:  23%|██▎       | 8415/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.88.down_proj:  23%|██▎       | 8416/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.89.gate_proj:  23%|██▎       | 8417/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.89.up_proj:  23%|██▎       | 8418/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.89.down_proj:  23%|██▎       | 8419/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.90.gate_proj:  23%|██▎       | 8420/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.90.up_proj:  23%|██▎       | 8421/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.90.down_proj:  23%|██▎       | 8422/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.91.gate_proj:  23%|██▎       | 8423/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.91.up_proj:  23%|██▎       | 8424/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.91.down_proj:  23%|██▎       | 8425/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.92.gate_proj:  23%|██▎       | 8426/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.92.up_proj:  23%|██▎       | 8427/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.92.down_proj:  23%|██▎       | 8428/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.93.gate_proj:  23%|██▎       | 8429/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.93.up_proj:  23%|██▎       | 8430/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.93.down_proj:  23%|██▎       | 8431/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.94.gate_proj:  23%|██▎       | 8432/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.94.up_proj:  23%|██▎       | 8433/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.94.down_proj:  23%|██▎       | 8434/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.95.gate_proj:  23%|██▎       | 8435/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.95.up_proj:  23%|██▎       | 8436/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.95.down_proj:  23%|██▎       | 8437/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.96.gate_proj:  23%|██▎       | 8438/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.96.up_proj:  23%|██▎       | 8439/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.96.down_proj:  23%|██▎       | 8440/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.97.gate_proj:  23%|██▎       | 8441/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.97.up_proj:  23%|██▎       | 8442/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.97.down_proj:  23%|██▎       | 8443/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.98.gate_proj:  23%|██▎       | 8444/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.98.up_proj:  23%|██▎       | 8445/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.98.down_proj:  23%|██▎       | 8446/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.99.gate_proj:  23%|██▎       | 8447/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.99.up_proj:  23%|██▎       | 8448/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.99.down_proj:  23%|██▎       | 8449/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.100.gate_proj:  23%|██▎       | 8450/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.100.up_proj:  23%|██▎       | 8451/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.100.down_proj:  23%|██▎       | 8452/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.101.gate_proj:  23%|██▎       | 8453/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.101.up_proj:  23%|██▎       | 8454/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.101.down_proj:  23%|██▎       | 8455/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.102.gate_proj:  23%|██▎       | 8456/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.102.up_proj:  23%|██▎       | 8457/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.102.down_proj:  23%|██▎       | 8458/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.103.gate_proj:  23%|██▎       | 8459/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.103.up_proj:  23%|██▎       | 8460/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.103.down_proj:  23%|██▎       | 8461/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.104.gate_proj:  23%|██▎       | 8462/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.104.up_proj:  23%|██▎       | 8463/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.104.down_proj:  23%|██▎       | 8464/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.105.gate_proj:  23%|██▎       | 8465/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.105.up_proj:  23%|██▎       | 8466/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.105.down_proj:  23%|██▎       | 8467/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.106.gate_proj:  23%|██▎       | 8468/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.106.up_proj:  23%|██▎       | 8469/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.106.down_proj:  23%|██▎       | 8470/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.107.gate_proj:  23%|██▎       | 8471/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.107.up_proj:  23%|██▎       | 8472/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.107.down_proj:  23%|██▎       | 8473/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.108.gate_proj:  23%|██▎       | 8474/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.108.up_proj:  23%|██▎       | 8475/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.108.down_proj:  23%|██▎       | 8476/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.109.gate_proj:  23%|██▎       | 8477/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.109.up_proj:  23%|██▎       | 8478/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.109.down_proj:  23%|██▎       | 8479/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.110.gate_proj:  23%|██▎       | 8480/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.110.up_proj:  23%|██▎       | 8481/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.110.down_proj:  23%|██▎       | 8482/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.111.gate_proj:  23%|██▎       | 8483/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.111.up_proj:  23%|██▎       | 8484/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.111.down_proj:  23%|██▎       | 8485/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.112.gate_proj:  23%|██▎       | 8486/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.112.up_proj:  23%|██▎       | 8487/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.112.down_proj:  23%|██▎       | 8488/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.113.gate_proj:  23%|██▎       | 8489/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.113.up_proj:  23%|██▎       | 8490/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.113.down_proj:  23%|██▎       | 8491/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.114.gate_proj:  23%|██▎       | 8492/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.114.up_proj:  23%|██▎       | 8493/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.114.down_proj:  23%|██▎       | 8494/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.115.gate_proj:  23%|██▎       | 8495/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.115.up_proj:  23%|██▎       | 8496/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.115.down_proj:  23%|██▎       | 8497/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.116.gate_proj:  23%|██▎       | 8498/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.116.up_proj:  23%|██▎       | 8499/36566 [00:08<00:24, 1151.52it/s]  
packing model.layers.20.mlp.experts.116.down_proj:  23%|██▎       | 8500/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.117.gate_proj:  23%|██▎       | 8501/36566 [00:08<00:24, 1151.52it/s]
packing model.layers.20.mlp.experts.117.gate_proj:  23%|██▎       | 8502/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.117.up_proj:  23%|██▎       | 8502/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.117.down_proj:  23%|██▎       | 8503/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.118.gate_proj:  23%|██▎       | 8504/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.118.up_proj:  23%|██▎       | 8505/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.118.down_proj:  23%|██▎       | 8506/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.119.gate_proj:  23%|██▎       | 8507/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.119.up_proj:  23%|██▎       | 8508/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.119.down_proj:  23%|██▎       | 8509/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.120.gate_proj:  23%|██▎       | 8510/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.120.up_proj:  23%|██▎       | 8511/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.120.down_proj:  23%|██▎       | 8512/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.121.gate_proj:  23%|██▎       | 8513/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.121.up_proj:  23%|██▎       | 8514/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.121.down_proj:  23%|██▎       | 8515/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.122.gate_proj:  23%|██▎       | 8516/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.122.up_proj:  23%|██▎       | 8517/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.122.down_proj:  23%|██▎       | 8518/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.123.gate_proj:  23%|██▎       | 8519/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.123.up_proj:  23%|██▎       | 8520/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.123.down_proj:  23%|██▎       | 8521/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.124.gate_proj:  23%|██▎       | 8522/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.124.up_proj:  23%|██▎       | 8523/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.124.down_proj:  23%|██▎       | 8524/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.125.gate_proj:  23%|██▎       | 8525/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.125.up_proj:  23%|██▎       | 8526/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.125.down_proj:  23%|██▎       | 8527/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.126.gate_proj:  23%|██▎       | 8528/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.126.up_proj:  23%|██▎       | 8529/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.126.down_proj:  23%|██▎       | 8530/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.127.gate_proj:  23%|██▎       | 8531/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.20.mlp.experts.127.up_proj:  23%|██▎       | 8532/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.20.mlp.experts.127.down_proj:  23%|██▎       | 8533/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.0.gate_proj:  23%|██▎       | 8534/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.0.up_proj:  23%|██▎       | 8535/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.0.down_proj:  23%|██▎       | 8536/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.1.gate_proj:  23%|██▎       | 8537/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.1.up_proj:  23%|██▎       | 8538/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.1.down_proj:  23%|██▎       | 8539/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.2.gate_proj:  23%|██▎       | 8540/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.2.up_proj:  23%|██▎       | 8541/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.2.down_proj:  23%|██▎       | 8542/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.3.gate_proj:  23%|██▎       | 8543/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.3.up_proj:  23%|██▎       | 8544/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.3.down_proj:  23%|██▎       | 8545/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.4.gate_proj:  23%|██▎       | 8546/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.4.up_proj:  23%|██▎       | 8547/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.4.down_proj:  23%|██▎       | 8548/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.5.gate_proj:  23%|██▎       | 8549/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.5.up_proj:  23%|██▎       | 8550/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.5.down_proj:  23%|██▎       | 8551/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.6.gate_proj:  23%|██▎       | 8552/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.6.up_proj:  23%|██▎       | 8553/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.6.down_proj:  23%|██▎       | 8554/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.7.gate_proj:  23%|██▎       | 8555/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.7.up_proj:  23%|██▎       | 8556/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.7.down_proj:  23%|██▎       | 8557/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.8.gate_proj:  23%|██▎       | 8558/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.8.up_proj:  23%|██▎       | 8559/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.8.down_proj:  23%|██▎       | 8560/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.9.gate_proj:  23%|██▎       | 8561/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.9.up_proj:  23%|██▎       | 8562/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.9.down_proj:  23%|██▎       | 8563/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.10.gate_proj:  23%|██▎       | 8564/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.10.up_proj:  23%|██▎       | 8565/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.10.down_proj:  23%|██▎       | 8566/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.11.gate_proj:  23%|██▎       | 8567/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.11.up_proj:  23%|██▎       | 8568/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.11.down_proj:  23%|██▎       | 8569/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.12.gate_proj:  23%|██▎       | 8570/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.12.up_proj:  23%|██▎       | 8571/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.12.down_proj:  23%|██▎       | 8572/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.13.gate_proj:  23%|██▎       | 8573/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.13.up_proj:  23%|██▎       | 8574/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.13.down_proj:  23%|██▎       | 8575/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.14.gate_proj:  23%|██▎       | 8576/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.14.up_proj:  23%|██▎       | 8577/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.14.down_proj:  23%|██▎       | 8578/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.15.gate_proj:  23%|██▎       | 8579/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.15.up_proj:  23%|██▎       | 8580/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.15.down_proj:  23%|██▎       | 8581/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.16.gate_proj:  23%|██▎       | 8582/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.16.up_proj:  23%|██▎       | 8583/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.16.down_proj:  23%|██▎       | 8584/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.17.gate_proj:  23%|██▎       | 8585/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.17.up_proj:  23%|██▎       | 8586/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.17.down_proj:  23%|██▎       | 8587/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.18.gate_proj:  23%|██▎       | 8588/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.18.up_proj:  23%|██▎       | 8589/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.18.down_proj:  23%|██▎       | 8590/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.19.gate_proj:  23%|██▎       | 8591/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.19.up_proj:  23%|██▎       | 8592/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.19.down_proj:  23%|██▎       | 8593/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.20.gate_proj:  24%|██▎       | 8594/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.20.up_proj:  24%|██▎       | 8595/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.20.down_proj:  24%|██▎       | 8596/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.21.gate_proj:  24%|██▎       | 8597/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.21.up_proj:  24%|██▎       | 8598/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.21.down_proj:  24%|██▎       | 8599/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.22.gate_proj:  24%|██▎       | 8600/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.22.up_proj:  24%|██▎       | 8601/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.22.down_proj:  24%|██▎       | 8602/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.23.gate_proj:  24%|██▎       | 8603/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.23.up_proj:  24%|██▎       | 8604/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.23.down_proj:  24%|██▎       | 8605/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.24.gate_proj:  24%|██▎       | 8606/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.24.up_proj:  24%|██▎       | 8607/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.24.down_proj:  24%|██▎       | 8608/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.25.gate_proj:  24%|██▎       | 8609/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.25.up_proj:  24%|██▎       | 8610/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.25.down_proj:  24%|██▎       | 8611/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.26.gate_proj:  24%|██▎       | 8612/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.26.up_proj:  24%|██▎       | 8613/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.26.down_proj:  24%|██▎       | 8614/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.27.gate_proj:  24%|██▎       | 8615/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.27.up_proj:  24%|██▎       | 8616/36566 [00:08<00:24, 1143.63it/s]  
packing model.layers.21.mlp.experts.27.down_proj:  24%|██▎       | 8617/36566 [00:08<00:24, 1143.63it/s]
packing model.layers.21.mlp.experts.27.down_proj:  24%|██▎       | 8618/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.28.gate_proj:  24%|██▎       | 8618/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.28.up_proj:  24%|██▎       | 8619/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.28.down_proj:  24%|██▎       | 8620/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.29.gate_proj:  24%|██▎       | 8621/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.29.up_proj:  24%|██▎       | 8622/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.29.down_proj:  24%|██▎       | 8623/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.30.gate_proj:  24%|██▎       | 8624/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.30.up_proj:  24%|██▎       | 8625/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.30.down_proj:  24%|██▎       | 8626/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.31.gate_proj:  24%|██▎       | 8627/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.31.up_proj:  24%|██▎       | 8628/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.31.down_proj:  24%|██▎       | 8629/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.32.gate_proj:  24%|██▎       | 8630/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.32.up_proj:  24%|██▎       | 8631/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.32.down_proj:  24%|██▎       | 8632/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.33.gate_proj:  24%|██▎       | 8633/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.33.up_proj:  24%|██▎       | 8634/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.33.down_proj:  24%|██▎       | 8635/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.34.gate_proj:  24%|██▎       | 8636/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.34.up_proj:  24%|██▎       | 8637/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.34.down_proj:  24%|██▎       | 8638/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.35.gate_proj:  24%|██▎       | 8639/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.35.up_proj:  24%|██▎       | 8640/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.35.down_proj:  24%|██▎       | 8641/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.36.gate_proj:  24%|██▎       | 8642/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.36.up_proj:  24%|██▎       | 8643/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.36.down_proj:  24%|██▎       | 8644/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.37.gate_proj:  24%|██▎       | 8645/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.37.up_proj:  24%|██▎       | 8646/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.37.down_proj:  24%|██▎       | 8647/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.38.gate_proj:  24%|██▎       | 8648/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.38.up_proj:  24%|██▎       | 8649/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.38.down_proj:  24%|██▎       | 8650/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.39.gate_proj:  24%|██▎       | 8651/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.39.up_proj:  24%|██▎       | 8652/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.39.down_proj:  24%|██▎       | 8653/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.40.gate_proj:  24%|██▎       | 8654/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.40.up_proj:  24%|██▎       | 8655/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.40.down_proj:  24%|██▎       | 8656/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.41.gate_proj:  24%|██▎       | 8657/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.41.up_proj:  24%|██▎       | 8658/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.41.down_proj:  24%|██▎       | 8659/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.42.gate_proj:  24%|██▎       | 8660/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.42.up_proj:  24%|██▎       | 8661/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.42.down_proj:  24%|██▎       | 8662/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.43.gate_proj:  24%|██▎       | 8663/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.43.up_proj:  24%|██▎       | 8664/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.43.down_proj:  24%|██▎       | 8665/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.44.gate_proj:  24%|██▎       | 8666/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.44.up_proj:  24%|██▎       | 8667/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.44.down_proj:  24%|██▎       | 8668/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.45.gate_proj:  24%|██▎       | 8669/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.45.up_proj:  24%|██▎       | 8670/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.45.down_proj:  24%|██▎       | 8671/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.46.gate_proj:  24%|██▎       | 8672/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.46.up_proj:  24%|██▎       | 8673/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.46.down_proj:  24%|██▎       | 8674/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.47.gate_proj:  24%|██▎       | 8675/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.47.up_proj:  24%|██▎       | 8676/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.47.down_proj:  24%|██▎       | 8677/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.48.gate_proj:  24%|██▎       | 8678/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.48.up_proj:  24%|██▎       | 8679/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.48.down_proj:  24%|██▎       | 8680/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.49.gate_proj:  24%|██▎       | 8681/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.49.up_proj:  24%|██▎       | 8682/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.49.down_proj:  24%|██▎       | 8683/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.50.gate_proj:  24%|██▎       | 8684/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.50.up_proj:  24%|██▍       | 8685/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.50.down_proj:  24%|██▍       | 8686/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.51.gate_proj:  24%|██▍       | 8687/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.51.up_proj:  24%|██▍       | 8688/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.51.down_proj:  24%|██▍       | 8689/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.52.gate_proj:  24%|██▍       | 8690/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.52.up_proj:  24%|██▍       | 8691/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.52.down_proj:  24%|██▍       | 8692/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.53.gate_proj:  24%|██▍       | 8693/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.53.up_proj:  24%|██▍       | 8694/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.53.down_proj:  24%|██▍       | 8695/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.54.gate_proj:  24%|██▍       | 8696/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.54.up_proj:  24%|██▍       | 8697/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.54.down_proj:  24%|██▍       | 8698/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.55.gate_proj:  24%|██▍       | 8699/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.55.up_proj:  24%|██▍       | 8700/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.55.down_proj:  24%|██▍       | 8701/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.56.gate_proj:  24%|██▍       | 8702/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.56.up_proj:  24%|██▍       | 8703/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.56.down_proj:  24%|██▍       | 8704/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.57.gate_proj:  24%|██▍       | 8705/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.57.up_proj:  24%|██▍       | 8706/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.57.down_proj:  24%|██▍       | 8707/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.58.gate_proj:  24%|██▍       | 8708/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.58.up_proj:  24%|██▍       | 8709/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.58.down_proj:  24%|██▍       | 8710/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.59.gate_proj:  24%|██▍       | 8711/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.59.up_proj:  24%|██▍       | 8712/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.59.down_proj:  24%|██▍       | 8713/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.60.gate_proj:  24%|██▍       | 8714/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.60.up_proj:  24%|██▍       | 8715/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.60.down_proj:  24%|██▍       | 8716/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.61.gate_proj:  24%|██▍       | 8717/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.61.up_proj:  24%|██▍       | 8718/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.61.down_proj:  24%|██▍       | 8719/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.62.gate_proj:  24%|██▍       | 8720/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.62.up_proj:  24%|██▍       | 8721/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.62.down_proj:  24%|██▍       | 8722/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.63.gate_proj:  24%|██▍       | 8723/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.63.up_proj:  24%|██▍       | 8724/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.63.down_proj:  24%|██▍       | 8725/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.64.gate_proj:  24%|██▍       | 8726/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.64.up_proj:  24%|██▍       | 8727/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.64.down_proj:  24%|██▍       | 8728/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.65.gate_proj:  24%|██▍       | 8729/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.65.up_proj:  24%|██▍       | 8730/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.65.down_proj:  24%|██▍       | 8731/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.66.gate_proj:  24%|██▍       | 8732/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.66.up_proj:  24%|██▍       | 8733/36566 [00:08<00:24, 1146.72it/s]  
packing model.layers.21.mlp.experts.66.down_proj:  24%|██▍       | 8734/36566 [00:08<00:24, 1146.72it/s]
packing model.layers.21.mlp.experts.66.down_proj:  24%|██▍       | 8735/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.67.gate_proj:  24%|██▍       | 8735/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.67.up_proj:  24%|██▍       | 8736/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.67.down_proj:  24%|██▍       | 8737/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.68.gate_proj:  24%|██▍       | 8738/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.68.up_proj:  24%|██▍       | 8739/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.68.down_proj:  24%|██▍       | 8740/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.69.gate_proj:  24%|██▍       | 8741/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.69.up_proj:  24%|██▍       | 8742/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.69.down_proj:  24%|██▍       | 8743/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.70.gate_proj:  24%|██▍       | 8744/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.70.up_proj:  24%|██▍       | 8745/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.70.down_proj:  24%|██▍       | 8746/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.71.gate_proj:  24%|██▍       | 8747/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.71.up_proj:  24%|██▍       | 8748/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.71.down_proj:  24%|██▍       | 8749/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.72.gate_proj:  24%|██▍       | 8750/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.72.up_proj:  24%|██▍       | 8751/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.72.down_proj:  24%|██▍       | 8752/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.73.gate_proj:  24%|██▍       | 8753/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.73.up_proj:  24%|██▍       | 8754/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.73.down_proj:  24%|██▍       | 8755/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.74.gate_proj:  24%|██▍       | 8756/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.74.up_proj:  24%|██▍       | 8757/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.74.down_proj:  24%|██▍       | 8758/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.75.gate_proj:  24%|██▍       | 8759/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.75.up_proj:  24%|██▍       | 8760/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.75.down_proj:  24%|██▍       | 8761/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.76.gate_proj:  24%|██▍       | 8762/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.76.up_proj:  24%|██▍       | 8763/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.76.down_proj:  24%|██▍       | 8764/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.77.gate_proj:  24%|██▍       | 8765/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.77.up_proj:  24%|██▍       | 8766/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.77.down_proj:  24%|██▍       | 8767/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.78.gate_proj:  24%|██▍       | 8768/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.78.up_proj:  24%|██▍       | 8769/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.78.down_proj:  24%|██▍       | 8770/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.79.gate_proj:  24%|██▍       | 8771/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.79.up_proj:  24%|██▍       | 8772/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.79.down_proj:  24%|██▍       | 8773/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.80.gate_proj:  24%|██▍       | 8774/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.80.up_proj:  24%|██▍       | 8775/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.80.down_proj:  24%|██▍       | 8776/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.81.gate_proj:  24%|██▍       | 8777/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.81.up_proj:  24%|██▍       | 8778/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.81.down_proj:  24%|██▍       | 8779/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.82.gate_proj:  24%|██▍       | 8780/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.82.up_proj:  24%|██▍       | 8781/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.82.down_proj:  24%|██▍       | 8782/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.83.gate_proj:  24%|██▍       | 8783/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.83.up_proj:  24%|██▍       | 8784/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.83.down_proj:  24%|██▍       | 8785/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.84.gate_proj:  24%|██▍       | 8786/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.84.up_proj:  24%|██▍       | 8787/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.84.down_proj:  24%|██▍       | 8788/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.85.gate_proj:  24%|██▍       | 8789/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.85.up_proj:  24%|██▍       | 8790/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.85.down_proj:  24%|██▍       | 8791/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.86.gate_proj:  24%|██▍       | 8792/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.86.up_proj:  24%|██▍       | 8793/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.86.down_proj:  24%|██▍       | 8794/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.87.gate_proj:  24%|██▍       | 8795/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.87.up_proj:  24%|██▍       | 8796/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.87.down_proj:  24%|██▍       | 8797/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.88.gate_proj:  24%|██▍       | 8798/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.88.up_proj:  24%|██▍       | 8799/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.88.down_proj:  24%|██▍       | 8800/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.89.gate_proj:  24%|██▍       | 8801/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.89.up_proj:  24%|██▍       | 8802/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.89.down_proj:  24%|██▍       | 8803/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.90.gate_proj:  24%|██▍       | 8804/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.90.up_proj:  24%|██▍       | 8805/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.90.down_proj:  24%|██▍       | 8806/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.91.gate_proj:  24%|██▍       | 8807/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.91.up_proj:  24%|██▍       | 8808/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.91.down_proj:  24%|██▍       | 8809/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.92.gate_proj:  24%|██▍       | 8810/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.92.up_proj:  24%|██▍       | 8811/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.92.down_proj:  24%|██▍       | 8812/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.93.gate_proj:  24%|██▍       | 8813/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.93.up_proj:  24%|██▍       | 8814/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.93.down_proj:  24%|██▍       | 8815/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.94.gate_proj:  24%|██▍       | 8816/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.94.up_proj:  24%|██▍       | 8817/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.94.down_proj:  24%|██▍       | 8818/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.95.gate_proj:  24%|██▍       | 8819/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.95.up_proj:  24%|██▍       | 8820/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.95.down_proj:  24%|██▍       | 8821/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.96.gate_proj:  24%|██▍       | 8822/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.96.up_proj:  24%|██▍       | 8823/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.96.down_proj:  24%|██▍       | 8824/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.97.gate_proj:  24%|██▍       | 8825/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.97.up_proj:  24%|██▍       | 8826/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.97.down_proj:  24%|██▍       | 8827/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.98.gate_proj:  24%|██▍       | 8828/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.98.up_proj:  24%|██▍       | 8829/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.98.down_proj:  24%|██▍       | 8830/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.99.gate_proj:  24%|██▍       | 8831/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.99.up_proj:  24%|██▍       | 8832/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.99.down_proj:  24%|██▍       | 8833/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.100.gate_proj:  24%|██▍       | 8834/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.100.up_proj:  24%|██▍       | 8835/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.100.down_proj:  24%|██▍       | 8836/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.101.gate_proj:  24%|██▍       | 8837/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.101.up_proj:  24%|██▍       | 8838/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.101.down_proj:  24%|██▍       | 8839/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.102.gate_proj:  24%|██▍       | 8840/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.102.up_proj:  24%|██▍       | 8841/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.102.down_proj:  24%|██▍       | 8842/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.103.gate_proj:  24%|██▍       | 8843/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.103.up_proj:  24%|██▍       | 8844/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.103.down_proj:  24%|██▍       | 8845/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.104.gate_proj:  24%|██▍       | 8846/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.104.up_proj:  24%|██▍       | 8847/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.104.down_proj:  24%|██▍       | 8848/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.105.gate_proj:  24%|██▍       | 8849/36566 [00:08<00:24, 1150.89it/s]
packing model.layers.21.mlp.experts.105.up_proj:  24%|██▍       | 8850/36566 [00:08<00:24, 1150.89it/s]  
packing model.layers.21.mlp.experts.105.up_proj:  24%|██▍       | 8851/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.105.down_proj:  24%|██▍       | 8851/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.106.gate_proj:  24%|██▍       | 8852/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.106.up_proj:  24%|██▍       | 8853/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.106.down_proj:  24%|██▍       | 8854/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.107.gate_proj:  24%|██▍       | 8855/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.107.up_proj:  24%|██▍       | 8856/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.107.down_proj:  24%|██▍       | 8857/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.108.gate_proj:  24%|██▍       | 8858/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.108.up_proj:  24%|██▍       | 8859/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.108.down_proj:  24%|██▍       | 8860/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.109.gate_proj:  24%|██▍       | 8861/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.109.up_proj:  24%|██▍       | 8862/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.109.down_proj:  24%|██▍       | 8863/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.110.gate_proj:  24%|██▍       | 8864/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.110.up_proj:  24%|██▍       | 8865/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.110.down_proj:  24%|██▍       | 8866/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.111.gate_proj:  24%|██▍       | 8867/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.111.up_proj:  24%|██▍       | 8868/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.111.down_proj:  24%|██▍       | 8869/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.112.gate_proj:  24%|██▍       | 8870/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.112.up_proj:  24%|██▍       | 8871/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.112.down_proj:  24%|██▍       | 8872/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.113.gate_proj:  24%|██▍       | 8873/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.113.up_proj:  24%|██▍       | 8874/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.113.down_proj:  24%|██▍       | 8875/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.114.gate_proj:  24%|██▍       | 8876/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.114.up_proj:  24%|██▍       | 8877/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.114.down_proj:  24%|██▍       | 8878/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.115.gate_proj:  24%|██▍       | 8879/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.115.up_proj:  24%|██▍       | 8880/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.115.down_proj:  24%|██▍       | 8881/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.116.gate_proj:  24%|██▍       | 8882/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.116.up_proj:  24%|██▍       | 8883/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.116.down_proj:  24%|██▍       | 8884/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.117.gate_proj:  24%|██▍       | 8885/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.117.up_proj:  24%|██▍       | 8886/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.117.down_proj:  24%|██▍       | 8887/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.118.gate_proj:  24%|██▍       | 8888/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.118.up_proj:  24%|██▍       | 8889/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.118.down_proj:  24%|██▍       | 8890/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.119.gate_proj:  24%|██▍       | 8891/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.119.up_proj:  24%|██▍       | 8892/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.119.down_proj:  24%|██▍       | 8893/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.120.gate_proj:  24%|██▍       | 8894/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.120.up_proj:  24%|██▍       | 8895/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.120.down_proj:  24%|██▍       | 8896/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.121.gate_proj:  24%|██▍       | 8897/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.121.up_proj:  24%|██▍       | 8898/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.121.down_proj:  24%|██▍       | 8899/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.122.gate_proj:  24%|██▍       | 8900/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.122.up_proj:  24%|██▍       | 8901/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.122.down_proj:  24%|██▍       | 8902/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.123.gate_proj:  24%|██▍       | 8903/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.123.up_proj:  24%|██▍       | 8904/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.123.down_proj:  24%|██▍       | 8905/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.124.gate_proj:  24%|██▍       | 8906/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.124.up_proj:  24%|██▍       | 8907/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.124.down_proj:  24%|██▍       | 8908/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.125.gate_proj:  24%|██▍       | 8909/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.125.up_proj:  24%|██▍       | 8910/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.125.down_proj:  24%|██▍       | 8911/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.126.gate_proj:  24%|██▍       | 8912/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.126.up_proj:  24%|██▍       | 8913/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.126.down_proj:  24%|██▍       | 8914/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.127.gate_proj:  24%|██▍       | 8915/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.21.mlp.experts.127.up_proj:  24%|██▍       | 8916/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.21.mlp.experts.127.down_proj:  24%|██▍       | 8917/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.0.gate_proj:  24%|██▍       | 8918/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.22.mlp.experts.0.up_proj:  24%|██▍       | 8919/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.22.mlp.experts.0.down_proj:  24%|██▍       | 8920/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.1.gate_proj:  24%|██▍       | 8921/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.1.up_proj:  24%|██▍       | 8922/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.22.mlp.experts.1.down_proj:  24%|██▍       | 8923/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.2.gate_proj:  24%|██▍       | 8924/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.2.up_proj:  24%|██▍       | 8925/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.22.mlp.experts.2.down_proj:  24%|██▍       | 8926/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.3.gate_proj:  24%|██▍       | 8927/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.3.up_proj:  24%|██▍       | 8928/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.22.mlp.experts.3.down_proj:  24%|██▍       | 8929/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.4.gate_proj:  24%|██▍       | 8930/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.4.up_proj:  24%|██▍       | 8931/36566 [00:08<00:24, 1151.38it/s]  
packing model.layers.22.mlp.experts.4.down_proj:  24%|██▍       | 8932/36566 [00:08<00:24, 1151.38it/s]
packing model.layers.22.mlp.experts.5.gate_proj:  24%|██▍       | 8933/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.5.up_proj:  24%|██▍       | 8934/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.5.down_proj:  24%|██▍       | 8935/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.6.gate_proj:  24%|██▍       | 8936/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.6.up_proj:  24%|██▍       | 8937/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.6.down_proj:  24%|██▍       | 8938/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.7.gate_proj:  24%|██▍       | 8939/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.7.up_proj:  24%|██▍       | 8940/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.7.down_proj:  24%|██▍       | 8941/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.8.gate_proj:  24%|██▍       | 8942/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.8.up_proj:  24%|██▍       | 8943/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.8.down_proj:  24%|██▍       | 8944/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.9.gate_proj:  24%|██▍       | 8945/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.9.up_proj:  24%|██▍       | 8946/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.9.down_proj:  24%|██▍       | 8947/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.10.gate_proj:  24%|██▍       | 8948/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.10.up_proj:  24%|██▍       | 8949/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.10.down_proj:  24%|██▍       | 8950/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.11.gate_proj:  24%|██▍       | 8951/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.11.up_proj:  24%|██▍       | 8952/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.11.down_proj:  24%|██▍       | 8953/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.12.gate_proj:  24%|██▍       | 8954/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.12.up_proj:  24%|██▍       | 8955/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.12.down_proj:  24%|██▍       | 8956/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.13.gate_proj:  24%|██▍       | 8957/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.13.up_proj:  24%|██▍       | 8958/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.13.down_proj:  25%|██▍       | 8959/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.14.gate_proj:  25%|██▍       | 8960/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.14.up_proj:  25%|██▍       | 8961/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.14.down_proj:  25%|██▍       | 8962/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.15.gate_proj:  25%|██▍       | 8963/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.15.up_proj:  25%|██▍       | 8964/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.15.down_proj:  25%|██▍       | 8965/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.16.gate_proj:  25%|██▍       | 8966/36566 [00:08<00:23, 1151.38it/s]
packing model.layers.22.mlp.experts.16.up_proj:  25%|██▍       | 8967/36566 [00:08<00:23, 1151.38it/s]  
packing model.layers.22.mlp.experts.16.up_proj:  25%|██▍       | 8968/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.16.down_proj:  25%|██▍       | 8968/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.17.gate_proj:  25%|██▍       | 8969/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.17.up_proj:  25%|██▍       | 8970/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.17.down_proj:  25%|██▍       | 8971/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.18.gate_proj:  25%|██▍       | 8972/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.18.up_proj:  25%|██▍       | 8973/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.18.down_proj:  25%|██▍       | 8974/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.19.gate_proj:  25%|██▍       | 8975/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.19.up_proj:  25%|██▍       | 8976/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.19.down_proj:  25%|██▍       | 8977/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.20.gate_proj:  25%|██▍       | 8978/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.20.up_proj:  25%|██▍       | 8979/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.20.down_proj:  25%|██▍       | 8980/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.21.gate_proj:  25%|██▍       | 8981/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.21.up_proj:  25%|██▍       | 8982/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.21.down_proj:  25%|██▍       | 8983/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.22.gate_proj:  25%|██▍       | 8984/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.22.up_proj:  25%|██▍       | 8985/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.22.down_proj:  25%|██▍       | 8986/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.23.gate_proj:  25%|██▍       | 8987/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.23.up_proj:  25%|██▍       | 8988/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.23.down_proj:  25%|██▍       | 8989/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.24.gate_proj:  25%|██▍       | 8990/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.24.up_proj:  25%|██▍       | 8991/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.24.down_proj:  25%|██▍       | 8992/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.25.gate_proj:  25%|██▍       | 8993/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.25.up_proj:  25%|██▍       | 8994/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.25.down_proj:  25%|██▍       | 8995/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.26.gate_proj:  25%|██▍       | 8996/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.26.up_proj:  25%|██▍       | 8997/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.26.down_proj:  25%|██▍       | 8998/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.27.gate_proj:  25%|██▍       | 8999/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.27.up_proj:  25%|██▍       | 9000/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.27.down_proj:  25%|██▍       | 9001/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.28.gate_proj:  25%|██▍       | 9002/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.28.up_proj:  25%|██▍       | 9003/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.28.down_proj:  25%|██▍       | 9004/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.29.gate_proj:  25%|██▍       | 9005/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.29.up_proj:  25%|██▍       | 9006/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.29.down_proj:  25%|██▍       | 9007/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.30.gate_proj:  25%|██▍       | 9008/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.30.up_proj:  25%|██▍       | 9009/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.30.down_proj:  25%|██▍       | 9010/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.31.gate_proj:  25%|██▍       | 9011/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.31.up_proj:  25%|██▍       | 9012/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.31.down_proj:  25%|██▍       | 9013/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.32.gate_proj:  25%|██▍       | 9014/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.32.up_proj:  25%|██▍       | 9015/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.32.down_proj:  25%|██▍       | 9016/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.33.gate_proj:  25%|██▍       | 9017/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.33.up_proj:  25%|██▍       | 9018/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.33.down_proj:  25%|██▍       | 9019/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.34.gate_proj:  25%|██▍       | 9020/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.34.up_proj:  25%|██▍       | 9021/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.34.down_proj:  25%|██▍       | 9022/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.35.gate_proj:  25%|██▍       | 9023/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.35.up_proj:  25%|██▍       | 9024/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.35.down_proj:  25%|██▍       | 9025/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.36.gate_proj:  25%|██▍       | 9026/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.36.up_proj:  25%|██▍       | 9027/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.36.down_proj:  25%|██▍       | 9028/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.37.gate_proj:  25%|██▍       | 9029/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.37.up_proj:  25%|██▍       | 9030/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.37.down_proj:  25%|██▍       | 9031/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.38.gate_proj:  25%|██▍       | 9032/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.38.up_proj:  25%|██▍       | 9033/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.38.down_proj:  25%|██▍       | 9034/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.39.gate_proj:  25%|██▍       | 9035/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.39.up_proj:  25%|██▍       | 9036/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.39.down_proj:  25%|██▍       | 9037/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.40.gate_proj:  25%|██▍       | 9038/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.40.up_proj:  25%|██▍       | 9039/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.40.down_proj:  25%|██▍       | 9040/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.41.gate_proj:  25%|██▍       | 9041/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.41.up_proj:  25%|██▍       | 9042/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.41.down_proj:  25%|██▍       | 9043/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.42.gate_proj:  25%|██▍       | 9044/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.42.up_proj:  25%|██▍       | 9045/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.42.down_proj:  25%|██▍       | 9046/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.43.gate_proj:  25%|██▍       | 9047/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.43.up_proj:  25%|██▍       | 9048/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.43.down_proj:  25%|██▍       | 9049/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.44.gate_proj:  25%|██▍       | 9050/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.44.up_proj:  25%|██▍       | 9051/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.44.down_proj:  25%|██▍       | 9052/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.45.gate_proj:  25%|██▍       | 9053/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.45.up_proj:  25%|██▍       | 9054/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.45.down_proj:  25%|██▍       | 9055/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.46.gate_proj:  25%|██▍       | 9056/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.46.up_proj:  25%|██▍       | 9057/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.46.down_proj:  25%|██▍       | 9058/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.47.gate_proj:  25%|██▍       | 9059/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.47.up_proj:  25%|██▍       | 9060/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.47.down_proj:  25%|██▍       | 9061/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.48.gate_proj:  25%|██▍       | 9062/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.48.up_proj:  25%|██▍       | 9063/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.48.down_proj:  25%|██▍       | 9064/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.49.gate_proj:  25%|██▍       | 9065/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.49.up_proj:  25%|██▍       | 9066/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.49.down_proj:  25%|██▍       | 9067/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.50.gate_proj:  25%|██▍       | 9068/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.50.up_proj:  25%|██▍       | 9069/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.50.down_proj:  25%|██▍       | 9070/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.51.gate_proj:  25%|██▍       | 9071/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.51.up_proj:  25%|██▍       | 9072/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.51.down_proj:  25%|██▍       | 9073/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.52.gate_proj:  25%|██▍       | 9074/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.52.up_proj:  25%|██▍       | 9075/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.52.down_proj:  25%|██▍       | 9076/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.53.gate_proj:  25%|██▍       | 9077/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.53.up_proj:  25%|██▍       | 9078/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.53.down_proj:  25%|██▍       | 9079/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.54.gate_proj:  25%|██▍       | 9080/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.54.up_proj:  25%|██▍       | 9081/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.54.down_proj:  25%|██▍       | 9082/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.55.gate_proj:  25%|██▍       | 9083/36566 [00:08<00:23, 1154.10it/s]
packing model.layers.22.mlp.experts.55.up_proj:  25%|██▍       | 9084/36566 [00:08<00:23, 1154.10it/s]  
packing model.layers.22.mlp.experts.55.up_proj:  25%|██▍       | 9085/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.55.down_proj:  25%|██▍       | 9085/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.56.gate_proj:  25%|██▍       | 9086/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.56.up_proj:  25%|██▍       | 9087/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.56.down_proj:  25%|██▍       | 9088/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.57.gate_proj:  25%|██▍       | 9089/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.57.up_proj:  25%|██▍       | 9090/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.57.down_proj:  25%|██▍       | 9091/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.58.gate_proj:  25%|██▍       | 9092/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.58.up_proj:  25%|██▍       | 9093/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.58.down_proj:  25%|██▍       | 9094/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.59.gate_proj:  25%|██▍       | 9095/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.59.up_proj:  25%|██▍       | 9096/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.59.down_proj:  25%|██▍       | 9097/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.60.gate_proj:  25%|██▍       | 9098/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.60.up_proj:  25%|██▍       | 9099/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.60.down_proj:  25%|██▍       | 9100/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.61.gate_proj:  25%|██▍       | 9101/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.61.up_proj:  25%|██▍       | 9102/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.61.down_proj:  25%|██▍       | 9103/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.62.gate_proj:  25%|██▍       | 9104/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.62.up_proj:  25%|██▍       | 9105/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.62.down_proj:  25%|██▍       | 9106/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.63.gate_proj:  25%|██▍       | 9107/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.63.up_proj:  25%|██▍       | 9108/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.63.down_proj:  25%|██▍       | 9109/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.64.gate_proj:  25%|██▍       | 9110/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.64.up_proj:  25%|██▍       | 9111/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.64.down_proj:  25%|██▍       | 9112/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.65.gate_proj:  25%|██▍       | 9113/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.65.up_proj:  25%|██▍       | 9114/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.65.down_proj:  25%|██▍       | 9115/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.66.gate_proj:  25%|██▍       | 9116/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.66.up_proj:  25%|██▍       | 9117/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.66.down_proj:  25%|██▍       | 9118/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.67.gate_proj:  25%|██▍       | 9119/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.67.up_proj:  25%|██▍       | 9120/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.67.down_proj:  25%|██▍       | 9121/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.68.gate_proj:  25%|██▍       | 9122/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.68.up_proj:  25%|██▍       | 9123/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.68.down_proj:  25%|██▍       | 9124/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.69.gate_proj:  25%|██▍       | 9125/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.69.up_proj:  25%|██▍       | 9126/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.69.down_proj:  25%|██▍       | 9127/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.70.gate_proj:  25%|██▍       | 9128/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.70.up_proj:  25%|██▍       | 9129/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.70.down_proj:  25%|██▍       | 9130/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.71.gate_proj:  25%|██▍       | 9131/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.71.up_proj:  25%|██▍       | 9132/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.71.down_proj:  25%|██▍       | 9133/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.72.gate_proj:  25%|██▍       | 9134/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.72.up_proj:  25%|██▍       | 9135/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.72.down_proj:  25%|██▍       | 9136/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.73.gate_proj:  25%|██▍       | 9137/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.73.up_proj:  25%|██▍       | 9138/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.73.down_proj:  25%|██▍       | 9139/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.74.gate_proj:  25%|██▍       | 9140/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.74.up_proj:  25%|██▍       | 9141/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.74.down_proj:  25%|██▌       | 9142/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.75.gate_proj:  25%|██▌       | 9143/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.75.up_proj:  25%|██▌       | 9144/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.75.down_proj:  25%|██▌       | 9145/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.76.gate_proj:  25%|██▌       | 9146/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.76.up_proj:  25%|██▌       | 9147/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.76.down_proj:  25%|██▌       | 9148/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.77.gate_proj:  25%|██▌       | 9149/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.77.up_proj:  25%|██▌       | 9150/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.77.down_proj:  25%|██▌       | 9151/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.78.gate_proj:  25%|██▌       | 9152/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.78.up_proj:  25%|██▌       | 9153/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.78.down_proj:  25%|██▌       | 9154/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.79.gate_proj:  25%|██▌       | 9155/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.79.up_proj:  25%|██▌       | 9156/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.79.down_proj:  25%|██▌       | 9157/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.80.gate_proj:  25%|██▌       | 9158/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.80.up_proj:  25%|██▌       | 9159/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.80.down_proj:  25%|██▌       | 9160/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.81.gate_proj:  25%|██▌       | 9161/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.81.up_proj:  25%|██▌       | 9162/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.81.down_proj:  25%|██▌       | 9163/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.82.gate_proj:  25%|██▌       | 9164/36566 [00:08<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.82.up_proj:  25%|██▌       | 9165/36566 [00:08<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.82.down_proj:  25%|██▌       | 9166/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.83.gate_proj:  25%|██▌       | 9167/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.83.up_proj:  25%|██▌       | 9168/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.83.down_proj:  25%|██▌       | 9169/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.84.gate_proj:  25%|██▌       | 9170/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.84.up_proj:  25%|██▌       | 9171/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.84.down_proj:  25%|██▌       | 9172/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.85.gate_proj:  25%|██▌       | 9173/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.85.up_proj:  25%|██▌       | 9174/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.85.down_proj:  25%|██▌       | 9175/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.86.gate_proj:  25%|██▌       | 9176/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.86.up_proj:  25%|██▌       | 9177/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.86.down_proj:  25%|██▌       | 9178/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.87.gate_proj:  25%|██▌       | 9179/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.87.up_proj:  25%|██▌       | 9180/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.87.down_proj:  25%|██▌       | 9181/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.88.gate_proj:  25%|██▌       | 9182/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.88.up_proj:  25%|██▌       | 9183/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.88.down_proj:  25%|██▌       | 9184/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.89.gate_proj:  25%|██▌       | 9185/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.89.up_proj:  25%|██▌       | 9186/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.89.down_proj:  25%|██▌       | 9187/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.90.gate_proj:  25%|██▌       | 9188/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.90.up_proj:  25%|██▌       | 9189/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.90.down_proj:  25%|██▌       | 9190/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.91.gate_proj:  25%|██▌       | 9191/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.91.up_proj:  25%|██▌       | 9192/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.91.down_proj:  25%|██▌       | 9193/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.92.gate_proj:  25%|██▌       | 9194/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.92.up_proj:  25%|██▌       | 9195/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.92.down_proj:  25%|██▌       | 9196/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.93.gate_proj:  25%|██▌       | 9197/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.93.up_proj:  25%|██▌       | 9198/36566 [00:09<00:23, 1156.06it/s]  
packing model.layers.22.mlp.experts.93.down_proj:  25%|██▌       | 9199/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.94.gate_proj:  25%|██▌       | 9200/36566 [00:09<00:23, 1156.06it/s]
packing model.layers.22.mlp.experts.94.gate_proj:  25%|██▌       | 9201/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.94.up_proj:  25%|██▌       | 9201/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.94.down_proj:  25%|██▌       | 9202/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.95.gate_proj:  25%|██▌       | 9203/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.95.up_proj:  25%|██▌       | 9204/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.95.down_proj:  25%|██▌       | 9205/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.96.gate_proj:  25%|██▌       | 9206/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.96.up_proj:  25%|██▌       | 9207/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.96.down_proj:  25%|██▌       | 9208/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.97.gate_proj:  25%|██▌       | 9209/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.97.up_proj:  25%|██▌       | 9210/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.97.down_proj:  25%|██▌       | 9211/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.98.gate_proj:  25%|██▌       | 9212/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.98.up_proj:  25%|██▌       | 9213/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.98.down_proj:  25%|██▌       | 9214/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.99.gate_proj:  25%|██▌       | 9215/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.99.up_proj:  25%|██▌       | 9216/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.99.down_proj:  25%|██▌       | 9217/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.100.gate_proj:  25%|██▌       | 9218/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.100.up_proj:  25%|██▌       | 9219/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.100.down_proj:  25%|██▌       | 9220/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.101.gate_proj:  25%|██▌       | 9221/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.101.up_proj:  25%|██▌       | 9222/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.101.down_proj:  25%|██▌       | 9223/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.102.gate_proj:  25%|██▌       | 9224/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.102.up_proj:  25%|██▌       | 9225/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.102.down_proj:  25%|██▌       | 9226/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.103.gate_proj:  25%|██▌       | 9227/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.103.up_proj:  25%|██▌       | 9228/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.103.down_proj:  25%|██▌       | 9229/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.104.gate_proj:  25%|██▌       | 9230/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.104.up_proj:  25%|██▌       | 9231/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.104.down_proj:  25%|██▌       | 9232/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.105.gate_proj:  25%|██▌       | 9233/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.105.up_proj:  25%|██▌       | 9234/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.105.down_proj:  25%|██▌       | 9235/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.106.gate_proj:  25%|██▌       | 9236/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.106.up_proj:  25%|██▌       | 9237/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.106.down_proj:  25%|██▌       | 9238/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.107.gate_proj:  25%|██▌       | 9239/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.107.up_proj:  25%|██▌       | 9240/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.107.down_proj:  25%|██▌       | 9241/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.108.gate_proj:  25%|██▌       | 9242/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.108.up_proj:  25%|██▌       | 9243/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.108.down_proj:  25%|██▌       | 9244/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.109.gate_proj:  25%|██▌       | 9245/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.109.up_proj:  25%|██▌       | 9246/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.109.down_proj:  25%|██▌       | 9247/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.110.gate_proj:  25%|██▌       | 9248/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.110.up_proj:  25%|██▌       | 9249/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.110.down_proj:  25%|██▌       | 9250/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.111.gate_proj:  25%|██▌       | 9251/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.111.up_proj:  25%|██▌       | 9252/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.111.down_proj:  25%|██▌       | 9253/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.112.gate_proj:  25%|██▌       | 9254/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.112.up_proj:  25%|██▌       | 9255/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.112.down_proj:  25%|██▌       | 9256/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.113.gate_proj:  25%|██▌       | 9257/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.113.up_proj:  25%|██▌       | 9258/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.113.down_proj:  25%|██▌       | 9259/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.114.gate_proj:  25%|██▌       | 9260/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.114.up_proj:  25%|██▌       | 9261/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.114.down_proj:  25%|██▌       | 9262/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.115.gate_proj:  25%|██▌       | 9263/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.115.up_proj:  25%|██▌       | 9264/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.115.down_proj:  25%|██▌       | 9265/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.116.gate_proj:  25%|██▌       | 9266/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.116.up_proj:  25%|██▌       | 9267/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.116.down_proj:  25%|██▌       | 9268/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.117.gate_proj:  25%|██▌       | 9269/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.117.up_proj:  25%|██▌       | 9270/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.117.down_proj:  25%|██▌       | 9271/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.118.gate_proj:  25%|██▌       | 9272/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.118.up_proj:  25%|██▌       | 9273/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.118.down_proj:  25%|██▌       | 9274/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.119.gate_proj:  25%|██▌       | 9275/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.119.up_proj:  25%|██▌       | 9276/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.119.down_proj:  25%|██▌       | 9277/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.120.gate_proj:  25%|██▌       | 9278/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.120.up_proj:  25%|██▌       | 9279/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.120.down_proj:  25%|██▌       | 9280/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.121.gate_proj:  25%|██▌       | 9281/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.121.up_proj:  25%|██▌       | 9282/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.121.down_proj:  25%|██▌       | 9283/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.122.gate_proj:  25%|██▌       | 9284/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.122.up_proj:  25%|██▌       | 9285/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.122.down_proj:  25%|██▌       | 9286/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.123.gate_proj:  25%|██▌       | 9287/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.123.up_proj:  25%|██▌       | 9288/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.123.down_proj:  25%|██▌       | 9289/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.124.gate_proj:  25%|██▌       | 9290/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.124.up_proj:  25%|██▌       | 9291/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.124.down_proj:  25%|██▌       | 9292/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.125.gate_proj:  25%|██▌       | 9293/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.125.up_proj:  25%|██▌       | 9294/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.125.down_proj:  25%|██▌       | 9295/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.126.gate_proj:  25%|██▌       | 9296/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.126.up_proj:  25%|██▌       | 9297/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.126.down_proj:  25%|██▌       | 9298/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.127.gate_proj:  25%|██▌       | 9299/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.22.mlp.experts.127.up_proj:  25%|██▌       | 9300/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.22.mlp.experts.127.down_proj:  25%|██▌       | 9301/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.0.gate_proj:  25%|██▌       | 9302/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.23.mlp.experts.0.up_proj:  25%|██▌       | 9303/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.23.mlp.experts.0.down_proj:  25%|██▌       | 9304/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.1.gate_proj:  25%|██▌       | 9305/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.1.up_proj:  25%|██▌       | 9306/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.23.mlp.experts.1.down_proj:  25%|██▌       | 9307/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.2.gate_proj:  25%|██▌       | 9308/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.2.up_proj:  25%|██▌       | 9309/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.23.mlp.experts.2.down_proj:  25%|██▌       | 9310/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.3.gate_proj:  25%|██▌       | 9311/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.3.up_proj:  25%|██▌       | 9312/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.23.mlp.experts.3.down_proj:  25%|██▌       | 9313/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.4.gate_proj:  25%|██▌       | 9314/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.4.up_proj:  25%|██▌       | 9315/36566 [00:09<00:23, 1156.92it/s]  
packing model.layers.23.mlp.experts.4.down_proj:  25%|██▌       | 9316/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.5.gate_proj:  25%|██▌       | 9317/36566 [00:09<00:23, 1156.92it/s]
packing model.layers.23.mlp.experts.5.gate_proj:  25%|██▌       | 9318/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.5.up_proj:  25%|██▌       | 9318/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.5.down_proj:  25%|██▌       | 9319/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.6.gate_proj:  25%|██▌       | 9320/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.6.up_proj:  25%|██▌       | 9321/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.6.down_proj:  25%|██▌       | 9322/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.7.gate_proj:  25%|██▌       | 9323/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.7.up_proj:  25%|██▌       | 9324/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.7.down_proj:  26%|██▌       | 9325/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.8.gate_proj:  26%|██▌       | 9326/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.8.up_proj:  26%|██▌       | 9327/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.8.down_proj:  26%|██▌       | 9328/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.9.gate_proj:  26%|██▌       | 9329/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.9.up_proj:  26%|██▌       | 9330/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.9.down_proj:  26%|██▌       | 9331/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.10.gate_proj:  26%|██▌       | 9332/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.10.up_proj:  26%|██▌       | 9333/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.10.down_proj:  26%|██▌       | 9334/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.11.gate_proj:  26%|██▌       | 9335/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.11.up_proj:  26%|██▌       | 9336/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.11.down_proj:  26%|██▌       | 9337/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.12.gate_proj:  26%|██▌       | 9338/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.12.up_proj:  26%|██▌       | 9339/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.12.down_proj:  26%|██▌       | 9340/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.13.gate_proj:  26%|██▌       | 9341/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.13.up_proj:  26%|██▌       | 9342/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.13.down_proj:  26%|██▌       | 9343/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.14.gate_proj:  26%|██▌       | 9344/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.14.up_proj:  26%|██▌       | 9345/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.14.down_proj:  26%|██▌       | 9346/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.15.gate_proj:  26%|██▌       | 9347/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.15.up_proj:  26%|██▌       | 9348/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.15.down_proj:  26%|██▌       | 9349/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.16.gate_proj:  26%|██▌       | 9350/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.16.up_proj:  26%|██▌       | 9351/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.16.down_proj:  26%|██▌       | 9352/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.17.gate_proj:  26%|██▌       | 9353/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.17.up_proj:  26%|██▌       | 9354/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.17.down_proj:  26%|██▌       | 9355/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.18.gate_proj:  26%|██▌       | 9356/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.18.up_proj:  26%|██▌       | 9357/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.18.down_proj:  26%|██▌       | 9358/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.19.gate_proj:  26%|██▌       | 9359/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.19.up_proj:  26%|██▌       | 9360/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.19.down_proj:  26%|██▌       | 9361/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.20.gate_proj:  26%|██▌       | 9362/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.20.up_proj:  26%|██▌       | 9363/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.20.down_proj:  26%|██▌       | 9364/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.21.gate_proj:  26%|██▌       | 9365/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.21.up_proj:  26%|██▌       | 9366/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.21.down_proj:  26%|██▌       | 9367/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.22.gate_proj:  26%|██▌       | 9368/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.22.up_proj:  26%|██▌       | 9369/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.22.down_proj:  26%|██▌       | 9370/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.23.gate_proj:  26%|██▌       | 9371/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.23.up_proj:  26%|██▌       | 9372/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.23.down_proj:  26%|██▌       | 9373/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.24.gate_proj:  26%|██▌       | 9374/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.24.up_proj:  26%|██▌       | 9375/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.24.down_proj:  26%|██▌       | 9376/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.25.gate_proj:  26%|██▌       | 9377/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.25.up_proj:  26%|██▌       | 9378/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.25.down_proj:  26%|██▌       | 9379/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.26.gate_proj:  26%|██▌       | 9380/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.26.up_proj:  26%|██▌       | 9381/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.26.down_proj:  26%|██▌       | 9382/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.27.gate_proj:  26%|██▌       | 9383/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.27.up_proj:  26%|██▌       | 9384/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.27.down_proj:  26%|██▌       | 9385/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.28.gate_proj:  26%|██▌       | 9386/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.28.up_proj:  26%|██▌       | 9387/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.28.down_proj:  26%|██▌       | 9388/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.29.gate_proj:  26%|██▌       | 9389/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.29.up_proj:  26%|██▌       | 9390/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.29.down_proj:  26%|██▌       | 9391/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.30.gate_proj:  26%|██▌       | 9392/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.30.up_proj:  26%|██▌       | 9393/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.30.down_proj:  26%|██▌       | 9394/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.31.gate_proj:  26%|██▌       | 9395/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.31.up_proj:  26%|██▌       | 9396/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.31.down_proj:  26%|██▌       | 9397/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.32.gate_proj:  26%|██▌       | 9398/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.32.up_proj:  26%|██▌       | 9399/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.32.down_proj:  26%|██▌       | 9400/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.33.gate_proj:  26%|██▌       | 9401/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.33.up_proj:  26%|██▌       | 9402/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.33.down_proj:  26%|██▌       | 9403/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.34.gate_proj:  26%|██▌       | 9404/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.34.up_proj:  26%|██▌       | 9405/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.34.down_proj:  26%|██▌       | 9406/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.35.gate_proj:  26%|██▌       | 9407/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.35.up_proj:  26%|██▌       | 9408/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.35.down_proj:  26%|██▌       | 9409/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.36.gate_proj:  26%|██▌       | 9410/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.36.up_proj:  26%|██▌       | 9411/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.36.down_proj:  26%|██▌       | 9412/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.37.gate_proj:  26%|██▌       | 9413/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.37.up_proj:  26%|██▌       | 9414/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.37.down_proj:  26%|██▌       | 9415/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.38.gate_proj:  26%|██▌       | 9416/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.38.up_proj:  26%|██▌       | 9417/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.38.down_proj:  26%|██▌       | 9418/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.39.gate_proj:  26%|██▌       | 9419/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.39.up_proj:  26%|██▌       | 9420/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.39.down_proj:  26%|██▌       | 9421/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.40.gate_proj:  26%|██▌       | 9422/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.40.up_proj:  26%|██▌       | 9423/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.40.down_proj:  26%|██▌       | 9424/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.41.gate_proj:  26%|██▌       | 9425/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.41.up_proj:  26%|██▌       | 9426/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.41.down_proj:  26%|██▌       | 9427/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.42.gate_proj:  26%|██▌       | 9428/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.42.up_proj:  26%|██▌       | 9429/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.42.down_proj:  26%|██▌       | 9430/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.43.gate_proj:  26%|██▌       | 9431/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.43.up_proj:  26%|██▌       | 9432/36566 [00:09<00:23, 1158.55it/s]  
packing model.layers.23.mlp.experts.43.down_proj:  26%|██▌       | 9433/36566 [00:09<00:23, 1158.55it/s]
packing model.layers.23.mlp.experts.43.down_proj:  26%|██▌       | 9434/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.44.gate_proj:  26%|██▌       | 9434/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.44.up_proj:  26%|██▌       | 9435/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.44.down_proj:  26%|██▌       | 9436/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.45.gate_proj:  26%|██▌       | 9437/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.45.up_proj:  26%|██▌       | 9438/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.45.down_proj:  26%|██▌       | 9439/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.46.gate_proj:  26%|██▌       | 9440/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.46.up_proj:  26%|██▌       | 9441/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.46.down_proj:  26%|██▌       | 9442/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.47.gate_proj:  26%|██▌       | 9443/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.47.up_proj:  26%|██▌       | 9444/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.47.down_proj:  26%|██▌       | 9445/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.48.gate_proj:  26%|██▌       | 9446/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.48.up_proj:  26%|██▌       | 9447/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.48.down_proj:  26%|██▌       | 9448/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.49.gate_proj:  26%|██▌       | 9449/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.49.up_proj:  26%|██▌       | 9450/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.49.down_proj:  26%|██▌       | 9451/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.50.gate_proj:  26%|██▌       | 9452/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.50.up_proj:  26%|██▌       | 9453/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.50.down_proj:  26%|██▌       | 9454/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.51.gate_proj:  26%|██▌       | 9455/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.51.up_proj:  26%|██▌       | 9456/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.51.down_proj:  26%|██▌       | 9457/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.52.gate_proj:  26%|██▌       | 9458/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.52.up_proj:  26%|██▌       | 9459/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.52.down_proj:  26%|██▌       | 9460/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.53.gate_proj:  26%|██▌       | 9461/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.53.up_proj:  26%|██▌       | 9462/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.53.down_proj:  26%|██▌       | 9463/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.54.gate_proj:  26%|██▌       | 9464/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.54.up_proj:  26%|██▌       | 9465/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.54.down_proj:  26%|██▌       | 9466/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.55.gate_proj:  26%|██▌       | 9467/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.55.up_proj:  26%|██▌       | 9468/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.55.down_proj:  26%|██▌       | 9469/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.56.gate_proj:  26%|██▌       | 9470/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.56.up_proj:  26%|██▌       | 9471/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.56.down_proj:  26%|██▌       | 9472/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.57.gate_proj:  26%|██▌       | 9473/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.57.up_proj:  26%|██▌       | 9474/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.57.down_proj:  26%|██▌       | 9475/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.58.gate_proj:  26%|██▌       | 9476/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.58.up_proj:  26%|██▌       | 9477/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.58.down_proj:  26%|██▌       | 9478/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.59.gate_proj:  26%|██▌       | 9479/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.59.up_proj:  26%|██▌       | 9480/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.59.down_proj:  26%|██▌       | 9481/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.60.gate_proj:  26%|██▌       | 9482/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.60.up_proj:  26%|██▌       | 9483/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.60.down_proj:  26%|██▌       | 9484/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.61.gate_proj:  26%|██▌       | 9485/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.61.up_proj:  26%|██▌       | 9486/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.61.down_proj:  26%|██▌       | 9487/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.62.gate_proj:  26%|██▌       | 9488/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.62.up_proj:  26%|██▌       | 9489/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.62.down_proj:  26%|██▌       | 9490/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.63.gate_proj:  26%|██▌       | 9491/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.63.up_proj:  26%|██▌       | 9492/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.63.down_proj:  26%|██▌       | 9493/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.64.gate_proj:  26%|██▌       | 9494/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.64.up_proj:  26%|██▌       | 9495/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.64.down_proj:  26%|██▌       | 9496/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.65.gate_proj:  26%|██▌       | 9497/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.65.up_proj:  26%|██▌       | 9498/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.65.down_proj:  26%|██▌       | 9499/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.66.gate_proj:  26%|██▌       | 9500/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.66.up_proj:  26%|██▌       | 9501/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.66.down_proj:  26%|██▌       | 9502/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.67.gate_proj:  26%|██▌       | 9503/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.67.up_proj:  26%|██▌       | 9504/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.67.down_proj:  26%|██▌       | 9505/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.68.gate_proj:  26%|██▌       | 9506/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.68.up_proj:  26%|██▌       | 9507/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.68.down_proj:  26%|██▌       | 9508/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.69.gate_proj:  26%|██▌       | 9509/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.69.up_proj:  26%|██▌       | 9510/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.69.down_proj:  26%|██▌       | 9511/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.70.gate_proj:  26%|██▌       | 9512/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.70.up_proj:  26%|██▌       | 9513/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.70.down_proj:  26%|██▌       | 9514/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.71.gate_proj:  26%|██▌       | 9515/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.71.up_proj:  26%|██▌       | 9516/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.71.down_proj:  26%|██▌       | 9517/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.72.gate_proj:  26%|██▌       | 9518/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.72.up_proj:  26%|██▌       | 9519/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.72.down_proj:  26%|██▌       | 9520/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.73.gate_proj:  26%|██▌       | 9521/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.73.up_proj:  26%|██▌       | 9522/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.73.down_proj:  26%|██▌       | 9523/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.74.gate_proj:  26%|██▌       | 9524/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.74.up_proj:  26%|██▌       | 9525/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.74.down_proj:  26%|██▌       | 9526/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.75.gate_proj:  26%|██▌       | 9527/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.75.up_proj:  26%|██▌       | 9528/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.75.down_proj:  26%|██▌       | 9529/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.76.gate_proj:  26%|██▌       | 9530/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.76.up_proj:  26%|██▌       | 9531/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.76.down_proj:  26%|██▌       | 9532/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.77.gate_proj:  26%|██▌       | 9533/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.77.up_proj:  26%|██▌       | 9534/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.77.down_proj:  26%|██▌       | 9535/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.78.gate_proj:  26%|██▌       | 9536/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.78.up_proj:  26%|██▌       | 9537/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.78.down_proj:  26%|██▌       | 9538/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.79.gate_proj:  26%|██▌       | 9539/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.79.up_proj:  26%|██▌       | 9540/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.79.down_proj:  26%|██▌       | 9541/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.80.gate_proj:  26%|██▌       | 9542/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.80.up_proj:  26%|██▌       | 9543/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.80.down_proj:  26%|██▌       | 9544/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.81.gate_proj:  26%|██▌       | 9545/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.81.up_proj:  26%|██▌       | 9546/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.81.down_proj:  26%|██▌       | 9547/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.82.gate_proj:  26%|██▌       | 9548/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.82.up_proj:  26%|██▌       | 9549/36566 [00:09<00:23, 1150.09it/s]  
packing model.layers.23.mlp.experts.82.down_proj:  26%|██▌       | 9550/36566 [00:09<00:23, 1150.09it/s]
packing model.layers.23.mlp.experts.82.down_proj:  26%|██▌       | 9551/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.83.gate_proj:  26%|██▌       | 9551/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.83.up_proj:  26%|██▌       | 9552/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.83.down_proj:  26%|██▌       | 9553/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.84.gate_proj:  26%|██▌       | 9554/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.84.up_proj:  26%|██▌       | 9555/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.84.down_proj:  26%|██▌       | 9556/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.85.gate_proj:  26%|██▌       | 9557/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.85.up_proj:  26%|██▌       | 9558/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.85.down_proj:  26%|██▌       | 9559/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.86.gate_proj:  26%|██▌       | 9560/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.86.up_proj:  26%|██▌       | 9561/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.86.down_proj:  26%|██▌       | 9562/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.87.gate_proj:  26%|██▌       | 9563/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.87.up_proj:  26%|██▌       | 9564/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.87.down_proj:  26%|██▌       | 9565/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.88.gate_proj:  26%|██▌       | 9566/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.88.up_proj:  26%|██▌       | 9567/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.88.down_proj:  26%|██▌       | 9568/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.89.gate_proj:  26%|██▌       | 9569/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.89.up_proj:  26%|██▌       | 9570/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.89.down_proj:  26%|██▌       | 9571/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.90.gate_proj:  26%|██▌       | 9572/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.90.up_proj:  26%|██▌       | 9573/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.90.down_proj:  26%|██▌       | 9574/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.91.gate_proj:  26%|██▌       | 9575/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.91.up_proj:  26%|██▌       | 9576/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.91.down_proj:  26%|██▌       | 9577/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.92.gate_proj:  26%|██▌       | 9578/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.92.up_proj:  26%|██▌       | 9579/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.92.down_proj:  26%|██▌       | 9580/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.93.gate_proj:  26%|██▌       | 9581/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.93.up_proj:  26%|██▌       | 9582/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.93.down_proj:  26%|██▌       | 9583/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.94.gate_proj:  26%|██▌       | 9584/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.94.up_proj:  26%|██▌       | 9585/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.94.down_proj:  26%|██▌       | 9586/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.95.gate_proj:  26%|██▌       | 9587/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.95.up_proj:  26%|██▌       | 9588/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.95.down_proj:  26%|██▌       | 9589/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.96.gate_proj:  26%|██▌       | 9590/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.96.up_proj:  26%|██▌       | 9591/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.96.down_proj:  26%|██▌       | 9592/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.97.gate_proj:  26%|██▌       | 9593/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.97.up_proj:  26%|██▌       | 9594/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.97.down_proj:  26%|██▌       | 9595/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.98.gate_proj:  26%|██▌       | 9596/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.98.up_proj:  26%|██▌       | 9597/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.98.down_proj:  26%|██▌       | 9598/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.99.gate_proj:  26%|██▋       | 9599/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.99.up_proj:  26%|██▋       | 9600/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.99.down_proj:  26%|██▋       | 9601/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.100.gate_proj:  26%|██▋       | 9602/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.100.up_proj:  26%|██▋       | 9603/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.100.down_proj:  26%|██▋       | 9604/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.101.gate_proj:  26%|██▋       | 9605/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.101.up_proj:  26%|██▋       | 9606/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.101.down_proj:  26%|██▋       | 9607/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.102.gate_proj:  26%|██▋       | 9608/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.102.up_proj:  26%|██▋       | 9609/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.102.down_proj:  26%|██▋       | 9610/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.103.gate_proj:  26%|██▋       | 9611/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.103.up_proj:  26%|██▋       | 9612/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.103.down_proj:  26%|██▋       | 9613/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.104.gate_proj:  26%|██▋       | 9614/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.104.up_proj:  26%|██▋       | 9615/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.104.down_proj:  26%|██▋       | 9616/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.105.gate_proj:  26%|██▋       | 9617/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.105.up_proj:  26%|██▋       | 9618/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.105.down_proj:  26%|██▋       | 9619/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.106.gate_proj:  26%|██▋       | 9620/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.106.up_proj:  26%|██▋       | 9621/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.106.down_proj:  26%|██▋       | 9622/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.107.gate_proj:  26%|██▋       | 9623/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.107.up_proj:  26%|██▋       | 9624/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.107.down_proj:  26%|██▋       | 9625/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.108.gate_proj:  26%|██▋       | 9626/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.108.up_proj:  26%|██▋       | 9627/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.108.down_proj:  26%|██▋       | 9628/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.109.gate_proj:  26%|██▋       | 9629/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.109.up_proj:  26%|██▋       | 9630/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.109.down_proj:  26%|██▋       | 9631/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.110.gate_proj:  26%|██▋       | 9632/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.110.up_proj:  26%|██▋       | 9633/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.110.down_proj:  26%|██▋       | 9634/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.111.gate_proj:  26%|██▋       | 9635/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.111.up_proj:  26%|██▋       | 9636/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.111.down_proj:  26%|██▋       | 9637/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.112.gate_proj:  26%|██▋       | 9638/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.112.up_proj:  26%|██▋       | 9639/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.112.down_proj:  26%|██▋       | 9640/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.113.gate_proj:  26%|██▋       | 9641/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.113.up_proj:  26%|██▋       | 9642/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.113.down_proj:  26%|██▋       | 9643/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.114.gate_proj:  26%|██▋       | 9644/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.114.up_proj:  26%|██▋       | 9645/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.114.down_proj:  26%|██▋       | 9646/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.115.gate_proj:  26%|██▋       | 9647/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.115.up_proj:  26%|██▋       | 9648/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.115.down_proj:  26%|██▋       | 9649/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.116.gate_proj:  26%|██▋       | 9650/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.116.up_proj:  26%|██▋       | 9651/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.116.down_proj:  26%|██▋       | 9652/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.117.gate_proj:  26%|██▋       | 9653/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.117.up_proj:  26%|██▋       | 9654/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.117.down_proj:  26%|██▋       | 9655/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.118.gate_proj:  26%|██▋       | 9656/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.118.up_proj:  26%|██▋       | 9657/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.118.down_proj:  26%|██▋       | 9658/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.119.gate_proj:  26%|██▋       | 9659/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.119.up_proj:  26%|██▋       | 9660/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.119.down_proj:  26%|██▋       | 9661/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.120.gate_proj:  26%|██▋       | 9662/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.120.up_proj:  26%|██▋       | 9663/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.120.down_proj:  26%|██▋       | 9664/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.121.gate_proj:  26%|██▋       | 9665/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.121.up_proj:  26%|██▋       | 9666/36566 [00:09<00:23, 1153.55it/s]  
packing model.layers.23.mlp.experts.121.down_proj:  26%|██▋       | 9667/36566 [00:09<00:23, 1153.55it/s]
packing model.layers.23.mlp.experts.121.down_proj:  26%|██▋       | 9668/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.122.gate_proj:  26%|██▋       | 9668/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.122.up_proj:  26%|██▋       | 9669/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.23.mlp.experts.122.down_proj:  26%|██▋       | 9670/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.123.gate_proj:  26%|██▋       | 9671/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.123.up_proj:  26%|██▋       | 9672/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.23.mlp.experts.123.down_proj:  26%|██▋       | 9673/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.124.gate_proj:  26%|██▋       | 9674/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.124.up_proj:  26%|██▋       | 9675/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.23.mlp.experts.124.down_proj:  26%|██▋       | 9676/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.125.gate_proj:  26%|██▋       | 9677/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.125.up_proj:  26%|██▋       | 9678/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.23.mlp.experts.125.down_proj:  26%|██▋       | 9679/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.126.gate_proj:  26%|██▋       | 9680/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.126.up_proj:  26%|██▋       | 9681/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.23.mlp.experts.126.down_proj:  26%|██▋       | 9682/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.127.gate_proj:  26%|██▋       | 9683/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.23.mlp.experts.127.up_proj:  26%|██▋       | 9684/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.23.mlp.experts.127.down_proj:  26%|██▋       | 9685/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.0.gate_proj:  26%|██▋       | 9686/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.0.up_proj:  26%|██▋       | 9687/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.0.down_proj:  26%|██▋       | 9688/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.1.gate_proj:  26%|██▋       | 9689/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.1.up_proj:  27%|██▋       | 9690/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.1.down_proj:  27%|██▋       | 9691/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.2.gate_proj:  27%|██▋       | 9692/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.2.up_proj:  27%|██▋       | 9693/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.2.down_proj:  27%|██▋       | 9694/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.3.gate_proj:  27%|██▋       | 9695/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.3.up_proj:  27%|██▋       | 9696/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.3.down_proj:  27%|██▋       | 9697/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.4.gate_proj:  27%|██▋       | 9698/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.4.up_proj:  27%|██▋       | 9699/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.4.down_proj:  27%|██▋       | 9700/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.5.gate_proj:  27%|██▋       | 9701/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.5.up_proj:  27%|██▋       | 9702/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.5.down_proj:  27%|██▋       | 9703/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.6.gate_proj:  27%|██▋       | 9704/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.6.up_proj:  27%|██▋       | 9705/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.6.down_proj:  27%|██▋       | 9706/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.7.gate_proj:  27%|██▋       | 9707/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.7.up_proj:  27%|██▋       | 9708/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.7.down_proj:  27%|██▋       | 9709/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.8.gate_proj:  27%|██▋       | 9710/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.8.up_proj:  27%|██▋       | 9711/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.8.down_proj:  27%|██▋       | 9712/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.9.gate_proj:  27%|██▋       | 9713/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.9.up_proj:  27%|██▋       | 9714/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.9.down_proj:  27%|██▋       | 9715/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.10.gate_proj:  27%|██▋       | 9716/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.10.up_proj:  27%|██▋       | 9717/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.10.down_proj:  27%|██▋       | 9718/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.11.gate_proj:  27%|██▋       | 9719/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.11.up_proj:  27%|██▋       | 9720/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.11.down_proj:  27%|██▋       | 9721/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.12.gate_proj:  27%|██▋       | 9722/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.12.up_proj:  27%|██▋       | 9723/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.12.down_proj:  27%|██▋       | 9724/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.13.gate_proj:  27%|██▋       | 9725/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.13.up_proj:  27%|██▋       | 9726/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.13.down_proj:  27%|██▋       | 9727/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.14.gate_proj:  27%|██▋       | 9728/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.14.up_proj:  27%|██▋       | 9729/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.14.down_proj:  27%|██▋       | 9730/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.15.gate_proj:  27%|██▋       | 9731/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.15.up_proj:  27%|██▋       | 9732/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.15.down_proj:  27%|██▋       | 9733/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.16.gate_proj:  27%|██▋       | 9734/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.16.up_proj:  27%|██▋       | 9735/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.16.down_proj:  27%|██▋       | 9736/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.17.gate_proj:  27%|██▋       | 9737/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.17.up_proj:  27%|██▋       | 9738/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.17.down_proj:  27%|██▋       | 9739/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.18.gate_proj:  27%|██▋       | 9740/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.18.up_proj:  27%|██▋       | 9741/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.18.down_proj:  27%|██▋       | 9742/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.19.gate_proj:  27%|██▋       | 9743/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.19.up_proj:  27%|██▋       | 9744/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.19.down_proj:  27%|██▋       | 9745/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.20.gate_proj:  27%|██▋       | 9746/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.20.up_proj:  27%|██▋       | 9747/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.20.down_proj:  27%|██▋       | 9748/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.21.gate_proj:  27%|██▋       | 9749/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.21.up_proj:  27%|██▋       | 9750/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.21.down_proj:  27%|██▋       | 9751/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.22.gate_proj:  27%|██▋       | 9752/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.22.up_proj:  27%|██▋       | 9753/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.22.down_proj:  27%|██▋       | 9754/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.23.gate_proj:  27%|██▋       | 9755/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.23.up_proj:  27%|██▋       | 9756/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.23.down_proj:  27%|██▋       | 9757/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.24.gate_proj:  27%|██▋       | 9758/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.24.up_proj:  27%|██▋       | 9759/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.24.down_proj:  27%|██▋       | 9760/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.25.gate_proj:  27%|██▋       | 9761/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.25.up_proj:  27%|██▋       | 9762/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.25.down_proj:  27%|██▋       | 9763/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.26.gate_proj:  27%|██▋       | 9764/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.26.up_proj:  27%|██▋       | 9765/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.26.down_proj:  27%|██▋       | 9766/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.27.gate_proj:  27%|██▋       | 9767/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.27.up_proj:  27%|██▋       | 9768/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.27.down_proj:  27%|██▋       | 9769/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.28.gate_proj:  27%|██▋       | 9770/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.28.up_proj:  27%|██▋       | 9771/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.28.down_proj:  27%|██▋       | 9772/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.29.gate_proj:  27%|██▋       | 9773/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.29.up_proj:  27%|██▋       | 9774/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.29.down_proj:  27%|██▋       | 9775/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.30.gate_proj:  27%|██▋       | 9776/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.30.up_proj:  27%|██▋       | 9777/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.30.down_proj:  27%|██▋       | 9778/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.31.gate_proj:  27%|██▋       | 9779/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.31.up_proj:  27%|██▋       | 9780/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.31.down_proj:  27%|██▋       | 9781/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.32.gate_proj:  27%|██▋       | 9782/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.32.up_proj:  27%|██▋       | 9783/36566 [00:09<00:23, 1155.62it/s]  
packing model.layers.24.mlp.experts.32.down_proj:  27%|██▋       | 9784/36566 [00:09<00:23, 1155.62it/s]
packing model.layers.24.mlp.experts.32.down_proj:  27%|██▋       | 9785/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.33.gate_proj:  27%|██▋       | 9785/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.33.up_proj:  27%|██▋       | 9786/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.33.down_proj:  27%|██▋       | 9787/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.34.gate_proj:  27%|██▋       | 9788/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.34.up_proj:  27%|██▋       | 9789/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.34.down_proj:  27%|██▋       | 9790/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.35.gate_proj:  27%|██▋       | 9791/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.35.up_proj:  27%|██▋       | 9792/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.35.down_proj:  27%|██▋       | 9793/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.36.gate_proj:  27%|██▋       | 9794/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.36.up_proj:  27%|██▋       | 9795/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.36.down_proj:  27%|██▋       | 9796/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.37.gate_proj:  27%|██▋       | 9797/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.37.up_proj:  27%|██▋       | 9798/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.37.down_proj:  27%|██▋       | 9799/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.38.gate_proj:  27%|██▋       | 9800/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.38.up_proj:  27%|██▋       | 9801/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.38.down_proj:  27%|██▋       | 9802/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.39.gate_proj:  27%|██▋       | 9803/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.39.up_proj:  27%|██▋       | 9804/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.39.down_proj:  27%|██▋       | 9805/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.40.gate_proj:  27%|██▋       | 9806/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.40.up_proj:  27%|██▋       | 9807/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.40.down_proj:  27%|██▋       | 9808/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.41.gate_proj:  27%|██▋       | 9809/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.41.up_proj:  27%|██▋       | 9810/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.41.down_proj:  27%|██▋       | 9811/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.42.gate_proj:  27%|██▋       | 9812/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.42.up_proj:  27%|██▋       | 9813/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.42.down_proj:  27%|██▋       | 9814/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.43.gate_proj:  27%|██▋       | 9815/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.43.up_proj:  27%|██▋       | 9816/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.43.down_proj:  27%|██▋       | 9817/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.44.gate_proj:  27%|██▋       | 9818/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.44.up_proj:  27%|██▋       | 9819/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.44.down_proj:  27%|██▋       | 9820/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.45.gate_proj:  27%|██▋       | 9821/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.45.up_proj:  27%|██▋       | 9822/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.45.down_proj:  27%|██▋       | 9823/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.46.gate_proj:  27%|██▋       | 9824/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.46.up_proj:  27%|██▋       | 9825/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.46.down_proj:  27%|██▋       | 9826/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.47.gate_proj:  27%|██▋       | 9827/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.47.up_proj:  27%|██▋       | 9828/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.47.down_proj:  27%|██▋       | 9829/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.48.gate_proj:  27%|██▋       | 9830/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.48.up_proj:  27%|██▋       | 9831/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.48.down_proj:  27%|██▋       | 9832/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.49.gate_proj:  27%|██▋       | 9833/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.49.up_proj:  27%|██▋       | 9834/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.49.down_proj:  27%|██▋       | 9835/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.50.gate_proj:  27%|██▋       | 9836/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.50.up_proj:  27%|██▋       | 9837/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.50.down_proj:  27%|██▋       | 9838/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.51.gate_proj:  27%|██▋       | 9839/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.51.up_proj:  27%|██▋       | 9840/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.51.down_proj:  27%|██▋       | 9841/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.52.gate_proj:  27%|██▋       | 9842/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.52.up_proj:  27%|██▋       | 9843/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.52.down_proj:  27%|██▋       | 9844/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.53.gate_proj:  27%|██▋       | 9845/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.53.up_proj:  27%|██▋       | 9846/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.53.down_proj:  27%|██▋       | 9847/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.54.gate_proj:  27%|██▋       | 9848/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.54.up_proj:  27%|██▋       | 9849/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.54.down_proj:  27%|██▋       | 9850/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.55.gate_proj:  27%|██▋       | 9851/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.55.up_proj:  27%|██▋       | 9852/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.55.down_proj:  27%|██▋       | 9853/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.56.gate_proj:  27%|██▋       | 9854/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.56.up_proj:  27%|██▋       | 9855/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.56.down_proj:  27%|██▋       | 9856/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.57.gate_proj:  27%|██▋       | 9857/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.57.up_proj:  27%|██▋       | 9858/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.57.down_proj:  27%|██▋       | 9859/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.58.gate_proj:  27%|██▋       | 9860/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.58.up_proj:  27%|██▋       | 9861/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.58.down_proj:  27%|██▋       | 9862/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.59.gate_proj:  27%|██▋       | 9863/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.59.up_proj:  27%|██▋       | 9864/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.59.down_proj:  27%|██▋       | 9865/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.60.gate_proj:  27%|██▋       | 9866/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.60.up_proj:  27%|██▋       | 9867/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.60.down_proj:  27%|██▋       | 9868/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.61.gate_proj:  27%|██▋       | 9869/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.61.up_proj:  27%|██▋       | 9870/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.61.down_proj:  27%|██▋       | 9871/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.62.gate_proj:  27%|██▋       | 9872/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.62.up_proj:  27%|██▋       | 9873/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.62.down_proj:  27%|██▋       | 9874/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.63.gate_proj:  27%|██▋       | 9875/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.63.up_proj:  27%|██▋       | 9876/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.63.down_proj:  27%|██▋       | 9877/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.64.gate_proj:  27%|██▋       | 9878/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.64.up_proj:  27%|██▋       | 9879/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.64.down_proj:  27%|██▋       | 9880/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.65.gate_proj:  27%|██▋       | 9881/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.65.up_proj:  27%|██▋       | 9882/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.65.down_proj:  27%|██▋       | 9883/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.66.gate_proj:  27%|██▋       | 9884/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.66.up_proj:  27%|██▋       | 9885/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.66.down_proj:  27%|██▋       | 9886/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.67.gate_proj:  27%|██▋       | 9887/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.67.up_proj:  27%|██▋       | 9888/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.67.down_proj:  27%|██▋       | 9889/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.68.gate_proj:  27%|██▋       | 9890/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.68.up_proj:  27%|██▋       | 9891/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.68.down_proj:  27%|██▋       | 9892/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.69.gate_proj:  27%|██▋       | 9893/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.69.up_proj:  27%|██▋       | 9894/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.69.down_proj:  27%|██▋       | 9895/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.70.gate_proj:  27%|██▋       | 9896/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.70.up_proj:  27%|██▋       | 9897/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.70.down_proj:  27%|██▋       | 9898/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.71.gate_proj:  27%|██▋       | 9899/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.71.up_proj:  27%|██▋       | 9900/36566 [00:09<00:23, 1157.33it/s]  
packing model.layers.24.mlp.experts.71.down_proj:  27%|██▋       | 9901/36566 [00:09<00:23, 1157.33it/s]
packing model.layers.24.mlp.experts.71.down_proj:  27%|██▋       | 9902/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.72.gate_proj:  27%|██▋       | 9902/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.72.up_proj:  27%|██▋       | 9903/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.72.down_proj:  27%|██▋       | 9904/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.73.gate_proj:  27%|██▋       | 9905/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.73.up_proj:  27%|██▋       | 9906/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.73.down_proj:  27%|██▋       | 9907/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.74.gate_proj:  27%|██▋       | 9908/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.74.up_proj:  27%|██▋       | 9909/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.74.down_proj:  27%|██▋       | 9910/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.75.gate_proj:  27%|██▋       | 9911/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.75.up_proj:  27%|██▋       | 9912/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.75.down_proj:  27%|██▋       | 9913/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.76.gate_proj:  27%|██▋       | 9914/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.76.up_proj:  27%|██▋       | 9915/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.76.down_proj:  27%|██▋       | 9916/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.77.gate_proj:  27%|██▋       | 9917/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.77.up_proj:  27%|██▋       | 9918/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.77.down_proj:  27%|██▋       | 9919/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.78.gate_proj:  27%|██▋       | 9920/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.78.up_proj:  27%|██▋       | 9921/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.78.down_proj:  27%|██▋       | 9922/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.79.gate_proj:  27%|██▋       | 9923/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.79.up_proj:  27%|██▋       | 9924/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.79.down_proj:  27%|██▋       | 9925/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.80.gate_proj:  27%|██▋       | 9926/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.80.up_proj:  27%|██▋       | 9927/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.80.down_proj:  27%|██▋       | 9928/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.81.gate_proj:  27%|██▋       | 9929/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.81.up_proj:  27%|██▋       | 9930/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.81.down_proj:  27%|██▋       | 9931/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.82.gate_proj:  27%|██▋       | 9932/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.82.up_proj:  27%|██▋       | 9933/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.82.down_proj:  27%|██▋       | 9934/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.83.gate_proj:  27%|██▋       | 9935/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.83.up_proj:  27%|██▋       | 9936/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.83.down_proj:  27%|██▋       | 9937/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.84.gate_proj:  27%|██▋       | 9938/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.84.up_proj:  27%|██▋       | 9939/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.84.down_proj:  27%|██▋       | 9940/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.85.gate_proj:  27%|██▋       | 9941/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.85.up_proj:  27%|██▋       | 9942/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.85.down_proj:  27%|██▋       | 9943/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.86.gate_proj:  27%|██▋       | 9944/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.86.up_proj:  27%|██▋       | 9945/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.86.down_proj:  27%|██▋       | 9946/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.87.gate_proj:  27%|██▋       | 9947/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.87.up_proj:  27%|██▋       | 9948/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.87.down_proj:  27%|██▋       | 9949/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.88.gate_proj:  27%|██▋       | 9950/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.88.up_proj:  27%|██▋       | 9951/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.88.down_proj:  27%|██▋       | 9952/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.89.gate_proj:  27%|██▋       | 9953/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.89.up_proj:  27%|██▋       | 9954/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.89.down_proj:  27%|██▋       | 9955/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.90.gate_proj:  27%|██▋       | 9956/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.90.up_proj:  27%|██▋       | 9957/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.90.down_proj:  27%|██▋       | 9958/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.91.gate_proj:  27%|██▋       | 9959/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.91.up_proj:  27%|██▋       | 9960/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.91.down_proj:  27%|██▋       | 9961/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.92.gate_proj:  27%|██▋       | 9962/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.92.up_proj:  27%|██▋       | 9963/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.92.down_proj:  27%|██▋       | 9964/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.93.gate_proj:  27%|██▋       | 9965/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.93.up_proj:  27%|██▋       | 9966/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.93.down_proj:  27%|██▋       | 9967/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.94.gate_proj:  27%|██▋       | 9968/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.94.up_proj:  27%|██▋       | 9969/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.94.down_proj:  27%|██▋       | 9970/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.95.gate_proj:  27%|██▋       | 9971/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.95.up_proj:  27%|██▋       | 9972/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.95.down_proj:  27%|██▋       | 9973/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.96.gate_proj:  27%|██▋       | 9974/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.96.up_proj:  27%|██▋       | 9975/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.96.down_proj:  27%|██▋       | 9976/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.97.gate_proj:  27%|██▋       | 9977/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.97.up_proj:  27%|██▋       | 9978/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.97.down_proj:  27%|██▋       | 9979/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.98.gate_proj:  27%|██▋       | 9980/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.98.up_proj:  27%|██▋       | 9981/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.98.down_proj:  27%|██▋       | 9982/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.99.gate_proj:  27%|██▋       | 9983/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.99.up_proj:  27%|██▋       | 9984/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.99.down_proj:  27%|██▋       | 9985/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.100.gate_proj:  27%|██▋       | 9986/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.100.up_proj:  27%|██▋       | 9987/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.100.down_proj:  27%|██▋       | 9988/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.101.gate_proj:  27%|██▋       | 9989/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.101.up_proj:  27%|██▋       | 9990/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.101.down_proj:  27%|██▋       | 9991/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.102.gate_proj:  27%|██▋       | 9992/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.102.up_proj:  27%|██▋       | 9993/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.102.down_proj:  27%|██▋       | 9994/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.103.gate_proj:  27%|██▋       | 9995/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.103.up_proj:  27%|██▋       | 9996/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.103.down_proj:  27%|██▋       | 9997/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.104.gate_proj:  27%|██▋       | 9998/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.104.up_proj:  27%|██▋       | 9999/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.104.down_proj:  27%|██▋       | 10000/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.105.gate_proj:  27%|██▋       | 10001/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.105.up_proj:  27%|██▋       | 10002/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.105.down_proj:  27%|██▋       | 10003/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.106.gate_proj:  27%|██▋       | 10004/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.106.up_proj:  27%|██▋       | 10005/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.106.down_proj:  27%|██▋       | 10006/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.107.gate_proj:  27%|██▋       | 10007/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.107.up_proj:  27%|██▋       | 10008/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.107.down_proj:  27%|██▋       | 10009/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.108.gate_proj:  27%|██▋       | 10010/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.108.up_proj:  27%|██▋       | 10011/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.108.down_proj:  27%|██▋       | 10012/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.109.gate_proj:  27%|██▋       | 10013/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.109.up_proj:  27%|██▋       | 10014/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.109.down_proj:  27%|██▋       | 10015/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.110.gate_proj:  27%|██▋       | 10016/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.110.up_proj:  27%|██▋       | 10017/36566 [00:09<00:22, 1159.61it/s]  
packing model.layers.24.mlp.experts.110.down_proj:  27%|██▋       | 10018/36566 [00:09<00:22, 1159.61it/s]
packing model.layers.24.mlp.experts.110.down_proj:  27%|██▋       | 10019/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.111.gate_proj:  27%|██▋       | 10019/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.111.up_proj:  27%|██▋       | 10020/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.111.down_proj:  27%|██▋       | 10021/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.112.gate_proj:  27%|██▋       | 10022/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.112.up_proj:  27%|██▋       | 10023/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.112.down_proj:  27%|██▋       | 10024/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.113.gate_proj:  27%|██▋       | 10025/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.113.up_proj:  27%|██▋       | 10026/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.113.down_proj:  27%|██▋       | 10027/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.114.gate_proj:  27%|██▋       | 10028/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.114.up_proj:  27%|██▋       | 10029/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.114.down_proj:  27%|██▋       | 10030/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.115.gate_proj:  27%|██▋       | 10031/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.115.up_proj:  27%|██▋       | 10032/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.115.down_proj:  27%|██▋       | 10033/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.116.gate_proj:  27%|██▋       | 10034/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.116.up_proj:  27%|██▋       | 10035/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.116.down_proj:  27%|██▋       | 10036/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.117.gate_proj:  27%|██▋       | 10037/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.117.up_proj:  27%|██▋       | 10038/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.117.down_proj:  27%|██▋       | 10039/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.118.gate_proj:  27%|██▋       | 10040/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.118.up_proj:  27%|██▋       | 10041/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.118.down_proj:  27%|██▋       | 10042/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.119.gate_proj:  27%|██▋       | 10043/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.119.up_proj:  27%|██▋       | 10044/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.119.down_proj:  27%|██▋       | 10045/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.120.gate_proj:  27%|██▋       | 10046/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.120.up_proj:  27%|██▋       | 10047/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.120.down_proj:  27%|██▋       | 10048/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.121.gate_proj:  27%|██▋       | 10049/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.121.up_proj:  27%|██▋       | 10050/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.121.down_proj:  27%|██▋       | 10051/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.122.gate_proj:  27%|██▋       | 10052/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.122.up_proj:  27%|██▋       | 10053/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.122.down_proj:  27%|██▋       | 10054/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.123.gate_proj:  27%|██▋       | 10055/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.123.up_proj:  28%|██▊       | 10056/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.123.down_proj:  28%|██▊       | 10057/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.124.gate_proj:  28%|██▊       | 10058/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.124.up_proj:  28%|██▊       | 10059/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.124.down_proj:  28%|██▊       | 10060/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.125.gate_proj:  28%|██▊       | 10061/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.125.up_proj:  28%|██▊       | 10062/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.125.down_proj:  28%|██▊       | 10063/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.126.gate_proj:  28%|██▊       | 10064/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.126.up_proj:  28%|██▊       | 10065/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.126.down_proj:  28%|██▊       | 10066/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.127.gate_proj:  28%|██▊       | 10067/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.24.mlp.experts.127.up_proj:  28%|██▊       | 10068/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.24.mlp.experts.127.down_proj:  28%|██▊       | 10069/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.0.gate_proj:  28%|██▊       | 10070/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.0.up_proj:  28%|██▊       | 10071/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.0.down_proj:  28%|██▊       | 10072/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.1.gate_proj:  28%|██▊       | 10073/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.1.up_proj:  28%|██▊       | 10074/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.1.down_proj:  28%|██▊       | 10075/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.2.gate_proj:  28%|██▊       | 10076/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.2.up_proj:  28%|██▊       | 10077/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.2.down_proj:  28%|██▊       | 10078/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.3.gate_proj:  28%|██▊       | 10079/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.3.up_proj:  28%|██▊       | 10080/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.3.down_proj:  28%|██▊       | 10081/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.4.gate_proj:  28%|██▊       | 10082/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.4.up_proj:  28%|██▊       | 10083/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.4.down_proj:  28%|██▊       | 10084/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.5.gate_proj:  28%|██▊       | 10085/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.5.up_proj:  28%|██▊       | 10086/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.5.down_proj:  28%|██▊       | 10087/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.6.gate_proj:  28%|██▊       | 10088/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.6.up_proj:  28%|██▊       | 10089/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.6.down_proj:  28%|██▊       | 10090/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.7.gate_proj:  28%|██▊       | 10091/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.7.up_proj:  28%|██▊       | 10092/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.7.down_proj:  28%|██▊       | 10093/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.8.gate_proj:  28%|██▊       | 10094/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.8.up_proj:  28%|██▊       | 10095/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.8.down_proj:  28%|██▊       | 10096/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.9.gate_proj:  28%|██▊       | 10097/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.9.up_proj:  28%|██▊       | 10098/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.9.down_proj:  28%|██▊       | 10099/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.10.gate_proj:  28%|██▊       | 10100/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.10.up_proj:  28%|██▊       | 10101/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.10.down_proj:  28%|██▊       | 10102/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.11.gate_proj:  28%|██▊       | 10103/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.11.up_proj:  28%|██▊       | 10104/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.11.down_proj:  28%|██▊       | 10105/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.12.gate_proj:  28%|██▊       | 10106/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.12.up_proj:  28%|██▊       | 10107/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.12.down_proj:  28%|██▊       | 10108/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.13.gate_proj:  28%|██▊       | 10109/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.13.up_proj:  28%|██▊       | 10110/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.13.down_proj:  28%|██▊       | 10111/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.14.gate_proj:  28%|██▊       | 10112/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.14.up_proj:  28%|██▊       | 10113/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.14.down_proj:  28%|██▊       | 10114/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.15.gate_proj:  28%|██▊       | 10115/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.15.up_proj:  28%|██▊       | 10116/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.15.down_proj:  28%|██▊       | 10117/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.16.gate_proj:  28%|██▊       | 10118/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.16.up_proj:  28%|██▊       | 10119/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.16.down_proj:  28%|██▊       | 10120/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.17.gate_proj:  28%|██▊       | 10121/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.17.up_proj:  28%|██▊       | 10122/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.17.down_proj:  28%|██▊       | 10123/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.18.gate_proj:  28%|██▊       | 10124/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.18.up_proj:  28%|██▊       | 10125/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.18.down_proj:  28%|██▊       | 10126/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.19.gate_proj:  28%|██▊       | 10127/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.19.up_proj:  28%|██▊       | 10128/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.19.down_proj:  28%|██▊       | 10129/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.20.gate_proj:  28%|██▊       | 10130/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.20.up_proj:  28%|██▊       | 10131/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.20.down_proj:  28%|██▊       | 10132/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.21.gate_proj:  28%|██▊       | 10133/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.21.up_proj:  28%|██▊       | 10134/36566 [00:09<00:22, 1161.79it/s]  
packing model.layers.25.mlp.experts.21.down_proj:  28%|██▊       | 10135/36566 [00:09<00:22, 1161.79it/s]
packing model.layers.25.mlp.experts.21.down_proj:  28%|██▊       | 10136/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.22.gate_proj:  28%|██▊       | 10136/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.22.up_proj:  28%|██▊       | 10137/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.22.down_proj:  28%|██▊       | 10138/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.23.gate_proj:  28%|██▊       | 10139/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.23.up_proj:  28%|██▊       | 10140/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.23.down_proj:  28%|██▊       | 10141/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.24.gate_proj:  28%|██▊       | 10142/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.24.up_proj:  28%|██▊       | 10143/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.24.down_proj:  28%|██▊       | 10144/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.25.gate_proj:  28%|██▊       | 10145/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.25.up_proj:  28%|██▊       | 10146/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.25.down_proj:  28%|██▊       | 10147/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.26.gate_proj:  28%|██▊       | 10148/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.26.up_proj:  28%|██▊       | 10149/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.26.down_proj:  28%|██▊       | 10150/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.27.gate_proj:  28%|██▊       | 10151/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.27.up_proj:  28%|██▊       | 10152/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.27.down_proj:  28%|██▊       | 10153/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.28.gate_proj:  28%|██▊       | 10154/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.28.up_proj:  28%|██▊       | 10155/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.28.down_proj:  28%|██▊       | 10156/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.29.gate_proj:  28%|██▊       | 10157/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.29.up_proj:  28%|██▊       | 10158/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.29.down_proj:  28%|██▊       | 10159/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.30.gate_proj:  28%|██▊       | 10160/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.30.up_proj:  28%|██▊       | 10161/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.30.down_proj:  28%|██▊       | 10162/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.31.gate_proj:  28%|██▊       | 10163/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.31.up_proj:  28%|██▊       | 10164/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.31.down_proj:  28%|██▊       | 10165/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.32.gate_proj:  28%|██▊       | 10166/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.32.up_proj:  28%|██▊       | 10167/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.32.down_proj:  28%|██▊       | 10168/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.33.gate_proj:  28%|██▊       | 10169/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.33.up_proj:  28%|██▊       | 10170/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.33.down_proj:  28%|██▊       | 10171/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.34.gate_proj:  28%|██▊       | 10172/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.34.up_proj:  28%|██▊       | 10173/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.34.down_proj:  28%|██▊       | 10174/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.35.gate_proj:  28%|██▊       | 10175/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.35.up_proj:  28%|██▊       | 10176/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.35.down_proj:  28%|██▊       | 10177/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.36.gate_proj:  28%|██▊       | 10178/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.36.up_proj:  28%|██▊       | 10179/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.36.down_proj:  28%|██▊       | 10180/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.37.gate_proj:  28%|██▊       | 10181/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.37.up_proj:  28%|██▊       | 10182/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.37.down_proj:  28%|██▊       | 10183/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.38.gate_proj:  28%|██▊       | 10184/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.38.up_proj:  28%|██▊       | 10185/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.38.down_proj:  28%|██▊       | 10186/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.39.gate_proj:  28%|██▊       | 10187/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.39.up_proj:  28%|██▊       | 10188/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.39.down_proj:  28%|██▊       | 10189/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.40.gate_proj:  28%|██▊       | 10190/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.40.up_proj:  28%|██▊       | 10191/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.40.down_proj:  28%|██▊       | 10192/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.41.gate_proj:  28%|██▊       | 10193/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.41.up_proj:  28%|██▊       | 10194/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.41.down_proj:  28%|██▊       | 10195/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.42.gate_proj:  28%|██▊       | 10196/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.42.up_proj:  28%|██▊       | 10197/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.42.down_proj:  28%|██▊       | 10198/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.43.gate_proj:  28%|██▊       | 10199/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.43.up_proj:  28%|██▊       | 10200/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.43.down_proj:  28%|██▊       | 10201/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.44.gate_proj:  28%|██▊       | 10202/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.44.up_proj:  28%|██▊       | 10203/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.44.down_proj:  28%|██▊       | 10204/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.45.gate_proj:  28%|██▊       | 10205/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.45.up_proj:  28%|██▊       | 10206/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.45.down_proj:  28%|██▊       | 10207/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.46.gate_proj:  28%|██▊       | 10208/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.46.up_proj:  28%|██▊       | 10209/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.46.down_proj:  28%|██▊       | 10210/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.47.gate_proj:  28%|██▊       | 10211/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.47.up_proj:  28%|██▊       | 10212/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.47.down_proj:  28%|██▊       | 10213/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.48.gate_proj:  28%|██▊       | 10214/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.48.up_proj:  28%|██▊       | 10215/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.48.down_proj:  28%|██▊       | 10216/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.49.gate_proj:  28%|██▊       | 10217/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.49.up_proj:  28%|██▊       | 10218/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.49.down_proj:  28%|██▊       | 10219/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.50.gate_proj:  28%|██▊       | 10220/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.50.up_proj:  28%|██▊       | 10221/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.50.down_proj:  28%|██▊       | 10222/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.51.gate_proj:  28%|██▊       | 10223/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.51.up_proj:  28%|██▊       | 10224/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.51.down_proj:  28%|██▊       | 10225/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.52.gate_proj:  28%|██▊       | 10226/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.52.up_proj:  28%|██▊       | 10227/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.52.down_proj:  28%|██▊       | 10228/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.53.gate_proj:  28%|██▊       | 10229/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.53.up_proj:  28%|██▊       | 10230/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.53.down_proj:  28%|██▊       | 10231/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.54.gate_proj:  28%|██▊       | 10232/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.54.up_proj:  28%|██▊       | 10233/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.54.down_proj:  28%|██▊       | 10234/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.55.gate_proj:  28%|██▊       | 10235/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.55.up_proj:  28%|██▊       | 10236/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.55.down_proj:  28%|██▊       | 10237/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.56.gate_proj:  28%|██▊       | 10238/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.56.up_proj:  28%|██▊       | 10239/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.56.down_proj:  28%|██▊       | 10240/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.57.gate_proj:  28%|██▊       | 10241/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.57.up_proj:  28%|██▊       | 10242/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.57.down_proj:  28%|██▊       | 10243/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.58.gate_proj:  28%|██▊       | 10244/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.58.up_proj:  28%|██▊       | 10245/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.58.down_proj:  28%|██▊       | 10246/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.59.gate_proj:  28%|██▊       | 10247/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.59.up_proj:  28%|██▊       | 10248/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.59.down_proj:  28%|██▊       | 10249/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.60.gate_proj:  28%|██▊       | 10250/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.60.up_proj:  28%|██▊       | 10251/36566 [00:09<00:22, 1163.48it/s]  
packing model.layers.25.mlp.experts.60.down_proj:  28%|██▊       | 10252/36566 [00:09<00:22, 1163.48it/s]
packing model.layers.25.mlp.experts.60.down_proj:  28%|██▊       | 10253/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.61.gate_proj:  28%|██▊       | 10253/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.61.up_proj:  28%|██▊       | 10254/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.61.down_proj:  28%|██▊       | 10255/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.62.gate_proj:  28%|██▊       | 10256/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.62.up_proj:  28%|██▊       | 10257/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.62.down_proj:  28%|██▊       | 10258/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.63.gate_proj:  28%|██▊       | 10259/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.63.up_proj:  28%|██▊       | 10260/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.63.down_proj:  28%|██▊       | 10261/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.64.gate_proj:  28%|██▊       | 10262/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.64.up_proj:  28%|██▊       | 10263/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.64.down_proj:  28%|██▊       | 10264/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.65.gate_proj:  28%|██▊       | 10265/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.65.up_proj:  28%|██▊       | 10266/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.65.down_proj:  28%|██▊       | 10267/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.66.gate_proj:  28%|██▊       | 10268/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.66.up_proj:  28%|██▊       | 10269/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.66.down_proj:  28%|██▊       | 10270/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.67.gate_proj:  28%|██▊       | 10271/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.67.up_proj:  28%|██▊       | 10272/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.67.down_proj:  28%|██▊       | 10273/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.68.gate_proj:  28%|██▊       | 10274/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.68.up_proj:  28%|██▊       | 10275/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.68.down_proj:  28%|██▊       | 10276/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.69.gate_proj:  28%|██▊       | 10277/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.69.up_proj:  28%|██▊       | 10278/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.69.down_proj:  28%|██▊       | 10279/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.70.gate_proj:  28%|██▊       | 10280/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.70.up_proj:  28%|██▊       | 10281/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.70.down_proj:  28%|██▊       | 10282/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.71.gate_proj:  28%|██▊       | 10283/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.71.up_proj:  28%|██▊       | 10284/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.71.down_proj:  28%|██▊       | 10285/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.72.gate_proj:  28%|██▊       | 10286/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.72.up_proj:  28%|██▊       | 10287/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.72.down_proj:  28%|██▊       | 10288/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.73.gate_proj:  28%|██▊       | 10289/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.73.up_proj:  28%|██▊       | 10290/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.73.down_proj:  28%|██▊       | 10291/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.74.gate_proj:  28%|██▊       | 10292/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.74.up_proj:  28%|██▊       | 10293/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.74.down_proj:  28%|██▊       | 10294/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.75.gate_proj:  28%|██▊       | 10295/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.75.up_proj:  28%|██▊       | 10296/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.75.down_proj:  28%|██▊       | 10297/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.76.gate_proj:  28%|██▊       | 10298/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.76.up_proj:  28%|██▊       | 10299/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.76.down_proj:  28%|██▊       | 10300/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.77.gate_proj:  28%|██▊       | 10301/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.77.up_proj:  28%|██▊       | 10302/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.77.down_proj:  28%|██▊       | 10303/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.78.gate_proj:  28%|██▊       | 10304/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.78.up_proj:  28%|██▊       | 10305/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.78.down_proj:  28%|██▊       | 10306/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.79.gate_proj:  28%|██▊       | 10307/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.79.up_proj:  28%|██▊       | 10308/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.79.down_proj:  28%|██▊       | 10309/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.80.gate_proj:  28%|██▊       | 10310/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.80.up_proj:  28%|██▊       | 10311/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.80.down_proj:  28%|██▊       | 10312/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.81.gate_proj:  28%|██▊       | 10313/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.81.up_proj:  28%|██▊       | 10314/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.81.down_proj:  28%|██▊       | 10315/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.82.gate_proj:  28%|██▊       | 10316/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.82.up_proj:  28%|██▊       | 10317/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.82.down_proj:  28%|██▊       | 10318/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.83.gate_proj:  28%|██▊       | 10319/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.83.up_proj:  28%|██▊       | 10320/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.83.down_proj:  28%|██▊       | 10321/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.84.gate_proj:  28%|██▊       | 10322/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.84.up_proj:  28%|██▊       | 10323/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.84.down_proj:  28%|██▊       | 10324/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.85.gate_proj:  28%|██▊       | 10325/36566 [00:09<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.85.up_proj:  28%|██▊       | 10326/36566 [00:09<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.85.down_proj:  28%|██▊       | 10327/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.86.gate_proj:  28%|██▊       | 10328/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.86.up_proj:  28%|██▊       | 10329/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.86.down_proj:  28%|██▊       | 10330/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.87.gate_proj:  28%|██▊       | 10331/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.87.up_proj:  28%|██▊       | 10332/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.87.down_proj:  28%|██▊       | 10333/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.88.gate_proj:  28%|██▊       | 10334/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.88.up_proj:  28%|██▊       | 10335/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.88.down_proj:  28%|██▊       | 10336/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.89.gate_proj:  28%|██▊       | 10337/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.89.up_proj:  28%|██▊       | 10338/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.89.down_proj:  28%|██▊       | 10339/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.90.gate_proj:  28%|██▊       | 10340/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.90.up_proj:  28%|██▊       | 10341/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.90.down_proj:  28%|██▊       | 10342/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.91.gate_proj:  28%|██▊       | 10343/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.91.up_proj:  28%|██▊       | 10344/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.91.down_proj:  28%|██▊       | 10345/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.92.gate_proj:  28%|██▊       | 10346/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.92.up_proj:  28%|██▊       | 10347/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.92.down_proj:  28%|██▊       | 10348/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.93.gate_proj:  28%|██▊       | 10349/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.93.up_proj:  28%|██▊       | 10350/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.93.down_proj:  28%|██▊       | 10351/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.94.gate_proj:  28%|██▊       | 10352/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.94.up_proj:  28%|██▊       | 10353/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.94.down_proj:  28%|██▊       | 10354/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.95.gate_proj:  28%|██▊       | 10355/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.95.up_proj:  28%|██▊       | 10356/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.95.down_proj:  28%|██▊       | 10357/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.96.gate_proj:  28%|██▊       | 10358/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.96.up_proj:  28%|██▊       | 10359/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.96.down_proj:  28%|██▊       | 10360/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.97.gate_proj:  28%|██▊       | 10361/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.97.up_proj:  28%|██▊       | 10362/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.97.down_proj:  28%|██▊       | 10363/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.98.gate_proj:  28%|██▊       | 10364/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.98.up_proj:  28%|██▊       | 10365/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.98.down_proj:  28%|██▊       | 10366/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.99.gate_proj:  28%|██▊       | 10367/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.99.up_proj:  28%|██▊       | 10368/36566 [00:10<00:22, 1165.20it/s]  
packing model.layers.25.mlp.experts.99.down_proj:  28%|██▊       | 10369/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.100.gate_proj:  28%|██▊       | 10370/36566 [00:10<00:22, 1165.20it/s]
packing model.layers.25.mlp.experts.100.gate_proj:  28%|██▊       | 10371/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.100.up_proj:  28%|██▊       | 10371/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.100.down_proj:  28%|██▊       | 10372/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.101.gate_proj:  28%|██▊       | 10373/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.101.up_proj:  28%|██▊       | 10374/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.101.down_proj:  28%|██▊       | 10375/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.102.gate_proj:  28%|██▊       | 10376/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.102.up_proj:  28%|██▊       | 10377/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.102.down_proj:  28%|██▊       | 10378/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.103.gate_proj:  28%|██▊       | 10379/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.103.up_proj:  28%|██▊       | 10380/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.103.down_proj:  28%|██▊       | 10381/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.104.gate_proj:  28%|██▊       | 10382/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.104.up_proj:  28%|██▊       | 10383/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.104.down_proj:  28%|██▊       | 10384/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.105.gate_proj:  28%|██▊       | 10385/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.105.up_proj:  28%|██▊       | 10386/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.105.down_proj:  28%|██▊       | 10387/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.106.gate_proj:  28%|██▊       | 10388/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.106.up_proj:  28%|██▊       | 10389/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.106.down_proj:  28%|██▊       | 10390/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.107.gate_proj:  28%|██▊       | 10391/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.107.up_proj:  28%|██▊       | 10392/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.107.down_proj:  28%|██▊       | 10393/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.108.gate_proj:  28%|██▊       | 10394/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.108.up_proj:  28%|██▊       | 10395/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.108.down_proj:  28%|██▊       | 10396/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.109.gate_proj:  28%|██▊       | 10397/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.109.up_proj:  28%|██▊       | 10398/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.109.down_proj:  28%|██▊       | 10399/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.110.gate_proj:  28%|██▊       | 10400/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.110.up_proj:  28%|██▊       | 10401/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.110.down_proj:  28%|██▊       | 10402/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.111.gate_proj:  28%|██▊       | 10403/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.111.up_proj:  28%|██▊       | 10404/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.111.down_proj:  28%|██▊       | 10405/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.112.gate_proj:  28%|██▊       | 10406/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.112.up_proj:  28%|██▊       | 10407/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.112.down_proj:  28%|██▊       | 10408/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.113.gate_proj:  28%|██▊       | 10409/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.113.up_proj:  28%|██▊       | 10410/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.113.down_proj:  28%|██▊       | 10411/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.114.gate_proj:  28%|██▊       | 10412/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.114.up_proj:  28%|██▊       | 10413/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.114.down_proj:  28%|██▊       | 10414/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.115.gate_proj:  28%|██▊       | 10415/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.115.up_proj:  28%|██▊       | 10416/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.115.down_proj:  28%|██▊       | 10417/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.116.gate_proj:  28%|██▊       | 10418/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.116.up_proj:  28%|██▊       | 10419/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.116.down_proj:  28%|██▊       | 10420/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.117.gate_proj:  28%|██▊       | 10421/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.117.up_proj:  29%|██▊       | 10422/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.117.down_proj:  29%|██▊       | 10423/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.118.gate_proj:  29%|██▊       | 10424/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.118.up_proj:  29%|██▊       | 10425/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.118.down_proj:  29%|██▊       | 10426/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.119.gate_proj:  29%|██▊       | 10427/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.119.up_proj:  29%|██▊       | 10428/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.119.down_proj:  29%|██▊       | 10429/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.120.gate_proj:  29%|██▊       | 10430/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.120.up_proj:  29%|██▊       | 10431/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.120.down_proj:  29%|██▊       | 10432/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.121.gate_proj:  29%|██▊       | 10433/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.121.up_proj:  29%|██▊       | 10434/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.121.down_proj:  29%|██▊       | 10435/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.122.gate_proj:  29%|██▊       | 10436/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.122.up_proj:  29%|██▊       | 10437/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.122.down_proj:  29%|██▊       | 10438/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.123.gate_proj:  29%|██▊       | 10439/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.123.up_proj:  29%|██▊       | 10440/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.123.down_proj:  29%|██▊       | 10441/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.124.gate_proj:  29%|██▊       | 10442/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.124.up_proj:  29%|██▊       | 10443/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.124.down_proj:  29%|██▊       | 10444/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.125.gate_proj:  29%|██▊       | 10445/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.125.up_proj:  29%|██▊       | 10446/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.125.down_proj:  29%|██▊       | 10447/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.126.gate_proj:  29%|██▊       | 10448/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.126.up_proj:  29%|██▊       | 10449/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.126.down_proj:  29%|██▊       | 10450/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.127.gate_proj:  29%|██▊       | 10451/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.25.mlp.experts.127.up_proj:  29%|██▊       | 10452/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.25.mlp.experts.127.down_proj:  29%|██▊       | 10453/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.0.gate_proj:  29%|██▊       | 10454/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.0.up_proj:  29%|██▊       | 10455/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.0.down_proj:  29%|██▊       | 10456/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.1.gate_proj:  29%|██▊       | 10457/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.1.up_proj:  29%|██▊       | 10458/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.1.down_proj:  29%|██▊       | 10459/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.2.gate_proj:  29%|██▊       | 10460/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.2.up_proj:  29%|██▊       | 10461/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.2.down_proj:  29%|██▊       | 10462/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.3.gate_proj:  29%|██▊       | 10463/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.3.up_proj:  29%|██▊       | 10464/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.3.down_proj:  29%|██▊       | 10465/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.4.gate_proj:  29%|██▊       | 10466/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.4.up_proj:  29%|██▊       | 10467/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.4.down_proj:  29%|██▊       | 10468/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.5.gate_proj:  29%|██▊       | 10469/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.5.up_proj:  29%|██▊       | 10470/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.5.down_proj:  29%|██▊       | 10471/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.6.gate_proj:  29%|██▊       | 10472/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.6.up_proj:  29%|██▊       | 10473/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.6.down_proj:  29%|██▊       | 10474/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.7.gate_proj:  29%|██▊       | 10475/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.7.up_proj:  29%|██▊       | 10476/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.7.down_proj:  29%|██▊       | 10477/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.8.gate_proj:  29%|██▊       | 10478/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.8.up_proj:  29%|██▊       | 10479/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.8.down_proj:  29%|██▊       | 10480/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.9.gate_proj:  29%|██▊       | 10481/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.9.up_proj:  29%|██▊       | 10482/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.9.down_proj:  29%|██▊       | 10483/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.10.gate_proj:  29%|██▊       | 10484/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.10.up_proj:  29%|██▊       | 10485/36566 [00:10<00:22, 1166.86it/s]  
packing model.layers.26.mlp.experts.10.down_proj:  29%|██▊       | 10486/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.11.gate_proj:  29%|██▊       | 10487/36566 [00:10<00:22, 1166.86it/s]
packing model.layers.26.mlp.experts.11.gate_proj:  29%|██▊       | 10488/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.11.up_proj:  29%|██▊       | 10488/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.11.down_proj:  29%|██▊       | 10489/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.12.gate_proj:  29%|██▊       | 10490/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.12.up_proj:  29%|██▊       | 10491/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.12.down_proj:  29%|██▊       | 10492/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.13.gate_proj:  29%|██▊       | 10493/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.13.up_proj:  29%|██▊       | 10494/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.13.down_proj:  29%|██▊       | 10495/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.14.gate_proj:  29%|██▊       | 10496/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.14.up_proj:  29%|██▊       | 10497/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.14.down_proj:  29%|██▊       | 10498/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.15.gate_proj:  29%|██▊       | 10499/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.15.up_proj:  29%|██▊       | 10500/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.15.down_proj:  29%|██▊       | 10501/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.16.gate_proj:  29%|██▊       | 10502/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.16.up_proj:  29%|██▊       | 10503/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.16.down_proj:  29%|██▊       | 10504/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.17.gate_proj:  29%|██▊       | 10505/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.17.up_proj:  29%|██▊       | 10506/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.17.down_proj:  29%|██▊       | 10507/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.18.gate_proj:  29%|██▊       | 10508/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.18.up_proj:  29%|██▊       | 10509/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.18.down_proj:  29%|██▊       | 10510/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.19.gate_proj:  29%|██▊       | 10511/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.19.up_proj:  29%|██▊       | 10512/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.19.down_proj:  29%|██▉       | 10513/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.20.gate_proj:  29%|██▉       | 10514/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.20.up_proj:  29%|██▉       | 10515/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.20.down_proj:  29%|██▉       | 10516/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.21.gate_proj:  29%|██▉       | 10517/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.21.up_proj:  29%|██▉       | 10518/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.21.down_proj:  29%|██▉       | 10519/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.22.gate_proj:  29%|██▉       | 10520/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.22.up_proj:  29%|██▉       | 10521/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.22.down_proj:  29%|██▉       | 10522/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.23.gate_proj:  29%|██▉       | 10523/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.23.up_proj:  29%|██▉       | 10524/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.23.down_proj:  29%|██▉       | 10525/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.24.gate_proj:  29%|██▉       | 10526/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.24.up_proj:  29%|██▉       | 10527/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.24.down_proj:  29%|██▉       | 10528/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.25.gate_proj:  29%|██▉       | 10529/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.25.up_proj:  29%|██▉       | 10530/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.25.down_proj:  29%|██▉       | 10531/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.26.gate_proj:  29%|██▉       | 10532/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.26.up_proj:  29%|██▉       | 10533/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.26.down_proj:  29%|██▉       | 10534/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.27.gate_proj:  29%|██▉       | 10535/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.27.up_proj:  29%|██▉       | 10536/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.27.down_proj:  29%|██▉       | 10537/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.28.gate_proj:  29%|██▉       | 10538/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.28.up_proj:  29%|██▉       | 10539/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.28.down_proj:  29%|██▉       | 10540/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.29.gate_proj:  29%|██▉       | 10541/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.29.up_proj:  29%|██▉       | 10542/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.29.down_proj:  29%|██▉       | 10543/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.30.gate_proj:  29%|██▉       | 10544/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.30.up_proj:  29%|██▉       | 10545/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.30.down_proj:  29%|██▉       | 10546/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.31.gate_proj:  29%|██▉       | 10547/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.31.up_proj:  29%|██▉       | 10548/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.31.down_proj:  29%|██▉       | 10549/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.32.gate_proj:  29%|██▉       | 10550/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.32.up_proj:  29%|██▉       | 10551/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.32.down_proj:  29%|██▉       | 10552/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.33.gate_proj:  29%|██▉       | 10553/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.33.up_proj:  29%|██▉       | 10554/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.33.down_proj:  29%|██▉       | 10555/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.34.gate_proj:  29%|██▉       | 10556/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.34.up_proj:  29%|██▉       | 10557/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.34.down_proj:  29%|██▉       | 10558/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.35.gate_proj:  29%|██▉       | 10559/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.35.up_proj:  29%|██▉       | 10560/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.35.down_proj:  29%|██▉       | 10561/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.36.gate_proj:  29%|██▉       | 10562/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.36.up_proj:  29%|██▉       | 10563/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.36.down_proj:  29%|██▉       | 10564/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.37.gate_proj:  29%|██▉       | 10565/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.37.up_proj:  29%|██▉       | 10566/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.37.down_proj:  29%|██▉       | 10567/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.38.gate_proj:  29%|██▉       | 10568/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.38.up_proj:  29%|██▉       | 10569/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.38.down_proj:  29%|██▉       | 10570/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.39.gate_proj:  29%|██▉       | 10571/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.39.up_proj:  29%|██▉       | 10572/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.39.down_proj:  29%|██▉       | 10573/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.40.gate_proj:  29%|██▉       | 10574/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.40.up_proj:  29%|██▉       | 10575/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.40.down_proj:  29%|██▉       | 10576/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.41.gate_proj:  29%|██▉       | 10577/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.41.up_proj:  29%|██▉       | 10578/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.41.down_proj:  29%|██▉       | 10579/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.42.gate_proj:  29%|██▉       | 10580/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.42.up_proj:  29%|██▉       | 10581/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.42.down_proj:  29%|██▉       | 10582/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.43.gate_proj:  29%|██▉       | 10583/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.43.up_proj:  29%|██▉       | 10584/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.43.down_proj:  29%|██▉       | 10585/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.44.gate_proj:  29%|██▉       | 10586/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.44.up_proj:  29%|██▉       | 10587/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.44.down_proj:  29%|██▉       | 10588/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.45.gate_proj:  29%|██▉       | 10589/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.45.up_proj:  29%|██▉       | 10590/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.45.down_proj:  29%|██▉       | 10591/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.46.gate_proj:  29%|██▉       | 10592/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.46.up_proj:  29%|██▉       | 10593/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.46.down_proj:  29%|██▉       | 10594/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.47.gate_proj:  29%|██▉       | 10595/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.47.up_proj:  29%|██▉       | 10596/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.47.down_proj:  29%|██▉       | 10597/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.48.gate_proj:  29%|██▉       | 10598/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.48.up_proj:  29%|██▉       | 10599/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.48.down_proj:  29%|██▉       | 10600/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.49.gate_proj:  29%|██▉       | 10601/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.49.up_proj:  29%|██▉       | 10602/36566 [00:10<00:22, 1162.75it/s]  
packing model.layers.26.mlp.experts.49.down_proj:  29%|██▉       | 10603/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.50.gate_proj:  29%|██▉       | 10604/36566 [00:10<00:22, 1162.75it/s]
packing model.layers.26.mlp.experts.50.gate_proj:  29%|██▉       | 10605/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.50.up_proj:  29%|██▉       | 10605/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.50.down_proj:  29%|██▉       | 10606/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.51.gate_proj:  29%|██▉       | 10607/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.51.up_proj:  29%|██▉       | 10608/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.51.down_proj:  29%|██▉       | 10609/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.52.gate_proj:  29%|██▉       | 10610/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.52.up_proj:  29%|██▉       | 10611/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.52.down_proj:  29%|██▉       | 10612/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.53.gate_proj:  29%|██▉       | 10613/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.53.up_proj:  29%|██▉       | 10614/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.53.down_proj:  29%|██▉       | 10615/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.54.gate_proj:  29%|██▉       | 10616/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.54.up_proj:  29%|██▉       | 10617/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.54.down_proj:  29%|██▉       | 10618/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.55.gate_proj:  29%|██▉       | 10619/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.55.up_proj:  29%|██▉       | 10620/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.55.down_proj:  29%|██▉       | 10621/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.56.gate_proj:  29%|██▉       | 10622/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.56.up_proj:  29%|██▉       | 10623/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.56.down_proj:  29%|██▉       | 10624/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.57.gate_proj:  29%|██▉       | 10625/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.57.up_proj:  29%|██▉       | 10626/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.57.down_proj:  29%|██▉       | 10627/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.58.gate_proj:  29%|██▉       | 10628/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.58.up_proj:  29%|██▉       | 10629/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.58.down_proj:  29%|██▉       | 10630/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.59.gate_proj:  29%|██▉       | 10631/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.59.up_proj:  29%|██▉       | 10632/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.59.down_proj:  29%|██▉       | 10633/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.60.gate_proj:  29%|██▉       | 10634/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.60.up_proj:  29%|██▉       | 10635/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.60.down_proj:  29%|██▉       | 10636/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.61.gate_proj:  29%|██▉       | 10637/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.61.up_proj:  29%|██▉       | 10638/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.61.down_proj:  29%|██▉       | 10639/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.62.gate_proj:  29%|██▉       | 10640/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.62.up_proj:  29%|██▉       | 10641/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.62.down_proj:  29%|██▉       | 10642/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.63.gate_proj:  29%|██▉       | 10643/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.63.up_proj:  29%|██▉       | 10644/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.63.down_proj:  29%|██▉       | 10645/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.64.gate_proj:  29%|██▉       | 10646/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.64.up_proj:  29%|██▉       | 10647/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.64.down_proj:  29%|██▉       | 10648/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.65.gate_proj:  29%|██▉       | 10649/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.65.up_proj:  29%|██▉       | 10650/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.65.down_proj:  29%|██▉       | 10651/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.66.gate_proj:  29%|██▉       | 10652/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.66.up_proj:  29%|██▉       | 10653/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.66.down_proj:  29%|██▉       | 10654/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.67.gate_proj:  29%|██▉       | 10655/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.67.up_proj:  29%|██▉       | 10656/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.67.down_proj:  29%|██▉       | 10657/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.68.gate_proj:  29%|██▉       | 10658/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.68.up_proj:  29%|██▉       | 10659/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.68.down_proj:  29%|██▉       | 10660/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.69.gate_proj:  29%|██▉       | 10661/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.69.up_proj:  29%|██▉       | 10662/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.69.down_proj:  29%|██▉       | 10663/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.70.gate_proj:  29%|██▉       | 10664/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.70.up_proj:  29%|██▉       | 10665/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.70.down_proj:  29%|██▉       | 10666/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.71.gate_proj:  29%|██▉       | 10667/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.71.up_proj:  29%|██▉       | 10668/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.71.down_proj:  29%|██▉       | 10669/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.72.gate_proj:  29%|██▉       | 10670/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.72.up_proj:  29%|██▉       | 10671/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.72.down_proj:  29%|██▉       | 10672/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.73.gate_proj:  29%|██▉       | 10673/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.73.up_proj:  29%|██▉       | 10674/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.73.down_proj:  29%|██▉       | 10675/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.74.gate_proj:  29%|██▉       | 10676/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.74.up_proj:  29%|██▉       | 10677/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.74.down_proj:  29%|██▉       | 10678/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.75.gate_proj:  29%|██▉       | 10679/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.75.up_proj:  29%|██▉       | 10680/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.75.down_proj:  29%|██▉       | 10681/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.76.gate_proj:  29%|██▉       | 10682/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.76.up_proj:  29%|██▉       | 10683/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.76.down_proj:  29%|██▉       | 10684/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.77.gate_proj:  29%|██▉       | 10685/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.77.up_proj:  29%|██▉       | 10686/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.77.down_proj:  29%|██▉       | 10687/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.78.gate_proj:  29%|██▉       | 10688/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.78.up_proj:  29%|██▉       | 10689/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.78.down_proj:  29%|██▉       | 10690/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.79.gate_proj:  29%|██▉       | 10691/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.79.up_proj:  29%|██▉       | 10692/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.79.down_proj:  29%|██▉       | 10693/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.80.gate_proj:  29%|██▉       | 10694/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.80.up_proj:  29%|██▉       | 10695/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.80.down_proj:  29%|██▉       | 10696/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.81.gate_proj:  29%|██▉       | 10697/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.81.up_proj:  29%|██▉       | 10698/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.81.down_proj:  29%|██▉       | 10699/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.82.gate_proj:  29%|██▉       | 10700/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.82.up_proj:  29%|██▉       | 10701/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.82.down_proj:  29%|██▉       | 10702/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.83.gate_proj:  29%|██▉       | 10703/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.83.up_proj:  29%|██▉       | 10704/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.83.down_proj:  29%|██▉       | 10705/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.84.gate_proj:  29%|██▉       | 10706/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.84.up_proj:  29%|██▉       | 10707/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.84.down_proj:  29%|██▉       | 10708/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.85.gate_proj:  29%|██▉       | 10709/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.85.up_proj:  29%|██▉       | 10710/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.85.down_proj:  29%|██▉       | 10711/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.86.gate_proj:  29%|██▉       | 10712/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.86.up_proj:  29%|██▉       | 10713/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.86.down_proj:  29%|██▉       | 10714/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.87.gate_proj:  29%|██▉       | 10715/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.87.up_proj:  29%|██▉       | 10716/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.87.down_proj:  29%|██▉       | 10717/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.88.gate_proj:  29%|██▉       | 10718/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.88.up_proj:  29%|██▉       | 10719/36566 [00:10<00:22, 1163.24it/s]  
packing model.layers.26.mlp.experts.88.down_proj:  29%|██▉       | 10720/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.89.gate_proj:  29%|██▉       | 10721/36566 [00:10<00:22, 1163.24it/s]
packing model.layers.26.mlp.experts.89.gate_proj:  29%|██▉       | 10722/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.89.up_proj:  29%|██▉       | 10722/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.89.down_proj:  29%|██▉       | 10723/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.90.gate_proj:  29%|██▉       | 10724/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.90.up_proj:  29%|██▉       | 10725/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.90.down_proj:  29%|██▉       | 10726/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.91.gate_proj:  29%|██▉       | 10727/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.91.up_proj:  29%|██▉       | 10728/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.91.down_proj:  29%|██▉       | 10729/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.92.gate_proj:  29%|██▉       | 10730/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.92.up_proj:  29%|██▉       | 10731/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.92.down_proj:  29%|██▉       | 10732/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.93.gate_proj:  29%|██▉       | 10733/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.93.up_proj:  29%|██▉       | 10734/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.93.down_proj:  29%|██▉       | 10735/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.94.gate_proj:  29%|██▉       | 10736/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.94.up_proj:  29%|██▉       | 10737/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.94.down_proj:  29%|██▉       | 10738/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.95.gate_proj:  29%|██▉       | 10739/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.95.up_proj:  29%|██▉       | 10740/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.95.down_proj:  29%|██▉       | 10741/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.96.gate_proj:  29%|██▉       | 10742/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.96.up_proj:  29%|██▉       | 10743/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.96.down_proj:  29%|██▉       | 10744/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.97.gate_proj:  29%|██▉       | 10745/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.97.up_proj:  29%|██▉       | 10746/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.97.down_proj:  29%|██▉       | 10747/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.98.gate_proj:  29%|██▉       | 10748/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.98.up_proj:  29%|██▉       | 10749/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.98.down_proj:  29%|██▉       | 10750/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.99.gate_proj:  29%|██▉       | 10751/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.99.up_proj:  29%|██▉       | 10752/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.99.down_proj:  29%|██▉       | 10753/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.100.gate_proj:  29%|██▉       | 10754/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.100.up_proj:  29%|██▉       | 10755/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.100.down_proj:  29%|██▉       | 10756/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.101.gate_proj:  29%|██▉       | 10757/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.101.up_proj:  29%|██▉       | 10758/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.101.down_proj:  29%|██▉       | 10759/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.102.gate_proj:  29%|██▉       | 10760/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.102.up_proj:  29%|██▉       | 10761/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.102.down_proj:  29%|██▉       | 10762/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.103.gate_proj:  29%|██▉       | 10763/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.103.up_proj:  29%|██▉       | 10764/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.103.down_proj:  29%|██▉       | 10765/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.104.gate_proj:  29%|██▉       | 10766/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.104.up_proj:  29%|██▉       | 10767/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.104.down_proj:  29%|██▉       | 10768/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.105.gate_proj:  29%|██▉       | 10769/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.105.up_proj:  29%|██▉       | 10770/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.105.down_proj:  29%|██▉       | 10771/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.106.gate_proj:  29%|██▉       | 10772/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.106.up_proj:  29%|██▉       | 10773/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.106.down_proj:  29%|██▉       | 10774/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.107.gate_proj:  29%|██▉       | 10775/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.107.up_proj:  29%|██▉       | 10776/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.107.down_proj:  29%|██▉       | 10777/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.108.gate_proj:  29%|██▉       | 10778/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.108.up_proj:  29%|██▉       | 10779/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.108.down_proj:  29%|██▉       | 10780/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.109.gate_proj:  29%|██▉       | 10781/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.109.up_proj:  29%|██▉       | 10782/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.109.down_proj:  29%|██▉       | 10783/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.110.gate_proj:  29%|██▉       | 10784/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.110.up_proj:  29%|██▉       | 10785/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.110.down_proj:  29%|██▉       | 10786/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.111.gate_proj:  30%|██▉       | 10787/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.111.up_proj:  30%|██▉       | 10788/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.111.down_proj:  30%|██▉       | 10789/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.112.gate_proj:  30%|██▉       | 10790/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.112.up_proj:  30%|██▉       | 10791/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.112.down_proj:  30%|██▉       | 10792/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.113.gate_proj:  30%|██▉       | 10793/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.113.up_proj:  30%|██▉       | 10794/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.113.down_proj:  30%|██▉       | 10795/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.114.gate_proj:  30%|██▉       | 10796/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.114.up_proj:  30%|██▉       | 10797/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.114.down_proj:  30%|██▉       | 10798/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.115.gate_proj:  30%|██▉       | 10799/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.115.up_proj:  30%|██▉       | 10800/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.115.down_proj:  30%|██▉       | 10801/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.116.gate_proj:  30%|██▉       | 10802/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.116.up_proj:  30%|██▉       | 10803/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.116.down_proj:  30%|██▉       | 10804/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.117.gate_proj:  30%|██▉       | 10805/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.117.up_proj:  30%|██▉       | 10806/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.117.down_proj:  30%|██▉       | 10807/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.118.gate_proj:  30%|██▉       | 10808/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.118.up_proj:  30%|██▉       | 10809/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.118.down_proj:  30%|██▉       | 10810/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.119.gate_proj:  30%|██▉       | 10811/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.119.up_proj:  30%|██▉       | 10812/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.119.down_proj:  30%|██▉       | 10813/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.120.gate_proj:  30%|██▉       | 10814/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.120.up_proj:  30%|██▉       | 10815/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.120.down_proj:  30%|██▉       | 10816/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.121.gate_proj:  30%|██▉       | 10817/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.121.up_proj:  30%|██▉       | 10818/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.121.down_proj:  30%|██▉       | 10819/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.122.gate_proj:  30%|██▉       | 10820/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.122.up_proj:  30%|██▉       | 10821/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.122.down_proj:  30%|██▉       | 10822/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.123.gate_proj:  30%|██▉       | 10823/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.123.up_proj:  30%|██▉       | 10824/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.123.down_proj:  30%|██▉       | 10825/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.124.gate_proj:  30%|██▉       | 10826/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.124.up_proj:  30%|██▉       | 10827/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.124.down_proj:  30%|██▉       | 10828/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.125.gate_proj:  30%|██▉       | 10829/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.125.up_proj:  30%|██▉       | 10830/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.125.down_proj:  30%|██▉       | 10831/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.126.gate_proj:  30%|██▉       | 10832/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.126.up_proj:  30%|██▉       | 10833/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.126.down_proj:  30%|██▉       | 10834/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.127.gate_proj:  30%|██▉       | 10835/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.26.mlp.experts.127.up_proj:  30%|██▉       | 10836/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.26.mlp.experts.127.down_proj:  30%|██▉       | 10837/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.27.mlp.experts.0.gate_proj:  30%|██▉       | 10838/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.27.mlp.experts.0.up_proj:  30%|██▉       | 10839/36566 [00:10<00:22, 1164.63it/s]  
packing model.layers.27.mlp.experts.0.down_proj:  30%|██▉       | 10840/36566 [00:10<00:22, 1164.63it/s]
packing model.layers.27.mlp.experts.0.down_proj:  30%|██▉       | 10841/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.1.gate_proj:  30%|██▉       | 10841/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.1.up_proj:  30%|██▉       | 10842/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.1.down_proj:  30%|██▉       | 10843/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.2.gate_proj:  30%|██▉       | 10844/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.2.up_proj:  30%|██▉       | 10845/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.2.down_proj:  30%|██▉       | 10846/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.3.gate_proj:  30%|██▉       | 10847/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.3.up_proj:  30%|██▉       | 10848/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.3.down_proj:  30%|██▉       | 10849/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.4.gate_proj:  30%|██▉       | 10850/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.4.up_proj:  30%|██▉       | 10851/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.4.down_proj:  30%|██▉       | 10852/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.5.gate_proj:  30%|██▉       | 10853/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.5.up_proj:  30%|██▉       | 10854/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.5.down_proj:  30%|██▉       | 10855/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.6.gate_proj:  30%|██▉       | 10856/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.6.up_proj:  30%|██▉       | 10857/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.6.down_proj:  30%|██▉       | 10858/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.7.gate_proj:  30%|██▉       | 10859/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.7.up_proj:  30%|██▉       | 10860/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.7.down_proj:  30%|██▉       | 10861/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.8.gate_proj:  30%|██▉       | 10862/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.8.up_proj:  30%|██▉       | 10863/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.8.down_proj:  30%|██▉       | 10864/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.9.gate_proj:  30%|██▉       | 10865/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.9.up_proj:  30%|██▉       | 10866/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.9.down_proj:  30%|██▉       | 10867/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.10.gate_proj:  30%|██▉       | 10868/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.10.up_proj:  30%|██▉       | 10869/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.10.down_proj:  30%|██▉       | 10870/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.11.gate_proj:  30%|██▉       | 10871/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.11.up_proj:  30%|██▉       | 10872/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.11.down_proj:  30%|██▉       | 10873/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.12.gate_proj:  30%|██▉       | 10874/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.12.up_proj:  30%|██▉       | 10875/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.12.down_proj:  30%|██▉       | 10876/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.13.gate_proj:  30%|██▉       | 10877/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.13.up_proj:  30%|██▉       | 10878/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.13.down_proj:  30%|██▉       | 10879/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.14.gate_proj:  30%|██▉       | 10880/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.14.up_proj:  30%|██▉       | 10881/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.14.down_proj:  30%|██▉       | 10882/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.15.gate_proj:  30%|██▉       | 10883/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.15.up_proj:  30%|██▉       | 10884/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.15.down_proj:  30%|██▉       | 10885/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.16.gate_proj:  30%|██▉       | 10886/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.16.up_proj:  30%|██▉       | 10887/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.16.down_proj:  30%|██▉       | 10888/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.17.gate_proj:  30%|██▉       | 10889/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.17.up_proj:  30%|██▉       | 10890/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.17.down_proj:  30%|██▉       | 10891/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.18.gate_proj:  30%|██▉       | 10892/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.18.up_proj:  30%|██▉       | 10893/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.18.down_proj:  30%|██▉       | 10894/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.19.gate_proj:  30%|██▉       | 10895/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.19.up_proj:  30%|██▉       | 10896/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.19.down_proj:  30%|██▉       | 10897/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.20.gate_proj:  30%|██▉       | 10898/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.20.up_proj:  30%|██▉       | 10899/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.20.down_proj:  30%|██▉       | 10900/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.21.gate_proj:  30%|██▉       | 10901/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.21.up_proj:  30%|██▉       | 10902/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.21.down_proj:  30%|██▉       | 10903/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.22.gate_proj:  30%|██▉       | 10904/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.22.up_proj:  30%|██▉       | 10905/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.22.down_proj:  30%|██▉       | 10906/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.23.gate_proj:  30%|██▉       | 10907/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.23.up_proj:  30%|██▉       | 10908/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.23.down_proj:  30%|██▉       | 10909/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.24.gate_proj:  30%|██▉       | 10910/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.24.up_proj:  30%|██▉       | 10911/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.24.down_proj:  30%|██▉       | 10912/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.25.gate_proj:  30%|██▉       | 10913/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.25.up_proj:  30%|██▉       | 10914/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.25.down_proj:  30%|██▉       | 10915/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.26.gate_proj:  30%|██▉       | 10916/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.26.up_proj:  30%|██▉       | 10917/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.26.down_proj:  30%|██▉       | 10918/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.27.gate_proj:  30%|██▉       | 10919/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.27.up_proj:  30%|██▉       | 10920/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.27.down_proj:  30%|██▉       | 10921/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.28.gate_proj:  30%|██▉       | 10922/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.28.up_proj:  30%|██▉       | 10923/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.28.down_proj:  30%|██▉       | 10924/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.29.gate_proj:  30%|██▉       | 10925/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.29.up_proj:  30%|██▉       | 10926/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.29.down_proj:  30%|██▉       | 10927/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.30.gate_proj:  30%|██▉       | 10928/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.30.up_proj:  30%|██▉       | 10929/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.30.down_proj:  30%|██▉       | 10930/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.31.gate_proj:  30%|██▉       | 10931/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.31.up_proj:  30%|██▉       | 10932/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.31.down_proj:  30%|██▉       | 10933/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.32.gate_proj:  30%|██▉       | 10934/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.32.up_proj:  30%|██▉       | 10935/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.32.down_proj:  30%|██▉       | 10936/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.33.gate_proj:  30%|██▉       | 10937/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.33.up_proj:  30%|██▉       | 10938/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.33.down_proj:  30%|██▉       | 10939/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.34.gate_proj:  30%|██▉       | 10940/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.34.up_proj:  30%|██▉       | 10941/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.34.down_proj:  30%|██▉       | 10942/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.35.gate_proj:  30%|██▉       | 10943/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.35.up_proj:  30%|██▉       | 10944/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.35.down_proj:  30%|██▉       | 10945/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.36.gate_proj:  30%|██▉       | 10946/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.36.up_proj:  30%|██▉       | 10947/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.36.down_proj:  30%|██▉       | 10948/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.37.gate_proj:  30%|██▉       | 10949/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.37.up_proj:  30%|██▉       | 10950/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.37.down_proj:  30%|██▉       | 10951/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.38.gate_proj:  30%|██▉       | 10952/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.38.up_proj:  30%|██▉       | 10953/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.38.down_proj:  30%|██▉       | 10954/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.39.gate_proj:  30%|██▉       | 10955/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.39.up_proj:  30%|██▉       | 10956/36566 [00:10<00:21, 1169.64it/s]  
packing model.layers.27.mlp.experts.39.down_proj:  30%|██▉       | 10957/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.40.gate_proj:  30%|██▉       | 10958/36566 [00:10<00:21, 1169.64it/s]
packing model.layers.27.mlp.experts.40.gate_proj:  30%|██▉       | 10959/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.40.up_proj:  30%|██▉       | 10959/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.40.down_proj:  30%|██▉       | 10960/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.41.gate_proj:  30%|██▉       | 10961/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.41.up_proj:  30%|██▉       | 10962/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.41.down_proj:  30%|██▉       | 10963/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.42.gate_proj:  30%|██▉       | 10964/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.42.up_proj:  30%|██▉       | 10965/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.42.down_proj:  30%|██▉       | 10966/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.43.gate_proj:  30%|██▉       | 10967/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.43.up_proj:  30%|██▉       | 10968/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.43.down_proj:  30%|██▉       | 10969/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.44.gate_proj:  30%|███       | 10970/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.44.up_proj:  30%|███       | 10971/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.44.down_proj:  30%|███       | 10972/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.45.gate_proj:  30%|███       | 10973/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.45.up_proj:  30%|███       | 10974/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.45.down_proj:  30%|███       | 10975/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.46.gate_proj:  30%|███       | 10976/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.46.up_proj:  30%|███       | 10977/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.46.down_proj:  30%|███       | 10978/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.47.gate_proj:  30%|███       | 10979/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.47.up_proj:  30%|███       | 10980/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.47.down_proj:  30%|███       | 10981/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.48.gate_proj:  30%|███       | 10982/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.48.up_proj:  30%|███       | 10983/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.48.down_proj:  30%|███       | 10984/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.49.gate_proj:  30%|███       | 10985/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.49.up_proj:  30%|███       | 10986/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.49.down_proj:  30%|███       | 10987/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.50.gate_proj:  30%|███       | 10988/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.50.up_proj:  30%|███       | 10989/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.50.down_proj:  30%|███       | 10990/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.51.gate_proj:  30%|███       | 10991/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.51.up_proj:  30%|███       | 10992/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.51.down_proj:  30%|███       | 10993/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.52.gate_proj:  30%|███       | 10994/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.52.up_proj:  30%|███       | 10995/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.52.down_proj:  30%|███       | 10996/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.53.gate_proj:  30%|███       | 10997/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.53.up_proj:  30%|███       | 10998/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.53.down_proj:  30%|███       | 10999/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.54.gate_proj:  30%|███       | 11000/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.54.up_proj:  30%|███       | 11001/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.54.down_proj:  30%|███       | 11002/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.55.gate_proj:  30%|███       | 11003/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.55.up_proj:  30%|███       | 11004/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.55.down_proj:  30%|███       | 11005/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.56.gate_proj:  30%|███       | 11006/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.56.up_proj:  30%|███       | 11007/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.56.down_proj:  30%|███       | 11008/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.57.gate_proj:  30%|███       | 11009/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.57.up_proj:  30%|███       | 11010/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.57.down_proj:  30%|███       | 11011/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.58.gate_proj:  30%|███       | 11012/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.58.up_proj:  30%|███       | 11013/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.58.down_proj:  30%|███       | 11014/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.59.gate_proj:  30%|███       | 11015/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.59.up_proj:  30%|███       | 11016/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.59.down_proj:  30%|███       | 11017/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.60.gate_proj:  30%|███       | 11018/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.60.up_proj:  30%|███       | 11019/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.60.down_proj:  30%|███       | 11020/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.61.gate_proj:  30%|███       | 11021/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.61.up_proj:  30%|███       | 11022/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.61.down_proj:  30%|███       | 11023/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.62.gate_proj:  30%|███       | 11024/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.62.up_proj:  30%|███       | 11025/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.62.down_proj:  30%|███       | 11026/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.63.gate_proj:  30%|███       | 11027/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.63.up_proj:  30%|███       | 11028/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.63.down_proj:  30%|███       | 11029/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.64.gate_proj:  30%|███       | 11030/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.64.up_proj:  30%|███       | 11031/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.64.down_proj:  30%|███       | 11032/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.65.gate_proj:  30%|███       | 11033/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.65.up_proj:  30%|███       | 11034/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.65.down_proj:  30%|███       | 11035/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.66.gate_proj:  30%|███       | 11036/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.66.up_proj:  30%|███       | 11037/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.66.down_proj:  30%|███       | 11038/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.67.gate_proj:  30%|███       | 11039/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.67.up_proj:  30%|███       | 11040/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.67.down_proj:  30%|███       | 11041/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.68.gate_proj:  30%|███       | 11042/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.68.up_proj:  30%|███       | 11043/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.68.down_proj:  30%|███       | 11044/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.69.gate_proj:  30%|███       | 11045/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.69.up_proj:  30%|███       | 11046/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.69.down_proj:  30%|███       | 11047/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.70.gate_proj:  30%|███       | 11048/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.70.up_proj:  30%|███       | 11049/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.70.down_proj:  30%|███       | 11050/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.71.gate_proj:  30%|███       | 11051/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.71.up_proj:  30%|███       | 11052/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.71.down_proj:  30%|███       | 11053/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.72.gate_proj:  30%|███       | 11054/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.72.up_proj:  30%|███       | 11055/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.72.down_proj:  30%|███       | 11056/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.73.gate_proj:  30%|███       | 11057/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.73.up_proj:  30%|███       | 11058/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.73.down_proj:  30%|███       | 11059/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.74.gate_proj:  30%|███       | 11060/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.74.up_proj:  30%|███       | 11061/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.74.down_proj:  30%|███       | 11062/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.75.gate_proj:  30%|███       | 11063/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.75.up_proj:  30%|███       | 11064/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.75.down_proj:  30%|███       | 11065/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.76.gate_proj:  30%|███       | 11066/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.76.up_proj:  30%|███       | 11067/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.76.down_proj:  30%|███       | 11068/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.77.gate_proj:  30%|███       | 11069/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.77.up_proj:  30%|███       | 11070/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.77.down_proj:  30%|███       | 11071/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.78.gate_proj:  30%|███       | 11072/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.78.up_proj:  30%|███       | 11073/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.78.down_proj:  30%|███       | 11074/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.79.gate_proj:  30%|███       | 11075/36566 [00:10<00:21, 1170.71it/s]
packing model.layers.27.mlp.experts.79.up_proj:  30%|███       | 11076/36566 [00:10<00:21, 1170.71it/s]  
packing model.layers.27.mlp.experts.79.up_proj:  30%|███       | 11077/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.79.down_proj:  30%|███       | 11077/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.80.gate_proj:  30%|███       | 11078/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.80.up_proj:  30%|███       | 11079/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.80.down_proj:  30%|███       | 11080/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.81.gate_proj:  30%|███       | 11081/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.81.up_proj:  30%|███       | 11082/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.81.down_proj:  30%|███       | 11083/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.82.gate_proj:  30%|███       | 11084/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.82.up_proj:  30%|███       | 11085/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.82.down_proj:  30%|███       | 11086/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.83.gate_proj:  30%|███       | 11087/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.83.up_proj:  30%|███       | 11088/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.83.down_proj:  30%|███       | 11089/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.84.gate_proj:  30%|███       | 11090/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.84.up_proj:  30%|███       | 11091/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.84.down_proj:  30%|███       | 11092/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.85.gate_proj:  30%|███       | 11093/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.85.up_proj:  30%|███       | 11094/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.85.down_proj:  30%|███       | 11095/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.86.gate_proj:  30%|███       | 11096/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.86.up_proj:  30%|███       | 11097/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.86.down_proj:  30%|███       | 11098/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.87.gate_proj:  30%|███       | 11099/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.87.up_proj:  30%|███       | 11100/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.87.down_proj:  30%|███       | 11101/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.88.gate_proj:  30%|███       | 11102/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.88.up_proj:  30%|███       | 11103/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.88.down_proj:  30%|███       | 11104/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.89.gate_proj:  30%|███       | 11105/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.89.up_proj:  30%|███       | 11106/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.89.down_proj:  30%|███       | 11107/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.90.gate_proj:  30%|███       | 11108/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.90.up_proj:  30%|███       | 11109/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.90.down_proj:  30%|███       | 11110/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.91.gate_proj:  30%|███       | 11111/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.91.up_proj:  30%|███       | 11112/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.91.down_proj:  30%|███       | 11113/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.92.gate_proj:  30%|███       | 11114/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.92.up_proj:  30%|███       | 11115/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.92.down_proj:  30%|███       | 11116/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.93.gate_proj:  30%|███       | 11117/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.93.up_proj:  30%|███       | 11118/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.93.down_proj:  30%|███       | 11119/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.94.gate_proj:  30%|███       | 11120/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.94.up_proj:  30%|███       | 11121/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.94.down_proj:  30%|███       | 11122/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.95.gate_proj:  30%|███       | 11123/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.95.up_proj:  30%|███       | 11124/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.95.down_proj:  30%|███       | 11125/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.96.gate_proj:  30%|███       | 11126/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.96.up_proj:  30%|███       | 11127/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.96.down_proj:  30%|███       | 11128/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.97.gate_proj:  30%|███       | 11129/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.97.up_proj:  30%|███       | 11130/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.97.down_proj:  30%|███       | 11131/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.98.gate_proj:  30%|███       | 11132/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.98.up_proj:  30%|███       | 11133/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.98.down_proj:  30%|███       | 11134/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.99.gate_proj:  30%|███       | 11135/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.99.up_proj:  30%|███       | 11136/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.99.down_proj:  30%|███       | 11137/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.100.gate_proj:  30%|███       | 11138/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.100.up_proj:  30%|███       | 11139/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.100.down_proj:  30%|███       | 11140/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.101.gate_proj:  30%|███       | 11141/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.101.up_proj:  30%|███       | 11142/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.101.down_proj:  30%|███       | 11143/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.102.gate_proj:  30%|███       | 11144/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.102.up_proj:  30%|███       | 11145/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.102.down_proj:  30%|███       | 11146/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.103.gate_proj:  30%|███       | 11147/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.103.up_proj:  30%|███       | 11148/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.103.down_proj:  30%|███       | 11149/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.104.gate_proj:  30%|███       | 11150/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.104.up_proj:  30%|███       | 11151/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.104.down_proj:  30%|███       | 11152/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.105.gate_proj:  31%|███       | 11153/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.105.up_proj:  31%|███       | 11154/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.105.down_proj:  31%|███       | 11155/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.106.gate_proj:  31%|███       | 11156/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.106.up_proj:  31%|███       | 11157/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.106.down_proj:  31%|███       | 11158/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.107.gate_proj:  31%|███       | 11159/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.107.up_proj:  31%|███       | 11160/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.107.down_proj:  31%|███       | 11161/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.108.gate_proj:  31%|███       | 11162/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.108.up_proj:  31%|███       | 11163/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.108.down_proj:  31%|███       | 11164/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.109.gate_proj:  31%|███       | 11165/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.109.up_proj:  31%|███       | 11166/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.109.down_proj:  31%|███       | 11167/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.110.gate_proj:  31%|███       | 11168/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.110.up_proj:  31%|███       | 11169/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.110.down_proj:  31%|███       | 11170/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.111.gate_proj:  31%|███       | 11171/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.111.up_proj:  31%|███       | 11172/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.111.down_proj:  31%|███       | 11173/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.112.gate_proj:  31%|███       | 11174/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.112.up_proj:  31%|███       | 11175/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.112.down_proj:  31%|███       | 11176/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.113.gate_proj:  31%|███       | 11177/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.113.up_proj:  31%|███       | 11178/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.113.down_proj:  31%|███       | 11179/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.114.gate_proj:  31%|███       | 11180/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.114.up_proj:  31%|███       | 11181/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.114.down_proj:  31%|███       | 11182/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.115.gate_proj:  31%|███       | 11183/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.115.up_proj:  31%|███       | 11184/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.115.down_proj:  31%|███       | 11185/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.116.gate_proj:  31%|███       | 11186/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.116.up_proj:  31%|███       | 11187/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.116.down_proj:  31%|███       | 11188/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.117.gate_proj:  31%|███       | 11189/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.117.up_proj:  31%|███       | 11190/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.117.down_proj:  31%|███       | 11191/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.118.gate_proj:  31%|███       | 11192/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.118.up_proj:  31%|███       | 11193/36566 [00:10<00:21, 1171.26it/s]  
packing model.layers.27.mlp.experts.118.down_proj:  31%|███       | 11194/36566 [00:10<00:21, 1171.26it/s]
packing model.layers.27.mlp.experts.118.down_proj:  31%|███       | 11195/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.119.gate_proj:  31%|███       | 11195/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.119.up_proj:  31%|███       | 11196/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.119.down_proj:  31%|███       | 11197/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.120.gate_proj:  31%|███       | 11198/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.120.up_proj:  31%|███       | 11199/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.120.down_proj:  31%|███       | 11200/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.121.gate_proj:  31%|███       | 11201/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.121.up_proj:  31%|███       | 11202/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.121.down_proj:  31%|███       | 11203/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.122.gate_proj:  31%|███       | 11204/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.122.up_proj:  31%|███       | 11205/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.122.down_proj:  31%|███       | 11206/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.123.gate_proj:  31%|███       | 11207/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.123.up_proj:  31%|███       | 11208/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.123.down_proj:  31%|███       | 11209/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.124.gate_proj:  31%|███       | 11210/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.124.up_proj:  31%|███       | 11211/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.124.down_proj:  31%|███       | 11212/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.125.gate_proj:  31%|███       | 11213/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.125.up_proj:  31%|███       | 11214/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.125.down_proj:  31%|███       | 11215/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.126.gate_proj:  31%|███       | 11216/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.126.up_proj:  31%|███       | 11217/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.126.down_proj:  31%|███       | 11218/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.127.gate_proj:  31%|███       | 11219/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.27.mlp.experts.127.up_proj:  31%|███       | 11220/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.27.mlp.experts.127.down_proj:  31%|███       | 11221/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.0.gate_proj:  31%|███       | 11222/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.0.up_proj:  31%|███       | 11223/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.0.down_proj:  31%|███       | 11224/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.1.gate_proj:  31%|███       | 11225/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.1.up_proj:  31%|███       | 11226/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.1.down_proj:  31%|███       | 11227/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.2.gate_proj:  31%|███       | 11228/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.2.up_proj:  31%|███       | 11229/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.2.down_proj:  31%|███       | 11230/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.3.gate_proj:  31%|███       | 11231/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.3.up_proj:  31%|███       | 11232/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.3.down_proj:  31%|███       | 11233/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.4.gate_proj:  31%|███       | 11234/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.4.up_proj:  31%|███       | 11235/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.4.down_proj:  31%|███       | 11236/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.5.gate_proj:  31%|███       | 11237/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.5.up_proj:  31%|███       | 11238/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.5.down_proj:  31%|███       | 11239/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.6.gate_proj:  31%|███       | 11240/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.6.up_proj:  31%|███       | 11241/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.6.down_proj:  31%|███       | 11242/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.7.gate_proj:  31%|███       | 11243/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.7.up_proj:  31%|███       | 11244/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.7.down_proj:  31%|███       | 11245/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.8.gate_proj:  31%|███       | 11246/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.8.up_proj:  31%|███       | 11247/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.8.down_proj:  31%|███       | 11248/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.9.gate_proj:  31%|███       | 11249/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.9.up_proj:  31%|███       | 11250/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.9.down_proj:  31%|███       | 11251/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.10.gate_proj:  31%|███       | 11252/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.10.up_proj:  31%|███       | 11253/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.10.down_proj:  31%|███       | 11254/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.11.gate_proj:  31%|███       | 11255/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.11.up_proj:  31%|███       | 11256/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.11.down_proj:  31%|███       | 11257/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.12.gate_proj:  31%|███       | 11258/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.12.up_proj:  31%|███       | 11259/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.12.down_proj:  31%|███       | 11260/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.13.gate_proj:  31%|███       | 11261/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.13.up_proj:  31%|███       | 11262/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.13.down_proj:  31%|███       | 11263/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.14.gate_proj:  31%|███       | 11264/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.14.up_proj:  31%|███       | 11265/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.14.down_proj:  31%|███       | 11266/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.15.gate_proj:  31%|███       | 11267/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.15.up_proj:  31%|███       | 11268/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.15.down_proj:  31%|███       | 11269/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.16.gate_proj:  31%|███       | 11270/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.16.up_proj:  31%|███       | 11271/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.16.down_proj:  31%|███       | 11272/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.17.gate_proj:  31%|███       | 11273/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.17.up_proj:  31%|███       | 11274/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.17.down_proj:  31%|███       | 11275/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.18.gate_proj:  31%|███       | 11276/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.18.up_proj:  31%|███       | 11277/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.18.down_proj:  31%|███       | 11278/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.19.gate_proj:  31%|███       | 11279/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.19.up_proj:  31%|███       | 11280/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.19.down_proj:  31%|███       | 11281/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.20.gate_proj:  31%|███       | 11282/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.20.up_proj:  31%|███       | 11283/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.20.down_proj:  31%|███       | 11284/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.21.gate_proj:  31%|███       | 11285/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.21.up_proj:  31%|███       | 11286/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.21.down_proj:  31%|███       | 11287/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.22.gate_proj:  31%|███       | 11288/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.22.up_proj:  31%|███       | 11289/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.22.down_proj:  31%|███       | 11290/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.23.gate_proj:  31%|███       | 11291/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.23.up_proj:  31%|███       | 11292/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.23.down_proj:  31%|███       | 11293/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.24.gate_proj:  31%|███       | 11294/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.24.up_proj:  31%|███       | 11295/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.24.down_proj:  31%|███       | 11296/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.25.gate_proj:  31%|███       | 11297/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.25.up_proj:  31%|███       | 11298/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.25.down_proj:  31%|███       | 11299/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.26.gate_proj:  31%|███       | 11300/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.26.up_proj:  31%|███       | 11301/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.26.down_proj:  31%|███       | 11302/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.27.gate_proj:  31%|███       | 11303/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.27.up_proj:  31%|███       | 11304/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.27.down_proj:  31%|███       | 11305/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.28.gate_proj:  31%|███       | 11306/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.28.up_proj:  31%|███       | 11307/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.28.down_proj:  31%|███       | 11308/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.29.gate_proj:  31%|███       | 11309/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.29.up_proj:  31%|███       | 11310/36566 [00:10<00:21, 1172.96it/s]  
packing model.layers.28.mlp.experts.29.down_proj:  31%|███       | 11311/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.30.gate_proj:  31%|███       | 11312/36566 [00:10<00:21, 1172.96it/s]
packing model.layers.28.mlp.experts.30.gate_proj:  31%|███       | 11313/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.30.up_proj:  31%|███       | 11313/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.30.down_proj:  31%|███       | 11314/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.31.gate_proj:  31%|███       | 11315/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.31.up_proj:  31%|███       | 11316/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.31.down_proj:  31%|███       | 11317/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.32.gate_proj:  31%|███       | 11318/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.32.up_proj:  31%|███       | 11319/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.32.down_proj:  31%|███       | 11320/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.33.gate_proj:  31%|███       | 11321/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.33.up_proj:  31%|███       | 11322/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.33.down_proj:  31%|███       | 11323/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.34.gate_proj:  31%|███       | 11324/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.34.up_proj:  31%|███       | 11325/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.34.down_proj:  31%|███       | 11326/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.35.gate_proj:  31%|███       | 11327/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.35.up_proj:  31%|███       | 11328/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.35.down_proj:  31%|███       | 11329/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.36.gate_proj:  31%|███       | 11330/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.36.up_proj:  31%|███       | 11331/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.36.down_proj:  31%|███       | 11332/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.37.gate_proj:  31%|███       | 11333/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.37.up_proj:  31%|███       | 11334/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.37.down_proj:  31%|███       | 11335/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.38.gate_proj:  31%|███       | 11336/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.38.up_proj:  31%|███       | 11337/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.38.down_proj:  31%|███       | 11338/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.39.gate_proj:  31%|███       | 11339/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.39.up_proj:  31%|███       | 11340/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.39.down_proj:  31%|███       | 11341/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.40.gate_proj:  31%|███       | 11342/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.40.up_proj:  31%|███       | 11343/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.40.down_proj:  31%|███       | 11344/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.41.gate_proj:  31%|███       | 11345/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.41.up_proj:  31%|███       | 11346/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.41.down_proj:  31%|███       | 11347/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.42.gate_proj:  31%|███       | 11348/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.42.up_proj:  31%|███       | 11349/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.42.down_proj:  31%|███       | 11350/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.43.gate_proj:  31%|███       | 11351/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.43.up_proj:  31%|███       | 11352/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.43.down_proj:  31%|███       | 11353/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.44.gate_proj:  31%|███       | 11354/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.44.up_proj:  31%|███       | 11355/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.44.down_proj:  31%|███       | 11356/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.45.gate_proj:  31%|███       | 11357/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.45.up_proj:  31%|███       | 11358/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.45.down_proj:  31%|███       | 11359/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.46.gate_proj:  31%|███       | 11360/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.46.up_proj:  31%|███       | 11361/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.46.down_proj:  31%|███       | 11362/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.47.gate_proj:  31%|███       | 11363/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.47.up_proj:  31%|███       | 11364/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.47.down_proj:  31%|███       | 11365/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.48.gate_proj:  31%|███       | 11366/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.48.up_proj:  31%|███       | 11367/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.48.down_proj:  31%|███       | 11368/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.49.gate_proj:  31%|███       | 11369/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.49.up_proj:  31%|███       | 11370/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.49.down_proj:  31%|███       | 11371/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.50.gate_proj:  31%|███       | 11372/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.50.up_proj:  31%|███       | 11373/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.50.down_proj:  31%|███       | 11374/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.51.gate_proj:  31%|███       | 11375/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.51.up_proj:  31%|███       | 11376/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.51.down_proj:  31%|███       | 11377/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.52.gate_proj:  31%|███       | 11378/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.52.up_proj:  31%|███       | 11379/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.52.down_proj:  31%|███       | 11380/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.53.gate_proj:  31%|███       | 11381/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.53.up_proj:  31%|███       | 11382/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.53.down_proj:  31%|███       | 11383/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.54.gate_proj:  31%|███       | 11384/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.54.up_proj:  31%|███       | 11385/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.54.down_proj:  31%|███       | 11386/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.55.gate_proj:  31%|███       | 11387/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.55.up_proj:  31%|███       | 11388/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.55.down_proj:  31%|███       | 11389/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.56.gate_proj:  31%|███       | 11390/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.56.up_proj:  31%|███       | 11391/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.56.down_proj:  31%|███       | 11392/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.57.gate_proj:  31%|███       | 11393/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.57.up_proj:  31%|███       | 11394/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.57.down_proj:  31%|███       | 11395/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.58.gate_proj:  31%|███       | 11396/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.58.up_proj:  31%|███       | 11397/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.58.down_proj:  31%|███       | 11398/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.59.gate_proj:  31%|███       | 11399/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.59.up_proj:  31%|███       | 11400/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.59.down_proj:  31%|███       | 11401/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.60.gate_proj:  31%|███       | 11402/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.60.up_proj:  31%|███       | 11403/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.60.down_proj:  31%|███       | 11404/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.61.gate_proj:  31%|███       | 11405/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.61.up_proj:  31%|███       | 11406/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.61.down_proj:  31%|███       | 11407/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.62.gate_proj:  31%|███       | 11408/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.62.up_proj:  31%|███       | 11409/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.62.down_proj:  31%|███       | 11410/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.63.gate_proj:  31%|███       | 11411/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.63.up_proj:  31%|███       | 11412/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.63.down_proj:  31%|███       | 11413/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.64.gate_proj:  31%|███       | 11414/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.64.up_proj:  31%|███       | 11415/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.64.down_proj:  31%|███       | 11416/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.65.gate_proj:  31%|███       | 11417/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.65.up_proj:  31%|███       | 11418/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.65.down_proj:  31%|███       | 11419/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.66.gate_proj:  31%|███       | 11420/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.66.up_proj:  31%|███       | 11421/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.66.down_proj:  31%|███       | 11422/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.67.gate_proj:  31%|███       | 11423/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.67.up_proj:  31%|███       | 11424/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.67.down_proj:  31%|███       | 11425/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.68.gate_proj:  31%|███       | 11426/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.68.up_proj:  31%|███▏      | 11427/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.68.down_proj:  31%|███▏      | 11428/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.69.gate_proj:  31%|███▏      | 11429/36566 [00:10<00:21, 1172.71it/s]
packing model.layers.28.mlp.experts.69.up_proj:  31%|███▏      | 11430/36566 [00:10<00:21, 1172.71it/s]  
packing model.layers.28.mlp.experts.69.up_proj:  31%|███▏      | 11431/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.69.down_proj:  31%|███▏      | 11431/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.70.gate_proj:  31%|███▏      | 11432/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.70.up_proj:  31%|███▏      | 11433/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.70.down_proj:  31%|███▏      | 11434/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.71.gate_proj:  31%|███▏      | 11435/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.71.up_proj:  31%|███▏      | 11436/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.71.down_proj:  31%|███▏      | 11437/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.72.gate_proj:  31%|███▏      | 11438/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.72.up_proj:  31%|███▏      | 11439/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.72.down_proj:  31%|███▏      | 11440/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.73.gate_proj:  31%|███▏      | 11441/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.73.up_proj:  31%|███▏      | 11442/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.73.down_proj:  31%|███▏      | 11443/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.74.gate_proj:  31%|███▏      | 11444/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.74.up_proj:  31%|███▏      | 11445/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.74.down_proj:  31%|███▏      | 11446/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.75.gate_proj:  31%|███▏      | 11447/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.75.up_proj:  31%|███▏      | 11448/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.75.down_proj:  31%|███▏      | 11449/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.76.gate_proj:  31%|███▏      | 11450/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.76.up_proj:  31%|███▏      | 11451/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.76.down_proj:  31%|███▏      | 11452/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.77.gate_proj:  31%|███▏      | 11453/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.77.up_proj:  31%|███▏      | 11454/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.77.down_proj:  31%|███▏      | 11455/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.78.gate_proj:  31%|███▏      | 11456/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.78.up_proj:  31%|███▏      | 11457/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.78.down_proj:  31%|███▏      | 11458/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.79.gate_proj:  31%|███▏      | 11459/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.79.up_proj:  31%|███▏      | 11460/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.79.down_proj:  31%|███▏      | 11461/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.80.gate_proj:  31%|███▏      | 11462/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.80.up_proj:  31%|███▏      | 11463/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.80.down_proj:  31%|███▏      | 11464/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.81.gate_proj:  31%|███▏      | 11465/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.81.up_proj:  31%|███▏      | 11466/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.81.down_proj:  31%|███▏      | 11467/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.82.gate_proj:  31%|███▏      | 11468/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.82.up_proj:  31%|███▏      | 11469/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.82.down_proj:  31%|███▏      | 11470/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.83.gate_proj:  31%|███▏      | 11471/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.83.up_proj:  31%|███▏      | 11472/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.83.down_proj:  31%|███▏      | 11473/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.84.gate_proj:  31%|███▏      | 11474/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.84.up_proj:  31%|███▏      | 11475/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.84.down_proj:  31%|███▏      | 11476/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.85.gate_proj:  31%|███▏      | 11477/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.85.up_proj:  31%|███▏      | 11478/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.85.down_proj:  31%|███▏      | 11479/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.86.gate_proj:  31%|███▏      | 11480/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.86.up_proj:  31%|███▏      | 11481/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.86.down_proj:  31%|███▏      | 11482/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.87.gate_proj:  31%|███▏      | 11483/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.87.up_proj:  31%|███▏      | 11484/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.87.down_proj:  31%|███▏      | 11485/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.88.gate_proj:  31%|███▏      | 11486/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.88.up_proj:  31%|███▏      | 11487/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.88.down_proj:  31%|███▏      | 11488/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.89.gate_proj:  31%|███▏      | 11489/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.89.up_proj:  31%|███▏      | 11490/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.89.down_proj:  31%|███▏      | 11491/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.90.gate_proj:  31%|███▏      | 11492/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.90.up_proj:  31%|███▏      | 11493/36566 [00:10<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.90.down_proj:  31%|███▏      | 11494/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.91.gate_proj:  31%|███▏      | 11495/36566 [00:10<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.91.up_proj:  31%|███▏      | 11496/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.91.down_proj:  31%|███▏      | 11497/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.92.gate_proj:  31%|███▏      | 11498/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.92.up_proj:  31%|███▏      | 11499/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.92.down_proj:  31%|███▏      | 11500/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.93.gate_proj:  31%|███▏      | 11501/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.93.up_proj:  31%|███▏      | 11502/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.93.down_proj:  31%|███▏      | 11503/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.94.gate_proj:  31%|███▏      | 11504/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.94.up_proj:  31%|███▏      | 11505/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.94.down_proj:  31%|███▏      | 11506/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.95.gate_proj:  31%|███▏      | 11507/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.95.up_proj:  31%|███▏      | 11508/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.95.down_proj:  31%|███▏      | 11509/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.96.gate_proj:  31%|███▏      | 11510/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.96.up_proj:  31%|███▏      | 11511/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.96.down_proj:  31%|███▏      | 11512/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.97.gate_proj:  31%|███▏      | 11513/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.97.up_proj:  31%|███▏      | 11514/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.97.down_proj:  31%|███▏      | 11515/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.98.gate_proj:  31%|███▏      | 11516/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.98.up_proj:  31%|███▏      | 11517/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.98.down_proj:  31%|███▏      | 11518/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.99.gate_proj:  32%|███▏      | 11519/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.99.up_proj:  32%|███▏      | 11520/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.99.down_proj:  32%|███▏      | 11521/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.100.gate_proj:  32%|███▏      | 11522/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.100.up_proj:  32%|███▏      | 11523/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.100.down_proj:  32%|███▏      | 11524/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.101.gate_proj:  32%|███▏      | 11525/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.101.up_proj:  32%|███▏      | 11526/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.101.down_proj:  32%|███▏      | 11527/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.102.gate_proj:  32%|███▏      | 11528/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.102.up_proj:  32%|███▏      | 11529/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.102.down_proj:  32%|███▏      | 11530/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.103.gate_proj:  32%|███▏      | 11531/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.103.up_proj:  32%|███▏      | 11532/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.103.down_proj:  32%|███▏      | 11533/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.104.gate_proj:  32%|███▏      | 11534/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.104.up_proj:  32%|███▏      | 11535/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.104.down_proj:  32%|███▏      | 11536/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.105.gate_proj:  32%|███▏      | 11537/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.105.up_proj:  32%|███▏      | 11538/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.105.down_proj:  32%|███▏      | 11539/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.106.gate_proj:  32%|███▏      | 11540/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.106.up_proj:  32%|███▏      | 11541/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.106.down_proj:  32%|███▏      | 11542/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.107.gate_proj:  32%|███▏      | 11543/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.107.up_proj:  32%|███▏      | 11544/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.107.down_proj:  32%|███▏      | 11545/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.108.gate_proj:  32%|███▏      | 11546/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.108.up_proj:  32%|███▏      | 11547/36566 [00:11<00:21, 1171.08it/s]  
packing model.layers.28.mlp.experts.108.down_proj:  32%|███▏      | 11548/36566 [00:11<00:21, 1171.08it/s]
packing model.layers.28.mlp.experts.108.down_proj:  32%|███▏      | 11549/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.109.gate_proj:  32%|███▏      | 11549/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.109.up_proj:  32%|███▏      | 11550/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.109.down_proj:  32%|███▏      | 11551/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.110.gate_proj:  32%|███▏      | 11552/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.110.up_proj:  32%|███▏      | 11553/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.110.down_proj:  32%|███▏      | 11554/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.111.gate_proj:  32%|███▏      | 11555/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.111.up_proj:  32%|███▏      | 11556/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.111.down_proj:  32%|███▏      | 11557/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.112.gate_proj:  32%|███▏      | 11558/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.112.up_proj:  32%|███▏      | 11559/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.112.down_proj:  32%|███▏      | 11560/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.113.gate_proj:  32%|███▏      | 11561/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.113.up_proj:  32%|███▏      | 11562/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.113.down_proj:  32%|███▏      | 11563/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.114.gate_proj:  32%|███▏      | 11564/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.114.up_proj:  32%|███▏      | 11565/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.114.down_proj:  32%|███▏      | 11566/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.115.gate_proj:  32%|███▏      | 11567/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.115.up_proj:  32%|███▏      | 11568/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.115.down_proj:  32%|███▏      | 11569/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.116.gate_proj:  32%|███▏      | 11570/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.116.up_proj:  32%|███▏      | 11571/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.116.down_proj:  32%|███▏      | 11572/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.117.gate_proj:  32%|███▏      | 11573/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.117.up_proj:  32%|███▏      | 11574/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.117.down_proj:  32%|███▏      | 11575/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.118.gate_proj:  32%|███▏      | 11576/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.118.up_proj:  32%|███▏      | 11577/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.118.down_proj:  32%|███▏      | 11578/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.119.gate_proj:  32%|███▏      | 11579/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.119.up_proj:  32%|███▏      | 11580/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.119.down_proj:  32%|███▏      | 11581/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.120.gate_proj:  32%|███▏      | 11582/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.120.up_proj:  32%|███▏      | 11583/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.120.down_proj:  32%|███▏      | 11584/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.121.gate_proj:  32%|███▏      | 11585/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.121.up_proj:  32%|███▏      | 11586/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.121.down_proj:  32%|███▏      | 11587/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.122.gate_proj:  32%|███▏      | 11588/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.122.up_proj:  32%|███▏      | 11589/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.122.down_proj:  32%|███▏      | 11590/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.123.gate_proj:  32%|███▏      | 11591/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.123.up_proj:  32%|███▏      | 11592/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.123.down_proj:  32%|███▏      | 11593/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.124.gate_proj:  32%|███▏      | 11594/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.124.up_proj:  32%|███▏      | 11595/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.124.down_proj:  32%|███▏      | 11596/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.125.gate_proj:  32%|███▏      | 11597/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.125.up_proj:  32%|███▏      | 11598/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.125.down_proj:  32%|███▏      | 11599/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.126.gate_proj:  32%|███▏      | 11600/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.126.up_proj:  32%|███▏      | 11601/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.126.down_proj:  32%|███▏      | 11602/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.127.gate_proj:  32%|███▏      | 11603/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.28.mlp.experts.127.up_proj:  32%|███▏      | 11604/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.28.mlp.experts.127.down_proj:  32%|███▏      | 11605/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.0.gate_proj:  32%|███▏      | 11606/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.0.up_proj:  32%|███▏      | 11607/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.0.down_proj:  32%|███▏      | 11608/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.1.gate_proj:  32%|███▏      | 11609/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.1.up_proj:  32%|███▏      | 11610/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.1.down_proj:  32%|███▏      | 11611/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.2.gate_proj:  32%|███▏      | 11612/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.2.up_proj:  32%|███▏      | 11613/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.2.down_proj:  32%|███▏      | 11614/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.3.gate_proj:  32%|███▏      | 11615/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.3.up_proj:  32%|███▏      | 11616/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.3.down_proj:  32%|███▏      | 11617/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.4.gate_proj:  32%|███▏      | 11618/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.4.up_proj:  32%|███▏      | 11619/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.4.down_proj:  32%|███▏      | 11620/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.5.gate_proj:  32%|███▏      | 11621/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.5.up_proj:  32%|███▏      | 11622/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.5.down_proj:  32%|███▏      | 11623/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.6.gate_proj:  32%|███▏      | 11624/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.6.up_proj:  32%|███▏      | 11625/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.6.down_proj:  32%|███▏      | 11626/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.7.gate_proj:  32%|███▏      | 11627/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.7.up_proj:  32%|███▏      | 11628/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.7.down_proj:  32%|███▏      | 11629/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.8.gate_proj:  32%|███▏      | 11630/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.8.up_proj:  32%|███▏      | 11631/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.8.down_proj:  32%|███▏      | 11632/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.9.gate_proj:  32%|███▏      | 11633/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.9.up_proj:  32%|███▏      | 11634/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.9.down_proj:  32%|███▏      | 11635/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.10.gate_proj:  32%|███▏      | 11636/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.10.up_proj:  32%|███▏      | 11637/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.10.down_proj:  32%|███▏      | 11638/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.11.gate_proj:  32%|███▏      | 11639/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.11.up_proj:  32%|███▏      | 11640/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.11.down_proj:  32%|███▏      | 11641/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.12.gate_proj:  32%|███▏      | 11642/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.12.up_proj:  32%|███▏      | 11643/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.12.down_proj:  32%|███▏      | 11644/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.13.gate_proj:  32%|███▏      | 11645/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.13.up_proj:  32%|███▏      | 11646/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.13.down_proj:  32%|███▏      | 11647/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.14.gate_proj:  32%|███▏      | 11648/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.14.up_proj:  32%|███▏      | 11649/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.14.down_proj:  32%|███▏      | 11650/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.15.gate_proj:  32%|███▏      | 11651/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.15.up_proj:  32%|███▏      | 11652/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.15.down_proj:  32%|███▏      | 11653/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.16.gate_proj:  32%|███▏      | 11654/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.16.up_proj:  32%|███▏      | 11655/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.16.down_proj:  32%|███▏      | 11656/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.17.gate_proj:  32%|███▏      | 11657/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.17.up_proj:  32%|███▏      | 11658/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.17.down_proj:  32%|███▏      | 11659/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.18.gate_proj:  32%|███▏      | 11660/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.18.up_proj:  32%|███▏      | 11661/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.18.down_proj:  32%|███▏      | 11662/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.19.gate_proj:  32%|███▏      | 11663/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.19.up_proj:  32%|███▏      | 11664/36566 [00:11<00:21, 1166.47it/s]  
packing model.layers.29.mlp.experts.19.down_proj:  32%|███▏      | 11665/36566 [00:11<00:21, 1166.47it/s]
packing model.layers.29.mlp.experts.19.down_proj:  32%|███▏      | 11666/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.20.gate_proj:  32%|███▏      | 11666/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.20.up_proj:  32%|███▏      | 11667/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.20.down_proj:  32%|███▏      | 11668/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.21.gate_proj:  32%|███▏      | 11669/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.21.up_proj:  32%|███▏      | 11670/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.21.down_proj:  32%|███▏      | 11671/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.22.gate_proj:  32%|███▏      | 11672/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.22.up_proj:  32%|███▏      | 11673/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.22.down_proj:  32%|███▏      | 11674/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.23.gate_proj:  32%|███▏      | 11675/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.23.up_proj:  32%|███▏      | 11676/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.23.down_proj:  32%|███▏      | 11677/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.24.gate_proj:  32%|███▏      | 11678/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.24.up_proj:  32%|███▏      | 11679/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.24.down_proj:  32%|███▏      | 11680/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.25.gate_proj:  32%|███▏      | 11681/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.25.up_proj:  32%|███▏      | 11682/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.25.down_proj:  32%|███▏      | 11683/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.26.gate_proj:  32%|███▏      | 11684/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.26.up_proj:  32%|███▏      | 11685/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.26.down_proj:  32%|███▏      | 11686/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.27.gate_proj:  32%|███▏      | 11687/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.27.up_proj:  32%|███▏      | 11688/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.27.down_proj:  32%|███▏      | 11689/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.28.gate_proj:  32%|███▏      | 11690/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.28.up_proj:  32%|███▏      | 11691/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.28.down_proj:  32%|███▏      | 11692/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.29.gate_proj:  32%|███▏      | 11693/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.29.up_proj:  32%|███▏      | 11694/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.29.down_proj:  32%|███▏      | 11695/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.30.gate_proj:  32%|███▏      | 11696/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.30.up_proj:  32%|███▏      | 11697/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.30.down_proj:  32%|███▏      | 11698/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.31.gate_proj:  32%|███▏      | 11699/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.31.up_proj:  32%|███▏      | 11700/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.31.down_proj:  32%|███▏      | 11701/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.32.gate_proj:  32%|███▏      | 11702/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.32.up_proj:  32%|███▏      | 11703/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.32.down_proj:  32%|███▏      | 11704/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.33.gate_proj:  32%|███▏      | 11705/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.33.up_proj:  32%|███▏      | 11706/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.33.down_proj:  32%|███▏      | 11707/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.34.gate_proj:  32%|███▏      | 11708/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.34.up_proj:  32%|███▏      | 11709/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.34.down_proj:  32%|███▏      | 11710/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.35.gate_proj:  32%|███▏      | 11711/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.35.up_proj:  32%|███▏      | 11712/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.35.down_proj:  32%|███▏      | 11713/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.36.gate_proj:  32%|███▏      | 11714/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.36.up_proj:  32%|███▏      | 11715/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.36.down_proj:  32%|███▏      | 11716/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.37.gate_proj:  32%|███▏      | 11717/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.37.up_proj:  32%|███▏      | 11718/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.37.down_proj:  32%|███▏      | 11719/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.38.gate_proj:  32%|███▏      | 11720/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.38.up_proj:  32%|███▏      | 11721/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.38.down_proj:  32%|███▏      | 11722/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.39.gate_proj:  32%|███▏      | 11723/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.39.up_proj:  32%|███▏      | 11724/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.39.down_proj:  32%|███▏      | 11725/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.40.gate_proj:  32%|███▏      | 11726/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.40.up_proj:  32%|███▏      | 11727/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.40.down_proj:  32%|███▏      | 11728/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.41.gate_proj:  32%|███▏      | 11729/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.41.up_proj:  32%|███▏      | 11730/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.41.down_proj:  32%|███▏      | 11731/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.42.gate_proj:  32%|███▏      | 11732/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.42.up_proj:  32%|███▏      | 11733/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.42.down_proj:  32%|███▏      | 11734/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.43.gate_proj:  32%|███▏      | 11735/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.43.up_proj:  32%|███▏      | 11736/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.43.down_proj:  32%|███▏      | 11737/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.44.gate_proj:  32%|███▏      | 11738/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.44.up_proj:  32%|███▏      | 11739/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.44.down_proj:  32%|███▏      | 11740/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.45.gate_proj:  32%|███▏      | 11741/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.45.up_proj:  32%|███▏      | 11742/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.45.down_proj:  32%|███▏      | 11743/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.46.gate_proj:  32%|███▏      | 11744/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.46.up_proj:  32%|███▏      | 11745/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.46.down_proj:  32%|███▏      | 11746/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.47.gate_proj:  32%|███▏      | 11747/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.47.up_proj:  32%|███▏      | 11748/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.47.down_proj:  32%|███▏      | 11749/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.48.gate_proj:  32%|███▏      | 11750/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.48.up_proj:  32%|███▏      | 11751/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.48.down_proj:  32%|███▏      | 11752/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.49.gate_proj:  32%|███▏      | 11753/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.49.up_proj:  32%|███▏      | 11754/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.49.down_proj:  32%|███▏      | 11755/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.50.gate_proj:  32%|███▏      | 11756/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.50.up_proj:  32%|███▏      | 11757/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.50.down_proj:  32%|███▏      | 11758/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.51.gate_proj:  32%|███▏      | 11759/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.51.up_proj:  32%|███▏      | 11760/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.51.down_proj:  32%|███▏      | 11761/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.52.gate_proj:  32%|███▏      | 11762/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.52.up_proj:  32%|███▏      | 11763/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.52.down_proj:  32%|███▏      | 11764/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.53.gate_proj:  32%|███▏      | 11765/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.53.up_proj:  32%|███▏      | 11766/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.53.down_proj:  32%|███▏      | 11767/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.54.gate_proj:  32%|███▏      | 11768/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.54.up_proj:  32%|███▏      | 11769/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.54.down_proj:  32%|███▏      | 11770/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.55.gate_proj:  32%|███▏      | 11771/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.55.up_proj:  32%|███▏      | 11772/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.55.down_proj:  32%|███▏      | 11773/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.56.gate_proj:  32%|███▏      | 11774/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.56.up_proj:  32%|███▏      | 11775/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.56.down_proj:  32%|███▏      | 11776/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.57.gate_proj:  32%|███▏      | 11777/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.57.up_proj:  32%|███▏      | 11778/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.57.down_proj:  32%|███▏      | 11779/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.58.gate_proj:  32%|███▏      | 11780/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.58.up_proj:  32%|███▏      | 11781/36566 [00:11<00:21, 1164.88it/s]  
packing model.layers.29.mlp.experts.58.down_proj:  32%|███▏      | 11782/36566 [00:11<00:21, 1164.88it/s]
packing model.layers.29.mlp.experts.58.down_proj:  32%|███▏      | 11783/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.59.gate_proj:  32%|███▏      | 11783/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.59.up_proj:  32%|███▏      | 11784/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.59.down_proj:  32%|███▏      | 11785/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.60.gate_proj:  32%|███▏      | 11786/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.60.up_proj:  32%|███▏      | 11787/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.60.down_proj:  32%|███▏      | 11788/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.61.gate_proj:  32%|███▏      | 11789/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.61.up_proj:  32%|███▏      | 11790/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.61.down_proj:  32%|███▏      | 11791/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.62.gate_proj:  32%|███▏      | 11792/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.62.up_proj:  32%|███▏      | 11793/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.62.down_proj:  32%|███▏      | 11794/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.63.gate_proj:  32%|███▏      | 11795/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.63.up_proj:  32%|███▏      | 11796/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.63.down_proj:  32%|███▏      | 11797/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.64.gate_proj:  32%|███▏      | 11798/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.64.up_proj:  32%|███▏      | 11799/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.64.down_proj:  32%|███▏      | 11800/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.65.gate_proj:  32%|███▏      | 11801/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.65.up_proj:  32%|███▏      | 11802/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.65.down_proj:  32%|███▏      | 11803/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.66.gate_proj:  32%|███▏      | 11804/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.66.up_proj:  32%|███▏      | 11805/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.66.down_proj:  32%|███▏      | 11806/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.67.gate_proj:  32%|███▏      | 11807/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.67.up_proj:  32%|███▏      | 11808/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.67.down_proj:  32%|███▏      | 11809/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.68.gate_proj:  32%|███▏      | 11810/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.68.up_proj:  32%|███▏      | 11811/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.68.down_proj:  32%|███▏      | 11812/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.69.gate_proj:  32%|███▏      | 11813/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.69.up_proj:  32%|███▏      | 11814/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.69.down_proj:  32%|███▏      | 11815/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.70.gate_proj:  32%|███▏      | 11816/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.70.up_proj:  32%|███▏      | 11817/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.70.down_proj:  32%|███▏      | 11818/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.71.gate_proj:  32%|███▏      | 11819/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.71.up_proj:  32%|███▏      | 11820/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.71.down_proj:  32%|███▏      | 11821/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.72.gate_proj:  32%|███▏      | 11822/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.72.up_proj:  32%|███▏      | 11823/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.72.down_proj:  32%|███▏      | 11824/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.73.gate_proj:  32%|███▏      | 11825/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.73.up_proj:  32%|███▏      | 11826/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.73.down_proj:  32%|███▏      | 11827/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.74.gate_proj:  32%|███▏      | 11828/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.74.up_proj:  32%|███▏      | 11829/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.74.down_proj:  32%|███▏      | 11830/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.75.gate_proj:  32%|███▏      | 11831/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.75.up_proj:  32%|███▏      | 11832/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.75.down_proj:  32%|███▏      | 11833/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.76.gate_proj:  32%|███▏      | 11834/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.76.up_proj:  32%|███▏      | 11835/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.76.down_proj:  32%|███▏      | 11836/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.77.gate_proj:  32%|███▏      | 11837/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.77.up_proj:  32%|███▏      | 11838/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.77.down_proj:  32%|███▏      | 11839/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.78.gate_proj:  32%|███▏      | 11840/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.78.up_proj:  32%|███▏      | 11841/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.78.down_proj:  32%|███▏      | 11842/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.79.gate_proj:  32%|███▏      | 11843/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.79.up_proj:  32%|███▏      | 11844/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.79.down_proj:  32%|███▏      | 11845/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.80.gate_proj:  32%|███▏      | 11846/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.80.up_proj:  32%|███▏      | 11847/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.80.down_proj:  32%|███▏      | 11848/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.81.gate_proj:  32%|███▏      | 11849/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.81.up_proj:  32%|███▏      | 11850/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.81.down_proj:  32%|███▏      | 11851/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.82.gate_proj:  32%|███▏      | 11852/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.82.up_proj:  32%|███▏      | 11853/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.82.down_proj:  32%|███▏      | 11854/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.83.gate_proj:  32%|███▏      | 11855/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.83.up_proj:  32%|███▏      | 11856/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.83.down_proj:  32%|███▏      | 11857/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.84.gate_proj:  32%|███▏      | 11858/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.84.up_proj:  32%|███▏      | 11859/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.84.down_proj:  32%|███▏      | 11860/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.85.gate_proj:  32%|███▏      | 11861/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.85.up_proj:  32%|███▏      | 11862/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.85.down_proj:  32%|███▏      | 11863/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.86.gate_proj:  32%|███▏      | 11864/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.86.up_proj:  32%|███▏      | 11865/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.86.down_proj:  32%|███▏      | 11866/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.87.gate_proj:  32%|███▏      | 11867/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.87.up_proj:  32%|███▏      | 11868/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.87.down_proj:  32%|███▏      | 11869/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.88.gate_proj:  32%|███▏      | 11870/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.88.up_proj:  32%|███▏      | 11871/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.88.down_proj:  32%|███▏      | 11872/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.89.gate_proj:  32%|███▏      | 11873/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.89.up_proj:  32%|███▏      | 11874/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.89.down_proj:  32%|███▏      | 11875/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.90.gate_proj:  32%|███▏      | 11876/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.90.up_proj:  32%|███▏      | 11877/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.90.down_proj:  32%|███▏      | 11878/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.91.gate_proj:  32%|███▏      | 11879/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.91.up_proj:  32%|███▏      | 11880/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.91.down_proj:  32%|███▏      | 11881/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.92.gate_proj:  32%|███▏      | 11882/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.92.up_proj:  32%|███▏      | 11883/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.92.down_proj:  33%|███▎      | 11884/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.93.gate_proj:  33%|███▎      | 11885/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.93.up_proj:  33%|███▎      | 11886/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.93.down_proj:  33%|███▎      | 11887/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.94.gate_proj:  33%|███▎      | 11888/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.94.up_proj:  33%|███▎      | 11889/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.94.down_proj:  33%|███▎      | 11890/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.95.gate_proj:  33%|███▎      | 11891/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.95.up_proj:  33%|███▎      | 11892/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.95.down_proj:  33%|███▎      | 11893/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.96.gate_proj:  33%|███▎      | 11894/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.96.up_proj:  33%|███▎      | 11895/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.96.down_proj:  33%|███▎      | 11896/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.97.gate_proj:  33%|███▎      | 11897/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.97.up_proj:  33%|███▎      | 11898/36566 [00:11<00:21, 1162.72it/s]  
packing model.layers.29.mlp.experts.97.down_proj:  33%|███▎      | 11899/36566 [00:11<00:21, 1162.72it/s]
packing model.layers.29.mlp.experts.97.down_proj:  33%|███▎      | 11900/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.98.gate_proj:  33%|███▎      | 11900/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.98.up_proj:  33%|███▎      | 11901/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.98.down_proj:  33%|███▎      | 11902/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.99.gate_proj:  33%|███▎      | 11903/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.99.up_proj:  33%|███▎      | 11904/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.99.down_proj:  33%|███▎      | 11905/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.100.gate_proj:  33%|███▎      | 11906/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.100.up_proj:  33%|███▎      | 11907/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.100.down_proj:  33%|███▎      | 11908/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.101.gate_proj:  33%|███▎      | 11909/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.101.up_proj:  33%|███▎      | 11910/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.101.down_proj:  33%|███▎      | 11911/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.102.gate_proj:  33%|███▎      | 11912/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.102.up_proj:  33%|███▎      | 11913/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.102.down_proj:  33%|███▎      | 11914/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.103.gate_proj:  33%|███▎      | 11915/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.103.up_proj:  33%|███▎      | 11916/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.103.down_proj:  33%|███▎      | 11917/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.104.gate_proj:  33%|███▎      | 11918/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.104.up_proj:  33%|███▎      | 11919/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.104.down_proj:  33%|███▎      | 11920/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.105.gate_proj:  33%|███▎      | 11921/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.105.up_proj:  33%|███▎      | 11922/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.105.down_proj:  33%|███▎      | 11923/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.106.gate_proj:  33%|███▎      | 11924/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.106.up_proj:  33%|███▎      | 11925/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.106.down_proj:  33%|███▎      | 11926/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.107.gate_proj:  33%|███▎      | 11927/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.107.up_proj:  33%|███▎      | 11928/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.107.down_proj:  33%|███▎      | 11929/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.108.gate_proj:  33%|███▎      | 11930/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.108.up_proj:  33%|███▎      | 11931/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.108.down_proj:  33%|███▎      | 11932/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.109.gate_proj:  33%|███▎      | 11933/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.109.up_proj:  33%|███▎      | 11934/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.109.down_proj:  33%|███▎      | 11935/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.110.gate_proj:  33%|███▎      | 11936/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.110.up_proj:  33%|███▎      | 11937/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.110.down_proj:  33%|███▎      | 11938/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.111.gate_proj:  33%|███▎      | 11939/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.111.up_proj:  33%|███▎      | 11940/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.111.down_proj:  33%|███▎      | 11941/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.112.gate_proj:  33%|███▎      | 11942/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.112.up_proj:  33%|███▎      | 11943/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.112.down_proj:  33%|███▎      | 11944/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.113.gate_proj:  33%|███▎      | 11945/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.113.up_proj:  33%|███▎      | 11946/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.113.down_proj:  33%|███▎      | 11947/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.114.gate_proj:  33%|███▎      | 11948/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.114.up_proj:  33%|███▎      | 11949/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.114.down_proj:  33%|███▎      | 11950/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.115.gate_proj:  33%|███▎      | 11951/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.115.up_proj:  33%|███▎      | 11952/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.115.down_proj:  33%|███▎      | 11953/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.116.gate_proj:  33%|███▎      | 11954/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.116.up_proj:  33%|███▎      | 11955/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.116.down_proj:  33%|███▎      | 11956/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.117.gate_proj:  33%|███▎      | 11957/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.117.up_proj:  33%|███▎      | 11958/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.117.down_proj:  33%|███▎      | 11959/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.118.gate_proj:  33%|███▎      | 11960/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.118.up_proj:  33%|███▎      | 11961/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.118.down_proj:  33%|███▎      | 11962/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.119.gate_proj:  33%|███▎      | 11963/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.119.up_proj:  33%|███▎      | 11964/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.119.down_proj:  33%|███▎      | 11965/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.120.gate_proj:  33%|███▎      | 11966/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.120.up_proj:  33%|███▎      | 11967/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.120.down_proj:  33%|███▎      | 11968/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.121.gate_proj:  33%|███▎      | 11969/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.121.up_proj:  33%|███▎      | 11970/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.121.down_proj:  33%|███▎      | 11971/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.122.gate_proj:  33%|███▎      | 11972/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.122.up_proj:  33%|███▎      | 11973/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.122.down_proj:  33%|███▎      | 11974/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.123.gate_proj:  33%|███▎      | 11975/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.123.up_proj:  33%|███▎      | 11976/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.123.down_proj:  33%|███▎      | 11977/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.124.gate_proj:  33%|███▎      | 11978/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.124.up_proj:  33%|███▎      | 11979/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.124.down_proj:  33%|███▎      | 11980/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.125.gate_proj:  33%|███▎      | 11981/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.125.up_proj:  33%|███▎      | 11982/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.125.down_proj:  33%|███▎      | 11983/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.126.gate_proj:  33%|███▎      | 11984/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.126.up_proj:  33%|███▎      | 11985/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.126.down_proj:  33%|███▎      | 11986/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.127.gate_proj:  33%|███▎      | 11987/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.29.mlp.experts.127.up_proj:  33%|███▎      | 11988/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.29.mlp.experts.127.down_proj:  33%|███▎      | 11989/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.0.gate_proj:  33%|███▎      | 11990/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.0.up_proj:  33%|███▎      | 11991/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.0.down_proj:  33%|███▎      | 11992/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.1.gate_proj:  33%|███▎      | 11993/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.1.up_proj:  33%|███▎      | 11994/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.1.down_proj:  33%|███▎      | 11995/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.2.gate_proj:  33%|███▎      | 11996/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.2.up_proj:  33%|███▎      | 11997/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.2.down_proj:  33%|███▎      | 11998/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.3.gate_proj:  33%|███▎      | 11999/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.3.up_proj:  33%|███▎      | 12000/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.3.down_proj:  33%|███▎      | 12001/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.4.gate_proj:  33%|███▎      | 12002/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.4.up_proj:  33%|███▎      | 12003/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.4.down_proj:  33%|███▎      | 12004/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.5.gate_proj:  33%|███▎      | 12005/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.5.up_proj:  33%|███▎      | 12006/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.5.down_proj:  33%|███▎      | 12007/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.6.gate_proj:  33%|███▎      | 12008/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.6.up_proj:  33%|███▎      | 12009/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.6.down_proj:  33%|███▎      | 12010/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.7.gate_proj:  33%|███▎      | 12011/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.7.up_proj:  33%|███▎      | 12012/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.7.down_proj:  33%|███▎      | 12013/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.8.gate_proj:  33%|███▎      | 12014/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.8.up_proj:  33%|███▎      | 12015/36566 [00:11<00:21, 1162.43it/s]  
packing model.layers.30.mlp.experts.8.down_proj:  33%|███▎      | 12016/36566 [00:11<00:21, 1162.43it/s]
packing model.layers.30.mlp.experts.8.down_proj:  33%|███▎      | 12017/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.9.gate_proj:  33%|███▎      | 12017/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.9.up_proj:  33%|███▎      | 12018/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.9.down_proj:  33%|███▎      | 12019/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.10.gate_proj:  33%|███▎      | 12020/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.10.up_proj:  33%|███▎      | 12021/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.10.down_proj:  33%|███▎      | 12022/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.11.gate_proj:  33%|███▎      | 12023/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.11.up_proj:  33%|███▎      | 12024/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.11.down_proj:  33%|███▎      | 12025/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.12.gate_proj:  33%|███▎      | 12026/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.12.up_proj:  33%|███▎      | 12027/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.12.down_proj:  33%|███▎      | 12028/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.13.gate_proj:  33%|███▎      | 12029/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.13.up_proj:  33%|███▎      | 12030/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.13.down_proj:  33%|███▎      | 12031/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.14.gate_proj:  33%|███▎      | 12032/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.14.up_proj:  33%|███▎      | 12033/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.14.down_proj:  33%|███▎      | 12034/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.15.gate_proj:  33%|███▎      | 12035/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.15.up_proj:  33%|███▎      | 12036/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.15.down_proj:  33%|███▎      | 12037/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.16.gate_proj:  33%|███▎      | 12038/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.16.up_proj:  33%|███▎      | 12039/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.16.down_proj:  33%|███▎      | 12040/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.17.gate_proj:  33%|███▎      | 12041/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.17.up_proj:  33%|███▎      | 12042/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.17.down_proj:  33%|███▎      | 12043/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.18.gate_proj:  33%|███▎      | 12044/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.18.up_proj:  33%|███▎      | 12045/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.18.down_proj:  33%|███▎      | 12046/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.19.gate_proj:  33%|███▎      | 12047/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.19.up_proj:  33%|███▎      | 12048/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.19.down_proj:  33%|███▎      | 12049/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.20.gate_proj:  33%|███▎      | 12050/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.20.up_proj:  33%|███▎      | 12051/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.20.down_proj:  33%|███▎      | 12052/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.21.gate_proj:  33%|███▎      | 12053/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.21.up_proj:  33%|███▎      | 12054/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.21.down_proj:  33%|███▎      | 12055/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.22.gate_proj:  33%|███▎      | 12056/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.22.up_proj:  33%|███▎      | 12057/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.22.down_proj:  33%|███▎      | 12058/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.23.gate_proj:  33%|███▎      | 12059/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.23.up_proj:  33%|███▎      | 12060/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.23.down_proj:  33%|███▎      | 12061/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.24.gate_proj:  33%|███▎      | 12062/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.24.up_proj:  33%|███▎      | 12063/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.24.down_proj:  33%|███▎      | 12064/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.25.gate_proj:  33%|███▎      | 12065/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.25.up_proj:  33%|███▎      | 12066/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.25.down_proj:  33%|███▎      | 12067/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.26.gate_proj:  33%|███▎      | 12068/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.26.up_proj:  33%|███▎      | 12069/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.26.down_proj:  33%|███▎      | 12070/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.27.gate_proj:  33%|███▎      | 12071/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.27.up_proj:  33%|███▎      | 12072/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.27.down_proj:  33%|███▎      | 12073/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.28.gate_proj:  33%|███▎      | 12074/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.28.up_proj:  33%|███▎      | 12075/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.28.down_proj:  33%|███▎      | 12076/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.29.gate_proj:  33%|███▎      | 12077/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.29.up_proj:  33%|███▎      | 12078/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.29.down_proj:  33%|███▎      | 12079/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.30.gate_proj:  33%|███▎      | 12080/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.30.up_proj:  33%|███▎      | 12081/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.30.down_proj:  33%|███▎      | 12082/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.31.gate_proj:  33%|███▎      | 12083/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.31.up_proj:  33%|███▎      | 12084/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.31.down_proj:  33%|███▎      | 12085/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.32.gate_proj:  33%|███▎      | 12086/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.32.up_proj:  33%|███▎      | 12087/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.32.down_proj:  33%|███▎      | 12088/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.33.gate_proj:  33%|███▎      | 12089/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.33.up_proj:  33%|███▎      | 12090/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.33.down_proj:  33%|███▎      | 12091/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.34.gate_proj:  33%|███▎      | 12092/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.34.up_proj:  33%|███▎      | 12093/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.34.down_proj:  33%|███▎      | 12094/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.35.gate_proj:  33%|███▎      | 12095/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.35.up_proj:  33%|███▎      | 12096/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.35.down_proj:  33%|███▎      | 12097/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.36.gate_proj:  33%|███▎      | 12098/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.36.up_proj:  33%|███▎      | 12099/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.36.down_proj:  33%|███▎      | 12100/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.37.gate_proj:  33%|███▎      | 12101/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.37.up_proj:  33%|███▎      | 12102/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.37.down_proj:  33%|███▎      | 12103/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.38.gate_proj:  33%|███▎      | 12104/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.38.up_proj:  33%|███▎      | 12105/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.38.down_proj:  33%|███▎      | 12106/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.39.gate_proj:  33%|███▎      | 12107/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.39.up_proj:  33%|███▎      | 12108/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.39.down_proj:  33%|███▎      | 12109/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.40.gate_proj:  33%|███▎      | 12110/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.40.up_proj:  33%|███▎      | 12111/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.40.down_proj:  33%|███▎      | 12112/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.41.gate_proj:  33%|███▎      | 12113/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.41.up_proj:  33%|███▎      | 12114/36566 [00:11<00:21, 1164.27it/s]  
packing model.layers.30.mlp.experts.41.down_proj:  33%|███▎      | 12115/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.42.gate_proj:  33%|███▎      | 12116/36566 [00:11<00:21, 1164.27it/s]
packing model.layers.30.mlp.experts.42.up_proj:  33%|███▎      | 12117/36566 [00:11<00:20, 1164.27it/s]  
packing model.layers.30.mlp.experts.42.down_proj:  33%|███▎      | 12118/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.43.gate_proj:  33%|███▎      | 12119/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.43.up_proj:  33%|███▎      | 12120/36566 [00:11<00:20, 1164.27it/s]  
packing model.layers.30.mlp.experts.43.down_proj:  33%|███▎      | 12121/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.44.gate_proj:  33%|███▎      | 12122/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.44.up_proj:  33%|███▎      | 12123/36566 [00:11<00:20, 1164.27it/s]  
packing model.layers.30.mlp.experts.44.down_proj:  33%|███▎      | 12124/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.45.gate_proj:  33%|███▎      | 12125/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.45.up_proj:  33%|███▎      | 12126/36566 [00:11<00:20, 1164.27it/s]  
packing model.layers.30.mlp.experts.45.down_proj:  33%|███▎      | 12127/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.46.gate_proj:  33%|███▎      | 12128/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.46.up_proj:  33%|███▎      | 12129/36566 [00:11<00:20, 1164.27it/s]  
packing model.layers.30.mlp.experts.46.down_proj:  33%|███▎      | 12130/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.47.gate_proj:  33%|███▎      | 12131/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.47.up_proj:  33%|███▎      | 12132/36566 [00:11<00:20, 1164.27it/s]  
packing model.layers.30.mlp.experts.47.down_proj:  33%|███▎      | 12133/36566 [00:11<00:20, 1164.27it/s]
packing model.layers.30.mlp.experts.47.down_proj:  33%|███▎      | 12134/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.48.gate_proj:  33%|███▎      | 12134/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.48.up_proj:  33%|███▎      | 12135/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.48.down_proj:  33%|███▎      | 12136/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.49.gate_proj:  33%|███▎      | 12137/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.49.up_proj:  33%|███▎      | 12138/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.49.down_proj:  33%|███▎      | 12139/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.50.gate_proj:  33%|███▎      | 12140/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.50.up_proj:  33%|███▎      | 12141/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.50.down_proj:  33%|███▎      | 12142/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.51.gate_proj:  33%|███▎      | 12143/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.51.up_proj:  33%|███▎      | 12144/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.51.down_proj:  33%|███▎      | 12145/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.52.gate_proj:  33%|███▎      | 12146/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.52.up_proj:  33%|███▎      | 12147/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.52.down_proj:  33%|███▎      | 12148/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.53.gate_proj:  33%|███▎      | 12149/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.53.up_proj:  33%|███▎      | 12150/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.53.down_proj:  33%|███▎      | 12151/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.54.gate_proj:  33%|███▎      | 12152/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.54.up_proj:  33%|███▎      | 12153/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.54.down_proj:  33%|███▎      | 12154/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.55.gate_proj:  33%|███▎      | 12155/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.55.up_proj:  33%|███▎      | 12156/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.55.down_proj:  33%|███▎      | 12157/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.56.gate_proj:  33%|███▎      | 12158/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.56.up_proj:  33%|███▎      | 12159/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.56.down_proj:  33%|███▎      | 12160/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.57.gate_proj:  33%|███▎      | 12161/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.57.up_proj:  33%|███▎      | 12162/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.57.down_proj:  33%|███▎      | 12163/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.58.gate_proj:  33%|███▎      | 12164/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.58.up_proj:  33%|███▎      | 12165/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.58.down_proj:  33%|███▎      | 12166/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.59.gate_proj:  33%|███▎      | 12167/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.59.up_proj:  33%|███▎      | 12168/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.59.down_proj:  33%|███▎      | 12169/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.60.gate_proj:  33%|███▎      | 12170/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.60.up_proj:  33%|███▎      | 12171/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.60.down_proj:  33%|███▎      | 12172/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.61.gate_proj:  33%|███▎      | 12173/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.61.up_proj:  33%|███▎      | 12174/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.61.down_proj:  33%|███▎      | 12175/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.62.gate_proj:  33%|███▎      | 12176/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.62.up_proj:  33%|███▎      | 12177/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.62.down_proj:  33%|███▎      | 12178/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.63.gate_proj:  33%|███▎      | 12179/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.63.up_proj:  33%|███▎      | 12180/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.63.down_proj:  33%|███▎      | 12181/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.64.gate_proj:  33%|███▎      | 12182/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.64.up_proj:  33%|███▎      | 12183/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.64.down_proj:  33%|███▎      | 12184/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.65.gate_proj:  33%|███▎      | 12185/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.65.up_proj:  33%|███▎      | 12186/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.65.down_proj:  33%|███▎      | 12187/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.66.gate_proj:  33%|███▎      | 12188/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.66.up_proj:  33%|███▎      | 12189/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.66.down_proj:  33%|███▎      | 12190/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.67.gate_proj:  33%|███▎      | 12191/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.67.up_proj:  33%|███▎      | 12192/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.67.down_proj:  33%|███▎      | 12193/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.68.gate_proj:  33%|███▎      | 12194/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.68.up_proj:  33%|███▎      | 12195/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.68.down_proj:  33%|███▎      | 12196/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.69.gate_proj:  33%|███▎      | 12197/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.69.up_proj:  33%|███▎      | 12198/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.69.down_proj:  33%|███▎      | 12199/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.70.gate_proj:  33%|███▎      | 12200/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.70.up_proj:  33%|███▎      | 12201/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.70.down_proj:  33%|███▎      | 12202/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.71.gate_proj:  33%|███▎      | 12203/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.71.up_proj:  33%|███▎      | 12204/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.71.down_proj:  33%|███▎      | 12205/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.72.gate_proj:  33%|███▎      | 12206/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.72.up_proj:  33%|███▎      | 12207/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.72.down_proj:  33%|███▎      | 12208/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.73.gate_proj:  33%|███▎      | 12209/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.73.up_proj:  33%|███▎      | 12210/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.73.down_proj:  33%|███▎      | 12211/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.74.gate_proj:  33%|███▎      | 12212/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.74.up_proj:  33%|███▎      | 12213/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.74.down_proj:  33%|███▎      | 12214/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.75.gate_proj:  33%|███▎      | 12215/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.75.up_proj:  33%|███▎      | 12216/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.75.down_proj:  33%|███▎      | 12217/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.76.gate_proj:  33%|███▎      | 12218/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.76.up_proj:  33%|███▎      | 12219/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.76.down_proj:  33%|███▎      | 12220/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.77.gate_proj:  33%|███▎      | 12221/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.77.up_proj:  33%|███▎      | 12222/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.77.down_proj:  33%|███▎      | 12223/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.78.gate_proj:  33%|███▎      | 12224/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.78.up_proj:  33%|███▎      | 12225/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.78.down_proj:  33%|███▎      | 12226/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.79.gate_proj:  33%|███▎      | 12227/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.79.up_proj:  33%|███▎      | 12228/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.79.down_proj:  33%|███▎      | 12229/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.80.gate_proj:  33%|███▎      | 12230/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.80.up_proj:  33%|███▎      | 12231/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.80.down_proj:  33%|███▎      | 12232/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.81.gate_proj:  33%|███▎      | 12233/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.81.up_proj:  33%|███▎      | 12234/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.81.down_proj:  33%|███▎      | 12235/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.82.gate_proj:  33%|███▎      | 12236/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.82.up_proj:  33%|███▎      | 12237/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.82.down_proj:  33%|███▎      | 12238/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.83.gate_proj:  33%|███▎      | 12239/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.83.up_proj:  33%|███▎      | 12240/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.83.down_proj:  33%|███▎      | 12241/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.84.gate_proj:  33%|███▎      | 12242/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.84.up_proj:  33%|███▎      | 12243/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.84.down_proj:  33%|███▎      | 12244/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.85.gate_proj:  33%|███▎      | 12245/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.85.up_proj:  33%|███▎      | 12246/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.85.down_proj:  33%|███▎      | 12247/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.86.gate_proj:  33%|███▎      | 12248/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.86.up_proj:  33%|███▎      | 12249/36566 [00:11<00:20, 1165.95it/s]  
packing model.layers.30.mlp.experts.86.down_proj:  34%|███▎      | 12250/36566 [00:11<00:20, 1165.95it/s]
packing model.layers.30.mlp.experts.86.down_proj:  34%|███▎      | 12251/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.87.gate_proj:  34%|███▎      | 12251/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.87.up_proj:  34%|███▎      | 12252/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.87.down_proj:  34%|███▎      | 12253/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.88.gate_proj:  34%|███▎      | 12254/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.88.up_proj:  34%|███▎      | 12255/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.88.down_proj:  34%|███▎      | 12256/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.89.gate_proj:  34%|███▎      | 12257/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.89.up_proj:  34%|███▎      | 12258/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.89.down_proj:  34%|███▎      | 12259/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.90.gate_proj:  34%|███▎      | 12260/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.90.up_proj:  34%|███▎      | 12261/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.90.down_proj:  34%|███▎      | 12262/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.91.gate_proj:  34%|███▎      | 12263/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.91.up_proj:  34%|███▎      | 12264/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.91.down_proj:  34%|███▎      | 12265/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.92.gate_proj:  34%|███▎      | 12266/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.92.up_proj:  34%|███▎      | 12267/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.92.down_proj:  34%|███▎      | 12268/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.93.gate_proj:  34%|███▎      | 12269/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.93.up_proj:  34%|███▎      | 12270/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.93.down_proj:  34%|███▎      | 12271/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.94.gate_proj:  34%|███▎      | 12272/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.94.up_proj:  34%|███▎      | 12273/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.94.down_proj:  34%|███▎      | 12274/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.95.gate_proj:  34%|███▎      | 12275/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.95.up_proj:  34%|███▎      | 12276/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.95.down_proj:  34%|███▎      | 12277/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.96.gate_proj:  34%|███▎      | 12278/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.96.up_proj:  34%|███▎      | 12279/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.96.down_proj:  34%|███▎      | 12280/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.97.gate_proj:  34%|███▎      | 12281/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.97.up_proj:  34%|███▎      | 12282/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.97.down_proj:  34%|███▎      | 12283/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.98.gate_proj:  34%|███▎      | 12284/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.98.up_proj:  34%|███▎      | 12285/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.98.down_proj:  34%|███▎      | 12286/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.99.gate_proj:  34%|███▎      | 12287/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.99.up_proj:  34%|███▎      | 12288/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.99.down_proj:  34%|███▎      | 12289/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.100.gate_proj:  34%|███▎      | 12290/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.100.up_proj:  34%|███▎      | 12291/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.100.down_proj:  34%|███▎      | 12292/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.101.gate_proj:  34%|███▎      | 12293/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.101.up_proj:  34%|███▎      | 12294/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.101.down_proj:  34%|███▎      | 12295/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.102.gate_proj:  34%|███▎      | 12296/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.102.up_proj:  34%|███▎      | 12297/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.102.down_proj:  34%|███▎      | 12298/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.103.gate_proj:  34%|███▎      | 12299/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.103.up_proj:  34%|███▎      | 12300/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.103.down_proj:  34%|███▎      | 12301/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.104.gate_proj:  34%|███▎      | 12302/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.104.up_proj:  34%|███▎      | 12303/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.104.down_proj:  34%|███▎      | 12304/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.105.gate_proj:  34%|███▎      | 12305/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.105.up_proj:  34%|███▎      | 12306/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.105.down_proj:  34%|███▎      | 12307/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.106.gate_proj:  34%|███▎      | 12308/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.106.up_proj:  34%|███▎      | 12309/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.106.down_proj:  34%|███▎      | 12310/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.107.gate_proj:  34%|███▎      | 12311/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.107.up_proj:  34%|███▎      | 12312/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.107.down_proj:  34%|███▎      | 12313/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.108.gate_proj:  34%|███▎      | 12314/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.108.up_proj:  34%|███▎      | 12315/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.108.down_proj:  34%|███▎      | 12316/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.109.gate_proj:  34%|███▎      | 12317/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.109.up_proj:  34%|███▎      | 12318/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.109.down_proj:  34%|███▎      | 12319/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.110.gate_proj:  34%|███▎      | 12320/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.110.up_proj:  34%|███▎      | 12321/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.110.down_proj:  34%|███▎      | 12322/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.111.gate_proj:  34%|███▎      | 12323/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.111.up_proj:  34%|███▎      | 12324/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.111.down_proj:  34%|███▎      | 12325/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.112.gate_proj:  34%|███▎      | 12326/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.112.up_proj:  34%|███▎      | 12327/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.112.down_proj:  34%|███▎      | 12328/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.113.gate_proj:  34%|███▎      | 12329/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.113.up_proj:  34%|███▎      | 12330/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.113.down_proj:  34%|███▎      | 12331/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.114.gate_proj:  34%|███▎      | 12332/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.114.up_proj:  34%|███▎      | 12333/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.114.down_proj:  34%|███▎      | 12334/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.115.gate_proj:  34%|███▎      | 12335/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.115.up_proj:  34%|███▎      | 12336/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.115.down_proj:  34%|███▎      | 12337/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.116.gate_proj:  34%|███▎      | 12338/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.116.up_proj:  34%|███▎      | 12339/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.116.down_proj:  34%|███▎      | 12340/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.117.gate_proj:  34%|███▎      | 12341/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.117.up_proj:  34%|███▍      | 12342/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.117.down_proj:  34%|███▍      | 12343/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.118.gate_proj:  34%|███▍      | 12344/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.118.up_proj:  34%|███▍      | 12345/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.118.down_proj:  34%|███▍      | 12346/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.119.gate_proj:  34%|███▍      | 12347/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.119.up_proj:  34%|███▍      | 12348/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.119.down_proj:  34%|███▍      | 12349/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.120.gate_proj:  34%|███▍      | 12350/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.120.up_proj:  34%|███▍      | 12351/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.120.down_proj:  34%|███▍      | 12352/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.121.gate_proj:  34%|███▍      | 12353/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.121.up_proj:  34%|███▍      | 12354/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.121.down_proj:  34%|███▍      | 12355/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.122.gate_proj:  34%|███▍      | 12356/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.122.up_proj:  34%|███▍      | 12357/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.122.down_proj:  34%|███▍      | 12358/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.123.gate_proj:  34%|███▍      | 12359/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.123.up_proj:  34%|███▍      | 12360/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.123.down_proj:  34%|███▍      | 12361/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.124.gate_proj:  34%|███▍      | 12362/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.124.up_proj:  34%|███▍      | 12363/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.124.down_proj:  34%|███▍      | 12364/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.125.gate_proj:  34%|███▍      | 12365/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.125.up_proj:  34%|███▍      | 12366/36566 [00:11<00:20, 1166.79it/s]  
packing model.layers.30.mlp.experts.125.down_proj:  34%|███▍      | 12367/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.126.gate_proj:  34%|███▍      | 12368/36566 [00:11<00:20, 1166.79it/s]
packing model.layers.30.mlp.experts.126.gate_proj:  34%|███▍      | 12369/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.30.mlp.experts.126.up_proj:  34%|███▍      | 12369/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.30.mlp.experts.126.down_proj:  34%|███▍      | 12370/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.30.mlp.experts.127.gate_proj:  34%|███▍      | 12371/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.30.mlp.experts.127.up_proj:  34%|███▍      | 12372/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.30.mlp.experts.127.down_proj:  34%|███▍      | 12373/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.0.gate_proj:  34%|███▍      | 12374/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.0.up_proj:  34%|███▍      | 12375/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.0.down_proj:  34%|███▍      | 12376/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.1.gate_proj:  34%|███▍      | 12377/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.1.up_proj:  34%|███▍      | 12378/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.1.down_proj:  34%|███▍      | 12379/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.2.gate_proj:  34%|███▍      | 12380/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.2.up_proj:  34%|███▍      | 12381/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.2.down_proj:  34%|███▍      | 12382/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.3.gate_proj:  34%|███▍      | 12383/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.3.up_proj:  34%|███▍      | 12384/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.3.down_proj:  34%|███▍      | 12385/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.4.gate_proj:  34%|███▍      | 12386/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.4.up_proj:  34%|███▍      | 12387/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.4.down_proj:  34%|███▍      | 12388/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.5.gate_proj:  34%|███▍      | 12389/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.5.up_proj:  34%|███▍      | 12390/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.5.down_proj:  34%|███▍      | 12391/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.6.gate_proj:  34%|███▍      | 12392/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.6.up_proj:  34%|███▍      | 12393/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.6.down_proj:  34%|███▍      | 12394/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.7.gate_proj:  34%|███▍      | 12395/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.7.up_proj:  34%|███▍      | 12396/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.7.down_proj:  34%|███▍      | 12397/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.8.gate_proj:  34%|███▍      | 12398/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.8.up_proj:  34%|███▍      | 12399/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.8.down_proj:  34%|███▍      | 12400/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.9.gate_proj:  34%|███▍      | 12401/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.9.up_proj:  34%|███▍      | 12402/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.9.down_proj:  34%|███▍      | 12403/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.10.gate_proj:  34%|███▍      | 12404/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.10.up_proj:  34%|███▍      | 12405/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.10.down_proj:  34%|███▍      | 12406/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.11.gate_proj:  34%|███▍      | 12407/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.11.up_proj:  34%|███▍      | 12408/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.11.down_proj:  34%|███▍      | 12409/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.12.gate_proj:  34%|███▍      | 12410/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.12.up_proj:  34%|███▍      | 12411/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.12.down_proj:  34%|███▍      | 12412/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.13.gate_proj:  34%|███▍      | 12413/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.13.up_proj:  34%|███▍      | 12414/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.13.down_proj:  34%|███▍      | 12415/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.14.gate_proj:  34%|███▍      | 12416/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.14.up_proj:  34%|███▍      | 12417/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.14.down_proj:  34%|███▍      | 12418/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.15.gate_proj:  34%|███▍      | 12419/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.15.up_proj:  34%|███▍      | 12420/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.15.down_proj:  34%|███▍      | 12421/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.16.gate_proj:  34%|███▍      | 12422/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.16.up_proj:  34%|███▍      | 12423/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.16.down_proj:  34%|███▍      | 12424/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.17.gate_proj:  34%|███▍      | 12425/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.17.up_proj:  34%|███▍      | 12426/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.17.down_proj:  34%|███▍      | 12427/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.18.gate_proj:  34%|███▍      | 12428/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.18.up_proj:  34%|███▍      | 12429/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.18.down_proj:  34%|███▍      | 12430/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.19.gate_proj:  34%|███▍      | 12431/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.19.up_proj:  34%|███▍      | 12432/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.19.down_proj:  34%|███▍      | 12433/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.20.gate_proj:  34%|███▍      | 12434/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.20.up_proj:  34%|███▍      | 12435/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.20.down_proj:  34%|███▍      | 12436/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.21.gate_proj:  34%|███▍      | 12437/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.21.up_proj:  34%|███▍      | 12438/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.21.down_proj:  34%|███▍      | 12439/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.22.gate_proj:  34%|███▍      | 12440/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.22.up_proj:  34%|███▍      | 12441/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.22.down_proj:  34%|███▍      | 12442/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.23.gate_proj:  34%|███▍      | 12443/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.23.up_proj:  34%|███▍      | 12444/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.23.down_proj:  34%|███▍      | 12445/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.24.gate_proj:  34%|███▍      | 12446/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.24.up_proj:  34%|███▍      | 12447/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.24.down_proj:  34%|███▍      | 12448/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.25.gate_proj:  34%|███▍      | 12449/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.25.up_proj:  34%|███▍      | 12450/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.25.down_proj:  34%|███▍      | 12451/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.26.gate_proj:  34%|███▍      | 12452/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.26.up_proj:  34%|███▍      | 12453/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.26.down_proj:  34%|███▍      | 12454/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.27.gate_proj:  34%|███▍      | 12455/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.27.up_proj:  34%|███▍      | 12456/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.27.down_proj:  34%|███▍      | 12457/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.28.gate_proj:  34%|███▍      | 12458/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.28.up_proj:  34%|███▍      | 12459/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.28.down_proj:  34%|███▍      | 12460/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.29.gate_proj:  34%|███▍      | 12461/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.29.up_proj:  34%|███▍      | 12462/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.29.down_proj:  34%|███▍      | 12463/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.30.gate_proj:  34%|███▍      | 12464/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.30.up_proj:  34%|███▍      | 12465/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.30.down_proj:  34%|███▍      | 12466/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.31.gate_proj:  34%|███▍      | 12467/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.31.up_proj:  34%|███▍      | 12468/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.31.down_proj:  34%|███▍      | 12469/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.32.gate_proj:  34%|███▍      | 12470/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.32.up_proj:  34%|███▍      | 12471/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.32.down_proj:  34%|███▍      | 12472/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.33.gate_proj:  34%|███▍      | 12473/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.33.up_proj:  34%|███▍      | 12474/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.33.down_proj:  34%|███▍      | 12475/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.34.gate_proj:  34%|███▍      | 12476/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.34.up_proj:  34%|███▍      | 12477/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.34.down_proj:  34%|███▍      | 12478/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.35.gate_proj:  34%|███▍      | 12479/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.35.up_proj:  34%|███▍      | 12480/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.35.down_proj:  34%|███▍      | 12481/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.36.gate_proj:  34%|███▍      | 12482/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.36.up_proj:  34%|███▍      | 12483/36566 [00:11<00:20, 1168.85it/s]  
packing model.layers.31.mlp.experts.36.down_proj:  34%|███▍      | 12484/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.37.gate_proj:  34%|███▍      | 12485/36566 [00:11<00:20, 1168.85it/s]
packing model.layers.31.mlp.experts.37.gate_proj:  34%|███▍      | 12486/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.37.up_proj:  34%|███▍      | 12486/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.37.down_proj:  34%|███▍      | 12487/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.38.gate_proj:  34%|███▍      | 12488/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.38.up_proj:  34%|███▍      | 12489/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.38.down_proj:  34%|███▍      | 12490/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.39.gate_proj:  34%|███▍      | 12491/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.39.up_proj:  34%|███▍      | 12492/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.39.down_proj:  34%|███▍      | 12493/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.40.gate_proj:  34%|███▍      | 12494/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.40.up_proj:  34%|███▍      | 12495/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.40.down_proj:  34%|███▍      | 12496/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.41.gate_proj:  34%|███▍      | 12497/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.41.up_proj:  34%|███▍      | 12498/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.41.down_proj:  34%|███▍      | 12499/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.42.gate_proj:  34%|███▍      | 12500/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.42.up_proj:  34%|███▍      | 12501/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.42.down_proj:  34%|███▍      | 12502/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.43.gate_proj:  34%|███▍      | 12503/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.43.up_proj:  34%|███▍      | 12504/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.43.down_proj:  34%|███▍      | 12505/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.44.gate_proj:  34%|███▍      | 12506/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.44.up_proj:  34%|███▍      | 12507/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.44.down_proj:  34%|███▍      | 12508/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.45.gate_proj:  34%|███▍      | 12509/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.45.up_proj:  34%|███▍      | 12510/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.45.down_proj:  34%|███▍      | 12511/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.46.gate_proj:  34%|███▍      | 12512/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.46.up_proj:  34%|███▍      | 12513/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.46.down_proj:  34%|███▍      | 12514/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.47.gate_proj:  34%|███▍      | 12515/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.47.up_proj:  34%|███▍      | 12516/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.47.down_proj:  34%|███▍      | 12517/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.48.gate_proj:  34%|███▍      | 12518/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.48.up_proj:  34%|███▍      | 12519/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.48.down_proj:  34%|███▍      | 12520/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.49.gate_proj:  34%|███▍      | 12521/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.49.up_proj:  34%|███▍      | 12522/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.49.down_proj:  34%|███▍      | 12523/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.50.gate_proj:  34%|███▍      | 12524/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.50.up_proj:  34%|███▍      | 12525/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.50.down_proj:  34%|███▍      | 12526/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.51.gate_proj:  34%|███▍      | 12527/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.51.up_proj:  34%|███▍      | 12528/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.51.down_proj:  34%|███▍      | 12529/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.52.gate_proj:  34%|███▍      | 12530/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.52.up_proj:  34%|███▍      | 12531/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.52.down_proj:  34%|███▍      | 12532/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.53.gate_proj:  34%|███▍      | 12533/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.53.up_proj:  34%|███▍      | 12534/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.53.down_proj:  34%|███▍      | 12535/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.54.gate_proj:  34%|███▍      | 12536/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.54.up_proj:  34%|███▍      | 12537/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.54.down_proj:  34%|███▍      | 12538/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.55.gate_proj:  34%|███▍      | 12539/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.55.up_proj:  34%|███▍      | 12540/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.55.down_proj:  34%|███▍      | 12541/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.56.gate_proj:  34%|███▍      | 12542/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.56.up_proj:  34%|███▍      | 12543/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.56.down_proj:  34%|███▍      | 12544/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.57.gate_proj:  34%|███▍      | 12545/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.57.up_proj:  34%|███▍      | 12546/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.57.down_proj:  34%|███▍      | 12547/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.58.gate_proj:  34%|███▍      | 12548/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.58.up_proj:  34%|███▍      | 12549/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.58.down_proj:  34%|███▍      | 12550/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.59.gate_proj:  34%|███▍      | 12551/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.59.up_proj:  34%|███▍      | 12552/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.59.down_proj:  34%|███▍      | 12553/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.60.gate_proj:  34%|███▍      | 12554/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.60.up_proj:  34%|███▍      | 12555/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.60.down_proj:  34%|███▍      | 12556/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.61.gate_proj:  34%|███▍      | 12557/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.61.up_proj:  34%|███▍      | 12558/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.61.down_proj:  34%|███▍      | 12559/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.62.gate_proj:  34%|███▍      | 12560/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.62.up_proj:  34%|███▍      | 12561/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.62.down_proj:  34%|███▍      | 12562/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.63.gate_proj:  34%|███▍      | 12563/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.63.up_proj:  34%|███▍      | 12564/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.63.down_proj:  34%|███▍      | 12565/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.64.gate_proj:  34%|███▍      | 12566/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.64.up_proj:  34%|███▍      | 12567/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.64.down_proj:  34%|███▍      | 12568/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.65.gate_proj:  34%|███▍      | 12569/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.65.up_proj:  34%|███▍      | 12570/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.65.down_proj:  34%|███▍      | 12571/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.66.gate_proj:  34%|███▍      | 12572/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.66.up_proj:  34%|███▍      | 12573/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.66.down_proj:  34%|███▍      | 12574/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.67.gate_proj:  34%|███▍      | 12575/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.67.up_proj:  34%|███▍      | 12576/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.67.down_proj:  34%|███▍      | 12577/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.68.gate_proj:  34%|███▍      | 12578/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.68.up_proj:  34%|███▍      | 12579/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.68.down_proj:  34%|███▍      | 12580/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.69.gate_proj:  34%|███▍      | 12581/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.69.up_proj:  34%|███▍      | 12582/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.69.down_proj:  34%|███▍      | 12583/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.70.gate_proj:  34%|███▍      | 12584/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.70.up_proj:  34%|███▍      | 12585/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.70.down_proj:  34%|███▍      | 12586/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.71.gate_proj:  34%|███▍      | 12587/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.71.up_proj:  34%|███▍      | 12588/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.71.down_proj:  34%|███▍      | 12589/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.72.gate_proj:  34%|███▍      | 12590/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.72.up_proj:  34%|███▍      | 12591/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.72.down_proj:  34%|███▍      | 12592/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.73.gate_proj:  34%|███▍      | 12593/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.73.up_proj:  34%|███▍      | 12594/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.73.down_proj:  34%|███▍      | 12595/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.74.gate_proj:  34%|███▍      | 12596/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.74.up_proj:  34%|███▍      | 12597/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.74.down_proj:  34%|███▍      | 12598/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.75.gate_proj:  34%|███▍      | 12599/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.75.up_proj:  34%|███▍      | 12600/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.75.down_proj:  34%|███▍      | 12601/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.76.gate_proj:  34%|███▍      | 12602/36566 [00:11<00:20, 1166.33it/s]
packing model.layers.31.mlp.experts.76.up_proj:  34%|███▍      | 12603/36566 [00:11<00:20, 1166.33it/s]  
packing model.layers.31.mlp.experts.76.up_proj:  34%|███▍      | 12604/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.76.down_proj:  34%|███▍      | 12604/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.77.gate_proj:  34%|███▍      | 12605/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.77.up_proj:  34%|███▍      | 12606/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.77.down_proj:  34%|███▍      | 12607/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.78.gate_proj:  34%|███▍      | 12608/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.78.up_proj:  34%|███▍      | 12609/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.78.down_proj:  34%|███▍      | 12610/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.79.gate_proj:  34%|███▍      | 12611/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.79.up_proj:  34%|███▍      | 12612/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.79.down_proj:  34%|███▍      | 12613/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.80.gate_proj:  34%|███▍      | 12614/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.80.up_proj:  34%|███▍      | 12615/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.80.down_proj:  35%|███▍      | 12616/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.81.gate_proj:  35%|███▍      | 12617/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.81.up_proj:  35%|███▍      | 12618/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.81.down_proj:  35%|███▍      | 12619/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.82.gate_proj:  35%|███▍      | 12620/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.82.up_proj:  35%|███▍      | 12621/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.82.down_proj:  35%|███▍      | 12622/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.83.gate_proj:  35%|███▍      | 12623/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.83.up_proj:  35%|███▍      | 12624/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.83.down_proj:  35%|███▍      | 12625/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.84.gate_proj:  35%|███▍      | 12626/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.84.up_proj:  35%|███▍      | 12627/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.84.down_proj:  35%|███▍      | 12628/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.85.gate_proj:  35%|███▍      | 12629/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.85.up_proj:  35%|███▍      | 12630/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.85.down_proj:  35%|███▍      | 12631/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.86.gate_proj:  35%|███▍      | 12632/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.86.up_proj:  35%|███▍      | 12633/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.86.down_proj:  35%|███▍      | 12634/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.87.gate_proj:  35%|███▍      | 12635/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.87.up_proj:  35%|███▍      | 12636/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.87.down_proj:  35%|███▍      | 12637/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.88.gate_proj:  35%|███▍      | 12638/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.88.up_proj:  35%|███▍      | 12639/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.88.down_proj:  35%|███▍      | 12640/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.89.gate_proj:  35%|███▍      | 12641/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.89.up_proj:  35%|███▍      | 12642/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.89.down_proj:  35%|███▍      | 12643/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.90.gate_proj:  35%|███▍      | 12644/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.90.up_proj:  35%|███▍      | 12645/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.90.down_proj:  35%|███▍      | 12646/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.91.gate_proj:  35%|███▍      | 12647/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.91.up_proj:  35%|███▍      | 12648/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.91.down_proj:  35%|███▍      | 12649/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.92.gate_proj:  35%|███▍      | 12650/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.92.up_proj:  35%|███▍      | 12651/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.92.down_proj:  35%|███▍      | 12652/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.93.gate_proj:  35%|███▍      | 12653/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.93.up_proj:  35%|███▍      | 12654/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.93.down_proj:  35%|███▍      | 12655/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.94.gate_proj:  35%|███▍      | 12656/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.94.up_proj:  35%|███▍      | 12657/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.94.down_proj:  35%|███▍      | 12658/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.95.gate_proj:  35%|███▍      | 12659/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.95.up_proj:  35%|███▍      | 12660/36566 [00:11<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.95.down_proj:  35%|███▍      | 12661/36566 [00:11<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.96.gate_proj:  35%|███▍      | 12662/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.96.up_proj:  35%|███▍      | 12663/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.96.down_proj:  35%|███▍      | 12664/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.97.gate_proj:  35%|███▍      | 12665/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.97.up_proj:  35%|███▍      | 12666/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.97.down_proj:  35%|███▍      | 12667/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.98.gate_proj:  35%|███▍      | 12668/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.98.up_proj:  35%|███▍      | 12669/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.98.down_proj:  35%|███▍      | 12670/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.99.gate_proj:  35%|███▍      | 12671/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.99.up_proj:  35%|███▍      | 12672/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.99.down_proj:  35%|███▍      | 12673/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.100.gate_proj:  35%|███▍      | 12674/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.100.up_proj:  35%|███▍      | 12675/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.100.down_proj:  35%|███▍      | 12676/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.101.gate_proj:  35%|███▍      | 12677/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.101.up_proj:  35%|███▍      | 12678/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.101.down_proj:  35%|███▍      | 12679/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.102.gate_proj:  35%|███▍      | 12680/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.102.up_proj:  35%|███▍      | 12681/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.102.down_proj:  35%|███▍      | 12682/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.103.gate_proj:  35%|███▍      | 12683/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.103.up_proj:  35%|███▍      | 12684/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.103.down_proj:  35%|███▍      | 12685/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.104.gate_proj:  35%|███▍      | 12686/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.104.up_proj:  35%|███▍      | 12687/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.104.down_proj:  35%|███▍      | 12688/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.105.gate_proj:  35%|███▍      | 12689/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.105.up_proj:  35%|███▍      | 12690/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.105.down_proj:  35%|███▍      | 12691/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.106.gate_proj:  35%|███▍      | 12692/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.106.up_proj:  35%|███▍      | 12693/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.106.down_proj:  35%|███▍      | 12694/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.107.gate_proj:  35%|███▍      | 12695/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.107.up_proj:  35%|███▍      | 12696/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.107.down_proj:  35%|███▍      | 12697/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.108.gate_proj:  35%|███▍      | 12698/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.108.up_proj:  35%|███▍      | 12699/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.108.down_proj:  35%|███▍      | 12700/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.109.gate_proj:  35%|███▍      | 12701/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.109.up_proj:  35%|███▍      | 12702/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.109.down_proj:  35%|███▍      | 12703/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.110.gate_proj:  35%|███▍      | 12704/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.110.up_proj:  35%|███▍      | 12705/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.110.down_proj:  35%|███▍      | 12706/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.111.gate_proj:  35%|███▍      | 12707/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.111.up_proj:  35%|███▍      | 12708/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.111.down_proj:  35%|███▍      | 12709/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.112.gate_proj:  35%|███▍      | 12710/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.112.up_proj:  35%|███▍      | 12711/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.112.down_proj:  35%|███▍      | 12712/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.113.gate_proj:  35%|███▍      | 12713/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.113.up_proj:  35%|███▍      | 12714/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.113.down_proj:  35%|███▍      | 12715/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.114.gate_proj:  35%|███▍      | 12716/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.114.up_proj:  35%|███▍      | 12717/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.114.down_proj:  35%|███▍      | 12718/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.115.gate_proj:  35%|███▍      | 12719/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.115.up_proj:  35%|███▍      | 12720/36566 [00:12<00:20, 1167.68it/s]  
packing model.layers.31.mlp.experts.115.down_proj:  35%|███▍      | 12721/36566 [00:12<00:20, 1167.68it/s]
packing model.layers.31.mlp.experts.115.down_proj:  35%|███▍      | 12722/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.116.gate_proj:  35%|███▍      | 12722/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.116.up_proj:  35%|███▍      | 12723/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.116.down_proj:  35%|███▍      | 12724/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.117.gate_proj:  35%|███▍      | 12725/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.117.up_proj:  35%|███▍      | 12726/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.117.down_proj:  35%|███▍      | 12727/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.118.gate_proj:  35%|███▍      | 12728/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.118.up_proj:  35%|███▍      | 12729/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.118.down_proj:  35%|███▍      | 12730/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.119.gate_proj:  35%|███▍      | 12731/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.119.up_proj:  35%|███▍      | 12732/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.119.down_proj:  35%|███▍      | 12733/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.120.gate_proj:  35%|███▍      | 12734/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.120.up_proj:  35%|███▍      | 12735/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.120.down_proj:  35%|███▍      | 12736/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.121.gate_proj:  35%|███▍      | 12737/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.121.up_proj:  35%|███▍      | 12738/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.121.down_proj:  35%|███▍      | 12739/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.122.gate_proj:  35%|███▍      | 12740/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.122.up_proj:  35%|███▍      | 12741/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.122.down_proj:  35%|███▍      | 12742/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.123.gate_proj:  35%|███▍      | 12743/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.123.up_proj:  35%|███▍      | 12744/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.123.down_proj:  35%|███▍      | 12745/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.124.gate_proj:  35%|███▍      | 12746/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.124.up_proj:  35%|███▍      | 12747/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.124.down_proj:  35%|███▍      | 12748/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.125.gate_proj:  35%|███▍      | 12749/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.125.up_proj:  35%|███▍      | 12750/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.125.down_proj:  35%|███▍      | 12751/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.126.gate_proj:  35%|███▍      | 12752/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.126.up_proj:  35%|███▍      | 12753/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.126.down_proj:  35%|███▍      | 12754/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.127.gate_proj:  35%|███▍      | 12755/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.31.mlp.experts.127.up_proj:  35%|███▍      | 12756/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.31.mlp.experts.127.down_proj:  35%|███▍      | 12757/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.0.gate_proj:  35%|███▍      | 12758/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.0.up_proj:  35%|███▍      | 12759/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.0.down_proj:  35%|███▍      | 12760/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.1.gate_proj:  35%|███▍      | 12761/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.1.up_proj:  35%|███▍      | 12762/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.1.down_proj:  35%|███▍      | 12763/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.2.gate_proj:  35%|███▍      | 12764/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.2.up_proj:  35%|███▍      | 12765/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.2.down_proj:  35%|███▍      | 12766/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.3.gate_proj:  35%|███▍      | 12767/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.3.up_proj:  35%|███▍      | 12768/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.3.down_proj:  35%|███▍      | 12769/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.4.gate_proj:  35%|███▍      | 12770/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.4.up_proj:  35%|███▍      | 12771/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.4.down_proj:  35%|███▍      | 12772/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.5.gate_proj:  35%|███▍      | 12773/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.5.up_proj:  35%|███▍      | 12774/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.5.down_proj:  35%|███▍      | 12775/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.6.gate_proj:  35%|███▍      | 12776/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.6.up_proj:  35%|███▍      | 12777/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.6.down_proj:  35%|███▍      | 12778/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.7.gate_proj:  35%|███▍      | 12779/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.7.up_proj:  35%|███▍      | 12780/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.7.down_proj:  35%|███▍      | 12781/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.8.gate_proj:  35%|███▍      | 12782/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.8.up_proj:  35%|███▍      | 12783/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.8.down_proj:  35%|███▍      | 12784/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.9.gate_proj:  35%|███▍      | 12785/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.9.up_proj:  35%|███▍      | 12786/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.9.down_proj:  35%|███▍      | 12787/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.10.gate_proj:  35%|███▍      | 12788/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.10.up_proj:  35%|███▍      | 12789/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.10.down_proj:  35%|███▍      | 12790/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.11.gate_proj:  35%|███▍      | 12791/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.11.up_proj:  35%|███▍      | 12792/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.11.down_proj:  35%|███▍      | 12793/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.12.gate_proj:  35%|███▍      | 12794/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.12.up_proj:  35%|███▍      | 12795/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.12.down_proj:  35%|███▍      | 12796/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.13.gate_proj:  35%|███▍      | 12797/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.13.up_proj:  35%|███▍      | 12798/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.13.down_proj:  35%|███▌      | 12799/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.14.gate_proj:  35%|███▌      | 12800/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.14.up_proj:  35%|███▌      | 12801/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.14.down_proj:  35%|███▌      | 12802/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.15.gate_proj:  35%|███▌      | 12803/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.15.up_proj:  35%|███▌      | 12804/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.15.down_proj:  35%|███▌      | 12805/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.16.gate_proj:  35%|███▌      | 12806/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.16.up_proj:  35%|███▌      | 12807/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.16.down_proj:  35%|███▌      | 12808/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.17.gate_proj:  35%|███▌      | 12809/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.17.up_proj:  35%|███▌      | 12810/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.17.down_proj:  35%|███▌      | 12811/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.18.gate_proj:  35%|███▌      | 12812/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.18.up_proj:  35%|███▌      | 12813/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.18.down_proj:  35%|███▌      | 12814/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.19.gate_proj:  35%|███▌      | 12815/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.19.up_proj:  35%|███▌      | 12816/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.19.down_proj:  35%|███▌      | 12817/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.20.gate_proj:  35%|███▌      | 12818/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.20.up_proj:  35%|███▌      | 12819/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.20.down_proj:  35%|███▌      | 12820/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.21.gate_proj:  35%|███▌      | 12821/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.21.up_proj:  35%|███▌      | 12822/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.21.down_proj:  35%|███▌      | 12823/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.22.gate_proj:  35%|███▌      | 12824/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.22.up_proj:  35%|███▌      | 12825/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.22.down_proj:  35%|███▌      | 12826/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.23.gate_proj:  35%|███▌      | 12827/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.23.up_proj:  35%|███▌      | 12828/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.23.down_proj:  35%|███▌      | 12829/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.24.gate_proj:  35%|███▌      | 12830/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.24.up_proj:  35%|███▌      | 12831/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.24.down_proj:  35%|███▌      | 12832/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.25.gate_proj:  35%|███▌      | 12833/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.25.up_proj:  35%|███▌      | 12834/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.25.down_proj:  35%|███▌      | 12835/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.26.gate_proj:  35%|███▌      | 12836/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.26.up_proj:  35%|███▌      | 12837/36566 [00:12<00:20, 1168.94it/s]  
packing model.layers.32.mlp.experts.26.down_proj:  35%|███▌      | 12838/36566 [00:12<00:20, 1168.94it/s]
packing model.layers.32.mlp.experts.26.down_proj:  35%|███▌      | 12839/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.27.gate_proj:  35%|███▌      | 12839/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.27.up_proj:  35%|███▌      | 12840/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.27.down_proj:  35%|███▌      | 12841/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.28.gate_proj:  35%|███▌      | 12842/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.28.up_proj:  35%|███▌      | 12843/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.28.down_proj:  35%|███▌      | 12844/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.29.gate_proj:  35%|███▌      | 12845/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.29.up_proj:  35%|███▌      | 12846/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.29.down_proj:  35%|███▌      | 12847/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.30.gate_proj:  35%|███▌      | 12848/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.30.up_proj:  35%|███▌      | 12849/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.30.down_proj:  35%|███▌      | 12850/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.31.gate_proj:  35%|███▌      | 12851/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.31.up_proj:  35%|███▌      | 12852/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.31.down_proj:  35%|███▌      | 12853/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.32.gate_proj:  35%|███▌      | 12854/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.32.up_proj:  35%|███▌      | 12855/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.32.down_proj:  35%|███▌      | 12856/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.33.gate_proj:  35%|███▌      | 12857/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.33.up_proj:  35%|███▌      | 12858/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.33.down_proj:  35%|███▌      | 12859/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.34.gate_proj:  35%|███▌      | 12860/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.34.up_proj:  35%|███▌      | 12861/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.34.down_proj:  35%|███▌      | 12862/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.35.gate_proj:  35%|███▌      | 12863/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.35.up_proj:  35%|███▌      | 12864/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.35.down_proj:  35%|███▌      | 12865/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.36.gate_proj:  35%|███▌      | 12866/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.36.up_proj:  35%|███▌      | 12867/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.36.down_proj:  35%|███▌      | 12868/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.37.gate_proj:  35%|███▌      | 12869/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.37.up_proj:  35%|███▌      | 12870/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.37.down_proj:  35%|███▌      | 12871/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.38.gate_proj:  35%|███▌      | 12872/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.38.up_proj:  35%|███▌      | 12873/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.38.down_proj:  35%|███▌      | 12874/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.39.gate_proj:  35%|███▌      | 12875/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.39.up_proj:  35%|███▌      | 12876/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.39.down_proj:  35%|███▌      | 12877/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.40.gate_proj:  35%|███▌      | 12878/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.40.up_proj:  35%|███▌      | 12879/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.40.down_proj:  35%|███▌      | 12880/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.41.gate_proj:  35%|███▌      | 12881/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.41.up_proj:  35%|███▌      | 12882/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.41.down_proj:  35%|███▌      | 12883/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.42.gate_proj:  35%|███▌      | 12884/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.42.up_proj:  35%|███▌      | 12885/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.42.down_proj:  35%|███▌      | 12886/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.43.gate_proj:  35%|███▌      | 12887/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.43.up_proj:  35%|███▌      | 12888/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.43.down_proj:  35%|███▌      | 12889/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.44.gate_proj:  35%|███▌      | 12890/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.44.up_proj:  35%|███▌      | 12891/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.44.down_proj:  35%|███▌      | 12892/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.45.gate_proj:  35%|███▌      | 12893/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.45.up_proj:  35%|███▌      | 12894/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.45.down_proj:  35%|███▌      | 12895/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.46.gate_proj:  35%|███▌      | 12896/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.46.up_proj:  35%|███▌      | 12897/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.46.down_proj:  35%|███▌      | 12898/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.47.gate_proj:  35%|███▌      | 12899/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.47.up_proj:  35%|███▌      | 12900/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.47.down_proj:  35%|███▌      | 12901/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.48.gate_proj:  35%|███▌      | 12902/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.48.up_proj:  35%|███▌      | 12903/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.48.down_proj:  35%|███▌      | 12904/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.49.gate_proj:  35%|███▌      | 12905/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.49.up_proj:  35%|███▌      | 12906/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.49.down_proj:  35%|███▌      | 12907/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.50.gate_proj:  35%|███▌      | 12908/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.50.up_proj:  35%|███▌      | 12909/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.50.down_proj:  35%|███▌      | 12910/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.51.gate_proj:  35%|███▌      | 12911/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.51.up_proj:  35%|███▌      | 12912/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.51.down_proj:  35%|███▌      | 12913/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.52.gate_proj:  35%|███▌      | 12914/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.52.up_proj:  35%|███▌      | 12915/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.52.down_proj:  35%|███▌      | 12916/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.53.gate_proj:  35%|███▌      | 12917/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.53.up_proj:  35%|███▌      | 12918/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.53.down_proj:  35%|███▌      | 12919/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.54.gate_proj:  35%|███▌      | 12920/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.54.up_proj:  35%|███▌      | 12921/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.54.down_proj:  35%|███▌      | 12922/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.55.gate_proj:  35%|███▌      | 12923/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.55.up_proj:  35%|███▌      | 12924/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.55.down_proj:  35%|███▌      | 12925/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.56.gate_proj:  35%|███▌      | 12926/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.56.up_proj:  35%|███▌      | 12927/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.56.down_proj:  35%|███▌      | 12928/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.57.gate_proj:  35%|███▌      | 12929/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.57.up_proj:  35%|███▌      | 12930/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.57.down_proj:  35%|███▌      | 12931/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.58.gate_proj:  35%|███▌      | 12932/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.58.up_proj:  35%|███▌      | 12933/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.58.down_proj:  35%|███▌      | 12934/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.59.gate_proj:  35%|███▌      | 12935/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.59.up_proj:  35%|███▌      | 12936/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.59.down_proj:  35%|███▌      | 12937/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.60.gate_proj:  35%|███▌      | 12938/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.60.up_proj:  35%|███▌      | 12939/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.60.down_proj:  35%|███▌      | 12940/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.61.gate_proj:  35%|███▌      | 12941/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.61.up_proj:  35%|███▌      | 12942/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.61.down_proj:  35%|███▌      | 12943/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.62.gate_proj:  35%|███▌      | 12944/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.62.up_proj:  35%|███▌      | 12945/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.62.down_proj:  35%|███▌      | 12946/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.63.gate_proj:  35%|███▌      | 12947/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.63.up_proj:  35%|███▌      | 12948/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.63.down_proj:  35%|███▌      | 12949/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.64.gate_proj:  35%|███▌      | 12950/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.64.up_proj:  35%|███▌      | 12951/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.64.down_proj:  35%|███▌      | 12952/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.65.gate_proj:  35%|███▌      | 12953/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.65.up_proj:  35%|███▌      | 12954/36566 [00:12<00:20, 1169.10it/s]  
packing model.layers.32.mlp.experts.65.down_proj:  35%|███▌      | 12955/36566 [00:12<00:20, 1169.10it/s]
packing model.layers.32.mlp.experts.65.down_proj:  35%|███▌      | 12956/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.66.gate_proj:  35%|███▌      | 12956/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.66.up_proj:  35%|███▌      | 12957/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.66.down_proj:  35%|███▌      | 12958/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.67.gate_proj:  35%|███▌      | 12959/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.67.up_proj:  35%|███▌      | 12960/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.67.down_proj:  35%|███▌      | 12961/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.68.gate_proj:  35%|███▌      | 12962/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.68.up_proj:  35%|███▌      | 12963/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.68.down_proj:  35%|███▌      | 12964/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.69.gate_proj:  35%|███▌      | 12965/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.69.up_proj:  35%|███▌      | 12966/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.69.down_proj:  35%|███▌      | 12967/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.70.gate_proj:  35%|███▌      | 12968/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.70.up_proj:  35%|███▌      | 12969/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.70.down_proj:  35%|███▌      | 12970/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.71.gate_proj:  35%|███▌      | 12971/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.71.up_proj:  35%|███▌      | 12972/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.71.down_proj:  35%|███▌      | 12973/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.72.gate_proj:  35%|███▌      | 12974/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.72.up_proj:  35%|███▌      | 12975/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.72.down_proj:  35%|███▌      | 12976/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.73.gate_proj:  35%|███▌      | 12977/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.73.up_proj:  35%|███▌      | 12978/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.73.down_proj:  35%|███▌      | 12979/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.74.gate_proj:  35%|███▌      | 12980/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.74.up_proj:  36%|███▌      | 12981/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.74.down_proj:  36%|███▌      | 12982/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.75.gate_proj:  36%|███▌      | 12983/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.75.up_proj:  36%|███▌      | 12984/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.75.down_proj:  36%|███▌      | 12985/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.76.gate_proj:  36%|███▌      | 12986/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.76.up_proj:  36%|███▌      | 12987/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.76.down_proj:  36%|███▌      | 12988/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.77.gate_proj:  36%|███▌      | 12989/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.77.up_proj:  36%|███▌      | 12990/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.77.down_proj:  36%|███▌      | 12991/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.78.gate_proj:  36%|███▌      | 12992/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.78.up_proj:  36%|███▌      | 12993/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.78.down_proj:  36%|███▌      | 12994/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.79.gate_proj:  36%|███▌      | 12995/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.79.up_proj:  36%|███▌      | 12996/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.79.down_proj:  36%|███▌      | 12997/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.80.gate_proj:  36%|███▌      | 12998/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.80.up_proj:  36%|███▌      | 12999/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.80.down_proj:  36%|███▌      | 13000/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.81.gate_proj:  36%|███▌      | 13001/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.81.up_proj:  36%|███▌      | 13002/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.81.down_proj:  36%|███▌      | 13003/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.82.gate_proj:  36%|███▌      | 13004/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.82.up_proj:  36%|███▌      | 13005/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.82.down_proj:  36%|███▌      | 13006/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.83.gate_proj:  36%|███▌      | 13007/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.83.up_proj:  36%|███▌      | 13008/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.83.down_proj:  36%|███▌      | 13009/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.84.gate_proj:  36%|███▌      | 13010/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.84.up_proj:  36%|███▌      | 13011/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.84.down_proj:  36%|███▌      | 13012/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.85.gate_proj:  36%|███▌      | 13013/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.85.up_proj:  36%|███▌      | 13014/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.85.down_proj:  36%|███▌      | 13015/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.86.gate_proj:  36%|███▌      | 13016/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.86.up_proj:  36%|███▌      | 13017/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.86.down_proj:  36%|███▌      | 13018/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.87.gate_proj:  36%|███▌      | 13019/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.87.up_proj:  36%|███▌      | 13020/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.87.down_proj:  36%|███▌      | 13021/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.88.gate_proj:  36%|███▌      | 13022/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.88.up_proj:  36%|███▌      | 13023/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.88.down_proj:  36%|███▌      | 13024/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.89.gate_proj:  36%|███▌      | 13025/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.89.up_proj:  36%|███▌      | 13026/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.89.down_proj:  36%|███▌      | 13027/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.90.gate_proj:  36%|███▌      | 13028/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.90.up_proj:  36%|███▌      | 13029/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.90.down_proj:  36%|███▌      | 13030/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.91.gate_proj:  36%|███▌      | 13031/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.91.up_proj:  36%|███▌      | 13032/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.91.down_proj:  36%|███▌      | 13033/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.92.gate_proj:  36%|███▌      | 13034/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.92.up_proj:  36%|███▌      | 13035/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.92.down_proj:  36%|███▌      | 13036/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.93.gate_proj:  36%|███▌      | 13037/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.93.up_proj:  36%|███▌      | 13038/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.93.down_proj:  36%|███▌      | 13039/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.94.gate_proj:  36%|███▌      | 13040/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.94.up_proj:  36%|███▌      | 13041/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.94.down_proj:  36%|███▌      | 13042/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.95.gate_proj:  36%|███▌      | 13043/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.95.up_proj:  36%|███▌      | 13044/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.95.down_proj:  36%|███▌      | 13045/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.96.gate_proj:  36%|███▌      | 13046/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.96.up_proj:  36%|███▌      | 13047/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.96.down_proj:  36%|███▌      | 13048/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.97.gate_proj:  36%|███▌      | 13049/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.97.up_proj:  36%|███▌      | 13050/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.97.down_proj:  36%|███▌      | 13051/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.98.gate_proj:  36%|███▌      | 13052/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.98.up_proj:  36%|███▌      | 13053/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.98.down_proj:  36%|███▌      | 13054/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.99.gate_proj:  36%|███▌      | 13055/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.99.up_proj:  36%|███▌      | 13056/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.99.down_proj:  36%|███▌      | 13057/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.100.gate_proj:  36%|███▌      | 13058/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.100.up_proj:  36%|███▌      | 13059/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.100.down_proj:  36%|███▌      | 13060/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.101.gate_proj:  36%|███▌      | 13061/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.101.up_proj:  36%|███▌      | 13062/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.101.down_proj:  36%|███▌      | 13063/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.102.gate_proj:  36%|███▌      | 13064/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.102.up_proj:  36%|███▌      | 13065/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.102.down_proj:  36%|███▌      | 13066/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.103.gate_proj:  36%|███▌      | 13067/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.103.up_proj:  36%|███▌      | 13068/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.103.down_proj:  36%|███▌      | 13069/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.104.gate_proj:  36%|███▌      | 13070/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.104.up_proj:  36%|███▌      | 13071/36566 [00:12<00:20, 1168.72it/s]  
packing model.layers.32.mlp.experts.104.down_proj:  36%|███▌      | 13072/36566 [00:12<00:20, 1168.72it/s]
packing model.layers.32.mlp.experts.104.down_proj:  36%|███▌      | 13073/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.105.gate_proj:  36%|███▌      | 13073/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.105.up_proj:  36%|███▌      | 13074/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.105.down_proj:  36%|███▌      | 13075/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.106.gate_proj:  36%|███▌      | 13076/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.106.up_proj:  36%|███▌      | 13077/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.106.down_proj:  36%|███▌      | 13078/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.107.gate_proj:  36%|███▌      | 13079/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.107.up_proj:  36%|███▌      | 13080/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.107.down_proj:  36%|███▌      | 13081/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.108.gate_proj:  36%|███▌      | 13082/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.108.up_proj:  36%|███▌      | 13083/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.108.down_proj:  36%|███▌      | 13084/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.109.gate_proj:  36%|███▌      | 13085/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.109.up_proj:  36%|███▌      | 13086/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.109.down_proj:  36%|███▌      | 13087/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.110.gate_proj:  36%|███▌      | 13088/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.110.up_proj:  36%|███▌      | 13089/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.110.down_proj:  36%|███▌      | 13090/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.111.gate_proj:  36%|███▌      | 13091/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.111.up_proj:  36%|███▌      | 13092/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.111.down_proj:  36%|███▌      | 13093/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.112.gate_proj:  36%|███▌      | 13094/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.112.up_proj:  36%|███▌      | 13095/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.112.down_proj:  36%|███▌      | 13096/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.113.gate_proj:  36%|███▌      | 13097/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.113.up_proj:  36%|███▌      | 13098/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.113.down_proj:  36%|███▌      | 13099/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.114.gate_proj:  36%|███▌      | 13100/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.114.up_proj:  36%|███▌      | 13101/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.114.down_proj:  36%|███▌      | 13102/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.115.gate_proj:  36%|███▌      | 13103/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.115.up_proj:  36%|███▌      | 13104/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.115.down_proj:  36%|███▌      | 13105/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.116.gate_proj:  36%|███▌      | 13106/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.116.up_proj:  36%|███▌      | 13107/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.116.down_proj:  36%|███▌      | 13108/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.117.gate_proj:  36%|███▌      | 13109/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.117.up_proj:  36%|███▌      | 13110/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.117.down_proj:  36%|███▌      | 13111/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.118.gate_proj:  36%|███▌      | 13112/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.118.up_proj:  36%|███▌      | 13113/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.118.down_proj:  36%|███▌      | 13114/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.119.gate_proj:  36%|███▌      | 13115/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.119.up_proj:  36%|███▌      | 13116/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.119.down_proj:  36%|███▌      | 13117/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.120.gate_proj:  36%|███▌      | 13118/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.120.up_proj:  36%|███▌      | 13119/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.120.down_proj:  36%|███▌      | 13120/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.121.gate_proj:  36%|███▌      | 13121/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.121.up_proj:  36%|███▌      | 13122/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.121.down_proj:  36%|███▌      | 13123/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.122.gate_proj:  36%|███▌      | 13124/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.122.up_proj:  36%|███▌      | 13125/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.122.down_proj:  36%|███▌      | 13126/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.123.gate_proj:  36%|███▌      | 13127/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.123.up_proj:  36%|███▌      | 13128/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.123.down_proj:  36%|███▌      | 13129/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.124.gate_proj:  36%|███▌      | 13130/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.124.up_proj:  36%|███▌      | 13131/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.124.down_proj:  36%|███▌      | 13132/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.125.gate_proj:  36%|███▌      | 13133/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.125.up_proj:  36%|███▌      | 13134/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.125.down_proj:  36%|███▌      | 13135/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.126.gate_proj:  36%|███▌      | 13136/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.126.up_proj:  36%|███▌      | 13137/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.126.down_proj:  36%|███▌      | 13138/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.127.gate_proj:  36%|███▌      | 13139/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.32.mlp.experts.127.up_proj:  36%|███▌      | 13140/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.32.mlp.experts.127.down_proj:  36%|███▌      | 13141/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.0.gate_proj:  36%|███▌      | 13142/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.0.up_proj:  36%|███▌      | 13143/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.0.down_proj:  36%|███▌      | 13144/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.1.gate_proj:  36%|███▌      | 13145/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.1.up_proj:  36%|███▌      | 13146/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.1.down_proj:  36%|███▌      | 13147/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.2.gate_proj:  36%|███▌      | 13148/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.2.up_proj:  36%|███▌      | 13149/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.2.down_proj:  36%|███▌      | 13150/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.3.gate_proj:  36%|███▌      | 13151/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.3.up_proj:  36%|███▌      | 13152/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.3.down_proj:  36%|███▌      | 13153/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.4.gate_proj:  36%|███▌      | 13154/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.4.up_proj:  36%|███▌      | 13155/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.4.down_proj:  36%|███▌      | 13156/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.5.gate_proj:  36%|███▌      | 13157/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.5.up_proj:  36%|███▌      | 13158/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.5.down_proj:  36%|███▌      | 13159/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.6.gate_proj:  36%|███▌      | 13160/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.6.up_proj:  36%|███▌      | 13161/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.6.down_proj:  36%|███▌      | 13162/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.7.gate_proj:  36%|███▌      | 13163/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.7.up_proj:  36%|███▌      | 13164/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.7.down_proj:  36%|███▌      | 13165/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.8.gate_proj:  36%|███▌      | 13166/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.8.up_proj:  36%|███▌      | 13167/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.8.down_proj:  36%|███▌      | 13168/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.9.gate_proj:  36%|███▌      | 13169/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.9.up_proj:  36%|███▌      | 13170/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.9.down_proj:  36%|███▌      | 13171/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.10.gate_proj:  36%|███▌      | 13172/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.10.up_proj:  36%|███▌      | 13173/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.10.down_proj:  36%|███▌      | 13174/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.11.gate_proj:  36%|███▌      | 13175/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.11.up_proj:  36%|███▌      | 13176/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.11.down_proj:  36%|███▌      | 13177/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.12.gate_proj:  36%|███▌      | 13178/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.12.up_proj:  36%|███▌      | 13179/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.12.down_proj:  36%|███▌      | 13180/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.13.gate_proj:  36%|███▌      | 13181/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.13.up_proj:  36%|███▌      | 13182/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.13.down_proj:  36%|███▌      | 13183/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.14.gate_proj:  36%|███▌      | 13184/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.14.up_proj:  36%|███▌      | 13185/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.14.down_proj:  36%|███▌      | 13186/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.15.gate_proj:  36%|███▌      | 13187/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.15.up_proj:  36%|███▌      | 13188/36566 [00:12<00:20, 1168.45it/s]  
packing model.layers.33.mlp.experts.15.down_proj:  36%|███▌      | 13189/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.16.gate_proj:  36%|███▌      | 13190/36566 [00:12<00:20, 1168.45it/s]
packing model.layers.33.mlp.experts.16.gate_proj:  36%|███▌      | 13191/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.16.up_proj:  36%|███▌      | 13191/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.16.down_proj:  36%|███▌      | 13192/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.17.gate_proj:  36%|███▌      | 13193/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.17.up_proj:  36%|███▌      | 13194/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.17.down_proj:  36%|███▌      | 13195/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.18.gate_proj:  36%|███▌      | 13196/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.18.up_proj:  36%|███▌      | 13197/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.18.down_proj:  36%|███▌      | 13198/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.19.gate_proj:  36%|███▌      | 13199/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.19.up_proj:  36%|███▌      | 13200/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.19.down_proj:  36%|███▌      | 13201/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.20.gate_proj:  36%|███▌      | 13202/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.20.up_proj:  36%|███▌      | 13203/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.20.down_proj:  36%|███▌      | 13204/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.21.gate_proj:  36%|███▌      | 13205/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.21.up_proj:  36%|███▌      | 13206/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.21.down_proj:  36%|███▌      | 13207/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.22.gate_proj:  36%|███▌      | 13208/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.22.up_proj:  36%|███▌      | 13209/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.22.down_proj:  36%|███▌      | 13210/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.23.gate_proj:  36%|███▌      | 13211/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.23.up_proj:  36%|███▌      | 13212/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.23.down_proj:  36%|███▌      | 13213/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.24.gate_proj:  36%|███▌      | 13214/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.24.up_proj:  36%|███▌      | 13215/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.24.down_proj:  36%|███▌      | 13216/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.25.gate_proj:  36%|███▌      | 13217/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.25.up_proj:  36%|███▌      | 13218/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.25.down_proj:  36%|███▌      | 13219/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.26.gate_proj:  36%|███▌      | 13220/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.26.up_proj:  36%|███▌      | 13221/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.26.down_proj:  36%|███▌      | 13222/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.27.gate_proj:  36%|███▌      | 13223/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.27.up_proj:  36%|███▌      | 13224/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.27.down_proj:  36%|███▌      | 13225/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.28.gate_proj:  36%|███▌      | 13226/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.28.up_proj:  36%|███▌      | 13227/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.28.down_proj:  36%|███▌      | 13228/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.29.gate_proj:  36%|███▌      | 13229/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.29.up_proj:  36%|███▌      | 13230/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.29.down_proj:  36%|███▌      | 13231/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.30.gate_proj:  36%|███▌      | 13232/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.30.up_proj:  36%|███▌      | 13233/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.30.down_proj:  36%|███▌      | 13234/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.31.gate_proj:  36%|███▌      | 13235/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.31.up_proj:  36%|███▌      | 13236/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.31.down_proj:  36%|███▌      | 13237/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.32.gate_proj:  36%|███▌      | 13238/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.32.up_proj:  36%|███▌      | 13239/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.32.down_proj:  36%|███▌      | 13240/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.33.gate_proj:  36%|███▌      | 13241/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.33.up_proj:  36%|███▌      | 13242/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.33.down_proj:  36%|███▌      | 13243/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.34.gate_proj:  36%|███▌      | 13244/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.34.up_proj:  36%|███▌      | 13245/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.34.down_proj:  36%|███▌      | 13246/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.35.gate_proj:  36%|███▌      | 13247/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.35.up_proj:  36%|███▌      | 13248/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.35.down_proj:  36%|███▌      | 13249/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.36.gate_proj:  36%|███▌      | 13250/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.36.up_proj:  36%|███▌      | 13251/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.36.down_proj:  36%|███▌      | 13252/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.37.gate_proj:  36%|███▌      | 13253/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.37.up_proj:  36%|███▌      | 13254/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.37.down_proj:  36%|███▌      | 13255/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.38.gate_proj:  36%|███▋      | 13256/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.38.up_proj:  36%|███▋      | 13257/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.38.down_proj:  36%|███▋      | 13258/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.39.gate_proj:  36%|███▋      | 13259/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.39.up_proj:  36%|███▋      | 13260/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.39.down_proj:  36%|███▋      | 13261/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.40.gate_proj:  36%|███▋      | 13262/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.40.up_proj:  36%|███▋      | 13263/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.40.down_proj:  36%|███▋      | 13264/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.41.gate_proj:  36%|███▋      | 13265/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.41.up_proj:  36%|███▋      | 13266/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.41.down_proj:  36%|███▋      | 13267/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.42.gate_proj:  36%|███▋      | 13268/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.42.up_proj:  36%|███▋      | 13269/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.42.down_proj:  36%|███▋      | 13270/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.43.gate_proj:  36%|███▋      | 13271/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.43.up_proj:  36%|███▋      | 13272/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.43.down_proj:  36%|███▋      | 13273/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.44.gate_proj:  36%|███▋      | 13274/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.44.up_proj:  36%|███▋      | 13275/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.44.down_proj:  36%|███▋      | 13276/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.45.gate_proj:  36%|███▋      | 13277/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.45.up_proj:  36%|███▋      | 13278/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.45.down_proj:  36%|███▋      | 13279/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.46.gate_proj:  36%|███▋      | 13280/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.46.up_proj:  36%|███▋      | 13281/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.46.down_proj:  36%|███▋      | 13282/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.47.gate_proj:  36%|███▋      | 13283/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.47.up_proj:  36%|███▋      | 13284/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.47.down_proj:  36%|███▋      | 13285/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.48.gate_proj:  36%|███▋      | 13286/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.48.up_proj:  36%|███▋      | 13287/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.48.down_proj:  36%|███▋      | 13288/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.49.gate_proj:  36%|███▋      | 13289/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.49.up_proj:  36%|███▋      | 13290/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.49.down_proj:  36%|███▋      | 13291/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.50.gate_proj:  36%|███▋      | 13292/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.50.up_proj:  36%|███▋      | 13293/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.50.down_proj:  36%|███▋      | 13294/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.51.gate_proj:  36%|███▋      | 13295/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.51.up_proj:  36%|███▋      | 13296/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.51.down_proj:  36%|███▋      | 13297/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.52.gate_proj:  36%|███▋      | 13298/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.52.up_proj:  36%|███▋      | 13299/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.52.down_proj:  36%|███▋      | 13300/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.53.gate_proj:  36%|███▋      | 13301/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.53.up_proj:  36%|███▋      | 13302/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.53.down_proj:  36%|███▋      | 13303/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.54.gate_proj:  36%|███▋      | 13304/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.54.up_proj:  36%|███▋      | 13305/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.54.down_proj:  36%|███▋      | 13306/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.55.gate_proj:  36%|███▋      | 13307/36566 [00:12<00:19, 1170.47it/s]
packing model.layers.33.mlp.experts.55.up_proj:  36%|███▋      | 13308/36566 [00:12<00:19, 1170.47it/s]  
packing model.layers.33.mlp.experts.55.up_proj:  36%|███▋      | 13309/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.55.down_proj:  36%|███▋      | 13309/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.56.gate_proj:  36%|███▋      | 13310/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.56.up_proj:  36%|███▋      | 13311/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.56.down_proj:  36%|███▋      | 13312/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.57.gate_proj:  36%|███▋      | 13313/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.57.up_proj:  36%|███▋      | 13314/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.57.down_proj:  36%|███▋      | 13315/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.58.gate_proj:  36%|███▋      | 13316/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.58.up_proj:  36%|███▋      | 13317/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.58.down_proj:  36%|███▋      | 13318/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.59.gate_proj:  36%|███▋      | 13319/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.59.up_proj:  36%|███▋      | 13320/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.59.down_proj:  36%|███▋      | 13321/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.60.gate_proj:  36%|███▋      | 13322/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.60.up_proj:  36%|███▋      | 13323/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.60.down_proj:  36%|███▋      | 13324/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.61.gate_proj:  36%|███▋      | 13325/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.61.up_proj:  36%|███▋      | 13326/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.61.down_proj:  36%|███▋      | 13327/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.62.gate_proj:  36%|███▋      | 13328/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.62.up_proj:  36%|███▋      | 13329/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.62.down_proj:  36%|███▋      | 13330/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.63.gate_proj:  36%|███▋      | 13331/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.63.up_proj:  36%|███▋      | 13332/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.63.down_proj:  36%|███▋      | 13333/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.64.gate_proj:  36%|███▋      | 13334/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.64.up_proj:  36%|███▋      | 13335/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.64.down_proj:  36%|███▋      | 13336/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.65.gate_proj:  36%|███▋      | 13337/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.65.up_proj:  36%|███▋      | 13338/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.65.down_proj:  36%|███▋      | 13339/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.66.gate_proj:  36%|███▋      | 13340/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.66.up_proj:  36%|███▋      | 13341/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.66.down_proj:  36%|███▋      | 13342/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.67.gate_proj:  36%|███▋      | 13343/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.67.up_proj:  36%|███▋      | 13344/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.67.down_proj:  36%|███▋      | 13345/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.68.gate_proj:  36%|███▋      | 13346/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.68.up_proj:  37%|███▋      | 13347/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.68.down_proj:  37%|███▋      | 13348/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.69.gate_proj:  37%|███▋      | 13349/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.69.up_proj:  37%|███▋      | 13350/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.69.down_proj:  37%|███▋      | 13351/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.70.gate_proj:  37%|███▋      | 13352/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.70.up_proj:  37%|███▋      | 13353/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.70.down_proj:  37%|███▋      | 13354/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.71.gate_proj:  37%|███▋      | 13355/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.71.up_proj:  37%|███▋      | 13356/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.71.down_proj:  37%|███▋      | 13357/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.72.gate_proj:  37%|███▋      | 13358/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.72.up_proj:  37%|███▋      | 13359/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.72.down_proj:  37%|███▋      | 13360/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.73.gate_proj:  37%|███▋      | 13361/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.73.up_proj:  37%|███▋      | 13362/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.73.down_proj:  37%|███▋      | 13363/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.74.gate_proj:  37%|███▋      | 13364/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.74.up_proj:  37%|███▋      | 13365/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.74.down_proj:  37%|███▋      | 13366/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.75.gate_proj:  37%|███▋      | 13367/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.75.up_proj:  37%|███▋      | 13368/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.75.down_proj:  37%|███▋      | 13369/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.76.gate_proj:  37%|███▋      | 13370/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.76.up_proj:  37%|███▋      | 13371/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.76.down_proj:  37%|███▋      | 13372/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.77.gate_proj:  37%|███▋      | 13373/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.77.up_proj:  37%|███▋      | 13374/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.77.down_proj:  37%|███▋      | 13375/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.78.gate_proj:  37%|███▋      | 13376/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.78.up_proj:  37%|███▋      | 13377/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.78.down_proj:  37%|███▋      | 13378/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.79.gate_proj:  37%|███▋      | 13379/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.79.up_proj:  37%|███▋      | 13380/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.79.down_proj:  37%|███▋      | 13381/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.80.gate_proj:  37%|███▋      | 13382/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.80.up_proj:  37%|███▋      | 13383/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.80.down_proj:  37%|███▋      | 13384/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.81.gate_proj:  37%|███▋      | 13385/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.81.up_proj:  37%|███▋      | 13386/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.81.down_proj:  37%|███▋      | 13387/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.82.gate_proj:  37%|███▋      | 13388/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.82.up_proj:  37%|███▋      | 13389/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.82.down_proj:  37%|███▋      | 13390/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.83.gate_proj:  37%|███▋      | 13391/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.83.up_proj:  37%|███▋      | 13392/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.83.down_proj:  37%|███▋      | 13393/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.84.gate_proj:  37%|███▋      | 13394/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.84.up_proj:  37%|███▋      | 13395/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.84.down_proj:  37%|███▋      | 13396/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.85.gate_proj:  37%|███▋      | 13397/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.85.up_proj:  37%|███▋      | 13398/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.85.down_proj:  37%|███▋      | 13399/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.86.gate_proj:  37%|███▋      | 13400/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.86.up_proj:  37%|███▋      | 13401/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.86.down_proj:  37%|███▋      | 13402/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.87.gate_proj:  37%|███▋      | 13403/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.87.up_proj:  37%|███▋      | 13404/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.87.down_proj:  37%|███▋      | 13405/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.88.gate_proj:  37%|███▋      | 13406/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.88.up_proj:  37%|███▋      | 13407/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.88.down_proj:  37%|███▋      | 13408/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.89.gate_proj:  37%|███▋      | 13409/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.89.up_proj:  37%|███▋      | 13410/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.89.down_proj:  37%|███▋      | 13411/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.90.gate_proj:  37%|███▋      | 13412/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.90.up_proj:  37%|███▋      | 13413/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.90.down_proj:  37%|███▋      | 13414/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.91.gate_proj:  37%|███▋      | 13415/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.91.up_proj:  37%|███▋      | 13416/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.91.down_proj:  37%|███▋      | 13417/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.92.gate_proj:  37%|███▋      | 13418/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.92.up_proj:  37%|███▋      | 13419/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.92.down_proj:  37%|███▋      | 13420/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.93.gate_proj:  37%|███▋      | 13421/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.93.up_proj:  37%|███▋      | 13422/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.93.down_proj:  37%|███▋      | 13423/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.94.gate_proj:  37%|███▋      | 13424/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.94.up_proj:  37%|███▋      | 13425/36566 [00:12<00:19, 1171.16it/s]  
packing model.layers.33.mlp.experts.94.down_proj:  37%|███▋      | 13426/36566 [00:12<00:19, 1171.16it/s]
packing model.layers.33.mlp.experts.94.down_proj:  37%|███▋      | 13427/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.95.gate_proj:  37%|███▋      | 13427/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.95.up_proj:  37%|███▋      | 13428/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.95.down_proj:  37%|███▋      | 13429/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.96.gate_proj:  37%|███▋      | 13430/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.96.up_proj:  37%|███▋      | 13431/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.96.down_proj:  37%|███▋      | 13432/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.97.gate_proj:  37%|███▋      | 13433/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.97.up_proj:  37%|███▋      | 13434/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.97.down_proj:  37%|███▋      | 13435/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.98.gate_proj:  37%|███▋      | 13436/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.98.up_proj:  37%|███▋      | 13437/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.98.down_proj:  37%|███▋      | 13438/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.99.gate_proj:  37%|███▋      | 13439/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.99.up_proj:  37%|███▋      | 13440/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.99.down_proj:  37%|███▋      | 13441/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.100.gate_proj:  37%|███▋      | 13442/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.100.up_proj:  37%|███▋      | 13443/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.100.down_proj:  37%|███▋      | 13444/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.101.gate_proj:  37%|███▋      | 13445/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.101.up_proj:  37%|███▋      | 13446/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.101.down_proj:  37%|███▋      | 13447/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.102.gate_proj:  37%|███▋      | 13448/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.102.up_proj:  37%|███▋      | 13449/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.102.down_proj:  37%|███▋      | 13450/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.103.gate_proj:  37%|███▋      | 13451/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.103.up_proj:  37%|███▋      | 13452/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.103.down_proj:  37%|███▋      | 13453/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.104.gate_proj:  37%|███▋      | 13454/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.104.up_proj:  37%|███▋      | 13455/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.104.down_proj:  37%|███▋      | 13456/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.105.gate_proj:  37%|███▋      | 13457/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.105.up_proj:  37%|███▋      | 13458/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.105.down_proj:  37%|███▋      | 13459/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.106.gate_proj:  37%|███▋      | 13460/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.106.up_proj:  37%|███▋      | 13461/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.106.down_proj:  37%|███▋      | 13462/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.107.gate_proj:  37%|███▋      | 13463/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.107.up_proj:  37%|███▋      | 13464/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.107.down_proj:  37%|███▋      | 13465/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.108.gate_proj:  37%|███▋      | 13466/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.108.up_proj:  37%|███▋      | 13467/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.108.down_proj:  37%|███▋      | 13468/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.109.gate_proj:  37%|███▋      | 13469/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.109.up_proj:  37%|███▋      | 13470/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.109.down_proj:  37%|███▋      | 13471/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.110.gate_proj:  37%|███▋      | 13472/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.110.up_proj:  37%|███▋      | 13473/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.110.down_proj:  37%|███▋      | 13474/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.111.gate_proj:  37%|███▋      | 13475/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.111.up_proj:  37%|███▋      | 13476/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.111.down_proj:  37%|███▋      | 13477/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.112.gate_proj:  37%|███▋      | 13478/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.112.up_proj:  37%|███▋      | 13479/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.112.down_proj:  37%|███▋      | 13480/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.113.gate_proj:  37%|███▋      | 13481/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.113.up_proj:  37%|███▋      | 13482/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.113.down_proj:  37%|███▋      | 13483/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.114.gate_proj:  37%|███▋      | 13484/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.114.up_proj:  37%|███▋      | 13485/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.114.down_proj:  37%|███▋      | 13486/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.115.gate_proj:  37%|███▋      | 13487/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.115.up_proj:  37%|███▋      | 13488/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.115.down_proj:  37%|███▋      | 13489/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.116.gate_proj:  37%|███▋      | 13490/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.116.up_proj:  37%|███▋      | 13491/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.116.down_proj:  37%|███▋      | 13492/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.117.gate_proj:  37%|███▋      | 13493/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.117.up_proj:  37%|███▋      | 13494/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.117.down_proj:  37%|███▋      | 13495/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.118.gate_proj:  37%|███▋      | 13496/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.118.up_proj:  37%|███▋      | 13497/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.118.down_proj:  37%|███▋      | 13498/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.119.gate_proj:  37%|███▋      | 13499/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.119.up_proj:  37%|███▋      | 13500/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.119.down_proj:  37%|███▋      | 13501/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.120.gate_proj:  37%|███▋      | 13502/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.120.up_proj:  37%|███▋      | 13503/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.120.down_proj:  37%|███▋      | 13504/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.121.gate_proj:  37%|███▋      | 13505/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.121.up_proj:  37%|███▋      | 13506/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.121.down_proj:  37%|███▋      | 13507/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.122.gate_proj:  37%|███▋      | 13508/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.122.up_proj:  37%|███▋      | 13509/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.122.down_proj:  37%|███▋      | 13510/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.123.gate_proj:  37%|███▋      | 13511/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.123.up_proj:  37%|███▋      | 13512/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.123.down_proj:  37%|███▋      | 13513/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.124.gate_proj:  37%|███▋      | 13514/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.124.up_proj:  37%|███▋      | 13515/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.124.down_proj:  37%|███▋      | 13516/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.125.gate_proj:  37%|███▋      | 13517/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.125.up_proj:  37%|███▋      | 13518/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.125.down_proj:  37%|███▋      | 13519/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.126.gate_proj:  37%|███▋      | 13520/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.126.up_proj:  37%|███▋      | 13521/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.126.down_proj:  37%|███▋      | 13522/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.127.gate_proj:  37%|███▋      | 13523/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.33.mlp.experts.127.up_proj:  37%|███▋      | 13524/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.33.mlp.experts.127.down_proj:  37%|███▋      | 13525/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.0.gate_proj:  37%|███▋      | 13526/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.34.mlp.experts.0.up_proj:  37%|███▋      | 13527/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.34.mlp.experts.0.down_proj:  37%|███▋      | 13528/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.1.gate_proj:  37%|███▋      | 13529/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.1.up_proj:  37%|███▋      | 13530/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.34.mlp.experts.1.down_proj:  37%|███▋      | 13531/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.2.gate_proj:  37%|███▋      | 13532/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.2.up_proj:  37%|███▋      | 13533/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.34.mlp.experts.2.down_proj:  37%|███▋      | 13534/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.3.gate_proj:  37%|███▋      | 13535/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.3.up_proj:  37%|███▋      | 13536/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.34.mlp.experts.3.down_proj:  37%|███▋      | 13537/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.4.gate_proj:  37%|███▋      | 13538/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.4.up_proj:  37%|███▋      | 13539/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.34.mlp.experts.4.down_proj:  37%|███▋      | 13540/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.5.gate_proj:  37%|███▋      | 13541/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.5.up_proj:  37%|███▋      | 13542/36566 [00:12<00:19, 1171.25it/s]  
packing model.layers.34.mlp.experts.5.down_proj:  37%|███▋      | 13543/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.6.gate_proj:  37%|███▋      | 13544/36566 [00:12<00:19, 1171.25it/s]
packing model.layers.34.mlp.experts.6.gate_proj:  37%|███▋      | 13545/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.6.up_proj:  37%|███▋      | 13545/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.6.down_proj:  37%|███▋      | 13546/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.7.gate_proj:  37%|███▋      | 13547/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.7.up_proj:  37%|███▋      | 13548/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.7.down_proj:  37%|███▋      | 13549/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.8.gate_proj:  37%|███▋      | 13550/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.8.up_proj:  37%|███▋      | 13551/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.8.down_proj:  37%|███▋      | 13552/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.9.gate_proj:  37%|███▋      | 13553/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.9.up_proj:  37%|███▋      | 13554/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.9.down_proj:  37%|███▋      | 13555/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.10.gate_proj:  37%|███▋      | 13556/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.10.up_proj:  37%|███▋      | 13557/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.10.down_proj:  37%|███▋      | 13558/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.11.gate_proj:  37%|███▋      | 13559/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.11.up_proj:  37%|███▋      | 13560/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.11.down_proj:  37%|███▋      | 13561/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.12.gate_proj:  37%|███▋      | 13562/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.12.up_proj:  37%|███▋      | 13563/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.12.down_proj:  37%|███▋      | 13564/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.13.gate_proj:  37%|███▋      | 13565/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.13.up_proj:  37%|███▋      | 13566/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.13.down_proj:  37%|███▋      | 13567/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.14.gate_proj:  37%|███▋      | 13568/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.14.up_proj:  37%|███▋      | 13569/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.14.down_proj:  37%|███▋      | 13570/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.15.gate_proj:  37%|███▋      | 13571/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.15.up_proj:  37%|███▋      | 13572/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.15.down_proj:  37%|███▋      | 13573/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.16.gate_proj:  37%|███▋      | 13574/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.16.up_proj:  37%|███▋      | 13575/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.16.down_proj:  37%|███▋      | 13576/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.17.gate_proj:  37%|███▋      | 13577/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.17.up_proj:  37%|███▋      | 13578/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.17.down_proj:  37%|███▋      | 13579/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.18.gate_proj:  37%|███▋      | 13580/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.18.up_proj:  37%|███▋      | 13581/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.18.down_proj:  37%|███▋      | 13582/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.19.gate_proj:  37%|███▋      | 13583/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.19.up_proj:  37%|███▋      | 13584/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.19.down_proj:  37%|███▋      | 13585/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.20.gate_proj:  37%|███▋      | 13586/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.20.up_proj:  37%|███▋      | 13587/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.20.down_proj:  37%|███▋      | 13588/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.21.gate_proj:  37%|███▋      | 13589/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.21.up_proj:  37%|███▋      | 13590/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.21.down_proj:  37%|███▋      | 13591/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.22.gate_proj:  37%|███▋      | 13592/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.22.up_proj:  37%|███▋      | 13593/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.22.down_proj:  37%|███▋      | 13594/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.23.gate_proj:  37%|███▋      | 13595/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.23.up_proj:  37%|███▋      | 13596/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.23.down_proj:  37%|███▋      | 13597/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.24.gate_proj:  37%|███▋      | 13598/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.24.up_proj:  37%|███▋      | 13599/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.24.down_proj:  37%|███▋      | 13600/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.25.gate_proj:  37%|███▋      | 13601/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.25.up_proj:  37%|███▋      | 13602/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.25.down_proj:  37%|███▋      | 13603/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.26.gate_proj:  37%|███▋      | 13604/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.26.up_proj:  37%|███▋      | 13605/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.26.down_proj:  37%|███▋      | 13606/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.27.gate_proj:  37%|███▋      | 13607/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.27.up_proj:  37%|███▋      | 13608/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.27.down_proj:  37%|███▋      | 13609/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.28.gate_proj:  37%|███▋      | 13610/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.28.up_proj:  37%|███▋      | 13611/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.28.down_proj:  37%|███▋      | 13612/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.29.gate_proj:  37%|███▋      | 13613/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.29.up_proj:  37%|███▋      | 13614/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.29.down_proj:  37%|███▋      | 13615/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.30.gate_proj:  37%|███▋      | 13616/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.30.up_proj:  37%|███▋      | 13617/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.30.down_proj:  37%|███▋      | 13618/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.31.gate_proj:  37%|███▋      | 13619/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.31.up_proj:  37%|███▋      | 13620/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.31.down_proj:  37%|███▋      | 13621/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.32.gate_proj:  37%|███▋      | 13622/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.32.up_proj:  37%|███▋      | 13623/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.32.down_proj:  37%|███▋      | 13624/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.33.gate_proj:  37%|███▋      | 13625/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.33.up_proj:  37%|███▋      | 13626/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.33.down_proj:  37%|███▋      | 13627/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.34.gate_proj:  37%|███▋      | 13628/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.34.up_proj:  37%|███▋      | 13629/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.34.down_proj:  37%|███▋      | 13630/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.35.gate_proj:  37%|███▋      | 13631/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.35.up_proj:  37%|███▋      | 13632/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.35.down_proj:  37%|███▋      | 13633/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.36.gate_proj:  37%|███▋      | 13634/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.36.up_proj:  37%|███▋      | 13635/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.36.down_proj:  37%|███▋      | 13636/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.37.gate_proj:  37%|███▋      | 13637/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.37.up_proj:  37%|███▋      | 13638/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.37.down_proj:  37%|███▋      | 13639/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.38.gate_proj:  37%|███▋      | 13640/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.38.up_proj:  37%|███▋      | 13641/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.38.down_proj:  37%|███▋      | 13642/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.39.gate_proj:  37%|███▋      | 13643/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.39.up_proj:  37%|███▋      | 13644/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.39.down_proj:  37%|███▋      | 13645/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.40.gate_proj:  37%|███▋      | 13646/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.40.up_proj:  37%|███▋      | 13647/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.40.down_proj:  37%|███▋      | 13648/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.41.gate_proj:  37%|███▋      | 13649/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.41.up_proj:  37%|███▋      | 13650/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.41.down_proj:  37%|███▋      | 13651/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.42.gate_proj:  37%|███▋      | 13652/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.42.up_proj:  37%|███▋      | 13653/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.42.down_proj:  37%|███▋      | 13654/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.43.gate_proj:  37%|███▋      | 13655/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.43.up_proj:  37%|███▋      | 13656/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.43.down_proj:  37%|███▋      | 13657/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.44.gate_proj:  37%|███▋      | 13658/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.44.up_proj:  37%|███▋      | 13659/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.44.down_proj:  37%|███▋      | 13660/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.45.gate_proj:  37%|███▋      | 13661/36566 [00:12<00:19, 1169.33it/s]
packing model.layers.34.mlp.experts.45.up_proj:  37%|███▋      | 13662/36566 [00:12<00:19, 1169.33it/s]  
packing model.layers.34.mlp.experts.45.up_proj:  37%|███▋      | 13663/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.45.down_proj:  37%|███▋      | 13663/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.46.gate_proj:  37%|███▋      | 13664/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.46.up_proj:  37%|███▋      | 13665/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.46.down_proj:  37%|███▋      | 13666/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.47.gate_proj:  37%|███▋      | 13667/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.47.up_proj:  37%|███▋      | 13668/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.47.down_proj:  37%|███▋      | 13669/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.48.gate_proj:  37%|███▋      | 13670/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.48.up_proj:  37%|███▋      | 13671/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.48.down_proj:  37%|███▋      | 13672/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.49.gate_proj:  37%|███▋      | 13673/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.49.up_proj:  37%|███▋      | 13674/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.49.down_proj:  37%|███▋      | 13675/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.50.gate_proj:  37%|███▋      | 13676/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.50.up_proj:  37%|███▋      | 13677/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.50.down_proj:  37%|███▋      | 13678/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.51.gate_proj:  37%|███▋      | 13679/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.51.up_proj:  37%|███▋      | 13680/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.51.down_proj:  37%|███▋      | 13681/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.52.gate_proj:  37%|███▋      | 13682/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.52.up_proj:  37%|███▋      | 13683/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.52.down_proj:  37%|███▋      | 13684/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.53.gate_proj:  37%|███▋      | 13685/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.53.up_proj:  37%|███▋      | 13686/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.53.down_proj:  37%|███▋      | 13687/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.54.gate_proj:  37%|███▋      | 13688/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.54.up_proj:  37%|███▋      | 13689/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.54.down_proj:  37%|███▋      | 13690/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.55.gate_proj:  37%|███▋      | 13691/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.55.up_proj:  37%|███▋      | 13692/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.55.down_proj:  37%|███▋      | 13693/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.56.gate_proj:  37%|███▋      | 13694/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.56.up_proj:  37%|███▋      | 13695/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.56.down_proj:  37%|███▋      | 13696/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.57.gate_proj:  37%|███▋      | 13697/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.57.up_proj:  37%|███▋      | 13698/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.57.down_proj:  37%|███▋      | 13699/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.58.gate_proj:  37%|███▋      | 13700/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.58.up_proj:  37%|███▋      | 13701/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.58.down_proj:  37%|███▋      | 13702/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.59.gate_proj:  37%|███▋      | 13703/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.59.up_proj:  37%|███▋      | 13704/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.59.down_proj:  37%|███▋      | 13705/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.60.gate_proj:  37%|███▋      | 13706/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.60.up_proj:  37%|███▋      | 13707/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.60.down_proj:  37%|███▋      | 13708/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.61.gate_proj:  37%|███▋      | 13709/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.61.up_proj:  37%|███▋      | 13710/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.61.down_proj:  37%|███▋      | 13711/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.62.gate_proj:  37%|███▋      | 13712/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.62.up_proj:  38%|███▊      | 13713/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.62.down_proj:  38%|███▊      | 13714/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.63.gate_proj:  38%|███▊      | 13715/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.63.up_proj:  38%|███▊      | 13716/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.63.down_proj:  38%|███▊      | 13717/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.64.gate_proj:  38%|███▊      | 13718/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.64.up_proj:  38%|███▊      | 13719/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.64.down_proj:  38%|███▊      | 13720/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.65.gate_proj:  38%|███▊      | 13721/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.65.up_proj:  38%|███▊      | 13722/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.65.down_proj:  38%|███▊      | 13723/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.66.gate_proj:  38%|███▊      | 13724/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.66.up_proj:  38%|███▊      | 13725/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.66.down_proj:  38%|███▊      | 13726/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.67.gate_proj:  38%|███▊      | 13727/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.67.up_proj:  38%|███▊      | 13728/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.67.down_proj:  38%|███▊      | 13729/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.68.gate_proj:  38%|███▊      | 13730/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.68.up_proj:  38%|███▊      | 13731/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.68.down_proj:  38%|███▊      | 13732/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.69.gate_proj:  38%|███▊      | 13733/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.69.up_proj:  38%|███▊      | 13734/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.69.down_proj:  38%|███▊      | 13735/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.70.gate_proj:  38%|███▊      | 13736/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.70.up_proj:  38%|███▊      | 13737/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.70.down_proj:  38%|███▊      | 13738/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.71.gate_proj:  38%|███▊      | 13739/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.71.up_proj:  38%|███▊      | 13740/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.71.down_proj:  38%|███▊      | 13741/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.72.gate_proj:  38%|███▊      | 13742/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.72.up_proj:  38%|███▊      | 13743/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.72.down_proj:  38%|███▊      | 13744/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.73.gate_proj:  38%|███▊      | 13745/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.73.up_proj:  38%|███▊      | 13746/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.73.down_proj:  38%|███▊      | 13747/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.74.gate_proj:  38%|███▊      | 13748/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.74.up_proj:  38%|███▊      | 13749/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.74.down_proj:  38%|███▊      | 13750/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.75.gate_proj:  38%|███▊      | 13751/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.75.up_proj:  38%|███▊      | 13752/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.75.down_proj:  38%|███▊      | 13753/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.76.gate_proj:  38%|███▊      | 13754/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.76.up_proj:  38%|███▊      | 13755/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.76.down_proj:  38%|███▊      | 13756/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.77.gate_proj:  38%|███▊      | 13757/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.77.up_proj:  38%|███▊      | 13758/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.77.down_proj:  38%|███▊      | 13759/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.78.gate_proj:  38%|███▊      | 13760/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.78.up_proj:  38%|███▊      | 13761/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.78.down_proj:  38%|███▊      | 13762/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.79.gate_proj:  38%|███▊      | 13763/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.79.up_proj:  38%|███▊      | 13764/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.79.down_proj:  38%|███▊      | 13765/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.80.gate_proj:  38%|███▊      | 13766/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.80.up_proj:  38%|███▊      | 13767/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.80.down_proj:  38%|███▊      | 13768/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.81.gate_proj:  38%|███▊      | 13769/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.81.up_proj:  38%|███▊      | 13770/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.81.down_proj:  38%|███▊      | 13771/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.82.gate_proj:  38%|███▊      | 13772/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.82.up_proj:  38%|███▊      | 13773/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.82.down_proj:  38%|███▊      | 13774/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.83.gate_proj:  38%|███▊      | 13775/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.83.up_proj:  38%|███▊      | 13776/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.83.down_proj:  38%|███▊      | 13777/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.84.gate_proj:  38%|███▊      | 13778/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.84.up_proj:  38%|███▊      | 13779/36566 [00:12<00:19, 1172.27it/s]  
packing model.layers.34.mlp.experts.84.down_proj:  38%|███▊      | 13780/36566 [00:12<00:19, 1172.27it/s]
packing model.layers.34.mlp.experts.84.down_proj:  38%|███▊      | 13781/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.85.gate_proj:  38%|███▊      | 13781/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.85.up_proj:  38%|███▊      | 13782/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.85.down_proj:  38%|███▊      | 13783/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.86.gate_proj:  38%|███▊      | 13784/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.86.up_proj:  38%|███▊      | 13785/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.86.down_proj:  38%|███▊      | 13786/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.87.gate_proj:  38%|███▊      | 13787/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.87.up_proj:  38%|███▊      | 13788/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.87.down_proj:  38%|███▊      | 13789/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.88.gate_proj:  38%|███▊      | 13790/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.88.up_proj:  38%|███▊      | 13791/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.88.down_proj:  38%|███▊      | 13792/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.89.gate_proj:  38%|███▊      | 13793/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.89.up_proj:  38%|███▊      | 13794/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.89.down_proj:  38%|███▊      | 13795/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.90.gate_proj:  38%|███▊      | 13796/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.90.up_proj:  38%|███▊      | 13797/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.90.down_proj:  38%|███▊      | 13798/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.91.gate_proj:  38%|███▊      | 13799/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.91.up_proj:  38%|███▊      | 13800/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.91.down_proj:  38%|███▊      | 13801/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.92.gate_proj:  38%|███▊      | 13802/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.92.up_proj:  38%|███▊      | 13803/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.92.down_proj:  38%|███▊      | 13804/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.93.gate_proj:  38%|███▊      | 13805/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.93.up_proj:  38%|███▊      | 13806/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.93.down_proj:  38%|███▊      | 13807/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.94.gate_proj:  38%|███▊      | 13808/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.94.up_proj:  38%|███▊      | 13809/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.94.down_proj:  38%|███▊      | 13810/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.95.gate_proj:  38%|███▊      | 13811/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.95.up_proj:  38%|███▊      | 13812/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.95.down_proj:  38%|███▊      | 13813/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.96.gate_proj:  38%|███▊      | 13814/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.96.up_proj:  38%|███▊      | 13815/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.96.down_proj:  38%|███▊      | 13816/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.97.gate_proj:  38%|███▊      | 13817/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.97.up_proj:  38%|███▊      | 13818/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.97.down_proj:  38%|███▊      | 13819/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.98.gate_proj:  38%|███▊      | 13820/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.98.up_proj:  38%|███▊      | 13821/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.98.down_proj:  38%|███▊      | 13822/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.99.gate_proj:  38%|███▊      | 13823/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.99.up_proj:  38%|███▊      | 13824/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.99.down_proj:  38%|███▊      | 13825/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.100.gate_proj:  38%|███▊      | 13826/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.100.up_proj:  38%|███▊      | 13827/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.100.down_proj:  38%|███▊      | 13828/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.101.gate_proj:  38%|███▊      | 13829/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.101.up_proj:  38%|███▊      | 13830/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.101.down_proj:  38%|███▊      | 13831/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.102.gate_proj:  38%|███▊      | 13832/36566 [00:12<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.102.up_proj:  38%|███▊      | 13833/36566 [00:12<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.102.down_proj:  38%|███▊      | 13834/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.103.gate_proj:  38%|███▊      | 13835/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.103.up_proj:  38%|███▊      | 13836/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.103.down_proj:  38%|███▊      | 13837/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.104.gate_proj:  38%|███▊      | 13838/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.104.up_proj:  38%|███▊      | 13839/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.104.down_proj:  38%|███▊      | 13840/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.105.gate_proj:  38%|███▊      | 13841/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.105.up_proj:  38%|███▊      | 13842/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.105.down_proj:  38%|███▊      | 13843/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.106.gate_proj:  38%|███▊      | 13844/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.106.up_proj:  38%|███▊      | 13845/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.106.down_proj:  38%|███▊      | 13846/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.107.gate_proj:  38%|███▊      | 13847/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.107.up_proj:  38%|███▊      | 13848/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.107.down_proj:  38%|███▊      | 13849/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.108.gate_proj:  38%|███▊      | 13850/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.108.up_proj:  38%|███▊      | 13851/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.108.down_proj:  38%|███▊      | 13852/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.109.gate_proj:  38%|███▊      | 13853/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.109.up_proj:  38%|███▊      | 13854/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.109.down_proj:  38%|███▊      | 13855/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.110.gate_proj:  38%|███▊      | 13856/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.110.up_proj:  38%|███▊      | 13857/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.110.down_proj:  38%|███▊      | 13858/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.111.gate_proj:  38%|███▊      | 13859/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.111.up_proj:  38%|███▊      | 13860/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.111.down_proj:  38%|███▊      | 13861/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.112.gate_proj:  38%|███▊      | 13862/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.112.up_proj:  38%|███▊      | 13863/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.112.down_proj:  38%|███▊      | 13864/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.113.gate_proj:  38%|███▊      | 13865/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.113.up_proj:  38%|███▊      | 13866/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.113.down_proj:  38%|███▊      | 13867/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.114.gate_proj:  38%|███▊      | 13868/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.114.up_proj:  38%|███▊      | 13869/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.114.down_proj:  38%|███▊      | 13870/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.115.gate_proj:  38%|███▊      | 13871/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.115.up_proj:  38%|███▊      | 13872/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.115.down_proj:  38%|███▊      | 13873/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.116.gate_proj:  38%|███▊      | 13874/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.116.up_proj:  38%|███▊      | 13875/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.116.down_proj:  38%|███▊      | 13876/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.117.gate_proj:  38%|███▊      | 13877/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.117.up_proj:  38%|███▊      | 13878/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.117.down_proj:  38%|███▊      | 13879/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.118.gate_proj:  38%|███▊      | 13880/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.118.up_proj:  38%|███▊      | 13881/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.118.down_proj:  38%|███▊      | 13882/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.119.gate_proj:  38%|███▊      | 13883/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.119.up_proj:  38%|███▊      | 13884/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.119.down_proj:  38%|███▊      | 13885/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.120.gate_proj:  38%|███▊      | 13886/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.120.up_proj:  38%|███▊      | 13887/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.120.down_proj:  38%|███▊      | 13888/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.121.gate_proj:  38%|███▊      | 13889/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.121.up_proj:  38%|███▊      | 13890/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.121.down_proj:  38%|███▊      | 13891/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.122.gate_proj:  38%|███▊      | 13892/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.122.up_proj:  38%|███▊      | 13893/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.122.down_proj:  38%|███▊      | 13894/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.123.gate_proj:  38%|███▊      | 13895/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.123.up_proj:  38%|███▊      | 13896/36566 [00:13<00:19, 1173.45it/s]  
packing model.layers.34.mlp.experts.123.down_proj:  38%|███▊      | 13897/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.124.gate_proj:  38%|███▊      | 13898/36566 [00:13<00:19, 1173.45it/s]
packing model.layers.34.mlp.experts.124.gate_proj:  38%|███▊      | 13899/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.34.mlp.experts.124.up_proj:  38%|███▊      | 13899/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.34.mlp.experts.124.down_proj:  38%|███▊      | 13900/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.34.mlp.experts.125.gate_proj:  38%|███▊      | 13901/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.34.mlp.experts.125.up_proj:  38%|███▊      | 13902/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.34.mlp.experts.125.down_proj:  38%|███▊      | 13903/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.34.mlp.experts.126.gate_proj:  38%|███▊      | 13904/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.34.mlp.experts.126.up_proj:  38%|███▊      | 13905/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.34.mlp.experts.126.down_proj:  38%|███▊      | 13906/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.34.mlp.experts.127.gate_proj:  38%|███▊      | 13907/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.34.mlp.experts.127.up_proj:  38%|███▊      | 13908/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.34.mlp.experts.127.down_proj:  38%|███▊      | 13909/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.0.gate_proj:  38%|███▊      | 13910/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.0.up_proj:  38%|███▊      | 13911/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.0.down_proj:  38%|███▊      | 13912/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.1.gate_proj:  38%|███▊      | 13913/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.1.up_proj:  38%|███▊      | 13914/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.1.down_proj:  38%|███▊      | 13915/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.2.gate_proj:  38%|███▊      | 13916/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.2.up_proj:  38%|███▊      | 13917/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.2.down_proj:  38%|███▊      | 13918/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.3.gate_proj:  38%|███▊      | 13919/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.3.up_proj:  38%|███▊      | 13920/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.3.down_proj:  38%|███▊      | 13921/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.4.gate_proj:  38%|███▊      | 13922/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.4.up_proj:  38%|███▊      | 13923/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.4.down_proj:  38%|███▊      | 13924/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.5.gate_proj:  38%|███▊      | 13925/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.5.up_proj:  38%|███▊      | 13926/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.5.down_proj:  38%|███▊      | 13927/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.6.gate_proj:  38%|███▊      | 13928/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.6.up_proj:  38%|███▊      | 13929/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.6.down_proj:  38%|███▊      | 13930/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.7.gate_proj:  38%|███▊      | 13931/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.7.up_proj:  38%|███▊      | 13932/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.7.down_proj:  38%|███▊      | 13933/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.8.gate_proj:  38%|███▊      | 13934/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.8.up_proj:  38%|███▊      | 13935/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.8.down_proj:  38%|███▊      | 13936/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.9.gate_proj:  38%|███▊      | 13937/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.9.up_proj:  38%|███▊      | 13938/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.9.down_proj:  38%|███▊      | 13939/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.10.gate_proj:  38%|███▊      | 13940/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.10.up_proj:  38%|███▊      | 13941/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.10.down_proj:  38%|███▊      | 13942/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.11.gate_proj:  38%|███▊      | 13943/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.11.up_proj:  38%|███▊      | 13944/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.11.down_proj:  38%|███▊      | 13945/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.12.gate_proj:  38%|███▊      | 13946/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.12.up_proj:  38%|███▊      | 13947/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.12.down_proj:  38%|███▊      | 13948/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.13.gate_proj:  38%|███▊      | 13949/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.13.up_proj:  38%|███▊      | 13950/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.13.down_proj:  38%|███▊      | 13951/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.14.gate_proj:  38%|███▊      | 13952/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.14.up_proj:  38%|███▊      | 13953/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.14.down_proj:  38%|███▊      | 13954/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.15.gate_proj:  38%|███▊      | 13955/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.15.up_proj:  38%|███▊      | 13956/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.15.down_proj:  38%|███▊      | 13957/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.16.gate_proj:  38%|███▊      | 13958/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.16.up_proj:  38%|███▊      | 13959/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.16.down_proj:  38%|███▊      | 13960/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.17.gate_proj:  38%|███▊      | 13961/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.17.up_proj:  38%|███▊      | 13962/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.17.down_proj:  38%|███▊      | 13963/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.18.gate_proj:  38%|███▊      | 13964/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.18.up_proj:  38%|███▊      | 13965/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.18.down_proj:  38%|███▊      | 13966/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.19.gate_proj:  38%|███▊      | 13967/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.19.up_proj:  38%|███▊      | 13968/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.19.down_proj:  38%|███▊      | 13969/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.20.gate_proj:  38%|███▊      | 13970/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.20.up_proj:  38%|███▊      | 13971/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.20.down_proj:  38%|███▊      | 13972/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.21.gate_proj:  38%|███▊      | 13973/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.21.up_proj:  38%|███▊      | 13974/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.21.down_proj:  38%|███▊      | 13975/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.22.gate_proj:  38%|███▊      | 13976/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.22.up_proj:  38%|███▊      | 13977/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.22.down_proj:  38%|███▊      | 13978/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.23.gate_proj:  38%|███▊      | 13979/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.23.up_proj:  38%|███▊      | 13980/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.23.down_proj:  38%|███▊      | 13981/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.24.gate_proj:  38%|███▊      | 13982/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.24.up_proj:  38%|███▊      | 13983/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.24.down_proj:  38%|███▊      | 13984/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.25.gate_proj:  38%|███▊      | 13985/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.25.up_proj:  38%|███▊      | 13986/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.25.down_proj:  38%|███▊      | 13987/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.26.gate_proj:  38%|███▊      | 13988/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.26.up_proj:  38%|███▊      | 13989/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.26.down_proj:  38%|███▊      | 13990/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.27.gate_proj:  38%|███▊      | 13991/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.27.up_proj:  38%|███▊      | 13992/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.27.down_proj:  38%|███▊      | 13993/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.28.gate_proj:  38%|███▊      | 13994/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.28.up_proj:  38%|███▊      | 13995/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.28.down_proj:  38%|███▊      | 13996/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.29.gate_proj:  38%|███▊      | 13997/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.29.up_proj:  38%|███▊      | 13998/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.29.down_proj:  38%|███▊      | 13999/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.30.gate_proj:  38%|███▊      | 14000/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.30.up_proj:  38%|███▊      | 14001/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.30.down_proj:  38%|███▊      | 14002/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.31.gate_proj:  38%|███▊      | 14003/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.31.up_proj:  38%|███▊      | 14004/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.31.down_proj:  38%|███▊      | 14005/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.32.gate_proj:  38%|███▊      | 14006/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.32.up_proj:  38%|███▊      | 14007/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.32.down_proj:  38%|███▊      | 14008/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.33.gate_proj:  38%|███▊      | 14009/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.33.up_proj:  38%|███▊      | 14010/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.33.down_proj:  38%|███▊      | 14011/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.34.gate_proj:  38%|███▊      | 14012/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.34.up_proj:  38%|███▊      | 14013/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.34.down_proj:  38%|███▊      | 14014/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.35.gate_proj:  38%|███▊      | 14015/36566 [00:13<00:19, 1173.10it/s]
packing model.layers.35.mlp.experts.35.up_proj:  38%|███▊      | 14016/36566 [00:13<00:19, 1173.10it/s]  
packing model.layers.35.mlp.experts.35.up_proj:  38%|███▊      | 14017/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.35.down_proj:  38%|███▊      | 14017/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.36.gate_proj:  38%|███▊      | 14018/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.36.up_proj:  38%|███▊      | 14019/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.36.down_proj:  38%|███▊      | 14020/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.37.gate_proj:  38%|███▊      | 14021/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.37.up_proj:  38%|███▊      | 14022/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.37.down_proj:  38%|███▊      | 14023/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.38.gate_proj:  38%|███▊      | 14024/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.38.up_proj:  38%|███▊      | 14025/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.38.down_proj:  38%|███▊      | 14026/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.39.gate_proj:  38%|███▊      | 14027/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.39.up_proj:  38%|███▊      | 14028/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.39.down_proj:  38%|███▊      | 14029/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.40.gate_proj:  38%|███▊      | 14030/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.40.up_proj:  38%|███▊      | 14031/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.40.down_proj:  38%|███▊      | 14032/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.41.gate_proj:  38%|███▊      | 14033/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.41.up_proj:  38%|███▊      | 14034/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.41.down_proj:  38%|███▊      | 14035/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.42.gate_proj:  38%|███▊      | 14036/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.42.up_proj:  38%|███▊      | 14037/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.42.down_proj:  38%|███▊      | 14038/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.43.gate_proj:  38%|███▊      | 14039/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.43.up_proj:  38%|███▊      | 14040/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.43.down_proj:  38%|███▊      | 14041/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.44.gate_proj:  38%|███▊      | 14042/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.44.up_proj:  38%|███▊      | 14043/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.44.down_proj:  38%|███▊      | 14044/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.45.gate_proj:  38%|███▊      | 14045/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.45.up_proj:  38%|███▊      | 14046/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.45.down_proj:  38%|███▊      | 14047/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.46.gate_proj:  38%|███▊      | 14048/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.46.up_proj:  38%|███▊      | 14049/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.46.down_proj:  38%|███▊      | 14050/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.47.gate_proj:  38%|███▊      | 14051/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.47.up_proj:  38%|███▊      | 14052/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.47.down_proj:  38%|███▊      | 14053/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.48.gate_proj:  38%|███▊      | 14054/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.48.up_proj:  38%|███▊      | 14055/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.48.down_proj:  38%|███▊      | 14056/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.49.gate_proj:  38%|███▊      | 14057/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.49.up_proj:  38%|███▊      | 14058/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.49.down_proj:  38%|███▊      | 14059/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.50.gate_proj:  38%|███▊      | 14060/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.50.up_proj:  38%|███▊      | 14061/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.50.down_proj:  38%|███▊      | 14062/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.51.gate_proj:  38%|███▊      | 14063/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.51.up_proj:  38%|███▊      | 14064/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.51.down_proj:  38%|███▊      | 14065/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.52.gate_proj:  38%|███▊      | 14066/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.52.up_proj:  38%|███▊      | 14067/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.52.down_proj:  38%|███▊      | 14068/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.53.gate_proj:  38%|███▊      | 14069/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.53.up_proj:  38%|███▊      | 14070/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.53.down_proj:  38%|███▊      | 14071/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.54.gate_proj:  38%|███▊      | 14072/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.54.up_proj:  38%|███▊      | 14073/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.54.down_proj:  38%|███▊      | 14074/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.55.gate_proj:  38%|███▊      | 14075/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.55.up_proj:  38%|███▊      | 14076/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.55.down_proj:  38%|███▊      | 14077/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.56.gate_proj:  39%|███▊      | 14078/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.56.up_proj:  39%|███▊      | 14079/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.56.down_proj:  39%|███▊      | 14080/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.57.gate_proj:  39%|███▊      | 14081/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.57.up_proj:  39%|███▊      | 14082/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.57.down_proj:  39%|███▊      | 14083/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.58.gate_proj:  39%|███▊      | 14084/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.58.up_proj:  39%|███▊      | 14085/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.58.down_proj:  39%|███▊      | 14086/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.59.gate_proj:  39%|███▊      | 14087/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.59.up_proj:  39%|███▊      | 14088/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.59.down_proj:  39%|███▊      | 14089/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.60.gate_proj:  39%|███▊      | 14090/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.60.up_proj:  39%|███▊      | 14091/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.60.down_proj:  39%|███▊      | 14092/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.61.gate_proj:  39%|███▊      | 14093/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.61.up_proj:  39%|███▊      | 14094/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.61.down_proj:  39%|███▊      | 14095/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.62.gate_proj:  39%|███▊      | 14096/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.62.up_proj:  39%|███▊      | 14097/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.62.down_proj:  39%|███▊      | 14098/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.63.gate_proj:  39%|███▊      | 14099/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.63.up_proj:  39%|███▊      | 14100/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.63.down_proj:  39%|███▊      | 14101/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.64.gate_proj:  39%|███▊      | 14102/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.64.up_proj:  39%|███▊      | 14103/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.64.down_proj:  39%|███▊      | 14104/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.65.gate_proj:  39%|███▊      | 14105/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.65.up_proj:  39%|███▊      | 14106/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.65.down_proj:  39%|███▊      | 14107/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.66.gate_proj:  39%|███▊      | 14108/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.66.up_proj:  39%|███▊      | 14109/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.66.down_proj:  39%|███▊      | 14110/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.67.gate_proj:  39%|███▊      | 14111/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.67.up_proj:  39%|███▊      | 14112/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.67.down_proj:  39%|███▊      | 14113/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.68.gate_proj:  39%|███▊      | 14114/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.68.up_proj:  39%|███▊      | 14115/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.68.down_proj:  39%|███▊      | 14116/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.69.gate_proj:  39%|███▊      | 14117/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.69.up_proj:  39%|███▊      | 14118/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.69.down_proj:  39%|███▊      | 14119/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.70.gate_proj:  39%|███▊      | 14120/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.70.up_proj:  39%|███▊      | 14121/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.70.down_proj:  39%|███▊      | 14122/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.71.gate_proj:  39%|███▊      | 14123/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.71.up_proj:  39%|███▊      | 14124/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.71.down_proj:  39%|███▊      | 14125/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.72.gate_proj:  39%|███▊      | 14126/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.72.up_proj:  39%|███▊      | 14127/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.72.down_proj:  39%|███▊      | 14128/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.73.gate_proj:  39%|███▊      | 14129/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.73.up_proj:  39%|███▊      | 14130/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.73.down_proj:  39%|███▊      | 14131/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.74.gate_proj:  39%|███▊      | 14132/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.74.up_proj:  39%|███▊      | 14133/36566 [00:13<00:19, 1174.86it/s]  
packing model.layers.35.mlp.experts.74.down_proj:  39%|███▊      | 14134/36566 [00:13<00:19, 1174.86it/s]
packing model.layers.35.mlp.experts.74.down_proj:  39%|███▊      | 14135/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.75.gate_proj:  39%|███▊      | 14135/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.75.up_proj:  39%|███▊      | 14136/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.75.down_proj:  39%|███▊      | 14137/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.76.gate_proj:  39%|███▊      | 14138/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.76.up_proj:  39%|███▊      | 14139/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.76.down_proj:  39%|███▊      | 14140/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.77.gate_proj:  39%|███▊      | 14141/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.77.up_proj:  39%|███▊      | 14142/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.77.down_proj:  39%|███▊      | 14143/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.78.gate_proj:  39%|███▊      | 14144/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.78.up_proj:  39%|███▊      | 14145/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.78.down_proj:  39%|███▊      | 14146/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.79.gate_proj:  39%|███▊      | 14147/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.79.up_proj:  39%|███▊      | 14148/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.79.down_proj:  39%|███▊      | 14149/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.80.gate_proj:  39%|███▊      | 14150/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.80.up_proj:  39%|███▊      | 14151/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.80.down_proj:  39%|███▊      | 14152/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.81.gate_proj:  39%|███▊      | 14153/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.81.up_proj:  39%|███▊      | 14154/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.81.down_proj:  39%|███▊      | 14155/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.82.gate_proj:  39%|███▊      | 14156/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.82.up_proj:  39%|███▊      | 14157/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.82.down_proj:  39%|███▊      | 14158/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.83.gate_proj:  39%|███▊      | 14159/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.83.up_proj:  39%|███▊      | 14160/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.83.down_proj:  39%|███▊      | 14161/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.84.gate_proj:  39%|███▊      | 14162/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.84.up_proj:  39%|███▊      | 14163/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.84.down_proj:  39%|███▊      | 14164/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.85.gate_proj:  39%|███▊      | 14165/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.85.up_proj:  39%|███▊      | 14166/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.85.down_proj:  39%|███▊      | 14167/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.86.gate_proj:  39%|███▊      | 14168/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.86.up_proj:  39%|███▊      | 14169/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.86.down_proj:  39%|███▉      | 14170/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.87.gate_proj:  39%|███▉      | 14171/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.87.up_proj:  39%|███▉      | 14172/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.87.down_proj:  39%|███▉      | 14173/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.88.gate_proj:  39%|███▉      | 14174/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.88.up_proj:  39%|███▉      | 14175/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.88.down_proj:  39%|███▉      | 14176/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.89.gate_proj:  39%|███▉      | 14177/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.89.up_proj:  39%|███▉      | 14178/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.89.down_proj:  39%|███▉      | 14179/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.90.gate_proj:  39%|███▉      | 14180/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.90.up_proj:  39%|███▉      | 14181/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.90.down_proj:  39%|███▉      | 14182/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.91.gate_proj:  39%|███▉      | 14183/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.91.up_proj:  39%|███▉      | 14184/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.91.down_proj:  39%|███▉      | 14185/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.92.gate_proj:  39%|███▉      | 14186/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.92.up_proj:  39%|███▉      | 14187/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.92.down_proj:  39%|███▉      | 14188/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.93.gate_proj:  39%|███▉      | 14189/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.93.up_proj:  39%|███▉      | 14190/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.93.down_proj:  39%|███▉      | 14191/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.94.gate_proj:  39%|███▉      | 14192/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.94.up_proj:  39%|███▉      | 14193/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.94.down_proj:  39%|███▉      | 14194/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.95.gate_proj:  39%|███▉      | 14195/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.95.up_proj:  39%|███▉      | 14196/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.95.down_proj:  39%|███▉      | 14197/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.96.gate_proj:  39%|███▉      | 14198/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.96.up_proj:  39%|███▉      | 14199/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.96.down_proj:  39%|███▉      | 14200/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.97.gate_proj:  39%|███▉      | 14201/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.97.up_proj:  39%|███▉      | 14202/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.97.down_proj:  39%|███▉      | 14203/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.98.gate_proj:  39%|███▉      | 14204/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.98.up_proj:  39%|███▉      | 14205/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.98.down_proj:  39%|███▉      | 14206/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.99.gate_proj:  39%|███▉      | 14207/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.99.up_proj:  39%|███▉      | 14208/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.99.down_proj:  39%|███▉      | 14209/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.100.gate_proj:  39%|███▉      | 14210/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.100.up_proj:  39%|███▉      | 14211/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.100.down_proj:  39%|███▉      | 14212/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.101.gate_proj:  39%|███▉      | 14213/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.101.up_proj:  39%|███▉      | 14214/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.101.down_proj:  39%|███▉      | 14215/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.102.gate_proj:  39%|███▉      | 14216/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.102.up_proj:  39%|███▉      | 14217/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.102.down_proj:  39%|███▉      | 14218/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.103.gate_proj:  39%|███▉      | 14219/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.103.up_proj:  39%|███▉      | 14220/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.103.down_proj:  39%|███▉      | 14221/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.104.gate_proj:  39%|███▉      | 14222/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.104.up_proj:  39%|███▉      | 14223/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.104.down_proj:  39%|███▉      | 14224/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.105.gate_proj:  39%|███▉      | 14225/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.105.up_proj:  39%|███▉      | 14226/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.105.down_proj:  39%|███▉      | 14227/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.106.gate_proj:  39%|███▉      | 14228/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.106.up_proj:  39%|███▉      | 14229/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.106.down_proj:  39%|███▉      | 14230/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.107.gate_proj:  39%|███▉      | 14231/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.107.up_proj:  39%|███▉      | 14232/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.107.down_proj:  39%|███▉      | 14233/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.108.gate_proj:  39%|███▉      | 14234/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.108.up_proj:  39%|███▉      | 14235/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.108.down_proj:  39%|███▉      | 14236/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.109.gate_proj:  39%|███▉      | 14237/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.109.up_proj:  39%|███▉      | 14238/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.109.down_proj:  39%|███▉      | 14239/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.110.gate_proj:  39%|███▉      | 14240/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.110.up_proj:  39%|███▉      | 14241/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.110.down_proj:  39%|███▉      | 14242/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.111.gate_proj:  39%|███▉      | 14243/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.111.up_proj:  39%|███▉      | 14244/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.111.down_proj:  39%|███▉      | 14245/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.112.gate_proj:  39%|███▉      | 14246/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.112.up_proj:  39%|███▉      | 14247/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.112.down_proj:  39%|███▉      | 14248/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.113.gate_proj:  39%|███▉      | 14249/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.113.up_proj:  39%|███▉      | 14250/36566 [00:13<00:19, 1173.54it/s]  
packing model.layers.35.mlp.experts.113.down_proj:  39%|███▉      | 14251/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.114.gate_proj:  39%|███▉      | 14252/36566 [00:13<00:19, 1173.54it/s]
packing model.layers.35.mlp.experts.114.gate_proj:  39%|███▉      | 14253/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.114.up_proj:  39%|███▉      | 14253/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.114.down_proj:  39%|███▉      | 14254/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.115.gate_proj:  39%|███▉      | 14255/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.115.up_proj:  39%|███▉      | 14256/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.115.down_proj:  39%|███▉      | 14257/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.116.gate_proj:  39%|███▉      | 14258/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.116.up_proj:  39%|███▉      | 14259/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.116.down_proj:  39%|███▉      | 14260/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.117.gate_proj:  39%|███▉      | 14261/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.117.up_proj:  39%|███▉      | 14262/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.117.down_proj:  39%|███▉      | 14263/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.118.gate_proj:  39%|███▉      | 14264/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.118.up_proj:  39%|███▉      | 14265/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.118.down_proj:  39%|███▉      | 14266/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.119.gate_proj:  39%|███▉      | 14267/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.119.up_proj:  39%|███▉      | 14268/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.119.down_proj:  39%|███▉      | 14269/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.120.gate_proj:  39%|███▉      | 14270/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.120.up_proj:  39%|███▉      | 14271/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.120.down_proj:  39%|███▉      | 14272/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.121.gate_proj:  39%|███▉      | 14273/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.121.up_proj:  39%|███▉      | 14274/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.121.down_proj:  39%|███▉      | 14275/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.122.gate_proj:  39%|███▉      | 14276/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.122.up_proj:  39%|███▉      | 14277/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.122.down_proj:  39%|███▉      | 14278/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.123.gate_proj:  39%|███▉      | 14279/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.123.up_proj:  39%|███▉      | 14280/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.123.down_proj:  39%|███▉      | 14281/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.124.gate_proj:  39%|███▉      | 14282/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.124.up_proj:  39%|███▉      | 14283/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.124.down_proj:  39%|███▉      | 14284/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.125.gate_proj:  39%|███▉      | 14285/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.125.up_proj:  39%|███▉      | 14286/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.125.down_proj:  39%|███▉      | 14287/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.126.gate_proj:  39%|███▉      | 14288/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.126.up_proj:  39%|███▉      | 14289/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.126.down_proj:  39%|███▉      | 14290/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.127.gate_proj:  39%|███▉      | 14291/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.35.mlp.experts.127.up_proj:  39%|███▉      | 14292/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.35.mlp.experts.127.down_proj:  39%|███▉      | 14293/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.0.gate_proj:  39%|███▉      | 14294/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.36.mlp.experts.0.up_proj:  39%|███▉      | 14295/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.36.mlp.experts.0.down_proj:  39%|███▉      | 14296/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.1.gate_proj:  39%|███▉      | 14297/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.1.up_proj:  39%|███▉      | 14298/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.36.mlp.experts.1.down_proj:  39%|███▉      | 14299/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.2.gate_proj:  39%|███▉      | 14300/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.2.up_proj:  39%|███▉      | 14301/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.36.mlp.experts.2.down_proj:  39%|███▉      | 14302/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.3.gate_proj:  39%|███▉      | 14303/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.3.up_proj:  39%|███▉      | 14304/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.36.mlp.experts.3.down_proj:  39%|███▉      | 14305/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.4.gate_proj:  39%|███▉      | 14306/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.4.up_proj:  39%|███▉      | 14307/36566 [00:13<00:19, 1171.43it/s]  
packing model.layers.36.mlp.experts.4.down_proj:  39%|███▉      | 14308/36566 [00:13<00:19, 1171.43it/s]
packing model.layers.36.mlp.experts.5.gate_proj:  39%|███▉      | 14309/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.5.up_proj:  39%|███▉      | 14310/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.5.down_proj:  39%|███▉      | 14311/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.6.gate_proj:  39%|███▉      | 14312/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.6.up_proj:  39%|███▉      | 14313/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.6.down_proj:  39%|███▉      | 14314/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.7.gate_proj:  39%|███▉      | 14315/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.7.up_proj:  39%|███▉      | 14316/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.7.down_proj:  39%|███▉      | 14317/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.8.gate_proj:  39%|███▉      | 14318/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.8.up_proj:  39%|███▉      | 14319/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.8.down_proj:  39%|███▉      | 14320/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.9.gate_proj:  39%|███▉      | 14321/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.9.up_proj:  39%|███▉      | 14322/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.9.down_proj:  39%|███▉      | 14323/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.10.gate_proj:  39%|███▉      | 14324/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.10.up_proj:  39%|███▉      | 14325/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.10.down_proj:  39%|███▉      | 14326/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.11.gate_proj:  39%|███▉      | 14327/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.11.up_proj:  39%|███▉      | 14328/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.11.down_proj:  39%|███▉      | 14329/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.12.gate_proj:  39%|███▉      | 14330/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.12.up_proj:  39%|███▉      | 14331/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.12.down_proj:  39%|███▉      | 14332/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.13.gate_proj:  39%|███▉      | 14333/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.13.up_proj:  39%|███▉      | 14334/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.13.down_proj:  39%|███▉      | 14335/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.14.gate_proj:  39%|███▉      | 14336/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.14.up_proj:  39%|███▉      | 14337/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.14.down_proj:  39%|███▉      | 14338/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.15.gate_proj:  39%|███▉      | 14339/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.15.up_proj:  39%|███▉      | 14340/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.15.down_proj:  39%|███▉      | 14341/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.16.gate_proj:  39%|███▉      | 14342/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.16.up_proj:  39%|███▉      | 14343/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.16.down_proj:  39%|███▉      | 14344/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.17.gate_proj:  39%|███▉      | 14345/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.17.up_proj:  39%|███▉      | 14346/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.17.down_proj:  39%|███▉      | 14347/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.18.gate_proj:  39%|███▉      | 14348/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.18.up_proj:  39%|███▉      | 14349/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.18.down_proj:  39%|███▉      | 14350/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.19.gate_proj:  39%|███▉      | 14351/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.19.up_proj:  39%|███▉      | 14352/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.19.down_proj:  39%|███▉      | 14353/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.20.gate_proj:  39%|███▉      | 14354/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.20.up_proj:  39%|███▉      | 14355/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.20.down_proj:  39%|███▉      | 14356/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.21.gate_proj:  39%|███▉      | 14357/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.21.up_proj:  39%|███▉      | 14358/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.21.down_proj:  39%|███▉      | 14359/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.22.gate_proj:  39%|███▉      | 14360/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.22.up_proj:  39%|███▉      | 14361/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.22.down_proj:  39%|███▉      | 14362/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.23.gate_proj:  39%|███▉      | 14363/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.23.up_proj:  39%|███▉      | 14364/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.23.down_proj:  39%|███▉      | 14365/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.24.gate_proj:  39%|███▉      | 14366/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.24.up_proj:  39%|███▉      | 14367/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.24.down_proj:  39%|███▉      | 14368/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.25.gate_proj:  39%|███▉      | 14369/36566 [00:13<00:18, 1171.43it/s]
packing model.layers.36.mlp.experts.25.up_proj:  39%|███▉      | 14370/36566 [00:13<00:18, 1171.43it/s]  
packing model.layers.36.mlp.experts.25.up_proj:  39%|███▉      | 14371/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.25.down_proj:  39%|███▉      | 14371/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.26.gate_proj:  39%|███▉      | 14372/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.26.up_proj:  39%|███▉      | 14373/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.26.down_proj:  39%|███▉      | 14374/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.27.gate_proj:  39%|███▉      | 14375/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.27.up_proj:  39%|███▉      | 14376/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.27.down_proj:  39%|███▉      | 14377/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.28.gate_proj:  39%|███▉      | 14378/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.28.up_proj:  39%|███▉      | 14379/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.28.down_proj:  39%|███▉      | 14380/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.29.gate_proj:  39%|███▉      | 14381/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.29.up_proj:  39%|███▉      | 14382/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.29.down_proj:  39%|███▉      | 14383/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.30.gate_proj:  39%|███▉      | 14384/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.30.up_proj:  39%|███▉      | 14385/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.30.down_proj:  39%|███▉      | 14386/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.31.gate_proj:  39%|███▉      | 14387/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.31.up_proj:  39%|███▉      | 14388/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.31.down_proj:  39%|███▉      | 14389/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.32.gate_proj:  39%|███▉      | 14390/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.32.up_proj:  39%|███▉      | 14391/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.32.down_proj:  39%|███▉      | 14392/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.33.gate_proj:  39%|███▉      | 14393/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.33.up_proj:  39%|███▉      | 14394/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.33.down_proj:  39%|███▉      | 14395/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.34.gate_proj:  39%|███▉      | 14396/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.34.up_proj:  39%|███▉      | 14397/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.34.down_proj:  39%|███▉      | 14398/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.35.gate_proj:  39%|███▉      | 14399/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.35.up_proj:  39%|███▉      | 14400/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.35.down_proj:  39%|███▉      | 14401/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.36.gate_proj:  39%|███▉      | 14402/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.36.up_proj:  39%|███▉      | 14403/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.36.down_proj:  39%|███▉      | 14404/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.37.gate_proj:  39%|███▉      | 14405/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.37.up_proj:  39%|███▉      | 14406/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.37.down_proj:  39%|███▉      | 14407/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.38.gate_proj:  39%|███▉      | 14408/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.38.up_proj:  39%|███▉      | 14409/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.38.down_proj:  39%|███▉      | 14410/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.39.gate_proj:  39%|███▉      | 14411/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.39.up_proj:  39%|███▉      | 14412/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.39.down_proj:  39%|███▉      | 14413/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.40.gate_proj:  39%|███▉      | 14414/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.40.up_proj:  39%|███▉      | 14415/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.40.down_proj:  39%|███▉      | 14416/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.41.gate_proj:  39%|███▉      | 14417/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.41.up_proj:  39%|███▉      | 14418/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.41.down_proj:  39%|███▉      | 14419/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.42.gate_proj:  39%|███▉      | 14420/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.42.up_proj:  39%|███▉      | 14421/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.42.down_proj:  39%|███▉      | 14422/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.43.gate_proj:  39%|███▉      | 14423/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.43.up_proj:  39%|███▉      | 14424/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.43.down_proj:  39%|███▉      | 14425/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.44.gate_proj:  39%|███▉      | 14426/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.44.up_proj:  39%|███▉      | 14427/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.44.down_proj:  39%|███▉      | 14428/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.45.gate_proj:  39%|███▉      | 14429/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.45.up_proj:  39%|███▉      | 14430/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.45.down_proj:  39%|███▉      | 14431/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.46.gate_proj:  39%|███▉      | 14432/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.46.up_proj:  39%|███▉      | 14433/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.46.down_proj:  39%|███▉      | 14434/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.47.gate_proj:  39%|███▉      | 14435/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.47.up_proj:  39%|███▉      | 14436/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.47.down_proj:  39%|███▉      | 14437/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.48.gate_proj:  39%|███▉      | 14438/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.48.up_proj:  39%|███▉      | 14439/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.48.down_proj:  39%|███▉      | 14440/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.49.gate_proj:  39%|███▉      | 14441/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.49.up_proj:  39%|███▉      | 14442/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.49.down_proj:  39%|███▉      | 14443/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.50.gate_proj:  40%|███▉      | 14444/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.50.up_proj:  40%|███▉      | 14445/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.50.down_proj:  40%|███▉      | 14446/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.51.gate_proj:  40%|███▉      | 14447/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.51.up_proj:  40%|███▉      | 14448/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.51.down_proj:  40%|███▉      | 14449/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.52.gate_proj:  40%|███▉      | 14450/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.52.up_proj:  40%|███▉      | 14451/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.52.down_proj:  40%|███▉      | 14452/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.53.gate_proj:  40%|███▉      | 14453/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.53.up_proj:  40%|███▉      | 14454/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.53.down_proj:  40%|███▉      | 14455/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.54.gate_proj:  40%|███▉      | 14456/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.54.up_proj:  40%|███▉      | 14457/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.54.down_proj:  40%|███▉      | 14458/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.55.gate_proj:  40%|███▉      | 14459/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.55.up_proj:  40%|███▉      | 14460/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.55.down_proj:  40%|███▉      | 14461/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.56.gate_proj:  40%|███▉      | 14462/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.56.up_proj:  40%|███▉      | 14463/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.56.down_proj:  40%|███▉      | 14464/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.57.gate_proj:  40%|███▉      | 14465/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.57.up_proj:  40%|███▉      | 14466/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.57.down_proj:  40%|███▉      | 14467/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.58.gate_proj:  40%|███▉      | 14468/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.58.up_proj:  40%|███▉      | 14469/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.58.down_proj:  40%|███▉      | 14470/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.59.gate_proj:  40%|███▉      | 14471/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.59.up_proj:  40%|███▉      | 14472/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.59.down_proj:  40%|███▉      | 14473/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.60.gate_proj:  40%|███▉      | 14474/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.60.up_proj:  40%|███▉      | 14475/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.60.down_proj:  40%|███▉      | 14476/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.61.gate_proj:  40%|███▉      | 14477/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.61.up_proj:  40%|███▉      | 14478/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.61.down_proj:  40%|███▉      | 14479/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.62.gate_proj:  40%|███▉      | 14480/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.62.up_proj:  40%|███▉      | 14481/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.62.down_proj:  40%|███▉      | 14482/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.63.gate_proj:  40%|███▉      | 14483/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.63.up_proj:  40%|███▉      | 14484/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.63.down_proj:  40%|███▉      | 14485/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.64.gate_proj:  40%|███▉      | 14486/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.64.up_proj:  40%|███▉      | 14487/36566 [00:13<00:18, 1170.97it/s]  
packing model.layers.36.mlp.experts.64.down_proj:  40%|███▉      | 14488/36566 [00:13<00:18, 1170.97it/s]
packing model.layers.36.mlp.experts.64.down_proj:  40%|███▉      | 14489/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.65.gate_proj:  40%|███▉      | 14489/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.65.up_proj:  40%|███▉      | 14490/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.65.down_proj:  40%|███▉      | 14491/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.66.gate_proj:  40%|███▉      | 14492/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.66.up_proj:  40%|███▉      | 14493/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.66.down_proj:  40%|███▉      | 14494/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.67.gate_proj:  40%|███▉      | 14495/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.67.up_proj:  40%|███▉      | 14496/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.67.down_proj:  40%|███▉      | 14497/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.68.gate_proj:  40%|███▉      | 14498/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.68.up_proj:  40%|███▉      | 14499/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.68.down_proj:  40%|███▉      | 14500/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.69.gate_proj:  40%|███▉      | 14501/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.69.up_proj:  40%|███▉      | 14502/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.69.down_proj:  40%|███▉      | 14503/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.70.gate_proj:  40%|███▉      | 14504/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.70.up_proj:  40%|███▉      | 14505/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.70.down_proj:  40%|███▉      | 14506/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.71.gate_proj:  40%|███▉      | 14507/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.71.up_proj:  40%|███▉      | 14508/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.71.down_proj:  40%|███▉      | 14509/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.72.gate_proj:  40%|███▉      | 14510/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.72.up_proj:  40%|███▉      | 14511/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.72.down_proj:  40%|███▉      | 14512/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.73.gate_proj:  40%|███▉      | 14513/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.73.up_proj:  40%|███▉      | 14514/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.73.down_proj:  40%|███▉      | 14515/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.74.gate_proj:  40%|███▉      | 14516/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.74.up_proj:  40%|███▉      | 14517/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.74.down_proj:  40%|███▉      | 14518/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.75.gate_proj:  40%|███▉      | 14519/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.75.up_proj:  40%|███▉      | 14520/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.75.down_proj:  40%|███▉      | 14521/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.76.gate_proj:  40%|███▉      | 14522/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.76.up_proj:  40%|███▉      | 14523/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.76.down_proj:  40%|███▉      | 14524/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.77.gate_proj:  40%|███▉      | 14525/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.77.up_proj:  40%|███▉      | 14526/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.77.down_proj:  40%|███▉      | 14527/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.78.gate_proj:  40%|███▉      | 14528/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.78.up_proj:  40%|███▉      | 14529/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.78.down_proj:  40%|███▉      | 14530/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.79.gate_proj:  40%|███▉      | 14531/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.79.up_proj:  40%|███▉      | 14532/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.79.down_proj:  40%|███▉      | 14533/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.80.gate_proj:  40%|███▉      | 14534/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.80.up_proj:  40%|███▉      | 14535/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.80.down_proj:  40%|███▉      | 14536/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.81.gate_proj:  40%|███▉      | 14537/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.81.up_proj:  40%|███▉      | 14538/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.81.down_proj:  40%|███▉      | 14539/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.82.gate_proj:  40%|███▉      | 14540/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.82.up_proj:  40%|███▉      | 14541/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.82.down_proj:  40%|███▉      | 14542/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.83.gate_proj:  40%|███▉      | 14543/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.83.up_proj:  40%|███▉      | 14544/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.83.down_proj:  40%|███▉      | 14545/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.84.gate_proj:  40%|███▉      | 14546/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.84.up_proj:  40%|███▉      | 14547/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.84.down_proj:  40%|███▉      | 14548/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.85.gate_proj:  40%|███▉      | 14549/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.85.up_proj:  40%|███▉      | 14550/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.85.down_proj:  40%|███▉      | 14551/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.86.gate_proj:  40%|███▉      | 14552/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.86.up_proj:  40%|███▉      | 14553/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.86.down_proj:  40%|███▉      | 14554/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.87.gate_proj:  40%|███▉      | 14555/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.87.up_proj:  40%|███▉      | 14556/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.87.down_proj:  40%|███▉      | 14557/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.88.gate_proj:  40%|███▉      | 14558/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.88.up_proj:  40%|███▉      | 14559/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.88.down_proj:  40%|███▉      | 14560/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.89.gate_proj:  40%|███▉      | 14561/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.89.up_proj:  40%|███▉      | 14562/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.89.down_proj:  40%|███▉      | 14563/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.90.gate_proj:  40%|███▉      | 14564/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.90.up_proj:  40%|███▉      | 14565/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.90.down_proj:  40%|███▉      | 14566/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.91.gate_proj:  40%|███▉      | 14567/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.91.up_proj:  40%|███▉      | 14568/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.91.down_proj:  40%|███▉      | 14569/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.92.gate_proj:  40%|███▉      | 14570/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.92.up_proj:  40%|███▉      | 14571/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.92.down_proj:  40%|███▉      | 14572/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.93.gate_proj:  40%|███▉      | 14573/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.93.up_proj:  40%|███▉      | 14574/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.93.down_proj:  40%|███▉      | 14575/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.94.gate_proj:  40%|███▉      | 14576/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.94.up_proj:  40%|███▉      | 14577/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.94.down_proj:  40%|███▉      | 14578/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.95.gate_proj:  40%|███▉      | 14579/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.95.up_proj:  40%|███▉      | 14580/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.95.down_proj:  40%|███▉      | 14581/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.96.gate_proj:  40%|███▉      | 14582/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.96.up_proj:  40%|███▉      | 14583/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.96.down_proj:  40%|███▉      | 14584/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.97.gate_proj:  40%|███▉      | 14585/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.97.up_proj:  40%|███▉      | 14586/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.97.down_proj:  40%|███▉      | 14587/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.98.gate_proj:  40%|███▉      | 14588/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.98.up_proj:  40%|███▉      | 14589/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.98.down_proj:  40%|███▉      | 14590/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.99.gate_proj:  40%|███▉      | 14591/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.99.up_proj:  40%|███▉      | 14592/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.99.down_proj:  40%|███▉      | 14593/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.100.gate_proj:  40%|███▉      | 14594/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.100.up_proj:  40%|███▉      | 14595/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.100.down_proj:  40%|███▉      | 14596/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.101.gate_proj:  40%|███▉      | 14597/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.101.up_proj:  40%|███▉      | 14598/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.101.down_proj:  40%|███▉      | 14599/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.102.gate_proj:  40%|███▉      | 14600/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.102.up_proj:  40%|███▉      | 14601/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.102.down_proj:  40%|███▉      | 14602/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.103.gate_proj:  40%|███▉      | 14603/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.103.up_proj:  40%|███▉      | 14604/36566 [00:13<00:18, 1168.80it/s]  
packing model.layers.36.mlp.experts.103.down_proj:  40%|███▉      | 14605/36566 [00:13<00:18, 1168.80it/s]
packing model.layers.36.mlp.experts.103.down_proj:  40%|███▉      | 14606/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.104.gate_proj:  40%|███▉      | 14606/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.104.up_proj:  40%|███▉      | 14607/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.104.down_proj:  40%|███▉      | 14608/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.105.gate_proj:  40%|███▉      | 14609/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.105.up_proj:  40%|███▉      | 14610/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.105.down_proj:  40%|███▉      | 14611/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.106.gate_proj:  40%|███▉      | 14612/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.106.up_proj:  40%|███▉      | 14613/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.106.down_proj:  40%|███▉      | 14614/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.107.gate_proj:  40%|███▉      | 14615/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.107.up_proj:  40%|███▉      | 14616/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.107.down_proj:  40%|███▉      | 14617/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.108.gate_proj:  40%|███▉      | 14618/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.108.up_proj:  40%|███▉      | 14619/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.108.down_proj:  40%|███▉      | 14620/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.109.gate_proj:  40%|███▉      | 14621/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.109.up_proj:  40%|███▉      | 14622/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.109.down_proj:  40%|███▉      | 14623/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.110.gate_proj:  40%|███▉      | 14624/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.110.up_proj:  40%|███▉      | 14625/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.110.down_proj:  40%|███▉      | 14626/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.111.gate_proj:  40%|████      | 14627/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.111.up_proj:  40%|████      | 14628/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.111.down_proj:  40%|████      | 14629/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.112.gate_proj:  40%|████      | 14630/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.112.up_proj:  40%|████      | 14631/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.112.down_proj:  40%|████      | 14632/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.113.gate_proj:  40%|████      | 14633/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.113.up_proj:  40%|████      | 14634/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.113.down_proj:  40%|████      | 14635/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.114.gate_proj:  40%|████      | 14636/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.114.up_proj:  40%|████      | 14637/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.114.down_proj:  40%|████      | 14638/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.115.gate_proj:  40%|████      | 14639/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.115.up_proj:  40%|████      | 14640/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.115.down_proj:  40%|████      | 14641/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.116.gate_proj:  40%|████      | 14642/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.116.up_proj:  40%|████      | 14643/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.116.down_proj:  40%|████      | 14644/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.117.gate_proj:  40%|████      | 14645/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.117.up_proj:  40%|████      | 14646/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.117.down_proj:  40%|████      | 14647/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.118.gate_proj:  40%|████      | 14648/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.118.up_proj:  40%|████      | 14649/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.118.down_proj:  40%|████      | 14650/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.119.gate_proj:  40%|████      | 14651/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.119.up_proj:  40%|████      | 14652/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.119.down_proj:  40%|████      | 14653/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.120.gate_proj:  40%|████      | 14654/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.120.up_proj:  40%|████      | 14655/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.120.down_proj:  40%|████      | 14656/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.121.gate_proj:  40%|████      | 14657/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.121.up_proj:  40%|████      | 14658/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.121.down_proj:  40%|████      | 14659/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.122.gate_proj:  40%|████      | 14660/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.122.up_proj:  40%|████      | 14661/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.122.down_proj:  40%|████      | 14662/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.123.gate_proj:  40%|████      | 14663/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.123.up_proj:  40%|████      | 14664/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.123.down_proj:  40%|████      | 14665/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.124.gate_proj:  40%|████      | 14666/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.124.up_proj:  40%|████      | 14667/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.124.down_proj:  40%|████      | 14668/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.125.gate_proj:  40%|████      | 14669/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.125.up_proj:  40%|████      | 14670/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.125.down_proj:  40%|████      | 14671/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.126.gate_proj:  40%|████      | 14672/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.126.up_proj:  40%|████      | 14673/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.126.down_proj:  40%|████      | 14674/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.127.gate_proj:  40%|████      | 14675/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.36.mlp.experts.127.up_proj:  40%|████      | 14676/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.36.mlp.experts.127.down_proj:  40%|████      | 14677/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.0.gate_proj:  40%|████      | 14678/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.0.up_proj:  40%|████      | 14679/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.0.down_proj:  40%|████      | 14680/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.1.gate_proj:  40%|████      | 14681/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.1.up_proj:  40%|████      | 14682/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.1.down_proj:  40%|████      | 14683/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.2.gate_proj:  40%|████      | 14684/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.2.up_proj:  40%|████      | 14685/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.2.down_proj:  40%|████      | 14686/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.3.gate_proj:  40%|████      | 14687/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.3.up_proj:  40%|████      | 14688/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.3.down_proj:  40%|████      | 14689/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.4.gate_proj:  40%|████      | 14690/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.4.up_proj:  40%|████      | 14691/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.4.down_proj:  40%|████      | 14692/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.5.gate_proj:  40%|████      | 14693/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.5.up_proj:  40%|████      | 14694/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.5.down_proj:  40%|████      | 14695/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.6.gate_proj:  40%|████      | 14696/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.6.up_proj:  40%|████      | 14697/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.6.down_proj:  40%|████      | 14698/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.7.gate_proj:  40%|████      | 14699/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.7.up_proj:  40%|████      | 14700/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.7.down_proj:  40%|████      | 14701/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.8.gate_proj:  40%|████      | 14702/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.8.up_proj:  40%|████      | 14703/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.8.down_proj:  40%|████      | 14704/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.9.gate_proj:  40%|████      | 14705/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.9.up_proj:  40%|████      | 14706/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.9.down_proj:  40%|████      | 14707/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.10.gate_proj:  40%|████      | 14708/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.10.up_proj:  40%|████      | 14709/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.10.down_proj:  40%|████      | 14710/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.11.gate_proj:  40%|████      | 14711/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.11.up_proj:  40%|████      | 14712/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.11.down_proj:  40%|████      | 14713/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.12.gate_proj:  40%|████      | 14714/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.12.up_proj:  40%|████      | 14715/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.12.down_proj:  40%|████      | 14716/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.13.gate_proj:  40%|████      | 14717/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.13.up_proj:  40%|████      | 14718/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.13.down_proj:  40%|████      | 14719/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.14.gate_proj:  40%|████      | 14720/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.14.up_proj:  40%|████      | 14721/36566 [00:13<00:18, 1167.32it/s]  
packing model.layers.37.mlp.experts.14.down_proj:  40%|████      | 14722/36566 [00:13<00:18, 1167.32it/s]
packing model.layers.37.mlp.experts.14.down_proj:  40%|████      | 14723/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.15.gate_proj:  40%|████      | 14723/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.15.up_proj:  40%|████      | 14724/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.15.down_proj:  40%|████      | 14725/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.16.gate_proj:  40%|████      | 14726/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.16.up_proj:  40%|████      | 14727/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.16.down_proj:  40%|████      | 14728/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.17.gate_proj:  40%|████      | 14729/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.17.up_proj:  40%|████      | 14730/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.17.down_proj:  40%|████      | 14731/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.18.gate_proj:  40%|████      | 14732/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.18.up_proj:  40%|████      | 14733/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.18.down_proj:  40%|████      | 14734/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.19.gate_proj:  40%|████      | 14735/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.19.up_proj:  40%|████      | 14736/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.19.down_proj:  40%|████      | 14737/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.20.gate_proj:  40%|████      | 14738/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.20.up_proj:  40%|████      | 14739/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.20.down_proj:  40%|████      | 14740/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.21.gate_proj:  40%|████      | 14741/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.21.up_proj:  40%|████      | 14742/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.21.down_proj:  40%|████      | 14743/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.22.gate_proj:  40%|████      | 14744/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.22.up_proj:  40%|████      | 14745/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.22.down_proj:  40%|████      | 14746/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.23.gate_proj:  40%|████      | 14747/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.23.up_proj:  40%|████      | 14748/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.23.down_proj:  40%|████      | 14749/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.24.gate_proj:  40%|████      | 14750/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.24.up_proj:  40%|████      | 14751/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.24.down_proj:  40%|████      | 14752/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.25.gate_proj:  40%|████      | 14753/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.25.up_proj:  40%|████      | 14754/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.25.down_proj:  40%|████      | 14755/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.26.gate_proj:  40%|████      | 14756/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.26.up_proj:  40%|████      | 14757/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.26.down_proj:  40%|████      | 14758/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.27.gate_proj:  40%|████      | 14759/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.27.up_proj:  40%|████      | 14760/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.27.down_proj:  40%|████      | 14761/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.28.gate_proj:  40%|████      | 14762/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.28.up_proj:  40%|████      | 14763/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.28.down_proj:  40%|████      | 14764/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.29.gate_proj:  40%|████      | 14765/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.29.up_proj:  40%|████      | 14766/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.29.down_proj:  40%|████      | 14767/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.30.gate_proj:  40%|████      | 14768/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.30.up_proj:  40%|████      | 14769/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.30.down_proj:  40%|████      | 14770/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.31.gate_proj:  40%|████      | 14771/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.31.up_proj:  40%|████      | 14772/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.31.down_proj:  40%|████      | 14773/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.32.gate_proj:  40%|████      | 14774/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.32.up_proj:  40%|████      | 14775/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.32.down_proj:  40%|████      | 14776/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.33.gate_proj:  40%|████      | 14777/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.33.up_proj:  40%|████      | 14778/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.33.down_proj:  40%|████      | 14779/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.34.gate_proj:  40%|████      | 14780/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.34.up_proj:  40%|████      | 14781/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.34.down_proj:  40%|████      | 14782/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.35.gate_proj:  40%|████      | 14783/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.35.up_proj:  40%|████      | 14784/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.35.down_proj:  40%|████      | 14785/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.36.gate_proj:  40%|████      | 14786/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.36.up_proj:  40%|████      | 14787/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.36.down_proj:  40%|████      | 14788/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.37.gate_proj:  40%|████      | 14789/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.37.up_proj:  40%|████      | 14790/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.37.down_proj:  40%|████      | 14791/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.38.gate_proj:  40%|████      | 14792/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.38.up_proj:  40%|████      | 14793/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.38.down_proj:  40%|████      | 14794/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.39.gate_proj:  40%|████      | 14795/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.39.up_proj:  40%|████      | 14796/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.39.down_proj:  40%|████      | 14797/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.40.gate_proj:  40%|████      | 14798/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.40.up_proj:  40%|████      | 14799/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.40.down_proj:  40%|████      | 14800/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.41.gate_proj:  40%|████      | 14801/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.41.up_proj:  40%|████      | 14802/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.41.down_proj:  40%|████      | 14803/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.42.gate_proj:  40%|████      | 14804/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.42.up_proj:  40%|████      | 14805/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.42.down_proj:  40%|████      | 14806/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.43.gate_proj:  40%|████      | 14807/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.43.up_proj:  40%|████      | 14808/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.43.down_proj:  40%|████      | 14809/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.44.gate_proj:  41%|████      | 14810/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.44.up_proj:  41%|████      | 14811/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.44.down_proj:  41%|████      | 14812/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.45.gate_proj:  41%|████      | 14813/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.45.up_proj:  41%|████      | 14814/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.45.down_proj:  41%|████      | 14815/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.46.gate_proj:  41%|████      | 14816/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.46.up_proj:  41%|████      | 14817/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.46.down_proj:  41%|████      | 14818/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.47.gate_proj:  41%|████      | 14819/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.47.up_proj:  41%|████      | 14820/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.47.down_proj:  41%|████      | 14821/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.48.gate_proj:  41%|████      | 14822/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.48.up_proj:  41%|████      | 14823/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.48.down_proj:  41%|████      | 14824/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.49.gate_proj:  41%|████      | 14825/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.49.up_proj:  41%|████      | 14826/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.49.down_proj:  41%|████      | 14827/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.50.gate_proj:  41%|████      | 14828/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.50.up_proj:  41%|████      | 14829/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.50.down_proj:  41%|████      | 14830/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.51.gate_proj:  41%|████      | 14831/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.51.up_proj:  41%|████      | 14832/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.51.down_proj:  41%|████      | 14833/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.52.gate_proj:  41%|████      | 14834/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.52.up_proj:  41%|████      | 14835/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.52.down_proj:  41%|████      | 14836/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.53.gate_proj:  41%|████      | 14837/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.53.up_proj:  41%|████      | 14838/36566 [00:13<00:18, 1167.81it/s]  
packing model.layers.37.mlp.experts.53.down_proj:  41%|████      | 14839/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.54.gate_proj:  41%|████      | 14840/36566 [00:13<00:18, 1167.81it/s]
packing model.layers.37.mlp.experts.54.gate_proj:  41%|████      | 14841/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.54.up_proj:  41%|████      | 14841/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.54.down_proj:  41%|████      | 14842/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.55.gate_proj:  41%|████      | 14843/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.55.up_proj:  41%|████      | 14844/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.55.down_proj:  41%|████      | 14845/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.56.gate_proj:  41%|████      | 14846/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.56.up_proj:  41%|████      | 14847/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.56.down_proj:  41%|████      | 14848/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.57.gate_proj:  41%|████      | 14849/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.57.up_proj:  41%|████      | 14850/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.57.down_proj:  41%|████      | 14851/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.58.gate_proj:  41%|████      | 14852/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.58.up_proj:  41%|████      | 14853/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.58.down_proj:  41%|████      | 14854/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.59.gate_proj:  41%|████      | 14855/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.59.up_proj:  41%|████      | 14856/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.59.down_proj:  41%|████      | 14857/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.60.gate_proj:  41%|████      | 14858/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.60.up_proj:  41%|████      | 14859/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.60.down_proj:  41%|████      | 14860/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.61.gate_proj:  41%|████      | 14861/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.61.up_proj:  41%|████      | 14862/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.61.down_proj:  41%|████      | 14863/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.62.gate_proj:  41%|████      | 14864/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.62.up_proj:  41%|████      | 14865/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.62.down_proj:  41%|████      | 14866/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.63.gate_proj:  41%|████      | 14867/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.63.up_proj:  41%|████      | 14868/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.63.down_proj:  41%|████      | 14869/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.64.gate_proj:  41%|████      | 14870/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.64.up_proj:  41%|████      | 14871/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.64.down_proj:  41%|████      | 14872/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.65.gate_proj:  41%|████      | 14873/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.65.up_proj:  41%|████      | 14874/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.65.down_proj:  41%|████      | 14875/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.66.gate_proj:  41%|████      | 14876/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.66.up_proj:  41%|████      | 14877/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.66.down_proj:  41%|████      | 14878/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.67.gate_proj:  41%|████      | 14879/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.67.up_proj:  41%|████      | 14880/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.67.down_proj:  41%|████      | 14881/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.68.gate_proj:  41%|████      | 14882/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.68.up_proj:  41%|████      | 14883/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.68.down_proj:  41%|████      | 14884/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.69.gate_proj:  41%|████      | 14885/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.69.up_proj:  41%|████      | 14886/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.69.down_proj:  41%|████      | 14887/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.70.gate_proj:  41%|████      | 14888/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.70.up_proj:  41%|████      | 14889/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.70.down_proj:  41%|████      | 14890/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.71.gate_proj:  41%|████      | 14891/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.71.up_proj:  41%|████      | 14892/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.71.down_proj:  41%|████      | 14893/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.72.gate_proj:  41%|████      | 14894/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.72.up_proj:  41%|████      | 14895/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.72.down_proj:  41%|████      | 14896/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.73.gate_proj:  41%|████      | 14897/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.73.up_proj:  41%|████      | 14898/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.73.down_proj:  41%|████      | 14899/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.74.gate_proj:  41%|████      | 14900/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.74.up_proj:  41%|████      | 14901/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.74.down_proj:  41%|████      | 14902/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.75.gate_proj:  41%|████      | 14903/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.75.up_proj:  41%|████      | 14904/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.75.down_proj:  41%|████      | 14905/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.76.gate_proj:  41%|████      | 14906/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.76.up_proj:  41%|████      | 14907/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.76.down_proj:  41%|████      | 14908/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.77.gate_proj:  41%|████      | 14909/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.77.up_proj:  41%|████      | 14910/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.77.down_proj:  41%|████      | 14911/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.78.gate_proj:  41%|████      | 14912/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.78.up_proj:  41%|████      | 14913/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.78.down_proj:  41%|████      | 14914/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.79.gate_proj:  41%|████      | 14915/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.79.up_proj:  41%|████      | 14916/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.79.down_proj:  41%|████      | 14917/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.80.gate_proj:  41%|████      | 14918/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.80.up_proj:  41%|████      | 14919/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.80.down_proj:  41%|████      | 14920/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.81.gate_proj:  41%|████      | 14921/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.81.up_proj:  41%|████      | 14922/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.81.down_proj:  41%|████      | 14923/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.82.gate_proj:  41%|████      | 14924/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.82.up_proj:  41%|████      | 14925/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.82.down_proj:  41%|████      | 14926/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.83.gate_proj:  41%|████      | 14927/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.83.up_proj:  41%|████      | 14928/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.83.down_proj:  41%|████      | 14929/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.84.gate_proj:  41%|████      | 14930/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.84.up_proj:  41%|████      | 14931/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.84.down_proj:  41%|████      | 14932/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.85.gate_proj:  41%|████      | 14933/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.85.up_proj:  41%|████      | 14934/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.85.down_proj:  41%|████      | 14935/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.86.gate_proj:  41%|████      | 14936/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.86.up_proj:  41%|████      | 14937/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.86.down_proj:  41%|████      | 14938/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.87.gate_proj:  41%|████      | 14939/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.87.up_proj:  41%|████      | 14940/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.87.down_proj:  41%|████      | 14941/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.88.gate_proj:  41%|████      | 14942/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.88.up_proj:  41%|████      | 14943/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.88.down_proj:  41%|████      | 14944/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.89.gate_proj:  41%|████      | 14945/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.89.up_proj:  41%|████      | 14946/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.89.down_proj:  41%|████      | 14947/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.90.gate_proj:  41%|████      | 14948/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.90.up_proj:  41%|████      | 14949/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.90.down_proj:  41%|████      | 14950/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.91.gate_proj:  41%|████      | 14951/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.91.up_proj:  41%|████      | 14952/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.91.down_proj:  41%|████      | 14953/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.92.gate_proj:  41%|████      | 14954/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.92.up_proj:  41%|████      | 14955/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.92.down_proj:  41%|████      | 14956/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.93.gate_proj:  41%|████      | 14957/36566 [00:13<00:18, 1170.74it/s]
packing model.layers.37.mlp.experts.93.up_proj:  41%|████      | 14958/36566 [00:13<00:18, 1170.74it/s]  
packing model.layers.37.mlp.experts.93.up_proj:  41%|████      | 14959/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.93.down_proj:  41%|████      | 14959/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.94.gate_proj:  41%|████      | 14960/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.94.up_proj:  41%|████      | 14961/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.94.down_proj:  41%|████      | 14962/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.95.gate_proj:  41%|████      | 14963/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.95.up_proj:  41%|████      | 14964/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.95.down_proj:  41%|████      | 14965/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.96.gate_proj:  41%|████      | 14966/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.96.up_proj:  41%|████      | 14967/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.96.down_proj:  41%|████      | 14968/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.97.gate_proj:  41%|████      | 14969/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.97.up_proj:  41%|████      | 14970/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.97.down_proj:  41%|████      | 14971/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.98.gate_proj:  41%|████      | 14972/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.98.up_proj:  41%|████      | 14973/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.98.down_proj:  41%|████      | 14974/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.99.gate_proj:  41%|████      | 14975/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.99.up_proj:  41%|████      | 14976/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.99.down_proj:  41%|████      | 14977/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.100.gate_proj:  41%|████      | 14978/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.100.up_proj:  41%|████      | 14979/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.100.down_proj:  41%|████      | 14980/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.101.gate_proj:  41%|████      | 14981/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.101.up_proj:  41%|████      | 14982/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.101.down_proj:  41%|████      | 14983/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.102.gate_proj:  41%|████      | 14984/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.102.up_proj:  41%|████      | 14985/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.102.down_proj:  41%|████      | 14986/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.103.gate_proj:  41%|████      | 14987/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.103.up_proj:  41%|████      | 14988/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.103.down_proj:  41%|████      | 14989/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.104.gate_proj:  41%|████      | 14990/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.104.up_proj:  41%|████      | 14991/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.104.down_proj:  41%|████      | 14992/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.105.gate_proj:  41%|████      | 14993/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.105.up_proj:  41%|████      | 14994/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.105.down_proj:  41%|████      | 14995/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.106.gate_proj:  41%|████      | 14996/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.106.up_proj:  41%|████      | 14997/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.106.down_proj:  41%|████      | 14998/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.107.gate_proj:  41%|████      | 14999/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.107.up_proj:  41%|████      | 15000/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.107.down_proj:  41%|████      | 15001/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.108.gate_proj:  41%|████      | 15002/36566 [00:13<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.108.up_proj:  41%|████      | 15003/36566 [00:13<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.108.down_proj:  41%|████      | 15004/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.109.gate_proj:  41%|████      | 15005/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.109.up_proj:  41%|████      | 15006/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.109.down_proj:  41%|████      | 15007/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.110.gate_proj:  41%|████      | 15008/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.110.up_proj:  41%|████      | 15009/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.110.down_proj:  41%|████      | 15010/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.111.gate_proj:  41%|████      | 15011/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.111.up_proj:  41%|████      | 15012/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.111.down_proj:  41%|████      | 15013/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.112.gate_proj:  41%|████      | 15014/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.112.up_proj:  41%|████      | 15015/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.112.down_proj:  41%|████      | 15016/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.113.gate_proj:  41%|████      | 15017/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.113.up_proj:  41%|████      | 15018/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.113.down_proj:  41%|████      | 15019/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.114.gate_proj:  41%|████      | 15020/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.114.up_proj:  41%|████      | 15021/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.114.down_proj:  41%|████      | 15022/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.115.gate_proj:  41%|████      | 15023/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.115.up_proj:  41%|████      | 15024/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.115.down_proj:  41%|████      | 15025/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.116.gate_proj:  41%|████      | 15026/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.116.up_proj:  41%|████      | 15027/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.116.down_proj:  41%|████      | 15028/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.117.gate_proj:  41%|████      | 15029/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.117.up_proj:  41%|████      | 15030/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.117.down_proj:  41%|████      | 15031/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.118.gate_proj:  41%|████      | 15032/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.118.up_proj:  41%|████      | 15033/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.118.down_proj:  41%|████      | 15034/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.119.gate_proj:  41%|████      | 15035/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.119.up_proj:  41%|████      | 15036/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.119.down_proj:  41%|████      | 15037/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.120.gate_proj:  41%|████      | 15038/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.120.up_proj:  41%|████      | 15039/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.120.down_proj:  41%|████      | 15040/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.121.gate_proj:  41%|████      | 15041/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.121.up_proj:  41%|████      | 15042/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.121.down_proj:  41%|████      | 15043/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.122.gate_proj:  41%|████      | 15044/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.122.up_proj:  41%|████      | 15045/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.122.down_proj:  41%|████      | 15046/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.123.gate_proj:  41%|████      | 15047/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.123.up_proj:  41%|████      | 15048/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.123.down_proj:  41%|████      | 15049/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.124.gate_proj:  41%|████      | 15050/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.124.up_proj:  41%|████      | 15051/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.124.down_proj:  41%|████      | 15052/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.125.gate_proj:  41%|████      | 15053/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.125.up_proj:  41%|████      | 15054/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.125.down_proj:  41%|████      | 15055/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.126.gate_proj:  41%|████      | 15056/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.126.up_proj:  41%|████      | 15057/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.126.down_proj:  41%|████      | 15058/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.127.gate_proj:  41%|████      | 15059/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.37.mlp.experts.127.up_proj:  41%|████      | 15060/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.37.mlp.experts.127.down_proj:  41%|████      | 15061/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.0.gate_proj:  41%|████      | 15062/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.38.mlp.experts.0.up_proj:  41%|████      | 15063/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.38.mlp.experts.0.down_proj:  41%|████      | 15064/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.1.gate_proj:  41%|████      | 15065/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.1.up_proj:  41%|████      | 15066/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.38.mlp.experts.1.down_proj:  41%|████      | 15067/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.2.gate_proj:  41%|████      | 15068/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.2.up_proj:  41%|████      | 15069/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.38.mlp.experts.2.down_proj:  41%|████      | 15070/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.3.gate_proj:  41%|████      | 15071/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.3.up_proj:  41%|████      | 15072/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.38.mlp.experts.3.down_proj:  41%|████      | 15073/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.4.gate_proj:  41%|████      | 15074/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.4.up_proj:  41%|████      | 15075/36566 [00:14<00:18, 1171.92it/s]  
packing model.layers.38.mlp.experts.4.down_proj:  41%|████      | 15076/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.5.gate_proj:  41%|████      | 15077/36566 [00:14<00:18, 1171.92it/s]
packing model.layers.38.mlp.experts.5.gate_proj:  41%|████      | 15078/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.5.up_proj:  41%|████      | 15078/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.5.down_proj:  41%|████      | 15079/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.6.gate_proj:  41%|████      | 15080/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.6.up_proj:  41%|████      | 15081/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.6.down_proj:  41%|████      | 15082/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.7.gate_proj:  41%|████      | 15083/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.7.up_proj:  41%|████▏     | 15084/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.7.down_proj:  41%|████▏     | 15085/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.8.gate_proj:  41%|████▏     | 15086/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.8.up_proj:  41%|████▏     | 15087/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.8.down_proj:  41%|████▏     | 15088/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.9.gate_proj:  41%|████▏     | 15089/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.9.up_proj:  41%|████▏     | 15090/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.9.down_proj:  41%|████▏     | 15091/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.10.gate_proj:  41%|████▏     | 15092/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.10.up_proj:  41%|████▏     | 15093/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.10.down_proj:  41%|████▏     | 15094/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.11.gate_proj:  41%|████▏     | 15095/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.11.up_proj:  41%|████▏     | 15096/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.11.down_proj:  41%|████▏     | 15097/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.12.gate_proj:  41%|████▏     | 15098/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.12.up_proj:  41%|████▏     | 15099/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.12.down_proj:  41%|████▏     | 15100/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.13.gate_proj:  41%|████▏     | 15101/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.13.up_proj:  41%|████▏     | 15102/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.13.down_proj:  41%|████▏     | 15103/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.14.gate_proj:  41%|████▏     | 15104/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.14.up_proj:  41%|████▏     | 15105/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.14.down_proj:  41%|████▏     | 15106/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.15.gate_proj:  41%|████▏     | 15107/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.15.up_proj:  41%|████▏     | 15108/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.15.down_proj:  41%|████▏     | 15109/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.16.gate_proj:  41%|████▏     | 15110/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.16.up_proj:  41%|████▏     | 15111/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.16.down_proj:  41%|████▏     | 15112/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.17.gate_proj:  41%|████▏     | 15113/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.17.up_proj:  41%|████▏     | 15114/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.17.down_proj:  41%|████▏     | 15115/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.18.gate_proj:  41%|████▏     | 15116/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.18.up_proj:  41%|████▏     | 15117/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.18.down_proj:  41%|████▏     | 15118/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.19.gate_proj:  41%|████▏     | 15119/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.19.up_proj:  41%|████▏     | 15120/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.19.down_proj:  41%|████▏     | 15121/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.20.gate_proj:  41%|████▏     | 15122/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.20.up_proj:  41%|████▏     | 15123/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.20.down_proj:  41%|████▏     | 15124/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.21.gate_proj:  41%|████▏     | 15125/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.21.up_proj:  41%|████▏     | 15126/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.21.down_proj:  41%|████▏     | 15127/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.22.gate_proj:  41%|████▏     | 15128/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.22.up_proj:  41%|████▏     | 15129/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.22.down_proj:  41%|████▏     | 15130/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.23.gate_proj:  41%|████▏     | 15131/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.23.up_proj:  41%|████▏     | 15132/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.23.down_proj:  41%|████▏     | 15133/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.24.gate_proj:  41%|████▏     | 15134/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.24.up_proj:  41%|████▏     | 15135/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.24.down_proj:  41%|████▏     | 15136/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.25.gate_proj:  41%|████▏     | 15137/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.25.up_proj:  41%|████▏     | 15138/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.25.down_proj:  41%|████▏     | 15139/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.26.gate_proj:  41%|████▏     | 15140/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.26.up_proj:  41%|████▏     | 15141/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.26.down_proj:  41%|████▏     | 15142/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.27.gate_proj:  41%|████▏     | 15143/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.27.up_proj:  41%|████▏     | 15144/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.27.down_proj:  41%|████▏     | 15145/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.28.gate_proj:  41%|████▏     | 15146/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.28.up_proj:  41%|████▏     | 15147/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.28.down_proj:  41%|████▏     | 15148/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.29.gate_proj:  41%|████▏     | 15149/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.29.up_proj:  41%|████▏     | 15150/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.29.down_proj:  41%|████▏     | 15151/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.30.gate_proj:  41%|████▏     | 15152/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.30.up_proj:  41%|████▏     | 15153/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.30.down_proj:  41%|████▏     | 15154/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.31.gate_proj:  41%|████▏     | 15155/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.31.up_proj:  41%|████▏     | 15156/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.31.down_proj:  41%|████▏     | 15157/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.32.gate_proj:  41%|████▏     | 15158/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.32.up_proj:  41%|████▏     | 15159/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.32.down_proj:  41%|████▏     | 15160/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.33.gate_proj:  41%|████▏     | 15161/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.33.up_proj:  41%|████▏     | 15162/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.33.down_proj:  41%|████▏     | 15163/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.34.gate_proj:  41%|████▏     | 15164/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.34.up_proj:  41%|████▏     | 15165/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.34.down_proj:  41%|████▏     | 15166/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.35.gate_proj:  41%|████▏     | 15167/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.35.up_proj:  41%|████▏     | 15168/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.35.down_proj:  41%|████▏     | 15169/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.36.gate_proj:  41%|████▏     | 15170/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.36.up_proj:  41%|████▏     | 15171/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.36.down_proj:  41%|████▏     | 15172/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.37.gate_proj:  41%|████▏     | 15173/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.37.up_proj:  41%|████▏     | 15174/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.37.down_proj:  42%|████▏     | 15175/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.38.gate_proj:  42%|████▏     | 15176/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.38.up_proj:  42%|████▏     | 15177/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.38.down_proj:  42%|████▏     | 15178/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.39.gate_proj:  42%|████▏     | 15179/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.39.up_proj:  42%|████▏     | 15180/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.39.down_proj:  42%|████▏     | 15181/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.40.gate_proj:  42%|████▏     | 15182/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.40.up_proj:  42%|████▏     | 15183/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.40.down_proj:  42%|████▏     | 15184/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.41.gate_proj:  42%|████▏     | 15185/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.41.up_proj:  42%|████▏     | 15186/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.41.down_proj:  42%|████▏     | 15187/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.42.gate_proj:  42%|████▏     | 15188/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.42.up_proj:  42%|████▏     | 15189/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.42.down_proj:  42%|████▏     | 15190/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.43.gate_proj:  42%|████▏     | 15191/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.43.up_proj:  42%|████▏     | 15192/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.43.down_proj:  42%|████▏     | 15193/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.44.gate_proj:  42%|████▏     | 15194/36566 [00:14<00:18, 1174.50it/s]
packing model.layers.38.mlp.experts.44.up_proj:  42%|████▏     | 15195/36566 [00:14<00:18, 1174.50it/s]  
packing model.layers.38.mlp.experts.44.up_proj:  42%|████▏     | 15196/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.44.down_proj:  42%|████▏     | 15196/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.45.gate_proj:  42%|████▏     | 15197/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.45.up_proj:  42%|████▏     | 15198/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.45.down_proj:  42%|████▏     | 15199/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.46.gate_proj:  42%|████▏     | 15200/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.46.up_proj:  42%|████▏     | 15201/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.46.down_proj:  42%|████▏     | 15202/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.47.gate_proj:  42%|████▏     | 15203/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.47.up_proj:  42%|████▏     | 15204/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.47.down_proj:  42%|████▏     | 15205/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.48.gate_proj:  42%|████▏     | 15206/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.48.up_proj:  42%|████▏     | 15207/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.48.down_proj:  42%|████▏     | 15208/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.49.gate_proj:  42%|████▏     | 15209/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.49.up_proj:  42%|████▏     | 15210/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.49.down_proj:  42%|████▏     | 15211/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.50.gate_proj:  42%|████▏     | 15212/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.50.up_proj:  42%|████▏     | 15213/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.50.down_proj:  42%|████▏     | 15214/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.51.gate_proj:  42%|████▏     | 15215/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.51.up_proj:  42%|████▏     | 15216/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.51.down_proj:  42%|████▏     | 15217/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.52.gate_proj:  42%|████▏     | 15218/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.52.up_proj:  42%|████▏     | 15219/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.52.down_proj:  42%|████▏     | 15220/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.53.gate_proj:  42%|████▏     | 15221/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.53.up_proj:  42%|████▏     | 15222/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.53.down_proj:  42%|████▏     | 15223/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.54.gate_proj:  42%|████▏     | 15224/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.54.up_proj:  42%|████▏     | 15225/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.54.down_proj:  42%|████▏     | 15226/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.55.gate_proj:  42%|████▏     | 15227/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.55.up_proj:  42%|████▏     | 15228/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.55.down_proj:  42%|████▏     | 15229/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.56.gate_proj:  42%|████▏     | 15230/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.56.up_proj:  42%|████▏     | 15231/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.56.down_proj:  42%|████▏     | 15232/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.57.gate_proj:  42%|████▏     | 15233/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.57.up_proj:  42%|████▏     | 15234/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.57.down_proj:  42%|████▏     | 15235/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.58.gate_proj:  42%|████▏     | 15236/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.58.up_proj:  42%|████▏     | 15237/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.58.down_proj:  42%|████▏     | 15238/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.59.gate_proj:  42%|████▏     | 15239/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.59.up_proj:  42%|████▏     | 15240/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.59.down_proj:  42%|████▏     | 15241/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.60.gate_proj:  42%|████▏     | 15242/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.60.up_proj:  42%|████▏     | 15243/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.60.down_proj:  42%|████▏     | 15244/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.61.gate_proj:  42%|████▏     | 15245/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.61.up_proj:  42%|████▏     | 15246/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.61.down_proj:  42%|████▏     | 15247/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.62.gate_proj:  42%|████▏     | 15248/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.62.up_proj:  42%|████▏     | 15249/36566 [00:14<00:18, 1175.54it/s]  
packing model.layers.38.mlp.experts.62.down_proj:  42%|████▏     | 15250/36566 [00:14<00:18, 1175.54it/s]
packing model.layers.38.mlp.experts.63.gate_proj:  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Checking if ChaiML/muster-v0e-lr1e5ep2r64g4b01-W4A16 already exists in ChaiML
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Creating repo ChaiML/muster-v0e-lr1e5ep2r64g4b01-W4A16 and uploading /dev/shm/model_output to it
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Recovering from metadata files:   0%|          | 0/38 [00:00<?, ?it/s]
Recovering from metadata files: 100%|██████████| 38/38 [00:00<00:00, 8398.33it/s]
chaiml-muster-v0e-lr1e5-71769-v1-uploader: ---------- 2026-02-09 11:31:08 (0:00:00) ----------
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Files:   hashed 11/38 (26.1M/131.9G) | pre-uploaded: 0/1 (0.0/131.9G) (+27 unsure) | committed: 0/38 (0.0/131.9G) | ignored: 0
chaiml-muster-v0e-lr1e5-71769-v1-uploader: Workers: hashing: 27 | get upload mode: 0 | pre-uploading: 1 | committing: 0 | waiting: 98
chaiml-muster-v0e-lr1e5-71769-v1-uploader: ---------------------------------------------------
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Processing Files (0 / 0)      : |          |  0.00B /  0.00B            
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : |          |  0.00B /  0.00B            [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
Processing Files (1 / 1)      : 100%|██████████| 11.4MB / 11.4MB, 19.0MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
Processing Files (1 / 1)      : 100%|██████████| 11.4MB / 11.4MB, 14.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : |          |  0.00B /  0.00B,  0.00B/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
Processing Files (0 / 0)      : |          |  0.00B /  0.00B            
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : |          |  0.00B /  0.00B            [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:   0%|          | 73.3kB / 1.93GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:   0%|          | 73.3kB / 1.93GB            [A[A
Processing Files (0 / 1)      :   0%|          | 73.3kB / 1.93GB,   ???B/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:   0%|          | 73.3kB / 1.93GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:   3%|▎         | 67.0MB / 1.93GB            [A[A
Processing Files (0 / 1)      :   3%|▎         | 67.0MB / 1.93GB,  167MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  50%|████▉     | 66.9MB /  134MB,  167MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:   7%|▋         |  134MB / 1.93GB            [A[A
Processing Files (0 / 1)      :   7%|▋         |  134MB / 1.93GB,  223MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  134MB /  134MB,  223MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  10%|█         |  200MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  10%|█         |  200MB / 1.93GB,  250MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  75%|███████▍  |  200MB /  268MB,  250MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  14%|█▍        |  267MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  14%|█▍        |  267MB / 1.93GB,  267MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  99%|█████████▉|  267MB /  268MB,  267MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  14%|█▍        |  267MB / 1.93GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  15%|█▍        |  282MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  282MB / 1.93GB,  201MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  84%|████████▍ |  282MB /  335MB,  201MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  17%|█▋        |  335MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  335MB / 1.93GB,  209MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  83%|████████▎ |  335MB /  402MB,  209MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  21%|██        |  402MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  21%|██        |  402MB / 1.93GB,  223MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  86%|████████▌ |  402MB /  469MB,  223MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  24%|██▍       |  468MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       |  468MB / 1.93GB,  234MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  87%|████████▋ |  468MB /  536MB,  234MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  28%|██▊       |  535MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  28%|██▊       |  535MB / 1.93GB,  243MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  535MB /  536MB,  243MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  31%|███       |  602MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  31%|███       |  602MB / 1.93GB,  251MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  602MB /  603MB,  251MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  33%|███▎      |  639MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  33%|███▎      |  639MB / 1.93GB,  246MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▌|  639MB /  670MB,  246MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  35%|███▍      |  669MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  35%|███▍      |  669MB / 1.93GB,  239MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  669MB /  670MB,  239MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  35%|███▍      |  669MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  35%|███▍      |  669MB / 1.93GB,  223MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  669MB /  670MB,  223MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  40%|███▉      |  771MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  40%|███▉      |  771MB / 1.93GB,  241MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  670MB /  670MB,  209MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  44%|████▍     |  846MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  44%|████▍     |  846MB / 1.93GB,  249MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  48%|████▊     |  922MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  48%|████▊     |  922MB / 1.93GB,  256MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  52%|█████▏    |  998MB / 1.93GB            [A[A
Processing Files (0 / 1)      :  52%|█████▏    |  998MB / 1.93GB,  262MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|██████████|  670MB /  670MB,  176MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  56%|█████▌    | 1.07GB / 1.93GB            [A[A
Processing Files (0 / 1)      :  56%|█████▌    | 1.07GB / 1.93GB,  268MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  60%|█████▉    | 1.16GB / 1.93GB            [A[A
Processing Files (0 / 1)      :  60%|█████▉    | 1.16GB / 1.93GB,  276MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  63%|██████▎   | 1.22GB / 1.93GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 1.22GB / 1.93GB,  278MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors:  67%|██████▋   | 1.29GB / 1.93GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 1.29GB / 1.93GB,  281MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 77.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  603MB /  671MB, 77.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  11%|█         |  536MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:   9%|▉         |  469MB / 5.00GB            [A[A
Processing Files (0 / 1)      :   9%|▉         |  469MB / 5.00GB, 61.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  469MB /  469MB, 61.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  11%|█         |  536MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 77.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  603MB /  671MB, 77.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 77.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  603MB /  604MB, 77.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 83.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  670MB /  671MB, 83.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  11%|█         |  537MB / 5.00GB, 68.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  89%|████████▉ |  536MB /  603MB, 68.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:   9%|▉         |  469MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 75.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  603MB /  671MB, 75.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 75.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  603MB /  670MB, 75.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:   9%|▉         |  469MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 73.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  604MB /  671MB, 73.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 73.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  603MB /  604MB, 73.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 73.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  603MB /  604MB, 73.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:   9%|▉         |  469MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  11%|█         |  536MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  11%|█         |  536MB / 5.00GB, 63.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  536MB /  536MB, 63.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 70.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  604MB /  671MB, 70.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  11%|█         |  537MB / 5.00GB, 62.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  89%|████████▉ |  536MB /  603MB, 62.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 68.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  604MB /  671MB, 68.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 76.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  670MB /  738MB, 76.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  13%|█▎        |  670MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  670MB / 5.00GB, 76.1MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  670MB /  671MB, 76.1MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 68.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  603MB /  670MB, 68.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 74.5MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  671MB /  671MB, 74.5MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  13%|█▎        |  670MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  670MB / 5.00GB, 74.5MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  670MB /  738MB, 74.5MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 80.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  738MB /  805MB, 80.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 67.1MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|█████████ |  604MB /  671MB, 67.1MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  13%|█▎        |  641MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  641MB / 5.00GB, 71.1MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▌|  640MB /  670MB, 71.1MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  13%|█▎        |  670MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 72.9MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  670MB /  737MB, 72.9MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  604MB / 5.00GB, 65.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|█████████ |  604MB /  671MB, 65.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  13%|█▎        |  670MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 71.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  670MB /  738MB, 71.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 71.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  670MB /  671MB, 71.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 69.9MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  671MB /  738MB, 69.9MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  13%|█▎        |  670MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  12%|█▏        |  603MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  12%|█▏        |  603MB / 5.00GB, 62.9MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  90%|████████▉ |  603MB /  671MB, 62.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 68.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  671MB /  738MB, 68.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 75.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  737MB /  805MB, 75.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 75.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  737MB /  805MB, 75.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 80.5MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  805MB /  872MB, 80.5MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  12%|█▏        |  603MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 67.0MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  670MB /  737MB, 67.0MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  12%|█▏        |  603MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  737MB /  805MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  671MB /  738MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  15%|█▍        |  737MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  737MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  737MB /  805MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  12%|█▏        |  603MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  738MB /  805MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  737MB /  805MB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  15%|█▍        |  737MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  737MB /  805MB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  13%|█▎        |  671MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  91%|█████████ |  670MB /  738MB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  15%|█▍        |  737MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  805MB /  872MB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  805MB /  805MB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  16%|█▋        |  822MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▋        |  822MB / 5.00GB, 67.5MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍|  822MB /  872MB, 67.5MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  15%|█▍        |  737MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  738MB /  805MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  871MB /  939MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  738MB /  805MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  15%|█▍        |  737MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  804MB /  805MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  805MB /  805MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  805MB /  872MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  738MB /  805MB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  13%|█▎        |  671MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  805MB /  872MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  805MB /  872MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  15%|█▍        |  738MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  737MB /  805MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  872MB /  872MB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  872MB /  939MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  17%|█▋        |  857MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  857MB / 5.00GB, 70.9MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊|  856MB /  872MB, 70.9MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  938MB /  939MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  805MB /  872MB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 68.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  871MB /  939MB, 68.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 66.9MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  872MB /  939MB, 66.9MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  805MB /  872MB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  871MB /  939MB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  872MB /  939MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  938MB / 1.01GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  872MB /  939MB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 68.1MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  871MB /  939MB, 68.1MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  16%|█▌        |  805MB / 5.00GB, 72.1MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  92%|█████████▏|  804MB /  872MB, 72.1MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  939MB / 1.01GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  939MB / 1.01GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  939MB /  939MB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  938MB / 1.01GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  939MB / 1.01GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  19%|█▊        |  936MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▊        |  936MB / 5.00GB, 72.0MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  935MB /  939MB, 72.0MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  17%|█▋        |  871MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  871MB / 5.00GB, 72.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉|  871MB /  872MB, 72.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.01GB / 1.01GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.01GB / 1.01GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.01GB / 1.07GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  939MB / 1.01GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  938MB / 1.01GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  17%|█▋        |  872MB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  871MB /  939MB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.07GB / 1.14GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  19%|█▉        |  954MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  954MB / 5.00GB, 67.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍|  954MB / 1.01GB, 67.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  939MB / 1.01GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  17%|█▋        |  872MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
Processing Files (0 / 1)      :  19%|█▉        |  939MB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  93%|█████████▎|  939MB / 1.01GB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.07GB / 1.07GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  22%|██▏       | 1.08GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  22%|██▏       | 1.08GB / 5.00GB, 66.5MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.08GB / 1.14GB, 66.5MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.07GB / 1.07GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.14GB / 1.21GB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 72.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.07GB / 1.07GB, 72.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.07GB / 1.07GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.01GB / 1.07GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.07GB / 1.14GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.07GB / 1.14GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.07GB / 1.14GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.14GB / 1.14GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.14GB / 1.14GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.21GB / 1.21GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  20%|██        | 1.01GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  20%|██        | 1.01GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▎| 1.01GB / 1.07GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.14GB / 1.14GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.21GB / 1.27GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.14GB / 1.14GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.14GB / 1.21GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 71.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  99%|█████████▉| 1.06GB / 1.07GB, 71.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  21%|██▏       | 1.07GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.07GB / 1.14GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.14GB / 1.21GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.21GB / 1.27GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  24%|██▎       | 1.18GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▎       | 1.18GB / 5.00GB, 63.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 1.18GB / 1.21GB, 63.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.21GB / 1.27GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.21GB / 1.27GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.21GB / 1.27GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  25%|██▌       | 1.27GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  25%|██▌       | 1.27GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.27GB / 1.34GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 1.21GB / 1.21GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.21GB / 1.27GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0007-of-00027.safetensors:  25%|██▌       | 1.27GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  24%|██▍       | 1.21GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  95%|█████████▍| 1.21GB / 1.27GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0006-of-00027.safetensors:  23%|██▎       | 1.14GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  23%|██▎       | 1.14GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  94%|█████████▍| 1.14GB / 1.21GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.07GB / 3.08GB, 71.0MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  60%|██████    | 3.02GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 78.9MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.15GB / 3.15GB, 78.9MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.15GB / 3.15GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  62%|██████▏   | 3.08GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  62%|██████▏   | 3.08GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.08GB / 3.15GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  62%|██████▏   | 3.09GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.08GB / 3.08GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  62%|██████▏   | 3.09GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.08GB / 3.15GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  62%|██████▏   | 3.08GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  62%|██████▏   | 3.09GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.08GB / 3.15GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  62%|██████▏   | 3.08GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  62%|██████▏   | 3.09GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.08GB / 3.15GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.22GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  62%|██████▏   | 3.09GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.08GB / 3.15GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.22GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 70.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 70.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.22GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.22GB / 3.22GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 72.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.29GB / 3.29GB, 72.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  63%|██████▎   | 3.15GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.15GB / 3.22GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.29GB / 3.29GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.29GB / 3.29GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  64%|██████▍   | 3.22GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.22GB / 3.29GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 72.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 72.4MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.35GB / 3.35GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  64%|██████▍   | 3.22GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.29GB / 3.29GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 72.4MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.42GB / 3.42GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.42GB / 3.42GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  68%|██████▊   | 3.40GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.40GB / 5.00GB, 70.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.40GB / 3.42GB, 70.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.35GB / 3.42GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  66%|██████▌   | 3.29GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.29GB / 3.35GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  67%|██████▋   | 3.35GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.35GB / 3.35GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  70%|██████▉   | 3.48GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.48GB / 5.00GB, 64.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.48GB / 3.49GB, 64.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 68.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.42GB / 3.42GB, 68.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.49GB / 3.49GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  68%|██████▊   | 3.42GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.42GB / 3.49GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.55GB / 3.55GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.55GB / 3.55GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 72.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.55GB / 3.55GB, 72.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  69%|██████▉   | 3.47GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  69%|██████▉   | 3.47GB / 5.00GB, 63.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  99%|█████████▉| 3.47GB / 3.49GB, 63.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.56GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  70%|███████   | 3.51GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|███████   | 3.51GB / 5.00GB, 60.9MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  99%|█████████▊| 3.50GB / 3.55GB, 60.9MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.56GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.56GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.55GB / 3.55GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 59.1MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.62GB / 3.69GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.62GB / 3.62GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.56GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.62GB / 3.62GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.62GB / 3.69GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  70%|██████▉   | 3.49GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  70%|██████▉   | 3.49GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.49GB / 3.55GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.62GB / 3.69GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.62GB / 3.62GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.55GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.56GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.62GB / 3.69GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.62GB / 3.69GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.69GB / 3.69GB, 65.6MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.6MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.69GB / 3.69GB, 65.5MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.69GB / 3.69GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  71%|███████   | 3.56GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  71%|███████   | 3.56GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.55GB / 3.62GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  72%|███████▏  | 3.62GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.62GB / 3.62GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  75%|███████▌  | 3.76GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.76GB / 3.82GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  75%|███████▌  | 3.76GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               : 100%|█████████▉| 3.76GB / 3.76GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 59.3MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 59.3MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 59.2MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 59.2MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  74%|███████▍  | 3.69GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.69GB / 3.76GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  75%|███████▌  | 3.76GB / 5.00GB, 65.8MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.76GB / 3.82GB, 65.8MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A
Processing Files (0 / 1)      :  75%|███████▌  | 3.76GB / 5.00GB, 65.7MB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
New Data Upload               :  98%|█████████▊| 3.76GB / 3.82GB, 65.7MB/s  [A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▍  | 3.69GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  54%|█████▍    | 2.72GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (2 / 10)     :  28%|██▊       | 37.4GB /  132GB, 3.43GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors: 100%|██████████| 1.93GB / 1.93GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  96%|█████████▋| 4.81GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0014-of-00027.safetensors:  95%|█████████▌| 4.76GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  96%|█████████▌| 4.81GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  94%|█████████▍| 4.72GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  95%|█████████▌| 4.76GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  95%|█████████▌| 4.75GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors:  95%|█████████▌| 4.76GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  56%|█████▌    | 2.81GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (2 / 10)     :  29%|██▉       | 38.1GB /  132GB, 3.43GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors: 100%|██████████| 1.93GB / 1.93GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors:  98%|█████████▊| 4.90GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0014-of-00027.safetensors:  97%|█████████▋| 4.85GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors:  98%|█████████▊| 4.89GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  96%|█████████▌| 4.81GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  97%|█████████▋| 4.85GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  97%|█████████▋| 4.84GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors:  97%|█████████▋| 4.86GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  58%|█████▊    | 2.89GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (2 / 10)     :  29%|██▉       | 38.8GB /  132GB, 3.43GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors: 100%|██████████| 1.93GB / 1.93GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors: 100%|█████████▉| 4.99GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0014-of-00027.safetensors:  99%|█████████▊| 4.93GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors: 100%|█████████▉| 4.97GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors:  98%|█████████▊| 4.90GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors:  99%|█████████▊| 4.93GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors:  99%|█████████▊| 4.93GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors:  99%|█████████▉| 4.94GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  60%|█████▉    | 2.98GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (2 / 10)     :  30%|██▉       | 39.5GB /  132GB, 3.43GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...del_output/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0027-of-00027.safetensors: 100%|██████████| 1.93GB / 1.93GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0014-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors: 100%|█████████▉| 4.97GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  [+ 2 files]                 :  21%|██        | 3.18GB / 15.0GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (8 / 12)     :  30%|███       | 40.1GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0018-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0014-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0001-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0025-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0004-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:   3%|▎         |  143MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  [+ 5 files]                 :   2%|▏         |  528MB / 30.0GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  31%|███       | 40.8GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  65%|██████▍   | 3.23GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:   5%|▍         |  226MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:   4%|▍         |  218MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:   4%|▎         |  185MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:   4%|▎         |  176MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:   4%|▎         |  176MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:   3%|▎         |  159MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:   3%|▎         |  134MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  31%|███▏      | 41.4GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  66%|██████▋   | 3.31GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:   6%|▌         |  310MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:   6%|▌         |  310MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:   6%|▌         |  277MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:   5%|▌         |  260MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:   5%|▌         |  260MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:   5%|▍         |  243MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:   4%|▍         |  218MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  32%|███▏      | 42.1GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  68%|██████▊   | 3.40GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:   8%|▊         |  394MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:   8%|▊         |  394MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:   7%|▋         |  361MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:   7%|▋         |  344MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:   7%|▋         |  352MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:   7%|▋         |  336MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:   6%|▌         |  302MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  32%|███▏      | 42.8GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  70%|██████▉   | 3.48GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  10%|▉         |  478MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  10%|▉         |  478MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:   9%|▉         |  453MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:   9%|▊         |  428MB / 5.00GB            [A[A[A[A[A[A[A[A
Retrying (%r) after connection broken by '%r': %s
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:   9%|▊         |  436MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:   9%|▊         |  428MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:   8%|▊         |  394MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  33%|███▎      | 43.5GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  71%|███████▏  | 3.57GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  11%|█         |  562MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  11%|█         |  562MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  11%|█         |  537MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  10%|█         |  520MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  10%|█         |  520MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  10%|█         |  512MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:   9%|▉         |  470MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  33%|███▎      | 44.2GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  73%|███████▎  | 3.65GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  13%|█▎        |  654MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  13%|█▎        |  654MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  12%|█▏        |  621MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  12%|█▏        |  604MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  12%|█▏        |  612MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  12%|█▏        |  596MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  11%|█         |  562MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  34%|███▍      | 44.9GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  75%|███████▍  | 3.74GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  15%|█▍        |  730MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  15%|█▍        |  738MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  14%|█▍        |  713MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  14%|█▍        |  688MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  14%|█▍        |  696MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  14%|█▎        |  679MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  13%|█▎        |  646MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  35%|███▍      | 45.6GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  77%|███████▋  | 3.83GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  16%|█▋        |  822MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  16%|█▋        |  822MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  16%|█▌        |  797MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  15%|█▌        |  772MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  16%|█▌        |  780MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  15%|█▌        |  763MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  15%|█▍        |  730MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  35%|███▌      | 46.2GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  78%|███████▊  | 3.91GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  18%|█▊        |  897MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  18%|█▊        |  906MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  18%|█▊        |  881MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  17%|█▋        |  864MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  17%|█▋        |  864MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  17%|█▋        |  856MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  16%|█▋        |  814MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  36%|███▌      | 46.9GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  80%|████████  | 4.00GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  20%|█▉        |  990MB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  20%|█▉        |  998MB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  19%|█▉        |  965MB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  19%|█▉        |  948MB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  19%|█▉        |  939MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  18%|█▊        |  898MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  36%|███▌      | 47.6GB /  132GB, 3.41GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  82%|████████▏ | 4.09GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  22%|██▏       | 1.08GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  21%|██        | 1.05GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  21%|██        | 1.03GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  21%|██        | 1.03GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  21%|██        | 1.03GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  20%|█▉        |  981MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  37%|███▋      | 48.3GB /  132GB, 3.41GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  84%|████████▎ | 4.18GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  23%|██▎       | 1.15GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  23%|██▎       | 1.17GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  22%|██▏       | 1.12GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  22%|██▏       | 1.12GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  22%|██▏       | 1.12GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  22%|██▏       | 1.12GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  22%|██▏       | 1.08GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  37%|███▋      | 49.0GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  85%|████████▌ | 4.25GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  25%|██▍       | 1.24GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  25%|██▌       | 1.25GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  24%|██▍       | 1.22GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  24%|██▍       | 1.21GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  24%|██▍       | 1.20GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  24%|██▍       | 1.20GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  23%|██▎       | 1.17GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  38%|███▊      | 49.7GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  87%|████████▋ | 4.35GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  27%|██▋       | 1.33GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  27%|██▋       | 1.33GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  26%|██▌       | 1.30GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  26%|██▌       | 1.30GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  26%|██▌       | 1.29GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  26%|██▌       | 1.28GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  25%|██▍       | 1.25GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  38%|███▊      | 50.4GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  89%|████████▊ | 4.43GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  28%|██▊       | 1.41GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  29%|██▊       | 1.43GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  28%|██▊       | 1.38GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  28%|██▊       | 1.38GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  28%|██▊       | 1.38GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  27%|██▋       | 1.37GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  27%|██▋       | 1.33GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  39%|███▊      | 51.0GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  90%|█████████ | 4.51GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  30%|██▉       | 1.49GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  30%|███       | 1.51GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  29%|██▉       | 1.47GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  30%|██▉       | 1.48GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  29%|██▉       | 1.47GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  29%|██▉       | 1.46GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  28%|██▊       | 1.41GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  39%|███▉      | 51.7GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  92%|█████████▏| 4.61GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  32%|███▏      | 1.58GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  32%|███▏      | 1.59GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  31%|███       | 1.55GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  31%|███       | 1.56GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  31%|███       | 1.55GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  31%|███       | 1.54GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  30%|██▉       | 1.49GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  40%|███▉      | 52.4GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  94%|█████████▍| 4.69GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  33%|███▎      | 1.66GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  34%|███▎      | 1.68GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  33%|███▎      | 1.64GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  33%|███▎      | 1.64GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  33%|███▎      | 1.64GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  33%|███▎      | 1.64GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  32%|███▏      | 1.58GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  40%|████      | 53.1GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  96%|█████████▌| 4.78GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  35%|███▍      | 1.74GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  35%|███▌      | 1.76GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  35%|███▍      | 1.73GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  35%|███▍      | 1.73GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  35%|███▍      | 1.73GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  34%|███▍      | 1.71GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  33%|███▎      | 1.66GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  41%|████      | 53.8GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  97%|█████████▋| 4.86GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  37%|███▋      | 1.83GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  37%|███▋      | 1.85GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  36%|███▋      | 1.82GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  36%|███▌      | 1.80GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  36%|███▋      | 1.81GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  36%|███▌      | 1.80GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  35%|███▍      | 1.74GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  41%|████▏     | 54.4GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors:  99%|█████████▉| 4.94GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  38%|███▊      | 1.91GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  39%|███▉      | 1.94GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  38%|███▊      | 1.90GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  38%|███▊      | 1.90GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  38%|███▊      | 1.90GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  38%|███▊      | 1.90GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  37%|███▋      | 1.83GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (9 / 17)     :  42%|████▏     | 55.1GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0019-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  40%|███▉      | 2.00GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  40%|████      | 2.02GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  40%|███▉      | 1.99GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  40%|███▉      | 1.98GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  40%|███▉      | 1.98GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  39%|███▉      | 1.97GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  [+ 1 files]                 :  19%|█▉        | 1.94GB / 10.0GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  42%|████▏     | 55.8GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  42%|████▏     | 2.08GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  42%|████▏     | 2.11GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  41%|████▏     | 2.07GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  41%|████▏     | 2.06GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  41%|████      | 2.06GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  41%|████▏     | 2.06GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  40%|████      | 2.00GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:   2%|▏         |  109MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  43%|████▎     | 56.5GB /  132GB, 3.41GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  43%|████▎     | 2.16GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  44%|████▍     | 2.21GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  43%|████▎     | 2.16GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  43%|████▎     | 2.15GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  43%|████▎     | 2.15GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  43%|████▎     | 2.15GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  42%|████▏     | 2.10GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:   4%|▍         |  193MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  43%|████▎     | 57.2GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  45%|████▍     | 2.25GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  46%|████▌     | 2.30GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  45%|████▍     | 2.24GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  45%|████▍     | 2.23GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  45%|████▍     | 2.23GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  45%|████▍     | 2.23GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  44%|████▎     | 2.18GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:   6%|▌         |  285MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  44%|████▍     | 57.9GB /  132GB, 3.41GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  47%|████▋     | 2.33GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  48%|████▊     | 2.39GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  47%|████▋     | 2.33GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  46%|████▋     | 2.32GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  46%|████▋     | 2.32GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  46%|████▋     | 2.32GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  45%|████▌     | 2.26GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:   8%|▊         |  377MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  44%|████▍     | 58.6GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  48%|████▊     | 2.42GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  50%|████▉     | 2.47GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  48%|████▊     | 2.42GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  48%|████▊     | 2.41GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  48%|████▊     | 2.40GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  48%|████▊     | 2.40GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  47%|████▋     | 2.35GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:   9%|▉         |  461MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  45%|████▍     | 59.3GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  50%|█████     | 2.51GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  51%|█████     | 2.56GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  50%|████▉     | 2.50GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  50%|████▉     | 2.49GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  50%|████▉     | 2.49GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  50%|████▉     | 2.49GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  49%|████▊     | 2.43GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  11%|█         |  554MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  45%|████▌     | 60.0GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  52%|█████▏    | 2.59GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  53%|█████▎    | 2.64GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  52%|█████▏    | 2.58GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  52%|█████▏    | 2.58GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  51%|█████▏    | 2.57GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  52%|█████▏    | 2.58GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  50%|█████     | 2.52GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  13%|█▎        |  629MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  46%|████▌     | 60.6GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  54%|█████▎    | 2.68GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  55%|█████▍    | 2.73GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  53%|█████▎    | 2.67GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  53%|█████▎    | 2.67GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  53%|█████▎    | 2.66GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  53%|█████▎    | 2.66GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  52%|█████▏    | 2.59GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  14%|█▍        |  721MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  46%|████▋     | 61.3GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  55%|█████▌    | 2.77GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  56%|█████▋    | 2.82GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  55%|█████▌    | 2.75GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  55%|█████▌    | 2.76GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  55%|█████▌    | 2.75GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  55%|█████▌    | 2.75GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  54%|█████▎    | 2.68GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  16%|█▌        |  805MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  47%|████▋     | 62.0GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  57%|█████▋    | 2.85GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  58%|█████▊    | 2.90GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  57%|█████▋    | 2.84GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  57%|█████▋    | 2.84GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  57%|█████▋    | 2.84GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  57%|█████▋    | 2.84GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  55%|█████▌    | 2.76GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  18%|█▊        |  889MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  48%|████▊     | 62.7GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  59%|█████▊    | 2.94GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  60%|█████▉    | 2.99GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  59%|█████▉    | 2.94GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  59%|█████▊    | 2.94GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  58%|█████▊    | 2.92GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  58%|█████▊    | 2.92GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  57%|█████▋    | 2.84GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  20%|█▉        |  981MB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  48%|████▊     | 63.4GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  60%|██████    | 3.02GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  61%|██████▏   | 3.07GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  61%|██████    | 3.03GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  60%|██████    | 3.02GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  60%|██████    | 3.01GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  60%|██████    | 3.00GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  59%|█████▊    | 2.94GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  21%|██▏       | 1.07GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  49%|████▊     | 64.1GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  62%|██████▏   | 3.11GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  63%|██████▎   | 3.15GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  62%|██████▏   | 3.11GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  62%|██████▏   | 3.10GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  62%|██████▏   | 3.09GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  60%|██████    | 3.02GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  23%|██▎       | 1.16GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  49%|████▉     | 64.8GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  64%|██████▍   | 3.20GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  65%|██████▍   | 3.24GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  64%|██████▍   | 3.20GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  64%|██████▍   | 3.19GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  63%|██████▎   | 3.17GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  63%|██████▎   | 3.17GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  62%|██████▏   | 3.10GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  25%|██▍       | 1.25GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  50%|████▉     | 65.5GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  66%|██████▌   | 3.28GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  66%|██████▋   | 3.32GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  66%|██████▌   | 3.29GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  65%|██████▌   | 3.25GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  65%|██████▌   | 3.25GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  64%|██████▍   | 3.20GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  27%|██▋       | 1.33GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  50%|█████     | 66.1GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  67%|██████▋   | 3.36GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  68%|██████▊   | 3.41GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  67%|██████▋   | 3.37GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  67%|██████▋   | 3.37GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  67%|██████▋   | 3.34GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  67%|██████▋   | 3.35GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  66%|██████▌   | 3.28GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  28%|██▊       | 1.41GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  51%|█████     | 66.8GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  69%|██████▉   | 3.46GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  70%|███████   | 3.51GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  69%|██████▉   | 3.46GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  69%|██████▉   | 3.46GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  68%|██████▊   | 3.42GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  69%|██████▊   | 3.43GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  67%|██████▋   | 3.36GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  30%|███       | 1.50GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  51%|█████     | 67.5GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  71%|███████   | 3.54GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  72%|███████▏  | 3.59GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  71%|███████   | 3.55GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  70%|███████   | 3.51GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  70%|███████   | 3.51GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  69%|██████▉   | 3.45GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  32%|███▏      | 1.58GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  52%|█████▏    | 68.2GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  73%|███████▎  | 3.63GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  74%|███████▎  | 3.67GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  73%|███████▎  | 3.63GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  73%|███████▎  | 3.63GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  72%|███████▏  | 3.59GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  72%|███████▏  | 3.60GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  71%|███████   | 3.53GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  33%|███▎      | 1.66GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  52%|█████▏    | 68.9GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  74%|███████▍  | 3.72GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  75%|███████▌  | 3.76GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  74%|███████▍  | 3.72GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  74%|███████▍  | 3.72GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  74%|███████▎  | 3.67GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  74%|███████▎  | 3.68GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  72%|███████▏  | 3.62GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  35%|███▍      | 1.74GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  53%|█████▎    | 69.6GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  76%|███████▌  | 3.80GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  77%|███████▋  | 3.84GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  76%|███████▌  | 3.81GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  76%|███████▌  | 3.81GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  75%|███████▌  | 3.77GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  75%|███████▌  | 3.77GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  74%|███████▍  | 3.72GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  37%|███▋      | 1.84GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  53%|█████▎    | 70.3GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  78%|███████▊  | 3.88GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  79%|███████▊  | 3.93GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  78%|███████▊  | 3.89GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  78%|███████▊  | 3.89GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  77%|███████▋  | 3.86GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  77%|███████▋  | 3.86GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  76%|███████▌  | 3.81GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0013-of-00027.safetensors:  38%|███▊      | 1.91GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A[A
Processing Files (10 / 18)    :  54%|█████▍    | 71.0GB /  132GB, 3.42GB/s  
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0010-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0024-of-00027.safetensors: 100%|██████████| 5.00GB / 5.00GB            [A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0026-of-00027.safetensors:  80%|███████▉  | 3.98GB / 5.00GB            [A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0016-of-00027.safetensors:  80%|████████  | 4.02GB / 5.00GB            [A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0015-of-00027.safetensors:  80%|███████▉  | 3.98GB / 5.00GB            [A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0009-of-00027.safetensors:  80%|███████▉  | 3.98GB / 5.00GB            [A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0020-of-00027.safetensors:  79%|███████▉  | 3.94GB / 5.00GB            [A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0005-of-00027.safetensors:  79%|███████▉  | 3.94GB / 5.00GB            [A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: 
  ...0021-of-00027.safetensors:  78%|███████▊  | 3.89GB / 5.00GB            [A[A[A[A[A[A[A[A[A[A
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00027-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00008-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00009-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00019-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00014-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00017-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00005-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00018-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00015-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00024-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00022-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00026-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00021-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00011-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00004-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00020-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00020-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00002-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00016-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00001-of-00027.safetensors
chaiml-muster-v0e-lr1e5-71769-v1-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v0e-lr1e5-71769-v1/model-00003-of-00027.safetensors
Job chaiml-muster-v0e-lr1e5-71769-v1-uploader completed after 5182.15s with status: succeeded
Stopping job with name chaiml-muster-v0e-lr1e5-71769-v1-uploader
Pipeline stage VLLMUploader completed in 5183.30s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.46s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v0e-lr1e5-71769-v1
Waiting for inference service chaiml-muster-v0e-lr1e5-71769-v1 to be ready
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-muster-v0e-lr1e5-71769-v1 ready after 680.5217907428741s
Pipeline stage VLLMDeployer completed in 681.79s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3673129081726074s
Received healthy response to inference request in 2.2231051921844482s
Received healthy response to inference request in 2.300488233566284s
Received healthy response to inference request in 2.3660571575164795s
Received healthy response to inference request in 2.0907156467437744s
Received healthy response to inference request in 2.213825225830078s
Received healthy response to inference request in 2.1499955654144287s
Received healthy response to inference request in 2.5255990028381348s
Received healthy response to inference request in 2.281825065612793s
Received healthy response to inference request in 2.332942008972168s
Received healthy response to inference request in 2.2456018924713135s
Received healthy response to inference request in 2.3450329303741455s
Received healthy response to inference request in 2.813804864883423s
Received healthy response to inference request in 2.770437002182007s
Received healthy response to inference request in 2.1054763793945312s
Received healthy response to inference request in 2.115480422973633s
Received healthy response to inference request in 2.425788640975952s
Received healthy response to inference request in 2.272496223449707s
Received healthy response to inference request in 2.33903169631958s
Received healthy response to inference request in 2.361818313598633s
Received healthy response to inference request in 2.1987075805664062s
Received healthy response to inference request in 2.2743029594421387s
Received healthy response to inference request in 2.153576612472534s
Received healthy response to inference request in 2.139907121658325s
Received healthy response to inference request in 2.018388271331787s
Received healthy response to inference request in 2.258918046951294s
Received healthy response to inference request in 2.287553071975708s
Received healthy response to inference request in 2.4491798877716064s
Received healthy response to inference request in 2.393563747406006s
Received healthy response to inference request in 2.956075668334961s
30 requests
0 failed requests
5th percentile: 2.097357976436615
10th percentile: 2.1144800186157227
20th percentile: 2.152860403060913
30th percentile: 2.220321202278137
40th percentile: 2.2670649528503417
50th percentile: 2.2846890687942505
60th percentile: 2.335377883911133
70th percentile: 2.3630899667739866
80th percentile: 2.4000087261199954
90th percentile: 2.5500828027725224
95th percentile: 2.7942893266677857
99th percentile: 2.914817135334015
mean time: 2.3259002447128294
Pipeline stage StressChecker completed in 83.07s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.89s
Shutdown handler de-registered
chaiml-muster-v0e-lr1e5_71769_v1 status is now deployed due to DeploymentManager action
chaiml-muster-v0e-lr1e5_71769_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-muster-v0e-lr1e5_71769_v1 status is now torndown due to DeploymentManager action