submission_id: brucethemoose-yi-34b-200_6263_v1
developer_uid: brucethemoose
status: torndown
model_repo: brucethemoose/Yi-34B-200K-RPMerge
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 1.0, 'top_p': 0.5, 'min_p': 0.0, 'top_k': 30, 'presence_penalty': 0.02, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2024-03-21T20:07:51+00:00
model_name: brucethemoose-yi-34b-200_6263_v1
model_eval_status: success
model_group: brucethemoose/Yi-34B-200
num_battles: 67547
num_wins: 33822
celo_rating: 1157.65
propriety_score: 0.0
propriety_total_count: 0.0
submission_type: basic
model_architecture: None
model_num_parameters: 34388945920.0
best_of: 4
max_input_tokens: 512
max_output_tokens: 64
display_name: brucethemoose-yi-34b-200_6263_v1
ineligible_reason: propriety_total_count < 800
language_model: brucethemoose/Yi-34B-200K-RPMerge
model_size: 34B
reward_model: ChaiML/reward_gpt2_medium_preference_24m_e2
us_pacific_date: 2024-03-21
win_ratio: 0.5007180185648511
preference_data_url: None
Resubmit model
Running pipeline stage MKMLizer
Starting job with name brucethemoose-yi-34b-200-6263-v1-mkmlizer
Waiting for job on brucethemoose-yi-34b-200-6263-v1-mkmlizer to finish
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║     _____            __           __                                ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║       /___/                                                         ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║                                                                     ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  Version: 0.6.11                                                    ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║                                                                     ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  belonging to:                                                      ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║                                                                     ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  Chai Research Corp.                                                ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║  Expiration: 2024-04-15 23:59:59                                    ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║                                                                     ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
.gitattributes:   0%|          | 0.00/1.52k [00:00<?, ?B/s]
.gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 19.4MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
README.md:   0%|          | 0.00/8.37k [00:00<?, ?B/s]
README.md: 100%|██████████| 8.37k/8.37k [00:00<00:00, 73.4MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
config.json:   0%|          | 0.00/737 [00:00<?, ?B/s]
config.json: 100%|██████████| 737/737 [00:00<00:00, 12.2MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
mergekit_config.yml:   0%|          | 0.00/1.04k [00:00<?, ?B/s]
mergekit_config.yml: 100%|██████████| 1.04k/1.04k [00:00<00:00, 8.34MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model-00001-of-00007.safetensors:   0%|          | 0.00/9.92G [00:00<?, ?B/s]
model-00001-of-00007.safetensors:   0%|          | 10.5M/9.92G [00:01<23:36, 6.99MB/s]
model-00001-of-00007.safetensors:   0%|          | 21.0M/9.92G [00:02<16:06, 10.2MB/s]
model-00001-of-00007.safetensors:   0%|          | 31.5M/9.92G [00:02<10:55, 15.1MB/s]
model-00001-of-00007.safetensors:   0%|          | 41.9M/9.92G [00:02<08:13, 20.0MB/s]
model-00001-of-00007.safetensors:   1%|          | 73.4M/9.92G [00:02<03:35, 45.6MB/s]
model-00001-of-00007.safetensors:   1%|          | 105M/9.92G [00:03<02:10, 74.9MB/s] 
model-00001-of-00007.safetensors:   1%|▏         | 136M/9.92G [00:03<01:34, 103MB/s] 
model-00001-of-00007.safetensors:   3%|▎         | 273M/9.92G [00:03<00:31, 302MB/s]
model-00001-of-00007.safetensors:   4%|▍         | 419M/9.92G [00:03<00:20, 471MB/s]
model-00001-of-00007.safetensors:   5%|▌         | 545M/9.92G [00:03<00:15, 623MB/s]
model-00001-of-00007.safetensors:  11%|█         | 1.10G/9.92G [00:03<00:05, 1.53GB/s]
model-00001-of-00007.safetensors:  13%|█▎        | 1.28G/9.92G [00:04<00:13, 625MB/s] 
model-00001-of-00007.safetensors:  14%|█▍        | 1.42G/9.92G [00:04<00:12, 676MB/s]
model-00001-of-00007.safetensors:  16%|█▌        | 1.60G/9.92G [00:04<00:09, 832MB/s]
model-00001-of-00007.safetensors:  18%|█▊        | 1.76G/9.92G [00:04<00:08, 913MB/s]
model-00001-of-00007.safetensors:  19%|█▉        | 1.90G/9.92G [00:04<00:08, 938MB/s]
model-00001-of-00007.safetensors:  20%|██        | 2.02G/9.92G [00:05<00:07, 988MB/s]
model-00001-of-00007.safetensors:  22%|██▏       | 2.15G/9.92G [00:05<00:07, 1.01GB/s]
model-00001-of-00007.safetensors:  24%|██▎       | 2.35G/9.92G [00:05<00:08, 931MB/s] 
model-00001-of-00007.safetensors:  25%|██▍       | 2.46G/9.92G [00:05<00:11, 665MB/s]
model-00001-of-00007.safetensors:  26%|██▌       | 2.56G/9.92G [00:05<00:10, 671MB/s]
model-00001-of-00007.safetensors:  28%|██▊       | 2.74G/9.92G [00:06<00:08, 861MB/s]
model-00001-of-00007.safetensors:  30%|██▉       | 2.93G/9.92G [00:06<00:06, 1.06GB/s]
model-00001-of-00007.safetensors:  32%|███▏      | 3.14G/9.92G [00:06<00:05, 1.28GB/s]
model-00001-of-00007.safetensors:  34%|███▍      | 3.36G/9.92G [00:06<00:04, 1.46GB/s]
model-00001-of-00007.safetensors:  36%|███▌      | 3.52G/9.92G [00:07<00:10, 614MB/s] 
model-00001-of-00007.safetensors:  37%|███▋      | 3.65G/9.92G [00:07<00:10, 590MB/s]
model-00001-of-00007.safetensors:  38%|███▊      | 3.75G/9.92G [00:07<00:09, 630MB/s]
model-00001-of-00007.safetensors:  40%|████      | 3.97G/9.92G [00:07<00:06, 870MB/s]
model-00001-of-00007.safetensors:  42%|████▏     | 4.13G/9.92G [00:07<00:05, 984MB/s]
model-00001-of-00007.safetensors:  45%|████▍     | 4.44G/9.92G [00:07<00:04, 1.35GB/s]
model-00001-of-00007.safetensors:  47%|████▋     | 4.61G/9.92G [00:08<00:07, 713MB/s] 
model-00001-of-00007.safetensors:  48%|████▊     | 4.75G/9.92G [00:08<00:07, 690MB/s]
model-00001-of-00007.safetensors:  49%|████▉     | 4.87G/9.92G [00:08<00:08, 623MB/s]
model-00001-of-00007.safetensors:  50%|█████     | 5.00G/9.92G [00:08<00:06, 727MB/s]
model-00001-of-00007.safetensors:  52%|█████▏    | 5.18G/9.92G [00:08<00:05, 901MB/s]
model-00001-of-00007.safetensors:  55%|█████▍    | 5.41G/9.92G [00:09<00:03, 1.17GB/s]
model-00001-of-00007.safetensors:  56%|█████▌    | 5.57G/9.92G [00:09<00:04, 902MB/s] 
model-00001-of-00007.safetensors:  57%|█████▋    | 5.69G/9.92G [00:09<00:06, 696MB/s]
model-00001-of-00007.safetensors:  58%|█████▊    | 5.80G/9.92G [00:09<00:05, 690MB/s]
model-00001-of-00007.safetensors:  59%|█████▉    | 5.89G/9.92G [00:10<00:06, 616MB/s]
model-00001-of-00007.safetensors:  60%|██████    | 5.98G/9.92G [00:10<00:06, 635MB/s]
model-00001-of-00007.safetensors:  61%|██████▏   | 6.09G/9.92G [00:10<00:05, 733MB/s]
model-00001-of-00007.safetensors:  63%|██████▎   | 6.24G/9.92G [00:10<00:04, 877MB/s]
model-00001-of-00007.safetensors:  64%|██████▍   | 6.38G/9.92G [00:10<00:03, 971MB/s]
model-00001-of-00007.safetensors:  66%|██████▌   | 6.52G/9.92G [00:10<00:03, 1.05GB/s]
model-00001-of-00007.safetensors:  67%|██████▋   | 6.64G/9.92G [00:10<00:03, 970MB/s] 
model-00001-of-00007.safetensors:  68%|██████▊   | 6.74G/9.92G [00:10<00:04, 752MB/s]
model-00001-of-00007.safetensors:  69%|██████▉   | 6.84G/9.92G [00:11<00:03, 784MB/s]
model-00001-of-00007.safetensors:  70%|██████▉   | 6.93G/9.92G [00:11<00:05, 563MB/s]
model-00001-of-00007.safetensors:  71%|███████   | 7.03G/9.92G [00:11<00:04, 631MB/s]
model-00001-of-00007.safetensors:  72%|███████▏  | 7.11G/9.92G [00:11<00:04, 570MB/s]
model-00001-of-00007.safetensors:  73%|███████▎  | 7.26G/9.92G [00:11<00:03, 746MB/s]
model-00001-of-00007.safetensors:  75%|███████▌  | 7.44G/9.92G [00:11<00:02, 984MB/s]
model-00001-of-00007.safetensors:  77%|███████▋  | 7.61G/9.92G [00:11<00:02, 1.12GB/s]
model-00001-of-00007.safetensors:  78%|███████▊  | 7.75G/9.92G [00:12<00:02, 981MB/s] 
model-00001-of-00007.safetensors:  79%|███████▉  | 7.86G/9.92G [00:12<00:02, 944MB/s]
model-00001-of-00007.safetensors:  80%|████████  | 7.97G/9.92G [00:12<00:02, 702MB/s]
model-00001-of-00007.safetensors:  81%|████████▏ | 8.06G/9.92G [00:12<00:02, 708MB/s]
model-00001-of-00007.safetensors:  82%|████████▏ | 8.15G/9.92G [00:12<00:02, 636MB/s]
model-00001-of-00007.safetensors:  83%|████████▎ | 8.22G/9.92G [00:13<00:02, 602MB/s]
model-00001-of-00007.safetensors:  84%|████████▍ | 8.38G/9.92G [00:13<00:01, 776MB/s]
model-00001-of-00007.safetensors:  86%|████████▌ | 8.52G/9.92G [00:13<00:01, 927MB/s]
model-00001-of-00007.safetensors:  88%|████████▊ | 8.69G/9.92G [00:13<00:01, 1.07GB/s]
model-00001-of-00007.safetensors:  89%|████████▉ | 8.81G/9.92G [00:13<00:01, 1.01GB/s]
model-00001-of-00007.safetensors:  90%|█████████ | 8.93G/9.92G [00:13<00:00, 1.05GB/s]
model-00001-of-00007.safetensors:  91%|█████████▏| 9.05G/9.92G [00:13<00:01, 668MB/s] 
model-00001-of-00007.safetensors:  92%|█████████▏| 9.14G/9.92G [00:14<00:01, 715MB/s]
model-00001-of-00007.safetensors:  93%|█████████▎| 9.24G/9.92G [00:14<00:00, 733MB/s]
model-00001-of-00007.safetensors:  94%|█████████▍| 9.34G/9.92G [00:14<00:00, 803MB/s]
model-00001-of-00007.safetensors:  96%|█████████▌| 9.48G/9.92G [00:14<00:00, 916MB/s]
model-00001-of-00007.safetensors:  97%|█████████▋| 9.64G/9.92G [00:14<00:00, 1.10GB/s]
model-00001-of-00007.safetensors: 100%|█████████▉| 9.91G/9.92G [00:14<00:00, 1.39GB/s]
model-00001-of-00007.safetensors: 100%|█████████▉| 9.92G/9.92G [00:14<00:00, 678MB/s] 
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model-00002-of-00007.safetensors:   0%|          | 0.00/9.91G [00:00<?, ?B/s]
model-00002-of-00007.safetensors:   0%|          | 10.5M/9.91G [00:02<37:03, 4.45MB/s]
model-00002-of-00007.safetensors:   0%|          | 31.5M/9.91G [00:02<10:22, 15.9MB/s]
model-00002-of-00007.safetensors:   1%|          | 62.9M/9.91G [00:02<04:19, 38.0MB/s]
model-00002-of-00007.safetensors:   1%|          | 83.9M/9.91G [00:02<03:00, 54.4MB/s]
model-00002-of-00007.safetensors:   1%|          | 105M/9.91G [00:02<02:28, 65.9MB/s] 
model-00002-of-00007.safetensors:   2%|▏         | 157M/9.91G [00:02<01:17, 125MB/s] 
model-00002-of-00007.safetensors:   3%|▎         | 315M/9.91G [00:03<00:27, 354MB/s]
model-00002-of-00007.safetensors:   4%|▍         | 388M/9.91G [00:03<00:22, 418MB/s]
model-00002-of-00007.safetensors:   6%|▋         | 640M/9.91G [00:03<00:10, 851MB/s]
model-00002-of-00007.safetensors:  11%|█▏        | 1.13G/9.91G [00:03<00:08, 996MB/s]
model-00002-of-00007.safetensors:  13%|█▎        | 1.26G/9.91G [00:04<00:14, 613MB/s]
model-00002-of-00007.safetensors:  14%|█▎        | 1.35G/9.91G [00:04<00:13, 645MB/s]
model-00002-of-00007.safetensors:  15%|█▌        | 1.52G/9.91G [00:04<00:11, 708MB/s]
model-00002-of-00007.safetensors:  16%|█▋        | 1.61G/9.91G [00:04<00:11, 697MB/s]
model-00002-of-00007.safetensors:  17%|█▋        | 1.70G/9.91G [00:04<00:11, 686MB/s]
model-00002-of-00007.safetensors:  18%|█▊        | 1.79G/9.91G [00:04<00:11, 733MB/s]
model-00002-of-00007.safetensors:  19%|█▉        | 1.93G/9.91G [00:05<00:09, 822MB/s]
model-00002-of-00007.safetensors:  21%|██        | 2.04G/9.91G [00:05<00:08, 892MB/s]
model-00002-of-00007.safetensors:  22%|██▏       | 2.16G/9.91G [00:05<00:08, 955MB/s]
model-00002-of-00007.safetensors:  26%|██▌       | 2.56G/9.91G [00:05<00:04, 1.73GB/s]
model-00002-of-00007.safetensors:  28%|██▊       | 2.81G/9.91G [00:05<00:03, 1.83GB/s]
model-00002-of-00007.safetensors:  30%|███       | 3.01G/9.91G [00:06<00:09, 756MB/s] 
model-00002-of-00007.safetensors:  32%|███▏      | 3.16G/9.91G [00:06<00:11, 584MB/s]
model-00002-of-00007.safetensors:  33%|███▎      | 3.29G/9.91G [00:06<00:09, 669MB/s]
model-00002-of-00007.safetensors:  35%|███▍      | 3.44G/9.91G [00:06<00:08, 773MB/s]
model-00002-of-00007.safetensors:  37%|███▋      | 3.62G/9.91G [00:06<00:06, 938MB/s]
model-00002-of-00007.safetensors:  40%|███▉      | 3.94G/9.91G [00:07<00:04, 1.36GB/s]
model-00002-of-00007.safetensors:  42%|████▏     | 4.13G/9.91G [00:07<00:07, 801MB/s] 
model-00002-of-00007.safetensors:  43%|████▎     | 4.28G/9.91G [00:07<00:09, 607MB/s]
model-00002-of-00007.safetensors:  44%|████▍     | 4.39G/9.91G [00:08<00:09, 597MB/s]
model-00002-of-00007.safetensors:  46%|████▌     | 4.51G/9.91G [00:08<00:08, 646MB/s]
model-00002-of-00007.safetensors:  47%|████▋     | 4.63G/9.91G [00:08<00:07, 737MB/s]
model-00002-of-00007.safetensors:  49%|████▉     | 4.88G/9.91G [00:08<00:04, 1.01GB/s]
model-00002-of-00007.safetensors:  52%|█████▏    | 5.13G/9.91G [00:08<00:03, 1.22GB/s]
model-00002-of-00007.safetensors:  53%|█████▎    | 5.28G/9.91G [00:09<00:06, 689MB/s] 
model-00002-of-00007.safetensors:  54%|█████▍    | 5.40G/9.91G [00:09<00:07, 624MB/s]
model-00002-of-00007.safetensors:  56%|█████▌    | 5.51G/9.91G [00:09<00:06, 649MB/s]
model-00002-of-00007.safetensors:  57%|█████▋    | 5.60G/9.91G [00:09<00:06, 637MB/s]
model-00002-of-00007.safetensors:  58%|█████▊    | 5.79G/9.91G [00:09<00:04, 851MB/s]
model-00002-of-00007.safetensors:  60%|█████▉    | 5.90G/9.91G [00:09<00:04, 887MB/s]
model-00002-of-00007.safetensors:  63%|██████▎   | 6.22G/9.91G [00:10<00:02, 1.32GB/s]
model-00002-of-00007.safetensors:  64%|██████▍   | 6.38G/9.91G [00:10<00:03, 938MB/s] 
model-00002-of-00007.safetensors:  66%|██████▌   | 6.50G/9.91G [00:10<00:04, 740MB/s]
model-00002-of-00007.safetensors:  67%|██████▋   | 6.61G/9.91G [00:10<00:05, 656MB/s]
model-00002-of-00007.safetensors:  68%|██████▊   | 6.70G/9.91G [00:11<00:05, 578MB/s]
model-00002-of-00007.safetensors:  69%|██████▉   | 6.84G/9.91G [00:11<00:04, 701MB/s]
model-00002-of-00007.safetensors:  70%|██████▉   | 6.93G/9.91G [00:11<00:04, 743MB/s]
model-00002-of-00007.safetensors:  72%|███████▏  | 7.11G/9.91G [00:11<00:03, 926MB/s]
model-00002-of-00007.safetensors:  73%|███████▎  | 7.28G/9.91G [00:11<00:02, 1.05GB/s]
model-00002-of-00007.safetensors:  75%|███████▍  | 7.40G/9.91G [00:11<00:02, 1.09GB/s]
model-00002-of-00007.safetensors:  76%|███████▌  | 7.53G/9.91G [00:12<00:03, 699MB/s] 
model-00002-of-00007.safetensors:  77%|███████▋  | 7.63G/9.91G [00:12<00:03, 662MB/s]
model-00002-of-00007.safetensors:  78%|███████▊  | 7.72G/9.91G [00:12<00:03, 553MB/s]
model-00002-of-00007.safetensors:  79%|███████▊  | 7.80G/9.91G [00:12<00:03, 598MB/s]
model-00002-of-00007.safetensors:  80%|███████▉  | 7.91G/9.91G [00:12<00:02, 677MB/s]
model-00002-of-00007.safetensors:  81%|████████  | 7.99G/9.91G [00:12<00:02, 652MB/s]
model-00002-of-00007.safetensors:  83%|████████▎ | 8.19G/9.91G [00:12<00:01, 940MB/s]
model-00002-of-00007.safetensors:  84%|████████▍ | 8.34G/9.91G [00:12<00:01, 1.05GB/s]
model-00002-of-00007.safetensors:  85%|████████▌ | 8.46G/9.91G [00:13<00:01, 1.06GB/s]
model-00002-of-00007.safetensors:  87%|████████▋ | 8.59G/9.91G [00:13<00:01, 786MB/s] 
model-00002-of-00007.safetensors:  88%|████████▊ | 8.69G/9.91G [00:13<00:01, 771MB/s]
model-00002-of-00007.safetensors:  89%|████████▊ | 8.79G/9.91G [00:13<00:01, 604MB/s]
model-00002-of-00007.safetensors:  89%|████████▉ | 8.86G/9.91G [00:13<00:01, 580MB/s]
model-00002-of-00007.safetensors:  91%|█████████ | 8.98G/9.91G [00:14<00:01, 675MB/s]
model-00002-of-00007.safetensors:  91%|█████████▏| 9.06G/9.91G [00:14<00:01, 683MB/s]
model-00002-of-00007.safetensors:  94%|█████████▎| 9.28G/9.91G [00:14<00:00, 1.03GB/s]
model-00002-of-00007.safetensors:  96%|█████████▌| 9.47G/9.91G [00:14<00:00, 1.21GB/s]
model-00002-of-00007.safetensors:  97%|█████████▋| 9.64G/9.91G [00:14<00:00, 1.32GB/s]
model-00002-of-00007.safetensors:  99%|█████████▉| 9.86G/9.91G [00:14<00:00, 1.44GB/s]
model-00002-of-00007.safetensors: 100%|█████████▉| 9.91G/9.91G [00:15<00:00, 655MB/s] 
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model-00003-of-00007.safetensors:   0%|          | 0.00/9.98G [00:00<?, ?B/s]
model-00003-of-00007.safetensors:   0%|          | 10.5M/9.98G [00:01<30:39, 5.42MB/s]
model-00003-of-00007.safetensors:   0%|          | 31.5M/9.98G [00:02<11:07, 14.9MB/s]
model-00003-of-00007.safetensors:   0%|          | 41.9M/9.98G [00:02<08:28, 19.5MB/s]
model-00003-of-00007.safetensors:   1%|          | 52.4M/9.98G [00:02<06:15, 26.5MB/s]
model-00003-of-00007.safetensors:   1%|          | 105M/9.98G [00:02<02:04, 79.3MB/s] 
model-00003-of-00007.safetensors:   3%|▎         | 252M/9.98G [00:03<00:37, 261MB/s] 
model-00003-of-00007.safetensors:   4%|▎         | 357M/9.98G [00:03<00:27, 356MB/s]
model-00003-of-00007.safetensors:   4%|▍         | 440M/9.98G [00:03<00:22, 434MB/s]
model-00003-of-00007.safetensors:  10%|▉         | 986M/9.98G [00:03<00:06, 1.41GB/s]
model-00003-of-00007.safetensors:  12%|█▏        | 1.21G/9.98G [00:04<00:14, 593MB/s]
model-00003-of-00007.safetensors:  14%|█▍        | 1.37G/9.98G [00:04<00:16, 522MB/s]
model-00003-of-00007.safetensors:  15%|█▌        | 1.50G/9.98G [00:04<00:15, 541MB/s]
model-00003-of-00007.safetensors:  17%|█▋        | 1.67G/9.98G [00:04<00:12, 670MB/s]
model-00003-of-00007.safetensors:  18%|█▊        | 1.81G/9.98G [00:05<00:10, 776MB/s]
model-00003-of-00007.safetensors:  20%|█▉        | 1.98G/9.98G [00:05<00:08, 925MB/s]
model-00003-of-00007.safetensors:  22%|██▏       | 2.20G/9.98G [00:05<00:07, 1.07GB/s]
model-00003-of-00007.safetensors:  24%|██▎       | 2.35G/9.98G [00:05<00:09, 824MB/s] 
model-00003-of-00007.safetensors:  25%|██▍       | 2.46G/9.98G [00:06<00:14, 517MB/s]
model-00003-of-00007.safetensors:  26%|██▌       | 2.56G/9.98G [00:06<00:15, 469MB/s]
model-00003-of-00007.safetensors:  26%|██▋       | 2.64G/9.98G [00:06<00:14, 504MB/s]
model-00003-of-00007.safetensors:  28%|██▊       | 2.76G/9.98G [00:06<00:12, 595MB/s]
model-00003-of-00007.safetensors:  29%|██▉       | 2.88G/9.98G [00:06<00:10, 700MB/s]
model-00003-of-00007.safetensors:  30%|███       | 3.02G/9.98G [00:06<00:08, 807MB/s]
model-00003-of-00007.safetensors:  32%|███▏      | 3.22G/9.98G [00:07<00:06, 973MB/s]
model-00003-of-00007.safetensors:  33%|███▎      | 3.33G/9.98G [00:07<00:06, 954MB/s]
model-00003-of-00007.safetensors:  35%|███▍      | 3.45G/9.98G [00:07<00:10, 653MB/s]
model-00003-of-00007.safetensors:  36%|███▌      | 3.54G/9.98G [00:07<00:14, 443MB/s]
model-00003-of-00007.safetensors:  36%|███▌      | 3.62G/9.98G [00:08<00:15, 405MB/s]
model-00003-of-00007.safetensors:  37%|███▋      | 3.70G/9.98G [00:08<00:14, 439MB/s]
model-00003-of-00007.safetensors:  38%|███▊      | 3.80G/9.98G [00:08<00:12, 501MB/s]
model-00003-of-00007.safetensors:  40%|████      | 4.02G/9.98G [00:08<00:07, 801MB/s]
model-00003-of-00007.safetensors:  42%|████▏     | 4.19G/9.98G [00:08<00:05, 999MB/s]
model-00003-of-00007.safetensors:  43%|████▎     | 4.33G/9.98G [00:08<00:05, 971MB/s]
model-00003-of-00007.safetensors:  45%|████▍     | 4.46G/9.98G [00:08<00:06, 823MB/s]
model-00003-of-00007.safetensors:  46%|████▌     | 4.56G/9.98G [00:09<00:10, 522MB/s]
model-00003-of-00007.safetensors:  47%|████▋     | 4.65G/9.98G [00:09<00:13, 401MB/s]
model-00003-of-00007.safetensors:  47%|████▋     | 4.72G/9.98G [00:09<00:12, 437MB/s]
model-00003-of-00007.safetensors:  48%|████▊     | 4.78G/9.98G [00:10<00:12, 410MB/s]
model-00003-of-00007.safetensors:  49%|████▊     | 4.84G/9.98G [00:10<00:11, 443MB/s]
model-00003-of-00007.safetensors:  51%|█████     | 5.05G/9.98G [00:10<00:06, 749MB/s]
model-00003-of-00007.safetensors:  52%|█████▏    | 5.18G/9.98G [00:10<00:05, 854MB/s]
model-00003-of-00007.safetensors:  54%|█████▎    | 5.36G/9.98G [00:10<00:04, 1.06GB/s]
model-00003-of-00007.safetensors:  55%|█████▌    | 5.49G/9.98G [00:10<00:04, 1.08GB/s]
model-00003-of-00007.safetensors:  56%|█████▋    | 5.62G/9.98G [00:10<00:06, 688MB/s] 
model-00003-of-00007.safetensors:  57%|█████▋    | 5.73G/9.98G [00:11<00:07, 537MB/s]
model-00003-of-00007.safetensors:  58%|█████▊    | 5.81G/9.98G [00:11<00:07, 574MB/s]
model-00003-of-00007.safetensors:  59%|█████▉    | 5.89G/9.98G [00:11<00:08, 474MB/s]
model-00003-of-00007.safetensors:  60%|██████    | 6.01G/9.98G [00:11<00:07, 568MB/s]
model-00003-of-00007.safetensors:  61%|██████    | 6.08G/9.98G [00:11<00:06, 570MB/s]
model-00003-of-00007.safetensors:  62%|██████▏   | 6.20G/9.98G [00:12<00:05, 686MB/s]
model-00003-of-00007.safetensors:  63%|██████▎   | 6.31G/9.98G [00:12<00:04, 790MB/s]
model-00003-of-00007.safetensors:  65%|██████▍   | 6.48G/9.98G [00:12<00:03, 980MB/s]
model-00003-of-00007.safetensors:  66%|██████▌   | 6.60G/9.98G [00:12<00:04, 811MB/s]
model-00003-of-00007.safetensors:  67%|██████▋   | 6.69G/9.98G [00:12<00:05, 583MB/s]
model-00003-of-00007.safetensors:  68%|██████▊   | 6.77G/9.98G [00:12<00:06, 526MB/s]
model-00003-of-00007.safetensors:  69%|██████▊   | 6.85G/9.98G [00:13<00:05, 538MB/s]
model-00003-of-00007.safetensors:  69%|██████▉   | 6.91G/9.98G [00:13<00:06, 477MB/s]
model-00003-of-00007.safetensors:  70%|███████   | 7.03G/9.98G [00:13<00:04, 602MB/s]
model-00003-of-00007.safetensors:  71%|███████   | 7.10G/9.98G [00:13<00:05, 528MB/s]
model-00003-of-00007.safetensors:  72%|███████▏  | 7.20G/9.98G [00:13<00:04, 623MB/s]
model-00003-of-00007.safetensors:  74%|███████▎  | 7.34G/9.98G [00:13<00:03, 786MB/s]
model-00003-of-00007.safetensors:  75%|███████▍  | 7.49G/9.98G [00:13<00:02, 928MB/s]
model-00003-of-00007.safetensors:  76%|███████▌  | 7.59G/9.98G [00:13<00:02, 951MB/s]
model-00003-of-00007.safetensors:  77%|███████▋  | 7.70G/9.98G [00:14<00:03, 726MB/s]
model-00003-of-00007.safetensors:  78%|███████▊  | 7.79G/9.98G [00:14<00:03, 670MB/s]
model-00003-of-00007.safetensors:  79%|███████▉  | 7.87G/9.98G [00:14<00:03, 581MB/s]
model-00003-of-00007.safetensors:  80%|███████▉  | 7.95G/9.98G [00:14<00:03, 513MB/s]
model-00003-of-00007.safetensors:  80%|████████  | 8.01G/9.98G [00:14<00:03, 536MB/s]
model-00003-of-00007.safetensors:  81%|████████▏ | 8.13G/9.98G [00:15<00:02, 650MB/s]
model-00003-of-00007.safetensors:  82%|████████▏ | 8.20G/9.98G [00:15<00:03, 530MB/s]
model-00003-of-00007.safetensors:  83%|████████▎ | 8.29G/9.98G [00:15<00:02, 616MB/s]
model-00003-of-00007.safetensors:  84%|████████▍ | 8.41G/9.98G [00:15<00:02, 739MB/s]
model-00003-of-00007.safetensors:  86%|████████▌ | 8.59G/9.98G [00:15<00:01, 976MB/s]
model-00003-of-00007.safetensors:  87%|████████▋ | 8.71G/9.98G [00:15<00:01, 948MB/s]
model-00003-of-00007.safetensors:  88%|████████▊ | 8.82G/9.98G [00:15<00:01, 674MB/s]
model-00003-of-00007.safetensors:  89%|████████▉ | 8.90G/9.98G [00:16<00:01, 581MB/s]
model-00003-of-00007.safetensors:  90%|█████████ | 9.00G/9.98G [00:16<00:01, 629MB/s]
model-00003-of-00007.safetensors:  91%|█████████ | 9.07G/9.98G [00:16<00:01, 576MB/s]
model-00003-of-00007.safetensors:  92%|█████████▏| 9.15G/9.98G [00:16<00:01, 618MB/s]
model-00003-of-00007.safetensors:  92%|█████████▏| 9.23G/9.98G [00:16<00:01, 585MB/s]
model-00003-of-00007.safetensors:  93%|█████████▎| 9.32G/9.98G [00:16<00:01, 622MB/s]
model-00003-of-00007.safetensors:  95%|█████████▍| 9.47G/9.98G [00:16<00:00, 798MB/s]
model-00003-of-00007.safetensors:  96%|█████████▋| 9.62G/9.98G [00:17<00:00, 954MB/s]
model-00003-of-00007.safetensors:  99%|█████████▉| 9.87G/9.98G [00:17<00:00, 1.35GB/s]
model-00003-of-00007.safetensors: 100%|█████████▉| 9.98G/9.98G [00:17<00:00, 580MB/s] 
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model-00004-of-00007.safetensors:   0%|          | 0.00/9.81G [00:00<?, ?B/s]
model-00004-of-00007.safetensors:   0%|          | 10.5M/9.81G [00:00<09:14, 17.7MB/s]
model-00004-of-00007.safetensors:   0%|          | 21.0M/9.81G [00:02<20:25, 7.99MB/s]
model-00004-of-00007.safetensors:   0%|          | 31.5M/9.81G [00:02<13:06, 12.4MB/s]
model-00004-of-00007.safetensors:   1%|          | 73.4M/9.81G [00:02<03:54, 41.4MB/s]
model-00004-of-00007.safetensors:   1%|▏         | 136M/9.81G [00:02<01:49, 88.2MB/s] 
model-00004-of-00007.safetensors:   3%|▎         | 252M/9.81G [00:03<00:53, 179MB/s] 
model-00004-of-00007.safetensors:   4%|▍         | 409M/9.81G [00:03<00:27, 346MB/s]
model-00004-of-00007.safetensors:  11%|█         | 1.08G/9.81G [00:03<00:07, 1.24GB/s]
model-00004-of-00007.safetensors:  13%|█▎        | 1.32G/9.81G [00:04<00:15, 561MB/s] 
model-00004-of-00007.safetensors:  16%|█▌        | 1.55G/9.81G [00:04<00:11, 704MB/s]
model-00004-of-00007.safetensors:  18%|█▊        | 1.74G/9.81G [00:04<00:11, 674MB/s]
model-00004-of-00007.safetensors:  19%|█▉        | 1.89G/9.81G [00:05<00:11, 684MB/s]
model-00004-of-00007.safetensors:  21%|██        | 2.01G/9.81G [00:05<00:10, 756MB/s]
model-00004-of-00007.safetensors:  23%|██▎       | 2.24G/9.81G [00:05<00:07, 987MB/s]
model-00004-of-00007.safetensors:  27%|██▋       | 2.65G/9.81G [00:05<00:04, 1.50GB/s]
model-00004-of-00007.safetensors:  29%|██▉       | 2.87G/9.81G [00:05<00:06, 1.04GB/s]
model-00004-of-00007.safetensors:  31%|███       | 3.04G/9.81G [00:06<00:08, 756MB/s] 
model-00004-of-00007.safetensors:  32%|███▏      | 3.18G/9.81G [00:06<00:09, 721MB/s]
model-00004-of-00007.safetensors:  34%|███▎      | 3.29G/9.81G [00:06<00:08, 770MB/s]
model-00004-of-00007.safetensors:  35%|███▌      | 3.47G/9.81G [00:06<00:06, 928MB/s]
model-00004-of-00007.safetensors:  38%|███▊      | 3.69G/9.81G [00:06<00:05, 1.14GB/s]
model-00004-of-00007.safetensors:  39%|███▉      | 3.85G/9.81G [00:06<00:04, 1.22GB/s]
model-00004-of-00007.safetensors:  41%|████      | 4.01G/9.81G [00:07<00:07, 766MB/s] 
model-00004-of-00007.safetensors:  42%|████▏     | 4.13G/9.81G [00:07<00:08, 649MB/s]
model-00004-of-00007.safetensors:  43%|████▎     | 4.23G/9.81G [00:07<00:08, 622MB/s]
model-00004-of-00007.safetensors:  44%|████▍     | 4.31G/9.81G [00:07<00:08, 649MB/s]
model-00004-of-00007.safetensors:  45%|████▌     | 4.44G/9.81G [00:07<00:07, 760MB/s]
model-00004-of-00007.safetensors:  47%|████▋     | 4.62G/9.81G [00:08<00:05, 967MB/s]
model-00004-of-00007.safetensors:  50%|████▉     | 4.89G/9.81G [00:08<00:03, 1.33GB/s]
model-00004-of-00007.safetensors:  52%|█████▏    | 5.05G/9.81G [00:08<00:05, 923MB/s] 
model-00004-of-00007.safetensors:  53%|█████▎    | 5.19G/9.81G [00:08<00:05, 837MB/s]
model-00004-of-00007.safetensors:  54%|█████▍    | 5.31G/9.81G [00:08<00:06, 676MB/s]
model-00004-of-00007.safetensors:  55%|█████▌    | 5.40G/9.81G [00:09<00:06, 646MB/s]
model-00004-of-00007.safetensors:  57%|█████▋    | 5.55G/9.81G [00:09<00:05, 780MB/s]
model-00004-of-00007.safetensors:  58%|█████▊    | 5.69G/9.81G [00:09<00:04, 905MB/s]
model-00004-of-00007.safetensors:  60%|██████    | 5.92G/9.81G [00:09<00:03, 1.16GB/s]
model-00004-of-00007.safetensors:  62%|██████▏   | 6.06G/9.81G [00:09<00:03, 958MB/s] 
model-00004-of-00007.safetensors:  63%|██████▎   | 6.18G/9.81G [00:09<00:03, 935MB/s]
model-00004-of-00007.safetensors:  64%|██████▍   | 6.29G/9.81G [00:10<00:04, 745MB/s]
model-00004-of-00007.safetensors:  65%|██████▌   | 6.39G/9.81G [00:10<00:05, 657MB/s]
model-00004-of-00007.safetensors:  66%|██████▌   | 6.47G/9.81G [00:10<00:05, 608MB/s]
model-00004-of-00007.safetensors:  67%|██████▋   | 6.59G/9.81G [00:10<00:04, 697MB/s]
model-00004-of-00007.safetensors:  69%|██████▉   | 6.76G/9.81G [00:10<00:03, 922MB/s]
model-00004-of-00007.safetensors:  70%|███████   | 6.89G/9.81G [00:10<00:02, 973MB/s]
model-00004-of-00007.safetensors:  72%|███████▏  | 7.01G/9.81G [00:10<00:02, 1.04GB/s]
model-00004-of-00007.safetensors:  73%|███████▎  | 7.14G/9.81G [00:10<00:02, 1.09GB/s]
model-00004-of-00007.safetensors:  74%|███████▍  | 7.27G/9.81G [00:11<00:03, 846MB/s] 
model-00004-of-00007.safetensors:  75%|███████▌  | 7.37G/9.81G [00:11<00:02, 823MB/s]
model-00004-of-00007.safetensors:  76%|███████▌  | 7.47G/9.81G [00:11<00:02, 796MB/s]
model-00004-of-00007.safetensors:  77%|███████▋  | 7.56G/9.81G [00:11<00:03, 704MB/s]
model-00004-of-00007.safetensors:  78%|███████▊  | 7.64G/9.81G [00:11<00:03, 682MB/s]
model-00004-of-00007.safetensors:  80%|███████▉  | 7.84G/9.81G [00:11<00:02, 960MB/s]
model-00004-of-00007.safetensors:  81%|████████  | 7.96G/9.81G [00:12<00:01, 1.00GB/s]
model-00004-of-00007.safetensors:  82%|████████▏ | 8.07G/9.81G [00:12<00:01, 988MB/s] 
model-00004-of-00007.safetensors:  83%|████████▎ | 8.18G/9.81G [00:12<00:01, 910MB/s]
model-00004-of-00007.safetensors:  84%|████████▍ | 8.28G/9.81G [00:12<00:01, 921MB/s]
model-00004-of-00007.safetensors:  86%|████████▌ | 8.40G/9.81G [00:12<00:01, 933MB/s]
model-00004-of-00007.safetensors:  87%|████████▋ | 8.50G/9.81G [00:12<00:01, 722MB/s]
model-00004-of-00007.safetensors:  88%|████████▊ | 8.59G/9.81G [00:12<00:01, 664MB/s]
model-00004-of-00007.safetensors:  88%|████████▊ | 8.66G/9.81G [00:13<00:01, 652MB/s]
model-00004-of-00007.safetensors:  89%|████████▉ | 8.78G/9.81G [00:13<00:01, 749MB/s]
model-00004-of-00007.safetensors:  91%|█████████ | 8.93G/9.81G [00:13<00:00, 939MB/s]
model-00004-of-00007.safetensors:  93%|█████████▎| 9.10G/9.81G [00:13<00:00, 1.13GB/s]
model-00004-of-00007.safetensors:  94%|█████████▍| 9.24G/9.81G [00:13<00:00, 1.15GB/s]
model-00004-of-00007.safetensors:  96%|█████████▌| 9.43G/9.81G [00:13<00:00, 1.33GB/s]
model-00004-of-00007.safetensors:  99%|█████████▊| 9.67G/9.81G [00:13<00:00, 1.63GB/s]
model-00004-of-00007.safetensors: 100%|█████████▉| 9.81G/9.81G [00:13<00:00, 705MB/s] 
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model-00005-of-00007.safetensors:   0%|          | 0.00/9.75G [00:00<?, ?B/s]
model-00005-of-00007.safetensors:   0%|          | 10.5M/9.75G [00:01<24:56, 6.51MB/s]
model-00005-of-00007.safetensors:   0%|          | 31.5M/9.75G [00:02<10:27, 15.5MB/s]
model-00005-of-00007.safetensors:   0%|          | 41.9M/9.75G [00:02<07:36, 21.3MB/s]
model-00005-of-00007.safetensors:   1%|          | 83.9M/9.75G [00:02<02:49, 57.0MB/s]
model-00005-of-00007.safetensors:   1%|▏         | 136M/9.75G [00:02<01:27, 109MB/s]  
model-00005-of-00007.safetensors:   2%|▏         | 241M/9.75G [00:02<00:39, 239MB/s]
model-00005-of-00007.safetensors:   4%|▍         | 430M/9.75G [00:02<00:18, 494MB/s]
model-00005-of-00007.safetensors:   5%|▌         | 524M/9.75G [00:03<00:16, 553MB/s]
model-00005-of-00007.safetensors:  11%|█         | 1.08G/9.75G [00:03<00:05, 1.47GB/s]
model-00005-of-00007.safetensors:  13%|█▎        | 1.28G/9.75G [00:04<00:14, 597MB/s] 
model-00005-of-00007.safetensors:  16%|█▌        | 1.52G/9.75G [00:04<00:10, 784MB/s]
model-00005-of-00007.safetensors:  17%|█▋        | 1.70G/9.75G [00:04<00:12, 657MB/s]
model-00005-of-00007.safetensors:  19%|█▉        | 1.84G/9.75G [00:04<00:11, 707MB/s]
model-00005-of-00007.safetensors:  20%|██        | 1.98G/9.75G [00:04<00:09, 804MB/s]
model-00005-of-00007.safetensors:  22%|██▏       | 2.16G/9.75G [00:04<00:07, 962MB/s]
model-00005-of-00007.safetensors:  24%|██▎       | 2.31G/9.75G [00:05<00:08, 919MB/s]
model-00005-of-00007.safetensors:  29%|██▊       | 2.79G/9.75G [00:05<00:04, 1.65GB/s]
model-00005-of-00007.safetensors:  31%|███       | 3.02G/9.75G [00:05<00:06, 1.02GB/s]
model-00005-of-00007.safetensors:  33%|███▎      | 3.20G/9.75G [00:06<00:08, 783MB/s] 
model-00005-of-00007.safetensors:  34%|███▍      | 3.33G/9.75G [00:06<00:08, 715MB/s]
model-00005-of-00007.safetensors:  36%|███▋      | 3.53G/9.75G [00:06<00:07, 869MB/s]
model-00005-of-00007.safetensors:  38%|███▊      | 3.69G/9.75G [00:06<00:06, 966MB/s]
model-00005-of-00007.safetensors:  40%|████      | 3.92G/9.75G [00:06<00:04, 1.21GB/s]
model-00005-of-00007.safetensors:  42%|████▏     | 4.09G/9.75G [00:06<00:05, 973MB/s] 
model-00005-of-00007.safetensors:  43%|████▎     | 4.23G/9.75G [00:07<00:07, 729MB/s]
model-00005-of-00007.safetensors:  45%|████▍     | 4.34G/9.75G [00:07<00:07, 700MB/s]
model-00005-of-00007.safetensors:  46%|████▌     | 4.44G/9.75G [00:07<00:07, 715MB/s]
model-00005-of-00007.safetensors:  46%|████▋     | 4.53G/9.75G [00:07<00:07, 726MB/s]
model-00005-of-00007.safetensors:  48%|████▊     | 4.69G/9.75G [00:07<00:05, 883MB/s]
model-00005-of-00007.safetensors:  50%|█████     | 4.91G/9.75G [00:07<00:04, 1.17GB/s]
model-00005-of-00007.safetensors:  52%|█████▏    | 5.05G/9.75G [00:07<00:04, 1.16GB/s]
model-00005-of-00007.safetensors:  53%|█████▎    | 5.19G/9.75G [00:08<00:05, 790MB/s] 
model-00005-of-00007.safetensors:  54%|█████▍    | 5.30G/9.75G [00:08<00:06, 656MB/s]
model-00005-of-00007.safetensors:  55%|█████▌    | 5.39G/9.75G [00:08<00:06, 674MB/s]
model-00005-of-00007.safetensors:  56%|█████▌    | 5.47G/9.75G [00:08<00:06, 690MB/s]
model-00005-of-00007.safetensors:  57%|█████▋    | 5.60G/9.75G [00:08<00:05, 801MB/s]
model-00005-of-00007.safetensors:  59%|█████▉    | 5.74G/9.75G [00:08<00:04, 926MB/s]
model-00005-of-00007.safetensors:  60%|██████    | 5.86G/9.75G [00:09<00:03, 993MB/s]
model-00005-of-00007.safetensors:  62%|██████▏   | 6.02G/9.75G [00:09<00:03, 1.12GB/s]
model-00005-of-00007.safetensors:  63%|██████▎   | 6.16G/9.75G [00:09<00:03, 1.16GB/s]
model-00005-of-00007.safetensors:  64%|██████▍   | 6.28G/9.75G [00:09<00:03, 877MB/s] 
model-00005-of-00007.safetensors:  66%|██████▌   | 6.39G/9.75G [00:09<00:04, 724MB/s]
model-00005-of-00007.safetensors:  66%|██████▋   | 6.48G/9.75G [00:09<00:04, 708MB/s]
model-00005-of-00007.safetensors:  67%|██████▋   | 6.57G/9.75G [00:10<00:04, 757MB/s]
model-00005-of-00007.safetensors:  68%|██████▊   | 6.67G/9.75G [00:10<00:04, 683MB/s]
model-00005-of-00007.safetensors:  70%|██████▉   | 6.81G/9.75G [00:10<00:03, 824MB/s]
model-00005-of-00007.safetensors:  71%|███████   | 6.90G/9.75G [00:10<00:03, 837MB/s]
model-00005-of-00007.safetensors:  73%|███████▎  | 7.08G/9.75G [00:10<00:02, 1.05GB/s]
model-00005-of-00007.safetensors:  75%|███████▍  | 7.27G/9.75G [00:10<00:02, 1.21GB/s]
model-00005-of-00007.safetensors:  76%|███████▌  | 7.40G/9.75G [00:10<00:02, 801MB/s] 
model-00005-of-00007.safetensors:  77%|███████▋  | 7.51G/9.75G [00:11<00:02, 785MB/s]
model-00005-of-00007.safetensors:  78%|███████▊  | 7.60G/9.75G [00:11<00:02, 809MB/s]
model-00005-of-00007.safetensors:  79%|███████▉  | 7.70G/9.75G [00:11<00:02, 810MB/s]
model-00005-of-00007.safetensors:  80%|███████▉  | 7.79G/9.75G [00:11<00:02, 772MB/s]
model-00005-of-00007.safetensors:  81%|████████  | 7.87G/9.75G [00:11<00:02, 735MB/s]
model-00005-of-00007.safetensors:  82%|████████▏ | 8.00G/9.75G [00:11<00:02, 812MB/s]
model-00005-of-00007.safetensors:  84%|████████▍ | 8.18G/9.75G [00:11<00:01, 1.01GB/s]
model-00005-of-00007.safetensors:  86%|████████▌ | 8.37G/9.75G [00:11<00:01, 1.22GB/s]
model-00005-of-00007.safetensors:  87%|████████▋ | 8.50G/9.75G [00:12<00:01, 875MB/s] 
model-00005-of-00007.safetensors:  89%|████████▊ | 8.63G/9.75G [00:12<00:01, 952MB/s]
model-00005-of-00007.safetensors:  90%|████████▉ | 8.75G/9.75G [00:12<00:01, 912MB/s]
model-00005-of-00007.safetensors:  91%|█████████ | 8.85G/9.75G [00:12<00:01, 819MB/s]
model-00005-of-00007.safetensors:  92%|█████████▏| 8.94G/9.75G [00:12<00:00, 842MB/s]
model-00005-of-00007.safetensors:  93%|█████████▎| 9.05G/9.75G [00:12<00:00, 879MB/s]
model-00005-of-00007.safetensors:  95%|█████████▍| 9.26G/9.75G [00:12<00:00, 1.17GB/s]
model-00005-of-00007.safetensors:  97%|█████████▋| 9.49G/9.75G [00:12<00:00, 1.47GB/s]
model-00005-of-00007.safetensors: 100%|█████████▉| 9.72G/9.75G [00:13<00:00, 1.67GB/s]
model-00005-of-00007.safetensors: 100%|█████████▉| 9.75G/9.75G [00:13<00:00, 731MB/s] 
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model-00006-of-00007.safetensors:   0%|          | 0.00/9.75G [00:00<?, ?B/s]
model-00006-of-00007.safetensors:   0%|          | 10.5M/9.75G [00:02<31:10, 5.21MB/s]
model-00006-of-00007.safetensors:   0%|          | 21.0M/9.75G [00:02<17:44, 9.14MB/s]
model-00006-of-00007.safetensors:   1%|          | 73.4M/9.75G [00:02<03:40, 44.0MB/s]
model-00006-of-00007.safetensors:   2%|▏         | 220M/9.75G [00:02<00:56, 168MB/s]  
model-00006-of-00007.safetensors:   4%|▍         | 377M/9.75G [00:02<00:29, 321MB/s]
model-00006-of-00007.safetensors:   5%|▍         | 482M/9.75G [00:03<00:23, 391MB/s]
model-00006-of-00007.safetensors:  11%|█         | 1.07G/9.75G [00:03<00:07, 1.20GB/s]
model-00006-of-00007.safetensors:  13%|█▎        | 1.29G/9.75G [00:04<00:14, 572MB/s] 
model-00006-of-00007.safetensors:  15%|█▍        | 1.46G/9.75G [00:04<00:12, 641MB/s]
model-00006-of-00007.safetensors:  16%|█▋        | 1.60G/9.75G [00:04<00:11, 686MB/s]
model-00006-of-00007.safetensors:  18%|█▊        | 1.73G/9.75G [00:04<00:11, 708MB/s]
model-00006-of-00007.safetensors:  20%|█▉        | 1.91G/9.75G [00:04<00:09, 862MB/s]
model-00006-of-00007.safetensors:  21%|██        | 2.06G/9.75G [00:04<00:07, 966MB/s]
model-00006-of-00007.safetensors:  22%|██▏       | 2.19G/9.75G [00:04<00:07, 978MB/s]
model-00006-of-00007.safetensors:  25%|██▌       | 2.47G/9.75G [00:04<00:05, 1.36GB/s]
model-00006-of-00007.safetensors:  28%|██▊       | 2.71G/9.75G [00:05<00:04, 1.53GB/s]
model-00006-of-00007.safetensors:  30%|██▉       | 2.89G/9.75G [00:05<00:07, 938MB/s] 
model-00006-of-00007.safetensors:  31%|███       | 3.04G/9.75G [00:05<00:09, 691MB/s]
model-00006-of-00007.safetensors:  32%|███▏      | 3.16G/9.75G [00:06<00:09, 726MB/s]
model-00006-of-00007.safetensors:  34%|███▎      | 3.27G/9.75G [00:06<00:08, 773MB/s]
model-00006-of-00007.safetensors:  35%|███▍      | 3.40G/9.75G [00:06<00:07, 860MB/s]
model-00006-of-00007.safetensors:  37%|███▋      | 3.62G/9.75G [00:06<00:05, 1.12GB/s]
model-00006-of-00007.safetensors:  39%|███▉      | 3.81G/9.75G [00:06<00:04, 1.22GB/s]
model-00006-of-00007.safetensors:  41%|████      | 3.95G/9.75G [00:06<00:05, 1.05GB/s]
model-00006-of-00007.safetensors:  42%|████▏     | 4.08G/9.75G [00:06<00:07, 760MB/s] 
model-00006-of-00007.safetensors:  43%|████▎     | 4.18G/9.75G [00:07<00:07, 721MB/s]
model-00006-of-00007.safetensors:  44%|████▍     | 4.28G/9.75G [00:07<00:08, 683MB/s]
model-00006-of-00007.safetensors:  46%|████▌     | 4.45G/9.75G [00:07<00:06, 859MB/s]
model-00006-of-00007.safetensors:  47%|████▋     | 4.59G/9.75G [00:07<00:05, 970MB/s]
model-00006-of-00007.safetensors:  49%|████▊     | 4.74G/9.75G [00:07<00:04, 1.04GB/s]
model-00006-of-00007.safetensors:  50%|████▉     | 4.87G/9.75G [00:07<00:04, 1.02GB/s]
model-00006-of-00007.safetensors:  51%|█████     | 4.98G/9.75G [00:07<00:05, 942MB/s] 
model-00006-of-00007.safetensors:  52%|█████▏    | 5.09G/9.75G [00:08<00:05, 924MB/s]
model-00006-of-00007.safetensors:  53%|█████▎    | 5.19G/9.75G [00:08<00:06, 705MB/s]
model-00006-of-00007.safetensors:  54%|█████▍    | 5.27G/9.75G [00:08<00:06, 669MB/s]
model-00006-of-00007.safetensors:  55%|█████▌    | 5.39G/9.75G [00:08<00:05, 757MB/s]
model-00006-of-00007.safetensors:  56%|█████▋    | 5.51G/9.75G [00:08<00:05, 834MB/s]
model-00006-of-00007.safetensors:  58%|█████▊    | 5.64G/9.75G [00:08<00:04, 947MB/s]
model-00006-of-00007.safetensors:  59%|█████▉    | 5.77G/9.75G [00:08<00:04, 992MB/s]
model-00006-of-00007.safetensors:  60%|██████    | 5.87G/9.75G [00:08<00:04, 953MB/s]
model-00006-of-00007.safetensors:  61%|██████▏   | 5.98G/9.75G [00:09<00:04, 877MB/s]
model-00006-of-00007.safetensors:  63%|██████▎   | 6.11G/9.75G [00:09<00:03, 953MB/s]
model-00006-of-00007.safetensors:  64%|██████▍   | 6.22G/9.75G [00:09<00:04, 751MB/s]
model-00006-of-00007.safetensors:  65%|██████▍   | 6.30G/9.75G [00:09<00:05, 674MB/s]
model-00006-of-00007.safetensors:  66%|██████▌   | 6.39G/9.75G [00:09<00:04, 708MB/s]
model-00006-of-00007.safetensors:  67%|██████▋   | 6.49G/9.75G [00:09<00:04, 787MB/s]
model-00006-of-00007.safetensors:  68%|██████▊   | 6.60G/9.75G [00:09<00:03, 851MB/s]
model-00006-of-00007.safetensors:  69%|██████▊   | 6.69G/9.75G [00:10<00:03, 858MB/s]
model-00006-of-00007.safetensors:  70%|███████   | 6.86G/9.75G [00:10<00:02, 1.02GB/s]
model-00006-of-00007.safetensors:  71%|███████▏  | 6.96G/9.75G [00:10<00:02, 950MB/s] 
model-00006-of-00007.safetensors:  73%|███████▎  | 7.07G/9.75G [00:10<00:02, 905MB/s]
model-00006-of-00007.safetensors:  74%|███████▍  | 7.22G/9.75G [00:10<00:02, 877MB/s]
model-00006-of-00007.safetensors:  75%|███████▌  | 7.32G/9.75G [00:10<00:02, 891MB/s]
model-00006-of-00007.safetensors:  76%|███████▌  | 7.41G/9.75G [00:10<00:02, 819MB/s]
model-00006-of-00007.safetensors:  77%|███████▋  | 7.50G/9.75G [00:10<00:02, 823MB/s]
model-00006-of-00007.safetensors:  78%|███████▊  | 7.59G/9.75G [00:11<00:02, 793MB/s]
model-00006-of-00007.safetensors:  79%|███████▉  | 7.69G/9.75G [00:11<00:02, 825MB/s]
model-00006-of-00007.safetensors:  80%|███████▉  | 7.77G/9.75G [00:11<00:02, 800MB/s]
model-00006-of-00007.safetensors:  81%|████████▏ | 7.94G/9.75G [00:11<00:01, 1.00GB/s]
model-00006-of-00007.safetensors:  83%|████████▎ | 8.06G/9.75G [00:11<00:01, 1.04GB/s]
model-00006-of-00007.safetensors:  84%|████████▍ | 8.18G/9.75G [00:11<00:01, 1.03GB/s]
model-00006-of-00007.safetensors:  85%|████████▍ | 8.28G/9.75G [00:11<00:01, 853MB/s] 
model-00006-of-00007.safetensors:  86%|████████▌ | 8.38G/9.75G [00:11<00:01, 796MB/s]
model-00006-of-00007.safetensors:  87%|████████▋ | 8.46G/9.75G [00:12<00:01, 701MB/s]
model-00006-of-00007.safetensors:  88%|████████▊ | 8.58G/9.75G [00:12<00:01, 799MB/s]
model-00006-of-00007.safetensors:  89%|████████▉ | 8.68G/9.75G [00:12<00:01, 835MB/s]
model-00006-of-00007.safetensors:  90%|█████████ | 8.78G/9.75G [00:12<00:01, 822MB/s]
model-00006-of-00007.safetensors:  91%|█████████ | 8.87G/9.75G [00:12<00:01, 845MB/s]
model-00006-of-00007.safetensors:  93%|█████████▎| 9.03G/9.75G [00:12<00:00, 1.00GB/s]
model-00006-of-00007.safetensors:  94%|█████████▍| 9.18G/9.75G [00:12<00:00, 1.12GB/s]
model-00006-of-00007.safetensors:  96%|█████████▌| 9.35G/9.75G [00:12<00:00, 1.24GB/s]
model-00006-of-00007.safetensors:  98%|█████████▊| 9.56G/9.75G [00:12<00:00, 1.47GB/s]
model-00006-of-00007.safetensors: 100%|█████████▉| 9.74G/9.75G [00:13<00:00, 1.51GB/s]
model-00006-of-00007.safetensors: 100%|█████████▉| 9.75G/9.75G [00:13<00:00, 721MB/s] 
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model-00007-of-00007.safetensors:   0%|          | 0.00/9.67G [00:00<?, ?B/s]
model-00007-of-00007.safetensors:   0%|          | 10.5M/9.67G [00:02<33:25, 4.81MB/s]
model-00007-of-00007.safetensors:   0%|          | 21.0M/9.67G [00:02<15:04, 10.7MB/s]
model-00007-of-00007.safetensors:   0%|          | 31.5M/9.67G [00:02<09:22, 17.1MB/s]
model-00007-of-00007.safetensors:   1%|          | 62.9M/9.67G [00:02<04:00, 39.9MB/s]
model-00007-of-00007.safetensors:   2%|▏         | 157M/9.67G [00:02<01:10, 135MB/s]  
model-00007-of-00007.safetensors:   3%|▎         | 304M/9.67G [00:02<00:30, 307MB/s]
model-00007-of-00007.safetensors:   4%|▍         | 419M/9.67G [00:03<00:21, 437MB/s]
model-00007-of-00007.safetensors:   5%|▌         | 503M/9.67G [00:03<00:18, 501MB/s]
model-00007-of-00007.safetensors:   8%|▊         | 797M/9.67G [00:03<00:08, 995MB/s]
model-00007-of-00007.safetensors:  11%|█         | 1.06G/9.67G [00:03<00:11, 767MB/s]
model-00007-of-00007.safetensors:  12%|█▏        | 1.18G/9.67G [00:04<00:14, 579MB/s]
model-00007-of-00007.safetensors:  13%|█▎        | 1.30G/9.67G [00:04<00:12, 648MB/s]
model-00007-of-00007.safetensors:  15%|█▍        | 1.41G/9.67G [00:04<00:12, 666MB/s]
model-00007-of-00007.safetensors:  16%|█▌        | 1.50G/9.67G [00:04<00:12, 651MB/s]
model-00007-of-00007.safetensors:  16%|█▋        | 1.59G/9.67G [00:04<00:11, 694MB/s]
model-00007-of-00007.safetensors:  18%|█▊        | 1.71G/9.67G [00:04<00:10, 787MB/s]
model-00007-of-00007.safetensors:  19%|█▉        | 1.81G/9.67G [00:04<00:09, 832MB/s]
model-00007-of-00007.safetensors:  20%|█▉        | 1.93G/9.67G [00:04<00:08, 889MB/s]
model-00007-of-00007.safetensors:  22%|██▏       | 2.11G/9.67G [00:05<00:06, 1.10GB/s]
model-00007-of-00007.safetensors:  23%|██▎       | 2.23G/9.67G [00:05<00:07, 1.03GB/s]
model-00007-of-00007.safetensors:  26%|██▌       | 2.54G/9.67G [00:05<00:04, 1.53GB/s]
model-00007-of-00007.safetensors:  29%|██▊       | 2.76G/9.67G [00:05<00:04, 1.66GB/s]
model-00007-of-00007.safetensors:  30%|███       | 2.94G/9.67G [00:05<00:06, 998MB/s] 
model-00007-of-00007.safetensors:  32%|███▏      | 3.08G/9.67G [00:06<00:09, 678MB/s]
model-00007-of-00007.safetensors:  33%|███▎      | 3.20G/9.67G [00:06<00:09, 669MB/s]
model-00007-of-00007.safetensors:  34%|███▍      | 3.29G/9.67G [00:06<00:09, 703MB/s]
model-00007-of-00007.safetensors:  36%|███▌      | 3.48G/9.67G [00:06<00:06, 892MB/s]
model-00007-of-00007.safetensors:  39%|███▊      | 3.74G/9.67G [00:06<00:04, 1.21GB/s]
model-00007-of-00007.safetensors:  40%|████      | 3.90G/9.67G [00:06<00:05, 1.11GB/s]
model-00007-of-00007.safetensors:  42%|████▏     | 4.04G/9.67G [00:07<00:06, 840MB/s] 
model-00007-of-00007.safetensors:  43%|████▎     | 4.15G/9.67G [00:07<00:08, 688MB/s]
model-00007-of-00007.safetensors:  44%|████▍     | 4.25G/9.67G [00:07<00:07, 727MB/s]
model-00007-of-00007.safetensors:  45%|████▍     | 4.34G/9.67G [00:07<00:07, 721MB/s]
model-00007-of-00007.safetensors:  46%|████▌     | 4.46G/9.67G [00:07<00:06, 794MB/s]
model-00007-of-00007.safetensors:  47%|████▋     | 4.56G/9.67G [00:07<00:06, 846MB/s]
model-00007-of-00007.safetensors:  49%|████▊     | 4.71G/9.67G [00:07<00:05, 989MB/s]
model-00007-of-00007.safetensors:  50%|█████     | 4.83G/9.67G [00:08<00:04, 1.05GB/s]
model-00007-of-00007.safetensors:  51%|█████     | 4.95G/9.67G [00:08<00:04, 1.07GB/s]
model-00007-of-00007.safetensors:  52%|█████▏    | 5.06G/9.67G [00:08<00:04, 975MB/s] 
model-00007-of-00007.safetensors:  53%|█████▎    | 5.17G/9.67G [00:08<00:05, 871MB/s]
model-00007-of-00007.safetensors:  54%|█████▍    | 5.26G/9.67G [00:08<00:05, 755MB/s]
model-00007-of-00007.safetensors:  55%|█████▌    | 5.35G/9.67G [00:08<00:05, 747MB/s]
model-00007-of-00007.safetensors:  56%|█████▌    | 5.43G/9.67G [00:08<00:05, 717MB/s]
model-00007-of-00007.safetensors:  57%|█████▋    | 5.55G/9.67G [00:09<00:05, 794MB/s]
model-00007-of-00007.safetensors:  58%|█████▊    | 5.63G/9.67G [00:09<00:05, 796MB/s]
model-00007-of-00007.safetensors:  60%|█████▉    | 5.77G/9.67G [00:09<00:04, 939MB/s]
model-00007-of-00007.safetensors:  61%|██████    | 5.88G/9.67G [00:09<00:03, 997MB/s]
model-00007-of-00007.safetensors:  62%|██████▏   | 5.99G/9.67G [00:09<00:03, 996MB/s]
model-00007-of-00007.safetensors:  63%|██████▎   | 6.10G/9.67G [00:09<00:03, 1.00GB/s]
model-00007-of-00007.safetensors:  64%|██████▍   | 6.21G/9.67G [00:09<00:04, 756MB/s] 
model-00007-of-00007.safetensors:  65%|██████▌   | 6.32G/9.67G [00:09<00:03, 844MB/s]
model-00007-of-00007.safetensors:  66%|██████▋   | 6.42G/9.67G [00:09<00:03, 853MB/s]
model-00007-of-00007.safetensors:  67%|██████▋   | 6.51G/9.67G [00:10<00:03, 822MB/s]
model-00007-of-00007.safetensors:  68%|██████▊   | 6.61G/9.67G [00:10<00:03, 851MB/s]
model-00007-of-00007.safetensors:  69%|██████▉   | 6.70G/9.67G [00:10<00:04, 739MB/s]
model-00007-of-00007.safetensors:  71%|███████   | 6.82G/9.67G [00:10<00:03, 806MB/s]
model-00007-of-00007.safetensors:  71%|███████▏  | 6.91G/9.67G [00:10<00:03, 829MB/s]
model-00007-of-00007.safetensors:  73%|███████▎  | 7.01G/9.67G [00:10<00:03, 883MB/s]
model-00007-of-00007.safetensors:  74%|███████▍  | 7.13G/9.67G [00:10<00:02, 891MB/s]
model-00007-of-00007.safetensors:  75%|███████▍  | 7.22G/9.67G [00:11<00:03, 747MB/s]
model-00007-of-00007.safetensors:  76%|███████▌  | 7.31G/9.67G [00:11<00:03, 721MB/s]
model-00007-of-00007.safetensors:  76%|███████▋  | 7.39G/9.67G [00:11<00:03, 629MB/s]
model-00007-of-00007.safetensors:  78%|███████▊  | 7.51G/9.67G [00:11<00:02, 742MB/s]
model-00007-of-00007.safetensors:  79%|███████▊  | 7.61G/9.67G [00:11<00:02, 771MB/s]
model-00007-of-00007.safetensors:  80%|███████▉  | 7.72G/9.67G [00:11<00:02, 839MB/s]
model-00007-of-00007.safetensors:  81%|████████  | 7.81G/9.67G [00:11<00:02, 814MB/s]
model-00007-of-00007.safetensors:  82%|████████▏ | 7.91G/9.67G [00:11<00:02, 818MB/s]
model-00007-of-00007.safetensors:  83%|████████▎ | 8.01G/9.67G [00:11<00:01, 870MB/s]
model-00007-of-00007.safetensors:  84%|████████▍ | 8.15G/9.67G [00:12<00:01, 982MB/s]
model-00007-of-00007.safetensors:  85%|████████▌ | 8.25G/9.67G [00:12<00:01, 971MB/s]
model-00007-of-00007.safetensors:  86%|████████▋ | 8.36G/9.67G [00:12<00:01, 972MB/s]
model-00007-of-00007.safetensors:  88%|████████▊ | 8.46G/9.67G [00:12<00:01, 739MB/s]
model-00007-of-00007.safetensors:  89%|████████▊ | 8.58G/9.67G [00:12<00:01, 831MB/s]
model-00007-of-00007.safetensors:  90%|████████▉ | 8.67G/9.67G [00:12<00:01, 853MB/s]
model-00007-of-00007.safetensors:  91%|█████████ | 8.77G/9.67G [00:12<00:01, 787MB/s]
model-00007-of-00007.safetensors:  92%|█████████▏| 8.86G/9.67G [00:13<00:01, 770MB/s]
model-00007-of-00007.safetensors:  93%|█████████▎| 8.94G/9.67G [00:13<00:00, 769MB/s]
model-00007-of-00007.safetensors:  94%|█████████▍| 9.08G/9.67G [00:13<00:00, 916MB/s]
model-00007-of-00007.safetensors:  96%|█████████▌| 9.27G/9.67G [00:13<00:00, 1.16GB/s]
model-00007-of-00007.safetensors:  98%|█████████▊| 9.45G/9.67G [00:13<00:00, 1.32GB/s]
model-00007-of-00007.safetensors: 100%|█████████▉| 9.66G/9.67G [00:13<00:00, 1.47GB/s]
model-00007-of-00007.safetensors: 100%|█████████▉| 9.67G/9.67G [00:13<00:00, 707MB/s] 
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
model.safetensors.index.json:   0%|          | 0.00/42.6k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 42.6k/42.6k [00:00<00:00, 167MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/573 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 573/573 [00:00<00:00, 8.68MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
tokenizer.json:   0%|          | 0.00/3.56M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 3.56M/3.56M [00:00<00:00, 50.5MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
tokenizer.model:   0%|          | 0.00/1.03M [00:00<?, ?B/s]
tokenizer.model: 100%|██████████| 1.03M/1.03M [00:00<00:00, 30.9MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/1.35k [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 1.35k/1.35k [00:00<00:00, 16.0MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Downloaded to shared memory in 104.404s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: quantizing model to /dev/shm/model_cache
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Reading /tmp/tmpza_8ofsm/model.safetensors.index.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
Profiling:   0%|          | 0/543 [00:00<?, ?it/s]
Profiling:   0%|          | 1/543 [00:03<36:06,  4.00s/it]
Profiling:   2%|▏         | 9/543 [00:04<02:58,  2.99it/s]
Profiling:   3%|▎         | 18/543 [00:04<01:14,  7.03it/s]
Profiling:   6%|▌         | 30/543 [00:04<00:36, 13.95it/s]
Profiling:   7%|▋         | 39/543 [00:04<00:25, 20.00it/s]
Profiling:   9%|▉         | 48/543 [00:04<00:18, 27.11it/s]
Profiling:  10%|█         | 57/543 [00:04<00:13, 34.87it/s]
Profiling:  12%|█▏        | 66/543 [00:04<00:11, 43.02it/s]
Profiling:  14%|█▍        | 76/543 [00:04<00:08, 52.98it/s]
Profiling:  16%|█▌        | 85/543 [00:05<00:13, 34.07it/s]
Profiling:  17%|█▋        | 94/543 [00:05<00:11, 40.48it/s]
Profiling:  19%|█▊        | 101/543 [00:05<00:10, 42.06it/s]
Profiling:  20%|██        | 110/543 [00:05<00:08, 49.97it/s]
Profiling:  22%|██▏       | 119/543 [00:05<00:07, 56.06it/s]
Profiling:  24%|██▍       | 130/543 [00:05<00:06, 66.05it/s]
Profiling:  26%|██▌       | 140/543 [00:06<00:05, 70.37it/s]
Profiling:  27%|██▋       | 149/543 [00:06<00:05, 72.36it/s]
Profiling:  29%|██▉       | 157/543 [00:06<00:10, 36.70it/s]
Profiling:  30%|███       | 164/543 [00:06<00:09, 40.14it/s]
Profiling:  32%|███▏      | 172/543 [00:06<00:08, 46.11it/s]
Profiling:  33%|███▎      | 181/543 [00:07<00:06, 53.21it/s]
Profiling:  35%|███▌      | 192/543 [00:07<00:05, 63.89it/s]
Profiling:  37%|███▋      | 201/543 [00:07<00:05, 68.37it/s]
Profiling:  39%|███▊      | 210/543 [00:07<00:04, 72.15it/s]
Profiling:  40%|████      | 219/543 [00:07<00:04, 75.13it/s]
Profiling:  42%|████▏     | 229/543 [00:07<00:03, 80.26it/s]
Profiling:  44%|████▍     | 241/543 [00:08<00:06, 44.79it/s]
Profiling:  46%|████▌     | 248/543 [00:08<00:06, 45.33it/s]
Profiling:  47%|████▋     | 257/543 [00:08<00:05, 51.73it/s]
Profiling:  49%|████▉     | 266/543 [00:08<00:04, 57.77it/s]
Profiling:  50%|█████     | 274/543 [00:08<00:04, 56.66it/s]
Profiling:  52%|█████▏    | 283/543 [00:08<00:04, 62.47it/s]
Profiling:  54%|█████▍    | 292/543 [00:08<00:03, 66.90it/s]
Profiling:  55%|█████▌    | 300/543 [00:08<00:03, 67.53it/s]
Profiling:  57%|█████▋    | 310/543 [00:09<00:03, 74.51it/s]
Profiling:  59%|█████▊    | 318/543 [00:09<00:05, 38.12it/s]
Profiling:  60%|██████    | 326/543 [00:09<00:04, 44.23it/s]
Profiling:  62%|██████▏   | 334/543 [00:09<00:04, 50.73it/s]
Profiling:  63%|██████▎   | 341/543 [00:09<00:03, 54.61it/s]
Profiling:  64%|██████▍   | 350/543 [00:09<00:03, 61.67it/s]
Profiling:  66%|██████▌   | 358/543 [00:10<00:02, 63.08it/s]
Profiling:  67%|██████▋   | 366/543 [00:10<00:02, 66.21it/s]
Profiling:  69%|██████▉   | 374/543 [00:10<00:02, 68.73it/s]
Profiling:  72%|███████▏  | 389/543 [00:10<00:01, 90.27it/s]
Profiling:  73%|███████▎  | 399/543 [00:10<00:03, 41.45it/s]
Profiling:  75%|███████▍  | 407/543 [00:11<00:02, 46.68it/s]
Profiling:  77%|███████▋  | 416/543 [00:11<00:02, 53.33it/s]
Profiling:  78%|███████▊  | 424/543 [00:11<00:02, 56.59it/s]
Profiling:  80%|███████▉  | 432/543 [00:11<00:01, 60.70it/s]
Profiling:  81%|████████  | 440/543 [00:11<00:01, 65.14it/s]
Profiling:  83%|████████▎ | 448/543 [00:11<00:01, 68.39it/s]
Profiling:  84%|████████▍ | 456/543 [00:11<00:01, 68.89it/s]
Profiling:  87%|████████▋ | 470/543 [00:11<00:00, 87.20it/s]
Profiling:  88%|████████▊ | 480/543 [00:16<00:09,  6.70it/s]
Profiling:  90%|████████▉ | 488/543 [00:16<00:06,  8.73it/s]
Profiling:  91%|█████████ | 495/543 [00:16<00:04, 11.07it/s]
Profiling:  93%|█████████▎| 504/543 [00:16<00:02, 15.08it/s]
Profiling:  94%|█████████▍| 512/543 [00:16<00:01, 19.19it/s]
Profiling:  96%|█████████▌| 519/543 [00:17<00:01, 23.42it/s]
Profiling:  97%|█████████▋| 528/543 [00:17<00:00, 30.39it/s]
Profiling:  99%|█████████▉| 537/543 [00:17<00:00, 37.77it/s]
Profiling: 100%|██████████| 543/543 [00:17<00:00, 30.63it/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
brucethemoose-yi-34b-200-6263-v1-mkmlizer: quantized model in 65.270s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Processed model brucethemoose/Yi-34B-200K-RPMerge in 174.439s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
brucethemoose-yi-34b-200-6263-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/tokenizer.model
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/added_tokens.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/special_tokens_map.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/tokenizer_config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/tokenizer.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/mkml_model.tensors
brucethemoose-yi-34b-200-6263-v1-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
brucethemoose-yi-34b-200-6263-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
brucethemoose-yi-34b-200-6263-v1-mkmlizer:   warnings.warn(
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
config.json:   0%|          | 0.00/1.05k [00:00<?, ?B/s]
config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 11.6MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
brucethemoose-yi-34b-200-6263-v1-mkmlizer:   warnings.warn(
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/234 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 2.67MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
vocab.json:   0%|          | 0.00/1.04M [00:00<?, ?B/s]
vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 46.9MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: 
tokenizer.json:   0%|          | 0.00/2.11M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 17.0MB/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 16.8MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
brucethemoose-yi-34b-200-6263-v1-mkmlizer:   warnings.warn(
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Saving duration: 0.231s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 6.956s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: creating bucket guanaco-reward-models
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Bucket 's3://guanaco-reward-models/' created
brucethemoose-yi-34b-200-6263-v1-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/tokenizer_config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/special_tokens_map.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/merges.txt
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/vocab.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/tokenizer.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/reward.tensors
Job brucethemoose-yi-34b-200-6263-v1-mkmlizer completed after 378.52s with status: succeeded
Stopping job with name brucethemoose-yi-34b-200-6263-v1-mkmlizer
Pipeline stage MKMLizer completed in 381.43s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.12s
Running pipeline stage ISVCDeployer
Creating inference service brucethemoose-yi-34b-200-6263-v1
Waiting for inference service brucethemoose-yi-34b-200-6263-v1 to be ready
Inference service brucethemoose-yi-34b-200-6263-v1 ready after 70.43993735313416s
Pipeline stage ISVCDeployer completed in 77.55s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5221145153045654s
Received healthy response to inference request in 1.8475291728973389s
Received healthy response to inference request in 1.9070124626159668s
Received healthy response to inference request in 1.9613807201385498s
Received healthy response to inference request in 1.7757952213287354s
5 requests
0 failed requests
5th percentile: 1.790142011642456
10th percentile: 1.8044888019561767
20th percentile: 1.8331823825836182
30th percentile: 1.8594258308410645
40th percentile: 1.8832191467285155
50th percentile: 1.9070124626159668
60th percentile: 1.928759765625
70th percentile: 1.9505070686340331
80th percentile: 2.073527479171753
90th percentile: 2.2978209972381594
95th percentile: 2.4099677562713624
99th percentile: 2.499685163497925
mean time: 2.002766418457031
Pipeline stage StressChecker completed in 11.07s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.05s
Running pipeline stage DaemonicSafetyScorer
Pipeline stage DaemonicSafetyScorer completed in 0.07s
Running M-Eval for topic stay_in_character
M-Eval Dataset for topic stay_in_character is loaded
brucethemoose-yi-34b-200_6263_v1 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of brucethemoose-yi-34b-200_6263_v1
Running pipeline stage ISVCDeleter
Checking if service brucethemoose-yi-34b-200-6263-v1 is running
Tearing down inference service brucethemoose-yi-34b-200-6263-v1
Toredown service brucethemoose-yi-34b-200-6263-v1
Pipeline stage ISVCDeleter completed in 3.95s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key brucethemoose-yi-34b-200-6263-v1/added_tokens.json from bucket guanaco-mkml-models
Deleting key brucethemoose-yi-34b-200-6263-v1/config.json from bucket guanaco-mkml-models
Deleting key brucethemoose-yi-34b-200-6263-v1/mkml_model.tensors from bucket guanaco-mkml-models
Deleting key brucethemoose-yi-34b-200-6263-v1/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key brucethemoose-yi-34b-200-6263-v1/tokenizer.json from bucket guanaco-mkml-models
Deleting key brucethemoose-yi-34b-200-6263-v1/tokenizer.model from bucket guanaco-mkml-models
Deleting key brucethemoose-yi-34b-200-6263-v1/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key brucethemoose-yi-34b-200-6263-v1_reward/config.json from bucket guanaco-reward-models
Deleting key brucethemoose-yi-34b-200-6263-v1_reward/merges.txt from bucket guanaco-reward-models
Deleting key brucethemoose-yi-34b-200-6263-v1_reward/reward.tensors from bucket guanaco-reward-models
Deleting key brucethemoose-yi-34b-200-6263-v1_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key brucethemoose-yi-34b-200-6263-v1_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key brucethemoose-yi-34b-200-6263-v1_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key brucethemoose-yi-34b-200-6263-v1_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 11.30s
brucethemoose-yi-34b-200_6263_v1 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics