submission_id: brucethemoose-yi-34b-200_6263_v1
developer_uid: brucethemoose
status: inactive
model_repo: brucethemoose/Yi-34B-200K-RPMerge
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 1.0, 'top_p': 0.5, 'top_k': 30, 'presence_penalty': 0.02, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
timestamp: 2024-03-21T20:07:51+00:00
model_name: brucethemoose-yi-34b-200_6263_v1
model_eval_status: success
safety_score: 0.93
entertaining: 6.7
stay_in_character: 8.56
user_preference: 7.16
double_thumbs_up: 620
thumbs_up: 1043
thumbs_down: 578
num_battles: 67547
num_wins: 33822
win_ratio: 0.5007180185648511
celo_rating: 1157.65
Resubmit model
Running pipeline stage MKMLizer
Starting job with name brucethemoose-yi-34b-200-6263-v1-mkmlizer
Waiting for job on brucethemoose-yi-34b-200-6263-v1-mkmlizer to finish
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ _____ __ __ ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ /___/ ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ Version: 0.6.11 ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ The license key for the current software has been verified as ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ belonging to: ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ Chai Research Corp. ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ Expiration: 2024-04-15 23:59:59 ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ║ ║
brucethemoose-yi-34b-200-6263-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
brucethemoose-yi-34b-200-6263-v1-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 19.4MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: README.md: 0%| | 0.00/8.37k [00:00<?, ?B/s] README.md: 100%|██████████| 8.37k/8.37k [00:00<00:00, 73.4MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: config.json: 0%| | 0.00/737 [00:00<?, ?B/s] config.json: 100%|██████████| 737/737 [00:00<00:00, 12.2MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: mergekit_config.yml: 0%| | 0.00/1.04k [00:00<?, ?B/s] mergekit_config.yml: 100%|██████████| 1.04k/1.04k [00:00<00:00, 8.34MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model-00001-of-00007.safetensors: 0%| | 0.00/9.92G [00:00<?, ?B/s] model-00001-of-00007.safetensors: 0%| | 10.5M/9.92G [00:01<23:36, 6.99MB/s] model-00001-of-00007.safetensors: 0%| | 21.0M/9.92G [00:02<16:06, 10.2MB/s] model-00001-of-00007.safetensors: 0%| | 31.5M/9.92G [00:02<10:55, 15.1MB/s] model-00001-of-00007.safetensors: 0%| | 41.9M/9.92G [00:02<08:13, 20.0MB/s] model-00001-of-00007.safetensors: 1%| | 73.4M/9.92G [00:02<03:35, 45.6MB/s] model-00001-of-00007.safetensors: 1%| | 105M/9.92G [00:03<02:10, 74.9MB/s] model-00001-of-00007.safetensors: 1%|▏ | 136M/9.92G [00:03<01:34, 103MB/s] model-00001-of-00007.safetensors: 3%|▎ | 273M/9.92G [00:03<00:31, 302MB/s] model-00001-of-00007.safetensors: 4%|▍ | 419M/9.92G [00:03<00:20, 471MB/s] model-00001-of-00007.safetensors: 5%|▌ | 545M/9.92G [00:03<00:15, 623MB/s] model-00001-of-00007.safetensors: 11%|█ | 1.10G/9.92G [00:03<00:05, 1.53GB/s] model-00001-of-00007.safetensors: 13%|█▎ | 1.28G/9.92G [00:04<00:13, 625MB/s] model-00001-of-00007.safetensors: 14%|█▍ | 1.42G/9.92G [00:04<00:12, 676MB/s] model-00001-of-00007.safetensors: 16%|█▌ | 1.60G/9.92G [00:04<00:09, 832MB/s] model-00001-of-00007.safetensors: 18%|█▊ | 1.76G/9.92G [00:04<00:08, 913MB/s] model-00001-of-00007.safetensors: 19%|█▉ | 1.90G/9.92G [00:04<00:08, 938MB/s] model-00001-of-00007.safetensors: 20%|██ | 2.02G/9.92G [00:05<00:07, 988MB/s] model-00001-of-00007.safetensors: 22%|██▏ | 2.15G/9.92G [00:05<00:07, 1.01GB/s] model-00001-of-00007.safetensors: 24%|██▎ | 2.35G/9.92G [00:05<00:08, 931MB/s] model-00001-of-00007.safetensors: 25%|██▍ | 2.46G/9.92G [00:05<00:11, 665MB/s] model-00001-of-00007.safetensors: 26%|██▌ | 2.56G/9.92G [00:05<00:10, 671MB/s] model-00001-of-00007.safetensors: 28%|██▊ | 2.74G/9.92G [00:06<00:08, 861MB/s] model-00001-of-00007.safetensors: 30%|██▉ | 2.93G/9.92G [00:06<00:06, 1.06GB/s] model-00001-of-00007.safetensors: 32%|███▏ | 3.14G/9.92G [00:06<00:05, 1.28GB/s] model-00001-of-00007.safetensors: 34%|███▍ | 3.36G/9.92G [00:06<00:04, 1.46GB/s] model-00001-of-00007.safetensors: 36%|███▌ | 3.52G/9.92G [00:07<00:10, 614MB/s] model-00001-of-00007.safetensors: 37%|███▋ | 3.65G/9.92G [00:07<00:10, 590MB/s] model-00001-of-00007.safetensors: 38%|███▊ | 3.75G/9.92G [00:07<00:09, 630MB/s] model-00001-of-00007.safetensors: 40%|████ | 3.97G/9.92G [00:07<00:06, 870MB/s] model-00001-of-00007.safetensors: 42%|████▏ | 4.13G/9.92G [00:07<00:05, 984MB/s] model-00001-of-00007.safetensors: 45%|████▍ | 4.44G/9.92G [00:07<00:04, 1.35GB/s] model-00001-of-00007.safetensors: 47%|████▋ | 4.61G/9.92G [00:08<00:07, 713MB/s] model-00001-of-00007.safetensors: 48%|████▊ | 4.75G/9.92G [00:08<00:07, 690MB/s] model-00001-of-00007.safetensors: 49%|████▉ | 4.87G/9.92G [00:08<00:08, 623MB/s] model-00001-of-00007.safetensors: 50%|█████ | 5.00G/9.92G [00:08<00:06, 727MB/s] model-00001-of-00007.safetensors: 52%|█████▏ | 5.18G/9.92G [00:08<00:05, 901MB/s] model-00001-of-00007.safetensors: 55%|█████▍ | 5.41G/9.92G [00:09<00:03, 1.17GB/s] model-00001-of-00007.safetensors: 56%|█████▌ | 5.57G/9.92G [00:09<00:04, 902MB/s] model-00001-of-00007.safetensors: 57%|█████▋ | 5.69G/9.92G [00:09<00:06, 696MB/s] model-00001-of-00007.safetensors: 58%|█████▊ | 5.80G/9.92G [00:09<00:05, 690MB/s] model-00001-of-00007.safetensors: 59%|█████▉ | 5.89G/9.92G [00:10<00:06, 616MB/s] model-00001-of-00007.safetensors: 60%|██████ | 5.98G/9.92G [00:10<00:06, 635MB/s] model-00001-of-00007.safetensors: 61%|██████▏ | 6.09G/9.92G [00:10<00:05, 733MB/s] model-00001-of-00007.safetensors: 63%|██████▎ | 6.24G/9.92G [00:10<00:04, 877MB/s] model-00001-of-00007.safetensors: 64%|██████▍ | 6.38G/9.92G [00:10<00:03, 971MB/s] model-00001-of-00007.safetensors: 66%|██████▌ | 6.52G/9.92G [00:10<00:03, 1.05GB/s] model-00001-of-00007.safetensors: 67%|██████▋ | 6.64G/9.92G [00:10<00:03, 970MB/s] model-00001-of-00007.safetensors: 68%|██████▊ | 6.74G/9.92G [00:10<00:04, 752MB/s] model-00001-of-00007.safetensors: 69%|██████▉ | 6.84G/9.92G [00:11<00:03, 784MB/s] model-00001-of-00007.safetensors: 70%|██████▉ | 6.93G/9.92G [00:11<00:05, 563MB/s] model-00001-of-00007.safetensors: 71%|███████ | 7.03G/9.92G [00:11<00:04, 631MB/s] model-00001-of-00007.safetensors: 72%|███████▏ | 7.11G/9.92G [00:11<00:04, 570MB/s] model-00001-of-00007.safetensors: 73%|███████▎ | 7.26G/9.92G [00:11<00:03, 746MB/s] model-00001-of-00007.safetensors: 75%|███████▌ | 7.44G/9.92G [00:11<00:02, 984MB/s] model-00001-of-00007.safetensors: 77%|███████▋ | 7.61G/9.92G [00:11<00:02, 1.12GB/s] model-00001-of-00007.safetensors: 78%|███████▊ | 7.75G/9.92G [00:12<00:02, 981MB/s] model-00001-of-00007.safetensors: 79%|███████▉ | 7.86G/9.92G [00:12<00:02, 944MB/s] model-00001-of-00007.safetensors: 80%|████████ | 7.97G/9.92G [00:12<00:02, 702MB/s] model-00001-of-00007.safetensors: 81%|████████▏ | 8.06G/9.92G [00:12<00:02, 708MB/s] model-00001-of-00007.safetensors: 82%|████████▏ | 8.15G/9.92G [00:12<00:02, 636MB/s] model-00001-of-00007.safetensors: 83%|████████▎ | 8.22G/9.92G [00:13<00:02, 602MB/s] model-00001-of-00007.safetensors: 84%|████████▍ | 8.38G/9.92G [00:13<00:01, 776MB/s] model-00001-of-00007.safetensors: 86%|████████▌ | 8.52G/9.92G [00:13<00:01, 927MB/s] model-00001-of-00007.safetensors: 88%|████████▊ | 8.69G/9.92G [00:13<00:01, 1.07GB/s] model-00001-of-00007.safetensors: 89%|████████▉ | 8.81G/9.92G [00:13<00:01, 1.01GB/s] model-00001-of-00007.safetensors: 90%|█████████ | 8.93G/9.92G [00:13<00:00, 1.05GB/s] model-00001-of-00007.safetensors: 91%|█████████▏| 9.05G/9.92G [00:13<00:01, 668MB/s] model-00001-of-00007.safetensors: 92%|█████████▏| 9.14G/9.92G [00:14<00:01, 715MB/s] model-00001-of-00007.safetensors: 93%|█████████▎| 9.24G/9.92G [00:14<00:00, 733MB/s] model-00001-of-00007.safetensors: 94%|█████████▍| 9.34G/9.92G [00:14<00:00, 803MB/s] model-00001-of-00007.safetensors: 96%|█████████▌| 9.48G/9.92G [00:14<00:00, 916MB/s] model-00001-of-00007.safetensors: 97%|█████████▋| 9.64G/9.92G [00:14<00:00, 1.10GB/s] model-00001-of-00007.safetensors: 100%|█████████▉| 9.91G/9.92G [00:14<00:00, 1.39GB/s] model-00001-of-00007.safetensors: 100%|█████████▉| 9.92G/9.92G [00:14<00:00, 678MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model-00002-of-00007.safetensors: 0%| | 0.00/9.91G [00:00<?, ?B/s] model-00002-of-00007.safetensors: 0%| | 10.5M/9.91G [00:02<37:03, 4.45MB/s] model-00002-of-00007.safetensors: 0%| | 31.5M/9.91G [00:02<10:22, 15.9MB/s] model-00002-of-00007.safetensors: 1%| | 62.9M/9.91G [00:02<04:19, 38.0MB/s] model-00002-of-00007.safetensors: 1%| | 83.9M/9.91G [00:02<03:00, 54.4MB/s] model-00002-of-00007.safetensors: 1%| | 105M/9.91G [00:02<02:28, 65.9MB/s] model-00002-of-00007.safetensors: 2%|▏ | 157M/9.91G [00:02<01:17, 125MB/s] model-00002-of-00007.safetensors: 3%|▎ | 315M/9.91G [00:03<00:27, 354MB/s] model-00002-of-00007.safetensors: 4%|▍ | 388M/9.91G [00:03<00:22, 418MB/s] model-00002-of-00007.safetensors: 6%|▋ | 640M/9.91G [00:03<00:10, 851MB/s] model-00002-of-00007.safetensors: 11%|█▏ | 1.13G/9.91G [00:03<00:08, 996MB/s] model-00002-of-00007.safetensors: 13%|█▎ | 1.26G/9.91G [00:04<00:14, 613MB/s] model-00002-of-00007.safetensors: 14%|█▎ | 1.35G/9.91G [00:04<00:13, 645MB/s] model-00002-of-00007.safetensors: 15%|█▌ | 1.52G/9.91G [00:04<00:11, 708MB/s] model-00002-of-00007.safetensors: 16%|█▋ | 1.61G/9.91G [00:04<00:11, 697MB/s] model-00002-of-00007.safetensors: 17%|█▋ | 1.70G/9.91G [00:04<00:11, 686MB/s] model-00002-of-00007.safetensors: 18%|█▊ | 1.79G/9.91G [00:04<00:11, 733MB/s] model-00002-of-00007.safetensors: 19%|█▉ | 1.93G/9.91G [00:05<00:09, 822MB/s] model-00002-of-00007.safetensors: 21%|██ | 2.04G/9.91G [00:05<00:08, 892MB/s] model-00002-of-00007.safetensors: 22%|██▏ | 2.16G/9.91G [00:05<00:08, 955MB/s] model-00002-of-00007.safetensors: 26%|██▌ | 2.56G/9.91G [00:05<00:04, 1.73GB/s] model-00002-of-00007.safetensors: 28%|██▊ | 2.81G/9.91G [00:05<00:03, 1.83GB/s] model-00002-of-00007.safetensors: 30%|███ | 3.01G/9.91G [00:06<00:09, 756MB/s] model-00002-of-00007.safetensors: 32%|███▏ | 3.16G/9.91G [00:06<00:11, 584MB/s] model-00002-of-00007.safetensors: 33%|███▎ | 3.29G/9.91G [00:06<00:09, 669MB/s] model-00002-of-00007.safetensors: 35%|███▍ | 3.44G/9.91G [00:06<00:08, 773MB/s] model-00002-of-00007.safetensors: 37%|███▋ | 3.62G/9.91G [00:06<00:06, 938MB/s] model-00002-of-00007.safetensors: 40%|███▉ | 3.94G/9.91G [00:07<00:04, 1.36GB/s] model-00002-of-00007.safetensors: 42%|████▏ | 4.13G/9.91G [00:07<00:07, 801MB/s] model-00002-of-00007.safetensors: 43%|████▎ | 4.28G/9.91G [00:07<00:09, 607MB/s] model-00002-of-00007.safetensors: 44%|████▍ | 4.39G/9.91G [00:08<00:09, 597MB/s] model-00002-of-00007.safetensors: 46%|████▌ | 4.51G/9.91G [00:08<00:08, 646MB/s] model-00002-of-00007.safetensors: 47%|████▋ | 4.63G/9.91G [00:08<00:07, 737MB/s] model-00002-of-00007.safetensors: 49%|████▉ | 4.88G/9.91G [00:08<00:04, 1.01GB/s] model-00002-of-00007.safetensors: 52%|█████▏ | 5.13G/9.91G [00:08<00:03, 1.22GB/s] model-00002-of-00007.safetensors: 53%|█████▎ | 5.28G/9.91G [00:09<00:06, 689MB/s] model-00002-of-00007.safetensors: 54%|█████▍ | 5.40G/9.91G [00:09<00:07, 624MB/s] model-00002-of-00007.safetensors: 56%|█████▌ | 5.51G/9.91G [00:09<00:06, 649MB/s] model-00002-of-00007.safetensors: 57%|█████▋ | 5.60G/9.91G [00:09<00:06, 637MB/s] model-00002-of-00007.safetensors: 58%|█████▊ | 5.79G/9.91G [00:09<00:04, 851MB/s] model-00002-of-00007.safetensors: 60%|█████▉ | 5.90G/9.91G [00:09<00:04, 887MB/s] model-00002-of-00007.safetensors: 63%|██████▎ | 6.22G/9.91G [00:10<00:02, 1.32GB/s] model-00002-of-00007.safetensors: 64%|██████▍ | 6.38G/9.91G [00:10<00:03, 938MB/s] model-00002-of-00007.safetensors: 66%|██████▌ | 6.50G/9.91G [00:10<00:04, 740MB/s] model-00002-of-00007.safetensors: 67%|██████▋ | 6.61G/9.91G [00:10<00:05, 656MB/s] model-00002-of-00007.safetensors: 68%|██████▊ | 6.70G/9.91G [00:11<00:05, 578MB/s] model-00002-of-00007.safetensors: 69%|██████▉ | 6.84G/9.91G [00:11<00:04, 701MB/s] model-00002-of-00007.safetensors: 70%|██████▉ | 6.93G/9.91G [00:11<00:04, 743MB/s] model-00002-of-00007.safetensors: 72%|███████▏ | 7.11G/9.91G [00:11<00:03, 926MB/s] model-00002-of-00007.safetensors: 73%|███████▎ | 7.28G/9.91G [00:11<00:02, 1.05GB/s] model-00002-of-00007.safetensors: 75%|███████▍ | 7.40G/9.91G [00:11<00:02, 1.09GB/s] model-00002-of-00007.safetensors: 76%|███████▌ | 7.53G/9.91G [00:12<00:03, 699MB/s] model-00002-of-00007.safetensors: 77%|███████▋ | 7.63G/9.91G [00:12<00:03, 662MB/s] model-00002-of-00007.safetensors: 78%|███████▊ | 7.72G/9.91G [00:12<00:03, 553MB/s] model-00002-of-00007.safetensors: 79%|███████▊ | 7.80G/9.91G [00:12<00:03, 598MB/s] model-00002-of-00007.safetensors: 80%|███████▉ | 7.91G/9.91G [00:12<00:02, 677MB/s] model-00002-of-00007.safetensors: 81%|████████ | 7.99G/9.91G [00:12<00:02, 652MB/s] model-00002-of-00007.safetensors: 83%|████████▎ | 8.19G/9.91G [00:12<00:01, 940MB/s] model-00002-of-00007.safetensors: 84%|████████▍ | 8.34G/9.91G [00:12<00:01, 1.05GB/s] model-00002-of-00007.safetensors: 85%|████████▌ | 8.46G/9.91G [00:13<00:01, 1.06GB/s] model-00002-of-00007.safetensors: 87%|████████▋ | 8.59G/9.91G [00:13<00:01, 786MB/s] model-00002-of-00007.safetensors: 88%|████████▊ | 8.69G/9.91G [00:13<00:01, 771MB/s] model-00002-of-00007.safetensors: 89%|████████▊ | 8.79G/9.91G [00:13<00:01, 604MB/s] model-00002-of-00007.safetensors: 89%|████████▉ | 8.86G/9.91G [00:13<00:01, 580MB/s] model-00002-of-00007.safetensors: 91%|█████████ | 8.98G/9.91G [00:14<00:01, 675MB/s] model-00002-of-00007.safetensors: 91%|█████████▏| 9.06G/9.91G [00:14<00:01, 683MB/s] model-00002-of-00007.safetensors: 94%|█████████▎| 9.28G/9.91G [00:14<00:00, 1.03GB/s] model-00002-of-00007.safetensors: 96%|█████████▌| 9.47G/9.91G [00:14<00:00, 1.21GB/s] model-00002-of-00007.safetensors: 97%|█████████▋| 9.64G/9.91G [00:14<00:00, 1.32GB/s] model-00002-of-00007.safetensors: 99%|█████████▉| 9.86G/9.91G [00:14<00:00, 1.44GB/s] model-00002-of-00007.safetensors: 100%|█████████▉| 9.91G/9.91G [00:15<00:00, 655MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model-00003-of-00007.safetensors: 0%| | 0.00/9.98G [00:00<?, ?B/s] model-00003-of-00007.safetensors: 0%| | 10.5M/9.98G [00:01<30:39, 5.42MB/s] model-00003-of-00007.safetensors: 0%| | 31.5M/9.98G [00:02<11:07, 14.9MB/s] model-00003-of-00007.safetensors: 0%| | 41.9M/9.98G [00:02<08:28, 19.5MB/s] model-00003-of-00007.safetensors: 1%| | 52.4M/9.98G [00:02<06:15, 26.5MB/s] model-00003-of-00007.safetensors: 1%| | 105M/9.98G [00:02<02:04, 79.3MB/s] model-00003-of-00007.safetensors: 3%|▎ | 252M/9.98G [00:03<00:37, 261MB/s] model-00003-of-00007.safetensors: 4%|▎ | 357M/9.98G [00:03<00:27, 356MB/s] model-00003-of-00007.safetensors: 4%|▍ | 440M/9.98G [00:03<00:22, 434MB/s] model-00003-of-00007.safetensors: 10%|▉ | 986M/9.98G [00:03<00:06, 1.41GB/s] model-00003-of-00007.safetensors: 12%|█▏ | 1.21G/9.98G [00:04<00:14, 593MB/s] model-00003-of-00007.safetensors: 14%|█▍ | 1.37G/9.98G [00:04<00:16, 522MB/s] model-00003-of-00007.safetensors: 15%|█▌ | 1.50G/9.98G [00:04<00:15, 541MB/s] model-00003-of-00007.safetensors: 17%|█▋ | 1.67G/9.98G [00:04<00:12, 670MB/s] model-00003-of-00007.safetensors: 18%|█▊ | 1.81G/9.98G [00:05<00:10, 776MB/s] model-00003-of-00007.safetensors: 20%|█▉ | 1.98G/9.98G [00:05<00:08, 925MB/s] model-00003-of-00007.safetensors: 22%|██▏ | 2.20G/9.98G [00:05<00:07, 1.07GB/s] model-00003-of-00007.safetensors: 24%|██▎ | 2.35G/9.98G [00:05<00:09, 824MB/s] model-00003-of-00007.safetensors: 25%|██▍ | 2.46G/9.98G [00:06<00:14, 517MB/s] model-00003-of-00007.safetensors: 26%|██▌ | 2.56G/9.98G [00:06<00:15, 469MB/s] model-00003-of-00007.safetensors: 26%|██▋ | 2.64G/9.98G [00:06<00:14, 504MB/s] model-00003-of-00007.safetensors: 28%|██▊ | 2.76G/9.98G [00:06<00:12, 595MB/s] model-00003-of-00007.safetensors: 29%|██▉ | 2.88G/9.98G [00:06<00:10, 700MB/s] model-00003-of-00007.safetensors: 30%|███ | 3.02G/9.98G [00:06<00:08, 807MB/s] model-00003-of-00007.safetensors: 32%|███▏ | 3.22G/9.98G [00:07<00:06, 973MB/s] model-00003-of-00007.safetensors: 33%|███▎ | 3.33G/9.98G [00:07<00:06, 954MB/s] model-00003-of-00007.safetensors: 35%|███▍ | 3.45G/9.98G [00:07<00:10, 653MB/s] model-00003-of-00007.safetensors: 36%|███▌ | 3.54G/9.98G [00:07<00:14, 443MB/s] model-00003-of-00007.safetensors: 36%|███▌ | 3.62G/9.98G [00:08<00:15, 405MB/s] model-00003-of-00007.safetensors: 37%|███▋ | 3.70G/9.98G [00:08<00:14, 439MB/s] model-00003-of-00007.safetensors: 38%|███▊ | 3.80G/9.98G [00:08<00:12, 501MB/s] model-00003-of-00007.safetensors: 40%|████ | 4.02G/9.98G [00:08<00:07, 801MB/s] model-00003-of-00007.safetensors: 42%|████▏ | 4.19G/9.98G [00:08<00:05, 999MB/s] model-00003-of-00007.safetensors: 43%|████▎ | 4.33G/9.98G [00:08<00:05, 971MB/s] model-00003-of-00007.safetensors: 45%|████▍ | 4.46G/9.98G [00:08<00:06, 823MB/s] model-00003-of-00007.safetensors: 46%|████▌ | 4.56G/9.98G [00:09<00:10, 522MB/s] model-00003-of-00007.safetensors: 47%|████▋ | 4.65G/9.98G [00:09<00:13, 401MB/s] model-00003-of-00007.safetensors: 47%|████▋ | 4.72G/9.98G [00:09<00:12, 437MB/s] model-00003-of-00007.safetensors: 48%|████▊ | 4.78G/9.98G [00:10<00:12, 410MB/s] model-00003-of-00007.safetensors: 49%|████▊ | 4.84G/9.98G [00:10<00:11, 443MB/s] model-00003-of-00007.safetensors: 51%|█████ | 5.05G/9.98G [00:10<00:06, 749MB/s] model-00003-of-00007.safetensors: 52%|█████▏ | 5.18G/9.98G [00:10<00:05, 854MB/s] model-00003-of-00007.safetensors: 54%|█████▎ | 5.36G/9.98G [00:10<00:04, 1.06GB/s] model-00003-of-00007.safetensors: 55%|█████▌ | 5.49G/9.98G [00:10<00:04, 1.08GB/s] model-00003-of-00007.safetensors: 56%|█████▋ | 5.62G/9.98G [00:10<00:06, 688MB/s] model-00003-of-00007.safetensors: 57%|█████▋ | 5.73G/9.98G [00:11<00:07, 537MB/s] model-00003-of-00007.safetensors: 58%|█████▊ | 5.81G/9.98G [00:11<00:07, 574MB/s] model-00003-of-00007.safetensors: 59%|█████▉ | 5.89G/9.98G [00:11<00:08, 474MB/s] model-00003-of-00007.safetensors: 60%|██████ | 6.01G/9.98G [00:11<00:07, 568MB/s] model-00003-of-00007.safetensors: 61%|██████ | 6.08G/9.98G [00:11<00:06, 570MB/s] model-00003-of-00007.safetensors: 62%|██████▏ | 6.20G/9.98G [00:12<00:05, 686MB/s] model-00003-of-00007.safetensors: 63%|██████▎ | 6.31G/9.98G [00:12<00:04, 790MB/s] model-00003-of-00007.safetensors: 65%|██████▍ | 6.48G/9.98G [00:12<00:03, 980MB/s] model-00003-of-00007.safetensors: 66%|██████▌ | 6.60G/9.98G [00:12<00:04, 811MB/s] model-00003-of-00007.safetensors: 67%|██████▋ | 6.69G/9.98G [00:12<00:05, 583MB/s] model-00003-of-00007.safetensors: 68%|██████▊ | 6.77G/9.98G [00:12<00:06, 526MB/s] model-00003-of-00007.safetensors: 69%|██████▊ | 6.85G/9.98G [00:13<00:05, 538MB/s] model-00003-of-00007.safetensors: 69%|██████▉ | 6.91G/9.98G [00:13<00:06, 477MB/s] model-00003-of-00007.safetensors: 70%|███████ | 7.03G/9.98G [00:13<00:04, 602MB/s] model-00003-of-00007.safetensors: 71%|███████ | 7.10G/9.98G [00:13<00:05, 528MB/s] model-00003-of-00007.safetensors: 72%|███████▏ | 7.20G/9.98G [00:13<00:04, 623MB/s] model-00003-of-00007.safetensors: 74%|███████▎ | 7.34G/9.98G [00:13<00:03, 786MB/s] model-00003-of-00007.safetensors: 75%|███████▍ | 7.49G/9.98G [00:13<00:02, 928MB/s] model-00003-of-00007.safetensors: 76%|███████▌ | 7.59G/9.98G [00:13<00:02, 951MB/s] model-00003-of-00007.safetensors: 77%|███████▋ | 7.70G/9.98G [00:14<00:03, 726MB/s] model-00003-of-00007.safetensors: 78%|███████▊ | 7.79G/9.98G [00:14<00:03, 670MB/s] model-00003-of-00007.safetensors: 79%|███████▉ | 7.87G/9.98G [00:14<00:03, 581MB/s] model-00003-of-00007.safetensors: 80%|███████▉ | 7.95G/9.98G [00:14<00:03, 513MB/s] model-00003-of-00007.safetensors: 80%|████████ | 8.01G/9.98G [00:14<00:03, 536MB/s] model-00003-of-00007.safetensors: 81%|████████▏ | 8.13G/9.98G [00:15<00:02, 650MB/s] model-00003-of-00007.safetensors: 82%|████████▏ | 8.20G/9.98G [00:15<00:03, 530MB/s] model-00003-of-00007.safetensors: 83%|████████▎ | 8.29G/9.98G [00:15<00:02, 616MB/s] model-00003-of-00007.safetensors: 84%|████████▍ | 8.41G/9.98G [00:15<00:02, 739MB/s] model-00003-of-00007.safetensors: 86%|████████▌ | 8.59G/9.98G [00:15<00:01, 976MB/s] model-00003-of-00007.safetensors: 87%|████████▋ | 8.71G/9.98G [00:15<00:01, 948MB/s] model-00003-of-00007.safetensors: 88%|████████▊ | 8.82G/9.98G [00:15<00:01, 674MB/s] model-00003-of-00007.safetensors: 89%|████████▉ | 8.90G/9.98G [00:16<00:01, 581MB/s] model-00003-of-00007.safetensors: 90%|█████████ | 9.00G/9.98G [00:16<00:01, 629MB/s] model-00003-of-00007.safetensors: 91%|█████████ | 9.07G/9.98G [00:16<00:01, 576MB/s] model-00003-of-00007.safetensors: 92%|█████████▏| 9.15G/9.98G [00:16<00:01, 618MB/s] model-00003-of-00007.safetensors: 92%|█████████▏| 9.23G/9.98G [00:16<00:01, 585MB/s] model-00003-of-00007.safetensors: 93%|█████████▎| 9.32G/9.98G [00:16<00:01, 622MB/s] model-00003-of-00007.safetensors: 95%|█████████▍| 9.47G/9.98G [00:16<00:00, 798MB/s] model-00003-of-00007.safetensors: 96%|█████████▋| 9.62G/9.98G [00:17<00:00, 954MB/s] model-00003-of-00007.safetensors: 99%|█████████▉| 9.87G/9.98G [00:17<00:00, 1.35GB/s] model-00003-of-00007.safetensors: 100%|█████████▉| 9.98G/9.98G [00:17<00:00, 580MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model-00004-of-00007.safetensors: 0%| | 0.00/9.81G [00:00<?, ?B/s] model-00004-of-00007.safetensors: 0%| | 10.5M/9.81G [00:00<09:14, 17.7MB/s] model-00004-of-00007.safetensors: 0%| | 21.0M/9.81G [00:02<20:25, 7.99MB/s] model-00004-of-00007.safetensors: 0%| | 31.5M/9.81G [00:02<13:06, 12.4MB/s] model-00004-of-00007.safetensors: 1%| | 73.4M/9.81G [00:02<03:54, 41.4MB/s] model-00004-of-00007.safetensors: 1%|▏ | 136M/9.81G [00:02<01:49, 88.2MB/s] model-00004-of-00007.safetensors: 3%|▎ | 252M/9.81G [00:03<00:53, 179MB/s] model-00004-of-00007.safetensors: 4%|▍ | 409M/9.81G [00:03<00:27, 346MB/s] model-00004-of-00007.safetensors: 11%|█ | 1.08G/9.81G [00:03<00:07, 1.24GB/s] model-00004-of-00007.safetensors: 13%|█▎ | 1.32G/9.81G [00:04<00:15, 561MB/s] model-00004-of-00007.safetensors: 16%|█▌ | 1.55G/9.81G [00:04<00:11, 704MB/s] model-00004-of-00007.safetensors: 18%|█▊ | 1.74G/9.81G [00:04<00:11, 674MB/s] model-00004-of-00007.safetensors: 19%|█▉ | 1.89G/9.81G [00:05<00:11, 684MB/s] model-00004-of-00007.safetensors: 21%|██ | 2.01G/9.81G [00:05<00:10, 756MB/s] model-00004-of-00007.safetensors: 23%|██▎ | 2.24G/9.81G [00:05<00:07, 987MB/s] model-00004-of-00007.safetensors: 27%|██▋ | 2.65G/9.81G [00:05<00:04, 1.50GB/s] model-00004-of-00007.safetensors: 29%|██▉ | 2.87G/9.81G [00:05<00:06, 1.04GB/s] model-00004-of-00007.safetensors: 31%|███ | 3.04G/9.81G [00:06<00:08, 756MB/s] model-00004-of-00007.safetensors: 32%|███▏ | 3.18G/9.81G [00:06<00:09, 721MB/s] model-00004-of-00007.safetensors: 34%|███▎ | 3.29G/9.81G [00:06<00:08, 770MB/s] model-00004-of-00007.safetensors: 35%|███▌ | 3.47G/9.81G [00:06<00:06, 928MB/s] model-00004-of-00007.safetensors: 38%|███▊ | 3.69G/9.81G [00:06<00:05, 1.14GB/s] model-00004-of-00007.safetensors: 39%|███▉ | 3.85G/9.81G [00:06<00:04, 1.22GB/s] model-00004-of-00007.safetensors: 41%|████ | 4.01G/9.81G [00:07<00:07, 766MB/s] model-00004-of-00007.safetensors: 42%|████▏ | 4.13G/9.81G [00:07<00:08, 649MB/s] model-00004-of-00007.safetensors: 43%|████▎ | 4.23G/9.81G [00:07<00:08, 622MB/s] model-00004-of-00007.safetensors: 44%|████▍ | 4.31G/9.81G [00:07<00:08, 649MB/s] model-00004-of-00007.safetensors: 45%|████▌ | 4.44G/9.81G [00:07<00:07, 760MB/s] model-00004-of-00007.safetensors: 47%|████▋ | 4.62G/9.81G [00:08<00:05, 967MB/s] model-00004-of-00007.safetensors: 50%|████▉ | 4.89G/9.81G [00:08<00:03, 1.33GB/s] model-00004-of-00007.safetensors: 52%|█████▏ | 5.05G/9.81G [00:08<00:05, 923MB/s] model-00004-of-00007.safetensors: 53%|█████▎ | 5.19G/9.81G [00:08<00:05, 837MB/s] model-00004-of-00007.safetensors: 54%|█████▍ | 5.31G/9.81G [00:08<00:06, 676MB/s] model-00004-of-00007.safetensors: 55%|█████▌ | 5.40G/9.81G [00:09<00:06, 646MB/s] model-00004-of-00007.safetensors: 57%|█████▋ | 5.55G/9.81G [00:09<00:05, 780MB/s] model-00004-of-00007.safetensors: 58%|█████▊ | 5.69G/9.81G [00:09<00:04, 905MB/s] model-00004-of-00007.safetensors: 60%|██████ | 5.92G/9.81G [00:09<00:03, 1.16GB/s] model-00004-of-00007.safetensors: 62%|██████▏ | 6.06G/9.81G [00:09<00:03, 958MB/s] model-00004-of-00007.safetensors: 63%|██████▎ | 6.18G/9.81G [00:09<00:03, 935MB/s] model-00004-of-00007.safetensors: 64%|██████▍ | 6.29G/9.81G [00:10<00:04, 745MB/s] model-00004-of-00007.safetensors: 65%|██████▌ | 6.39G/9.81G [00:10<00:05, 657MB/s] model-00004-of-00007.safetensors: 66%|██████▌ | 6.47G/9.81G [00:10<00:05, 608MB/s] model-00004-of-00007.safetensors: 67%|██████▋ | 6.59G/9.81G [00:10<00:04, 697MB/s] model-00004-of-00007.safetensors: 69%|██████▉ | 6.76G/9.81G [00:10<00:03, 922MB/s] model-00004-of-00007.safetensors: 70%|███████ | 6.89G/9.81G [00:10<00:02, 973MB/s] model-00004-of-00007.safetensors: 72%|███████▏ | 7.01G/9.81G [00:10<00:02, 1.04GB/s] model-00004-of-00007.safetensors: 73%|███████▎ | 7.14G/9.81G [00:10<00:02, 1.09GB/s] model-00004-of-00007.safetensors: 74%|███████▍ | 7.27G/9.81G [00:11<00:03, 846MB/s] model-00004-of-00007.safetensors: 75%|███████▌ | 7.37G/9.81G [00:11<00:02, 823MB/s] model-00004-of-00007.safetensors: 76%|███████▌ | 7.47G/9.81G [00:11<00:02, 796MB/s] model-00004-of-00007.safetensors: 77%|███████▋ | 7.56G/9.81G [00:11<00:03, 704MB/s] model-00004-of-00007.safetensors: 78%|███████▊ | 7.64G/9.81G [00:11<00:03, 682MB/s] model-00004-of-00007.safetensors: 80%|███████▉ | 7.84G/9.81G [00:11<00:02, 960MB/s] model-00004-of-00007.safetensors: 81%|████████ | 7.96G/9.81G [00:12<00:01, 1.00GB/s] model-00004-of-00007.safetensors: 82%|████████▏ | 8.07G/9.81G [00:12<00:01, 988MB/s] model-00004-of-00007.safetensors: 83%|████████▎ | 8.18G/9.81G [00:12<00:01, 910MB/s] model-00004-of-00007.safetensors: 84%|████████▍ | 8.28G/9.81G [00:12<00:01, 921MB/s] model-00004-of-00007.safetensors: 86%|████████▌ | 8.40G/9.81G [00:12<00:01, 933MB/s] model-00004-of-00007.safetensors: 87%|████████▋ | 8.50G/9.81G [00:12<00:01, 722MB/s] model-00004-of-00007.safetensors: 88%|████████▊ | 8.59G/9.81G [00:12<00:01, 664MB/s] model-00004-of-00007.safetensors: 88%|████████▊ | 8.66G/9.81G [00:13<00:01, 652MB/s] model-00004-of-00007.safetensors: 89%|████████▉ | 8.78G/9.81G [00:13<00:01, 749MB/s] model-00004-of-00007.safetensors: 91%|█████████ | 8.93G/9.81G [00:13<00:00, 939MB/s] model-00004-of-00007.safetensors: 93%|█████████▎| 9.10G/9.81G [00:13<00:00, 1.13GB/s] model-00004-of-00007.safetensors: 94%|█████████▍| 9.24G/9.81G [00:13<00:00, 1.15GB/s] model-00004-of-00007.safetensors: 96%|█████████▌| 9.43G/9.81G [00:13<00:00, 1.33GB/s] model-00004-of-00007.safetensors: 99%|█████████▊| 9.67G/9.81G [00:13<00:00, 1.63GB/s] model-00004-of-00007.safetensors: 100%|█████████▉| 9.81G/9.81G [00:13<00:00, 705MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model-00005-of-00007.safetensors: 0%| | 0.00/9.75G [00:00<?, ?B/s] model-00005-of-00007.safetensors: 0%| | 10.5M/9.75G [00:01<24:56, 6.51MB/s] model-00005-of-00007.safetensors: 0%| | 31.5M/9.75G [00:02<10:27, 15.5MB/s] model-00005-of-00007.safetensors: 0%| | 41.9M/9.75G [00:02<07:36, 21.3MB/s] model-00005-of-00007.safetensors: 1%| | 83.9M/9.75G [00:02<02:49, 57.0MB/s] model-00005-of-00007.safetensors: 1%|▏ | 136M/9.75G [00:02<01:27, 109MB/s] model-00005-of-00007.safetensors: 2%|▏ | 241M/9.75G [00:02<00:39, 239MB/s] model-00005-of-00007.safetensors: 4%|▍ | 430M/9.75G [00:02<00:18, 494MB/s] model-00005-of-00007.safetensors: 5%|▌ | 524M/9.75G [00:03<00:16, 553MB/s] model-00005-of-00007.safetensors: 11%|█ | 1.08G/9.75G [00:03<00:05, 1.47GB/s] model-00005-of-00007.safetensors: 13%|█▎ | 1.28G/9.75G [00:04<00:14, 597MB/s] model-00005-of-00007.safetensors: 16%|█▌ | 1.52G/9.75G [00:04<00:10, 784MB/s] model-00005-of-00007.safetensors: 17%|█▋ | 1.70G/9.75G [00:04<00:12, 657MB/s] model-00005-of-00007.safetensors: 19%|█▉ | 1.84G/9.75G [00:04<00:11, 707MB/s] model-00005-of-00007.safetensors: 20%|██ | 1.98G/9.75G [00:04<00:09, 804MB/s] model-00005-of-00007.safetensors: 22%|██▏ | 2.16G/9.75G [00:04<00:07, 962MB/s] model-00005-of-00007.safetensors: 24%|██▎ | 2.31G/9.75G [00:05<00:08, 919MB/s] model-00005-of-00007.safetensors: 29%|██▊ | 2.79G/9.75G [00:05<00:04, 1.65GB/s] model-00005-of-00007.safetensors: 31%|███ | 3.02G/9.75G [00:05<00:06, 1.02GB/s] model-00005-of-00007.safetensors: 33%|███▎ | 3.20G/9.75G [00:06<00:08, 783MB/s] model-00005-of-00007.safetensors: 34%|███▍ | 3.33G/9.75G [00:06<00:08, 715MB/s] model-00005-of-00007.safetensors: 36%|███▋ | 3.53G/9.75G [00:06<00:07, 869MB/s] model-00005-of-00007.safetensors: 38%|███▊ | 3.69G/9.75G [00:06<00:06, 966MB/s] model-00005-of-00007.safetensors: 40%|████ | 3.92G/9.75G [00:06<00:04, 1.21GB/s] model-00005-of-00007.safetensors: 42%|████▏ | 4.09G/9.75G [00:06<00:05, 973MB/s] model-00005-of-00007.safetensors: 43%|████▎ | 4.23G/9.75G [00:07<00:07, 729MB/s] model-00005-of-00007.safetensors: 45%|████▍ | 4.34G/9.75G [00:07<00:07, 700MB/s] model-00005-of-00007.safetensors: 46%|████▌ | 4.44G/9.75G [00:07<00:07, 715MB/s] model-00005-of-00007.safetensors: 46%|████▋ | 4.53G/9.75G [00:07<00:07, 726MB/s] model-00005-of-00007.safetensors: 48%|████▊ | 4.69G/9.75G [00:07<00:05, 883MB/s] model-00005-of-00007.safetensors: 50%|█████ | 4.91G/9.75G [00:07<00:04, 1.17GB/s] model-00005-of-00007.safetensors: 52%|█████▏ | 5.05G/9.75G [00:07<00:04, 1.16GB/s] model-00005-of-00007.safetensors: 53%|█████▎ | 5.19G/9.75G [00:08<00:05, 790MB/s] model-00005-of-00007.safetensors: 54%|█████▍ | 5.30G/9.75G [00:08<00:06, 656MB/s] model-00005-of-00007.safetensors: 55%|█████▌ | 5.39G/9.75G [00:08<00:06, 674MB/s] model-00005-of-00007.safetensors: 56%|█████▌ | 5.47G/9.75G [00:08<00:06, 690MB/s] model-00005-of-00007.safetensors: 57%|█████▋ | 5.60G/9.75G [00:08<00:05, 801MB/s] model-00005-of-00007.safetensors: 59%|█████▉ | 5.74G/9.75G [00:08<00:04, 926MB/s] model-00005-of-00007.safetensors: 60%|██████ | 5.86G/9.75G [00:09<00:03, 993MB/s] model-00005-of-00007.safetensors: 62%|██████▏ | 6.02G/9.75G [00:09<00:03, 1.12GB/s] model-00005-of-00007.safetensors: 63%|██████▎ | 6.16G/9.75G [00:09<00:03, 1.16GB/s] model-00005-of-00007.safetensors: 64%|██████▍ | 6.28G/9.75G [00:09<00:03, 877MB/s] model-00005-of-00007.safetensors: 66%|██████▌ | 6.39G/9.75G [00:09<00:04, 724MB/s] model-00005-of-00007.safetensors: 66%|██████▋ | 6.48G/9.75G [00:09<00:04, 708MB/s] model-00005-of-00007.safetensors: 67%|██████▋ | 6.57G/9.75G [00:10<00:04, 757MB/s] model-00005-of-00007.safetensors: 68%|██████▊ | 6.67G/9.75G [00:10<00:04, 683MB/s] model-00005-of-00007.safetensors: 70%|██████▉ | 6.81G/9.75G [00:10<00:03, 824MB/s] model-00005-of-00007.safetensors: 71%|███████ | 6.90G/9.75G [00:10<00:03, 837MB/s] model-00005-of-00007.safetensors: 73%|███████▎ | 7.08G/9.75G [00:10<00:02, 1.05GB/s] model-00005-of-00007.safetensors: 75%|███████▍ | 7.27G/9.75G [00:10<00:02, 1.21GB/s] model-00005-of-00007.safetensors: 76%|███████▌ | 7.40G/9.75G [00:10<00:02, 801MB/s] model-00005-of-00007.safetensors: 77%|███████▋ | 7.51G/9.75G [00:11<00:02, 785MB/s] model-00005-of-00007.safetensors: 78%|███████▊ | 7.60G/9.75G [00:11<00:02, 809MB/s] model-00005-of-00007.safetensors: 79%|███████▉ | 7.70G/9.75G [00:11<00:02, 810MB/s] model-00005-of-00007.safetensors: 80%|███████▉ | 7.79G/9.75G [00:11<00:02, 772MB/s] model-00005-of-00007.safetensors: 81%|████████ | 7.87G/9.75G [00:11<00:02, 735MB/s] model-00005-of-00007.safetensors: 82%|████████▏ | 8.00G/9.75G [00:11<00:02, 812MB/s] model-00005-of-00007.safetensors: 84%|████████▍ | 8.18G/9.75G [00:11<00:01, 1.01GB/s] model-00005-of-00007.safetensors: 86%|████████▌ | 8.37G/9.75G [00:11<00:01, 1.22GB/s] model-00005-of-00007.safetensors: 87%|████████▋ | 8.50G/9.75G [00:12<00:01, 875MB/s] model-00005-of-00007.safetensors: 89%|████████▊ | 8.63G/9.75G [00:12<00:01, 952MB/s] model-00005-of-00007.safetensors: 90%|████████▉ | 8.75G/9.75G [00:12<00:01, 912MB/s] model-00005-of-00007.safetensors: 91%|█████████ | 8.85G/9.75G [00:12<00:01, 819MB/s] model-00005-of-00007.safetensors: 92%|█████████▏| 8.94G/9.75G [00:12<00:00, 842MB/s] model-00005-of-00007.safetensors: 93%|█████████▎| 9.05G/9.75G [00:12<00:00, 879MB/s] model-00005-of-00007.safetensors: 95%|█████████▍| 9.26G/9.75G [00:12<00:00, 1.17GB/s] model-00005-of-00007.safetensors: 97%|█████████▋| 9.49G/9.75G [00:12<00:00, 1.47GB/s] model-00005-of-00007.safetensors: 100%|█████████▉| 9.72G/9.75G [00:13<00:00, 1.67GB/s] model-00005-of-00007.safetensors: 100%|█████████▉| 9.75G/9.75G [00:13<00:00, 731MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model-00006-of-00007.safetensors: 0%| | 0.00/9.75G [00:00<?, ?B/s] model-00006-of-00007.safetensors: 0%| | 10.5M/9.75G [00:02<31:10, 5.21MB/s] model-00006-of-00007.safetensors: 0%| | 21.0M/9.75G [00:02<17:44, 9.14MB/s] model-00006-of-00007.safetensors: 1%| | 73.4M/9.75G [00:02<03:40, 44.0MB/s] model-00006-of-00007.safetensors: 2%|▏ | 220M/9.75G [00:02<00:56, 168MB/s] model-00006-of-00007.safetensors: 4%|▍ | 377M/9.75G [00:02<00:29, 321MB/s] model-00006-of-00007.safetensors: 5%|▍ | 482M/9.75G [00:03<00:23, 391MB/s] model-00006-of-00007.safetensors: 11%|█ | 1.07G/9.75G [00:03<00:07, 1.20GB/s] model-00006-of-00007.safetensors: 13%|█▎ | 1.29G/9.75G [00:04<00:14, 572MB/s] model-00006-of-00007.safetensors: 15%|█▍ | 1.46G/9.75G [00:04<00:12, 641MB/s] model-00006-of-00007.safetensors: 16%|█▋ | 1.60G/9.75G [00:04<00:11, 686MB/s] model-00006-of-00007.safetensors: 18%|█▊ | 1.73G/9.75G [00:04<00:11, 708MB/s] model-00006-of-00007.safetensors: 20%|█▉ | 1.91G/9.75G [00:04<00:09, 862MB/s] model-00006-of-00007.safetensors: 21%|██ | 2.06G/9.75G [00:04<00:07, 966MB/s] model-00006-of-00007.safetensors: 22%|██▏ | 2.19G/9.75G [00:04<00:07, 978MB/s] model-00006-of-00007.safetensors: 25%|██▌ | 2.47G/9.75G [00:04<00:05, 1.36GB/s] model-00006-of-00007.safetensors: 28%|██▊ | 2.71G/9.75G [00:05<00:04, 1.53GB/s] model-00006-of-00007.safetensors: 30%|██▉ | 2.89G/9.75G [00:05<00:07, 938MB/s] model-00006-of-00007.safetensors: 31%|███ | 3.04G/9.75G [00:05<00:09, 691MB/s] model-00006-of-00007.safetensors: 32%|███▏ | 3.16G/9.75G [00:06<00:09, 726MB/s] model-00006-of-00007.safetensors: 34%|███▎ | 3.27G/9.75G [00:06<00:08, 773MB/s] model-00006-of-00007.safetensors: 35%|███▍ | 3.40G/9.75G [00:06<00:07, 860MB/s] model-00006-of-00007.safetensors: 37%|███▋ | 3.62G/9.75G [00:06<00:05, 1.12GB/s] model-00006-of-00007.safetensors: 39%|███▉ | 3.81G/9.75G [00:06<00:04, 1.22GB/s] model-00006-of-00007.safetensors: 41%|████ | 3.95G/9.75G [00:06<00:05, 1.05GB/s] model-00006-of-00007.safetensors: 42%|████▏ | 4.08G/9.75G [00:06<00:07, 760MB/s] model-00006-of-00007.safetensors: 43%|████▎ | 4.18G/9.75G [00:07<00:07, 721MB/s] model-00006-of-00007.safetensors: 44%|████▍ | 4.28G/9.75G [00:07<00:08, 683MB/s] model-00006-of-00007.safetensors: 46%|████▌ | 4.45G/9.75G [00:07<00:06, 859MB/s] model-00006-of-00007.safetensors: 47%|████▋ | 4.59G/9.75G [00:07<00:05, 970MB/s] model-00006-of-00007.safetensors: 49%|████▊ | 4.74G/9.75G [00:07<00:04, 1.04GB/s] model-00006-of-00007.safetensors: 50%|████▉ | 4.87G/9.75G [00:07<00:04, 1.02GB/s] model-00006-of-00007.safetensors: 51%|█████ | 4.98G/9.75G [00:07<00:05, 942MB/s] model-00006-of-00007.safetensors: 52%|█████▏ | 5.09G/9.75G [00:08<00:05, 924MB/s] model-00006-of-00007.safetensors: 53%|█████▎ | 5.19G/9.75G [00:08<00:06, 705MB/s] model-00006-of-00007.safetensors: 54%|█████▍ | 5.27G/9.75G [00:08<00:06, 669MB/s] model-00006-of-00007.safetensors: 55%|█████▌ | 5.39G/9.75G [00:08<00:05, 757MB/s] model-00006-of-00007.safetensors: 56%|█████▋ | 5.51G/9.75G [00:08<00:05, 834MB/s] model-00006-of-00007.safetensors: 58%|█████▊ | 5.64G/9.75G [00:08<00:04, 947MB/s] model-00006-of-00007.safetensors: 59%|█████▉ | 5.77G/9.75G [00:08<00:04, 992MB/s] model-00006-of-00007.safetensors: 60%|██████ | 5.87G/9.75G [00:08<00:04, 953MB/s] model-00006-of-00007.safetensors: 61%|██████▏ | 5.98G/9.75G [00:09<00:04, 877MB/s] model-00006-of-00007.safetensors: 63%|██████▎ | 6.11G/9.75G [00:09<00:03, 953MB/s] model-00006-of-00007.safetensors: 64%|██████▍ | 6.22G/9.75G [00:09<00:04, 751MB/s] model-00006-of-00007.safetensors: 65%|██████▍ | 6.30G/9.75G [00:09<00:05, 674MB/s] model-00006-of-00007.safetensors: 66%|██████▌ | 6.39G/9.75G [00:09<00:04, 708MB/s] model-00006-of-00007.safetensors: 67%|██████▋ | 6.49G/9.75G [00:09<00:04, 787MB/s] model-00006-of-00007.safetensors: 68%|██████▊ | 6.60G/9.75G [00:09<00:03, 851MB/s] model-00006-of-00007.safetensors: 69%|██████▊ | 6.69G/9.75G [00:10<00:03, 858MB/s] model-00006-of-00007.safetensors: 70%|███████ | 6.86G/9.75G [00:10<00:02, 1.02GB/s] model-00006-of-00007.safetensors: 71%|███████▏ | 6.96G/9.75G [00:10<00:02, 950MB/s] model-00006-of-00007.safetensors: 73%|███████▎ | 7.07G/9.75G [00:10<00:02, 905MB/s] model-00006-of-00007.safetensors: 74%|███████▍ | 7.22G/9.75G [00:10<00:02, 877MB/s] model-00006-of-00007.safetensors: 75%|███████▌ | 7.32G/9.75G [00:10<00:02, 891MB/s] model-00006-of-00007.safetensors: 76%|███████▌ | 7.41G/9.75G [00:10<00:02, 819MB/s] model-00006-of-00007.safetensors: 77%|███████▋ | 7.50G/9.75G [00:10<00:02, 823MB/s] model-00006-of-00007.safetensors: 78%|███████▊ | 7.59G/9.75G [00:11<00:02, 793MB/s] model-00006-of-00007.safetensors: 79%|███████▉ | 7.69G/9.75G [00:11<00:02, 825MB/s] model-00006-of-00007.safetensors: 80%|███████▉ | 7.77G/9.75G [00:11<00:02, 800MB/s] model-00006-of-00007.safetensors: 81%|████████▏ | 7.94G/9.75G [00:11<00:01, 1.00GB/s] model-00006-of-00007.safetensors: 83%|████████▎ | 8.06G/9.75G [00:11<00:01, 1.04GB/s] model-00006-of-00007.safetensors: 84%|████████▍ | 8.18G/9.75G [00:11<00:01, 1.03GB/s] model-00006-of-00007.safetensors: 85%|████████▍ | 8.28G/9.75G [00:11<00:01, 853MB/s] model-00006-of-00007.safetensors: 86%|████████▌ | 8.38G/9.75G [00:11<00:01, 796MB/s] model-00006-of-00007.safetensors: 87%|████████▋ | 8.46G/9.75G [00:12<00:01, 701MB/s] model-00006-of-00007.safetensors: 88%|████████▊ | 8.58G/9.75G [00:12<00:01, 799MB/s] model-00006-of-00007.safetensors: 89%|████████▉ | 8.68G/9.75G [00:12<00:01, 835MB/s] model-00006-of-00007.safetensors: 90%|█████████ | 8.78G/9.75G [00:12<00:01, 822MB/s] model-00006-of-00007.safetensors: 91%|█████████ | 8.87G/9.75G [00:12<00:01, 845MB/s] model-00006-of-00007.safetensors: 93%|█████████▎| 9.03G/9.75G [00:12<00:00, 1.00GB/s] model-00006-of-00007.safetensors: 94%|█████████▍| 9.18G/9.75G [00:12<00:00, 1.12GB/s] model-00006-of-00007.safetensors: 96%|█████████▌| 9.35G/9.75G [00:12<00:00, 1.24GB/s] model-00006-of-00007.safetensors: 98%|█████████▊| 9.56G/9.75G [00:12<00:00, 1.47GB/s] model-00006-of-00007.safetensors: 100%|█████████▉| 9.74G/9.75G [00:13<00:00, 1.51GB/s] model-00006-of-00007.safetensors: 100%|█████████▉| 9.75G/9.75G [00:13<00:00, 721MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model-00007-of-00007.safetensors: 0%| | 0.00/9.67G [00:00<?, ?B/s] model-00007-of-00007.safetensors: 0%| | 10.5M/9.67G [00:02<33:25, 4.81MB/s] model-00007-of-00007.safetensors: 0%| | 21.0M/9.67G [00:02<15:04, 10.7MB/s] model-00007-of-00007.safetensors: 0%| | 31.5M/9.67G [00:02<09:22, 17.1MB/s] model-00007-of-00007.safetensors: 1%| | 62.9M/9.67G [00:02<04:00, 39.9MB/s] model-00007-of-00007.safetensors: 2%|▏ | 157M/9.67G [00:02<01:10, 135MB/s] model-00007-of-00007.safetensors: 3%|▎ | 304M/9.67G [00:02<00:30, 307MB/s] model-00007-of-00007.safetensors: 4%|▍ | 419M/9.67G [00:03<00:21, 437MB/s] model-00007-of-00007.safetensors: 5%|▌ | 503M/9.67G [00:03<00:18, 501MB/s] model-00007-of-00007.safetensors: 8%|▊ | 797M/9.67G [00:03<00:08, 995MB/s] model-00007-of-00007.safetensors: 11%|█ | 1.06G/9.67G [00:03<00:11, 767MB/s] model-00007-of-00007.safetensors: 12%|█▏ | 1.18G/9.67G [00:04<00:14, 579MB/s] model-00007-of-00007.safetensors: 13%|█▎ | 1.30G/9.67G [00:04<00:12, 648MB/s] model-00007-of-00007.safetensors: 15%|█▍ | 1.41G/9.67G [00:04<00:12, 666MB/s] model-00007-of-00007.safetensors: 16%|█▌ | 1.50G/9.67G [00:04<00:12, 651MB/s] model-00007-of-00007.safetensors: 16%|█▋ | 1.59G/9.67G [00:04<00:11, 694MB/s] model-00007-of-00007.safetensors: 18%|█▊ | 1.71G/9.67G [00:04<00:10, 787MB/s] model-00007-of-00007.safetensors: 19%|█▉ | 1.81G/9.67G [00:04<00:09, 832MB/s] model-00007-of-00007.safetensors: 20%|█▉ | 1.93G/9.67G [00:04<00:08, 889MB/s] model-00007-of-00007.safetensors: 22%|██▏ | 2.11G/9.67G [00:05<00:06, 1.10GB/s] model-00007-of-00007.safetensors: 23%|██▎ | 2.23G/9.67G [00:05<00:07, 1.03GB/s] model-00007-of-00007.safetensors: 26%|██▌ | 2.54G/9.67G [00:05<00:04, 1.53GB/s] model-00007-of-00007.safetensors: 29%|██▊ | 2.76G/9.67G [00:05<00:04, 1.66GB/s] model-00007-of-00007.safetensors: 30%|███ | 2.94G/9.67G [00:05<00:06, 998MB/s] model-00007-of-00007.safetensors: 32%|███▏ | 3.08G/9.67G [00:06<00:09, 678MB/s] model-00007-of-00007.safetensors: 33%|███▎ | 3.20G/9.67G [00:06<00:09, 669MB/s] model-00007-of-00007.safetensors: 34%|███▍ | 3.29G/9.67G [00:06<00:09, 703MB/s] model-00007-of-00007.safetensors: 36%|███▌ | 3.48G/9.67G [00:06<00:06, 892MB/s] model-00007-of-00007.safetensors: 39%|███▊ | 3.74G/9.67G [00:06<00:04, 1.21GB/s] model-00007-of-00007.safetensors: 40%|████ | 3.90G/9.67G [00:06<00:05, 1.11GB/s] model-00007-of-00007.safetensors: 42%|████▏ | 4.04G/9.67G [00:07<00:06, 840MB/s] model-00007-of-00007.safetensors: 43%|████▎ | 4.15G/9.67G [00:07<00:08, 688MB/s] model-00007-of-00007.safetensors: 44%|████▍ | 4.25G/9.67G [00:07<00:07, 727MB/s] model-00007-of-00007.safetensors: 45%|████▍ | 4.34G/9.67G [00:07<00:07, 721MB/s] model-00007-of-00007.safetensors: 46%|████▌ | 4.46G/9.67G [00:07<00:06, 794MB/s] model-00007-of-00007.safetensors: 47%|████▋ | 4.56G/9.67G [00:07<00:06, 846MB/s] model-00007-of-00007.safetensors: 49%|████▊ | 4.71G/9.67G [00:07<00:05, 989MB/s] model-00007-of-00007.safetensors: 50%|█████ | 4.83G/9.67G [00:08<00:04, 1.05GB/s] model-00007-of-00007.safetensors: 51%|█████ | 4.95G/9.67G [00:08<00:04, 1.07GB/s] model-00007-of-00007.safetensors: 52%|█████▏ | 5.06G/9.67G [00:08<00:04, 975MB/s] model-00007-of-00007.safetensors: 53%|█████▎ | 5.17G/9.67G [00:08<00:05, 871MB/s] model-00007-of-00007.safetensors: 54%|█████▍ | 5.26G/9.67G [00:08<00:05, 755MB/s] model-00007-of-00007.safetensors: 55%|█████▌ | 5.35G/9.67G [00:08<00:05, 747MB/s] model-00007-of-00007.safetensors: 56%|█████▌ | 5.43G/9.67G [00:08<00:05, 717MB/s] model-00007-of-00007.safetensors: 57%|█████▋ | 5.55G/9.67G [00:09<00:05, 794MB/s] model-00007-of-00007.safetensors: 58%|█████▊ | 5.63G/9.67G [00:09<00:05, 796MB/s] model-00007-of-00007.safetensors: 60%|█████▉ | 5.77G/9.67G [00:09<00:04, 939MB/s] model-00007-of-00007.safetensors: 61%|██████ | 5.88G/9.67G [00:09<00:03, 997MB/s] model-00007-of-00007.safetensors: 62%|██████▏ | 5.99G/9.67G [00:09<00:03, 996MB/s] model-00007-of-00007.safetensors: 63%|██████▎ | 6.10G/9.67G [00:09<00:03, 1.00GB/s] model-00007-of-00007.safetensors: 64%|██████▍ | 6.21G/9.67G [00:09<00:04, 756MB/s] model-00007-of-00007.safetensors: 65%|██████▌ | 6.32G/9.67G [00:09<00:03, 844MB/s] model-00007-of-00007.safetensors: 66%|██████▋ | 6.42G/9.67G [00:09<00:03, 853MB/s] model-00007-of-00007.safetensors: 67%|██████▋ | 6.51G/9.67G [00:10<00:03, 822MB/s] model-00007-of-00007.safetensors: 68%|██████▊ | 6.61G/9.67G [00:10<00:03, 851MB/s] model-00007-of-00007.safetensors: 69%|██████▉ | 6.70G/9.67G [00:10<00:04, 739MB/s] model-00007-of-00007.safetensors: 71%|███████ | 6.82G/9.67G [00:10<00:03, 806MB/s] model-00007-of-00007.safetensors: 71%|███████▏ | 6.91G/9.67G [00:10<00:03, 829MB/s] model-00007-of-00007.safetensors: 73%|███████▎ | 7.01G/9.67G [00:10<00:03, 883MB/s] model-00007-of-00007.safetensors: 74%|███████▍ | 7.13G/9.67G [00:10<00:02, 891MB/s] model-00007-of-00007.safetensors: 75%|███████▍ | 7.22G/9.67G [00:11<00:03, 747MB/s] model-00007-of-00007.safetensors: 76%|███████▌ | 7.31G/9.67G [00:11<00:03, 721MB/s] model-00007-of-00007.safetensors: 76%|███████▋ | 7.39G/9.67G [00:11<00:03, 629MB/s] model-00007-of-00007.safetensors: 78%|███████▊ | 7.51G/9.67G [00:11<00:02, 742MB/s] model-00007-of-00007.safetensors: 79%|███████▊ | 7.61G/9.67G [00:11<00:02, 771MB/s] model-00007-of-00007.safetensors: 80%|███████▉ | 7.72G/9.67G [00:11<00:02, 839MB/s] model-00007-of-00007.safetensors: 81%|████████ | 7.81G/9.67G [00:11<00:02, 814MB/s] model-00007-of-00007.safetensors: 82%|████████▏ | 7.91G/9.67G [00:11<00:02, 818MB/s] model-00007-of-00007.safetensors: 83%|████████▎ | 8.01G/9.67G [00:11<00:01, 870MB/s] model-00007-of-00007.safetensors: 84%|████████▍ | 8.15G/9.67G [00:12<00:01, 982MB/s] model-00007-of-00007.safetensors: 85%|████████▌ | 8.25G/9.67G [00:12<00:01, 971MB/s] model-00007-of-00007.safetensors: 86%|████████▋ | 8.36G/9.67G [00:12<00:01, 972MB/s] model-00007-of-00007.safetensors: 88%|████████▊ | 8.46G/9.67G [00:12<00:01, 739MB/s] model-00007-of-00007.safetensors: 89%|████████▊ | 8.58G/9.67G [00:12<00:01, 831MB/s] model-00007-of-00007.safetensors: 90%|████████▉ | 8.67G/9.67G [00:12<00:01, 853MB/s] model-00007-of-00007.safetensors: 91%|█████████ | 8.77G/9.67G [00:12<00:01, 787MB/s] model-00007-of-00007.safetensors: 92%|█████████▏| 8.86G/9.67G [00:13<00:01, 770MB/s] model-00007-of-00007.safetensors: 93%|█████████▎| 8.94G/9.67G [00:13<00:00, 769MB/s] model-00007-of-00007.safetensors: 94%|█████████▍| 9.08G/9.67G [00:13<00:00, 916MB/s] model-00007-of-00007.safetensors: 96%|█████████▌| 9.27G/9.67G [00:13<00:00, 1.16GB/s] model-00007-of-00007.safetensors: 98%|█████████▊| 9.45G/9.67G [00:13<00:00, 1.32GB/s] model-00007-of-00007.safetensors: 100%|█████████▉| 9.66G/9.67G [00:13<00:00, 1.47GB/s] model-00007-of-00007.safetensors: 100%|█████████▉| 9.67G/9.67G [00:13<00:00, 707MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: model.safetensors.index.json: 0%| | 0.00/42.6k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 42.6k/42.6k [00:00<00:00, 167MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: special_tokens_map.json: 0%| | 0.00/573 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 573/573 [00:00<00:00, 8.68MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: tokenizer.json: 0%| | 0.00/3.56M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 3.56M/3.56M [00:00<00:00, 50.5MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: tokenizer.model: 0%| | 0.00/1.03M [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 1.03M/1.03M [00:00<00:00, 30.9MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: tokenizer_config.json: 0%| | 0.00/1.35k [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 1.35k/1.35k [00:00<00:00, 16.0MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Downloaded to shared memory in 104.404s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: quantizing model to /dev/shm/model_cache
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Reading /tmp/tmpza_8ofsm/model.safetensors.index.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Profiling: 0%| | 0/543 [00:00<?, ?it/s] Profiling: 0%| | 1/543 [00:03<36:06, 4.00s/it] Profiling: 2%|▏ | 9/543 [00:04<02:58, 2.99it/s] Profiling: 3%|▎ | 18/543 [00:04<01:14, 7.03it/s] Profiling: 6%|▌ | 30/543 [00:04<00:36, 13.95it/s] Profiling: 7%|▋ | 39/543 [00:04<00:25, 20.00it/s] Profiling: 9%|▉ | 48/543 [00:04<00:18, 27.11it/s] Profiling: 10%|█ | 57/543 [00:04<00:13, 34.87it/s] Profiling: 12%|█▏ | 66/543 [00:04<00:11, 43.02it/s] Profiling: 14%|█▍ | 76/543 [00:04<00:08, 52.98it/s] Profiling: 16%|█▌ | 85/543 [00:05<00:13, 34.07it/s] Profiling: 17%|█▋ | 94/543 [00:05<00:11, 40.48it/s] Profiling: 19%|█▊ | 101/543 [00:05<00:10, 42.06it/s] Profiling: 20%|██ | 110/543 [00:05<00:08, 49.97it/s] Profiling: 22%|██▏ | 119/543 [00:05<00:07, 56.06it/s] Profiling: 24%|██▍ | 130/543 [00:05<00:06, 66.05it/s] Profiling: 26%|██▌ | 140/543 [00:06<00:05, 70.37it/s] Profiling: 27%|██▋ | 149/543 [00:06<00:05, 72.36it/s] Profiling: 29%|██▉ | 157/543 [00:06<00:10, 36.70it/s] Profiling: 30%|███ | 164/543 [00:06<00:09, 40.14it/s] Profiling: 32%|███▏ | 172/543 [00:06<00:08, 46.11it/s] Profiling: 33%|███▎ | 181/543 [00:07<00:06, 53.21it/s] Profiling: 35%|███▌ | 192/543 [00:07<00:05, 63.89it/s] Profiling: 37%|███▋ | 201/543 [00:07<00:05, 68.37it/s] Profiling: 39%|███▊ | 210/543 [00:07<00:04, 72.15it/s] Profiling: 40%|████ | 219/543 [00:07<00:04, 75.13it/s] Profiling: 42%|████▏ | 229/543 [00:07<00:03, 80.26it/s] Profiling: 44%|████▍ | 241/543 [00:08<00:06, 44.79it/s] Profiling: 46%|████▌ | 248/543 [00:08<00:06, 45.33it/s] Profiling: 47%|████▋ | 257/543 [00:08<00:05, 51.73it/s] Profiling: 49%|████▉ | 266/543 [00:08<00:04, 57.77it/s] Profiling: 50%|█████ | 274/543 [00:08<00:04, 56.66it/s] Profiling: 52%|█████▏ | 283/543 [00:08<00:04, 62.47it/s] Profiling: 54%|█████▍ | 292/543 [00:08<00:03, 66.90it/s] Profiling: 55%|█████▌ | 300/543 [00:08<00:03, 67.53it/s] Profiling: 57%|█████▋ | 310/543 [00:09<00:03, 74.51it/s] Profiling: 59%|█████▊ | 318/543 [00:09<00:05, 38.12it/s] Profiling: 60%|██████ | 326/543 [00:09<00:04, 44.23it/s] Profiling: 62%|██████▏ | 334/543 [00:09<00:04, 50.73it/s] Profiling: 63%|██████▎ | 341/543 [00:09<00:03, 54.61it/s] Profiling: 64%|██████▍ | 350/543 [00:09<00:03, 61.67it/s] Profiling: 66%|██████▌ | 358/543 [00:10<00:02, 63.08it/s] Profiling: 67%|██████▋ | 366/543 [00:10<00:02, 66.21it/s] Profiling: 69%|██████▉ | 374/543 [00:10<00:02, 68.73it/s] Profiling: 72%|███████▏ | 389/543 [00:10<00:01, 90.27it/s] Profiling: 73%|███████▎ | 399/543 [00:10<00:03, 41.45it/s] Profiling: 75%|███████▍ | 407/543 [00:11<00:02, 46.68it/s] Profiling: 77%|███████▋ | 416/543 [00:11<00:02, 53.33it/s] Profiling: 78%|███████▊ | 424/543 [00:11<00:02, 56.59it/s] Profiling: 80%|███████▉ | 432/543 [00:11<00:01, 60.70it/s] Profiling: 81%|████████ | 440/543 [00:11<00:01, 65.14it/s] Profiling: 83%|████████▎ | 448/543 [00:11<00:01, 68.39it/s] Profiling: 84%|████████▍ | 456/543 [00:11<00:01, 68.89it/s] Profiling: 87%|████████▋ | 470/543 [00:11<00:00, 87.20it/s] Profiling: 88%|████████▊ | 480/543 [00:16<00:09, 6.70it/s] Profiling: 90%|████████▉ | 488/543 [00:16<00:06, 8.73it/s] Profiling: 91%|█████████ | 495/543 [00:16<00:04, 11.07it/s] Profiling: 93%|█████████▎| 504/543 [00:16<00:02, 15.08it/s] Profiling: 94%|█████████▍| 512/543 [00:16<00:01, 19.19it/s] Profiling: 96%|█████████▌| 519/543 [00:17<00:01, 23.42it/s] Profiling: 97%|█████████▋| 528/543 [00:17<00:00, 30.39it/s] Profiling: 99%|█████████▉| 537/543 [00:17<00:00, 37.77it/s] Profiling: 100%|██████████| 543/543 [00:17<00:00, 30.63it/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
brucethemoose-yi-34b-200-6263-v1-mkmlizer: quantized model in 65.270s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Processed model brucethemoose/Yi-34B-200K-RPMerge in 174.439s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
brucethemoose-yi-34b-200-6263-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/tokenizer.model
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/added_tokens.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/special_tokens_map.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/tokenizer_config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/tokenizer.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/brucethemoose-yi-34b-200-6263-v1/mkml_model.tensors
brucethemoose-yi-34b-200-6263-v1-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
brucethemoose-yi-34b-200-6263-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
brucethemoose-yi-34b-200-6263-v1-mkmlizer: warnings.warn(
brucethemoose-yi-34b-200-6263-v1-mkmlizer: config.json: 0%| | 0.00/1.05k [00:00<?, ?B/s] config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 11.6MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
brucethemoose-yi-34b-200-6263-v1-mkmlizer: warnings.warn(
brucethemoose-yi-34b-200-6263-v1-mkmlizer: tokenizer_config.json: 0%| | 0.00/234 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 2.67MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: vocab.json: 0%| | 0.00/1.04M [00:00<?, ?B/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 46.9MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 17.0MB/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 16.8MB/s]
brucethemoose-yi-34b-200-6263-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
brucethemoose-yi-34b-200-6263-v1-mkmlizer: warnings.warn(
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Saving duration: 0.231s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 6.956s
brucethemoose-yi-34b-200-6263-v1-mkmlizer: creating bucket guanaco-reward-models
brucethemoose-yi-34b-200-6263-v1-mkmlizer: Bucket 's3://guanaco-reward-models/' created
brucethemoose-yi-34b-200-6263-v1-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/tokenizer_config.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/special_tokens_map.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/merges.txt
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/vocab.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/tokenizer.json
brucethemoose-yi-34b-200-6263-v1-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/brucethemoose-yi-34b-200-6263-v1_reward/reward.tensors
Job brucethemoose-yi-34b-200-6263-v1-mkmlizer completed after 378.52s with status: succeeded
Stopping job with name brucethemoose-yi-34b-200-6263-v1-mkmlizer
Pipeline stage MKMLizer completed in 381.43s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.12s
Running pipeline stage ISVCDeployer
Creating inference service brucethemoose-yi-34b-200-6263-v1
Waiting for inference service brucethemoose-yi-34b-200-6263-v1 to be ready
Inference service brucethemoose-yi-34b-200-6263-v1 ready after 70.43993735313416s
Pipeline stage ISVCDeployer completed in 77.55s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5221145153045654s
Received healthy response to inference request in 1.8475291728973389s
Received healthy response to inference request in 1.9070124626159668s
Received healthy response to inference request in 1.9613807201385498s
Received healthy response to inference request in 1.7757952213287354s
5 requests
0 failed requests
5th percentile: 1.790142011642456
10th percentile: 1.8044888019561767
20th percentile: 1.8331823825836182
30th percentile: 1.8594258308410645
40th percentile: 1.8832191467285155
50th percentile: 1.9070124626159668
60th percentile: 1.928759765625
70th percentile: 1.9505070686340331
80th percentile: 2.073527479171753
90th percentile: 2.2978209972381594
95th percentile: 2.4099677562713624
99th percentile: 2.499685163497925
mean time: 2.002766418457031
Pipeline stage StressChecker completed in 11.07s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.05s
Running pipeline stage DaemonicSafetyScorer
Pipeline stage DaemonicSafetyScorer completed in 0.07s
Running M-Eval for topic stay_in_character
M-Eval Dataset for topic stay_in_character is loaded
brucethemoose-yi-34b-200_6263_v1 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics