submission_id: arlineka-nyans-13b-esp1_v1
developer_uid: arlineka
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
model_name: arlineka-nyans-13b-esp1_v1
model_repo: arlineka/Nyans-13b-esp1
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'user_template': '{user_name}: {message}\n'}
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
status: torndown
timestamp: 2024-04-13T22:51:56+00:00
Resubmit model
Running pipeline stage MKMLizer
Starting job with name arlineka-nyans-13b-esp1-v1-mkmlizer
Waiting for job on arlineka-nyans-13b-esp1-v1-mkmlizer to finish
arlineka-nyans-13b-esp1-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ _____ __ __ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /___/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Version: 0.6.11 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ The license key for the current software has been verified as ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ belonging to: ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Chai Research Corp. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 18.6MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitignore: 0%| | 0.00/19.0 [00:00<?, ?B/s] .gitignore: 100%|██████████| 19.0/19.0 [00:00<00:00, 256kB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: README.md: 0%| | 0.00/78.0 [00:00<?, ?B/s] README.md: 100%|██████████| 78.0/78.0 [00:00<00:00, 722kB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: config.json: 0%| | 0.00/817 [00:00<?, ?B/s] config.json: 100%|██████████| 817/817 [00:00<00:00, 6.64MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00001-of-00003.safetensors: 0%| | 0.00/9.99G [00:00<?, ?B/s] model-00001-of-00003.safetensors: 0%| | 10.5M/9.99G [00:02<45:37, 3.64MB/s] model-00001-of-00003.safetensors: 0%| | 41.9M/9.99G [00:02<09:03, 18.3MB/s] model-00001-of-00003.safetensors: 1%| | 62.9M/9.99G [00:03<05:30, 30.0MB/s] model-00001-of-00003.safetensors: 1%| | 94.4M/9.99G [00:03<03:05, 53.3MB/s] model-00001-of-00003.safetensors: 2%|▏ | 178M/9.99G [00:03<01:12, 134MB/s] model-00001-of-00003.safetensors: 3%|▎ | 252M/9.99G [00:03<00:45, 212MB/s] model-00001-of-00003.safetensors: 3%|▎ | 315M/9.99G [00:03<00:36, 266MB/s] model-00001-of-00003.safetensors: 4%|▍ | 377M/9.99G [00:03<00:30, 315MB/s] model-00001-of-00003.safetensors: 5%|▌ | 524M/9.99G [00:03<00:17, 538MB/s] model-00001-of-00003.safetensors: 11%|█ | 1.11G/9.99G [00:03<00:06, 1.46GB/s] model-00001-of-00003.safetensors: 13%|█▎ | 1.28G/9.99G [00:04<00:09, 945MB/s] model-00001-of-00003.safetensors: 14%|█▍ | 1.41G/9.99G [00:04<00:15, 549MB/s] model-00001-of-00003.safetensors: 15%|█▌ | 1.50G/9.99G [00:05<00:14, 590MB/s] model-00001-of-00003.safetensors: 16%|█▋ | 1.65G/9.99G [00:05<00:11, 705MB/s] model-00001-of-00003.safetensors: 18%|█▊ | 1.79G/9.99G [00:05<00:10, 813MB/s] model-00001-of-00003.safetensors: 19%|█▉ | 1.91G/9.99G [00:05<00:10, 761MB/s] model-00001-of-00003.safetensors: 20%|██ | 2.04G/9.99G [00:05<00:09, 868MB/s] model-00001-of-00003.safetensors: 22%|██▏ | 2.16G/9.99G [00:05<00:08, 918MB/s] model-00001-of-00003.safetensors: 25%|██▍ | 2.50G/9.99G [00:05<00:05, 1.47GB/s] model-00001-of-00003.safetensors: 27%|██▋ | 2.67G/9.99G [00:05<00:05, 1.38GB/s] model-00001-of-00003.safetensors: 28%|██▊ | 2.84G/9.99G [00:06<00:06, 1.05GB/s] model-00001-of-00003.safetensors: 30%|██▉ | 2.98G/9.99G [00:06<00:11, 585MB/s] model-00001-of-00003.safetensors: 31%|███ | 3.08G/9.99G [00:06<00:12, 570MB/s] model-00001-of-00003.safetensors: 32%|███▏ | 3.18G/9.99G [00:07<00:11, 614MB/s] model-00001-of-00003.safetensors: 34%|███▎ | 3.36G/9.99G [00:07<00:08, 795MB/s] model-00001-of-00003.safetensors: 36%|███▌ | 3.57G/9.99G [00:07<00:06, 1.04GB/s] model-00001-of-00003.safetensors: 37%|███▋ | 3.71G/9.99G [00:07<00:05, 1.05GB/s] model-00001-of-00003.safetensors: 39%|███▊ | 3.85G/9.99G [00:07<00:05, 1.03GB/s] model-00001-of-00003.safetensors: 40%|███▉ | 3.97G/9.99G [00:07<00:10, 596MB/s] model-00001-of-00003.safetensors: 41%|████ | 4.07G/9.99G [00:08<00:10, 577MB/s] model-00001-of-00003.safetensors: 42%|████▏ | 4.15G/9.99G [00:08<00:10, 558MB/s] model-00001-of-00003.safetensors: 42%|████▏ | 4.23G/9.99G [00:08<00:10, 570MB/s] model-00001-of-00003.safetensors: 45%|████▍ | 4.45G/9.99G [00:08<00:06, 846MB/s] model-00001-of-00003.safetensors: 47%|████▋ | 4.66G/9.99G [00:08<00:05, 1.05GB/s] model-00001-of-00003.safetensors: 49%|████▉ | 4.88G/9.99G [00:08<00:03, 1.29GB/s] model-00001-of-00003.safetensors: 50%|█████ | 5.03G/9.99G [00:09<00:05, 854MB/s] model-00001-of-00003.safetensors: 52%|█████▏ | 5.16G/9.99G [00:09<00:06, 698MB/s] model-00001-of-00003.safetensors: 53%|█████▎ | 5.26G/9.99G [00:09<00:07, 622MB/s] model-00001-of-00003.safetensors: 54%|█████▍ | 5.39G/9.99G [00:09<00:06, 713MB/s] model-00001-of-00003.safetensors: 55%|█████▌ | 5.52G/9.99G [00:09<00:05, 789MB/s] model-00001-of-00003.safetensors: 57%|█████▋ | 5.65G/9.99G [00:09<00:04, 894MB/s] model-00001-of-00003.safetensors: 58%|█████▊ | 5.80G/9.99G [00:10<00:04, 1.01GB/s] model-00001-of-00003.safetensors: 59%|█████▉ | 5.92G/9.99G [00:10<00:03, 1.07GB/s] model-00001-of-00003.safetensors: 61%|██████ | 6.05G/9.99G [00:10<00:04, 898MB/s] model-00001-of-00003.safetensors: 62%|██████▏ | 6.16G/9.99G [00:10<00:05, 650MB/s] model-00001-of-00003.safetensors: 62%|██████▏ | 6.24G/9.99G [00:10<00:06, 545MB/s] model-00001-of-00003.safetensors: 63%|██████▎ | 6.31G/9.99G [00:11<00:06, 544MB/s] model-00001-of-00003.safetensors: 64%|██████▍ | 6.44G/9.99G [00:11<00:05, 663MB/s] model-00001-of-00003.safetensors: 65%|██████▌ | 6.53G/9.99G [00:11<00:04, 714MB/s] model-00001-of-00003.safetensors: 67%|██████▋ | 6.70G/9.99G [00:11<00:03, 917MB/s] model-00001-of-00003.safetensors: 68%|██████▊ | 6.83G/9.99G [00:11<00:03, 996MB/s] model-00001-of-00003.safetensors: 70%|███████ | 7.00G/9.99G [00:11<00:02, 1.19GB/s] model-00001-of-00003.safetensors: 72%|███████▏ | 7.14G/9.99G [00:11<00:02, 953MB/s] model-00001-of-00003.safetensors: 73%|███████▎ | 7.26G/9.99G [00:12<00:04, 672MB/s] model-00001-of-00003.safetensors: 74%|███████▎ | 7.35G/9.99G [00:12<00:04, 577MB/s] model-00001-of-00003.safetensors: 74%|███████▍ | 7.42G/9.99G [00:12<00:05, 498MB/s] model-00001-of-00003.safetensors: 76%|███████▌ | 7.57G/9.99G [00:12<00:03, 653MB/s] model-00001-of-00003.safetensors: 77%|███████▋ | 7.70G/9.99G [00:12<00:03, 756MB/s] model-00001-of-00003.safetensors: 78%|███████▊ | 7.82G/9.99G [00:12<00:02, 827MB/s] model-00001-of-00003.safetensors: 80%|███████▉ | 7.97G/9.99G [00:13<00:02, 958MB/s] model-00001-of-00003.safetensors: 81%|████████ | 8.08G/9.99G [00:13<00:02, 821MB/s] model-00001-of-00003.safetensors: 82%|████████▏ | 8.21G/9.99G [00:13<00:01, 899MB/s] model-00001-of-00003.safetensors: 83%|████████▎ | 8.34G/9.99G [00:13<00:01, 970MB/s] model-00001-of-00003.safetensors: 85%|████████▍ | 8.45G/9.99G [00:13<00:01, 1.00GB/s] model-00001-of-00003.safetensors: 86%|████████▌ | 8.57G/9.99G [00:13<00:01, 980MB/s] model-00001-of-00003.safetensors: 87%|████████▋ | 8.67G/9.99G [00:13<00:01, 940MB/s] model-00001-of-00003.safetensors: 88%|████████▊ | 8.78G/9.99G [00:13<00:01, 759MB/s] model-00001-of-00003.safetensors: 89%|████████▊ | 8.86G/9.99G [00:14<00:01, 733MB/s] model-00001-of-00003.safetensors: 90%|████████▉ | 8.94G/9.99G [00:14<00:01, 730MB/s] model-00001-of-00003.safetensors: 91%|█████████ | 9.09G/9.99G [00:14<00:00, 909MB/s] model-00001-of-00003.safetensors: 92%|█████████▏| 9.23G/9.99G [00:14<00:00, 1.02GB/s] model-00001-of-00003.safetensors: 94%|█████████▍| 9.36G/9.99G [00:14<00:00, 1.11GB/s] model-00001-of-00003.safetensors: 95%|█████████▌| 9.51G/9.99G [00:14<00:00, 1.19GB/s] model-00001-of-00003.safetensors: 97%|█████████▋| 9.74G/9.99G [00:14<00:00, 1.47GB/s] model-00001-of-00003.safetensors: 99%|█████████▉| 9.89G/9.99G [00:14<00:00, 1.25GB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.99G/9.99G [00:14<00:00, 666MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00002-of-00003.safetensors: 0%| | 0.00/9.90G [00:00<?, ?B/s] model-00002-of-00003.safetensors: 0%| | 10.5M/9.90G [00:00<09:11, 17.9MB/s] model-00002-of-00003.safetensors: 0%| | 21.0M/9.90G [00:02<21:01, 7.83MB/s] model-00002-of-00003.safetensors: 0%| | 31.5M/9.90G [00:02<14:24, 11.4MB/s] model-00002-of-00003.safetensors: 1%| | 73.4M/9.90G [00:02<04:18, 38.0MB/s] model-00002-of-00003.safetensors: 1%| | 94.4M/9.90G [00:03<03:11, 51.3MB/s] model-00002-of-00003.safetensors: 1%|▏ | 136M/9.90G [00:03<01:49, 89.4MB/s] model-00002-of-00003.safetensors: 3%|▎ | 283M/9.90G [00:03<00:36, 267MB/s] model-00002-of-00003.safetensors: 4%|▎ | 367M/9.90G [00:03<00:27, 352MB/s] model-00002-of-00003.safetensors: 5%|▍ | 472M/9.90G [00:03<00:20, 467MB/s] model-00002-of-00003.safetensors: 11%|█ | 1.07G/9.90G [00:03<00:08, 1.03GB/s] model-00002-of-00003.safetensors: 12%|█▏ | 1.17G/9.90G [00:04<00:15, 580MB/s] model-00002-of-00003.safetensors: 13%|█▎ | 1.26G/9.90G [00:04<00:15, 560MB/s] model-00002-of-00003.safetensors: 15%|█▍ | 1.45G/9.90G [00:04<00:11, 715MB/s] model-00002-of-00003.safetensors: 16%|█▌ | 1.55G/9.90G [00:04<00:11, 699MB/s] model-00002-of-00003.safetensors: 17%|█▋ | 1.67G/9.90G [00:05<00:10, 774MB/s] model-00002-of-00003.safetensors: 18%|█▊ | 1.79G/9.90G [00:05<00:09, 827MB/s] model-00002-of-00003.safetensors: 19%|█▉ | 1.90G/9.90G [00:05<00:09, 866MB/s] model-00002-of-00003.safetensors: 20%|██ | 2.00G/9.90G [00:05<00:09, 867MB/s] model-00002-of-00003.safetensors: 22%|██▏ | 2.14G/9.90G [00:05<00:07, 972MB/s] model-00002-of-00003.safetensors: 24%|██▍ | 2.36G/9.90G [00:05<00:05, 1.28GB/s] model-00002-of-00003.safetensors: 26%|██▌ | 2.58G/9.90G [00:05<00:05, 1.42GB/s] model-00002-of-00003.safetensors: 28%|██▊ | 2.74G/9.90G [00:06<00:07, 947MB/s] model-00002-of-00003.safetensors: 29%|██▉ | 2.86G/9.90G [00:06<00:10, 672MB/s] model-00002-of-00003.safetensors: 30%|██▉ | 2.97G/9.90G [00:06<00:11, 617MB/s] model-00002-of-00003.safetensors: 31%|███ | 3.05G/9.90G [00:06<00:12, 552MB/s] model-00002-of-00003.safetensors: 32%|███▏ | 3.15G/9.90G [00:06<00:11, 600MB/s] model-00002-of-00003.safetensors: 33%|███▎ | 3.25G/9.90G [00:07<00:09, 675MB/s] model-00002-of-00003.safetensors: 34%|███▍ | 3.40G/9.90G [00:07<00:07, 820MB/s] model-00002-of-00003.safetensors: 37%|███▋ | 3.69G/9.90G [00:07<00:04, 1.27GB/s] model-00002-of-00003.safetensors: 39%|███▉ | 3.85G/9.90G [00:07<00:06, 913MB/s] model-00002-of-00003.safetensors: 40%|████ | 3.97G/9.90G [00:07<00:08, 683MB/s] model-00002-of-00003.safetensors: 41%|████ | 4.08G/9.90G [00:08<00:08, 687MB/s] model-00002-of-00003.safetensors: 42%|████▏ | 4.17G/9.90G [00:08<00:09, 631MB/s] model-00002-of-00003.safetensors: 43%|████▎ | 4.26G/9.90G [00:08<00:09, 599MB/s] model-00002-of-00003.safetensors: 44%|████▍ | 4.34G/9.90G [00:08<00:08, 633MB/s] model-00002-of-00003.safetensors: 45%|████▌ | 4.49G/9.90G [00:08<00:06, 795MB/s] model-00002-of-00003.safetensors: 47%|████▋ | 4.70G/9.90G [00:08<00:04, 1.08GB/s] model-00002-of-00003.safetensors: 49%|████▊ | 4.82G/9.90G [00:08<00:04, 1.07GB/s] model-00002-of-00003.safetensors: 50%|████▉ | 4.95G/9.90G [00:09<00:05, 834MB/s] model-00002-of-00003.safetensors: 51%|█████ | 5.05G/9.90G [00:09<00:07, 654MB/s] model-00002-of-00003.safetensors: 52%|█████▏ | 5.14G/9.90G [00:09<00:07, 654MB/s] model-00002-of-00003.safetensors: 53%|█████▎ | 5.22G/9.90G [00:09<00:07, 616MB/s] model-00002-of-00003.safetensors: 53%|█████▎ | 5.30G/9.90G [00:09<00:08, 562MB/s] model-00002-of-00003.safetensors: 54%|█████▍ | 5.39G/9.90G [00:09<00:07, 601MB/s] model-00002-of-00003.safetensors: 56%|█████▌ | 5.52G/9.90G [00:10<00:05, 734MB/s] model-00002-of-00003.safetensors: 57%|█████▋ | 5.66G/9.90G [00:10<00:05, 845MB/s] model-00002-of-00003.safetensors: 59%|█████▉ | 5.85G/9.90G [00:10<00:03, 1.09GB/s] model-00002-of-00003.safetensors: 60%|██████ | 5.98G/9.90G [00:10<00:03, 1.01GB/s] model-00002-of-00003.safetensors: 62%|██████▏ | 6.09G/9.90G [00:10<00:05, 635MB/s] model-00002-of-00003.safetensors: 63%|██████▎ | 6.21G/9.90G [00:10<00:05, 670MB/s] model-00002-of-00003.safetensors: 64%|██████▎ | 6.29G/9.90G [00:11<00:05, 658MB/s] model-00002-of-00003.safetensors: 64%|██████▍ | 6.38G/9.90G [00:11<00:05, 627MB/s] model-00002-of-00003.safetensors: 65%|██████▌ | 6.47G/9.90G [00:11<00:05, 683MB/s] model-00002-of-00003.safetensors: 67%|██████▋ | 6.59G/9.90G [00:11<00:04, 744MB/s] model-00002-of-00003.safetensors: 68%|██████▊ | 6.76G/9.90G [00:11<00:03, 984MB/s] model-00002-of-00003.safetensors: 70%|███████ | 6.94G/9.90G [00:11<00:02, 1.17GB/s] model-00002-of-00003.safetensors: 72%|███████▏ | 7.08G/9.90G [00:11<00:02, 1.02GB/s] model-00002-of-00003.safetensors: 73%|███████▎ | 7.19G/9.90G [00:12<00:04, 618MB/s] model-00002-of-00003.safetensors: 74%|███████▎ | 7.29G/9.90G [00:12<00:03, 668MB/s] model-00002-of-00003.safetensors: 75%|███████▍ | 7.38G/9.90G [00:12<00:04, 599MB/s] model-00002-of-00003.safetensors: 75%|███████▌ | 7.47G/9.90G [00:12<00:03, 624MB/s] model-00002-of-00003.safetensors: 76%|███████▋ | 7.57G/9.90G [00:12<00:03, 673MB/s] model-00002-of-00003.safetensors: 78%|███████▊ | 7.68G/9.90G [00:12<00:03, 735MB/s] model-00002-of-00003.safetensors: 80%|███████▉ | 7.89G/9.90G [00:13<00:01, 1.03GB/s] model-00002-of-00003.safetensors: 81%|████████ | 8.03G/9.90G [00:13<00:01, 1.10GB/s] model-00002-of-00003.safetensors: 82%|████████▏ | 8.16G/9.90G [00:13<00:01, 1.05GB/s] model-00002-of-00003.safetensors: 84%|████████▎ | 8.27G/9.90G [00:13<00:02, 653MB/s] model-00002-of-00003.safetensors: 85%|████████▍ | 8.37G/9.90G [00:13<00:02, 676MB/s] model-00002-of-00003.safetensors: 85%|████████▌ | 8.46G/9.90G [00:13<00:02, 655MB/s] model-00002-of-00003.safetensors: 86%|████████▋ | 8.55G/9.90G [00:14<00:02, 627MB/s] model-00002-of-00003.safetensors: 87%|████████▋ | 8.64G/9.90G [00:14<00:01, 681MB/s] model-00002-of-00003.safetensors: 88%|████████▊ | 8.73G/9.90G [00:14<00:01, 703MB/s] model-00002-of-00003.safetensors: 90%|████████▉ | 8.89G/9.90G [00:14<00:01, 899MB/s] model-00002-of-00003.safetensors: 92%|█████████▏| 9.06G/9.90G [00:14<00:00, 1.06GB/s] model-00002-of-00003.safetensors: 93%|█████████▎| 9.20G/9.90G [00:14<00:00, 1.06GB/s] model-00002-of-00003.safetensors: 94%|█████████▍| 9.31G/9.90G [00:14<00:00, 828MB/s] model-00002-of-00003.safetensors: 96%|█████████▌| 9.48G/9.90G [00:14<00:00, 986MB/s] model-00002-of-00003.safetensors: 97%|█████████▋| 9.62G/9.90G [00:15<00:00, 1.07GB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.90G/9.90G [00:15<00:00, 651MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00003-of-00003.safetensors: 0%| | 0.00/5.87G [00:00<?, ?B/s] model-00003-of-00003.safetensors: 0%| | 10.5M/5.87G [00:01<14:33, 6.71MB/s] model-00003-of-00003.safetensors: 0%| | 21.0M/5.87G [00:02<12:25, 7.85MB/s] model-00003-of-00003.safetensors: 1%| | 52.4M/5.87G [00:02<03:45, 25.9MB/s] model-00003-of-00003.safetensors: 1%| | 73.4M/5.87G [00:03<02:38, 36.7MB/s] model-00003-of-00003.safetensors: 2%|▏ | 147M/5.87G [00:03<00:56, 101MB/s] model-00003-of-00003.safetensors: 5%|▌ | 315M/5.87G [00:03<00:19, 280MB/s] model-00003-of-00003.safetensors: 8%|▊ | 472M/5.87G [00:03<00:11, 457MB/s] model-00003-of-00003.safetensors: 10%|▉ | 577M/5.87G [00:03<00:11, 479MB/s] model-00003-of-00003.safetensors: 19%|█▊ | 1.10G/5.87G [00:03<00:04, 1.17GB/s] model-00003-of-00003.safetensors: 22%|██▏ | 1.27G/5.87G [00:04<00:08, 531MB/s] model-00003-of-00003.safetensors: 26%|██▌ | 1.50G/5.87G [00:04<00:06, 699MB/s] model-00003-of-00003.safetensors: 28%|██▊ | 1.65G/5.87G [00:05<00:06, 640MB/s] model-00003-of-00003.safetensors: 31%|███ | 1.81G/5.87G [00:05<00:05, 763MB/s] model-00003-of-00003.safetensors: 33%|███▎ | 1.95G/5.87G [00:05<00:04, 846MB/s] model-00003-of-00003.safetensors: 37%|███▋ | 2.19G/5.87G [00:05<00:03, 1.11GB/s] model-00003-of-00003.safetensors: 40%|████ | 2.36G/5.87G [00:05<00:03, 1.13GB/s] model-00003-of-00003.safetensors: 46%|████▌ | 2.67G/5.87G [00:05<00:02, 1.09GB/s] model-00003-of-00003.safetensors: 48%|████▊ | 2.81G/5.87G [00:06<00:04, 646MB/s] model-00003-of-00003.safetensors: 50%|████▉ | 2.92G/5.87G [00:06<00:04, 658MB/s] model-00003-of-00003.safetensors: 51%|█████ | 3.01G/5.87G [00:06<00:04, 698MB/s] model-00003-of-00003.safetensors: 53%|█████▎ | 3.12G/5.87G [00:06<00:03, 757MB/s] model-00003-of-00003.safetensors: 55%|█████▌ | 3.25G/5.87G [00:06<00:03, 847MB/s] model-00003-of-00003.safetensors: 57%|█████▋ | 3.36G/5.87G [00:06<00:03, 825MB/s] model-00003-of-00003.safetensors: 60%|██████ | 3.53G/5.87G [00:07<00:02, 1.03GB/s] model-00003-of-00003.safetensors: 63%|██████▎ | 3.71G/5.87G [00:07<00:01, 1.20GB/s] model-00003-of-00003.safetensors: 66%|██████▌ | 3.85G/5.87G [00:07<00:03, 628MB/s] model-00003-of-00003.safetensors: 67%|██████▋ | 3.95G/5.87G [00:07<00:03, 564MB/s] model-00003-of-00003.safetensors: 69%|██████▉ | 4.06G/5.87G [00:07<00:02, 631MB/s] model-00003-of-00003.safetensors: 72%|███████▏ | 4.22G/5.87G [00:08<00:02, 790MB/s] model-00003-of-00003.safetensors: 74%|███████▎ | 4.33G/5.87G [00:08<00:01, 825MB/s] model-00003-of-00003.safetensors: 76%|███████▌ | 4.44G/5.87G [00:08<00:01, 868MB/s] model-00003-of-00003.safetensors: 77%|███████▋ | 4.54G/5.87G [00:08<00:01, 901MB/s] model-00003-of-00003.safetensors: 81%|████████ | 4.74G/5.87G [00:08<00:00, 1.17GB/s] model-00003-of-00003.safetensors: 83%|████████▎ | 4.88G/5.87G [00:08<00:01, 649MB/s] model-00003-of-00003.safetensors: 85%|████████▍ | 4.98G/5.87G [00:09<00:01, 547MB/s] model-00003-of-00003.safetensors: 87%|████████▋ | 5.13G/5.87G [00:09<00:01, 678MB/s] model-00003-of-00003.safetensors: 91%|█████████ | 5.32G/5.87G [00:09<00:00, 868MB/s] model-00003-of-00003.safetensors: 94%|█████████▍| 5.51G/5.87G [00:09<00:00, 1.05GB/s] model-00003-of-00003.safetensors: 97%|█████████▋| 5.69G/5.87G [00:09<00:00, 1.22GB/s] model-00003-of-00003.safetensors: 100%|█████████▉| 5.87G/5.87G [00:09<00:00, 604MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model.safetensors.index.json: 0%| | 0.00/39.2k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 39.2k/39.2k [00:00<00:00, 7.22MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: special_tokens_map.json: 0%| | 0.00/436 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 436/436 [00:00<00:00, 5.54MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer.json: 0%| | 0.00/1.80M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 16.1MB/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 16.0MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer.model: 0%| | 0.00/493k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 5.88MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer_config.json: 0%| | 0.00/968 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 968/968 [00:00<00:00, 11.5MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: Downloaded to shared memory in 45.021s
arlineka-nyans-13b-esp1-v1-mkmlizer: quantizing model to /dev/shm/model_cache
arlineka-nyans-13b-esp1-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
arlineka-nyans-13b-esp1-v1-mkmlizer: Traceback (most recent call last):
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 147, in <module>
arlineka-nyans-13b-esp1-v1-mkmlizer: cli()
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1128, in __call__
arlineka-nyans-13b-esp1-v1-mkmlizer: return self.main(*args, **kwargs)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1053, in main
arlineka-nyans-13b-esp1-v1-mkmlizer: rv = self.invoke(ctx)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return _process_result(sub_ctx.command.invoke(sub_ctx))
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1395, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return ctx.invoke(self.callback, **ctx.params)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 754, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return __callback(*args, **kwargs)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 42, in quantize
arlineka-nyans-13b-esp1-v1-mkmlizer: quantize_model(temp_folder, output_path, profile, device)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 131, in quantize_model
arlineka-nyans-13b-esp1-v1-mkmlizer: mkml.instrument(
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/mk1/mkml/instrument.py", line 70, in instrument
arlineka-nyans-13b-esp1-v1-mkmlizer: raise NotImplementedError(config.architectures)
arlineka-nyans-13b-esp1-v1-mkmlizer: NotImplementedError: ['MixtralForCausalLM']
Job arlineka-nyans-13b-esp1-v1-mkmlizer completed after 53.61s with status: failed
Stopping job with name arlineka-nyans-13b-esp1-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name arlineka-nyans-13b-esp1-v1-mkmlizer
Waiting for job on arlineka-nyans-13b-esp1-v1-mkmlizer to finish
arlineka-nyans-13b-esp1-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ _____ __ __ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /___/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Version: 0.6.11 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ The license key for the current software has been verified as ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ belonging to: ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Chai Research Corp. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 15.4MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitignore: 0%| | 0.00/19.0 [00:00<?, ?B/s] .gitignore: 100%|██████████| 19.0/19.0 [00:00<00:00, 216kB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: README.md: 0%| | 0.00/78.0 [00:00<?, ?B/s] README.md: 100%|██████████| 78.0/78.0 [00:00<00:00, 1.04MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: config.json: 0%| | 0.00/817 [00:00<?, ?B/s] config.json: 100%|██████████| 817/817 [00:00<00:00, 12.4MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00001-of-00003.safetensors: 0%| | 0.00/9.99G [00:00<?, ?B/s] model-00001-of-00003.safetensors: 0%| | 10.5M/9.99G [00:00<14:04, 11.8MB/s] model-00001-of-00003.safetensors: 0%| | 21.0M/9.99G [00:00<06:48, 24.4MB/s] model-00001-of-00003.safetensors: 0%| | 41.9M/9.99G [00:01<03:46, 43.9MB/s] model-00001-of-00003.safetensors: 1%| | 52.4M/9.99G [00:01<03:51, 42.8MB/s] model-00001-of-00003.safetensors: 1%| | 115M/9.99G [00:01<01:17, 127MB/s] model-00001-of-00003.safetensors: 2%|▏ | 178M/9.99G [00:01<00:45, 214MB/s] model-00001-of-00003.safetensors: 3%|▎ | 304M/9.99G [00:01<00:23, 421MB/s] model-00001-of-00003.safetensors: 9%|▉ | 912M/9.99G [00:01<00:05, 1.67GB/s] model-00001-of-00003.safetensors: 12%|█▏ | 1.15G/9.99G [00:02<00:05, 1.68GB/s] model-00001-of-00003.safetensors: 14%|█▍ | 1.37G/9.99G [00:02<00:07, 1.18GB/s] model-00001-of-00003.safetensors: 16%|█▌ | 1.58G/9.99G [00:02<00:06, 1.34GB/s] model-00001-of-00003.safetensors: 18%|█▊ | 1.77G/9.99G [00:02<00:05, 1.44GB/s] model-00001-of-00003.safetensors: 20%|█▉ | 1.96G/9.99G [00:02<00:05, 1.50GB/s] model-00001-of-00003.safetensors: 22%|██▏ | 2.21G/9.99G [00:02<00:04, 1.72GB/s] model-00001-of-00003.safetensors: 25%|██▌ | 2.53G/9.99G [00:02<00:03, 2.05GB/s] model-00001-of-00003.safetensors: 28%|██▊ | 2.77G/9.99G [00:03<00:03, 2.12GB/s] model-00001-of-00003.safetensors: 30%|███ | 3.00G/9.99G [00:03<00:03, 1.75GB/s] model-00001-of-00003.safetensors: 32%|███▏ | 3.20G/9.99G [00:03<00:04, 1.42GB/s] model-00001-of-00003.safetensors: 34%|███▎ | 3.37G/9.99G [00:03<00:04, 1.45GB/s] model-00001-of-00003.safetensors: 35%|███▌ | 3.53G/9.99G [00:03<00:04, 1.36GB/s] model-00001-of-00003.safetensors: 37%|███▋ | 3.69G/9.99G [00:03<00:05, 1.20GB/s] model-00001-of-00003.safetensors: 39%|███▊ | 3.87G/9.99G [00:03<00:04, 1.32GB/s] model-00001-of-00003.safetensors: 40%|████ | 4.02G/9.99G [00:04<00:04, 1.20GB/s] model-00001-of-00003.safetensors: 42%|████▏ | 4.15G/9.99G [00:04<00:05, 1.16GB/s] model-00001-of-00003.safetensors: 44%|████▎ | 4.36G/9.99G [00:04<00:04, 1.33GB/s] model-00001-of-00003.safetensors: 45%|████▌ | 4.52G/9.99G [00:04<00:04, 1.34GB/s] model-00001-of-00003.safetensors: 47%|████▋ | 4.67G/9.99G [00:04<00:04, 1.29GB/s] model-00001-of-00003.safetensors: 48%|████▊ | 4.83G/9.99G [00:04<00:03, 1.35GB/s] model-00001-of-00003.safetensors: 50%|█████ | 5.03G/9.99G [00:04<00:03, 1.49GB/s] model-00001-of-00003.safetensors: 52%|█████▏ | 5.19G/9.99G [00:04<00:03, 1.34GB/s] model-00001-of-00003.safetensors: 53%|█████▎ | 5.34G/9.99G [00:05<00:03, 1.34GB/s] model-00001-of-00003.safetensors: 55%|█████▌ | 5.51G/9.99G [00:05<00:03, 1.43GB/s] model-00001-of-00003.safetensors: 57%|█████▋ | 5.65G/9.99G [00:05<00:03, 1.40GB/s] model-00001-of-00003.safetensors: 58%|█████▊ | 5.80G/9.99G [00:05<00:02, 1.40GB/s] model-00001-of-00003.safetensors: 60%|██████ | 6.03G/9.99G [00:05<00:02, 1.63GB/s] model-00001-of-00003.safetensors: 63%|██████▎ | 6.28G/9.99G [00:05<00:01, 1.87GB/s] model-00001-of-00003.safetensors: 65%|██████▌ | 6.51G/9.99G [00:05<00:01, 2.00GB/s] model-00001-of-00003.safetensors: 68%|██████▊ | 6.74G/9.99G [00:05<00:01, 2.03GB/s] model-00001-of-00003.safetensors: 70%|██████▉ | 6.95G/9.99G [00:05<00:01, 1.97GB/s] model-00001-of-00003.safetensors: 72%|███████▏ | 7.15G/9.99G [00:06<00:01, 1.79GB/s] model-00001-of-00003.safetensors: 74%|███████▎ | 7.35G/9.99G [00:06<00:01, 1.84GB/s] model-00001-of-00003.safetensors: 75%|███████▌ | 7.54G/9.99G [00:06<00:01, 1.69GB/s] model-00001-of-00003.safetensors: 77%|███████▋ | 7.72G/9.99G [00:06<00:01, 1.40GB/s] model-00001-of-00003.safetensors: 79%|███████▉ | 7.90G/9.99G [00:06<00:01, 1.42GB/s] model-00001-of-00003.safetensors: 82%|████████▏ | 8.18G/9.99G [00:06<00:01, 1.73GB/s] model-00001-of-00003.safetensors: 84%|████████▍ | 8.37G/9.99G [00:06<00:01, 1.55GB/s] model-00001-of-00003.safetensors: 85%|████████▌ | 8.54G/9.99G [00:07<00:01, 1.32GB/s] model-00001-of-00003.safetensors: 87%|████████▋ | 8.68G/9.99G [00:07<00:00, 1.34GB/s] model-00001-of-00003.safetensors: 89%|████████▉ | 8.88G/9.99G [00:07<00:00, 1.46GB/s] model-00001-of-00003.safetensors: 91%|█████████ | 9.11G/9.99G [00:07<00:00, 1.65GB/s] model-00001-of-00003.safetensors: 94%|█████████▎| 9.35G/9.99G [00:07<00:00, 1.78GB/s] model-00001-of-00003.safetensors: 96%|█████████▋| 9.62G/9.99G [00:07<00:00, 1.98GB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.99G/9.99G [00:07<00:00, 1.29GB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00002-of-00003.safetensors: 0%| | 0.00/9.90G [00:00<?, ?B/s] model-00002-of-00003.safetensors: 0%| | 10.5M/9.90G [00:00<13:38, 12.1MB/s] model-00002-of-00003.safetensors: 0%| | 21.0M/9.90G [00:00<06:40, 24.6MB/s] model-00002-of-00003.safetensors: 0%| | 31.5M/9.90G [00:01<04:41, 35.0MB/s] model-00002-of-00003.safetensors: 0%| | 41.9M/9.90G [00:01<05:47, 28.4MB/s] model-00002-of-00003.safetensors: 1%|▏ | 136M/9.90G [00:01<01:07, 144MB/s] model-00002-of-00003.safetensors: 4%|▎ | 357M/9.90G [00:01<00:20, 459MB/s] model-00002-of-00003.safetensors: 11%|█ | 1.07G/9.90G [00:01<00:05, 1.65GB/s] model-00002-of-00003.safetensors: 14%|█▍ | 1.36G/9.90G [00:02<00:07, 1.19GB/s] model-00002-of-00003.safetensors: 19%|█▉ | 1.87G/9.90G [00:02<00:04, 1.77GB/s] model-00002-of-00003.safetensors: 22%|██▏ | 2.18G/9.90G [00:02<00:05, 1.43GB/s] model-00002-of-00003.safetensors: 25%|██▍ | 2.43G/9.90G [00:03<00:08, 861MB/s] model-00002-of-00003.safetensors: 26%|██▋ | 2.62G/9.90G [00:03<00:08, 897MB/s] model-00002-of-00003.safetensors: 28%|██▊ | 2.79G/9.90G [00:03<00:07, 891MB/s] model-00002-of-00003.safetensors: 30%|██▉ | 2.94G/9.90G [00:03<00:07, 925MB/s] model-00002-of-00003.safetensors: 31%|███ | 3.07G/9.90G [00:04<00:08, 798MB/s] model-00002-of-00003.safetensors: 32%|███▏ | 3.19G/9.90G [00:04<00:07, 839MB/s] model-00002-of-00003.safetensors: 34%|███▍ | 3.36G/9.90G [00:04<00:06, 979MB/s] model-00002-of-00003.safetensors: 35%|███▌ | 3.48G/9.90G [00:04<00:06, 1.02GB/s] model-00002-of-00003.safetensors: 36%|███▋ | 3.61G/9.90G [00:04<00:06, 1.02GB/s] model-00002-of-00003.safetensors: 38%|███▊ | 3.73G/9.90G [00:04<00:07, 869MB/s] model-00002-of-00003.safetensors: 39%|███▉ | 3.84G/9.90G [00:04<00:07, 816MB/s] model-00002-of-00003.safetensors: 42%|████▏ | 4.13G/9.90G [00:05<00:04, 1.26GB/s] model-00002-of-00003.safetensors: 45%|████▌ | 4.47G/9.90G [00:05<00:03, 1.73GB/s] model-00002-of-00003.safetensors: 47%|████▋ | 4.68G/9.90G [00:05<00:03, 1.31GB/s] model-00002-of-00003.safetensors: 49%|████▉ | 4.84G/9.90G [00:05<00:04, 1.13GB/s] model-00002-of-00003.safetensors: 52%|█████▏ | 5.14G/9.90G [00:05<00:03, 1.47GB/s] model-00002-of-00003.safetensors: 55%|█████▍ | 5.40G/9.90G [00:05<00:02, 1.71GB/s] model-00002-of-00003.safetensors: 57%|█████▋ | 5.61G/9.90G [00:06<00:02, 1.70GB/s] model-00002-of-00003.safetensors: 59%|█████▉ | 5.85G/9.90G [00:06<00:02, 1.84GB/s] model-00002-of-00003.safetensors: 62%|██████▏ | 6.09G/9.90G [00:06<00:01, 1.92GB/s] model-00002-of-00003.safetensors: 65%|██████▍ | 6.39G/9.90G [00:06<00:01, 2.17GB/s] model-00002-of-00003.safetensors: 67%|██████▋ | 6.62G/9.90G [00:06<00:01, 2.01GB/s] model-00002-of-00003.safetensors: 69%|██████▉ | 6.84G/9.90G [00:06<00:01, 1.78GB/s] model-00002-of-00003.safetensors: 72%|███████▏ | 7.15G/9.90G [00:06<00:01, 2.11GB/s] model-00002-of-00003.safetensors: 75%|███████▍ | 7.38G/9.90G [00:06<00:01, 1.88GB/s] model-00002-of-00003.safetensors: 77%|███████▋ | 7.59G/9.90G [00:07<00:01, 1.70GB/s] model-00002-of-00003.safetensors: 79%|███████▊ | 7.78G/9.90G [00:07<00:01, 1.56GB/s] model-00002-of-00003.safetensors: 80%|████████ | 7.95G/9.90G [00:07<00:01, 1.46GB/s] model-00002-of-00003.safetensors: 83%|████████▎ | 8.23G/9.90G [00:07<00:00, 1.77GB/s] model-00002-of-00003.safetensors: 85%|████████▌ | 8.43G/9.90G [00:07<00:00, 1.49GB/s] model-00002-of-00003.safetensors: 87%|████████▋ | 8.60G/9.90G [00:07<00:00, 1.52GB/s] model-00002-of-00003.safetensors: 89%|████████▊ | 8.77G/9.90G [00:07<00:00, 1.36GB/s] model-00002-of-00003.safetensors: 91%|█████████▏| 9.05G/9.90G [00:07<00:00, 1.68GB/s] model-00002-of-00003.safetensors: 93%|█████████▎| 9.24G/9.90G [00:08<00:00, 1.65GB/s] model-00002-of-00003.safetensors: 96%|█████████▌| 9.46G/9.90G [00:08<00:00, 1.71GB/s] model-00002-of-00003.safetensors: 97%|█████████▋| 9.64G/9.90G [00:08<00:00, 1.21GB/s] model-00002-of-00003.safetensors: 99%|█████████▉| 9.78G/9.90G [00:08<00:00, 1.22GB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.90G/9.90G [00:08<00:00, 1.14GB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00003-of-00003.safetensors: 0%| | 0.00/5.87G [00:00<?, ?B/s] model-00003-of-00003.safetensors: 0%| | 10.5M/5.87G [00:00<07:52, 12.4MB/s] model-00003-of-00003.safetensors: 0%| | 21.0M/5.87G [00:00<03:52, 25.2MB/s] model-00003-of-00003.safetensors: 1%| | 41.9M/5.87G [00:01<02:12, 44.0MB/s] model-00003-of-00003.safetensors: 1%| | 52.4M/5.87G [00:01<02:33, 38.0MB/s] model-00003-of-00003.safetensors: 1%| | 62.9M/5.87G [00:01<02:17, 42.3MB/s] model-00003-of-00003.safetensors: 3%|▎ | 157M/5.87G [00:01<00:32, 178MB/s] model-00003-of-00003.safetensors: 17%|█▋ | 1.03G/5.87G [00:01<00:02, 1.68GB/s] model-00003-of-00003.safetensors: 23%|██▎ | 1.34G/5.87G [00:02<00:03, 1.32GB/s] model-00003-of-00003.safetensors: 30%|██▉ | 1.75G/5.87G [00:02<00:02, 1.69GB/s] model-00003-of-00003.safetensors: 34%|███▍ | 2.02G/5.87G [00:02<00:02, 1.45GB/s] model-00003-of-00003.safetensors: 41%|████▏ | 2.43G/5.87G [00:02<00:01, 1.89GB/s] model-00003-of-00003.safetensors: 46%|████▌ | 2.72G/5.87G [00:03<00:03, 928MB/s] model-00003-of-00003.safetensors: 50%|████▉ | 2.93G/5.87G [00:04<00:04, 672MB/s] model-00003-of-00003.safetensors: 52%|█████▏ | 3.08G/5.87G [00:04<00:05, 531MB/s] model-00003-of-00003.safetensors: 54%|█████▍ | 3.20G/5.87G [00:05<00:06, 408MB/s] model-00003-of-00003.safetensors: 56%|█████▌ | 3.30G/5.87G [00:05<00:05, 454MB/s] model-00003-of-00003.safetensors: 60%|█████▉ | 3.50G/5.87G [00:05<00:04, 592MB/s] model-00003-of-00003.safetensors: 62%|██████▏ | 3.65G/5.87G [00:05<00:03, 673MB/s] model-00003-of-00003.safetensors: 64%|██████▍ | 3.76G/5.87G [00:05<00:02, 739MB/s] model-00003-of-00003.safetensors: 66%|██████▋ | 3.90G/5.87G [00:05<00:02, 843MB/s] model-00003-of-00003.safetensors: 69%|██████▊ | 4.03G/5.87G [00:06<00:02, 825MB/s] model-00003-of-00003.safetensors: 71%|███████ | 4.14G/5.87G [00:06<00:01, 881MB/s] model-00003-of-00003.safetensors: 75%|███████▌ | 4.42G/5.87G [00:06<00:01, 1.30GB/s] model-00003-of-00003.safetensors: 81%|████████ | 4.73G/5.87G [00:06<00:00, 1.69GB/s] model-00003-of-00003.safetensors: 84%|████████▍ | 4.93G/5.87G [00:06<00:00, 1.76GB/s] model-00003-of-00003.safetensors: 88%|████████▊ | 5.19G/5.87G [00:06<00:00, 1.96GB/s] model-00003-of-00003.safetensors: 92%|█████████▏| 5.41G/5.87G [00:06<00:00, 1.49GB/s] model-00003-of-00003.safetensors: 95%|█████████▌| 5.59G/5.87G [00:07<00:00, 1.00GB/s] model-00003-of-00003.safetensors: 98%|█████████▊| 5.74G/5.87G [00:07<00:00, 919MB/s] model-00003-of-00003.safetensors: 100%|█████████▉| 5.87G/5.87G [00:07<00:00, 780MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer.json: 0%| | 0.00/1.80M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 7.48MB/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 7.46MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer.model: 0%| | 0.00/493k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 2.48MB/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 2.48MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer_config.json: 0%| | 0.00/968 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 968/968 [00:00<00:00, 7.84MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: Downloaded to shared memory in 28.717s
arlineka-nyans-13b-esp1-v1-mkmlizer: quantizing model to /dev/shm/model_cache
arlineka-nyans-13b-esp1-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
arlineka-nyans-13b-esp1-v1-mkmlizer: Traceback (most recent call last):
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 147, in <module>
arlineka-nyans-13b-esp1-v1-mkmlizer: cli()
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1128, in __call__
arlineka-nyans-13b-esp1-v1-mkmlizer: return self.main(*args, **kwargs)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1053, in main
arlineka-nyans-13b-esp1-v1-mkmlizer: rv = self.invoke(ctx)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return _process_result(sub_ctx.command.invoke(sub_ctx))
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1395, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return ctx.invoke(self.callback, **ctx.params)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 754, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return __callback(*args, **kwargs)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 42, in quantize
arlineka-nyans-13b-esp1-v1-mkmlizer: quantize_model(temp_folder, output_path, profile, device)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 131, in quantize_model
arlineka-nyans-13b-esp1-v1-mkmlizer: mkml.instrument(
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/mk1/mkml/instrument.py", line 70, in instrument
arlineka-nyans-13b-esp1-v1-mkmlizer: raise NotImplementedError(config.architectures)
arlineka-nyans-13b-esp1-v1-mkmlizer: NotImplementedError: ['MixtralForCausalLM']
Job arlineka-nyans-13b-esp1-v1-mkmlizer completed after 43.74s with status: failed
Stopping job with name arlineka-nyans-13b-esp1-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name arlineka-nyans-13b-esp1-v1-mkmlizer
Waiting for job on arlineka-nyans-13b-esp1-v1-mkmlizer to finish
arlineka-nyans-13b-esp1-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ _____ __ __ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /___/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Version: 0.6.11 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ The license key for the current software has been verified as ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ belonging to: ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Chai Research Corp. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 18.8MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitignore: 0%| | 0.00/19.0 [00:00<?, ?B/s] .gitignore: 100%|██████████| 19.0/19.0 [00:00<00:00, 147kB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: README.md: 0%| | 0.00/78.0 [00:00<?, ?B/s] README.md: 100%|██████████| 78.0/78.0 [00:00<00:00, 1.14MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: config.json: 0%| | 0.00/817 [00:00<?, ?B/s] config.json: 100%|██████████| 817/817 [00:00<00:00, 5.83MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00001-of-00003.safetensors: 0%| | 0.00/9.99G [00:00<?, ?B/s] model-00001-of-00003.safetensors: 0%| | 10.5M/9.99G [00:00<06:25, 25.9MB/s] model-00001-of-00003.safetensors: 0%| | 31.5M/9.99G [00:00<02:25, 68.3MB/s] model-00001-of-00003.safetensors: 1%| | 52.4M/9.99G [00:00<01:37, 102MB/s] model-00001-of-00003.safetensors: 1%| | 73.4M/9.99G [00:01<02:10, 75.7MB/s] model-00001-of-00003.safetensors: 1%| | 94.4M/9.99G [00:01<01:39, 99.1MB/s] model-00001-of-00003.safetensors: 2%|▏ | 157M/9.99G [00:01<00:47, 207MB/s] model-00001-of-00003.safetensors: 5%|▌ | 524M/9.99G [00:01<00:09, 983MB/s] model-00001-of-00003.safetensors: 11%|█ | 1.12G/9.99G [00:01<00:04, 2.16GB/s] model-00001-of-00003.safetensors: 14%|█▍ | 1.41G/9.99G [00:01<00:05, 1.44GB/s] model-00001-of-00003.safetensors: 16%|█▋ | 1.63G/9.99G [00:01<00:05, 1.44GB/s] model-00001-of-00003.safetensors: 20%|██ | 2.01G/9.99G [00:02<00:04, 1.90GB/s] model-00001-of-00003.safetensors: 23%|██▎ | 2.34G/9.99G [00:02<00:03, 2.08GB/s] model-00001-of-00003.safetensors: 26%|██▌ | 2.60G/9.99G [00:02<00:04, 1.82GB/s] model-00001-of-00003.safetensors: 28%|██▊ | 2.82G/9.99G [00:02<00:03, 1.84GB/s] model-00001-of-00003.safetensors: 31%|███ | 3.05G/9.99G [00:02<00:03, 1.81GB/s] model-00001-of-00003.safetensors: 33%|███▎ | 3.25G/9.99G [00:02<00:04, 1.56GB/s] model-00001-of-00003.safetensors: 34%|███▍ | 3.43G/9.99G [00:02<00:04, 1.55GB/s] model-00001-of-00003.safetensors: 39%|███▊ | 3.87G/9.99G [00:02<00:02, 2.20GB/s] model-00001-of-00003.safetensors: 42%|████▏ | 4.16G/9.99G [00:03<00:02, 2.36GB/s] model-00001-of-00003.safetensors: 44%|████▍ | 4.42G/9.99G [00:03<00:03, 1.78GB/s] model-00001-of-00003.safetensors: 48%|████▊ | 4.79G/9.99G [00:03<00:02, 2.17GB/s] model-00001-of-00003.safetensors: 51%|█████ | 5.05G/9.99G [00:03<00:02, 1.95GB/s] model-00001-of-00003.safetensors: 53%|█████▎ | 5.28G/9.99G [00:03<00:02, 1.79GB/s] model-00001-of-00003.safetensors: 56%|█████▌ | 5.58G/9.99G [00:03<00:02, 2.02GB/s] model-00001-of-00003.safetensors: 58%|█████▊ | 5.83G/9.99G [00:03<00:01, 2.12GB/s] model-00001-of-00003.safetensors: 61%|██████ | 6.06G/9.99G [00:04<00:01, 2.05GB/s] model-00001-of-00003.safetensors: 63%|██████▎ | 6.28G/9.99G [00:04<00:01, 2.05GB/s] model-00001-of-00003.safetensors: 65%|██████▌ | 6.50G/9.99G [00:04<00:01, 1.98GB/s] model-00001-of-00003.safetensors: 68%|██████▊ | 6.75G/9.99G [00:04<00:01, 2.09GB/s] model-00001-of-00003.safetensors: 70%|██████▉ | 6.97G/9.99G [00:04<00:01, 1.62GB/s] model-00001-of-00003.safetensors: 72%|███████▏ | 7.20G/9.99G [00:04<00:01, 1.75GB/s] model-00001-of-00003.safetensors: 75%|███████▌ | 7.54G/9.99G [00:04<00:01, 2.11GB/s] model-00001-of-00003.safetensors: 78%|███████▊ | 7.80G/9.99G [00:04<00:00, 2.21GB/s] model-00001-of-00003.safetensors: 81%|████████ | 8.07G/9.99G [00:05<00:00, 2.33GB/s] model-00001-of-00003.safetensors: 83%|████████▎ | 8.33G/9.99G [00:05<00:00, 2.36GB/s] model-00001-of-00003.safetensors: 86%|████████▌ | 8.58G/9.99G [00:05<00:00, 2.27GB/s] model-00001-of-00003.safetensors: 88%|████████▊ | 8.83G/9.99G [00:05<00:00, 2.34GB/s] model-00001-of-00003.safetensors: 91%|█████████ | 9.07G/9.99G [00:05<00:00, 2.17GB/s] model-00001-of-00003.safetensors: 93%|█████████▎| 9.29G/9.99G [00:05<00:00, 2.12GB/s] model-00001-of-00003.safetensors: 95%|█████████▌| 9.52G/9.99G [00:05<00:00, 2.08GB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.98G/9.99G [00:06<00:00, 1.62GB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.99G/9.99G [00:06<00:00, 1.57GB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00002-of-00003.safetensors: 0%| | 0.00/9.90G [00:00<?, ?B/s] model-00002-of-00003.safetensors: 0%| | 10.5M/9.90G [00:00<06:18, 26.1MB/s] model-00002-of-00003.safetensors: 0%| | 31.5M/9.90G [00:00<03:00, 54.7MB/s] model-00002-of-00003.safetensors: 1%| | 115M/9.90G [00:00<00:47, 205MB/s] model-00002-of-00003.safetensors: 1%|▏ | 147M/9.90G [00:01<01:05, 149MB/s] model-00002-of-00003.safetensors: 6%|▋ | 640M/9.90G [00:01<00:09, 960MB/s] model-00002-of-00003.safetensors: 13%|█▎ | 1.25G/9.90G [00:01<00:04, 1.91GB/s] model-00002-of-00003.safetensors: 16%|█▌ | 1.56G/9.90G [00:01<00:06, 1.35GB/s] model-00002-of-00003.safetensors: 18%|█▊ | 1.80G/9.90G [00:01<00:05, 1.41GB/s] model-00002-of-00003.safetensors: 24%|██▎ | 2.33G/9.90G [00:01<00:03, 2.05GB/s] model-00002-of-00003.safetensors: 27%|██▋ | 2.63G/9.90G [00:02<00:03, 2.00GB/s] model-00002-of-00003.safetensors: 29%|██▉ | 2.90G/9.90G [00:02<00:03, 2.13GB/s] model-00002-of-00003.safetensors: 32%|███▏ | 3.18G/9.90G [00:02<00:03, 2.11GB/s] model-00002-of-00003.safetensors: 35%|███▍ | 3.43G/9.90G [00:02<00:02, 2.20GB/s] model-00002-of-00003.safetensors: 38%|███▊ | 3.75G/9.90G [00:02<00:02, 2.38GB/s] model-00002-of-00003.safetensors: 41%|████ | 4.02G/9.90G [00:02<00:03, 1.88GB/s] model-00002-of-00003.safetensors: 43%|████▎ | 4.24G/9.90G [00:02<00:03, 1.84GB/s] model-00002-of-00003.safetensors: 45%|████▍ | 4.45G/9.90G [00:03<00:04, 1.32GB/s] model-00002-of-00003.safetensors: 47%|████▋ | 4.61G/9.90G [00:03<00:04, 1.10GB/s] model-00002-of-00003.safetensors: 48%|████▊ | 4.75G/9.90G [00:03<00:05, 993MB/s] model-00002-of-00003.safetensors: 49%|████▉ | 4.89G/9.90G [00:03<00:04, 1.05GB/s] model-00002-of-00003.safetensors: 51%|█████ | 5.01G/9.90G [00:03<00:04, 1.07GB/s] model-00002-of-00003.safetensors: 52%|█████▏ | 5.19G/9.90G [00:03<00:03, 1.20GB/s] model-00002-of-00003.safetensors: 54%|█████▍ | 5.35G/9.90G [00:04<00:03, 1.28GB/s] model-00002-of-00003.safetensors: 56%|█████▋ | 5.58G/9.90G [00:04<00:02, 1.53GB/s] model-00002-of-00003.safetensors: 58%|█████▊ | 5.77G/9.90G [00:04<00:02, 1.62GB/s] model-00002-of-00003.safetensors: 60%|██████ | 5.95G/9.90G [00:04<00:02, 1.56GB/s] model-00002-of-00003.safetensors: 62%|██████▏ | 6.17G/9.90G [00:04<00:02, 1.70GB/s] model-00002-of-00003.safetensors: 64%|██████▍ | 6.34G/9.90G [00:04<00:02, 1.66GB/s] model-00002-of-00003.safetensors: 66%|██████▌ | 6.52G/9.90G [00:04<00:02, 1.66GB/s] model-00002-of-00003.safetensors: 68%|██████▊ | 6.70G/9.90G [00:04<00:01, 1.67GB/s] model-00002-of-00003.safetensors: 69%|██████▉ | 6.88G/9.90G [00:04<00:01, 1.64GB/s] model-00002-of-00003.safetensors: 72%|███████▏ | 7.10G/9.90G [00:05<00:01, 1.78GB/s] model-00002-of-00003.safetensors: 74%|███████▍ | 7.37G/9.90G [00:05<00:01, 1.92GB/s] model-00002-of-00003.safetensors: 76%|███████▋ | 7.57G/9.90G [00:05<00:01, 1.87GB/s] model-00002-of-00003.safetensors: 79%|███████▉ | 7.82G/9.90G [00:05<00:01, 2.05GB/s] model-00002-of-00003.safetensors: 81%|████████ | 8.03G/9.90G [00:05<00:00, 1.98GB/s] model-00002-of-00003.safetensors: 83%|████████▎ | 8.24G/9.90G [00:05<00:00, 1.97GB/s] model-00002-of-00003.safetensors: 86%|████████▌ | 8.47G/9.90G [00:05<00:00, 2.01GB/s] model-00002-of-00003.safetensors: 88%|████████▊ | 8.68G/9.90G [00:05<00:00, 2.01GB/s] model-00002-of-00003.safetensors: 90%|█████████ | 8.93G/9.90G [00:05<00:00, 2.11GB/s] model-00002-of-00003.safetensors: 92%|█████████▏| 9.15G/9.90G [00:06<00:00, 2.13GB/s] model-00002-of-00003.safetensors: 95%|█████████▍| 9.40G/9.90G [00:06<00:00, 2.20GB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.90G/9.90G [00:06<00:00, 1.58GB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: unable to retrieve container logs for containerd://9b9557f747f6cbb86dc63
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00002-of-00003.safetensors: 0%| | 0.00/9.90G [00:00<?, ?B/s] model-00002-of-00003.safetensors: 0%| | 10.5M/9.90G [00:00<13:10, 12.5MB/s] model-00002-of-00003.safetensors: 0%| | 21.0M/9.90G [00:00<06:28, 25.4MB/s] model-00002-of-00003.safetensors: 0%| | 41.9M/9.90G [00:01<04:09, 39.5MB/s] model-00002-of-00003.safetensors: 1%| | 73.4M/9.90G [00:01<02:16, 71.9MB/s] model-00002-of-00003.safetensors: 1%| | 94.4M/9.90G [00:01<01:53, 86.7MB/s] model-00002-of-00003.safetensors: 1%|▏ | 126M/9.90G [00:01<01:19, 123MB/s] model-00002-of-00003.safetensors: 3%|▎ | 315M/9.90G [00:01<00:21, 448MB/s] model-00002-of-00003.safetensors: 8%|▊ | 765M/9.90G [00:01<00:07, 1.30GB/s] model-00002-of-00003.safetensors: 11%|█ | 1.10G/9.90G [00:02<00:05, 1.75GB/s] model-00002-of-00003.safetensors: 13%|█▎ | 1.33G/9.90G [00:02<00:06, 1.24GB/s] model-00002-of-00003.safetensors: 15%|█▌ | 1.52G/9.90G [00:02<00:08, 1.03GB/s] model-00002-of-00003.safetensors: 21%|██ | 2.04G/9.90G [00:02<00:04, 1.74GB/s] model-00002-of-00003.safetensors: 23%|██▎ | 2.31G/9.90G [00:02<00:04, 1.83GB/s] model-00002-of-00003.safetensors: 26%|██▌ | 2.56G/9.90G [00:03<00:04, 1.51GB/s] model-00002-of-00003.safetensors: 28%|██▊ | 2.77G/9.90G [00:03<00:06, 1.17GB/s] model-00002-of-00003.safetensors: 31%|███▏ | 3.10G/9.90G [00:03<00:04, 1.52GB/s] model-00002-of-00003.safetensors: 36%|███▌ | 3.59G/9.90G [00:03<00:02, 2.12GB/s] model-00002-of-00003.safetensors: 39%|███▉ | 3.88G/9.90G [00:04<00:04, 1.27GB/s] model-00002-of-00003.safetensors: 41%|████▏ | 4.10G/9.90G [00:04<00:04, 1.20GB/s] model-00002-of-00003.safetensors: 46%|████▌ | 4.52G/9.90G [00:04<00:03, 1.64GB/s] model-00002-of-00003.safetensors: 48%|████▊ | 4.78G/9.90G [00:04<00:03, 1.48GB/s] model-00002-of-00003.safetensors: 51%|█████ | 5.00G/9.90G [00:04<00:04, 1.22GB/s] model-00002-of-00003.safetensors: 52%|█████▏ | 5.18G/9.90G [00:05<00:03, 1.24GB/s] model-00002-of-00003.safetensors: 56%|█████▋ | 5.58G/9.90G [00:05<00:02, 1.70GB/s] model-00002-of-00003.safetensors: 59%|█████▊ | 5.81G/9.90G [00:05<00:02, 1.77GB/s] model-00002-of-00003.safetensors: 61%|██████ | 6.03G/9.90G [00:05<00:02, 1.42GB/s] model-00002-of-00003.safetensors: 63%|██████▎ | 6.22G/9.90G [00:05<00:02, 1.33GB/s] model-00002-of-00003.safetensors: 66%|██████▌ | 6.52G/9.90G [00:05<00:02, 1.66GB/s] model-00002-of-00003.safetensors: 68%|██████▊ | 6.73G/9.90G [00:05<00:01, 1.64GB/s] model-00002-of-00003.safetensors: 70%|██████▉ | 6.92G/9.90G [00:06<00:01, 1.53GB/s] model-00002-of-00003.safetensors: 72%|███████▏ | 7.10G/9.90G [00:06<00:02, 1.29GB/s] model-00002-of-00003.safetensors: 73%|███████▎ | 7.27G/9.90G [00:06<00:01, 1.32GB/s] model-00002-of-00003.safetensors: 77%|███████▋ | 7.61G/9.90G [00:06<00:01, 1.79GB/s] model-00002-of-00003.safetensors: 79%|███████▉ | 7.82G/9.90G [00:06<00:01, 1.64GB/s] model-00002-of-00003.safetensors: 81%|████████ | 8.01G/9.90G [00:06<00:01, 1.55GB/s] model-00002-of-00003.safetensors: 83%|████████▎ | 8.18G/9.90G [00:06<00:01, 1.56GB/s] model-00002-of-00003.safetensors: 85%|████████▍ | 8.38G/9.90G [00:07<00:00, 1.66GB/s] model-00002-of-00003.safetensors: 87%|████████▋ | 8.63G/9.90G [00:07<00:00, 1.87GB/s] model-00002-of-00003.safetensors: 89%|████████▉ | 8.83G/9.90G [00:07<00:00, 1.65GB/s] model-00002-of-00003.safetensors: 92%|█████████▏| 9.06G/9.90G [00:07<00:00, 1.75GB/s] model-00002-of-00003.safetensors: 94%|█████████▍| 9.31G/9.90G [00:07<00:00, 1.94GB/s] model-00002-of-00003.safetensors: 98%|█████████▊| 9.66G/9.90G [00:07<00:00, 2.24GB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.89G/9.90G [00:07<00:00, 1.71GB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.90G/9.90G [00:07<00:00, 1.25GB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00003-of-00003.safetensors: 0%| | 0.00/5.87G [00:00<?, ?B/s] model-00003-of-00003.safetensors: 0%| | 10.5M/5.87G [00:00<07:48, 12.5MB/s] model-00003-of-00003.safetensors: 0%| | 21.0M/5.87G [00:00<03:59, 24.4MB/s] model-00003-of-00003.safetensors: 1%| | 31.5M/5.87G [00:01<05:12, 18.7MB/s] model-00003-of-00003.safetensors: 1%| | 73.4M/5.87G [00:01<01:37, 59.3MB/s] model-00003-of-00003.safetensors: 7%|▋ | 388M/5.87G [00:01<00:12, 452MB/s] model-00003-of-00003.safetensors: 19%|█▊ | 1.09G/5.87G [00:02<00:03, 1.46GB/s] model-00003-of-00003.safetensors: 24%|██▍ | 1.42G/5.87G [00:02<00:05, 844MB/s] model-00003-of-00003.safetensors: 37%|███▋ | 2.17G/5.87G [00:02<00:02, 1.57GB/s] model-00003-of-00003.safetensors: 44%|████▎ | 2.57G/5.87G [00:03<00:03, 1.07GB/s] model-00003-of-00003.safetensors: 49%|████▊ | 2.86G/5.87G [00:03<00:02, 1.24GB/s] model-00003-of-00003.safetensors: 57%|█████▋ | 3.37G/5.87G [00:03<00:01, 1.68GB/s] model-00003-of-00003.safetensors: 63%|██████▎ | 3.70G/5.87G [00:04<00:01, 1.40GB/s] model-00003-of-00003.safetensors: 67%|██████▋ | 3.96G/5.87G [00:04<00:01, 1.44GB/s] model-00003-of-00003.safetensors: 74%|███████▍ | 4.37G/5.87G [00:04<00:00, 1.82GB/s] model-00003-of-00003.safetensors: 79%|███████▉ | 4.66G/5.87G [00:04<00:00, 1.62GB/s] model-00003-of-00003.safetensors: 83%|████████▎ | 4.89G/5.87G [00:04<00:00, 1.54GB/s] model-00003-of-00003.safetensors: 87%|████████▋ | 5.11G/5.87G [00:04<00:00, 1.65GB/s] model-00003-of-00003.safetensors: 95%|█████████▌| 5.60G/5.87G [00:04<00:00, 2.30GB/s] model-00003-of-00003.safetensors: 100%|█████████▉| 5.87G/5.87G [00:05<00:00, 1.15GB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model.safetensors.index.json: 0%| | 0.00/39.2k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 39.2k/39.2k [00:00<00:00, 3.19MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: special_tokens_map.json: 0%| | 0.00/436 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 436/436 [00:00<00:00, 6.75MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer.json: 0%| | 0.00/1.80M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 5.16MB/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 5.15MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer.model: 0%| | 0.00/493k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 2.57MB/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 2.57MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: tokenizer_config.json: 0%| | 0.00/968 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 968/968 [00:00<00:00, 7.88MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: Downloaded to shared memory in 25.358s
arlineka-nyans-13b-esp1-v1-mkmlizer: quantizing model to /dev/shm/model_cache
arlineka-nyans-13b-esp1-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
arlineka-nyans-13b-esp1-v1-mkmlizer: Traceback (most recent call last):
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 147, in <module>
arlineka-nyans-13b-esp1-v1-mkmlizer: cli()
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1128, in __call__
arlineka-nyans-13b-esp1-v1-mkmlizer: return self.main(*args, **kwargs)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1053, in main
arlineka-nyans-13b-esp1-v1-mkmlizer: rv = self.invoke(ctx)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return _process_result(sub_ctx.command.invoke(sub_ctx))
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1395, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return ctx.invoke(self.callback, **ctx.params)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 754, in invoke
arlineka-nyans-13b-esp1-v1-mkmlizer: return __callback(*args, **kwargs)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 42, in quantize
arlineka-nyans-13b-esp1-v1-mkmlizer: quantize_model(temp_folder, output_path, profile, device)
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/code/uploading/mkmlize.py", line 131, in quantize_model
arlineka-nyans-13b-esp1-v1-mkmlizer: mkml.instrument(
arlineka-nyans-13b-esp1-v1-mkmlizer: File "/opt/conda/lib/python3.10/site-packages/mk1/mkml/instrument.py", line 70, in instrument
arlineka-nyans-13b-esp1-v1-mkmlizer: raise NotImplementedError(config.architectures)
arlineka-nyans-13b-esp1-v1-mkmlizer: NotImplementedError: ['MixtralForCausalLM']
arlineka-nyans-13b-esp1-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ _____ __ __ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ /___/ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Version: 0.6.11 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ The license key for the current software has been verified as ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ belonging to: ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Chai Research Corp. ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ║ ║
arlineka-nyans-13b-esp1-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 18.4MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: .gitignore: 0%| | 0.00/19.0 [00:00<?, ?B/s] .gitignore: 100%|██████████| 19.0/19.0 [00:00<00:00, 160kB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: README.md: 0%| | 0.00/78.0 [00:00<?, ?B/s] README.md: 100%|██████████| 78.0/78.0 [00:00<00:00, 1.17MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: config.json: 0%| | 0.00/817 [00:00<?, ?B/s] config.json: 100%|██████████| 817/817 [00:00<00:00, 10.5MB/s]
arlineka-nyans-13b-esp1-v1-mkmlizer: model-00001-of-00003.safetensors: 0%| | 0.00/9.99G [00:00<?, ?B/s] model-00001-of-00003.safetensors: 0%| | 10.5M/9.99G [00:00<06:43, 24.7MB/s] model-00001-of-00003.safetensors: 0%| | 31.5M/9.99G [00:00<02:28, 67.2MB/s] model-00001-of-00003.safetensors: 1%| | 52.4M/9.99G [00:00<01:50, 90.1MB/s] model-00001-of-00003.safetensors: 1%|▏ | 126M/9.99G [00:01<01:02, 157MB/s] model-00001-of-00003.safetensors: 2%|▏ | 199M/9.99G [00:01<00:38, 258MB/s] model-00001-of-00003.safetensors: 5%|▍ | 472M/9.99G [00:01<00:12, 756MB/s] model-00001-of-00003.safetensors: 11%|█ | 1.11G/9.99G [00:01<00:04, 2.02GB/s] model-00001-of-00003.safetensors: 14%|█▍ | 1.41G/9.99G [00:01<00:05, 1.46GB/s] model-00001-of-00003.safetensors: 16%|█▋ | 1.64G/9.99G [00:01<00:06, 1.27GB/s] model-00001-of-00003.safetensors: 24%|██▎ | 2.35G/9.99G [00:02<00:03, 2.27GB/s] model-00001-of-00003.safetensors: 27%|██▋ | 2.69G/9.99G [00:02<00:03, 1.96GB/s] model-00001-of-00003.safetensors: 30%|██▉ | 2.98G/9.99G [00:02<00:03, 1.85GB/s] model-00001-of-00003.safetensors: 32%|███▏ | 3.23G/9.99G [00:02<00:03, 1.91GB/s] model-00001-of-00003.safetensors: 35%|███▍ | 3.47G/9.99G [00:02<00:03, 1.83GB/s] model-00001-of-00003.safetensors: 38%|███▊ | 3.83G/9.99G [00:02<00:02, 2.16GB/s] model-00001-of-00003.safetensors: 41%|████ | 4.08G/9.99G [00:02<00:02, 1.98GB/s] model-00001-of-00003.safetensors: 43%|████▎ | 4.33G/9.99G [00:03<00:02, 2.01GB/s] model-00001-of-00003.safetensors: 46%|████▌ | 4.55G/9.99G [00:03<00:02, 1.97GB/s] model-00001-of-00003.safetensors: 49%|████▉ | 4.88G/9.99G [00:03<00:02, 2.23GB/s] model-00001-of-00003.safetensors: 51%|█████ | 5.12G/9.99G [00:03<00:02, 1.80GB/s] model-00001-of-00003.safetensors: 54%|█████▎ | 5.36G/9.99G [00:03<00:02, 1.91GB/s] model-00001-of-00003.safetensors: 56%|█████▌ | 5.57G/9.99G [00:03<00:02, 1.85GB/s] model-00001-of-00003.safetensors: 60%|█████▉ | 5.99G/9.99G [00:03<00:01, 2.41GB/s] model-00001-of-00003.safetensors: 63%|██████▎ | 6.25G/9.99G [00:04<00:01, 2.19GB/s] model-00001-of-00003.safetensors: 65%|██████▍ | 6.49G/9.99G [00:04<00:01, 2.12GB/s] model-00001-of-00003.safetensors: 67%|██████▋ | 6.72G/9.99G [00:04<00:01, 2.07GB/s] model-00001-of-00003.safetensors: 70%|██████▉ | 6.94G/9.99G [00:04<00:01, 1.98GB/s] model-00001-of-00003.safetensors: 72%|███████▏ | 7.21G/9.99G [00:04<00:01, 2.14GB/s] model-00001-of-00003.safetensors: 76%|███████▌ | 7.55G/9.99G [00:04<00:01, 2.43GB/s] model-00001-of-00003.safetensors: 78%|███████▊ | 7.80G/9.99G [00:04<00:00, 2.34GB/s] model-00001-of-00003.safetensors: 81%|████████ | 8.04G/9.99G [00:04<00:00, 2.05GB/s] model-00001-of-00003.safetensors: 83%|████████▎ | 8.27G/9.99G [00:04<00:00, 2.10GB/s] model-00001-of-00003.safetensors: 85%|████████▌ | 8.54G/9.99G [00:05<00:00, 2.24GB/s] model-00001-of-00003.safetensors: 88%|████████▊ | 8.78G/9.99G [00:05<00:00, 2.22GB/s] model-00001-of-00003.safetensors: 90%|█████████ | 9.01G/9.99G [00:05<00:00, 1.93GB/s] model-00001-of-00003.safetensors: 92%|█████████▏| 9.23G/9.99G [00:05<00:00, 1.98GB/s] model-00001-of-00003.safetensors: 96%|█████████▌| 9.61G/9.99G [00:05<00:00, 2.46GB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.99G/9.99G [00:05<00:00, 1.77GB/s]
Job arlineka-nyans-13b-esp1-v1-mkmlizer completed after 45.41s with status: failed
Stopping job with name arlineka-nyans-13b-esp1-v1-mkmlizer
MKMLizerError('')
arlineka-nyans-13b-esp1_v1 status is now failed due to DeploymentManager action
admin requested tearing down of arlineka-nyans-13b-esp1_v1
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.21s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.20s
arlineka-nyans-13b-esp1_v1 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics