hastagaras-l3-2-3b-c1

submission_id: hastagaras-l3-2-3b-c1_v1
developer_uid: Hastagaras
formatter: {'memory_template': "<|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.08, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
model_name: hastagaras-l3-2-3b-c1_v1
model_repo: Hastagaras/L3.2-3B-C1
status: torndown
timestamp: 2024-09-26T14:54:33+00:00
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name hastagaras-l3-2-3b-c1-v1-mkmlizer
Waiting for job on hastagaras-l3-2-3b-c1-v1-mkmlizer to finish
hastagaras-l3-2-3b-c1-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║     _____            __           __                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║       /___/                                                         ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  https://mk1.ai                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  belonging to:                                                      ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Chai Research Corp.                                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
hastagaras-l3-2-3b-c1-v1-mkmlizer: Downloaded to shared memory in 18.299s
hastagaras-l3-2-3b-c1-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmprqprhueg, device:0
hastagaras-l3-2-3b-c1-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
hastagaras-l3-2-3b-c1-v1-mkmlizer: 
Loading 0:   0%|          | 0/254 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/254 [00:00<00:06, 37.73it/s]
Loading 0:   6%|▌         | 14/254 [00:00<00:04, 54.59it/s]
Loading 0:   9%|▉         | 23/254 [00:00<00:03, 63.45it/s]
Loading 0:  13%|█▎        | 32/254 [00:00<00:03, 67.15it/s]
Loading 0:  16%|█▌        | 41/254 [00:00<00:03, 68.49it/s]
Loading 0:  20%|█▉        | 50/254 [00:00<00:02, 68.64it/s]
Loading 0:  23%|██▎       | 59/254 [00:00<00:02, 70.55it/s]
Loading 0:  27%|██▋       | 68/254 [00:01<00:02, 69.89it/s]
Loading 0:  30%|███       | 77/254 [00:01<00:02, 65.65it/s]
Loading 0:  34%|███▍      | 86/254 [00:01<00:02, 67.80it/s]
Loading 0:  37%|███▋      | 95/254 [00:01<00:02, 69.72it/s]
Loading 0:  41%|████      | 104/254 [00:01<00:02, 70.44it/s]
Loading 0:  44%|████▍     | 113/254 [00:01<00:02, 69.79it/s]
Loading 0:  48%|████▊     | 121/254 [00:01<00:01, 69.29it/s]
Loading 0:  50%|█████     | 128/254 [00:01<00:01, 66.41it/s]
Loading 0:  54%|█████▍    | 137/254 [00:02<00:01, 67.44it/s]
Loading 0:  57%|█████▋    | 146/254 [00:02<00:01, 67.15it/s]
Loading 0:  61%|██████    | 155/254 [00:02<00:01, 69.32it/s]
Loading 0:  65%|██████▍   | 164/254 [00:02<00:01, 70.60it/s]
Loading 0:  68%|██████▊   | 173/254 [00:02<00:01, 70.73it/s]
Loading 0:  72%|███████▏  | 182/254 [00:02<00:01, 70.09it/s]
Loading 0:  75%|███████▍  | 190/254 [00:02<00:01, 52.93it/s]
Loading 0:  78%|███████▊  | 197/254 [00:03<00:01, 55.94it/s]
Loading 0:  80%|████████  | 204/254 [00:03<00:00, 54.70it/s]
Loading 0:  83%|████████▎ | 212/254 [00:03<00:00, 57.41it/s]
Loading 0:  87%|████████▋ | 221/254 [00:03<00:00, 60.49it/s]
Loading 0:  91%|█████████ | 230/254 [00:03<00:00, 63.74it/s]
Loading 0:  94%|█████████▎| 238/254 [00:03<00:00, 67.59it/s]
Loading 0:  96%|█████████▋| 245/254 [00:03<00:00, 67.12it/s]
Loading 0: 100%|█████████▉| 253/254 [00:03<00:00, 66.81it/s]
                                                            
Traceback (most recent call last):
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
hastagaras-l3-2-3b-c1-v1-mkmlizer:     cli()
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return self.main(*args, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
hastagaras-l3-2-3b-c1-v1-mkmlizer:     rv = self.invoke(ctx)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return __callback(*args, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
hastagaras-l3-2-3b-c1-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
hastagaras-l3-2-3b-c1-v1-mkmlizer:     flywheel.instrument(
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 96, in instrument
hastagaras-l3-2-3b-c1-v1-mkmlizer:     tokenizer = AutoTokenizer.from_pretrained(input_model_path, verbose=False)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 897, in from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return cls._from_pretrained(
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     tokenizer = cls(*init_inputs, **init_kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 115, in __init__
hastagaras-l3-2-3b-c1-v1-mkmlizer:     fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file)
hastagaras-l3-2-3b-c1-v1-mkmlizer: Exception: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3
Job hastagaras-l3-2-3b-c1-v1-mkmlizer completed after 103.8s with status: failed
Stopping job with name hastagaras-l3-2-3b-c1-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name hastagaras-l3-2-3b-c1-v1-mkmlizer
Waiting for job on hastagaras-l3-2-3b-c1-v1-mkmlizer to finish
hastagaras-l3-2-3b-c1-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║     _____            __           __                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║       /___/                                                         ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  https://mk1.ai                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  belonging to:                                                      ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Chai Research Corp.                                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
hastagaras-l3-2-3b-c1-v1-mkmlizer: Downloaded to shared memory in 11.891s
hastagaras-l3-2-3b-c1-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmprod24_ee, device:0
hastagaras-l3-2-3b-c1-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
hastagaras-l3-2-3b-c1-v1-mkmlizer: 
Loading 0:   0%|          | 0/254 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/254 [00:00<00:05, 45.16it/s]
Loading 0:   6%|▌         | 14/254 [00:00<00:04, 59.12it/s]
Loading 0:   9%|▉         | 23/254 [00:00<00:03, 65.65it/s]
Loading 0:  13%|█▎        | 32/254 [00:00<00:03, 66.06it/s]
Loading 0:  16%|█▌        | 41/254 [00:00<00:03, 67.43it/s]
Loading 0:  20%|█▉        | 50/254 [00:00<00:02, 69.53it/s]
Loading 0:  23%|██▎       | 59/254 [00:00<00:02, 70.24it/s]
Loading 0:  27%|██▋       | 68/254 [00:01<00:02, 69.37it/s]
Loading 0:  30%|███       | 77/254 [00:01<00:02, 67.22it/s]
Loading 0:  34%|███▍      | 86/254 [00:01<00:02, 68.52it/s]
Loading 0:  37%|███▋      | 95/254 [00:01<00:02, 69.18it/s]
Loading 0:  41%|████      | 104/254 [00:01<00:02, 66.04it/s]
Loading 0:  44%|████▍     | 113/254 [00:01<00:02, 66.19it/s]
Loading 0:  47%|████▋     | 120/254 [00:01<00:02, 61.23it/s]
Loading 0:  50%|█████     | 128/254 [00:01<00:02, 58.44it/s]
Loading 0:  54%|█████▍    | 137/254 [00:02<00:02, 57.31it/s]
Loading 0:  57%|█████▋    | 146/254 [00:02<00:01, 60.90it/s]
Loading 0:  61%|██████    | 155/254 [00:02<00:01, 63.68it/s]
Loading 0:  65%|██████▍   | 164/254 [00:02<00:01, 63.41it/s]
Loading 0:  68%|██████▊   | 173/254 [00:02<00:01, 64.01it/s]
Loading 0:  72%|███████▏  | 182/254 [00:02<00:01, 65.87it/s]
Loading 0:  74%|███████▍  | 189/254 [00:03<00:01, 49.51it/s]
Loading 0:  78%|███████▊  | 198/254 [00:03<00:00, 57.35it/s]
Loading 0:  81%|████████  | 205/254 [00:03<00:00, 56.82it/s]
Loading 0:  83%|████████▎ | 212/254 [00:03<00:00, 55.78it/s]
Loading 0:  87%|████████▋ | 221/254 [00:03<00:00, 57.89it/s]
Loading 0:  91%|█████████ | 230/254 [00:03<00:00, 60.41it/s]
Loading 0:  94%|█████████▍| 239/254 [00:03<00:00, 63.01it/s]
Loading 0:  98%|█████████▊| 248/254 [00:03<00:00, 64.39it/s]
                                                            
Traceback (most recent call last):
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
hastagaras-l3-2-3b-c1-v1-mkmlizer:     cli()
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return self.main(*args, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
hastagaras-l3-2-3b-c1-v1-mkmlizer:     rv = self.invoke(ctx)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return __callback(*args, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
hastagaras-l3-2-3b-c1-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
hastagaras-l3-2-3b-c1-v1-mkmlizer:     flywheel.instrument(
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 96, in instrument
hastagaras-l3-2-3b-c1-v1-mkmlizer:     tokenizer = AutoTokenizer.from_pretrained(input_model_path, verbose=False)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 897, in from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return cls._from_pretrained(
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     tokenizer = cls(*init_inputs, **init_kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 115, in __init__
hastagaras-l3-2-3b-c1-v1-mkmlizer:     fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file)
hastagaras-l3-2-3b-c1-v1-mkmlizer: Exception: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3
Job hastagaras-l3-2-3b-c1-v1-mkmlizer completed after 43.04s with status: failed
Stopping job with name hastagaras-l3-2-3b-c1-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name hastagaras-l3-2-3b-c1-v1-mkmlizer
Waiting for job on hastagaras-l3-2-3b-c1-v1-mkmlizer to finish
hastagaras-l3-2-3b-c1-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║     _____            __           __                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║       /___/                                                         ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  https://mk1.ai                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  belonging to:                                                      ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Chai Research Corp.                                                ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ║                                                                     ║
hastagaras-l3-2-3b-c1-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
hastagaras-l3-2-3b-c1-v1-mkmlizer: Downloaded to shared memory in 11.055s
hastagaras-l3-2-3b-c1-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp5gcxpvxh, device:0
hastagaras-l3-2-3b-c1-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
hastagaras-l3-2-3b-c1-v1-mkmlizer: 
Loading 0:   0%|          | 0/254 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/254 [00:00<00:06, 40.60it/s]
Loading 0:   5%|▌         | 13/254 [00:00<00:03, 61.61it/s]
Loading 0:   8%|▊         | 20/254 [00:00<00:04, 57.82it/s]
Loading 0:  11%|█         | 28/254 [00:00<00:03, 56.82it/s]
Loading 0:  15%|█▍        | 37/254 [00:00<00:03, 59.74it/s]
Loading 0:  18%|█▊        | 46/254 [00:00<00:03, 62.50it/s]
Loading 0:  22%|██▏       | 55/254 [00:00<00:03, 64.62it/s]
Loading 0:  25%|██▌       | 64/254 [00:01<00:02, 65.25it/s]
Loading 0:  29%|██▊       | 73/254 [00:01<00:02, 67.03it/s]
Loading 0:  32%|███▏      | 81/254 [00:01<00:02, 70.27it/s]
Loading 0:  35%|███▌      | 89/254 [00:01<00:02, 62.74it/s]
Loading 0:  38%|███▊      | 96/254 [00:01<00:02, 59.24it/s]
Loading 0:  41%|████      | 104/254 [00:01<00:02, 57.86it/s]
Loading 0:  44%|████▍     | 113/254 [00:01<00:02, 59.04it/s]
Loading 0:  47%|████▋     | 120/254 [00:01<00:02, 56.64it/s]
Loading 0:  50%|█████     | 128/254 [00:02<00:02, 57.85it/s]
Loading 0:  54%|█████▍    | 137/254 [00:02<00:02, 57.46it/s]
Loading 0:  57%|█████▋    | 146/254 [00:02<00:01, 57.48it/s]
Loading 0:  61%|██████    | 155/254 [00:02<00:01, 60.76it/s]
Loading 0:  65%|██████▍   | 164/254 [00:02<00:01, 61.76it/s]
Loading 0:  68%|██████▊   | 173/254 [00:02<00:01, 62.55it/s]
Loading 0:  72%|███████▏  | 182/254 [00:02<00:01, 64.40it/s]
Loading 0:  74%|███████▍  | 189/254 [00:03<00:01, 47.20it/s]
Loading 0:  78%|███████▊  | 199/254 [00:03<00:01, 53.09it/s]
Loading 0:  81%|████████▏ | 207/254 [00:03<00:00, 58.34it/s]
Loading 0:  84%|████████▍ | 214/254 [00:03<00:00, 52.32it/s]
Loading 0:  87%|████████▋ | 221/254 [00:03<00:00, 49.51it/s]
Loading 0:  91%|█████████ | 230/254 [00:03<00:00, 52.54it/s]
Loading 0:  94%|█████████▍| 239/254 [00:04<00:00, 54.89it/s]
Loading 0:  98%|█████████▊| 248/254 [00:04<00:00, 55.22it/s]
                                                            
Traceback (most recent call last):
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
hastagaras-l3-2-3b-c1-v1-mkmlizer:     cli()
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return self.main(*args, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
hastagaras-l3-2-3b-c1-v1-mkmlizer:     rv = self.invoke(ctx)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return __callback(*args, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
hastagaras-l3-2-3b-c1-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
hastagaras-l3-2-3b-c1-v1-mkmlizer:     flywheel.instrument(
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 96, in instrument
hastagaras-l3-2-3b-c1-v1-mkmlizer:     tokenizer = AutoTokenizer.from_pretrained(input_model_path, verbose=False)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 897, in from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     return cls._from_pretrained(
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained
hastagaras-l3-2-3b-c1-v1-mkmlizer:     tokenizer = cls(*init_inputs, **init_kwargs)
hastagaras-l3-2-3b-c1-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 115, in __init__
hastagaras-l3-2-3b-c1-v1-mkmlizer:     fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file)
hastagaras-l3-2-3b-c1-v1-mkmlizer: Exception: data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3
Job hastagaras-l3-2-3b-c1-v1-mkmlizer completed after 42.6s with status: failed
Stopping job with name hastagaras-l3-2-3b-c1-v1-mkmlizer
clean up pipeline due to error=%s
Shutdown handler de-registered
hastagaras-l3-2-3b-c1_v1 status is now failed due to DeploymentManager action
hastagaras-l3-2-3b-c1_v1 status is now torndown due to DeploymentManager action