nitral-ai-hathor-colt-ta_3990

submission_id: nitral-ai-hathor-colt-ta_3990_v1
developer_uid: Nitral-AI
formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.2, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|end_header_id|>,', '<|eot_id|>,', '\n\n{user_name}', 'You:', '\n\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64, 'reward_max_token_input': 256}
model_name: Hathor_Colt_Tahsin-L3-8B-v0_945
model_repo: Nitral-AI/Hathor_Colt_Tahsin-L3-8B-v0.945
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}
reward_repo: Jellywibble/gpt2_xl_pairwise_89m_step_347634
status: torndown
timestamp: 2024-08-10T12:19:17+00:00
Resubmit model
Running pipeline stage MKMLizer
Starting job with name nitral-ai-hathor-colt-ta-3990-v1-mkmlizer
Waiting for job on nitral-ai-hathor-colt-ta-3990-v1-mkmlizer to finish
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║     _____            __           __                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║       /___/                                                         ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Version: 0.9.9                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  https://mk1.ai                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  belonging to:                                                      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Chai Research Corp.                                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Downloaded to shared memory in 28.868s
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpeho6w6_t, device:0
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Traceback (most recent call last):
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     cli()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return self.main(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     rv = self.invoke(ctx)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return __callback(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     flywheel.instrument(
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 87, in instrument
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     model_iterator = self.factory.model_iterator()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: RuntimeError: Unable to construct an interator for the model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║     _____            __           __                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║       /___/                                                         ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Version: 0.9.9                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  https://mk1.ai                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  belonging to:                                                      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Chai Research Corp.                                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Job nitral-ai-hathor-colt-ta-3990-v1-mkmlizer completed after 54.03s with status: failed
Stopping job with name nitral-ai-hathor-colt-ta-3990-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name nitral-ai-hathor-colt-ta-3990-v1-mkmlizer
Waiting for job on nitral-ai-hathor-colt-ta-3990-v1-mkmlizer to finish
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║     _____            __           __                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║       /___/                                                         ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Version: 0.9.9                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  https://mk1.ai                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  belonging to:                                                      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Chai Research Corp.                                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Downloaded to shared memory in 21.145s
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpzn7hqrba, device:0
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Traceback (most recent call last):
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     cli()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return self.main(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     rv = self.invoke(ctx)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return __callback(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     flywheel.instrument(
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 87, in instrument
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     model_iterator = self.factory.model_iterator()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: RuntimeError: Unable to construct an interator for the model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Downloaded to shared memory in 20.996s
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpw1fxzwbk, device:0
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Traceback (most recent call last):
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     cli()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return self.main(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     rv = self.invoke(ctx)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return __callback(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     flywheel.instrument(
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 87, in instrument
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     model_iterator = self.factory.model_iterator()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: RuntimeError: Unable to construct an interator for the model
Job nitral-ai-hathor-colt-ta-3990-v1-mkmlizer completed after 44.91s with status: failed
Stopping job with name nitral-ai-hathor-colt-ta-3990-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name nitral-ai-hathor-colt-ta-3990-v1-mkmlizer
Waiting for job on nitral-ai-hathor-colt-ta-3990-v1-mkmlizer to finish
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║     _____            __           __                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║       /___/                                                         ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Version: 0.9.9                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  https://mk1.ai                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  belonging to:                                                      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Chai Research Corp.                                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Downloaded to shared memory in 21.198s
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpy3f4slfd, device:0
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Traceback (most recent call last):
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     cli()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return self.main(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     rv = self.invoke(ctx)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return __callback(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     flywheel.instrument(
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 87, in instrument
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     model_iterator = self.factory.model_iterator()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: RuntimeError: Unable to construct an interator for the model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Downloaded to shared memory in 20.699s
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp86uiynwj, device:0
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: Traceback (most recent call last):
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     cli()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return self.main(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     rv = self.invoke(ctx)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     return __callback(*args, **kwargs)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     flywheel.instrument(
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 87, in instrument
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     model_iterator = self.factory.model_iterator()
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: RuntimeError: Unable to construct an interator for the model
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║     _____            __           __                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║       /___/                                                         ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Version: 0.9.9                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  https://mk1.ai                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  belonging to:                                                      ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Chai Research Corp.                                                ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ║                                                                     ║
nitral-ai-hathor-colt-ta-3990-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Job nitral-ai-hathor-colt-ta-3990-v1-mkmlizer completed after 46.7s with status: failed
Stopping job with name nitral-ai-hathor-colt-ta-3990-v1-mkmlizer
MKMLizerError('')
nitral-ai-hathor-colt-ta_3990_v1 status is now failed due to DeploymentManager action
admin requested tearing down of nitral-ai-hathor-colt-ta_3990_v1
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.32s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.24s
nitral-ai-hathor-colt-ta_3990_v1 status is now torndown due to DeploymentManager action