submission_id: oliveiratime-axolotl_v3
developer_uid: Oliveiratime
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
model_name: oliveiratime-axolotl_v2
model_repo: Oliveiratime/axolotl
status: torndown
timestamp: 2024-08-24T09:14:40+00:00
Resubmit model
Running pipeline stage MKMLizer
Starting job with name oliveiratime-axolotl-v3-mkmlizer
Waiting for job on oliveiratime-axolotl-v3-mkmlizer to finish
Failed to get response for submission mistralai-mistral-nemo-_9330_v57: ('http://mistralai-mistral-nemo-9330-v57-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Running pipeline stage MKMLizer
Starting job with name oliveiratime-axolotl-v4-mkmlizer
Waiting for job on oliveiratime-axolotl-v4-mkmlizer to finish
Failed to get response for submission mistralai-mistral-nemo-_9330_v57: ('http://mistralai-mistral-nemo-9330-v57-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
oliveiratime-axolotl-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
oliveiratime-axolotl-v3-mkmlizer: ║     _____            __           __                                ║
oliveiratime-axolotl-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
oliveiratime-axolotl-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
oliveiratime-axolotl-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
oliveiratime-axolotl-v3-mkmlizer: ║       /___/                                                         ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  Version: 0.10.1                                                    ║
oliveiratime-axolotl-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
oliveiratime-axolotl-v3-mkmlizer: ║  https://mk1.ai                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
oliveiratime-axolotl-v3-mkmlizer: ║  belonging to:                                                      ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  Chai Research Corp.                                                ║
oliveiratime-axolotl-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
oliveiratime-axolotl-v3-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
oliveiratime-axolotl-v4-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
oliveiratime-axolotl-v4-mkmlizer: ║     _____            __           __                                ║
oliveiratime-axolotl-v4-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
oliveiratime-axolotl-v4-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
oliveiratime-axolotl-v4-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
oliveiratime-axolotl-v4-mkmlizer: ║       /___/                                                         ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  Version: 0.10.1                                                    ║
oliveiratime-axolotl-v4-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
oliveiratime-axolotl-v4-mkmlizer: ║  https://mk1.ai                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  The license key for the current software has been verified as      ║
oliveiratime-axolotl-v4-mkmlizer: ║  belonging to:                                                      ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  Chai Research Corp.                                                ║
oliveiratime-axolotl-v4-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
oliveiratime-axolotl-v4-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
oliveiratime-axolotl-v3-mkmlizer: Downloaded to shared memory in 7.453s
oliveiratime-axolotl-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp_zc_lmpw, device:0
oliveiratime-axolotl-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
oliveiratime-axolotl-v3-mkmlizer: Traceback (most recent call last):
oliveiratime-axolotl-v3-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
oliveiratime-axolotl-v3-mkmlizer:     cli()
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
oliveiratime-axolotl-v3-mkmlizer:     return self.main(*args, **kwargs)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
oliveiratime-axolotl-v3-mkmlizer:     rv = self.invoke(ctx)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
oliveiratime-axolotl-v3-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
oliveiratime-axolotl-v3-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
oliveiratime-axolotl-v3-mkmlizer:     return __callback(*args, **kwargs)
oliveiratime-axolotl-v3-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
oliveiratime-axolotl-v3-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
oliveiratime-axolotl-v3-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
oliveiratime-axolotl-v3-mkmlizer:     flywheel.instrument(
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 90, in instrument
oliveiratime-axolotl-v3-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
oliveiratime-axolotl-v3-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
oliveiratime-axolotl-v3-mkmlizer:     model_iterator = self.factory.model_iterator()
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
oliveiratime-axolotl-v3-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
oliveiratime-axolotl-v3-mkmlizer: RuntimeError: Unable to construct an interator for the model
Job oliveiratime-axolotl-v3-mkmlizer completed after 24.23s with status: failed
Stopping job with name oliveiratime-axolotl-v3-mkmlizer
%s, retrying in %s seconds...
Starting job with name oliveiratime-axolotl-v3-mkmlizer
Waiting for job on oliveiratime-axolotl-v3-mkmlizer to finish
oliveiratime-axolotl-v4-mkmlizer: Downloaded to shared memory in 7.634s
oliveiratime-axolotl-v4-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpg3x8du5x, device:0
oliveiratime-axolotl-v4-mkmlizer: Saving flywheel model at /dev/shm/model_cache
oliveiratime-axolotl-v4-mkmlizer: Traceback (most recent call last):
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
oliveiratime-axolotl-v4-mkmlizer:     cli()
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
oliveiratime-axolotl-v4-mkmlizer:     return self.main(*args, **kwargs)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
oliveiratime-axolotl-v4-mkmlizer:     rv = self.invoke(ctx)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return __callback(*args, **kwargs)
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
oliveiratime-axolotl-v4-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
oliveiratime-axolotl-v4-mkmlizer:     flywheel.instrument(
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 90, in instrument
oliveiratime-axolotl-v4-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
oliveiratime-axolotl-v4-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
oliveiratime-axolotl-v4-mkmlizer:     model_iterator = self.factory.model_iterator()
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
oliveiratime-axolotl-v4-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
oliveiratime-axolotl-v4-mkmlizer: RuntimeError: Unable to construct an interator for the model
Job oliveiratime-axolotl-v4-mkmlizer completed after 24.57s with status: failed
Stopping job with name oliveiratime-axolotl-v4-mkmlizer
%s, retrying in %s seconds...
Starting job with name oliveiratime-axolotl-v4-mkmlizer
Waiting for job on oliveiratime-axolotl-v4-mkmlizer to finish
oliveiratime-axolotl-v4-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
oliveiratime-axolotl-v4-mkmlizer: ║     _____            __           __                                ║
oliveiratime-axolotl-v4-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
oliveiratime-axolotl-v4-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
oliveiratime-axolotl-v4-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
oliveiratime-axolotl-v4-mkmlizer: ║       /___/                                                         ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  Version: 0.10.1                                                    ║
oliveiratime-axolotl-v4-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
oliveiratime-axolotl-v4-mkmlizer: ║  https://mk1.ai                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  The license key for the current software has been verified as      ║
oliveiratime-axolotl-v4-mkmlizer: ║  belonging to:                                                      ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  Chai Research Corp.                                                ║
oliveiratime-axolotl-v4-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
oliveiratime-axolotl-v4-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
oliveiratime-axolotl-v4-mkmlizer: Downloaded to shared memory in 7.302s
oliveiratime-axolotl-v4-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpo3kgs22f, device:0
oliveiratime-axolotl-v4-mkmlizer: Saving flywheel model at /dev/shm/model_cache
oliveiratime-axolotl-v4-mkmlizer: Traceback (most recent call last):
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
oliveiratime-axolotl-v4-mkmlizer:     cli()
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
oliveiratime-axolotl-v4-mkmlizer:     return self.main(*args, **kwargs)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
oliveiratime-axolotl-v4-mkmlizer:     rv = self.invoke(ctx)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return __callback(*args, **kwargs)
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
oliveiratime-axolotl-v4-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
oliveiratime-axolotl-v4-mkmlizer:     flywheel.instrument(
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 90, in instrument
oliveiratime-axolotl-v4-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
oliveiratime-axolotl-v4-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
oliveiratime-axolotl-v4-mkmlizer:     model_iterator = self.factory.model_iterator()
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
oliveiratime-axolotl-v4-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
oliveiratime-axolotl-v4-mkmlizer: RuntimeError: Unable to construct an interator for the model
Job oliveiratime-axolotl-v4-mkmlizer completed after 25.39s with status: failed
Stopping job with name oliveiratime-axolotl-v4-mkmlizer
%s, retrying in %s seconds...
Starting job with name oliveiratime-axolotl-v4-mkmlizer
Waiting for job on oliveiratime-axolotl-v4-mkmlizer to finish
oliveiratime-axolotl-v4-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
oliveiratime-axolotl-v4-mkmlizer: ║     _____            __           __                                ║
oliveiratime-axolotl-v4-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
oliveiratime-axolotl-v4-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
oliveiratime-axolotl-v4-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
oliveiratime-axolotl-v4-mkmlizer: ║       /___/                                                         ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  Version: 0.10.1                                                    ║
oliveiratime-axolotl-v4-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
oliveiratime-axolotl-v4-mkmlizer: ║  https://mk1.ai                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  The license key for the current software has been verified as      ║
oliveiratime-axolotl-v4-mkmlizer: ║  belonging to:                                                      ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ║  Chai Research Corp.                                                ║
oliveiratime-axolotl-v4-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
oliveiratime-axolotl-v4-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
oliveiratime-axolotl-v4-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v4-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
oliveiratime-axolotl-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
oliveiratime-axolotl-v3-mkmlizer: ║     _____            __           __                                ║
oliveiratime-axolotl-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
oliveiratime-axolotl-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
oliveiratime-axolotl-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
oliveiratime-axolotl-v3-mkmlizer: ║       /___/                                                         ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  Version: 0.10.1                                                    ║
oliveiratime-axolotl-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
oliveiratime-axolotl-v3-mkmlizer: ║  https://mk1.ai                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
oliveiratime-axolotl-v3-mkmlizer: ║  belonging to:                                                      ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  Chai Research Corp.                                                ║
oliveiratime-axolotl-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
oliveiratime-axolotl-v3-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
oliveiratime-axolotl-v4-mkmlizer: Downloaded to shared memory in 7.497s
oliveiratime-axolotl-v4-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmplfemqc4w, device:0
oliveiratime-axolotl-v4-mkmlizer: Saving flywheel model at /dev/shm/model_cache
oliveiratime-axolotl-v4-mkmlizer: Traceback (most recent call last):
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
oliveiratime-axolotl-v4-mkmlizer:     cli()
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
oliveiratime-axolotl-v4-mkmlizer:     return self.main(*args, **kwargs)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
oliveiratime-axolotl-v4-mkmlizer:     rv = self.invoke(ctx)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
oliveiratime-axolotl-v4-mkmlizer:     return __callback(*args, **kwargs)
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
oliveiratime-axolotl-v4-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
oliveiratime-axolotl-v4-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
oliveiratime-axolotl-v4-mkmlizer:     flywheel.instrument(
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 90, in instrument
oliveiratime-axolotl-v4-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
oliveiratime-axolotl-v4-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
Failed to get response for submission blend_dedat_2024-08-16: ('http://zonemercy-graft-cogent-v-7573-v6-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
oliveiratime-axolotl-v4-mkmlizer:     model_iterator = self.factory.model_iterator()
oliveiratime-axolotl-v4-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
oliveiratime-axolotl-v4-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
oliveiratime-axolotl-v4-mkmlizer: RuntimeError: Unable to construct an interator for the model
Job oliveiratime-axolotl-v4-mkmlizer completed after 27.03s with status: failed
Stopping job with name oliveiratime-axolotl-v4-mkmlizer
MKMLizerError('')
oliveiratime-axolotl_v4 status is now failed due to DeploymentManager action
oliveiratime-axolotl-v3-mkmlizer: Downloaded to shared memory in 7.452s
oliveiratime-axolotl-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpe1xigdog, device:0
oliveiratime-axolotl-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
oliveiratime-axolotl-v3-mkmlizer: Traceback (most recent call last):
oliveiratime-axolotl-v3-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
oliveiratime-axolotl-v3-mkmlizer:     cli()
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
oliveiratime-axolotl-v3-mkmlizer:     return self.main(*args, **kwargs)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
oliveiratime-axolotl-v3-mkmlizer:     rv = self.invoke(ctx)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
oliveiratime-axolotl-v3-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
oliveiratime-axolotl-v3-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
oliveiratime-axolotl-v3-mkmlizer:     return __callback(*args, **kwargs)
oliveiratime-axolotl-v3-mkmlizer:   File "/code/uploading/mkmlize.py", line 42, in quantize
oliveiratime-axolotl-v3-mkmlizer:     quantize_model(temp_folder, output_path, profile, device)
oliveiratime-axolotl-v3-mkmlizer:   File "/code/uploading/mkmlize.py", line 135, in quantize_model
oliveiratime-axolotl-v3-mkmlizer:     flywheel.instrument(
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/instrument.py", line 90, in instrument
oliveiratime-axolotl-v3-mkmlizer:     compiler.save_pretrained(input_model_path, output_model_path, storage_format)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 23, in save_pretrained
oliveiratime-axolotl-v3-mkmlizer:     self.save_st_pretrained(input_model_path, output_model_path)
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/compiler.py", line 31, in save_st_pretrained
oliveiratime-axolotl-v3-mkmlizer:     model_iterator = self.factory.model_iterator()
oliveiratime-axolotl-v3-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py", line 255, in model_iterator
oliveiratime-axolotl-v3-mkmlizer:     raise RuntimeError(f"Unable to construct an interator for the model")
oliveiratime-axolotl-v3-mkmlizer: RuntimeError: Unable to construct an interator for the model
Job oliveiratime-axolotl-v3-mkmlizer completed after 61.57s with status: failed
Stopping job with name oliveiratime-axolotl-v3-mkmlizer
%s, retrying in %s seconds...
Starting job with name oliveiratime-axolotl-v3-mkmlizer
Waiting for job on oliveiratime-axolotl-v3-mkmlizer to finish
Failed to get response for submission mistralai-mistral-nemo-_9330_v57: ('http://mistralai-mistral-nemo-9330-v57-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
oliveiratime-axolotl-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
oliveiratime-axolotl-v3-mkmlizer: ║     _____            __           __                                ║
oliveiratime-axolotl-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
oliveiratime-axolotl-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
oliveiratime-axolotl-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
oliveiratime-axolotl-v3-mkmlizer: ║       /___/                                                         ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  Version: 0.10.1                                                    ║
oliveiratime-axolotl-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
oliveiratime-axolotl-v3-mkmlizer: ║  https://mk1.ai                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
oliveiratime-axolotl-v3-mkmlizer: ║  belonging to:                                                      ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ║  Chai Research Corp.                                                ║
oliveiratime-axolotl-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
oliveiratime-axolotl-v3-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
oliveiratime-axolotl-v3-mkmlizer: ║                                                                     ║
oliveiratime-axolotl-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Job oliveiratime-axolotl-v3-mkmlizer completed after 55.18s with status: failed
Stopping job with name oliveiratime-axolotl-v3-mkmlizer
MKMLizerError('')
oliveiratime-axolotl_v3 status is now failed due to DeploymentManager action
admin requested tearing down of oliveiratime-axolotl_v3
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.33s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.30s
oliveiratime-axolotl_v3 status is now torndown due to DeploymentManager action