cgato-nemo-12b-thespice-_3053

submission_id: cgato-nemo-12b-thespice-_3053_v1
developer_uid: c.gato
status: torndown
model_repo: cgato/Nemo-12b-TheSpice-V0.9-All-v2-KTO-v0.3-BigBoy-20k
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 200, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '<|im_start|>user\n{prompt}<|im_end|>\n', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
timestamp: 2024-11-07T03:57:34+00:00
model_name: cgato-nemo-12b-thespice-_3053_v1
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name cgato-nemo-12b-thespice-3053-v1-mkmlizer
Waiting for job on cgato-nemo-12b-thespice-3053-v1-mkmlizer to finish
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║     _____            __           __                                ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║       /___/                                                         ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Version: 0.11.28                                                   ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  https://mk1.ai                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  belonging to:                                                      ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Chai Research Corp.                                                ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Traceback (most recent call last):
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 304, in hf_raise_for_status
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     response.raise_for_status()
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     raise HTTPError(http_error_msg, response=self)
cgato-nemo-12b-thespice-3053-v1-mkmlizer: requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/cgato/Nemo-12b-TheSpice-V0.9-All-v2-KTO-v0.3-BigBoy-20k/resolve/cdc5e108b7fe8f21dd281a6eedab47c3bc884892/model-00003-of-00005.safetensors
cgato-nemo-12b-thespice-3053-v1-mkmlizer: The above exception was the direct cause of the following exception:
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Traceback (most recent call last):
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     cli()
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return self.main(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     rv = self.invoke(ctx)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return __callback(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 38, in quantize
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     temp_folder = download_to_shared_memory(repo_id, revision, hf_auth_token)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 65, in download_to_shared_memory
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     snapshot_download(
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return fn(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 292, in snapshot_download
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     _inner_hf_hub_download(file)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 268, in _inner_hf_hub_download
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return hf_hub_download(
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return fn(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1202, in hf_hub_download
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return _hf_hub_download_to_local_dir(
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1440, in _hf_hub_download_to_local_dir
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     _raise_on_head_call_error(head_call_error, force_download, local_files_only)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1823, in _raise_on_head_call_error
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     raise head_call_error
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1722, in _get_metadata_or_catch_error
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     metadata = get_hf_file_metadata(url=url, proxies=proxies, timeout=etag_timeout, headers=headers)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return fn(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1645, in get_hf_file_metadata
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     r = _request_wrapper(
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 372, in _request_wrapper
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     response = _request_wrapper(
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 396, in _request_wrapper
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     hf_raise_for_status(response)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 352, in hf_raise_for_status
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     raise RepositoryNotFoundError(message, response) from e
cgato-nemo-12b-thespice-3053-v1-mkmlizer: huggingface_hub.utils._errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-672c3acd-43afa16a35000d3823859c8a;87b8163a-d9a1-4cba-b974-420639d00c8a)
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Repository Not Found for url: https://huggingface.co/cgato/Nemo-12b-TheSpice-V0.9-All-v2-KTO-v0.3-BigBoy-20k/resolve/cdc5e108b7fe8f21dd281a6eedab47c3bc884892/model-00003-of-00005.safetensors.
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Please make sure you specified the correct `repo_id` and `repo_type`.
cgato-nemo-12b-thespice-3053-v1-mkmlizer: If you are trying to access a private or gated repo, make sure you are authenticated.
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Invalid username or password.
Job cgato-nemo-12b-thespice-3053-v1-mkmlizer completed after 46.07s with status: failed
Stopping job with name cgato-nemo-12b-thespice-3053-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name cgato-nemo-12b-thespice-3053-v1-mkmlizer
Waiting for job on cgato-nemo-12b-thespice-3053-v1-mkmlizer to finish
Job cgato-nemo-12b-thespice-3053-v1-mkmlizer completed after 20.62s with status: failed
Stopping job with name cgato-nemo-12b-thespice-3053-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name cgato-nemo-12b-thespice-3053-v1-mkmlizer
Waiting for job on cgato-nemo-12b-thespice-3053-v1-mkmlizer to finish
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║     _____            __           __                                ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║       /___/                                                         ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Version: 0.11.28                                                   ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  https://mk1.ai                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  belonging to:                                                      ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Chai Research Corp.                                                ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ║                                                                     ║
cgato-nemo-12b-thespice-3053-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Traceback (most recent call last):
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 304, in hf_raise_for_status
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     response.raise_for_status()
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     raise HTTPError(http_error_msg, response=self)
cgato-nemo-12b-thespice-3053-v1-mkmlizer: requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/api/models/cgato/Nemo-12b-TheSpice-V0.9-All-v2-KTO-v0.3-BigBoy-20k/paths-info/main
cgato-nemo-12b-thespice-3053-v1-mkmlizer: The above exception was the direct cause of the following exception:
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Traceback (most recent call last):
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     cli()
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return self.main(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     rv = self.invoke(ctx)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return __callback(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 38, in quantize
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     temp_folder = download_to_shared_memory(repo_id, revision, hf_auth_token)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 60, in download_to_shared_memory
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     if repo_has_model_safetensors(repo_id, revision, token):
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/code/uploading/mkmlize.py", line 83, in repo_has_model_safetensors
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     files = [f.path for f in get_paths_info(repo_id, revision=revision, paths=["/"], token=token)]
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     return fn(*args, **kwargs)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/hf_api.py", line 3045, in get_paths_info
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     hf_raise_for_status(response)
cgato-nemo-12b-thespice-3053-v1-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 352, in hf_raise_for_status
cgato-nemo-12b-thespice-3053-v1-mkmlizer:     raise RepositoryNotFoundError(message, response) from e
cgato-nemo-12b-thespice-3053-v1-mkmlizer: huggingface_hub.utils._errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-672c3afd-2d8948b12f6c6b560ceb87c3;c8e64017-c43d-4740-a0b4-a7ab8582c697)
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Repository Not Found for url: https://huggingface.co/api/models/cgato/Nemo-12b-TheSpice-V0.9-All-v2-KTO-v0.3-BigBoy-20k/paths-info/main.
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Please make sure you specified the correct `repo_id` and `repo_type`.
cgato-nemo-12b-thespice-3053-v1-mkmlizer: If you are trying to access a private or gated repo, make sure you are authenticated.
cgato-nemo-12b-thespice-3053-v1-mkmlizer: Invalid username or password.
Job cgato-nemo-12b-thespice-3053-v1-mkmlizer completed after 25.27s with status: failed
Stopping job with name cgato-nemo-12b-thespice-3053-v1-mkmlizer
clean up pipeline due to error=MKMLizerError('')
Shutdown handler de-registered
cgato-nemo-12b-thespice-_3053_v1 status is now failed due to DeploymentManager action
cgato-nemo-12b-thespice-_3053_v1 status is now torndown due to DeploymentManager action