developer_uid: robert_irvine
submission_id: neversleep-noromaid-v0-_8068_v54
model_name: neversleep-noromaid-v0-_8068_v54
model_group: NeverSleep/Noromaid-v0.1
status: torndown
timestamp: 2024-05-27T20:19:32+00:00
num_battles: 32511
num_wins: 16052
celo_rating: 1167.54
family_friendly_score: 0.0
submission_type: basic
model_repo: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_architecture: MixtralForCausalLM
reward_repo: rirv938/scaleup_medium_125000_step_3906
model_num_parameters: 46702792704.0
best_of: 8
max_input_tokens: 512
max_output_tokens: 64
display_name: neversleep-noromaid-v0-_8068_v54
is_internal_developer: True
language_model: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_size: 47B
ranking_group: single
us_pacific_date: 2024-05-27
win_ratio: 0.4937405801113469
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|user|>', '###', '\n'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '<s>[INST] This is an entertaining conversation. You are {bot_name} who has the persona: {memory}.\nPlay the role of {bot_name}. Engage in a chat with {user_name} while staying in character. You should create a fun dialogue which entertains {user_name}.\n', 'prompt_template': '{prompt}\n', 'bot_template': '{bot_name}: {message}</s>', 'user_template': '[INST] {user_name}: {message} [/INST]', 'response_template': '{bot_name}:', 'truncate_by_message': False}
model_eval_status: success
reward_formatter: {'bot_template': 'Bot: {message}\n', 'memory_template': 'Memory: {memory}\n', 'prompt_template': '{prompt}\n', 'response_template': 'Bot:', 'truncate_by_message': False, 'user_template': 'User: {message}\n'}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name neversleep-noromaid-v0-8068-v54-mkmlizer
Waiting for job on neversleep-noromaid-v0-8068-v54-mkmlizer to finish
neversleep-noromaid-v0-8068-v54-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
neversleep-noromaid-v0-8068-v54-mkmlizer: ║     _____            __           __                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║       /___/                                                         ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Version: 0.8.14                                                    ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  https://mk1.ai                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  The license key for the current software has been verified as      ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  belonging to:                                                      ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Chai Research Corp.                                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
neversleep-noromaid-v0-8068-v54-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py:131: FutureWarning: 'list_files_info' (from 'huggingface_hub.hf_api') is deprecated and will be removed from version '0.23'. Use `list_repo_tree` and `get_paths_info` instead.
neversleep-noromaid-v0-8068-v54-mkmlizer:   warnings.warn(warning_message, FutureWarning)
neversleep-noromaid-v0-8068-v54-mkmlizer: Traceback (most recent call last):
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn
neversleep-noromaid-v0-8068-v54-mkmlizer:     conn = connection.create_connection(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/util/connection.py", line 72, in create_connection
neversleep-noromaid-v0-8068-v54-mkmlizer:     for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/socket.py", line 955, in getaddrinfo
neversleep-noromaid-v0-8068-v54-mkmlizer:     for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
neversleep-noromaid-v0-8068-v54-mkmlizer: socket.gaierror: [Errno -3] Temporary failure in name resolution
neversleep-noromaid-v0-8068-v54-mkmlizer: During handling of the above exception, another exception occurred:
neversleep-noromaid-v0-8068-v54-mkmlizer: Traceback (most recent call last):
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 714, in urlopen
neversleep-noromaid-v0-8068-v54-mkmlizer:     httplib_response = self._make_request(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 403, in _make_request
neversleep-noromaid-v0-8068-v54-mkmlizer:     self._validate_conn(conn)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1053, in _validate_conn
neversleep-noromaid-v0-8068-v54-mkmlizer:     conn.connect()
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connection.py", line 363, in connect
neversleep-noromaid-v0-8068-v54-mkmlizer:     self.sock = conn = self._new_conn()
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connection.py", line 186, in _new_conn
neversleep-noromaid-v0-8068-v54-mkmlizer:     raise NewConnectionError(
neversleep-noromaid-v0-8068-v54-mkmlizer: urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f74dd679450>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution
neversleep-noromaid-v0-8068-v54-mkmlizer: During handling of the above exception, another exception occurred:
neversleep-noromaid-v0-8068-v54-mkmlizer: Traceback (most recent call last):
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/adapters.py", line 486, in send
neversleep-noromaid-v0-8068-v54-mkmlizer:     resp = conn.urlopen(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 798, in urlopen
neversleep-noromaid-v0-8068-v54-mkmlizer:     retries = retries.increment(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
neversleep-noromaid-v0-8068-v54-mkmlizer:     raise MaxRetryError(_pool, url, error or ResponseError(cause))
neversleep-noromaid-v0-8068-v54-mkmlizer: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='cdn-lfs-us-1.huggingface.co', port=443): Max retries exceeded with url: /repos/01/3a/02d1d6e09dbfb1f7393ab/b21a536a109405ef3d5a9e9008927dc8a8e4fd6d566c7152cde6d5f661023b81?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27pytorch_model-00013-of-00019.bin%3B+filename%3D%22pytorch_model-00013-of-00019.bin%22%3B&response-content-type=application%2Foctet-stream&Expires=1717100536&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxNzEwMDUzNn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzAxLzNhLzAxM2FjMmE1NDMyNzZmNTNiMTA4OGJlMmIzZGM2ODg0NDc4N2Y4YTAyYTIwMmQxZDZlMDlkYmZiMWY3MzkzYWIvYjIxYTUzNmExMDk0MDVlZjNkNWE5ZTkwMDg5MjdkYzhhOGU0ZmQ2ZDU2NmM3MTUyY2RlNmQ1ZjY2MTAyM2I4MT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSomcmVzcG9uc2UtY29udGVudC10eXBlPSoifV19&Signature=Sx7Q1VyuMg~lReiZTb7kKQ00LwZEGzUTmhUcymC~AYO0HVW0pclMvPzWiBEwJizubTBG-VzwMtG0q7YmkpbfRrBkBBbYNkBW7VmSDoEFYUv12ddMys~CdMaQ-NeXbWGhtGEt8sBcO1pQa7ArilvszP55mNNUVbW205XglQkeC9nXX58KiJAikceX4gC04myPyhO7hdZq8vvCyq2N8Yo2q4B6E0qI5Xh4C6bouUeQp~QsivMXWQvjpmVzcMlXuCwkQ2WBopZONijGKLmK3duQq4YlWIjHwFkyVhKkOu~ssOgVYb7TaGjIZ-nDTmwialORuIvCAVVJjzto5VTVFGch1Q__&Key-Pair-Id=KCD77M1F0VK2B (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f74dd679450>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
neversleep-noromaid-v0-8068-v54-mkmlizer: During handling of the above exception, another exception occurred:
neversleep-noromaid-v0-8068-v54-mkmlizer: Traceback (most recent call last):
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
neversleep-noromaid-v0-8068-v54-mkmlizer:     cli()
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1128, in __call__
neversleep-noromaid-v0-8068-v54-mkmlizer:     return self.main(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1053, in main
neversleep-noromaid-v0-8068-v54-mkmlizer:     rv = self.invoke(ctx)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
neversleep-noromaid-v0-8068-v54-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1395, in invoke
neversleep-noromaid-v0-8068-v54-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 754, in invoke
neversleep-noromaid-v0-8068-v54-mkmlizer:     return __callback(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/code/uploading/mkmlize.py", line 38, in quantize
neversleep-noromaid-v0-8068-v54-mkmlizer:     temp_folder = download_to_shared_memory(repo_id, revision, hf_auth_token)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/code/uploading/mkmlize.py", line 65, in download_to_shared_memory
neversleep-noromaid-v0-8068-v54-mkmlizer:     snapshot_download(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 119, in _inner_fn
neversleep-noromaid-v0-8068-v54-mkmlizer:     return fn(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 314, in snapshot_download
neversleep-noromaid-v0-8068-v54-mkmlizer:     _inner_hf_hub_download(file)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 290, in _inner_hf_hub_download
neversleep-noromaid-v0-8068-v54-mkmlizer:     return hf_hub_download(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 119, in _inner_fn
neversleep-noromaid-v0-8068-v54-mkmlizer:     return fn(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1492, in hf_hub_download
neversleep-noromaid-v0-8068-v54-mkmlizer:     http_get(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 456, in http_get
neversleep-noromaid-v0-8068-v54-mkmlizer:     r = _request_wrapper(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 392, in _request_wrapper
neversleep-noromaid-v0-8068-v54-mkmlizer:     response = get_session().request(method=method, url=url, **params)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
neversleep-noromaid-v0-8068-v54-mkmlizer:     resp = self.send(prep, **send_kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
neversleep-noromaid-v0-8068-v54-mkmlizer:     r = adapter.send(request, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 68, in send
neversleep-noromaid-v0-8068-v54-mkmlizer:     return super().send(request, *args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/adapters.py", line 519, in send
neversleep-noromaid-v0-8068-v54-mkmlizer:     raise ConnectionError(e, request=request)
neversleep-noromaid-v0-8068-v54-mkmlizer: requests.exceptions.ConnectionError: (MaxRetryError("HTTPSConnectionPool(host='cdn-lfs-us-1.huggingface.co', port=443): Max retries exceeded with url: /repos/01/3a/02d1d6e09dbfb1f7393ab/b21a536a109405ef3d5a9e9008927dc8a8e4fd6d566c7152cde6d5f661023b81?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27pytorch_model-00013-of-00019.bin%3B+filename%3D%22pytorch_model-00013-of-00019.bin%22%3B&response-content-type=application%2Foctet-stream&Expires=1717100536&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxNzEwMDUzNn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzAxLzNhLzAxM2FjMmE1NDMyNzZmNTNiMTA4OGJlMmIzZGM2ODg0NDc4N2Y4YTAyYTIwMmQxZDZlMDlkYmZiMWY3MzkzYWIvYjIxYTUzNmExMDk0MDVlZjNkNWE5ZTkwMDg5MjdkYzhhOGU0ZmQ2ZDU2NmM3MTUyY2RlNmQ1ZjY2MTAyM2I4MT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSomcmVzcG9uc2UtY29udGVudC10eXBlPSoifV19&Signature=Sx7Q1VyuMg~lReiZTb7kKQ00LwZEGzUTmhUcymC~AYO0HVW0pclMvPzWiBEwJizubTBG-VzwMtG0q7YmkpbfRrBkBBbYNkBW7VmSDoEFYUv12ddMys~CdMaQ-NeXbWGhtGEt8sBcO1pQa7ArilvszP55mNNUVbW205XglQkeC9nXX58KiJAikceX4gC04myPyhO7hdZq8vvCyq2N8Yo2q4B6E0qI5Xh4C6bouUeQp~QsivMXWQvjpmVzcMlXuCwkQ2WBopZONijGKLmK3duQq4YlWIjHwFkyVhKkOu~ssOgVYb7TaGjIZ-nDTmwialORuIvCAVVJjzto5VTVFGch1Q__&Key-Pair-Id=KCD77M1F0VK2B (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f74dd679450>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))"), '(Request ID: ab497f29-888a-4e07-9433-15cf8eba54ee)')
Job neversleep-noromaid-v0-8068-v54-mkmlizer completed after 177.05s with status: failed
Stopping job with name neversleep-noromaid-v0-8068-v54-mkmlizer
%s, retrying in %s seconds...
Starting job with name neversleep-noromaid-v0-8068-v54-mkmlizer
Waiting for job on neversleep-noromaid-v0-8068-v54-mkmlizer to finish
neversleep-noromaid-v0-8068-v54-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
neversleep-noromaid-v0-8068-v54-mkmlizer: ║     _____            __           __                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║       /___/                                                         ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Version: 0.8.14                                                    ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  https://mk1.ai                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  The license key for the current software has been verified as      ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  belonging to:                                                      ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Chai Research Corp.                                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
neversleep-noromaid-v0-8068-v54-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py:131: FutureWarning: 'list_files_info' (from 'huggingface_hub.hf_api') is deprecated and will be removed from version '0.23'. Use `list_repo_tree` and `get_paths_info` instead.
neversleep-noromaid-v0-8068-v54-mkmlizer:   warnings.warn(warning_message, FutureWarning)
neversleep-noromaid-v0-8068-v54-mkmlizer: Traceback (most recent call last):
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 509, in http_get
neversleep-noromaid-v0-8068-v54-mkmlizer:     hf_transfer.download(
neversleep-noromaid-v0-8068-v54-mkmlizer: Exception: Error while downloading: reqwest::Error { kind: Request, url: Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("cdn-lfs-us-1.huggingface.co")), port: None, path: "/repos/01/3a/02d1d6e09dbfb1f7393ab/fdcdb2420de7552ba0fa300185a9aedde7c6d4e5f0c710eff29bb3c3b6c1edeb", query: Some("response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27pytorch_model-00017-of-00019.bin%3B+filename%3D%22pytorch_model-00017-of-00019.bin%22%3B&response-content-type=application%2Foctet-stream&Expires=1717100963&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxNzEwMDk2M319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzAxLzNhLzAxM2FjMmE1NDMyNzZmNTNiMTA4OGJlMmIzZGM2ODg0NDc4N2Y4YTAyYTIwMmQxZDZlMDlkYmZiMWY3MzkzYWIvZmRjZGIyNDIwZGU3NTUyYmEwZmEzMDAxODVhOWFlZGRlN2M2ZDRlNWYwYzcxMGVmZjI5YmIzYzNiNmMxZWRlYj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSomcmVzcG9uc2UtY29udGVudC10eXBlPSoifV19&Signature=maKqKb5NSSpHjppZjaUZjllD998P3a4a8SGMwkKFV7neSDJEkdFMevQyRA3WbVIMqAF8h1n6N2xeRVcvxtfQnb4ydS7pdP5e8lcVYTXvTjEyld%7EhpOAdPHQR2T7xOBapIMCQOlI%7EtB-VF3A6WrukYhPvILXTtuDJv2R6EBJhJLI0j0dLRHir9goeUTuxWL9JqogifnQZE85T0KOjHhNgpkwKUPMvrwRpUE50m9WtF8vfmb6CfICYEChQpx3ff%7E%7E8T29PhX2jP4DdAxFCSLc--lH64mrnOZ2w2MA2Lhd08NsZE7kZRkUdeMsCvnW9zuoeXfsar4jkfd978Dvv0XVMjw__&Key-Pair-Id=KCD77M1F0VK2B"), fragment: None }, source: hyper::Error(Connect, ConnectError("dns error", Custom { kind: Uncategorized, error: "failed to lookup address information: Temporary failure in name resolution" })) }
neversleep-noromaid-v0-8068-v54-mkmlizer: The above exception was the direct cause of the following exception:
neversleep-noromaid-v0-8068-v54-mkmlizer: Traceback (most recent call last):
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/code/uploading/mkmlize.py", line 151, in <module>
neversleep-noromaid-v0-8068-v54-mkmlizer:     cli()
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1128, in __call__
neversleep-noromaid-v0-8068-v54-mkmlizer:     return self.main(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1053, in main
neversleep-noromaid-v0-8068-v54-mkmlizer:     rv = self.invoke(ctx)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1659, in invoke
neversleep-noromaid-v0-8068-v54-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1395, in invoke
neversleep-noromaid-v0-8068-v54-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 754, in invoke
neversleep-noromaid-v0-8068-v54-mkmlizer:     return __callback(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/code/uploading/mkmlize.py", line 38, in quantize
neversleep-noromaid-v0-8068-v54-mkmlizer:     temp_folder = download_to_shared_memory(repo_id, revision, hf_auth_token)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/code/uploading/mkmlize.py", line 65, in download_to_shared_memory
neversleep-noromaid-v0-8068-v54-mkmlizer:     snapshot_download(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 119, in _inner_fn
neversleep-noromaid-v0-8068-v54-mkmlizer:     return fn(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 314, in snapshot_download
neversleep-noromaid-v0-8068-v54-mkmlizer:     _inner_hf_hub_download(file)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 290, in _inner_hf_hub_download
neversleep-noromaid-v0-8068-v54-mkmlizer:     return hf_hub_download(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 119, in _inner_fn
neversleep-noromaid-v0-8068-v54-mkmlizer:     return fn(*args, **kwargs)
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1492, in hf_hub_download
neversleep-noromaid-v0-8068-v54-mkmlizer:     http_get(
neversleep-noromaid-v0-8068-v54-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 520, in http_get
neversleep-noromaid-v0-8068-v54-mkmlizer:     raise RuntimeError(
neversleep-noromaid-v0-8068-v54-mkmlizer: RuntimeError: An error occurred while downloading using `hf_transfer`. Consider disabling HF_HUB_ENABLE_HF_TRANSFER for better error handling.
Job neversleep-noromaid-v0-8068-v54-mkmlizer completed after 432.11s with status: failed
Stopping job with name neversleep-noromaid-v0-8068-v54-mkmlizer
%s, retrying in %s seconds...
Starting job with name neversleep-noromaid-v0-8068-v54-mkmlizer
Waiting for job on neversleep-noromaid-v0-8068-v54-mkmlizer to finish
neversleep-noromaid-v0-8068-v54-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
neversleep-noromaid-v0-8068-v54-mkmlizer: ║     _____            __           __                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║       /___/                                                         ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Version: 0.8.14                                                    ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  https://mk1.ai                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  The license key for the current software has been verified as      ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  belonging to:                                                      ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Chai Research Corp.                                                ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v54-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
neversleep-noromaid-v0-8068-v54-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py:131: FutureWarning: 'list_files_info' (from 'huggingface_hub.hf_api') is deprecated and will be removed from version '0.23'. Use `list_repo_tree` and `get_paths_info` instead.
neversleep-noromaid-v0-8068-v54-mkmlizer:   warnings.warn(warning_message, FutureWarning)
neversleep-noromaid-v0-8068-v54-mkmlizer: Downloaded to shared memory in 66.347s
neversleep-noromaid-v0-8068-v54-mkmlizer: quantizing model to /dev/shm/model_cache
neversleep-noromaid-v0-8068-v54-mkmlizer: Saving flywheel model at /dev/shm/model_cache
neversleep-noromaid-v0-8068-v54-mkmlizer: quantized model in 51.073s
neversleep-noromaid-v0-8068-v54-mkmlizer: Processed model NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3 in 123.381s
neversleep-noromaid-v0-8068-v54-mkmlizer: creating bucket guanaco-mkml-models
neversleep-noromaid-v0-8068-v54-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
neversleep-noromaid-v0-8068-v54-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/config.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/special_tokens_map.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/tokenizer_config.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/tokenizer.model
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/tokenizer.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/flywheel_model.3.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/flywheel_model.3.safetensors
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/flywheel_model.0.safetensors
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/flywheel_model.2.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/flywheel_model.2.safetensors
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v54/flywheel_model.1.safetensors
neversleep-noromaid-v0-8068-v54-mkmlizer: loading reward model from rirv938/scaleup_medium_125000_step_3906
neversleep-noromaid-v0-8068-v54-mkmlizer: 
Loading 0:   0%|          | 0/995 [00:00<?, ?it/s]
Loading 0:   5%|▌         | 52/995 [00:00<00:17, 54.77it/s]
Loading 0:  11%|█         | 107/995 [00:01<00:15, 57.47it/s]
Loading 0:  16%|█▋        | 162/995 [00:02<00:14, 58.83it/s]
Loading 0:  21%|██        | 210/995 [00:03<00:13, 56.49it/s]
Loading 0:  27%|██▋       | 265/995 [00:04<00:12, 58.24it/s]
Loading 0:  28%|██▊       | 278/995 [00:13<01:05, 10.96it/s]
Loading 0:  32%|███▏      | 320/995 [00:14<00:46, 14.56it/s]
Loading 0:  37%|███▋      | 368/995 [00:15<00:31, 19.80it/s]
Loading 0:  43%|████▎     | 423/995 [00:16<00:21, 26.67it/s]
Loading 0:  48%|████▊     | 478/995 [00:16<00:15, 33.64it/s]
Loading 0:  53%|█████▎    | 526/995 [00:17<00:12, 38.45it/s]
Loading 0:  57%|█████▋    | 565/995 [00:27<00:34, 12.44it/s]
Loading 0:  58%|█████▊    | 581/995 [00:28<00:32, 12.73it/s]
Loading 0:  64%|██████▍   | 636/995 [00:28<00:19, 18.59it/s]
Loading 0:  69%|██████▉   | 691/995 [00:29<00:12, 25.13it/s]
Loading 0:  74%|███████▍  | 739/995 [00:30<00:08, 30.54it/s]
Loading 0:  80%|███████▉  | 794/995 [00:31<00:05, 37.41it/s]
Loading 0:  85%|████████▌ | 846/995 [00:40<00:10, 13.90it/s]
Loading 0:  86%|████████▌ | 851/995 [00:41<00:11, 12.91it/s]
Loading 0:  90%|█████████ | 897/995 [00:42<00:05, 17.71it/s]
Loading 0:  96%|█████████▌| 952/995 [00:42<00:01, 24.92it/s]
Loading 0: 100%|██████████| 995/995 [00:43<00:00, 27.63it/s]
                                                            
/opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:913: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
neversleep-noromaid-v0-8068-v54-mkmlizer:   warnings.warn(
neversleep-noromaid-v0-8068-v54-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:757: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
neversleep-noromaid-v0-8068-v54-mkmlizer:   warnings.warn(
neversleep-noromaid-v0-8068-v54-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:468: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
neversleep-noromaid-v0-8068-v54-mkmlizer:   warnings.warn(
neversleep-noromaid-v0-8068-v54-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
neversleep-noromaid-v0-8068-v54-mkmlizer: Saving duration: 0.260s
neversleep-noromaid-v0-8068-v54-mkmlizer: Processed model rirv938/scaleup_medium_125000_step_3906 in 6.412s
neversleep-noromaid-v0-8068-v54-mkmlizer: creating bucket guanaco-reward-models
neversleep-noromaid-v0-8068-v54-mkmlizer: Bucket 's3://guanaco-reward-models/' created
neversleep-noromaid-v0-8068-v54-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward/special_tokens_map.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward/tokenizer_config.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward/merges.txt
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward/config.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward/vocab.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward/tokenizer.json
neversleep-noromaid-v0-8068-v54-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v54_reward/reward.tensors
Job neversleep-noromaid-v0-8068-v54-mkmlizer completed after 166.29s with status: succeeded
Stopping job with name neversleep-noromaid-v0-8068-v54-mkmlizer
Pipeline stage MKMLizer completed in 779.98s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.13s
Running pipeline stage ISVCDeployer
Creating inference service neversleep-noromaid-v0-8068-v54
Waiting for inference service neversleep-noromaid-v0-8068-v54 to be ready
Inference service neversleep-noromaid-v0-8068-v54 ready after 60.31328511238098s
Pipeline stage ISVCDeployer completed in 67.72s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.554630756378174s
Received healthy response to inference request in 2.4988675117492676s
Received healthy response to inference request in 2.603015184402466s
Received healthy response to inference request in 2.561385154724121s
Received healthy response to inference request in 2.590315103530884s
5 requests
0 failed requests
5th percentile: 2.511371040344238
10th percentile: 2.523874568939209
20th percentile: 2.5488816261291505
30th percentile: 2.5671711444854735
40th percentile: 2.5787431240081786
50th percentile: 2.590315103530884
60th percentile: 2.5953951358795164
70th percentile: 2.6004751682281495
80th percentile: 2.7933382987976074
90th percentile: 3.1739845275878906
95th percentile: 3.3643076419830322
99th percentile: 3.5165661334991456
mean time: 2.7616427421569822
Pipeline stage StressChecker completed in 14.97s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.06s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.06s
M-Eval Dataset for topic stay_in_character is loaded
neversleep-noromaid-v0-_8068_v54 status is now deployed due to DeploymentManager action
neversleep-noromaid-v0-_8068_v54 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of neversleep-noromaid-v0-_8068_v54
Running pipeline stage ISVCDeleter
Checking if service neversleep-noromaid-v0-8068-v54 is running
Skipping teardown as no inference service was found
Pipeline stage ISVCDeleter completed in 2.96s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key neversleep-noromaid-v0-8068-v54/config.json from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/flywheel_model.0.safetensors from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/flywheel_model.1.safetensors from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/flywheel_model.2.safetensors from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/flywheel_model.3.safetensors from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/tokenizer.json from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/tokenizer.model from bucket guanaco-mkml-models
Deleting key neversleep-noromaid-v0-8068-v54/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key neversleep-noromaid-v0-8068-v54_reward/config.json from bucket guanaco-reward-models
Deleting key neversleep-noromaid-v0-8068-v54_reward/merges.txt from bucket guanaco-reward-models
Deleting key neversleep-noromaid-v0-8068-v54_reward/reward.tensors from bucket guanaco-reward-models
Deleting key neversleep-noromaid-v0-8068-v54_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key neversleep-noromaid-v0-8068-v54_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key neversleep-noromaid-v0-8068-v54_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key neversleep-noromaid-v0-8068-v54_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 7.83s
neversleep-noromaid-v0-_8068_v54 status is now torndown due to DeploymentManager action