gryphe-pantheon-rp-1-6-_28075

developer_uid: zmeeks
submission_id: gryphe-pantheon-rp-1-6-_28075_v5
model_name: kto-0909_k4
model_group: Gryphe/Pantheon-RP-1.6-1
status: torndown
timestamp: 2025-06-29T20:50:00+00:00
num_battles: 6653
num_wins: 3234
celo_rating: 1258.39
family_friendly_score: 0.5756
family_friendly_standard_error: 0.00698977310075227
submission_type: basic
model_repo: Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
latencies: [{'batch_size': 1, 'throughput': 0.6067185904050405, 'latency_mean': 1.6481114625930786, 'latency_p50': 1.6365900039672852, 'latency_p90': 1.8206960678100585}, {'batch_size': 3, 'throughput': 1.089271424129977, 'latency_mean': 2.7459384644031526, 'latency_p50': 2.744871497154236, 'latency_p90': 3.016838312149048}, {'batch_size': 5, 'throughput': 1.3109636159590776, 'latency_mean': 3.799173653125763, 'latency_p50': 3.792880654335022, 'latency_p90': 4.276340532302856}, {'batch_size': 6, 'throughput': 1.3682542867714487, 'latency_mean': 4.364021583795547, 'latency_p50': 4.359598517417908, 'latency_p90': 4.91473331451416}, {'batch_size': 8, 'throughput': 1.4217369061161627, 'latency_mean': 5.5864391922950745, 'latency_p50': 5.5237205028533936, 'latency_p90': 6.3561697721481325}, {'batch_size': 10, 'throughput': 1.4764890499579995, 'latency_mean': 6.720510594844818, 'latency_p50': 6.700472831726074, 'latency_p90': 7.538185048103332}]
gpu_counts: {'NVIDIA RTX A5000': 1}
display_name: kto-0909_k4
is_internal_developer: False
language_model: Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO
model_size: 13B
ranking_group: single
throughput_3p7s: 1.3
us_pacific_date: 2025-06-29
win_ratio: 0.4860964978205321
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.0, 'top_k': 4, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name gryphe-pantheon-rp-1-6-28075-v5-mkmlizer
Waiting for job on gryphe-pantheon-rp-1-6-28075-v5-mkmlizer to finish
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Version: 0.29.3                                                    ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  https://mk1.ai                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  belonging to:                                                      ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Chai Research Corp.                                                ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Traceback (most recent call last):
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 536, in _make_request
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     response = conn.getresponse()
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connection.py", line 461, in getresponse
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     httplib_response = super().getresponse()
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/http/client.py", line 1375, in getresponse
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     response.begin()
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/http/client.py", line 318, in begin
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     version, status, reason = self._read_status()
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/http/client.py", line 279, in _read_status
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/socket.py", line 705, in readinto
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return self._sock.recv_into(b)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/ssl.py", line 1307, in recv_into
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return self.read(nbytes, buffer)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/ssl.py", line 1163, in read
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return self._sslobj.read(len, buffer)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: TimeoutError: The read operation timed out
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: The above exception was the direct cause of the following exception:
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Traceback (most recent call last):
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/adapters.py", line 667, in send
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     resp = conn.urlopen(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 844, in urlopen
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     retries = retries.increment(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/util/retry.py", line 470, in increment
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     raise reraise(type(error), error, _stacktrace)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/util/util.py", line 39, in reraise
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     raise value
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 790, in urlopen
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     response = self._make_request(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 538, in _make_request
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/urllib3/connectionpool.py", line 370, in _raise_timeout
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     raise ReadTimeoutError(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='cdn-lfs-us-1.hf.co', port=443): Read timed out. (read timeout=10)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: During handling of the above exception, another exception occurred:
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Traceback (most recent call last):
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/code/uploading/mkmlize.py", line 225, in <module>
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     cli()
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return self.main(*args, **kwargs)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1078, in main
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     rv = self.invoke(ctx)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return _process_result(sub_ctx.command.invoke(sub_ctx))
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return ctx.invoke(self.callback, **ctx.params)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/click/core.py", line 783, in invoke
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return __callback(*args, **kwargs)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/code/uploading/mkmlize.py", line 41, in quantize
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     temp_folder = download_to_shared_memory(repo_id, revision, hf_auth_token)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/code/uploading/mkmlize.py", line 91, in download_to_shared_memory
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     snapshot_download(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return fn(*args, **kwargs)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 294, in snapshot_download
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     _inner_hf_hub_download(file)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/_snapshot_download.py", line 270, in _inner_hf_hub_download
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return hf_hub_download(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return fn(*args, **kwargs)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 941, in hf_hub_download
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return _hf_hub_download_to_local_dir(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1241, in _hf_hub_download_to_local_dir
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     _download_to_tmp_and_move(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 1675, in _download_to_tmp_and_move
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     http_get(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 376, in http_get
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     r = _request_wrapper(
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 308, in _request_wrapper
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     response = get_session().request(method=method, url=url, **params)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     resp = self.send(prep, **send_kwargs)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     r = adapter.send(request, **kwargs)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_http.py", line 96, in send
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     return super().send(request, *args, **kwargs)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:   File "/opt/conda/lib/python3.10/site-packages/requests/adapters.py", line 713, in send
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer:     raise ReadTimeout(e, request=request)
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: requests.exceptions.ReadTimeout: (ReadTimeoutError("HTTPSConnectionPool(host='cdn-lfs-us-1.hf.co', port=443): Read timed out. (read timeout=10)"), '(Request ID: 05bdc812-26c2-4792-b367-f6b378d52290)')
Job gryphe-pantheon-rp-1-6-28075-v5-mkmlizer completed after 27.42s with status: failed
Stopping job with name gryphe-pantheon-rp-1-6-28075-v5-mkmlizer
%s, retrying in %s seconds...
Starting job with name gryphe-pantheon-rp-1-6-28075-v5-mkmlizer
Waiting for job on gryphe-pantheon-rp-1-6-28075-v5-mkmlizer to finish
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Version: 0.29.3                                                    ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  https://mk1.ai                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  belonging to:                                                      ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Chai Research Corp.                                                ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ║                                                                     ║
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Downloaded to shared memory in 28.272s
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Checking if Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO already exists in ChaiML
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp_in3xar3, device:0
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: quantized model in 30.295s
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Processed model Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO in 58.646s
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: creating bucket guanaco-mkml-models
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-28075-v5
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-28075-v5/config.json
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-28075-v5/special_tokens_map.json
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-28075-v5/tokenizer_config.json
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/gryphe-pantheon-rp-1-6-28075-v5/tokenizer.json
gryphe-pantheon-rp-1-6-28075-v5-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:11, 30.30it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:07, 49.38it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:07, 43.39it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:08, 40.38it/s]
Loading 0:   8%|▊         | 30/363 [00:00<00:07, 45.65it/s]
Loading 0:  10%|▉         | 35/363 [00:00<00:07, 45.36it/s]
Loading 0:  11%|█         | 40/363 [00:00<00:07, 45.60it/s]
Loading 0:  13%|█▎        | 46/363 [00:01<00:07, 42.96it/s]
Loading 0:  14%|█▍        | 51/363 [00:01<00:07, 40.93it/s]
Loading 0:  15%|█▌        | 56/363 [00:01<00:07, 42.42it/s]
Loading 0:  17%|█▋        | 61/363 [00:01<00:10, 29.44it/s]
Loading 0:  18%|█▊        | 65/363 [00:01<00:10, 29.77it/s]
Loading 0:  20%|█▉        | 72/363 [00:01<00:07, 36.82it/s]
Loading 0:  21%|██        | 77/363 [00:01<00:07, 39.60it/s]
Loading 0:  23%|██▎       | 82/363 [00:02<00:07, 35.27it/s]
Loading 0:  25%|██▍       | 89/363 [00:02<00:06, 41.81it/s]
Loading 0:  26%|██▌       | 94/363 [00:02<00:06, 42.11it/s]
Loading 0:  27%|██▋       | 99/363 [00:02<00:06, 43.03it/s]
Loading 0:  29%|██▉       | 105/363 [00:02<00:06, 41.17it/s]
Loading 0:  31%|███       | 112/363 [00:02<00:05, 44.42it/s]
Loading 0:  32%|███▏      | 117/363 [00:02<00:05, 42.20it/s]
Loading 0:  34%|███▎      | 122/363 [00:02<00:05, 44.08it/s]
Loading 0:  35%|███▍      | 127/363 [00:03<00:06, 36.70it/s]
Loading 0:  37%|███▋      | 134/363 [00:03<00:05, 42.97it/s]
Loading 0:  38%|███▊      | 139/363 [00:03<00:05, 42.75it/s]
Loading 0:  40%|███▉      | 144/363 [00:03<00:08, 27.14it/s]
Loading 0:  41%|████      | 149/363 [00:03<00:07, 29.36it/s]
Loading 0:  43%|████▎     | 156/363 [00:04<00:05, 36.40it/s]
Loading 0:  44%|████▍     | 161/363 [00:04<00:05, 38.08it/s]
Loading 0:  46%|████▌     | 166/363 [00:04<00:04, 39.44it/s]
Loading 0:  47%|████▋     | 171/363 [00:04<00:04, 41.78it/s]
Loading 0:  48%|████▊     | 176/363 [00:04<00:05, 35.83it/s]
Loading 0:  50%|█████     | 183/363 [00:04<00:04, 42.94it/s]
Loading 0:  52%|█████▏    | 188/363 [00:04<00:04, 42.52it/s]
Loading 0:  53%|█████▎    | 193/363 [00:04<00:03, 42.75it/s]
Loading 0:  55%|█████▍    | 199/363 [00:05<00:04, 40.89it/s]
Loading 0:  56%|█████▌    | 204/363 [00:05<00:03, 39.75it/s]
Loading 0:  58%|█████▊    | 210/363 [00:05<00:03, 42.92it/s]
Loading 0:  59%|█████▉    | 215/363 [00:05<00:03, 42.61it/s]
Loading 0:  61%|██████    | 220/363 [00:05<00:03, 44.32it/s]
Loading 0:  62%|██████▏   | 225/363 [00:05<00:05, 26.65it/s]
Loading 0:  63%|██████▎   | 230/363 [00:06<00:04, 29.35it/s]
Loading 0:  65%|██████▌   | 237/363 [00:06<00:03, 36.66it/s]
Loading 0:  67%|██████▋   | 242/363 [00:06<00:03, 37.80it/s]
Loading 0:  68%|██████▊   | 247/363 [00:06<00:02, 39.30it/s]
Loading 0:  69%|██████▉   | 252/363 [00:06<00:02, 41.60it/s]
Loading 0:  71%|███████   | 257/363 [00:06<00:03, 34.38it/s]
Loading 0:  73%|███████▎  | 264/363 [00:06<00:02, 41.61it/s]
Loading 0:  74%|███████▍  | 269/363 [00:06<00:02, 42.03it/s]
Loading 0:  75%|███████▌  | 274/363 [00:07<00:02, 42.14it/s]
Loading 0:  77%|███████▋  | 279/363 [00:07<00:01, 43.68it/s]
Loading 0:  78%|███████▊  | 284/363 [00:07<00:02, 35.83it/s]
Loading 0:  80%|████████  | 291/363 [00:07<00:01, 42.44it/s]
Loading 0:  82%|████████▏ | 296/363 [00:07<00:01, 42.56it/s]
Loading 0:  83%|████████▎ | 301/363 [00:07<00:01, 43.51it/s]
Loading 0:  84%|████████▍ | 306/363 [00:08<00:02, 23.57it/s]
Loading 0:  85%|████████▌ | 310/363 [00:08<00:02, 24.92it/s]
Loading 0:  87%|████████▋ | 314/363 [00:08<00:01, 27.39it/s]
Loading 0:  88%|████████▊ | 319/363 [00:08<00:01, 31.88it/s]
Loading 0:  89%|████████▉ | 323/363 [00:08<00:01, 33.22it/s]
Loading 0:  91%|█████████ | 329/363 [00:08<00:00, 38.32it/s]
Loading 0:  92%|█████████▏| 334/363 [00:08<00:00, 40.53it/s]
Loading 0:  93%|█████████▎| 339/363 [00:08<00:00, 35.42it/s]
Loading 0:  95%|█████████▌| 346/363 [00:09<00:00, 42.92it/s]
Loading 0:  97%|█████████▋| 351/363 [00:09<00:00, 42.97it/s]
Loading 0:  98%|█████████▊| 356/363 [00:09<00:00, 43.42it/s]
Loading 0:  99%|█████████▉| 361/363 [00:09<00:00, 44.90it/s]
                                                            
Job gryphe-pantheon-rp-1-6-28075-v5-mkmlizer completed after 95.7s with status: succeeded
Stopping job with name gryphe-pantheon-rp-1-6-28075-v5-mkmlizer
Pipeline stage MKMLizer completed in 124.37s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.19s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service gryphe-pantheon-rp-1-6-28075-v5
Waiting for inference service gryphe-pantheon-rp-1-6-28075-v5 to be ready
Inference service gryphe-pantheon-rp-1-6-28075-v5 ready after 201.8976604938507s
Pipeline stage MKMLDeployer completed in 202.63s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.544668197631836s
Received healthy response to inference request in 1.7576181888580322s
Received healthy response to inference request in 1.8243038654327393s
Received healthy response to inference request in 1.951390027999878s
Received healthy response to inference request in 2.0923595428466797s
5 requests
0 failed requests
5th percentile: 1.7709553241729736
10th percentile: 1.784292459487915
20th percentile: 1.8109667301177979
30th percentile: 1.849721097946167
40th percentile: 1.9005555629730224
50th percentile: 1.951390027999878
60th percentile: 2.0077778339385985
70th percentile: 2.064165639877319
80th percentile: 2.182821273803711
90th percentile: 2.3637447357177734
95th percentile: 2.4542064666748047
99th percentile: 2.5265758514404295
mean time: 2.034067964553833
Pipeline stage StressChecker completed in 12.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.74s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.78s
Shutdown handler de-registered
gryphe-pantheon-rp-1-6-_28075_v5 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 6017.62s
Shutdown handler de-registered
gryphe-pantheon-rp-1-6-_28075_v5 status is now inactive due to auto deactivation removed underperforming models
gryphe-pantheon-rp-1-6-_28075_v5 status is now torndown due to DeploymentManager action