chaiml-mistral-24b-2048_54327

developer_uid: rirv938
submission_id: chaiml-mistral-24b-2048_54327_v3
model_name: chaiml-mistral-24b-2048_54327_v3
model_group: ChaiML/mistral_24b_2048_
status: torndown
timestamp: 2026-02-10T00:48:19+00:00
num_battles: 10241
num_wins: 5472
celo_rating: 1327.89
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 96
reward_model: default
display_name: chaiml-mistral-24b-2048_54327_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-06
win_ratio: 0.5343228200371057
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_start|>', '<|im_end|>', '###', 'You:', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 96}
formatter: {'memory_template': '[SYSTEM_PROMPT]Respond as a high quality storyteller.[/SYSTEM_PROMPT][INST]', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '[/INST]{bot_name}:', 'truncate_by_message': False}
Resubmit model
Waiting for job on chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-mistral-24b-2048-54327-v3-mkmlizer
Waiting for job on chaiml-mistral-24b-2048-54327-v3-mkmlizer to finish
chaiml-mistral-24b-2048-54327-v3-mkmlizer: bash: cannot set terminal process group (-1): Inappropriate ioctl for device
chaiml-mistral-24b-2048-54327-v3-mkmlizer: bash: no job control in this shell
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║                                                                     ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-98p-2ff-chaiml-m-54599-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  belonging to:                                                      ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ║                                                                     ║
chaiml-mistral-24b-2048-54327-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: Downloaded to shared memory in 92.000s
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: Checking if ChaiML/98p_2ff_chaiml_mistral_24b_2048_54327_v1_cp1250_merged already exists in ChaiML
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpxsyiuh2h, device:0
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-mistral-24b-2048-54327-v3-mkmlizer: Downloaded to shared memory in 93.128s
chaiml-mistral-24b-2048-54327-v3-mkmlizer: Checking if ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged already exists in ChaiML
chaiml-mistral-24b-2048-54327-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpjdolbbkv, device:0
chaiml-mistral-24b-2048-54327-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:28, 1.34it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:28, 1.34it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:14, 1.21s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:14, 1.21s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:19, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:19, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:16, 1.79it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:16, 1.37it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:16, 1.37it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:34, 1.04it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:34, 1.04it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:58, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:14, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:26, 1.14s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.84it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:00, 1.84it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:17, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:17, 1.67it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:10, 1.31it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:46, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:46, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:54, 1.29s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:54, 1.29s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.75it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.75it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:11, 1.62it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:41<03:11, 1.62it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:06, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:06, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:34, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:34, 1.12it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:31, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:31, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:36, 1.30s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:36, 1.30s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:49, 1.75it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:49, 1.75it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:00, 1.62it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:00, 1.62it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:49, 1.27it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:49, 1.00it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:49, 1.00it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:19, 1.11it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:19, 1.11it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:12, 1.09s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:12, 1.09s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:12, 1.30s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:41, 1.73it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:50, 1.61it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.26it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:36, 1.26it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.00it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:31, 1.00it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:16, 1.95it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:26, 1.79it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:09, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:01, 1.08it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:01, 1.08it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:45, 1.14it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.07s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.07s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:25, 1.28s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:23, 1.05s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:23, 1.05s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:10, 1.24s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:01, 1.45s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:01, 1.45s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:32, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:32, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<04:00, 1.02s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<04:00, 1.02s/it]
Loading 0:  36%|███▌      | 129/363 [01:48<03:32, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:48<03:32, 1.10it/s]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:04, 1.31s/it]
Loading 0:  36%|███▌      | 131/363 [01:52<05:04, 1.31s/it]
Loading 0:  38%|███▊      | 138/363 [01:53<02:10, 1.73it/s]
Loading 0:  38%|███▊      | 138/363 [01:53<02:10, 1.73it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:17, 1.61it/s]
Loading 0:  39%|███▉      | 142/363 [01:56<02:17, 1.61it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:54, 1.26it/s]
Loading 0:  39%|███▉      | 143/363 [01:58<02:54, 1.26it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:38, 1.00it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:38, 1.00it/s]
Loading 0:  40%|████      | 147/363 [02:03<03:14, 1.11it/s]
Loading 0:  40%|████      | 147/363 [02:03<03:14, 1.11it/s]
Loading 0:  41%|████      | 148/363 [02:05<03:58, 1.11s/it]
Loading 0:  41%|████      | 148/363 [02:05<03:58, 1.11s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:41, 1.32s/it]
Loading 0:  41%|████      | 149/363 [02:07<04:41, 1.32s/it]
Loading 0:  43%|████▎     | 156/363 [02:09<02:00, 1.72it/s]
Loading 0:  43%|████▎     | 156/363 [02:09<02:00, 1.72it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 160/363 [02:11<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.26it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:39, 1.26it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:20, 1.00it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:20, 1.00it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:58, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:58, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:20<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 166/363 [02:20<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  48%|████▊     | 174/363 [02:24<01:49, 1.73it/s]
Loading 0:  48%|████▊     | 174/363 [02:24<01:49, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 178/363 [02:26<01:54, 1.61it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.26it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.26it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:01, 1.01it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:01, 1.01it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.11it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.11it/s]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:35<03:14, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:52, 1.30s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:52, 1.30s/it]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:38, 1.74it/s]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:38, 1.74it/s]
Loading 0:  54%|█████▍    | 196/363 [02:42<01:43, 1.62it/s]
Loading 0:  54%|█████▍    | 196/363 [02:42<01:43, 1.62it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:10, 1.27it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:10, 1.27it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:25, 1.11it/s]
Loading 0:  55%|█████▌    | 201/363 [02:48<02:25, 1.11it/s]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:55, 1.09s/it]
Loading 0:  56%|█████▌    | 202/363 [02:50<02:55, 1.09s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:28, 1.30s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:28, 1.30s/it]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:28, 1.73it/s]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:28, 1.73it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:32, 1.61it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:32, 1.61it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:57, 1.26it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:57, 1.26it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:26, 1.01it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:26, 1.01it/s]
Loading 0:  60%|██████    | 219/363 [03:03<02:09, 1.11it/s]
Loading 0:  60%|██████    | 219/363 [03:03<02:09, 1.11it/s]
Loading 0:  61%|██████    | 220/363 [03:06<02:35, 1.09s/it]
Loading 0:  61%|██████    | 220/363 [03:06<02:35, 1.09s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:05, 1.30s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:05, 1.30s/it]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:18, 1.73it/s]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:18, 1.73it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:21, 1.61it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:21, 1.61it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.26it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:42, 1.26it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:53, 1.11it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:53, 1.11it/s]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:16, 1.09s/it]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:16, 1.09s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:41, 1.31s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:41, 1.31s/it]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.73it/s]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.73it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:10, 1.61it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.26it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:50, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:31<01:50, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:37, 1.11it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:37, 1.11it/s]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:18, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:18, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.73it/s]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.73it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:59, 1.61it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:59, 1.61it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:32, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:32, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:58, 2.65s/it]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:58, 2.65s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:49, 2.58s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:49, 2.58s/it]
Loading 0:  76%|███████▌  | 275/363 [04:08<03:43, 2.54s/it]
Loading 0:  76%|███████▌  | 275/363 [04:08<03:43, 2.54s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.02s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.02s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:09, 1.11it/s]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:29, 1.19s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:29, 1.19s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:12, 1.01s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:12, 1.01s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:23, 1.18s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:23, 1.18s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:36, 1.38s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:36, 1.38s/it]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:37, 1.68it/s]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:37, 1.68it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:37, 1.59it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:37, 1.59it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.25it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:46, 1.25it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:56, 1.00it/s]
Loading 0:  84%|████████▍ | 306/363 [04:31<00:56, 1.00it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.11it/s]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:58, 1.10s/it]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:58, 1.10s/it]
Loading 0:  86%|████████▌ | 311/363 [04:37<01:08, 1.31s/it]
Loading 0:  86%|████████▌ | 311/363 [04:37<01:08, 1.31s/it]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.75it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:25, 1.63it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:25, 1.63it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.01it/s]
Loading 0:  89%|████████▉ | 324/363 [04:46<00:38, 1.01it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:48<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 328/363 [04:50<00:38, 1.09s/it]
Loading 0:  90%|█████████ | 328/363 [04:50<00:38, 1.09s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.30s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:44, 1.30s/it]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.75it/s]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.75it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.63it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.63it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.28it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.28it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.01it/s]
Loading 0:  94%|█████████▍| 342/363 [05:01<00:20, 1.01it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [05:03<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.09s/it]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.09s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.31s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.31s/it]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.74it/s]
Loading 0:  98%|█████████▊| 354/363 [05:09<00:05, 1.74it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 359/363 [05:12<00:02, 1.67it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 360/363 [05:14<00:02, 1.31it/s]
Loading 0:  99%|█████████▉| 361/363 [05:16<00:01, 1.05it/s]
Loading 0:  99%|█████████▉| 361/363 [05:16<00:01, 1.05it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.05it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.15it/s]
chaiml-mistral-24b-2048-54327-v3-mkmlizer: 
Loading 0:   0%|          | 0.00/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 3.00/363 [00:02<04:26, 1.35it/s]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.21s/it]
Loading 0:   1%|          | 4.00/363 [00:04<07:12, 1.21s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:16, 1.56s/it]
Loading 0:   1%|▏         | 5.00/363 [00:06<09:16, 1.56s/it]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   3%|▎         | 11.0/363 [00:07<03:15, 1.80it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0:   4%|▎         | 13.0/363 [00:10<04:15, 1.37it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:33, 1.05it/s]
Loading 0:   4%|▍         | 14.0/363 [00:12<05:33, 1.05it/s]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:57, 1.20s/it]
Loading 0:   4%|▍         | 15.0/363 [00:14<06:57, 1.20s/it]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 21.0/363 [00:17<04:13, 1.35it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0:   6%|▌         | 22.0/363 [00:19<05:15, 1.08it/s]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   6%|▋         | 23.0/363 [00:21<06:25, 1.13s/it]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.83it/s]
Loading 0:   8%|▊         | 30.0/363 [00:23<03:01, 1.83it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:17, 1.67it/s]
Loading 0:   9%|▉         | 34.0/363 [00:25<03:17, 1.67it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:11, 1.30it/s]
Loading 0:  10%|▉         | 35.0/363 [00:28<04:11, 1.30it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  10%|▉         | 36.0/363 [00:30<05:16, 1.03it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:45, 1.13it/s]
Loading 0:  11%|█         | 39.0/363 [00:32<04:45, 1.13it/s]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█         | 40.0/363 [00:34<05:45, 1.07s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:52, 1.28s/it]
Loading 0:  11%|█▏        | 41.0/363 [00:37<06:52, 1.28s/it]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0:  13%|█▎        | 48.0/363 [00:38<02:59, 1.76it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:11, 1.62it/s]
Loading 0:  14%|█▍        | 52.0/363 [00:40<03:11, 1.62it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 53.0/363 [00:43<04:03, 1.27it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:05, 1.01it/s]
Loading 0:  15%|█▍        | 54.0/363 [00:45<05:05, 1.01it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:34, 1.12it/s]
Loading 0:  16%|█▌        | 57.0/363 [00:47<04:34, 1.12it/s]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:30, 1.09s/it]
Loading 0:  16%|█▌        | 58.0/363 [00:49<05:30, 1.09s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:40, 1.32s/it]
Loading 0:  16%|█▋        | 59.0/363 [00:52<06:40, 1.32s/it]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:51, 1.73it/s]
Loading 0:  18%|█▊        | 66.0/363 [00:53<02:51, 1.73it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:01, 1.62it/s]
Loading 0:  19%|█▉        | 70.0/363 [00:56<03:01, 1.62it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 71.0/363 [00:58<03:50, 1.27it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  20%|█▉        | 72.0/363 [01:00<04:48, 1.01it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 75.0/363 [01:02<04:18, 1.11it/s]
Loading 0:  21%|██        | 76.0/363 [01:04<05:12, 1.09s/it]
Loading 0:  21%|██        | 76.0/363 [01:04<05:12, 1.09s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:11, 1.30s/it]
Loading 0:  21%|██        | 77.0/363 [01:07<06:11, 1.30s/it]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:39, 1.75it/s]
Loading 0:  23%|██▎       | 84.0/363 [01:08<02:39, 1.75it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:49, 1.63it/s]
Loading 0:  24%|██▍       | 88.0/363 [01:11<02:49, 1.63it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:34, 1.27it/s]
Loading 0:  25%|██▍       | 89.0/363 [01:13<03:34, 1.27it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:29, 1.01it/s]
Loading 0:  25%|██▍       | 90.0/363 [01:15<04:29, 1.01it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:15, 1.96it/s]
Loading 0:  27%|██▋       | 97.0/363 [01:16<02:15, 1.96it/s]
Loading 0:  28%|██▊       | 101/363 [01:19<02:25, 1.80it/s] 
Loading 0:  28%|██▊       | 101/363 [01:19<02:25, 1.80it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 102/363 [01:21<03:08, 1.38it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:01, 1.08it/s]
Loading 0:  28%|██▊       | 103/363 [01:23<04:01, 1.08it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:46, 1.14it/s]
Loading 0:  29%|██▉       | 106/363 [01:26<03:46, 1.14it/s]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.07s/it]
Loading 0:  29%|██▉       | 107/363 [01:28<04:32, 1.07s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:32, 1.30s/it]
Loading 0:  30%|██▉       | 108/363 [01:30<05:32, 1.30s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:27, 1.06s/it]
Loading 0:  31%|███       | 111/363 [01:33<04:27, 1.06s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 112/363 [01:35<05:13, 1.25s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:03, 1.45s/it]
Loading 0:  31%|███       | 113/363 [01:37<06:03, 1.45s/it]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  33%|███▎      | 120/363 [01:38<02:25, 1.67it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 124/363 [01:41<02:31, 1.57it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  34%|███▍      | 125/363 [01:43<03:12, 1.24it/s]
Loading 0:  35%|███▍      | 126/363 [01:45<04:00, 1.01s/it]
Loading 0:  35%|███▍      | 126/363 [01:45<04:00, 1.01s/it]
Loading 0:  36%|███▌      | 129/363 [01:48<03:33, 1.10it/s]
Loading 0:  36%|███▌      | 129/363 [01:48<03:33, 1.10it/s]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 130/363 [01:50<04:16, 1.10s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:24, 1.40s/it]
Loading 0:  36%|███▌      | 131/363 [01:53<05:24, 1.40s/it]
Loading 0:  38%|███▊      | 138/363 [01:54<02:17, 1.64it/s]
Loading 0:  38%|███▊      | 138/363 [01:54<02:17, 1.64it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:22, 1.55it/s]
Loading 0:  39%|███▉      | 142/363 [01:57<02:22, 1.55it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:58, 1.23it/s]
Loading 0:  39%|███▉      | 143/363 [01:59<02:58, 1.23it/s]
Loading 0:  40%|███▉      | 144/363 [02:01<03:41, 1.01s/it]
Loading 0:  40%|███▉      | 144/363 [02:01<03:41, 1.01s/it]
Loading 0:  40%|████      | 147/363 [02:03<03:16, 1.10it/s]
Loading 0:  40%|████      | 147/363 [02:03<03:16, 1.10it/s]
Loading 0:  41%|████      | 148/363 [02:05<03:55, 1.10s/it]
Loading 0:  41%|████      | 148/363 [02:05<03:55, 1.10s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:39, 1.31s/it]
Loading 0:  41%|████      | 149/363 [02:08<04:39, 1.31s/it]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  43%|████▎     | 156/363 [02:09<01:59, 1.73it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 160/363 [02:12<02:06, 1.61it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:40, 1.26it/s]
Loading 0:  44%|████▍     | 161/363 [02:14<02:40, 1.26it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:20, 1.00it/s]
Loading 0:  45%|████▍     | 162/363 [02:16<03:20, 1.00it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:58, 1.11it/s]
Loading 0:  45%|████▌     | 165/363 [02:18<02:58, 1.11it/s]
Loading 0:  46%|████▌     | 166/363 [02:21<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 166/363 [02:21<03:34, 1.09s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  46%|████▌     | 167/363 [02:23<04:15, 1.30s/it]
Loading 0:  48%|████▊     | 174/363 [02:24<01:48, 1.73it/s]
Loading 0:  48%|████▊     | 174/363 [02:24<01:48, 1.73it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:54, 1.62it/s]
Loading 0:  49%|████▉     | 178/363 [02:27<01:54, 1.62it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.27it/s]
Loading 0:  49%|████▉     | 179/363 [02:29<02:25, 1.27it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:01, 1.01it/s]
Loading 0:  50%|████▉     | 180/363 [02:31<03:01, 1.01it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.12it/s]
Loading 0:  50%|█████     | 183/363 [02:33<02:41, 1.12it/s]
Loading 0:  51%|█████     | 184/363 [02:36<03:14, 1.09s/it]
Loading 0:  51%|█████     | 184/363 [02:36<03:14, 1.09s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:51, 1.30s/it]
Loading 0:  51%|█████     | 185/363 [02:38<03:51, 1.30s/it]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:38, 1.73it/s]
Loading 0:  53%|█████▎    | 192/363 [02:39<01:38, 1.73it/s]
Loading 0:  54%|█████▍    | 196/363 [02:42<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 196/363 [02:42<01:43, 1.61it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:11, 1.27it/s]
Loading 0:  54%|█████▍    | 197/363 [02:44<02:11, 1.27it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▍    | 198/363 [02:46<02:43, 1.01it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:25, 1.12it/s]
Loading 0:  55%|█████▌    | 201/363 [02:49<02:25, 1.12it/s]
Loading 0:  56%|█████▌    | 202/363 [02:51<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 202/363 [02:51<02:54, 1.08s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:27, 1.30s/it]
Loading 0:  56%|█████▌    | 203/363 [02:53<03:27, 1.30s/it]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:27, 1.74it/s]
Loading 0:  58%|█████▊    | 210/363 [02:54<01:27, 1.74it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:32, 1.61it/s]
Loading 0:  59%|█████▉    | 214/363 [02:57<01:32, 1.61it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:56, 1.27it/s]
Loading 0:  59%|█████▉    | 215/363 [02:59<01:56, 1.27it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:25, 1.01it/s]
Loading 0:  60%|█████▉    | 216/363 [03:01<02:25, 1.01it/s]
Loading 0:  60%|██████    | 219/363 [03:04<02:09, 1.12it/s]
Loading 0:  60%|██████    | 219/363 [03:04<02:09, 1.12it/s]
Loading 0:  61%|██████    | 220/363 [03:06<02:35, 1.09s/it]
Loading 0:  61%|██████    | 220/363 [03:06<02:35, 1.09s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:04, 1.30s/it]
Loading 0:  61%|██████    | 221/363 [03:08<03:04, 1.30s/it]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.75it/s]
Loading 0:  63%|██████▎   | 228/363 [03:09<01:17, 1.75it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:20, 1.63it/s]
Loading 0:  64%|██████▍   | 232/363 [03:12<01:20, 1.63it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:41, 1.28it/s]
Loading 0:  64%|██████▍   | 233/363 [03:14<01:41, 1.28it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  64%|██████▍   | 234/363 [03:16<02:07, 1.01it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:52, 1.12it/s]
Loading 0:  65%|██████▌   | 237/363 [03:19<01:52, 1.12it/s]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 238/363 [03:21<02:15, 1.08s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:40, 1.30s/it]
Loading 0:  66%|██████▌   | 239/363 [03:23<02:40, 1.30s/it]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.73it/s]
Loading 0:  68%|██████▊   | 246/363 [03:24<01:07, 1.73it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:09, 1.61it/s]
Loading 0:  69%|██████▉   | 250/363 [03:27<01:09, 1.61it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.27it/s]
Loading 0:  69%|██████▉   | 251/363 [03:29<01:28, 1.27it/s]
Loading 0:  69%|██████▉   | 252/363 [03:32<01:49, 1.01it/s]
Loading 0:  69%|██████▉   | 252/363 [03:32<01:49, 1.01it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:36, 1.12it/s]
Loading 0:  70%|███████   | 255/363 [03:34<01:36, 1.12it/s]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 256/363 [03:36<01:56, 1.09s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:18, 1.30s/it]
Loading 0:  71%|███████   | 257/363 [03:38<02:18, 1.30s/it]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.73it/s]
Loading 0:  73%|███████▎  | 264/363 [03:39<00:57, 1.73it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.62it/s]
Loading 0:  74%|███████▍  | 268/363 [03:42<00:58, 1.62it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 269/363 [03:44<01:14, 1.26it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:32, 1.01it/s]
Loading 0:  74%|███████▍  | 270/363 [03:47<01:32, 1.01it/s]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:55, 2.61s/it]
Loading 0:  75%|███████▌  | 273/363 [04:03<03:55, 2.61s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:46, 2.55s/it]
Loading 0:  75%|███████▌  | 274/363 [04:05<03:46, 2.55s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:40, 2.51s/it]
Loading 0:  76%|███████▌  | 275/363 [04:07<03:40, 2.51s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.01s/it]
Loading 0:  78%|███████▊  | 282/363 [04:09<01:22, 1.01s/it]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:08, 1.12it/s]
Loading 0:  79%|███████▉  | 286/363 [04:11<01:08, 1.12it/s]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 287/363 [04:13<01:17, 1.02s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:29, 1.19s/it]
Loading 0:  79%|███████▉  | 288/363 [04:16<01:29, 1.19s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:13, 1.02s/it]
Loading 0:  80%|████████  | 291/363 [04:18<01:13, 1.02s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:24, 1.19s/it]
Loading 0:  80%|████████  | 292/363 [04:20<01:24, 1.19s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:36, 1.38s/it]
Loading 0:  81%|████████  | 293/363 [04:22<01:36, 1.38s/it]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:37, 1.67it/s]
Loading 0:  83%|████████▎ | 300/363 [04:23<00:37, 1.67it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:36, 1.61it/s]
Loading 0:  84%|████████▎ | 304/363 [04:26<00:36, 1.61it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:45, 1.27it/s]
Loading 0:  84%|████████▍ | 305/363 [04:28<00:45, 1.27it/s]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:56, 1.01it/s]
Loading 0:  84%|████████▍ | 306/363 [04:30<00:56, 1.01it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 309/363 [04:33<00:48, 1.12it/s]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:57, 1.08s/it]
Loading 0:  85%|████████▌ | 310/363 [04:35<00:57, 1.08s/it]
Loading 0:  86%|████████▌ | 311/363 [04:37<01:07, 1.30s/it]
Loading 0:  86%|████████▌ | 311/363 [04:37<01:07, 1.30s/it]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.77it/s]
Loading 0:  88%|████████▊ | 318/363 [04:38<00:25, 1.77it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:24, 1.64it/s]
Loading 0:  89%|████████▊ | 322/363 [04:41<00:24, 1.64it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0:  89%|████████▉ | 323/363 [04:43<00:31, 1.28it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.02it/s]
Loading 0:  89%|████████▉ | 324/363 [04:45<00:38, 1.02it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 327/363 [04:47<00:32, 1.12it/s]
Loading 0:  90%|█████████ | 328/363 [04:50<00:37, 1.08s/it]
Loading 0:  90%|█████████ | 328/363 [04:50<00:37, 1.08s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:43, 1.29s/it]
Loading 0:  91%|█████████ | 329/363 [04:52<00:43, 1.29s/it]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.77it/s]
Loading 0:  93%|█████████▎| 336/363 [04:53<00:15, 1.77it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.64it/s]
Loading 0:  94%|█████████▎| 340/363 [04:56<00:14, 1.64it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.29it/s]
Loading 0:  94%|█████████▍| 341/363 [04:58<00:17, 1.29it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.02it/s]
Loading 0:  94%|█████████▍| 342/363 [05:00<00:20, 1.02it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 345/363 [05:02<00:16, 1.12it/s]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.08s/it]
Loading 0:  95%|█████████▌| 346/363 [05:05<00:18, 1.08s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.29s/it]
Loading 0:  96%|█████████▌| 347/363 [05:07<00:20, 1.29s/it]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.77it/s]
Loading 0:  98%|█████████▊| 354/363 [05:08<00:05, 1.77it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.69it/s]
Loading 0:  99%|█████████▉| 359/363 [05:11<00:02, 1.69it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.33it/s]
Loading 0:  99%|█████████▉| 360/363 [05:13<00:02, 1.33it/s]
Loading 0:  99%|█████████▉| 361/363 [05:16<00:01, 1.06it/s]
Loading 0:  99%|█████████▉| 361/363 [05:16<00:01, 1.06it/s]
Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.06it/s]
                                                           

Loading 0: 100%|██████████| 363/363 [05:16<00:00, 1.15it/s]
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: The tokenizer you are loading from '/tmp/tmpxsyiuh2h' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: quantized model in 324.173s
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: Processed model ChaiML/98p_2ff_chaiml_mistral_24b_2048_54327_v1_cp1250_merged in 416.173s
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: creating bucket guanaco-mkml-models
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-60819-v1/nvidia
chaiml-mistral-24b-2048-54327-v3-mkmlizer: The tokenizer you are loading from '/tmp/tmpjdolbbkv' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-mistral-24b-2048-54327-v3-mkmlizer: quantized model in 324.219s
chaiml-mistral-24b-2048-54327-v3-mkmlizer: Processed model ChaiML/mistral_24b_2048_gemini_opus_ds_v12_843_merged in 417.348s
chaiml-mistral-24b-2048-54327-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-mistral-24b-2048-54327-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-mistral-24b-2048-54327-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v3/nvidia
chaiml-mistral-24b-2048-54327-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v3/nvidia/tokenizer_config.json
chaiml-mistral-24b-2048-54327-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v3/nvidia/config.json
chaiml-mistral-24b-2048-54327-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v3/nvidia/special_tokens_map.json
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-60819-v1/nvidia/tokenizer.json
chaiml-mistral-24b-2048-54327-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v3/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-60819-v1/nvidia/flywheel_model.1.safetensors
chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-98p-2ff-chaiml-m-60819-v1/nvidia/flywheel_model.0.safetensors
Job chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer completed after 854.89s with status: succeeded
Stopping job with name chaiml-98p-2ff-chaiml-m-60819-v1-mkmlizer
Pipeline stage MKMLizer completed in 856.56s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.49s
run pipeline stage %s
Running pipeline stage MKMLDeployer
chaiml-mistral-24b-2048-54327-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-mistral-24b-2048-54327-v3/nvidia/flywheel_model.0.safetensors
Creating inference service chaiml-98p-2ff-chaiml-m-60819-v1
Job chaiml-mistral-24b-2048-54327-v3-mkmlizer completed after 854.51s with status: succeeded
Waiting for inference service chaiml-98p-2ff-chaiml-m-60819-v1 to be ready
Stopping job with name chaiml-mistral-24b-2048-54327-v3-mkmlizer
Pipeline stage MKMLizer completed in 856.89s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.59s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-mistral-24b-2048-54327-v3
Waiting for inference service chaiml-mistral-24b-2048-54327-v3 to be ready
Inference service chaiml-mistral-24b-2048-54327-v3 ready after 263.95714592933655s
Pipeline stage MKMLDeployer completed in 266.11s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.874232292175293s
Inference service chaiml-98p-2ff-chaiml-m-60819-v1 ready after 274.1250126361847s
Pipeline stage MKMLDeployer completed in 276.19s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3141090869903564s
Received healthy response to inference request in 3.262197494506836s
Received healthy response to inference request in 3.177410840988159s
Received healthy response to inference request in 3.345396041870117s
Received healthy response to inference request in 3.069885015487671s
Received healthy response to inference request in 3.1849942207336426s
Received healthy response to inference request in 3.217259168624878s
5 requests
0 failed requests
5th percentile: 3.0913901805877684
10th percentile: 3.1128953456878663
Received healthy response to inference request in 2.7523248195648193s
20th percentile: 3.1559056758880617
30th percentile: 3.1853805065155028
40th percentile: 3.2013198375701903
50th percentile: 3.217259168624878
60th percentile: 3.255999135971069
70th percentile: 3.294739103317261
80th percentile: 3.426133728027344
90th percentile: 3.650183010101318
95th percentile: 3.7622076511383056
Received healthy response to inference request in 2.836663007736206s
99th percentile: 3.8518273639678955
5 requests
mean time: 3.3305792808532715
0 failed requests
Pipeline stage StressChecker completed in 25.20s
5th percentile: 2.7691924571990967
run pipeline stage %s
10th percentile: 2.786060094833374
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
20th percentile: 2.8197953701019287
run_pipeline:run_in_cloud %s
30th percentile: 2.9063292503356934
starting trigger_guanaco_pipeline args=%s
40th percentile: 3.045661735534668
50th percentile: 3.1849942207336426
triggered trigger_guanaco_pipeline args=%s
60th percentile: 3.21587553024292
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.32s
70th percentile: 3.246756839752197
run pipeline stage %s
80th percentile: 3.278837203979492
Running pipeline stage TriggerMKMLProfilingPipeline
90th percentile: 3.3121166229248047
run_pipeline:run_in_cloud %s
95th percentile: 3.328756332397461
starting trigger_guanaco_pipeline args=%s
99th percentile: 3.342068099975586
mean time: 3.0763151168823244
triggered trigger_guanaco_pipeline args=%s
Pipeline stage StressChecker completed in 25.72s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.22s
run pipeline stage %s
Shutdown handler de-registered
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
chaiml-mistral-24b-2048_54327_v3 status is now deployed due to DeploymentManager action
chaiml-mistral-24b-2048_54327_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-mistral-24b-2048_54327_v3 status is now torndown due to DeploymentManager action