rirv938-llama-8b-mcl-hea_9118

developer_uid: robert_irvine
submission_id: rirv938-llama-8b-mcl-hea_9118_v2
model_name: rirv938-llama-8b-mcl-hea_9118_v2
model_group: rirv938/llama_8b_mcl_hea
status: torndown
timestamp: 2024-10-21T17:48:38+00:00
num_battles: 5509
num_wins: 2579
celo_rating: 1219.43
family_friendly_score: 0.6234652114597544
family_friendly_standard_error: 0.006748009688435145
submission_type: basic
model_repo: rirv938/llama_8b_mcl_head_from_multihead
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 256
max_output_tokens: 1
display_name: rirv938-llama-8b-mcl-hea_9118_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: rirv938/llama_8b_mcl_head_from_multihead
model_size: 8B
ranking_group: single
us_pacific_date: 2024-10-21
win_ratio: 0.46814303866400436
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer
Waiting for job on rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer to finish
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║     _____            __           __                                ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║       /___/                                                         ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  Version: 0.11.12                                                   ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  https://mk1.ai                                                     ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  belonging to:                                                      ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  Chai Research Corp.                                                ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: Downloaded to shared memory in 36.612s
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmpgknwvfa_, device:0
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: quantized model in 86.626s
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: Processed model rirv938/llama_8b_mcl_head_from_multihead in 123.239s
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: creating bucket guanaco-mkml-models
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rirv938-llama-8b-mcl-hea-9118-v2
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-hea-9118-v2/config.json
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-hea-9118-v2/special_tokens_map.json
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-hea-9118-v2/tokenizer_config.json
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-hea-9118-v2/tokenizer.json
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rirv938-llama-8b-mcl-hea-9118-v2/flywheel_model.0.safetensors
rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/291 [00:00<00:57,  5.04it/s]
Loading 0:   1%|▏         | 4/291 [00:01<01:32,  3.09it/s]
Loading 0:   2%|▏         | 5/291 [00:01<02:04,  2.29it/s]
Loading 0:   3%|▎         | 8/291 [00:02<01:04,  4.38it/s]
Loading 0:   3%|▎         | 9/291 [00:02<01:03,  4.43it/s]
Loading 0:   3%|▎         | 10/291 [00:02<00:55,  5.09it/s]
Loading 0:   4%|▍         | 12/291 [00:02<01:05,  4.25it/s]
Loading 0:   4%|▍         | 13/291 [00:03<01:27,  3.19it/s]
Loading 0:   5%|▍         | 14/291 [00:04<01:50,  2.51it/s]
Loading 0:   6%|▌         | 17/291 [00:04<01:03,  4.31it/s]
Loading 0:   6%|▌         | 18/291 [00:04<01:00,  4.53it/s]
Loading 0:   7%|▋         | 21/291 [00:05<01:00,  4.44it/s]
Loading 0:   8%|▊         | 22/291 [00:05<01:17,  3.45it/s]
Loading 0:   8%|▊         | 23/291 [00:06<01:38,  2.73it/s]
Loading 0:   9%|▉         | 26/291 [00:06<01:00,  4.38it/s]
Loading 0:   9%|▉         | 27/291 [00:06<00:57,  4.58it/s]
Loading 0:  10%|▉         | 29/291 [00:07<00:43,  5.99it/s]
Loading 0:  10%|█         | 30/291 [00:07<00:43,  5.97it/s]
Loading 0:  11%|█         | 31/291 [00:07<00:43,  5.91it/s]
Loading 0:  11%|█         | 32/291 [00:07<00:40,  6.43it/s]
Loading 0:  11%|█▏        | 33/291 [00:07<00:41,  6.20it/s]
Loading 0:  12%|█▏        | 34/291 [00:08<01:10,  3.65it/s]
Loading 0:  12%|█▏        | 35/291 [00:08<01:32,  2.78it/s]
Loading 0:  12%|█▏        | 36/291 [00:09<01:54,  2.22it/s]
Loading 0:  13%|█▎        | 39/291 [00:10<01:18,  3.21it/s]
Loading 0:  14%|█▎        | 40/291 [00:10<01:32,  2.71it/s]
Loading 0:  14%|█▍        | 41/291 [00:11<01:48,  2.31it/s]
Loading 0:  15%|█▌        | 44/291 [00:11<01:02,  3.94it/s]
Loading 0:  15%|█▌        | 45/291 [00:11<00:58,  4.21it/s]
Loading 0:  16%|█▌        | 47/291 [00:11<00:41,  5.83it/s]
Loading 0:  17%|█▋        | 49/291 [00:13<01:14,  3.23it/s]
Loading 0:  17%|█▋        | 50/291 [00:13<01:31,  2.64it/s]
Loading 0:  18%|█▊        | 53/291 [00:13<00:56,  4.19it/s]
Loading 0:  19%|█▊        | 54/291 [00:14<00:53,  4.42it/s]
Loading 0:  20%|█▉        | 57/291 [00:14<00:52,  4.42it/s]
Loading 0:  20%|█▉        | 58/291 [00:15<01:06,  3.49it/s]
Loading 0:  20%|██        | 59/291 [00:16<01:22,  2.80it/s]
Loading 0:  21%|██▏       | 62/291 [00:16<00:51,  4.43it/s]
Loading 0:  22%|██▏       | 63/291 [00:16<00:49,  4.64it/s]
Loading 0:  23%|██▎       | 66/291 [00:17<00:49,  4.55it/s]
Loading 0:  23%|██▎       | 67/291 [00:17<01:03,  3.55it/s]
Loading 0:  23%|██▎       | 68/291 [00:18<01:18,  2.82it/s]
Loading 0:  24%|██▍       | 71/291 [00:18<00:49,  4.47it/s]
Loading 0:  25%|██▍       | 72/291 [00:18<00:47,  4.65it/s]
Loading 0:  25%|██▌       | 73/291 [00:18<00:42,  5.14it/s]
Loading 0:  25%|██▌       | 74/291 [00:19<01:01,  3.55it/s]
Loading 0:  26%|██▌       | 75/291 [00:20<01:19,  2.70it/s]
Loading 0:  26%|██▋       | 77/291 [00:20<00:55,  3.87it/s]
Loading 0:  27%|██▋       | 78/291 [00:20<00:50,  4.20it/s]
Loading 0:  27%|██▋       | 80/291 [00:20<00:41,  5.11it/s]
Loading 0:  28%|██▊       | 81/291 [00:21<00:58,  3.56it/s]
Loading 0:  28%|██▊       | 82/291 [00:21<01:13,  2.84it/s]
Loading 0:  29%|██▊       | 83/291 [00:22<01:28,  2.34it/s]
Loading 0:  30%|██▉       | 86/291 [00:22<00:49,  4.16it/s]
Loading 0:  30%|██▉       | 87/291 [00:22<00:46,  4.42it/s]
Loading 0:  31%|███       | 90/291 [00:23<00:45,  4.39it/s]
Loading 0:  31%|███▏      | 91/291 [00:24<00:58,  3.43it/s]
Loading 0:  32%|███▏      | 92/291 [00:24<01:12,  2.74it/s]
Loading 0:  33%|███▎      | 95/291 [00:24<00:44,  4.41it/s]
Loading 0:  33%|███▎      | 96/291 [00:25<00:42,  4.63it/s]
Loading 0:  33%|███▎      | 97/291 [00:25<00:37,  5.19it/s]
Loading 0:  34%|███▍      | 99/291 [00:25<00:44,  4.33it/s]
Loading 0:  34%|███▍      | 100/291 [00:26<00:58,  3.29it/s]
Loading 0:  35%|███▍      | 101/291 [00:27<01:13,  2.60it/s]
Loading 0:  36%|███▌      | 104/291 [00:27<00:42,  4.38it/s]
Loading 0:  36%|███▌      | 105/291 [00:27<00:40,  4.61it/s]
Loading 0:  36%|███▋      | 106/291 [00:27<00:35,  5.18it/s]
Loading 0:  37%|███▋      | 108/291 [00:28<00:42,  4.30it/s]
Loading 0:  37%|███▋      | 109/291 [00:28<00:55,  3.25it/s]
Loading 0:  38%|███▊      | 110/291 [00:29<01:09,  2.59it/s]
Loading 0:  39%|███▉      | 113/291 [00:29<00:40,  4.39it/s]
Loading 0:  39%|███▉      | 114/291 [00:29<00:38,  4.62it/s]
Loading 0:  40%|███▉      | 115/291 [00:29<00:33,  5.19it/s]
Loading 0:  40%|███▉      | 116/291 [00:30<00:50,  3.49it/s]
Loading 0:  41%|████      | 118/291 [00:30<00:36,  4.68it/s]
Loading 0:  41%|████      | 119/291 [00:30<00:35,  4.91it/s]
Loading 0:  41%|████      | 120/291 [00:30<00:30,  5.59it/s]
Loading 0:  42%|████▏     | 122/291 [00:31<00:38,  4.43it/s]
Loading 0:  43%|████▎     | 125/291 [00:32<00:34,  4.76it/s]
Loading 0:  43%|████▎     | 126/291 [00:32<00:45,  3.61it/s]
Loading 0:  44%|████▎     | 127/291 [00:33<00:57,  2.83it/s]
Loading 0:  45%|████▍     | 130/291 [00:33<00:35,  4.54it/s]
Loading 0:  45%|████▌     | 131/291 [00:33<00:33,  4.74it/s]
Loading 0:  45%|████▌     | 132/291 [00:33<00:30,  5.26it/s]
Loading 0:  46%|████▌     | 133/291 [00:33<00:30,  5.26it/s]
Loading 0:  46%|████▌     | 134/291 [00:34<00:45,  3.49it/s]
Loading 0:  46%|████▋     | 135/291 [00:35<00:59,  2.63it/s]
Loading 0:  47%|████▋     | 138/291 [00:35<00:43,  3.54it/s]
Loading 0:  48%|████▊     | 139/291 [00:36<00:52,  2.92it/s]
Loading 0:  48%|████▊     | 140/291 [00:37<01:01,  2.44it/s]
Loading 0:  49%|████▉     | 143/291 [00:37<00:36,  4.10it/s]
Loading 0:  49%|████▉     | 144/291 [00:37<00:33,  4.34it/s]
Loading 0:  50%|████▉     | 145/291 [00:37<00:30,  4.86it/s]
Loading 0:  51%|█████     | 147/291 [00:38<00:34,  4.18it/s]
Loading 0:  51%|█████     | 148/291 [00:38<00:44,  3.22it/s]
Loading 0:  51%|█████     | 149/291 [00:39<00:55,  2.58it/s]
Loading 0:  52%|█████▏    | 152/291 [00:39<00:31,  4.37it/s]
Loading 0:  53%|█████▎    | 153/291 [00:39<00:29,  4.60it/s]
Loading 0:  53%|█████▎    | 154/291 [00:39<00:26,  5.20it/s]
Loading 0:  54%|█████▎    | 156/291 [00:40<00:31,  4.32it/s]
Loading 0:  54%|█████▍    | 157/291 [00:40<00:41,  3.27it/s]
Loading 0:  54%|█████▍    | 158/291 [00:41<00:51,  2.59it/s]
Loading 0:  55%|█████▌    | 161/291 [00:41<00:29,  4.39it/s]
Loading 0:  56%|█████▌    | 162/291 [00:42<00:27,  4.62it/s]
Loading 0:  56%|█████▌    | 163/291 [00:42<00:24,  5.13it/s]
Loading 0:  57%|█████▋    | 165/291 [00:42<00:29,  4.30it/s]
Loading 0:  57%|█████▋    | 166/291 [00:43<00:38,  3.26it/s]
Loading 0:  57%|█████▋    | 167/291 [00:43<00:47,  2.60it/s]
Loading 0:  58%|█████▊    | 170/291 [00:44<00:27,  4.40it/s]
Loading 0:  59%|█████▉    | 171/291 [00:44<00:25,  4.62it/s]
Loading 0:  59%|█████▉    | 172/291 [00:44<00:22,  5.21it/s]
Loading 0:  60%|█████▉    | 174/291 [00:44<00:27,  4.33it/s]
Loading 0:  60%|██████    | 175/291 [00:45<00:35,  3.25it/s]
Loading 0:  60%|██████    | 176/291 [00:46<00:44,  2.59it/s]
Loading 0:  62%|██████▏   | 179/291 [00:46<00:25,  4.39it/s]
Loading 0:  62%|██████▏   | 180/291 [00:46<00:24,  4.62it/s]
Loading 0:  63%|██████▎   | 182/291 [00:46<00:17,  6.07it/s]
Loading 0:  63%|██████▎   | 183/291 [00:46<00:18,  5.94it/s]
Loading 0:  63%|██████▎   | 184/291 [00:47<00:18,  5.91it/s]
Loading 0:  64%|██████▎   | 185/291 [00:47<00:16,  6.55it/s]
Loading 0:  64%|██████▍   | 186/291 [00:47<00:16,  6.47it/s]
Loading 0:  64%|██████▍   | 187/291 [00:47<00:27,  3.71it/s]
Loading 0:  65%|██████▍   | 188/291 [00:48<00:36,  2.82it/s]
Loading 0:  65%|██████▍   | 189/291 [00:49<00:44,  2.30it/s]
Loading 0:  66%|██████▌   | 192/291 [00:49<00:29,  3.31it/s]
Loading 0:  66%|██████▋   | 193/291 [00:50<00:35,  2.78it/s]
Loading 0:  67%|██████▋   | 194/291 [00:50<00:41,  2.34it/s]
Loading 0:  68%|██████▊   | 197/291 [00:51<00:23,  3.98it/s]
Loading 0:  68%|██████▊   | 198/291 [00:51<00:21,  4.25it/s]
Loading 0:  68%|██████▊   | 199/291 [00:51<00:19,  4.83it/s]
Loading 0:  69%|██████▉   | 201/291 [00:52<00:21,  4.17it/s]
Loading 0:  69%|██████▉   | 202/291 [00:52<00:27,  3.21it/s]
Loading 0:  70%|██████▉   | 203/291 [00:53<00:34,  2.59it/s]
Loading 0:  71%|███████   | 206/291 [00:53<00:19,  4.38it/s]
Loading 0:  71%|███████   | 207/291 [00:53<00:18,  4.61it/s]
Loading 0:  71%|███████▏  | 208/291 [00:53<00:15,  5.20it/s]
Loading 0:  72%|███████▏  | 210/291 [00:54<00:18,  4.34it/s]
Loading 0:  73%|███████▎  | 211/291 [00:54<00:24,  3.28it/s]
Loading 0:  73%|███████▎  | 212/291 [00:55<00:30,  2.60it/s]
Loading 0:  74%|███████▍  | 215/291 [00:55<00:17,  4.39it/s]
Loading 0:  74%|███████▍  | 216/291 [00:55<00:16,  4.62it/s]
Loading 0:  75%|███████▍  | 217/291 [00:56<00:14,  5.21it/s]
Loading 0:  75%|███████▌  | 219/291 [00:56<00:16,  4.35it/s]
Loading 0:  76%|███████▌  | 220/291 [00:57<00:21,  3.28it/s]
Loading 0:  76%|███████▌  | 221/291 [00:57<00:26,  2.62it/s]
Loading 0:  77%|███████▋  | 224/291 [00:58<00:15,  4.42it/s]
Loading 0:  77%|███████▋  | 225/291 [00:58<00:14,  4.65it/s]
Loading 0:  78%|███████▊  | 226/291 [00:58<00:12,  5.25it/s]
Loading 0:  78%|███████▊  | 227/291 [00:58<00:18,  3.53it/s]
Loading 0:  78%|███████▊  | 228/291 [00:59<00:23,  2.69it/s]
Loading 0:  79%|███████▉  | 230/291 [00:59<00:15,  3.83it/s]
Loading 0:  79%|███████▉  | 231/291 [00:59<00:14,  4.16it/s]
Loading 0:  80%|███████▉  | 232/291 [01:00<00:12,  4.85it/s]
Loading 0:  80%|████████  | 233/291 [01:00<00:11,  5.25it/s]
Loading 0:  80%|████████  | 234/291 [01:00<00:16,  3.37it/s]
Loading 0:  81%|████████▏ | 237/291 [01:01<00:13,  4.14it/s]
Loading 0:  82%|████████▏ | 238/291 [01:01<00:16,  3.22it/s]
Loading 0:  82%|████████▏ | 239/291 [01:02<00:20,  2.58it/s]
Loading 0:  83%|████████▎ | 242/291 [01:02<00:11,  4.31it/s]
Loading 0:  84%|████████▎ | 243/291 [01:02<00:10,  4.54it/s]
Loading 0:  84%|████████▍ | 244/291 [01:03<00:09,  5.09it/s]
Loading 0:  85%|████████▍ | 246/291 [01:03<00:10,  4.29it/s]
Loading 0:  85%|████████▍ | 247/291 [01:04<00:13,  3.25it/s]
Loading 0:  85%|████████▌ | 248/291 [01:04<00:16,  2.59it/s]
Loading 0:  86%|████████▋ | 251/291 [01:05<00:09,  4.38it/s]
Loading 0:  87%|████████▋ | 252/291 [01:05<00:08,  4.60it/s]
Loading 0:  87%|████████▋ | 253/291 [01:05<00:07,  5.20it/s]
Loading 0:  88%|████████▊ | 255/291 [01:05<00:08,  4.32it/s]
Loading 0:  88%|████████▊ | 256/291 [01:06<00:10,  3.27it/s]
Loading 0:  88%|████████▊ | 257/291 [01:07<00:13,  2.60it/s]
Loading 0:  89%|████████▉ | 260/291 [01:07<00:07,  4.40it/s]
Loading 0:  90%|████████▉ | 261/291 [01:07<00:06,  4.63it/s]
Loading 0:  90%|█████████ | 262/291 [01:07<00:05,  5.19it/s]
Loading 0:  91%|█████████ | 264/291 [01:08<00:06,  4.32it/s]
Loading 0:  91%|█████████ | 265/291 [01:08<00:07,  3.27it/s]
Loading 0:  91%|█████████▏| 266/291 [01:09<00:09,  2.60it/s]
Loading 0:  92%|█████████▏| 269/291 [01:09<00:04,  4.40it/s]
Loading 0:  93%|█████████▎| 270/291 [01:09<00:04,  4.62it/s]
Loading 0:  93%|█████████▎| 271/291 [01:09<00:03,  5.21it/s]
Loading 0:  94%|█████████▍| 273/291 [01:10<00:04,  4.33it/s]
Loading 0:  94%|█████████▍| 274/291 [01:11<00:05,  3.27it/s]
Loading 0:  95%|█████████▍| 275/291 [01:11<00:06,  2.59it/s]
Loading 0:  96%|█████████▌| 278/291 [01:11<00:02,  4.37it/s]
Loading 0:  96%|█████████▌| 279/291 [01:12<00:02,  4.60it/s]
Loading 0:  96%|█████████▌| 280/291 [01:12<00:02,  5.18it/s]
Loading 0:  97%|█████████▋| 281/291 [01:12<00:02,  3.50it/s]
Loading 0:  97%|█████████▋| 283/291 [01:13<00:01,  4.68it/s]
Loading 0:  98%|█████████▊| 284/291 [01:13<00:01,  4.90it/s]
Loading 0:  98%|█████████▊| 285/291 [01:13<00:01,  5.57it/s]
Loading 0:  98%|█████████▊| 286/291 [01:13<00:00,  5.61it/s]
Loading 0:  99%|█████████▊| 287/291 [01:14<00:01,  3.49it/s]
Loading 0:  99%|█████████▉| 288/291 [01:14<00:01,  2.60it/s]
                                                            
Job rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer completed after 146.52s with status: succeeded
Stopping job with name rirv938-llama-8b-mcl-hea-9118-v2-mkmlizer
Pipeline stage MKMLizer completed in 147.21s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.22s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service rirv938-llama-8b-mcl-hea-9118-v2
Waiting for inference service rirv938-llama-8b-mcl-hea-9118-v2 to be ready
Inference service rirv938-llama-8b-mcl-hea-9118-v2 ready after 151.16855692863464s
Pipeline stage MKMLDeployer completed in 151.91s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.006695032119751s
Received healthy response to inference request in 2.10992693901062s
Received healthy response to inference request in 2.941723108291626s
Received healthy response to inference request in 2.620548963546753s
Received healthy response to inference request in 3.021733522415161s
5 requests
0 failed requests
5th percentile: 2.0273414134979246
10th percentile: 2.0479877948760987
20th percentile: 2.0892805576324465
30th percentile: 2.212051343917847
40th percentile: 2.4163001537323
50th percentile: 2.620548963546753
60th percentile: 2.7490186214447023
70th percentile: 2.8774882793426513
80th percentile: 2.957725191116333
90th percentile: 2.9897293567657472
95th percentile: 3.005731439590454
99th percentile: 3.01853310585022
mean time: 2.540125513076782
Pipeline stage StressChecker completed in 14.25s
Shutdown handler de-registered
rirv938-llama-8b-mcl-hea_9118_v2 status is now deployed due to DeploymentManager action
rirv938-llama-8b-mcl-hea_9118_v2 status is now inactive due to auto deactivation removed underperforming models
rirv938-llama-8b-mcl-hea_9118_v2 status is now torndown due to DeploymentManager action