developer_uid: robert_irvine
submission_id: rirv938-llama-8b-mcl-2m-_5910_v2
model_name: rirv938-llama-8b-mcl-2m-_5910_v2
model_group: rirv938/llama_8b_mcl_2m_
status: torndown
timestamp: 2024-10-14T17:14:57+00:00
num_battles: 7518
num_wins: 3390
celo_rating: 1211.76
family_friendly_score: 0.6091970121381887
family_friendly_standard_error: 0.005747302436240778
submission_type: basic
model_repo: rirv938/llama_8b_mcl_2m_256_tokens_step_7800
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 256
max_output_tokens: 1
display_name: rirv938-llama-8b-mcl-2m-_5910_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: rirv938/llama_8b_mcl_2m_256_tokens_step_7800
model_size: 8B
ranking_group: single
us_pacific_date: 2024-10-14
win_ratio: 0.4509177972865124
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer
Waiting for job on rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer to finish
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║     _____            __           __                                ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║       /___/                                                         ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  Version: 0.11.12                                                   ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  https://mk1.ai                                                     ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  belonging to:                                                      ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  Chai Research Corp.                                                ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ║                                                                     ║
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: Downloaded to shared memory in 56.201s
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmpebzqqmej, device:0
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: quantized model in 87.914s
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: Processed model rirv938/llama_8b_mcl_2m_256_tokens_step_7800 in 144.115s
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: creating bucket guanaco-mkml-models
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rirv938-llama-8b-mcl-2m-5910-v2
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-2m-5910-v2/config.json
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-2m-5910-v2/tokenizer_config.json
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-2m-5910-v2/special_tokens_map.json
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rirv938-llama-8b-mcl-2m-5910-v2/tokenizer.json
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rirv938-llama-8b-mcl-2m-5910-v2/flywheel_model.0.safetensors
rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/291 [00:00<00:58,  4.94it/s]
Loading 0:   1%|▏         | 4/291 [00:01<01:35,  3.02it/s]
Loading 0:   2%|▏         | 5/291 [00:01<02:08,  2.22it/s]
Loading 0:   3%|▎         | 8/291 [00:02<01:06,  4.25it/s]
Loading 0:   3%|▎         | 9/291 [00:02<01:05,  4.32it/s]
Loading 0:   3%|▎         | 10/291 [00:02<00:57,  4.92it/s]
Loading 0:   4%|▍         | 12/291 [00:03<01:07,  4.12it/s]
Loading 0:   4%|▍         | 13/291 [00:03<01:29,  3.11it/s]
Loading 0:   5%|▍         | 14/291 [00:04<01:52,  2.46it/s]
Loading 0:   6%|▌         | 17/291 [00:04<01:04,  4.22it/s]
Loading 0:   6%|▌         | 18/291 [00:04<01:01,  4.44it/s]
Loading 0:   7%|▋         | 19/291 [00:04<00:55,  4.94it/s]
Loading 0:   7%|▋         | 21/291 [00:05<01:05,  4.15it/s]
Loading 0:   8%|▊         | 22/291 [00:06<01:25,  3.15it/s]
Loading 0:   8%|▊         | 23/291 [00:06<01:48,  2.47it/s]
Loading 0:   9%|▉         | 26/291 [00:06<01:02,  4.27it/s]
Loading 0:   9%|▉         | 27/291 [00:07<00:58,  4.50it/s]
Loading 0:  10%|▉         | 28/291 [00:07<00:53,  4.95it/s]
Loading 0:  10%|█         | 30/291 [00:07<00:43,  6.03it/s]
Loading 0:  11%|█         | 31/291 [00:07<00:43,  5.97it/s]
Loading 0:  11%|█         | 32/291 [00:07<00:39,  6.55it/s]
Loading 0:  11%|█▏        | 33/291 [00:07<00:41,  6.25it/s]
Loading 0:  12%|█▏        | 34/291 [00:08<01:10,  3.64it/s]
Loading 0:  12%|█▏        | 35/291 [00:09<01:32,  2.78it/s]
Loading 0:  12%|█▏        | 36/291 [00:09<01:53,  2.24it/s]
Loading 0:  13%|█▎        | 39/291 [00:10<01:18,  3.21it/s]
Loading 0:  14%|█▎        | 40/291 [00:10<01:32,  2.70it/s]
Loading 0:  14%|█▍        | 41/291 [00:11<01:49,  2.29it/s]
Loading 0:  15%|█▌        | 44/291 [00:11<01:02,  3.94it/s]
Loading 0:  15%|█▌        | 45/291 [00:12<00:58,  4.18it/s]
Loading 0:  16%|█▌        | 46/291 [00:12<00:51,  4.77it/s]
Loading 0:  16%|█▋        | 48/291 [00:12<00:59,  4.12it/s]
Loading 0:  17%|█▋        | 49/291 [00:13<01:16,  3.15it/s]
Loading 0:  17%|█▋        | 50/291 [00:13<01:36,  2.50it/s]
Loading 0:  18%|█▊        | 53/291 [00:14<00:55,  4.31it/s]
Loading 0:  19%|█▊        | 54/291 [00:14<00:52,  4.53it/s]
Loading 0:  19%|█▉        | 55/291 [00:14<00:46,  5.12it/s]
Loading 0:  20%|█▉        | 57/291 [00:15<00:54,  4.27it/s]
Loading 0:  20%|█▉        | 58/291 [00:15<01:12,  3.22it/s]
Loading 0:  20%|██        | 59/291 [00:16<01:31,  2.54it/s]
Loading 0:  21%|██▏       | 62/291 [00:16<00:52,  4.38it/s]
Loading 0:  22%|██▏       | 63/291 [00:16<00:49,  4.60it/s]
Loading 0:  22%|██▏       | 64/291 [00:16<00:43,  5.21it/s]
Loading 0:  23%|██▎       | 66/291 [00:17<00:52,  4.30it/s]
Loading 0:  23%|██▎       | 67/291 [00:17<01:09,  3.22it/s]
Loading 0:  23%|██▎       | 68/291 [00:18<01:27,  2.54it/s]
Loading 0:  24%|██▍       | 71/291 [00:18<00:51,  4.30it/s]
Loading 0:  25%|██▍       | 72/291 [00:18<00:48,  4.54it/s]
Loading 0:  25%|██▌       | 73/291 [00:19<00:42,  5.13it/s]
Loading 0:  25%|██▌       | 74/291 [00:19<01:02,  3.48it/s]
Loading 0:  26%|██▌       | 75/291 [00:20<01:22,  2.62it/s]
Loading 0:  26%|██▋       | 77/291 [00:20<00:57,  3.74it/s]
Loading 0:  27%|██▋       | 78/291 [00:20<00:52,  4.07it/s]
Loading 0:  27%|██▋       | 79/291 [00:20<00:44,  4.74it/s]
Loading 0:  27%|██▋       | 80/291 [00:21<00:42,  4.97it/s]
Loading 0:  28%|██▊       | 81/291 [00:21<01:04,  3.24it/s]
Loading 0:  28%|██▊       | 82/291 [00:22<01:21,  2.58it/s]
Loading 0:  29%|██▊       | 83/291 [00:22<01:37,  2.14it/s]
Loading 0:  30%|██▉       | 86/291 [00:23<00:50,  4.03it/s]
Loading 0:  30%|██▉       | 87/291 [00:23<00:47,  4.29it/s]
Loading 0:  30%|███       | 88/291 [00:23<00:41,  4.91it/s]
Loading 0:  31%|███       | 90/291 [00:23<00:48,  4.15it/s]
Loading 0:  31%|███▏      | 91/291 [00:24<01:03,  3.14it/s]
Loading 0:  32%|███▏      | 92/291 [00:25<01:19,  2.50it/s]
Loading 0:  33%|███▎      | 95/291 [00:25<00:45,  4.34it/s]
Loading 0:  33%|███▎      | 96/291 [00:25<00:42,  4.57it/s]
Loading 0:  33%|███▎      | 97/291 [00:25<00:37,  5.15it/s]
Loading 0:  34%|███▍      | 99/291 [00:26<00:44,  4.27it/s]
Loading 0:  34%|███▍      | 100/291 [00:26<00:59,  3.22it/s]
Loading 0:  35%|███▍      | 101/291 [00:27<01:14,  2.54it/s]
Loading 0:  36%|███▌      | 104/291 [00:27<00:42,  4.39it/s]
Loading 0:  36%|███▌      | 105/291 [00:27<00:40,  4.62it/s]
Loading 0:  36%|███▋      | 106/291 [00:27<00:35,  5.19it/s]
Loading 0:  37%|███▋      | 108/291 [00:28<00:42,  4.30it/s]
Loading 0:  37%|███▋      | 109/291 [00:29<00:56,  3.24it/s]
Loading 0:  38%|███▊      | 110/291 [00:29<01:10,  2.56it/s]
Loading 0:  39%|███▉      | 113/291 [00:30<00:40,  4.35it/s]
Loading 0:  39%|███▉      | 114/291 [00:30<00:38,  4.57it/s]
Loading 0:  40%|███▉      | 115/291 [00:30<00:34,  5.08it/s]
Loading 0:  40%|███▉      | 116/291 [00:30<00:50,  3.44it/s]
Loading 0:  41%|████      | 118/291 [00:31<00:36,  4.70it/s]
Loading 0:  41%|████      | 119/291 [00:31<00:35,  4.90it/s]
Loading 0:  41%|████      | 120/291 [00:31<00:30,  5.54it/s]
Loading 0:  42%|████▏     | 122/291 [00:31<00:38,  4.39it/s]
Loading 0:  43%|████▎     | 125/291 [00:32<00:35,  4.69it/s]
Loading 0:  43%|████▎     | 126/291 [00:33<00:46,  3.55it/s]
Loading 0:  44%|████▎     | 127/291 [00:33<00:59,  2.77it/s]
Loading 0:  45%|████▍     | 130/291 [00:34<00:36,  4.44it/s]
Loading 0:  45%|████▌     | 131/291 [00:34<00:34,  4.65it/s]
Loading 0:  45%|████▌     | 132/291 [00:34<00:30,  5.18it/s]
Loading 0:  46%|████▌     | 133/291 [00:34<00:29,  5.32it/s]
Loading 0:  46%|████▌     | 134/291 [00:35<00:45,  3.48it/s]
Loading 0:  46%|████▋     | 135/291 [00:35<00:59,  2.61it/s]
Loading 0:  47%|████▋     | 138/291 [00:36<00:43,  3.50it/s]
Loading 0:  48%|████▊     | 139/291 [00:36<00:52,  2.88it/s]
Loading 0:  48%|████▊     | 140/291 [00:37<01:03,  2.39it/s]
Loading 0:  49%|████▉     | 143/291 [00:37<00:36,  4.01it/s]
Loading 0:  49%|████▉     | 144/291 [00:37<00:34,  4.26it/s]
Loading 0:  50%|████▉     | 145/291 [00:38<00:30,  4.82it/s]
Loading 0:  51%|█████     | 147/291 [00:38<00:34,  4.14it/s]
Loading 0:  51%|█████     | 148/291 [00:39<00:44,  3.18it/s]
Loading 0:  51%|█████     | 149/291 [00:39<00:55,  2.54it/s]
Loading 0:  52%|█████▏    | 152/291 [00:40<00:32,  4.31it/s]
Loading 0:  53%|█████▎    | 153/291 [00:40<00:30,  4.53it/s]
Loading 0:  53%|█████▎    | 154/291 [00:40<00:27,  5.06it/s]
Loading 0:  54%|█████▎    | 156/291 [00:41<00:31,  4.24it/s]
Loading 0:  54%|█████▍    | 157/291 [00:41<00:41,  3.21it/s]
Loading 0:  54%|█████▍    | 158/291 [00:42<00:52,  2.54it/s]
Loading 0:  55%|█████▌    | 161/291 [00:42<00:30,  4.30it/s]
Loading 0:  56%|█████▌    | 162/291 [00:42<00:28,  4.52it/s]
Loading 0:  56%|█████▌    | 163/291 [00:42<00:25,  5.08it/s]
Loading 0:  57%|█████▋    | 165/291 [00:43<00:29,  4.23it/s]
Loading 0:  57%|█████▋    | 166/291 [00:43<00:39,  3.19it/s]
Loading 0:  57%|█████▋    | 167/291 [00:44<00:48,  2.54it/s]
Loading 0:  58%|█████▊    | 170/291 [00:44<00:28,  4.31it/s]
Loading 0:  59%|█████▉    | 171/291 [00:45<00:26,  4.54it/s]
Loading 0:  59%|█████▉    | 172/291 [00:45<00:23,  5.13it/s]
Loading 0:  60%|█████▉    | 174/291 [00:45<00:27,  4.28it/s]
Loading 0:  60%|██████    | 175/291 [00:46<00:35,  3.23it/s]
Loading 0:  60%|██████    | 176/291 [00:46<00:44,  2.57it/s]
Loading 0:  62%|██████▏   | 179/291 [00:47<00:25,  4.35it/s]
Loading 0:  62%|██████▏   | 180/291 [00:47<00:24,  4.58it/s]
Loading 0:  62%|██████▏   | 181/291 [00:47<00:21,  5.15it/s]
Loading 0:  63%|██████▎   | 183/291 [00:47<00:17,  6.22it/s]
Loading 0:  63%|██████▎   | 184/291 [00:47<00:17,  6.12it/s]
Loading 0:  64%|██████▎   | 185/291 [00:47<00:15,  6.67it/s]
Loading 0:  64%|██████▍   | 186/291 [00:48<00:16,  6.39it/s]
Loading 0:  64%|██████▍   | 187/291 [00:48<00:28,  3.70it/s]
Loading 0:  65%|██████▍   | 188/291 [00:49<00:36,  2.79it/s]
Loading 0:  65%|██████▍   | 189/291 [00:49<00:45,  2.24it/s]
Loading 0:  66%|██████▌   | 192/291 [00:50<00:30,  3.23it/s]
Loading 0:  66%|██████▋   | 193/291 [00:51<00:36,  2.72it/s]
Loading 0:  67%|██████▋   | 194/291 [00:51<00:41,  2.31it/s]
Loading 0:  68%|██████▊   | 197/291 [00:52<00:23,  3.94it/s]
Loading 0:  68%|██████▊   | 198/291 [00:52<00:22,  4.20it/s]
Loading 0:  68%|██████▊   | 199/291 [00:52<00:19,  4.75it/s]
Loading 0:  69%|██████▉   | 201/291 [00:52<00:21,  4.11it/s]
Loading 0:  69%|██████▉   | 202/291 [00:53<00:28,  3.14it/s]
Loading 0:  70%|██████▉   | 203/291 [00:54<00:35,  2.51it/s]
Loading 0:  71%|███████   | 206/291 [00:54<00:20,  4.25it/s]
Loading 0:  71%|███████   | 207/291 [00:54<00:18,  4.48it/s]
Loading 0:  71%|███████▏  | 208/291 [00:54<00:16,  5.05it/s]
Loading 0:  72%|███████▏  | 210/291 [00:55<00:19,  4.25it/s]
Loading 0:  73%|███████▎  | 211/291 [00:55<00:24,  3.22it/s]
Loading 0:  73%|███████▎  | 212/291 [00:56<00:30,  2.56it/s]
Loading 0:  74%|███████▍  | 215/291 [00:56<00:17,  4.32it/s]
Loading 0:  74%|███████▍  | 216/291 [00:56<00:16,  4.55it/s]
Loading 0:  75%|███████▍  | 217/291 [00:56<00:14,  5.11it/s]
Loading 0:  75%|███████▌  | 219/291 [00:57<00:16,  4.28it/s]
Loading 0:  76%|███████▌  | 220/291 [00:58<00:21,  3.24it/s]
Loading 0:  76%|███████▌  | 221/291 [00:58<00:27,  2.57it/s]
Loading 0:  77%|███████▋  | 224/291 [00:58<00:15,  4.41it/s]
Loading 0:  77%|███████▋  | 225/291 [00:59<00:14,  4.63it/s]
Loading 0:  78%|███████▊  | 226/291 [00:59<00:12,  5.16it/s]
Loading 0:  78%|███████▊  | 227/291 [00:59<00:18,  3.46it/s]
Loading 0:  78%|███████▊  | 228/291 [01:00<00:24,  2.62it/s]
Loading 0:  79%|███████▉  | 230/291 [01:00<00:16,  3.80it/s]
Loading 0:  79%|███████▉  | 231/291 [01:00<00:14,  4.13it/s]
Loading 0:  80%|███████▉  | 232/291 [01:00<00:12,  4.82it/s]
Loading 0:  80%|████████  | 233/291 [01:01<00:11,  5.16it/s]
Loading 0:  80%|████████  | 234/291 [01:01<00:17,  3.32it/s]
Loading 0:  81%|████████▏ | 237/291 [01:02<00:13,  4.07it/s]
Loading 0:  82%|████████▏ | 238/291 [01:02<00:16,  3.17it/s]
Loading 0:  82%|████████▏ | 239/291 [01:03<00:20,  2.55it/s]
Loading 0:  83%|████████▎ | 242/291 [01:03<00:11,  4.27it/s]
Loading 0:  84%|████████▎ | 243/291 [01:03<00:10,  4.47it/s]
Loading 0:  84%|████████▍ | 244/291 [01:04<00:09,  5.00it/s]
Loading 0:  85%|████████▍ | 246/291 [01:04<00:10,  4.21it/s]
Loading 0:  85%|████████▍ | 247/291 [01:05<00:13,  3.20it/s]
Loading 0:  85%|████████▌ | 248/291 [01:05<00:16,  2.55it/s]
Loading 0:  86%|████████▋ | 251/291 [01:06<00:09,  4.31it/s]
Loading 0:  87%|████████▋ | 252/291 [01:06<00:08,  4.54it/s]
Loading 0:  87%|████████▋ | 253/291 [01:06<00:07,  5.08it/s]
Loading 0:  88%|████████▊ | 255/291 [01:07<00:08,  4.25it/s]
Loading 0:  88%|████████▊ | 256/291 [01:07<00:10,  3.22it/s]
Loading 0:  88%|████████▊ | 257/291 [01:08<00:13,  2.57it/s]
Loading 0:  89%|████████▉ | 260/291 [01:08<00:07,  4.35it/s]
Loading 0:  90%|████████▉ | 261/291 [01:08<00:06,  4.58it/s]
Loading 0:  90%|█████████ | 262/291 [01:08<00:05,  5.13it/s]
Loading 0:  91%|█████████ | 264/291 [01:09<00:06,  4.28it/s]
Loading 0:  91%|█████████ | 265/291 [01:09<00:08,  3.23it/s]
Loading 0:  91%|█████████▏| 266/291 [01:10<00:09,  2.55it/s]
Loading 0:  92%|█████████▏| 269/291 [01:10<00:05,  4.32it/s]
Loading 0:  93%|█████████▎| 270/291 [01:10<00:04,  4.55it/s]
Loading 0:  93%|█████████▎| 271/291 [01:11<00:03,  5.12it/s]
Loading 0:  94%|█████████▍| 273/291 [01:11<00:04,  4.27it/s]
Loading 0:  94%|█████████▍| 274/291 [01:12<00:05,  3.23it/s]
Loading 0:  95%|█████████▍| 275/291 [01:12<00:06,  2.57it/s]
Loading 0:  96%|█████████▌| 278/291 [01:13<00:02,  4.35it/s]
Loading 0:  96%|█████████▌| 279/291 [01:13<00:02,  4.57it/s]
Loading 0:  96%|█████████▌| 280/291 [01:13<00:02,  5.13it/s]
Loading 0:  97%|█████████▋| 281/291 [01:13<00:02,  3.45it/s]
Loading 0:  97%|█████████▋| 283/291 [01:14<00:01,  4.62it/s]
Loading 0:  98%|█████████▊| 284/291 [01:14<00:01,  4.84it/s]
Loading 0:  98%|█████████▊| 285/291 [01:14<00:01,  5.48it/s]
Loading 0:  98%|█████████▊| 286/291 [01:14<00:00,  5.58it/s]
Loading 0:  99%|█████████▊| 287/291 [01:15<00:01,  3.42it/s]
Loading 0:  99%|█████████▉| 288/291 [01:15<00:01,  2.52it/s]
                                                            

Job rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer completed after 166.23s with status: succeeded
Stopping job with name rirv938-llama-8b-mcl-2m-5910-v2-mkmlizer
Pipeline stage MKMLizer completed in 166.78s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service rirv938-llama-8b-mcl-2m-5910-v2
Waiting for inference service rirv938-llama-8b-mcl-2m-5910-v2 to be ready
Inference service rirv938-llama-8b-mcl-2m-5910-v2 ready after 140.66503858566284s
Pipeline stage MKMLDeployer completed in 141.53s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.4243433475494385s
Received healthy response to inference request in 2.7293455600738525s
Received healthy response to inference request in 4.593946218490601s
Received healthy response to inference request in 1.9903678894042969s
Received healthy response to inference request in 1.2899014949798584s
5 requests
0 failed requests
5th percentile: 1.3167898654937744
10th percentile: 1.3436782360076904
20th percentile: 1.3974549770355225
30th percentile: 1.5375482559204101
40th percentile: 1.7639580726623536
50th percentile: 1.9903678894042969
60th percentile: 2.2859589576721193
70th percentile: 2.5815500259399413
80th percentile: 3.1022656917572027
90th percentile: 3.8481059551239016
95th percentile: 4.22102608680725
99th percentile: 4.51936219215393
mean time: 2.4055809020996093
Pipeline stage StressChecker completed in 13.38s
Shutdown handler de-registered
rirv938-llama-8b-mcl-2m-_5910_v2 status is now deployed due to DeploymentManager action
rirv938-llama-8b-mcl-2m-_5910_v2 status is now inactive due to auto deactivation removed underperforming models
rirv938-llama-8b-mcl-2m-_5910_v2 status is now torndown due to DeploymentManager action