chaiml-llama-8b-pairwis_8189

submission_id: chaiml-llama-8b-pairwis_8189_v17
developer_uid: chai_backend_admin
best_of: 1
celo_rating: 1225.78
display_name: chaiml-llama-8b-pairwis_8189_v17
family_friendly_score: 0.0
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': True}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/llama_8b_pairwise_64m_256_tokens_step_249984
max_input_tokens: 256
max_output_tokens: 1
model_architecture: LlamaForSequenceClassification
model_group: ChaiML/llama_8b_pairwise
model_name: chaiml-llama-8b-pairwis_8189_v17
model_num_parameters: 8030261248.0
model_repo: ChaiML/llama_8b_pairwise_64m_256_tokens_step_249984
model_size: 8B
num_battles: 12203
num_wins: 6021
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-18T00:21:22+00:00
us_pacific_date: 2024-08-17
win_ratio: 0.49340326149307545
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name chaiml-llama-8b-pairwis-8189-v17-mkmlizer
Waiting for job on chaiml-llama-8b-pairwis-8189-v17-mkmlizer to finish
Stopping job with name chaiml-llama-8b-pairwis-8189-v17-mkmlizer
%s, retrying in %s seconds...
Starting job with name chaiml-llama-8b-pairwis-8189-v17-mkmlizer
Waiting for job on chaiml-llama-8b-pairwis-8189-v17-mkmlizer to finish
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║     _____            __           __                                ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║       /___/                                                         ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║                                                                     ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  Version: 0.9.11                                                    ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║                                                                     ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  belonging to:                                                      ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║                                                                     ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ║                                                                     ║
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: Downloaded to shared memory in 19.791s
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmp799_pp4f, device:0
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: quantized model in 84.302s
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: Processed model ChaiML/llama_8b_pairwise_64m_256_tokens_step_249984 in 104.093s
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: creating bucket guanaco-mkml-models
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-llama-8b-pairwis-8189-v17
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-llama-8b-pairwis-8189-v17/config.json
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-llama-8b-pairwis-8189-v17/special_tokens_map.json
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-llama-8b-pairwis-8189-v17/tokenizer_config.json
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-llama-8b-pairwis-8189-v17/tokenizer.json
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-llama-8b-pairwis-8189-v17/flywheel_model.0.safetensors
chaiml-llama-8b-pairwis-8189-v17-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/291 [00:00<00:55,  5.20it/s]
Loading 0:   1%|▏         | 4/291 [00:01<01:30,  3.17it/s]
Loading 0:   2%|▏         | 5/291 [00:01<01:58,  2.41it/s]
Loading 0:   3%|▎         | 8/291 [00:01<01:01,  4.59it/s]
Loading 0:   3%|▎         | 9/291 [00:02<01:00,  4.65it/s]
Loading 0:   3%|▎         | 10/291 [00:02<00:52,  5.31it/s]
Loading 0:   4%|▍         | 12/291 [00:02<01:04,  4.34it/s]
Loading 0:   4%|▍         | 13/291 [00:03<01:25,  3.25it/s]
Loading 0:   5%|▍         | 14/291 [00:04<01:47,  2.57it/s]
Loading 0:   6%|▌         | 17/291 [00:04<01:02,  4.42it/s]
Loading 0:   6%|▌         | 18/291 [00:04<00:58,  4.66it/s]
Loading 0:   7%|▋         | 21/291 [00:05<00:59,  4.54it/s]
Loading 0:   8%|▊         | 22/291 [00:05<01:16,  3.53it/s]
Loading 0:   8%|▊         | 23/291 [00:06<01:35,  2.82it/s]
Loading 0:   9%|▉         | 26/291 [00:06<00:58,  4.52it/s]
Loading 0:   9%|▉         | 27/291 [00:06<00:55,  4.74it/s]
Loading 0:  10%|▉         | 28/291 [00:06<00:49,  5.30it/s]
Loading 0:  10%|█         | 30/291 [00:07<00:58,  4.44it/s]
Loading 0:  11%|█         | 31/291 [00:07<01:17,  3.36it/s]
Loading 0:  11%|█         | 32/291 [00:08<01:37,  2.65it/s]
Loading 0:  12%|█▏        | 35/291 [00:08<00:57,  4.47it/s]
Loading 0:  12%|█▏        | 36/291 [00:09<00:54,  4.70it/s]
Loading 0:  13%|█▎        | 37/291 [00:09<00:48,  5.28it/s]
Loading 0:  13%|█▎        | 39/291 [00:09<00:56,  4.43it/s]
Loading 0:  14%|█▎        | 40/291 [00:10<01:15,  3.33it/s]
Loading 0:  14%|█▍        | 41/291 [00:10<01:34,  2.64it/s]
Loading 0:  15%|█▌        | 44/291 [00:11<00:54,  4.50it/s]
Loading 0:  15%|█▌        | 45/291 [00:11<00:51,  4.73it/s]
Loading 0:  16%|█▋        | 48/291 [00:11<00:52,  4.62it/s]
Loading 0:  17%|█▋        | 49/291 [00:12<01:07,  3.58it/s]
Loading 0:  17%|█▋        | 50/291 [00:13<01:24,  2.84it/s]
Loading 0:  18%|█▊        | 53/291 [00:13<00:52,  4.55it/s]
Loading 0:  19%|█▊        | 54/291 [00:13<00:49,  4.77it/s]
Loading 0:  20%|█▉        | 57/291 [00:14<00:50,  4.63it/s]
Loading 0:  20%|█▉        | 58/291 [00:14<01:04,  3.61it/s]
Loading 0:  20%|██        | 59/291 [00:15<01:22,  2.83it/s]
Loading 0:  21%|██▏       | 62/291 [00:15<00:50,  4.54it/s]
Loading 0:  22%|██▏       | 63/291 [00:15<00:47,  4.83it/s]
Loading 0:  23%|██▎       | 66/291 [00:16<00:47,  4.70it/s]
Loading 0:  23%|██▎       | 67/291 [00:16<01:01,  3.65it/s]
Loading 0:  23%|██▎       | 68/291 [00:17<01:16,  2.91it/s]
Loading 0:  24%|██▍       | 71/291 [00:17<00:47,  4.60it/s]
Loading 0:  25%|██▍       | 72/291 [00:17<00:45,  4.80it/s]
Loading 0:  25%|██▌       | 73/291 [00:18<00:40,  5.36it/s]
Loading 0:  26%|██▌       | 75/291 [00:18<00:48,  4.49it/s]
Loading 0:  26%|██▌       | 76/291 [00:19<01:03,  3.40it/s]
Loading 0:  26%|██▋       | 77/291 [00:19<01:19,  2.69it/s]
Loading 0:  27%|██▋       | 80/291 [00:20<00:46,  4.53it/s]
Loading 0:  28%|██▊       | 81/291 [00:20<00:44,  4.76it/s]
Loading 0:  29%|██▊       | 83/291 [00:20<00:38,  5.35it/s]
Loading 0:  29%|██▉       | 84/291 [00:21<00:54,  3.79it/s]
Loading 0:  29%|██▉       | 85/291 [00:21<01:08,  3.01it/s]
Loading 0:  30%|██▉       | 86/291 [00:22<01:23,  2.45it/s]
Loading 0:  31%|███       | 89/291 [00:22<00:47,  4.27it/s]
Loading 0:  31%|███       | 90/291 [00:22<00:44,  4.53it/s]
Loading 0:  32%|███▏      | 93/291 [00:23<00:43,  4.51it/s]
Loading 0:  32%|███▏      | 94/291 [00:23<00:55,  3.53it/s]
Loading 0:  33%|███▎      | 95/291 [00:24<01:09,  2.83it/s]
Loading 0:  34%|███▎      | 98/291 [00:24<00:42,  4.57it/s]
Loading 0:  34%|███▍      | 99/291 [00:24<00:40,  4.79it/s]
Loading 0:  34%|███▍      | 100/291 [00:24<00:35,  5.35it/s]
Loading 0:  35%|███▌      | 102/291 [00:25<00:42,  4.48it/s]
Loading 0:  35%|███▌      | 103/291 [00:26<00:55,  3.39it/s]
Loading 0:  36%|███▌      | 104/291 [00:26<01:09,  2.70it/s]
Loading 0:  37%|███▋      | 107/291 [00:26<00:40,  4.52it/s]
Loading 0:  37%|███▋      | 108/291 [00:27<00:38,  4.76it/s]
Loading 0:  38%|███▊      | 111/291 [00:27<00:38,  4.64it/s]
Loading 0:  38%|███▊      | 112/291 [00:28<00:49,  3.60it/s]
Loading 0:  39%|███▉      | 113/291 [00:28<01:02,  2.85it/s]
Loading 0:  40%|███▉      | 116/291 [00:29<00:38,  4.55it/s]
Loading 0:  40%|████      | 117/291 [00:29<00:36,  4.77it/s]
Loading 0:  41%|████      | 120/291 [00:29<00:36,  4.68it/s]
Loading 0:  42%|████▏     | 121/291 [00:30<00:46,  3.65it/s]
Loading 0:  42%|████▏     | 122/291 [00:31<00:58,  2.90it/s]
Loading 0:  43%|████▎     | 125/291 [00:31<00:36,  4.59it/s]
Loading 0:  43%|████▎     | 126/291 [00:31<00:34,  4.80it/s]
Loading 0:  44%|████▍     | 129/291 [00:32<00:34,  4.70it/s]
Loading 0:  45%|████▍     | 130/291 [00:32<00:44,  3.66it/s]
Loading 0:  45%|████▌     | 131/291 [00:33<00:55,  2.90it/s]
Loading 0:  46%|████▌     | 134/291 [00:33<00:35,  4.38it/s]
Loading 0:  46%|████▋     | 135/291 [00:33<00:33,  4.62it/s]
Loading 0:  47%|████▋     | 138/291 [00:34<00:33,  4.59it/s]
Loading 0:  48%|████▊     | 139/291 [00:35<00:42,  3.60it/s]
Loading 0:  48%|████▊     | 140/291 [00:35<00:52,  2.89it/s]
Loading 0:  49%|████▉     | 143/291 [00:35<00:31,  4.63it/s]
Loading 0:  49%|████▉     | 144/291 [00:36<00:30,  4.84it/s]
Loading 0:  51%|█████     | 147/291 [00:36<00:30,  4.71it/s]
Loading 0:  51%|█████     | 148/291 [00:37<00:39,  3.66it/s]
Loading 0:  51%|█████     | 149/291 [00:37<00:48,  2.91it/s]
Loading 0:  52%|█████▏    | 152/291 [00:38<00:30,  4.61it/s]
Loading 0:  53%|█████▎    | 153/291 [00:38<00:28,  4.82it/s]
Loading 0:  54%|█████▎    | 156/291 [00:38<00:28,  4.67it/s]
Loading 0:  54%|█████▍    | 157/291 [00:39<00:36,  3.64it/s]
Loading 0:  54%|█████▍    | 158/291 [00:40<00:46,  2.89it/s]
Loading 0:  55%|█████▌    | 161/291 [00:40<00:28,  4.56it/s]
Loading 0:  56%|█████▌    | 162/291 [00:40<00:27,  4.77it/s]
Loading 0:  57%|█████▋    | 165/291 [00:41<00:26,  4.67it/s]
Loading 0:  57%|█████▋    | 166/291 [00:41<00:34,  3.64it/s]
Loading 0:  57%|█████▋    | 167/291 [00:42<00:42,  2.90it/s]
Loading 0:  58%|█████▊    | 170/291 [00:42<00:26,  4.58it/s]
Loading 0:  59%|█████▉    | 171/291 [00:42<00:25,  4.79it/s]
Loading 0:  59%|█████▉    | 173/291 [00:43<00:29,  3.99it/s]
Loading 0:  60%|██████    | 175/291 [00:43<00:23,  5.02it/s]
Loading 0:  60%|██████    | 176/291 [00:43<00:22,  5.19it/s]
Loading 0:  62%|██████▏   | 179/291 [00:44<00:23,  4.86it/s]
Loading 0:  62%|██████▏   | 180/291 [00:45<00:29,  3.71it/s]
Loading 0:  62%|██████▏   | 181/291 [00:45<00:37,  2.94it/s]
Loading 0:  63%|██████▎   | 184/291 [00:45<00:22,  4.74it/s]
Loading 0:  64%|██████▎   | 185/291 [00:45<00:21,  4.94it/s]
Loading 0:  64%|██████▍   | 186/291 [00:46<00:19,  5.42it/s]
Loading 0:  64%|██████▍   | 187/291 [00:46<00:19,  5.34it/s]
Loading 0:  65%|██████▍   | 188/291 [00:46<00:28,  3.57it/s]
Loading 0:  65%|██████▍   | 189/291 [00:47<00:37,  2.70it/s]
Loading 0:  66%|██████▌   | 192/291 [00:48<00:27,  3.64it/s]
Loading 0:  66%|██████▋   | 193/291 [00:48<00:32,  3.00it/s]
Loading 0:  67%|██████▋   | 194/291 [00:49<00:38,  2.51it/s]
Loading 0:  68%|██████▊   | 197/291 [00:49<00:22,  4.24it/s]
Loading 0:  68%|██████▊   | 198/291 [00:49<00:20,  4.50it/s]
Loading 0:  69%|██████▉   | 201/291 [00:50<00:19,  4.52it/s]
Loading 0:  69%|██████▉   | 202/291 [00:50<00:25,  3.55it/s]
Loading 0:  70%|██████▉   | 203/291 [00:51<00:30,  2.84it/s]
Loading 0:  71%|███████   | 206/291 [00:51<00:18,  4.53it/s]
Loading 0:  71%|███████   | 207/291 [00:51<00:17,  4.75it/s]
Loading 0:  71%|███████▏  | 208/291 [00:51<00:15,  5.29it/s]
Loading 0:  72%|███████▏  | 210/291 [00:52<00:18,  4.45it/s]
Loading 0:  73%|███████▎  | 211/291 [00:53<00:23,  3.37it/s]
Loading 0:  73%|███████▎  | 212/291 [00:53<00:29,  2.69it/s]
Loading 0:  74%|███████▍  | 215/291 [00:53<00:16,  4.57it/s]
Loading 0:  74%|███████▍  | 216/291 [00:54<00:15,  4.80it/s]
Loading 0:  75%|███████▍  | 217/291 [00:54<00:13,  5.33it/s]
Loading 0:  75%|███████▌  | 219/291 [00:54<00:16,  4.45it/s]
Loading 0:  76%|███████▌  | 220/291 [00:55<00:21,  3.36it/s]
Loading 0:  76%|███████▌  | 221/291 [00:55<00:26,  2.68it/s]
Loading 0:  77%|███████▋  | 224/291 [00:56<00:14,  4.55it/s]
Loading 0:  77%|███████▋  | 225/291 [00:56<00:13,  4.79it/s]
Loading 0:  78%|███████▊  | 226/291 [00:56<00:12,  5.38it/s]
Loading 0:  78%|███████▊  | 228/291 [00:56<00:14,  4.47it/s]
Loading 0:  79%|███████▊  | 229/291 [00:57<00:18,  3.37it/s]
Loading 0:  79%|███████▉  | 230/291 [00:58<00:22,  2.68it/s]
Loading 0:  80%|████████  | 233/291 [00:58<00:12,  4.56it/s]
Loading 0:  80%|████████  | 234/291 [00:58<00:11,  4.77it/s]
Loading 0:  81%|████████  | 235/291 [00:58<00:10,  5.36it/s]
Loading 0:  81%|████████▏ | 237/291 [00:59<00:12,  4.42it/s]
Loading 0:  82%|████████▏ | 238/291 [00:59<00:15,  3.34it/s]
Loading 0:  82%|████████▏ | 239/291 [01:00<00:19,  2.66it/s]
Loading 0:  83%|████████▎ | 242/291 [01:00<00:10,  4.56it/s]
Loading 0:  84%|████████▎ | 243/291 [01:00<00:10,  4.80it/s]
Loading 0:  85%|████████▍ | 246/291 [01:01<00:09,  4.64it/s]
Loading 0:  85%|████████▍ | 247/291 [01:01<00:12,  3.61it/s]
Loading 0:  85%|████████▌ | 248/291 [01:02<00:14,  2.87it/s]
Loading 0:  86%|████████▋ | 251/291 [01:02<00:08,  4.63it/s]
Loading 0:  87%|████████▋ | 252/291 [01:02<00:08,  4.84it/s]
Loading 0:  88%|████████▊ | 255/291 [01:03<00:07,  4.67it/s]
Loading 0:  88%|████████▊ | 256/291 [01:04<00:09,  3.64it/s]
Loading 0:  88%|████████▊ | 257/291 [01:04<00:11,  2.90it/s]
Loading 0:  89%|████████▉ | 260/291 [01:05<00:06,  4.64it/s]
Loading 0:  90%|████████▉ | 261/291 [01:05<00:06,  4.85it/s]
Loading 0:  91%|█████████ | 264/291 [01:05<00:05,  4.70it/s]
Loading 0:  91%|█████████ | 265/291 [01:06<00:07,  3.66it/s]
Loading 0:  91%|█████████▏| 266/291 [01:07<00:08,  2.91it/s]
Loading 0:  92%|█████████▏| 269/291 [01:07<00:04,  4.67it/s]
Loading 0:  93%|█████████▎| 270/291 [01:07<00:04,  4.88it/s]
Loading 0:  94%|█████████▍| 273/291 [01:08<00:03,  4.73it/s]
Loading 0:  94%|█████████▍| 274/291 [01:08<00:04,  3.68it/s]
Loading 0:  95%|█████████▍| 275/291 [01:09<00:05,  2.93it/s]
Loading 0:  96%|█████████▌| 278/291 [01:09<00:02,  4.69it/s]
Loading 0:  96%|█████████▌| 279/291 [01:09<00:02,  4.90it/s]
Loading 0:  97%|█████████▋| 281/291 [01:10<00:02,  4.04it/s]
Loading 0:  97%|█████████▋| 282/291 [01:10<00:02,  3.12it/s]
Loading 0:  98%|█████████▊| 284/291 [01:11<00:01,  4.12it/s]
Loading 0:  98%|█████████▊| 285/291 [01:11<00:01,  4.42it/s]
Loading 0:  99%|█████████▊| 287/291 [01:11<00:00,  5.16it/s]
Loading 0:  99%|█████████▉| 288/291 [01:12<00:00,  3.68it/s]
                                                            
Job chaiml-llama-8b-pairwis-8189-v17-mkmlizer completed after 136.66s with status: succeeded
Stopping job with name chaiml-llama-8b-pairwis-8189-v17-mkmlizer
Pipeline stage MKMLizer completed in 138.28s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service chaiml-llama-8b-pairwis-8189-v17
Waiting for inference service chaiml-llama-8b-pairwis-8189-v17 to be ready
Inference service chaiml-llama-8b-pairwis-8189-v17 ready after 231.49033284187317s
Pipeline stage ISVCDeployer completed in 232.54s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.6930251121521s
Received healthy response to inference request in 19.38709330558777s
Received healthy response to inference request in 2.84384822845459s
Received healthy response to inference request in 3.3988962173461914s
Received healthy response to inference request in 3.075798749923706s
5 requests
0 failed requests
5th percentile: 2.890238332748413
10th percentile: 2.9366284370422364
20th percentile: 3.029408645629883
30th percentile: 3.1404182434082033
40th percentile: 3.2696572303771974
50th percentile: 3.3988962173461914
60th percentile: 4.316547775268554
70th percentile: 5.234199333190918
80th percentile: 8.431838750839235
90th percentile: 13.909466028213501
95th percentile: 16.64827966690063
99th percentile: 18.83933057785034
mean time: 6.879732322692871
%s, retrying in %s seconds...
Received healthy response to inference request in 4.006951570510864s
Received healthy response to inference request in 4.707237720489502s
Received healthy response to inference request in 4.177319765090942s
Received healthy response to inference request in 4.178955078125s
Received healthy response to inference request in 4.2472429275512695s
5 requests
0 failed requests
5th percentile: 4.04102520942688
10th percentile: 4.075098848342895
20th percentile: 4.143246126174927
30th percentile: 4.177646827697754
40th percentile: 4.178300952911377
50th percentile: 4.178955078125
60th percentile: 4.206270217895508
70th percentile: 4.233585357666016
80th percentile: 4.339241886138916
90th percentile: 4.523239803314209
95th percentile: 4.615238761901855
99th percentile: 4.688837928771973
mean time: 4.263541412353516
Pipeline stage StressChecker completed in 57.18s
chaiml-llama-8b-pairwis_8189_v17 status is now deployed due to DeploymentManager action
chaiml-llama-8b-pairwis_8189_v17 status is now inactive due to auto deactivation removed underperforming models
chaiml-llama-8b-pairwis_8189_v17 status is now torndown due to DeploymentManager action