chaiml-llama-8b-multihe_54063

developer_uid: chai_backend_admin
submission_id: chaiml-llama-8b-multihe_54063_v7
model_name: chaiml-llama-8b-multihe_54063_v7
model_group: ChaiML/llama_8b_multihea
status: torndown
timestamp: 2025-03-06T13:22:24+00:00
num_battles: 16320
num_wins: 8588
celo_rating: 1297.36
family_friendly_score: 0.5258
family_friendly_standard_error: 0.007061647966303617
submission_type: basic
model_repo: ChaiML/llama_8b_multihead_204m_preference
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 256
max_output_tokens: 1
reward_model: default
display_name: chaiml-llama-8b-multihe_54063_v7
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/llama_8b_multihead_204m_preference
model_size: 8B
ranking_group: single
us_pacific_date: 2025-03-06
win_ratio: 0.5262254901960784
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': True}
weights: {'nsfw': 2.0, 'preference': 8.0}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-llama-8b-multihe-54063-v7-mkmlizer
Waiting for job on chaiml-llama-8b-multihe-54063-v7-mkmlizer to finish
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║     _____            __           __                                ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║       /___/                                                         ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║                                                                     ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  Version: 0.11.37                                                   ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║                                                                     ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  belonging to:                                                      ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║                                                                     ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ║                                                                     ║
chaiml-llama-8b-multihe-54063-v7-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-llama-8b-multihe-54063-v7-mkmlizer: Downloaded to shared memory in 39.496s
chaiml-llama-8b-multihe-54063-v7-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmpuuvoa8ab, device:0
chaiml-llama-8b-multihe-54063-v7-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-llama-8b-multihe-54063-v7-mkmlizer: quantized model in 87.180s
chaiml-llama-8b-multihe-54063-v7-mkmlizer: Processed model ChaiML/llama_8b_multihead_204m_preference in 126.676s
chaiml-llama-8b-multihe-54063-v7-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-llama-8b-multihe-54063-v7-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-llama-8b-multihe-54063-v7
chaiml-llama-8b-multihe-54063-v7-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-llama-8b-multihe-54063-v7/config.json
chaiml-llama-8b-multihe-54063-v7-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-llama-8b-multihe-54063-v7/special_tokens_map.json
chaiml-llama-8b-multihe-54063-v7-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-llama-8b-multihe-54063-v7/tokenizer_config.json
chaiml-llama-8b-multihe-54063-v7-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-llama-8b-multihe-54063-v7/tokenizer.json
chaiml-llama-8b-multihe-54063-v7-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-llama-8b-multihe-54063-v7/flywheel_model.0.safetensors
chaiml-llama-8b-multihe-54063-v7-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/291 [00:00<00:57,  5.00it/s]
Loading 0:   1%|▏         | 4/291 [00:01<01:33,  3.07it/s]
Loading 0:   2%|▏         | 5/291 [00:01<02:03,  2.31it/s]
Loading 0:   3%|▎         | 8/291 [00:02<01:05,  4.34it/s]
Loading 0:   3%|▎         | 9/291 [00:02<01:03,  4.41it/s]
Loading 0:   3%|▎         | 10/291 [00:02<00:55,  5.04it/s]
Loading 0:   4%|▍         | 12/291 [00:03<01:06,  4.21it/s]
Loading 0:   4%|▍         | 13/291 [00:03<01:28,  3.15it/s]
Loading 0:   5%|▍         | 14/291 [00:04<01:51,  2.49it/s]
Loading 0:   6%|▌         | 17/291 [00:04<01:04,  4.28it/s]
Loading 0:   6%|▌         | 18/291 [00:04<01:00,  4.50it/s]
Loading 0:   7%|▋         | 19/291 [00:04<00:53,  5.10it/s]
Loading 0:   7%|▋         | 21/291 [00:05<01:03,  4.26it/s]
Loading 0:   8%|▊         | 22/291 [00:05<01:23,  3.22it/s]
Loading 0:   8%|▊         | 23/291 [00:06<01:45,  2.54it/s]
Loading 0:   9%|▉         | 26/291 [00:06<01:01,  4.32it/s]
Loading 0:   9%|▉         | 27/291 [00:06<00:58,  4.53it/s]
Loading 0:  10%|▉         | 28/291 [00:07<00:51,  5.06it/s]
Loading 0:  10%|█         | 30/291 [00:07<00:42,  6.17it/s]
Loading 0:  11%|█         | 31/291 [00:07<00:42,  6.11it/s]
Loading 0:  11%|█         | 32/291 [00:07<00:38,  6.70it/s]
Loading 0:  11%|█▏        | 33/291 [00:07<00:41,  6.28it/s]
Loading 0:  12%|█▏        | 34/291 [00:08<01:10,  3.67it/s]
Loading 0:  12%|█▏        | 35/291 [00:08<01:31,  2.79it/s]
Loading 0:  12%|█▏        | 36/291 [00:09<01:52,  2.26it/s]
Loading 0:  13%|█▎        | 39/291 [00:10<01:17,  3.24it/s]
Loading 0:  14%|█▎        | 40/291 [00:10<01:31,  2.74it/s]
Loading 0:  14%|█▍        | 41/291 [00:11<01:48,  2.31it/s]
Loading 0:  15%|█▌        | 44/291 [00:11<01:02,  3.98it/s]
Loading 0:  15%|█▌        | 45/291 [00:11<00:57,  4.25it/s]
Loading 0:  16%|█▌        | 46/291 [00:11<00:50,  4.83it/s]
Loading 0:  16%|█▋        | 48/291 [00:12<00:58,  4.18it/s]
Loading 0:  17%|█▋        | 49/291 [00:13<01:15,  3.19it/s]
Loading 0:  17%|█▋        | 50/291 [00:13<01:35,  2.53it/s]
Loading 0:  18%|█▊        | 53/291 [00:13<00:55,  4.30it/s]
Loading 0:  19%|█▊        | 54/291 [00:14<00:51,  4.61it/s]
Loading 0:  19%|█▉        | 55/291 [00:14<00:46,  5.11it/s]
Loading 0:  20%|█▉        | 57/291 [00:14<00:54,  4.30it/s]
Loading 0:  20%|█▉        | 58/291 [00:15<01:11,  3.26it/s]
Loading 0:  20%|██        | 59/291 [00:16<01:30,  2.58it/s]
Loading 0:  21%|██▏       | 62/291 [00:16<00:51,  4.42it/s]
Loading 0:  22%|██▏       | 63/291 [00:16<00:49,  4.65it/s]
Loading 0:  22%|██▏       | 64/291 [00:16<00:43,  5.25it/s]
Loading 0:  23%|██▎       | 66/291 [00:17<00:51,  4.35it/s]
Loading 0:  23%|██▎       | 67/291 [00:17<01:08,  3.27it/s]
Loading 0:  23%|██▎       | 68/291 [00:18<01:26,  2.58it/s]
Loading 0:  24%|██▍       | 71/291 [00:18<00:49,  4.43it/s]
Loading 0:  25%|██▍       | 72/291 [00:18<00:47,  4.64it/s]
Loading 0:  25%|██▌       | 73/291 [00:18<00:41,  5.23it/s]
Loading 0:  25%|██▌       | 74/291 [00:19<01:01,  3.52it/s]
Loading 0:  26%|██▌       | 75/291 [00:20<01:21,  2.65it/s]
Loading 0:  26%|██▋       | 77/291 [00:20<00:56,  3.79it/s]
Loading 0:  27%|██▋       | 78/291 [00:20<00:51,  4.14it/s]
Loading 0:  27%|██▋       | 79/291 [00:20<00:43,  4.83it/s]
Loading 0:  27%|██▋       | 80/291 [00:20<00:41,  5.12it/s]
Loading 0:  28%|██▊       | 81/291 [00:21<01:03,  3.32it/s]
Loading 0:  28%|██▊       | 82/291 [00:21<01:19,  2.63it/s]
Loading 0:  29%|██▊       | 83/291 [00:22<01:35,  2.19it/s]
Loading 0:  30%|██▉       | 86/291 [00:22<00:50,  4.10it/s]
Loading 0:  30%|██▉       | 87/291 [00:22<00:46,  4.38it/s]
Loading 0:  30%|███       | 88/291 [00:22<00:40,  5.00it/s]
Loading 0:  31%|███       | 90/291 [00:23<00:47,  4.19it/s]
Loading 0:  31%|███▏      | 91/291 [00:24<01:03,  3.14it/s]
Loading 0:  32%|███▏      | 92/291 [00:24<01:19,  2.50it/s]
Loading 0:  33%|███▎      | 95/291 [00:25<00:44,  4.36it/s]
Loading 0:  33%|███▎      | 96/291 [00:25<00:41,  4.67it/s]
Loading 0:  33%|███▎      | 97/291 [00:25<00:36,  5.26it/s]
Loading 0:  34%|███▍      | 99/291 [00:25<00:44,  4.36it/s]
Loading 0:  34%|███▍      | 100/291 [00:26<00:58,  3.27it/s]
Loading 0:  35%|███▍      | 101/291 [00:27<01:13,  2.59it/s]
Loading 0:  36%|███▌      | 104/291 [00:27<00:42,  4.41it/s]
Loading 0:  36%|███▌      | 105/291 [00:27<00:40,  4.65it/s]
Loading 0:  36%|███▋      | 106/291 [00:27<00:35,  5.20it/s]
Loading 0:  37%|███▋      | 108/291 [00:28<00:42,  4.32it/s]
Loading 0:  37%|███▋      | 109/291 [00:28<00:55,  3.26it/s]
Loading 0:  38%|███▊      | 110/291 [00:29<01:10,  2.57it/s]
Loading 0:  39%|███▉      | 113/291 [00:29<00:40,  4.36it/s]
Loading 0:  39%|███▉      | 114/291 [00:29<00:38,  4.60it/s]
Loading 0:  40%|███▉      | 115/291 [00:29<00:34,  5.18it/s]
Loading 0:  40%|███▉      | 116/291 [00:30<00:50,  3.49it/s]
Loading 0:  41%|████      | 118/291 [00:30<00:36,  4.70it/s]
Loading 0:  41%|████      | 119/291 [00:30<00:34,  4.93it/s]
Loading 0:  41%|████      | 120/291 [00:30<00:30,  5.59it/s]
Loading 0:  42%|████▏     | 122/291 [00:31<00:38,  4.44it/s]
Loading 0:  43%|████▎     | 125/291 [00:32<00:35,  4.74it/s]
Loading 0:  43%|████▎     | 126/291 [00:32<00:45,  3.61it/s]
Loading 0:  44%|████▎     | 127/291 [00:33<00:58,  2.82it/s]
Loading 0:  45%|████▍     | 130/291 [00:33<00:35,  4.59it/s]
Loading 0:  45%|████▌     | 131/291 [00:33<00:33,  4.80it/s]
Loading 0:  45%|████▌     | 132/291 [00:33<00:29,  5.33it/s]
Loading 0:  46%|████▌     | 133/291 [00:34<00:29,  5.42it/s]
Loading 0:  46%|████▌     | 134/291 [00:34<00:44,  3.53it/s]
Loading 0:  46%|████▋     | 135/291 [00:35<00:59,  2.62it/s]
Loading 0:  47%|████▋     | 138/291 [00:35<00:43,  3.53it/s]
Loading 0:  48%|████▊     | 139/291 [00:36<00:52,  2.91it/s]
Loading 0:  48%|████▊     | 140/291 [00:37<01:01,  2.44it/s]
Loading 0:  49%|████▉     | 143/291 [00:37<00:36,  4.10it/s]
Loading 0:  49%|████▉     | 144/291 [00:37<00:33,  4.36it/s]
Loading 0:  50%|████▉     | 145/291 [00:37<00:29,  4.94it/s]
Loading 0:  51%|█████     | 147/291 [00:38<00:34,  4.22it/s]
Loading 0:  51%|█████     | 148/291 [00:38<00:44,  3.23it/s]
Loading 0:  51%|█████     | 149/291 [00:39<00:55,  2.56it/s]
Loading 0:  52%|█████▏    | 152/291 [00:39<00:31,  4.35it/s]
Loading 0:  53%|█████▎    | 153/291 [00:39<00:30,  4.59it/s]
Loading 0:  53%|█████▎    | 154/291 [00:39<00:26,  5.18it/s]
Loading 0:  54%|█████▎    | 156/291 [00:40<00:31,  4.32it/s]
Loading 0:  54%|█████▍    | 157/291 [00:41<00:40,  3.27it/s]
Loading 0:  54%|█████▍    | 158/291 [00:41<00:51,  2.60it/s]
Loading 0:  55%|█████▌    | 161/291 [00:41<00:29,  4.41it/s]
Loading 0:  56%|█████▌    | 162/291 [00:42<00:27,  4.65it/s]
Loading 0:  56%|█████▌    | 163/291 [00:42<00:24,  5.25it/s]
Loading 0:  57%|█████▋    | 165/291 [00:42<00:29,  4.34it/s]
Loading 0:  57%|█████▋    | 166/291 [00:43<00:38,  3.28it/s]
Loading 0:  57%|█████▋    | 167/291 [00:43<00:47,  2.59it/s]
Loading 0:  58%|█████▊    | 170/291 [00:44<00:27,  4.39it/s]
Loading 0:  59%|█████▉    | 171/291 [00:44<00:25,  4.62it/s]
Loading 0:  59%|█████▉    | 172/291 [00:44<00:23,  5.13it/s]
Loading 0:  60%|█████▉    | 174/291 [00:45<00:27,  4.25it/s]
Loading 0:  60%|██████    | 175/291 [00:45<00:36,  3.22it/s]
Loading 0:  60%|██████    | 176/291 [00:46<00:44,  2.57it/s]
Loading 0:  62%|██████▏   | 179/291 [00:46<00:25,  4.36it/s]
Loading 0:  62%|██████▏   | 180/291 [00:46<00:24,  4.60it/s]
Loading 0:  62%|██████▏   | 181/291 [00:46<00:21,  5.13it/s]
Loading 0:  63%|██████▎   | 183/291 [00:46<00:17,  6.21it/s]
Loading 0:  63%|██████▎   | 184/291 [00:47<00:17,  6.13it/s]
Loading 0:  64%|██████▎   | 185/291 [00:47<00:15,  6.67it/s]
Loading 0:  64%|██████▍   | 186/291 [00:47<00:16,  6.44it/s]
Loading 0:  64%|██████▍   | 187/291 [00:48<00:27,  3.72it/s]
Loading 0:  65%|██████▍   | 188/291 [00:48<00:36,  2.82it/s]
Loading 0:  65%|██████▍   | 189/291 [00:49<00:44,  2.27it/s]
Loading 0:  66%|██████▌   | 192/291 [00:49<00:30,  3.26it/s]
Loading 0:  66%|██████▋   | 193/291 [00:50<00:35,  2.75it/s]
Loading 0:  67%|██████▋   | 194/291 [00:51<00:41,  2.32it/s]
Loading 0:  68%|██████▊   | 197/291 [00:51<00:23,  3.94it/s]
Loading 0:  68%|██████▊   | 198/291 [00:51<00:22,  4.21it/s]
Loading 0:  68%|██████▊   | 199/291 [00:51<00:19,  4.76it/s]
Loading 0:  69%|██████▉   | 201/291 [00:52<00:21,  4.12it/s]
Loading 0:  69%|██████▉   | 202/291 [00:52<00:28,  3.17it/s]
Loading 0:  70%|██████▉   | 203/291 [00:53<00:34,  2.55it/s]
Loading 0:  71%|███████   | 206/291 [00:53<00:19,  4.32it/s]
Loading 0:  71%|███████   | 207/291 [00:53<00:18,  4.56it/s]
Loading 0:  71%|███████▏  | 208/291 [00:53<00:16,  5.13it/s]
Loading 0:  72%|███████▏  | 210/291 [00:54<00:18,  4.29it/s]
Loading 0:  73%|███████▎  | 211/291 [00:55<00:24,  3.24it/s]
Loading 0:  73%|███████▎  | 212/291 [00:55<00:30,  2.56it/s]
Loading 0:  74%|███████▍  | 215/291 [00:55<00:17,  4.33it/s]
Loading 0:  74%|███████▍  | 216/291 [00:56<00:16,  4.56it/s]
Loading 0:  75%|███████▍  | 217/291 [00:56<00:14,  5.09it/s]
Loading 0:  75%|███████▌  | 219/291 [00:56<00:16,  4.27it/s]
Loading 0:  76%|███████▌  | 220/291 [00:57<00:21,  3.24it/s]
Loading 0:  76%|███████▌  | 221/291 [00:58<00:27,  2.57it/s]
Loading 0:  77%|███████▋  | 224/291 [00:58<00:15,  4.37it/s]
Loading 0:  77%|███████▋  | 225/291 [00:58<00:14,  4.60it/s]
Loading 0:  78%|███████▊  | 226/291 [00:58<00:12,  5.15it/s]
Loading 0:  78%|███████▊  | 227/291 [00:59<00:18,  3.47it/s]
Loading 0:  78%|███████▊  | 228/291 [00:59<00:23,  2.63it/s]
Loading 0:  79%|███████▉  | 230/291 [01:00<00:16,  3.77it/s]
Loading 0:  79%|███████▉  | 231/291 [01:00<00:14,  4.17it/s]
Loading 0:  80%|███████▉  | 232/291 [01:00<00:12,  4.84it/s]
Loading 0:  80%|████████  | 233/291 [01:00<00:11,  5.09it/s]
Loading 0:  80%|████████  | 234/291 [01:01<00:17,  3.30it/s]
Loading 0:  81%|████████▏ | 237/291 [01:01<00:13,  4.08it/s]
Loading 0:  82%|████████▏ | 238/291 [01:02<00:16,  3.18it/s]
Loading 0:  82%|████████▏ | 239/291 [01:02<00:20,  2.57it/s]
Loading 0:  83%|████████▎ | 242/291 [01:03<00:11,  4.30it/s]
Loading 0:  84%|████████▎ | 243/291 [01:03<00:10,  4.53it/s]
Loading 0:  84%|████████▍ | 244/291 [01:03<00:09,  5.09it/s]
Loading 0:  85%|████████▍ | 246/291 [01:03<00:10,  4.26it/s]
Loading 0:  85%|████████▍ | 247/291 [01:04<00:13,  3.24it/s]
Loading 0:  85%|████████▌ | 248/291 [01:05<00:16,  2.57it/s]
Loading 0:  86%|████████▋ | 251/291 [01:05<00:09,  4.33it/s]
Loading 0:  87%|████████▋ | 252/291 [01:05<00:08,  4.55it/s]
Loading 0:  87%|████████▋ | 253/291 [01:05<00:07,  5.10it/s]
Loading 0:  88%|████████▊ | 255/291 [01:06<00:08,  4.26it/s]
Loading 0:  88%|████████▊ | 256/291 [01:06<00:10,  3.23it/s]
Loading 0:  88%|████████▊ | 257/291 [01:07<00:13,  2.55it/s]
Loading 0:  89%|████████▉ | 260/291 [01:07<00:07,  4.32it/s]
Loading 0:  90%|████████▉ | 261/291 [01:07<00:06,  4.54it/s]
Loading 0:  90%|█████████ | 262/291 [01:07<00:05,  5.09it/s]
Loading 0:  91%|█████████ | 264/291 [01:08<00:06,  4.26it/s]
Loading 0:  91%|█████████ | 265/291 [01:09<00:08,  3.23it/s]
Loading 0:  91%|█████████▏| 266/291 [01:09<00:09,  2.55it/s]
Loading 0:  92%|█████████▏| 269/291 [01:10<00:05,  4.33it/s]
Loading 0:  93%|█████████▎| 270/291 [01:10<00:04,  4.56it/s]
Loading 0:  93%|█████████▎| 271/291 [01:10<00:03,  5.11it/s]
Loading 0:  94%|█████████▍| 273/291 [01:10<00:04,  4.28it/s]
Loading 0:  94%|█████████▍| 274/291 [01:11<00:05,  3.24it/s]
Loading 0:  95%|█████████▍| 275/291 [01:12<00:06,  2.56it/s]
Loading 0:  96%|█████████▌| 278/291 [01:12<00:02,  4.35it/s]
Loading 0:  96%|█████████▌| 279/291 [01:12<00:02,  4.58it/s]
Loading 0:  96%|█████████▌| 280/291 [01:12<00:02,  5.14it/s]
Loading 0:  97%|█████████▋| 281/291 [01:13<00:02,  3.47it/s]
Loading 0:  97%|█████████▋| 283/291 [01:13<00:01,  4.67it/s]
Loading 0:  98%|█████████▊| 284/291 [01:13<00:01,  4.89it/s]
Loading 0:  98%|█████████▊| 285/291 [01:13<00:01,  5.51it/s]
Loading 0:  98%|█████████▊| 286/291 [01:13<00:00,  5.64it/s]
Loading 0:  99%|█████████▊| 287/291 [01:14<00:01,  3.47it/s]
Loading 0:  99%|█████████▉| 288/291 [01:15<00:01,  2.57it/s]
                                                            
Job chaiml-llama-8b-multihe-54063-v7-mkmlizer completed after 154.76s with status: succeeded
Stopping job with name chaiml-llama-8b-multihe-54063-v7-mkmlizer
Pipeline stage MKMLizer completed in 155.28s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.18s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-llama-8b-multihe-54063-v7
Waiting for inference service chaiml-llama-8b-multihe-54063-v7 to be ready
Inference service chaiml-llama-8b-multihe-54063-v7 ready after 100.37337374687195s
Pipeline stage MKMLDeployer completed in 100.95s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.088683366775513s
Received healthy response to inference request in 6.222318172454834s
Received healthy response to inference request in 4.059891223907471s
Received healthy response to inference request in 3.245537042617798s
Received healthy response to inference request in 1.649989366531372s
5 requests
0 failed requests
5th percentile: 1.9690989017486573
10th percentile: 2.2882084369659426
20th percentile: 2.9264275074005126
30th percentile: 3.4084078788757326
40th percentile: 3.7341495513916017
50th percentile: 4.059891223907471
60th percentile: 4.471408081054688
70th percentile: 4.882924938201904
80th percentile: 5.315410327911377
90th percentile: 5.768864250183105
95th percentile: 5.9955912113189695
99th percentile: 6.176972780227661
mean time: 4.053283834457398
%s, retrying in %s seconds...
Received healthy response to inference request in 2.500906229019165s
Received healthy response to inference request in 3.3534436225891113s
Received healthy response to inference request in 3.3547983169555664s
Received healthy response to inference request in 4.164547920227051s
Received healthy response to inference request in 2.0690975189208984s
5 requests
0 failed requests
5th percentile: 2.155459260940552
10th percentile: 2.2418210029602053
20th percentile: 2.4145444869995116
30th percentile: 2.671413707733154
40th percentile: 3.0124286651611327
50th percentile: 3.3534436225891113
60th percentile: 3.3539855003356935
70th percentile: 3.3545273780822753
80th percentile: 3.5167482376098635
90th percentile: 3.840648078918457
95th percentile: 4.002597999572754
99th percentile: 4.132157936096191
mean time: 3.088558721542358
Pipeline stage StressChecker completed in 38.14s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.66s
Shutdown handler de-registered
chaiml-llama-8b-multihe_54063_v7 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3379.13s
Shutdown handler de-registered
chaiml-llama-8b-multihe_54063_v7 status is now inactive due to auto deactivation removed underperforming models
chaiml-llama-8b-multihe_54063_v7 status is now torndown due to DeploymentManager action