rirv938-llama-8b-pairwis_9273

developer_uid: rirv938
submission_id: rirv938-llama-8b-pairwis_9273_v3
model_name: rirv938-llama-8b-pairwis_9273_v3
model_group: rirv938/llama_8b_pairwis
status: inactive
timestamp: 2024-12-12T22:50:45+00:00
num_battles: 16648
num_wins: 8153
celo_rating: 1253.57
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: rirv938/llama_8b_pairwise_64m_256_tokens_step_15624
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 256
max_output_tokens: 1
display_name: rirv938-llama-8b-pairwis_9273_v3
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: rirv938/llama_8b_pairwise_64m_256_tokens_step_15624
model_size: 8B
ranking_group: single
us_pacific_date: 2024-12-12
win_ratio: 0.4897284959154253
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name rirv938-llama-8b-pairwis-9273-v3-mkmlizer
Waiting for job on rirv938-llama-8b-pairwis-9273-v3-mkmlizer to finish
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║     _____            __           __                                ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║       /___/                                                         ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║                                                                     ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  Version: 0.11.12                                                   ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  https://mk1.ai                                                     ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║                                                                     ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  belonging to:                                                      ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║                                                                     ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  Chai Research Corp.                                                ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ║                                                                     ║
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: Downloaded to shared memory in 21.933s
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:t0, folder:/tmp/tmpyavc73_s, device:0
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: quantized model in 85.899s
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: Processed model rirv938/llama_8b_pairwise_64m_256_tokens_step_15624 in 107.831s
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: creating bucket guanaco-mkml-models
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rirv938-llama-8b-pairwis-9273-v3
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rirv938-llama-8b-pairwis-9273-v3/config.json
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rirv938-llama-8b-pairwis-9273-v3/special_tokens_map.json
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rirv938-llama-8b-pairwis-9273-v3/tokenizer_config.json
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rirv938-llama-8b-pairwis-9273-v3/tokenizer.json
rirv938-llama-8b-pairwis-9273-v3-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/291 [00:00<00:56,  5.09it/s]
Loading 0:   1%|▏         | 4/291 [00:01<01:31,  3.13it/s]
Loading 0:   2%|▏         | 5/291 [00:01<02:01,  2.36it/s]
Loading 0:   3%|▎         | 8/291 [00:02<01:03,  4.49it/s]
Loading 0:   3%|▎         | 9/291 [00:02<01:02,  4.52it/s]
Loading 0:   3%|▎         | 10/291 [00:02<00:54,  5.13it/s]
Loading 0:   4%|▍         | 12/291 [00:02<01:05,  4.26it/s]
Loading 0:   4%|▍         | 13/291 [00:03<01:27,  3.19it/s]
Loading 0:   5%|▍         | 14/291 [00:04<01:50,  2.50it/s]
Loading 0:   6%|▌         | 17/291 [00:04<01:03,  4.30it/s]
Loading 0:   6%|▌         | 18/291 [00:04<01:00,  4.51it/s]
Loading 0:   7%|▋         | 19/291 [00:04<00:53,  5.09it/s]
Loading 0:   7%|▋         | 21/291 [00:05<01:03,  4.28it/s]
Loading 0:   8%|▊         | 22/291 [00:05<01:23,  3.24it/s]
Loading 0:   8%|▊         | 23/291 [00:06<01:44,  2.56it/s]
Loading 0:   9%|▉         | 26/291 [00:06<01:00,  4.36it/s]
Loading 0:   9%|▉         | 27/291 [00:06<00:57,  4.59it/s]
Loading 0:  10%|▉         | 28/291 [00:07<00:50,  5.17it/s]
Loading 0:  10%|█         | 30/291 [00:07<01:00,  4.32it/s]
Loading 0:  11%|█         | 31/291 [00:08<01:20,  3.24it/s]
Loading 0:  11%|█         | 32/291 [00:08<01:41,  2.54it/s]
Loading 0:  12%|█▏        | 35/291 [00:09<00:59,  4.34it/s]
Loading 0:  12%|█▏        | 36/291 [00:09<00:55,  4.58it/s]
Loading 0:  13%|█▎        | 37/291 [00:09<00:48,  5.18it/s]
Loading 0:  13%|█▎        | 39/291 [00:09<00:57,  4.35it/s]
Loading 0:  14%|█▎        | 40/291 [00:10<01:16,  3.26it/s]
Loading 0:  14%|█▍        | 41/291 [00:11<01:36,  2.59it/s]
Loading 0:  15%|█▌        | 44/291 [00:11<00:56,  4.39it/s]
Loading 0:  15%|█▌        | 45/291 [00:11<00:53,  4.62it/s]
Loading 0:  16%|█▌        | 46/291 [00:11<00:47,  5.15it/s]
Loading 0:  16%|█▋        | 48/291 [00:12<00:56,  4.33it/s]
Loading 0:  17%|█▋        | 49/291 [00:12<01:13,  3.27it/s]
Loading 0:  17%|█▋        | 50/291 [00:13<01:33,  2.57it/s]
Loading 0:  18%|█▊        | 53/291 [00:13<00:53,  4.42it/s]
Loading 0:  19%|█▊        | 54/291 [00:13<00:50,  4.65it/s]
Loading 0:  19%|█▉        | 55/291 [00:13<00:44,  5.26it/s]
Loading 0:  20%|█▉        | 57/291 [00:14<00:53,  4.38it/s]
Loading 0:  20%|█▉        | 58/291 [00:15<01:10,  3.29it/s]
Loading 0:  20%|██        | 59/291 [00:15<01:29,  2.60it/s]
Loading 0:  21%|██▏       | 62/291 [00:15<00:51,  4.41it/s]
Loading 0:  22%|██▏       | 63/291 [00:16<00:49,  4.65it/s]
Loading 0:  22%|██▏       | 64/291 [00:16<00:43,  5.24it/s]
Loading 0:  23%|██▎       | 66/291 [00:16<00:51,  4.36it/s]
Loading 0:  23%|██▎       | 67/291 [00:17<01:08,  3.29it/s]
Loading 0:  23%|██▎       | 68/291 [00:18<01:26,  2.58it/s]
Loading 0:  24%|██▍       | 71/291 [00:18<00:49,  4.43it/s]
Loading 0:  25%|██▍       | 72/291 [00:18<00:46,  4.67it/s]
Loading 0:  25%|██▌       | 73/291 [00:18<00:41,  5.26it/s]
Loading 0:  26%|██▌       | 75/291 [00:19<00:49,  4.38it/s]
Loading 0:  26%|██▌       | 76/291 [00:19<01:05,  3.31it/s]
Loading 0:  26%|██▋       | 77/291 [00:20<01:22,  2.58it/s]
Loading 0:  27%|██▋       | 80/291 [00:20<00:48,  4.38it/s]
Loading 0:  28%|██▊       | 81/291 [00:20<00:45,  4.63it/s]
Loading 0:  28%|██▊       | 82/291 [00:20<00:40,  5.22it/s]
Loading 0:  29%|██▊       | 83/291 [00:20<00:40,  5.16it/s]
Loading 0:  29%|██▉       | 84/291 [00:21<01:00,  3.44it/s]
Loading 0:  29%|██▉       | 85/291 [00:22<01:15,  2.72it/s]
Loading 0:  30%|██▉       | 86/291 [00:22<01:31,  2.24it/s]
Loading 0:  31%|███       | 89/291 [00:23<00:48,  4.17it/s]
Loading 0:  31%|███       | 90/291 [00:23<00:45,  4.45it/s]
Loading 0:  32%|███▏      | 93/291 [00:23<00:44,  4.45it/s]
Loading 0:  32%|███▏      | 94/291 [00:24<00:56,  3.46it/s]
Loading 0:  33%|███▎      | 95/291 [00:25<01:11,  2.75it/s]
Loading 0:  34%|███▎      | 98/291 [00:25<00:43,  4.47it/s]
Loading 0:  34%|███▍      | 99/291 [00:25<00:40,  4.69it/s]
Loading 0:  34%|███▍      | 100/291 [00:25<00:36,  5.24it/s]
Loading 0:  35%|███▌      | 102/291 [00:26<00:43,  4.39it/s]
Loading 0:  35%|███▌      | 103/291 [00:26<00:56,  3.32it/s]
Loading 0:  36%|███▌      | 104/291 [00:27<01:12,  2.59it/s]
Loading 0:  37%|███▋      | 107/291 [00:27<00:42,  4.36it/s]
Loading 0:  37%|███▋      | 108/291 [00:27<00:39,  4.60it/s]
Loading 0:  37%|███▋      | 109/291 [00:27<00:35,  5.20it/s]
Loading 0:  38%|███▊      | 111/291 [00:28<00:41,  4.35it/s]
Loading 0:  38%|███▊      | 112/291 [00:29<00:54,  3.30it/s]
Loading 0:  39%|███▉      | 113/291 [00:29<01:08,  2.61it/s]
Loading 0:  40%|███▉      | 116/291 [00:29<00:39,  4.48it/s]
Loading 0:  40%|████      | 117/291 [00:30<00:36,  4.71it/s]
Loading 0:  41%|████      | 120/291 [00:30<00:37,  4.59it/s]
Loading 0:  42%|████▏     | 121/291 [00:31<00:47,  3.56it/s]
Loading 0:  42%|████▏     | 122/291 [00:31<01:00,  2.81it/s]
Loading 0:  43%|████▎     | 125/291 [00:32<00:36,  4.49it/s]
Loading 0:  43%|████▎     | 126/291 [00:32<00:35,  4.71it/s]
Loading 0:  44%|████▎     | 127/291 [00:32<00:31,  5.26it/s]
Loading 0:  44%|████▍     | 129/291 [00:32<00:36,  4.42it/s]
Loading 0:  45%|████▍     | 130/291 [00:33<00:48,  3.35it/s]
Loading 0:  45%|████▌     | 131/291 [00:34<01:00,  2.64it/s]
Loading 0:  46%|████▌     | 134/291 [00:34<00:34,  4.50it/s]
Loading 0:  46%|████▋     | 135/291 [00:34<00:32,  4.73it/s]
Loading 0:  47%|████▋     | 136/291 [00:34<00:29,  5.25it/s]
Loading 0:  47%|████▋     | 138/291 [00:35<00:34,  4.38it/s]
Loading 0:  48%|████▊     | 139/291 [00:35<00:45,  3.31it/s]
Loading 0:  48%|████▊     | 140/291 [00:36<00:57,  2.61it/s]
Loading 0:  49%|████▉     | 143/291 [00:36<00:33,  4.44it/s]
Loading 0:  49%|████▉     | 144/291 [00:36<00:31,  4.69it/s]
Loading 0:  50%|████▉     | 145/291 [00:36<00:27,  5.28it/s]
Loading 0:  51%|█████     | 147/291 [00:37<00:32,  4.40it/s]
Loading 0:  51%|█████     | 148/291 [00:38<00:43,  3.31it/s]
Loading 0:  51%|█████     | 149/291 [00:38<00:54,  2.61it/s]
Loading 0:  52%|█████▏    | 152/291 [00:38<00:31,  4.48it/s]
Loading 0:  53%|█████▎    | 153/291 [00:39<00:29,  4.72it/s]
Loading 0:  53%|█████▎    | 154/291 [00:39<00:25,  5.32it/s]
Loading 0:  54%|█████▎    | 156/291 [00:39<00:30,  4.42it/s]
Loading 0:  54%|█████▍    | 157/291 [00:40<00:40,  3.32it/s]
Loading 0:  54%|█████▍    | 158/291 [00:41<00:51,  2.59it/s]
Loading 0:  55%|█████▌    | 161/291 [00:41<00:29,  4.45it/s]
Loading 0:  56%|█████▌    | 162/291 [00:41<00:27,  4.68it/s]
Loading 0:  56%|█████▌    | 163/291 [00:41<00:24,  5.26it/s]
Loading 0:  57%|█████▋    | 165/291 [00:42<00:28,  4.40it/s]
Loading 0:  57%|█████▋    | 166/291 [00:42<00:37,  3.32it/s]
Loading 0:  57%|█████▋    | 167/291 [00:43<00:47,  2.63it/s]
Loading 0:  58%|█████▊    | 170/291 [00:43<00:27,  4.47it/s]
Loading 0:  59%|█████▉    | 171/291 [00:43<00:25,  4.70it/s]
Loading 0:  59%|█████▉    | 172/291 [00:43<00:22,  5.26it/s]
Loading 0:  59%|█████▉    | 173/291 [00:44<00:33,  3.56it/s]
Loading 0:  60%|██████    | 175/291 [00:44<00:23,  4.89it/s]
Loading 0:  60%|██████    | 176/291 [00:44<00:22,  5.11it/s]
Loading 0:  61%|██████    | 178/291 [00:44<00:15,  7.19it/s]
Loading 0:  62%|██████▏   | 180/291 [00:45<00:32,  3.40it/s]
Loading 0:  62%|██████▏   | 181/291 [00:46<00:40,  2.71it/s]
Loading 0:  63%|██████▎   | 184/291 [00:46<00:24,  4.43it/s]
Loading 0:  64%|██████▎   | 185/291 [00:46<00:22,  4.65it/s]
Loading 0:  64%|██████▍   | 186/291 [00:47<00:20,  5.22it/s]
Loading 0:  64%|██████▍   | 187/291 [00:47<00:19,  5.23it/s]
Loading 0:  65%|██████▍   | 188/291 [00:47<00:29,  3.51it/s]
Loading 0:  65%|██████▍   | 189/291 [00:48<00:38,  2.63it/s]
Loading 0:  66%|██████▌   | 192/291 [00:48<00:27,  3.57it/s]
Loading 0:  66%|██████▋   | 193/291 [00:49<00:33,  2.96it/s]
Loading 0:  67%|██████▋   | 194/291 [00:50<00:39,  2.45it/s]
Loading 0:  68%|██████▊   | 197/291 [00:50<00:22,  4.14it/s]
Loading 0:  68%|██████▊   | 198/291 [00:50<00:21,  4.41it/s]
Loading 0:  68%|██████▊   | 199/291 [00:50<00:18,  5.00it/s]
Loading 0:  69%|██████▉   | 201/291 [00:51<00:20,  4.29it/s]
Loading 0:  69%|██████▉   | 202/291 [00:51<00:27,  3.28it/s]
Loading 0:  70%|██████▉   | 203/291 [00:52<00:33,  2.61it/s]
Loading 0:  71%|███████   | 206/291 [00:52<00:19,  4.42it/s]
Loading 0:  71%|███████   | 207/291 [00:52<00:18,  4.65it/s]
Loading 0:  71%|███████▏  | 208/291 [00:52<00:15,  5.22it/s]
Loading 0:  72%|███████▏  | 210/291 [00:53<00:18,  4.39it/s]
Loading 0:  73%|███████▎  | 211/291 [00:54<00:24,  3.31it/s]
Loading 0:  73%|███████▎  | 212/291 [00:54<00:30,  2.63it/s]
Loading 0:  74%|███████▍  | 215/291 [00:54<00:16,  4.49it/s]
Loading 0:  74%|███████▍  | 216/291 [00:55<00:15,  4.73it/s]
Loading 0:  75%|███████▍  | 217/291 [00:55<00:13,  5.29it/s]
Loading 0:  75%|███████▌  | 219/291 [00:55<00:16,  4.42it/s]
Loading 0:  76%|███████▌  | 220/291 [00:56<00:21,  3.33it/s]
Loading 0:  76%|███████▌  | 221/291 [00:56<00:26,  2.62it/s]
Loading 0:  77%|███████▋  | 224/291 [00:57<00:14,  4.49it/s]
Loading 0:  77%|███████▋  | 225/291 [00:57<00:14,  4.68it/s]
Loading 0:  78%|███████▊  | 226/291 [00:57<00:12,  5.23it/s]
Loading 0:  78%|███████▊  | 228/291 [00:58<00:14,  4.36it/s]
Loading 0:  79%|███████▊  | 229/291 [00:58<00:18,  3.30it/s]
Loading 0:  79%|███████▉  | 230/291 [00:59<00:23,  2.60it/s]
Loading 0:  80%|████████  | 233/291 [00:59<00:13,  4.43it/s]
Loading 0:  80%|████████  | 234/291 [00:59<00:12,  4.68it/s]
Loading 0:  81%|████████  | 235/291 [00:59<00:10,  5.25it/s]
Loading 0:  81%|████████▏ | 237/291 [01:00<00:12,  4.41it/s]
Loading 0:  82%|████████▏ | 238/291 [01:00<00:15,  3.33it/s]
Loading 0:  82%|████████▏ | 239/291 [01:01<00:19,  2.63it/s]
Loading 0:  83%|████████▎ | 242/291 [01:01<00:10,  4.46it/s]
Loading 0:  84%|████████▎ | 243/291 [01:01<00:10,  4.70it/s]
Loading 0:  84%|████████▍ | 244/291 [01:02<00:08,  5.27it/s]
Loading 0:  85%|████████▍ | 246/291 [01:02<00:10,  4.40it/s]
Loading 0:  85%|████████▍ | 247/291 [01:03<00:13,  3.33it/s]
Loading 0:  85%|████████▌ | 248/291 [01:03<00:16,  2.64it/s]
Loading 0:  86%|████████▋ | 251/291 [01:03<00:08,  4.48it/s]
Loading 0:  87%|████████▋ | 252/291 [01:04<00:08,  4.72it/s]
Loading 0:  87%|████████▋ | 253/291 [01:04<00:07,  5.30it/s]
Loading 0:  88%|████████▊ | 255/291 [01:04<00:08,  4.42it/s]
Loading 0:  88%|████████▊ | 256/291 [01:05<00:10,  3.34it/s]
Loading 0:  88%|████████▊ | 257/291 [01:06<00:12,  2.64it/s]
Loading 0:  89%|████████▉ | 260/291 [01:06<00:06,  4.52it/s]
Loading 0:  90%|████████▉ | 261/291 [01:06<00:06,  4.76it/s]
Loading 0:  90%|█████████ | 262/291 [01:06<00:05,  5.33it/s]
Loading 0:  91%|█████████ | 264/291 [01:07<00:06,  4.43it/s]
Loading 0:  91%|█████████ | 265/291 [01:07<00:07,  3.32it/s]
Loading 0:  91%|█████████▏| 266/291 [01:08<00:09,  2.63it/s]
Loading 0:  92%|█████████▏| 269/291 [01:08<00:04,  4.47it/s]
Loading 0:  93%|█████████▎| 270/291 [01:08<00:04,  4.71it/s]
Loading 0:  93%|█████████▎| 271/291 [01:08<00:03,  5.24it/s]
Loading 0:  94%|█████████▍| 273/291 [01:09<00:04,  4.39it/s]
Loading 0:  94%|█████████▍| 274/291 [01:09<00:05,  3.32it/s]
Loading 0:  95%|█████████▍| 275/291 [01:10<00:06,  2.64it/s]
Loading 0:  96%|█████████▌| 278/291 [01:10<00:02,  4.53it/s]
Loading 0:  96%|█████████▌| 279/291 [01:10<00:02,  4.77it/s]
Loading 0:  96%|█████████▌| 280/291 [01:11<00:02,  5.33it/s]
Loading 0:  97%|█████████▋| 281/291 [01:11<00:02,  3.58it/s]
Loading 0:  97%|█████████▋| 282/291 [01:12<00:03,  2.67it/s]
Loading 0:  98%|█████████▊| 284/291 [01:12<00:01,  3.85it/s]
Loading 0:  98%|█████████▊| 285/291 [01:12<00:01,  4.18it/s]
Loading 0:  98%|█████████▊| 286/291 [01:12<00:01,  4.80it/s]
Loading 0:  99%|█████████▊| 287/291 [01:12<00:00,  5.00it/s]
Loading 0:  99%|█████████▉| 288/291 [01:13<00:00,  3.31it/s]
                                                            
Job rirv938-llama-8b-pairwis-9273-v3-mkmlizer completed after 136.75s with status: succeeded
Stopping job with name rirv938-llama-8b-pairwis-9273-v3-mkmlizer
Pipeline stage MKMLizer completed in 137.29s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service rirv938-llama-8b-pairwis-9273-v3
Waiting for inference service rirv938-llama-8b-pairwis-9273-v3 to be ready
Inference service rirv938-llama-8b-pairwis-9273-v3 ready after 200.80181431770325s
Pipeline stage MKMLDeployer completed in 201.37s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8220107555389404s
Received healthy response to inference request in 2.391468048095703s
Received healthy response to inference request in 3.5714592933654785s
Received healthy response to inference request in 3.6124277114868164s
Received healthy response to inference request in 2.547710418701172s
5 requests
0 failed requests
5th percentile: 2.422716522216797
10th percentile: 2.4539649963378904
20th percentile: 2.516461944580078
30th percentile: 2.7524601936340334
40th percentile: 3.161959743499756
50th percentile: 3.5714592933654785
60th percentile: 3.5878466606140136
70th percentile: 3.6042340278625487
80th percentile: 3.654344320297241
90th percentile: 3.738177537918091
95th percentile: 3.7800941467285156
99th percentile: 3.8136274337768556
mean time: 3.189015245437622
Pipeline stage StressChecker completed in 17.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.59s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 2.60s
Shutdown handler de-registered
rirv938-llama-8b-pairwis_9273_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.13s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.11s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service rirv938-llama-8b-pairwis-9273-v3-profiler
Waiting for inference service rirv938-llama-8b-pairwis-9273-v3-profiler to be ready
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3420.71s
Shutdown handler de-registered