submission_id: chaiml-albert-0823-dpo30_6942_v3
developer_uid: albert_chai
alignment_samples: 9211
alignment_score: -33.88381386294573
best_of: 16
celo_rating: 1113.16
display_name: albert_0823_dpo3000_bo16
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
language_model: ChaiML/albert_0823_dpo3000-1e5x2
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: ChaiML/albert_0823_dpo30
model_name: albert_0823_dpo3000_bo16
model_num_parameters: 12772070400.0
model_repo: ChaiML/albert_0823_dpo3000-1e5x2
model_size: 13B
num_battles: 9211
num_wins: 3109
propriety_score: 0.6317460317460317
propriety_total_count: 945.0
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-24T06:04:37+00:00
us_pacific_date: 2024-08-23
win_ratio: 0.33753121268049074
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name chaiml-albert-0823-dpo30-6942-v3-mkmlizer
Waiting for job on chaiml-albert-0823-dpo30-6942-v3-mkmlizer to finish
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║     _____            __           __                                ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║       /___/                                                         ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║                                                                     ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  Version: 0.10.1                                                    ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║                                                                     ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  belonging to:                                                      ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║                                                                     ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ║                                                                     ║
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: Downloaded to shared memory in 55.667s
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp7hb43yl9, device:0
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: quantized model in 40.937s
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: Processed model ChaiML/albert_0823_dpo3000-1e5x2 in 96.604s
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: creating bucket guanaco-mkml-models
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-albert-0823-dpo30-6942-v3
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-albert-0823-dpo30-6942-v3/config.json
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-albert-0823-dpo30-6942-v3/special_tokens_map.json
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-albert-0823-dpo30-6942-v3/flywheel_model.0.safetensors
chaiml-albert-0823-dpo30-6942-v3-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:15, 23.51it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:12, 28.71it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:14, 24.55it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:11, 30.97it/s]
Loading 0:   6%|▋         | 23/363 [00:00<00:15, 22.12it/s]
Loading 0:   7%|▋         | 26/363 [00:01<00:16, 20.17it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:12, 25.98it/s]
Loading 0:  10%|▉         | 35/363 [00:01<00:11, 27.49it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:11, 28.64it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:11, 27.79it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:10, 29.79it/s]
Loading 0:  14%|█▍        | 52/363 [00:01<00:10, 28.83it/s]
Loading 0:  15%|█▌        | 56/363 [00:02<00:10, 28.98it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:12, 24.25it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:13, 21.79it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:10, 28.78it/s]
Loading 0:  21%|██        | 75/363 [00:02<00:10, 28.45it/s]
Loading 0:  22%|██▏       | 79/363 [00:02<00:10, 27.73it/s]
Loading 0:  23%|██▎       | 84/363 [00:03<00:09, 30.51it/s]
Loading 0:  24%|██▍       | 88/363 [00:03<00:09, 29.58it/s]
Loading 0:  26%|██▌       | 93/363 [00:03<00:08, 31.16it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:08, 29.88it/s]
Loading 0:  28%|██▊       | 101/363 [00:03<00:11, 23.60it/s]
Loading 0:  29%|██▊       | 104/363 [00:03<00:12, 21.08it/s]
Loading 0:  31%|███       | 111/363 [00:04<00:08, 28.21it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:08, 27.86it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:07, 30.43it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:08, 29.41it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:07, 31.56it/s]
Loading 0:  37%|███▋      | 133/363 [00:04<00:07, 29.97it/s]
Loading 0:  38%|███▊      | 137/363 [00:04<00:07, 29.58it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:08, 25.09it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:09, 24.05it/s]
Loading 0:  41%|████      | 148/363 [00:05<00:09, 23.11it/s]
Loading 0:  42%|████▏     | 151/363 [00:05<00:08, 24.08it/s]
Loading 0:  43%|████▎     | 156/363 [00:05<00:07, 27.99it/s]
Loading 0:  44%|████▍     | 159/363 [00:05<00:07, 26.21it/s]
Loading 0:  45%|████▌     | 165/363 [00:06<00:06, 30.69it/s]
Loading 0:  47%|████▋     | 169/363 [00:06<00:06, 29.14it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:05, 31.54it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:06, 29.71it/s]
Loading 0:  50%|█████     | 182/363 [00:06<00:07, 23.53it/s]
Loading 0:  51%|█████     | 185/363 [00:06<00:08, 21.38it/s]
Loading 0:  52%|█████▏    | 190/363 [00:07<00:06, 26.83it/s]
Loading 0:  53%|█████▎    | 194/363 [00:07<00:06, 24.99it/s]
Loading 0:  55%|█████▌    | 201/363 [00:07<00:05, 31.83it/s]
Loading 0:  56%|█████▋    | 205/363 [00:07<00:05, 30.36it/s]
Loading 0:  58%|█████▊    | 210/363 [00:07<00:04, 32.38it/s]
Loading 0:  59%|█████▉    | 214/363 [00:07<00:04, 30.58it/s]
Loading 0:  60%|██████    | 218/363 [00:07<00:04, 30.09it/s]
Loading 0:  61%|██████▏   | 223/363 [00:08<00:05, 24.76it/s]
Loading 0:  62%|██████▏   | 226/363 [00:08<00:05, 23.48it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:05, 22.34it/s]
Loading 0:  65%|██████▌   | 237/363 [00:08<00:04, 28.98it/s]
Loading 0:  66%|██████▋   | 241/363 [00:08<00:04, 28.36it/s]
Loading 0:  68%|██████▊   | 246/363 [00:09<00:03, 30.12it/s]
Loading 0:  69%|██████▉   | 250/363 [00:09<00:03, 28.71it/s]
Loading 0:  70%|██████▉   | 254/363 [00:09<00:03, 31.09it/s]
Loading 0:  71%|███████   | 258/363 [00:09<00:04, 25.77it/s]
Loading 0:  72%|███████▏  | 263/363 [00:09<00:04, 22.68it/s]
Loading 0:  73%|███████▎  | 266/363 [00:09<00:04, 20.50it/s]
Loading 0:  75%|███████▌  | 273/363 [00:10<00:03, 27.13it/s]
Loading 0:  76%|███████▋  | 277/363 [00:10<00:03, 26.29it/s]
Loading 0:  78%|███████▊  | 282/363 [00:10<00:02, 28.89it/s]
Loading 0:  79%|███████▉  | 286/363 [00:10<00:02, 28.47it/s]
Loading 0:  80%|████████  | 291/363 [00:10<00:02, 29.98it/s]
Loading 0:  81%|████████▏ | 295/363 [00:10<00:02, 28.68it/s]
Loading 0:  82%|████████▏ | 299/363 [00:10<00:02, 28.97it/s]
Loading 0:  84%|████████▎ | 304/363 [00:11<00:02, 24.81it/s]
Loading 0:  85%|████████▍ | 307/363 [00:11<00:02, 23.98it/s]
Loading 0:  86%|████████▌ | 311/363 [00:11<00:02, 23.31it/s]
Loading 0:  88%|████████▊ | 318/363 [00:11<00:01, 29.69it/s]
Loading 0:  89%|████████▊ | 322/363 [00:11<00:01, 28.76it/s]
Loading 0:  90%|█████████ | 327/363 [00:12<00:01, 30.97it/s]
Loading 0:  91%|█████████ | 331/363 [00:12<00:01, 29.45it/s]
Loading 0:  93%|█████████▎| 336/363 [00:12<00:00, 31.77it/s]
Loading 0:  94%|█████████▎| 340/363 [00:12<00:00, 30.18it/s]
Loading 0:  95%|█████████▍| 344/363 [00:19<00:09,  1.96it/s]
Loading 0:  96%|█████████▌| 348/363 [00:19<00:05,  2.64it/s]
Loading 0:  97%|█████████▋| 353/363 [00:19<00:02,  3.83it/s]
Loading 0:  98%|█████████▊| 357/363 [00:19<00:01,  4.98it/s]
                                                            

Job chaiml-albert-0823-dpo30-6942-v3-mkmlizer completed after 117.0s with status: succeeded
Stopping job with name chaiml-albert-0823-dpo30-6942-v3-mkmlizer
Pipeline stage MKMLizer completed in 118.54s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.23s
Running pipeline stage ISVCDeployer
Creating inference service chaiml-albert-0823-dpo30-6942-v3
Waiting for inference service chaiml-albert-0823-dpo30-6942-v3 to be ready
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'EOF\n')
Failed to get response for submission blend_remul_2024-08-22: ('http://zonemercy-graft-cogent-v-7573-v6-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission chaiml-albert-0823-dpo30_6942_v1: ('http://chaiml-albert-0823-dpo30-6942-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'EOF\n')
Failed to get response for submission blend_jerun_2024-08-22: ('http://mistralai-mixtral-8x7b-3473-v131-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '{"error":"ValueError : [TypeError(\\"\'numpy.int64\' object is not iterable\\"), TypeError(\'vars() argument must have __dict__ attribute\')]"}')
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'EOF\n')
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'EOF\n')
Failed to get response for submission mistralai-mistral-nemo-_9330_v57: ('http://mistralai-mistral-nemo-9330-v57-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v59: ('http://mistralai-mistral-nemo-9330-v59-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v57: ('http://mistralai-mistral-nemo-9330-v57-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'dial tcp 127.0.0.1:8080: connect: connection refused\n')
Failed to get response for submission mistralai-mistral-nemo-_9330_v59: ('http://mistralai-mistral-nemo-9330-v59-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Tearing down inference service chaiml-albert-0823-dpo30-6942-v3
%s, retrying in %s seconds...
Creating inference service chaiml-albert-0823-dpo30-6942-v3
Ignoring service chaiml-albert-0823-dpo30-6942-v3 already deployed
Waiting for inference service chaiml-albert-0823-dpo30-6942-v3 to be ready
Tearing down inference service chaiml-albert-0823-dpo30-6942-v3
%s, retrying in %s seconds...
Creating inference service chaiml-albert-0823-dpo30-6942-v3
Waiting for inference service chaiml-albert-0823-dpo30-6942-v3 to be ready
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'EOF\n')
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'EOF\n')
Running pipeline stage MKMLizer
Starting job with name rica40325-yui-chai-v5-mkmlizer
Waiting for job on rica40325-yui-chai-v5-mkmlizer to finish
Stopping job with name rica40325-yui-chai-v5-mkmlizer
%s, retrying in %s seconds...
Starting job with name rica40325-yui-chai-v5-mkmlizer
Waiting for job on rica40325-yui-chai-v5-mkmlizer to finish
rica40325-yui-chai-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rica40325-yui-chai-v5-mkmlizer: ║     _____            __           __                                ║
rica40325-yui-chai-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rica40325-yui-chai-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rica40325-yui-chai-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rica40325-yui-chai-v5-mkmlizer: ║       /___/                                                         ║
rica40325-yui-chai-v5-mkmlizer: ║                                                                     ║
rica40325-yui-chai-v5-mkmlizer: ║  Version: 0.10.1                                                    ║
rica40325-yui-chai-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rica40325-yui-chai-v5-mkmlizer: ║  https://mk1.ai                                                     ║
rica40325-yui-chai-v5-mkmlizer: ║                                                                     ║
rica40325-yui-chai-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
rica40325-yui-chai-v5-mkmlizer: ║  belonging to:                                                      ║
rica40325-yui-chai-v5-mkmlizer: ║                                                                     ║
rica40325-yui-chai-v5-mkmlizer: ║  Chai Research Corp.                                                ║
rica40325-yui-chai-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rica40325-yui-chai-v5-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
rica40325-yui-chai-v5-mkmlizer: ║                                                                     ║
rica40325-yui-chai-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission chaiml-albert-0823-dpo30_6942_v1: ('http://chaiml-albert-0823-dpo30-6942-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
rica40325-yui-chai-v5-mkmlizer: Downloaded to shared memory in 23.881s
rica40325-yui-chai-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp_qelkb1t, device:0
rica40325-yui-chai-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission chaiml-albert-0823-dpo30_6942_v1: ('http://chaiml-albert-0823-dpo30-6942-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v57: ('http://mistralai-mistral-nemo-9330-v57-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
rica40325-yui-chai-v5-mkmlizer: quantized model in 25.752s
rica40325-yui-chai-v5-mkmlizer: Processed model rica40325/yui_chai in 49.633s
rica40325-yui-chai-v5-mkmlizer: creating bucket guanaco-mkml-models
rica40325-yui-chai-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rica40325-yui-chai-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rica40325-yui-chai-v5
rica40325-yui-chai-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rica40325-yui-chai-v5/config.json
rica40325-yui-chai-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rica40325-yui-chai-v5/special_tokens_map.json
rica40325-yui-chai-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rica40325-yui-chai-v5/tokenizer_config.json
rica40325-yui-chai-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rica40325-yui-chai-v5/tokenizer.json
rica40325-yui-chai-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rica40325-yui-chai-v5/flywheel_model.0.safetensors
rica40325-yui-chai-v5-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 4/291 [00:00<00:07, 39.68it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:04, 60.22it/s]
Loading 0:   9%|▊         | 25/291 [00:00<00:03, 73.08it/s]
Loading 0:  14%|█▎        | 40/291 [00:00<00:02, 85.21it/s]
Loading 0:  18%|█▊        | 52/291 [00:00<00:02, 84.52it/s]
Loading 0:  23%|██▎       | 67/291 [00:00<00:02, 92.32it/s]
Loading 0:  27%|██▋       | 79/291 [00:00<00:02, 89.96it/s]
Loading 0:  30%|███       | 88/291 [00:02<00:08, 25.05it/s]
Loading 0:  35%|███▌      | 103/291 [00:02<00:05, 34.69it/s]
Loading 0:  38%|███▊      | 112/291 [00:02<00:04, 40.56it/s]
Loading 0:  43%|████▎     | 124/291 [00:02<00:03, 48.21it/s]
Loading 0:  48%|████▊     | 139/291 [00:02<00:02, 58.21it/s]
Loading 0:  52%|█████▏    | 151/291 [00:02<00:02, 64.32it/s]
Loading 0:  57%|█████▋    | 166/291 [00:02<00:01, 73.93it/s]
Loading 0:  61%|██████    | 178/291 [00:03<00:01, 76.33it/s]
Loading 0:  64%|██████▍   | 187/291 [00:04<00:04, 26.00it/s]
Loading 0:  68%|██████▊   | 197/291 [00:04<00:02, 32.38it/s]
Loading 0:  73%|███████▎  | 211/291 [00:04<00:01, 42.17it/s]
Loading 0:  77%|███████▋  | 223/291 [00:04<00:01, 49.81it/s]
Loading 0:  82%|████████▏ | 238/291 [00:04<00:00, 60.86it/s]
Loading 0:  86%|████████▌ | 250/291 [00:04<00:00, 65.70it/s]
Loading 0:  89%|████████▉ | 259/291 [00:04<00:00, 69.82it/s]
Loading 0:  92%|█████████▏| 268/291 [00:05<00:00, 72.37it/s]
Loading 0:  95%|█████████▌| 277/291 [00:05<00:00, 73.42it/s]
Loading 0:  98%|█████████▊| 286/291 [00:05<00:00, 74.15it/s]
                                                            

Failed to get response for submission chaiml-albert-0823-dpo30_3614_v1: ('http://chaiml-albert-0823-dpo30-3614-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'EOF\n')
Inference service chaiml-albert-0823-dpo30-6942-v3 ready after 222.2157106399536s
Pipeline stage ISVCDeployer completed in 841.69s
Running pipeline stage StressChecker
Job rica40325-yui-chai-v5-mkmlizer completed after 77.01s with status: succeeded
Stopping job with name rica40325-yui-chai-v5-mkmlizer
Pipeline stage MKMLizer completed in 79.67s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.13s
Running pipeline stage ISVCDeployer
Creating inference service rica40325-yui-chai-v5
Waiting for inference service rica40325-yui-chai-v5 to be ready
Received healthy response to inference request in 2.8877217769622803s
Received healthy response to inference request in 2.074770927429199s
Received healthy response to inference request in 2.3100132942199707s
Received healthy response to inference request in 2.6356372833251953s
Received healthy response to inference request in 2.176340103149414s
5 requests
0 failed requests
5th percentile: 2.0950847625732423
10th percentile: 2.1153985977172853
20th percentile: 2.156026268005371
30th percentile: 2.203074741363525
40th percentile: 2.256544017791748
50th percentile: 2.3100132942199707
60th percentile: 2.4402628898620606
70th percentile: 2.57051248550415
80th percentile: 2.6860541820526125
90th percentile: 2.7868879795074464
95th percentile: 2.837304878234863
99th percentile: 2.877638397216797
mean time: 2.416896677017212
Pipeline stage StressChecker completed in 14.62s
chaiml-albert-0823-dpo30_6942_v3 status is now deployed due to DeploymentManager action
chaiml-albert-0823-dpo30_6942_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-albert-0823-dpo30_6942_v3 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics