submission_id: zonemercy-vingt-deux-v2-1e5_v11
developer_uid: chai_backend_admin
best_of: 8
celo_rating: 1251.36
display_name: temp-4
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
ineligible_reason: num_battles<5000
is_internal_developer: True
language_model: zonemercy/Vingt-Deux-v2-1e5
max_input_tokens: 1024
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: zonemercy/Vingt-Deux-v2-
model_name: temp-4
model_num_parameters: 22247282688.0
model_repo: zonemercy/Vingt-Deux-v2-1e5
model_size: 22B
num_battles: 4120
num_wins: 2062
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-09-24T16:56:16+00:00
us_pacific_date: 2024-09-24
win_ratio: 0.5004854368932039
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-vingt-deux-v2-1e5-v11-mkmlizer
Waiting for job on zonemercy-vingt-deux-v2-1e5-v11-mkmlizer to finish
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║     _____            __           __                                ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║       /___/                                                         ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  belonging to:                                                      ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ║                                                                     ║
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission zonemercy-vingt-deux-v1-_8973_v1: ('http://zonemercy-vingt-deux-v1-8973-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: Downloaded to shared memory in 54.414s
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpvnhsp3um, device:0
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-v1-_8973_v1: ('http://zonemercy-vingt-deux-v1-8973-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-v2-1e5_v2: ('http://zonemercy-vingt-deux-v2-1e5-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: quantized model in 49.210s
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: Processed model zonemercy/Vingt-Deux-v2-1e5 in 103.625s
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-vingt-deux-v2-1e5-v11
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v2-1e5-v11/special_tokens_map.json
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v2-1e5-v11/config.json
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v2-1e5-v11/tokenizer_config.json
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-vingt-deux-v2-1e5-v11/tokenizer.json
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-vingt-deux-v2-1e5-v11/flywheel_model.1.safetensors
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-vingt-deux-v2-1e5-v11/flywheel_model.0.safetensors
zonemercy-vingt-deux-v2-1e5-v11-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/507 [00:00<00:22, 22.66it/s]
Loading 0:   2%|▏         | 10/507 [00:00<00:15, 31.73it/s]
Loading 0:   3%|▎         | 14/507 [00:00<00:18, 26.94it/s]
Loading 0:   4%|▎         | 19/507 [00:00<00:14, 33.08it/s]
Loading 0:   5%|▍         | 23/507 [00:00<00:16, 28.81it/s]
Loading 0:   6%|▌         | 28/507 [00:00<00:14, 33.90it/s]
Loading 0:   6%|▋         | 32/507 [00:01<00:15, 29.71it/s]
Loading 0:   7%|▋         | 37/507 [00:01<00:13, 34.24it/s]
Loading 0:   8%|▊         | 41/507 [00:01<00:15, 30.24it/s]
Loading 0:   9%|▉         | 46/507 [00:01<00:13, 34.81it/s]
Loading 0:  10%|▉         | 50/507 [00:01<00:14, 31.01it/s]
Loading 0:  11%|█         | 54/507 [00:01<00:22, 20.21it/s]
Loading 0:  11%|█         | 57/507 [00:02<00:22, 20.27it/s]
Loading 0:  12%|█▏        | 61/507 [00:02<00:19, 22.93it/s]
Loading 0:  13%|█▎        | 65/507 [00:02<00:21, 20.75it/s]
Loading 0:  14%|█▍        | 70/507 [00:02<00:17, 25.19it/s]
Loading 0:  15%|█▍        | 75/507 [00:02<00:15, 28.29it/s]
Loading 0:  16%|█▌        | 80/507 [00:02<00:15, 28.17it/s]
Loading 0:  17%|█▋        | 85/507 [00:03<00:13, 32.17it/s]
Loading 0:  18%|█▊        | 89/507 [00:03<00:15, 27.85it/s]
Loading 0:  19%|█▊        | 94/507 [00:03<00:13, 29.97it/s]
Loading 0:  19%|█▉        | 98/507 [00:03<00:15, 26.14it/s]
Loading 0:  20%|██        | 103/507 [00:03<00:13, 29.76it/s]
Loading 0:  21%|██        | 107/507 [00:03<00:14, 26.83it/s]
Loading 0:  22%|██▏       | 112/507 [00:04<00:13, 29.98it/s]
Loading 0:  23%|██▎       | 116/507 [00:04<00:21, 17.83it/s]
Loading 0:  24%|██▍       | 122/507 [00:04<00:18, 20.28it/s]
Loading 0:  25%|██▌       | 127/507 [00:04<00:16, 23.68it/s]
Loading 0:  26%|██▌       | 131/507 [00:05<00:16, 22.72it/s]
Loading 0:  27%|██▋       | 136/507 [00:05<00:13, 26.69it/s]
Loading 0:  28%|██▊       | 140/507 [00:05<00:14, 25.62it/s]
Loading 0:  29%|██▊       | 145/507 [00:05<00:12, 30.07it/s]
Loading 0:  29%|██▉       | 149/507 [00:05<00:12, 27.61it/s]
Loading 0:  30%|███       | 154/507 [00:05<00:10, 32.28it/s]
Loading 0:  31%|███       | 158/507 [00:05<00:11, 29.71it/s]
Loading 0:  32%|███▏      | 164/507 [00:05<00:09, 34.57it/s]
Loading 0:  33%|███▎      | 169/507 [00:06<00:12, 27.01it/s]
Loading 0:  34%|███▍      | 173/507 [00:06<00:12, 27.60it/s]
Loading 0:  35%|███▍      | 177/507 [00:06<00:12, 26.34it/s]
Loading 0:  36%|███▌      | 181/507 [00:06<00:11, 28.98it/s]
Loading 0:  36%|███▋      | 185/507 [00:06<00:11, 27.55it/s]
Loading 0:  38%|███▊      | 191/507 [00:06<00:09, 34.62it/s]
Loading 0:  38%|███▊      | 195/507 [00:07<00:10, 30.93it/s]
Loading 0:  39%|███▉      | 199/507 [00:07<00:09, 32.63it/s]
Loading 0:  40%|████      | 203/507 [00:07<00:10, 29.06it/s]
Loading 0:  41%|████      | 208/507 [00:07<00:09, 32.57it/s]
Loading 0:  42%|████▏     | 212/507 [00:07<00:10, 28.19it/s]
Loading 0:  43%|████▎     | 217/507 [00:07<00:08, 32.76it/s]
Loading 0:  44%|████▎     | 221/507 [00:07<00:09, 30.61it/s]
Loading 0:  44%|████▍     | 225/507 [00:08<00:13, 21.67it/s]
Loading 0:  45%|████▌     | 230/507 [00:08<00:12, 22.80it/s]
Loading 0:  46%|████▋     | 235/507 [00:08<00:10, 26.67it/s]
Loading 0:  47%|████▋     | 239/507 [00:08<00:10, 25.27it/s]
Loading 0:  48%|████▊     | 244/507 [00:08<00:08, 29.69it/s]
Loading 0:  49%|████▉     | 248/507 [00:09<00:09, 27.32it/s]
Loading 0:  50%|████▉     | 253/507 [00:09<00:08, 31.31it/s]
Loading 0:  51%|█████     | 257/507 [00:09<00:09, 27.35it/s]
Loading 0:  52%|█████▏    | 262/507 [00:09<00:07, 31.38it/s]
Loading 0:  52%|█████▏    | 266/507 [00:09<00:08, 27.95it/s]
Loading 0:  53%|█████▎    | 271/507 [00:09<00:07, 31.04it/s]
Loading 0:  54%|█████▍    | 275/507 [00:09<00:08, 28.26it/s]
Loading 0:  55%|█████▌    | 280/507 [00:10<00:07, 31.35it/s]
Loading 0:  56%|█████▌    | 284/507 [00:10<00:09, 22.83it/s]
Loading 0:  57%|█████▋    | 287/507 [00:10<00:10, 21.38it/s]
Loading 0:  58%|█████▊    | 293/507 [00:10<00:08, 24.98it/s]
Loading 0:  59%|█████▉    | 299/507 [00:26<00:08, 24.98it/s]
Loading 0:  59%|█████▉    | 300/507 [00:26<03:08,  1.10it/s]
Loading 0:  60%|█████▉    | 302/507 [00:26<02:43,  1.26it/s]
Loading 0:  61%|██████    | 307/507 [00:26<01:48,  1.84it/s]
Loading 0:  61%|██████    | 310/507 [00:26<01:25,  2.30it/s]
Loading 0:  62%|██████▏   | 313/507 [00:27<01:05,  2.95it/s]
Loading 0:  62%|██████▏   | 316/507 [00:27<00:49,  3.83it/s]
Loading 0:  63%|██████▎   | 320/507 [00:27<00:35,  5.30it/s]
Loading 0:  64%|██████▍   | 327/507 [00:27<00:20,  8.99it/s]
Loading 0:  65%|██████▌   | 331/507 [00:27<00:16, 10.96it/s]
Loading 0:  66%|██████▌   | 335/507 [00:27<00:13, 13.13it/s]
Loading 0:  67%|██████▋   | 339/507 [00:27<00:10, 15.53it/s]
Loading 0:  68%|██████▊   | 343/507 [00:28<00:11, 14.13it/s]
Loading 0:  68%|██████▊   | 347/507 [00:28<00:10, 15.93it/s]
Loading 0:  69%|██████▉   | 352/507 [00:28<00:07, 20.70it/s]
Loading 0:  70%|███████   | 356/507 [00:28<00:07, 20.56it/s]
Loading 0:  71%|███████   | 361/507 [00:28<00:06, 23.91it/s]
Loading 0:  72%|███████▏  | 365/507 [00:28<00:05, 24.09it/s]
Loading 0:  73%|███████▎  | 370/507 [00:29<00:04, 29.01it/s]
Loading 0:  74%|███████▍  | 374/507 [00:29<00:04, 27.15it/s]
Loading 0:  75%|███████▍  | 379/507 [00:29<00:04, 29.21it/s]
Loading 0:  76%|███████▌  | 383/507 [00:29<00:04, 25.77it/s]
Loading 0:  77%|███████▋  | 389/507 [00:29<00:03, 30.73it/s]
Loading 0:  78%|███████▊  | 393/507 [00:29<00:03, 29.92it/s]
Loading 0:  78%|███████▊  | 397/507 [00:30<00:05, 21.57it/s]
Loading 0:  79%|███████▉  | 401/507 [00:30<00:04, 21.89it/s]
Loading 0:  80%|████████  | 406/507 [00:30<00:03, 25.94it/s]
Loading 0:  81%|████████  | 410/507 [00:30<00:03, 24.46it/s]
Loading 0:  82%|████████▏ | 415/507 [00:30<00:03, 28.95it/s]
Loading 0:  83%|████████▎ | 419/507 [00:30<00:03, 27.24it/s]
Loading 0:  84%|████████▎ | 424/507 [00:31<00:02, 31.70it/s]
Loading 0:  84%|████████▍ | 428/507 [00:31<00:02, 29.47it/s]
Loading 0:  86%|████████▌ | 435/507 [00:31<00:01, 36.46it/s]
Loading 0:  87%|████████▋ | 439/507 [00:31<00:01, 34.87it/s]
Loading 0:  88%|████████▊ | 444/507 [00:31<00:01, 36.93it/s]
Loading 0:  88%|████████▊ | 448/507 [00:31<00:01, 34.87it/s]
Loading 0:  90%|████████▉ | 454/507 [00:31<00:01, 37.20it/s]
Loading 0:  90%|█████████ | 458/507 [00:34<00:08,  5.96it/s]
Loading 0:  91%|█████████ | 461/507 [00:34<00:06,  7.10it/s]
Loading 0:  92%|█████████▏| 465/507 [00:34<00:04,  8.87it/s]
Loading 0:  93%|█████████▎| 470/507 [00:34<00:03, 12.18it/s]
Loading 0:  93%|█████████▎| 474/507 [00:34<00:02, 13.76it/s]
Loading 0:  94%|█████████▍| 479/507 [00:34<00:01, 17.85it/s]
Loading 0:  95%|█████████▌| 483/507 [00:35<00:01, 18.75it/s]
Loading 0:  96%|█████████▋| 488/507 [00:35<00:00, 23.37it/s]
Loading 0:  97%|█████████▋| 492/507 [00:35<00:00, 22.60it/s]
Loading 0:  98%|█████████▊| 497/507 [00:35<00:00, 27.15it/s]
Loading 0:  99%|█████████▉| 501/507 [00:35<00:00, 25.79it/s]
                                                            

Job zonemercy-vingt-deux-v2-1e5-v11-mkmlizer completed after 135.93s with status: succeeded
Stopping job with name zonemercy-vingt-deux-v2-1e5-v11-mkmlizer
Pipeline stage MKMLizer completed in 139.78s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.31s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-vingt-deux-v2-1e5-v11
Waiting for inference service zonemercy-vingt-deux-v2-1e5-v11 to be ready
Failed to get response for submission zonemercy-vingt-deux-v2-1e5_v2: ('http://zonemercy-vingt-deux-v2-1e5-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission zonemercy-vingt-deux-v2-1e5_v2: ('http://zonemercy-vingt-deux-v2-1e5-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-v1-1e5_v9: ('http://zonemercy-vingt-deux-v1-1e5-v9-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission zonemercy-vingt-deux-v1-1e5_v9: ('http://zonemercy-vingt-deux-v1-1e5-v9-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-v1-_8973_v1: ('http://zonemercy-vingt-deux-v1-8973-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-v2-1e5_v2: ('http://zonemercy-vingt-deux-v2-1e5-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission zonemercy-vingt-deux-v1-1e5_v9: ('http://zonemercy-vingt-deux-v1-1e5-v9-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission zonemercy-vingt-deux-v2-1e5_v2: ('http://zonemercy-vingt-deux-v2-1e5-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission zonemercy-vingt-deux-v1-_8973_v1: ('http://zonemercy-vingt-deux-v1-8973-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission zonemercy-vingt-deux-v2-1e5_v2: ('http://zonemercy-vingt-deux-v2-1e5-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission zonemercy-vingt-deux-v1-1e5_v9: ('http://zonemercy-vingt-deux-v1-1e5-v9-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service zonemercy-vingt-deux-v2-1e5-v11 ready after 284.2841455936432s
Pipeline stage MKMLDeployer completed in 284.87s
run pipeline stage %s
Running pipeline stage StressChecker
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 5.912835359573364s
Received healthy response to inference request in 2.900855779647827s
Failed to get response for submission zonemercy-vingt-deux-v1-1e5_v9: ('http://zonemercy-vingt-deux-v1-1e5-v9-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Received healthy response to inference request in 2.987718343734741s
Received healthy response to inference request in 3.9852006435394287s
Failed to get response for submission zonemercy-vingt-deux-gfv_3432_v1: ('http://zonemercy-vingt-deux-gfv-3432-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 3.0745112895965576s
5 requests
0 failed requests
5th percentile: 2.91822829246521
10th percentile: 2.9356008052825926
20th percentile: 2.9703458309173585
30th percentile: 3.0050769329071043
40th percentile: 3.039794111251831
50th percentile: 3.0745112895965576
60th percentile: 3.438787031173706
70th percentile: 3.803062772750854
80th percentile: 4.3707275867462165
90th percentile: 5.14178147315979
95th percentile: 5.527308416366576
99th percentile: 5.8357299709320065
mean time: 3.772224283218384
%s, retrying in %s seconds...
Received healthy response to inference request in 3.2415928840637207s
Failed to get response for submission zonemercy-vingt-deux-v2-1e5_v2: ('http://zonemercy-vingt-deux-v2-1e5-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'activator request timeout')
Received healthy response to inference request in 3.098844528198242s
Received healthy response to inference request in 3.2450428009033203s
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission mistralai-mistral-nemo-_9330_v58: ('http://mistralai-mistral-nemo-9330-v58-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 3.7355093955993652s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.3391220569610596s
5 requests
0 failed requests
5th percentile: 3.127394199371338
10th percentile: 3.1559438705444336
20th percentile: 3.213043212890625
30th percentile: 3.2422828674316406
40th percentile: 3.2436628341674805
50th percentile: 3.2450428009033203
60th percentile: 3.282674503326416
70th percentile: 3.3203062057495116
80th percentile: 3.418399524688721
90th percentile: 3.576954460144043
95th percentile: 3.656231927871704
99th percentile: 3.719653902053833
mean time: 3.3320223331451415
Pipeline stage StressChecker completed in 41.45s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 11.63s
Shutdown handler de-registered
zonemercy-vingt-deux-v2-1e5_v11 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.20s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-vingt-deux-v2-1e5-v11-profiler
Waiting for inference service zonemercy-vingt-deux-v2-1e5-v11-profiler to be ready
Tearing down inference service zonemercy-vingt-deux-v2-1e5-v11-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-vingt-deux-v2-1e5-v11-profiler
Ignoring service zonemercy-vingt-deux-v2-1e5-v11-profiler already deployed
Waiting for inference service zonemercy-vingt-deux-v2-1e5-v11-profiler to be ready
Tearing down inference service zonemercy-vingt-deux-v2-1e5-v11-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-vingt-deux-v2-1e5-v11-profiler
Waiting for inference service zonemercy-vingt-deux-v2-1e5-v11-profiler to be ready
Tearing down inference service zonemercy-vingt-deux-v2-1e5-v11-profiler
clean up pipeline due to error=%s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.22s
Shutdown handler de-registered
zonemercy-vingt-deux-v2-1e5_v11 status is now inactive due to auto deactivation removed underperforming models
zonemercy-vingt-deux-v2-1e5_v11 status is now torndown due to DeploymentManager action