zonemercy-lexical-viral-_8360

developer_uid: chai_backend_admin
submission_id: zonemercy-lexical-viral-_8360_v3
model_name: tempv1-1
model_group: zonemercy/Lexical-Viral-
status: torndown
timestamp: 2024-11-01T21:41:06+00:00
num_battles: 11708
num_wins: 5991
celo_rating: 1255.13
family_friendly_score: 0.563
family_friendly_standard_error: 0.007014713108887633
submission_type: basic
model_repo: zonemercy/Lexical-Viral-v1avb-22b11e5
model_architecture: MistralForCausalLM
model_num_parameters: 22247282688.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: tempv1-1
is_internal_developer: True
language_model: zonemercy/Lexical-Viral-v1avb-22b11e5
model_size: 22B
ranking_group: single
us_pacific_date: 2024-11-01
win_ratio: 0.5117014007516228
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-lexical-viral-8360-v3-mkmlizer
Waiting for job on zonemercy-lexical-viral-8360-v3-mkmlizer to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-lexical-viral-1953-v5-mkmlizer
Waiting for job on zonemercy-lexical-viral-1953-v5-mkmlizer to finish
zonemercy-lexical-viral-8360-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-lexical-viral-8360-v3-mkmlizer: ║     _____            __           __                                ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║       /___/                                                         ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  belonging to:                                                      ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-8360-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-lexical-viral-1953-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-lexical-viral-1953-v5-mkmlizer: ║     _____            __           __                                ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║       /___/                                                         ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  belonging to:                                                      ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-1953-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-lexical-viral-1953-v5-mkmlizer: Downloaded to shared memory in 61.486s
zonemercy-lexical-viral-1953-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpcwm_icwg, device:0
zonemercy-lexical-viral-1953-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-lexical-viral-8360-v3-mkmlizer: Downloaded to shared memory in 77.256s
zonemercy-lexical-viral-8360-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpkgizd9ny, device:0
zonemercy-lexical-viral-8360-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-lexical-viral-1953-v5-mkmlizer: quantized model in 44.706s
zonemercy-lexical-viral-1953-v5-mkmlizer: Processed model zonemercy/Lexical-Viral-v3ava-22b11e5 in 106.193s
zonemercy-lexical-viral-1953-v5-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-lexical-viral-1953-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-lexical-viral-1953-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-lexical-viral-1953-v5
zonemercy-lexical-viral-1953-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-1953-v5/config.json
zonemercy-lexical-viral-1953-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-lexical-viral-1953-v5/special_tokens_map.json
zonemercy-lexical-viral-1953-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-1953-v5/tokenizer_config.json
zonemercy-lexical-viral-1953-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-lexical-viral-1953-v5/tokenizer.json
zonemercy-lexical-viral-8360-v3-mkmlizer: quantized model in 44.821s
zonemercy-lexical-viral-8360-v3-mkmlizer: Processed model zonemercy/Lexical-Viral-v1avb-22b11e5 in 122.077s
zonemercy-lexical-viral-8360-v3-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-lexical-viral-1953-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-1953-v5/flywheel_model.1.safetensors
zonemercy-lexical-viral-1953-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-1953-v5/flywheel_model.0.safetensors
zonemercy-lexical-viral-1953-v5-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/507 [00:00<00:19, 26.33it/s]
Loading 0:   2%|▏         | 12/507 [00:00<00:12, 40.94it/s]
Loading 0:   3%|▎         | 17/507 [00:00<00:12, 38.31it/s]
Loading 0:   4%|▍         | 22/507 [00:00<00:12, 38.77it/s]
Loading 0:   5%|▌         | 26/507 [00:00<00:12, 37.39it/s]
Loading 0:   6%|▌         | 30/507 [00:00<00:12, 38.03it/s]
Loading 0:   7%|▋         | 34/507 [00:00<00:13, 35.88it/s]
Loading 0:   8%|▊         | 39/507 [00:01<00:12, 38.93it/s]
Loading 0:   8%|▊         | 43/507 [00:01<00:12, 36.10it/s]
Loading 0:   9%|▉         | 47/507 [00:01<00:13, 35.34it/s]
Loading 0:  10%|█         | 51/507 [00:01<00:13, 34.86it/s]
Loading 0:  11%|█         | 55/507 [00:01<00:18, 23.95it/s]
Loading 0:  11%|█▏        | 58/507 [00:01<00:18, 24.85it/s]
Loading 0:  12%|█▏        | 63/507 [00:01<00:15, 28.78it/s]
Loading 0:  13%|█▎        | 67/507 [00:02<00:15, 29.28it/s]
Loading 0:  14%|█▍        | 72/507 [00:02<00:12, 33.69it/s]
Loading 0:  15%|█▌        | 78/507 [00:02<00:11, 37.98it/s]
Loading 0:  16%|█▌        | 82/507 [00:02<00:11, 35.53it/s]
Loading 0:  17%|█▋        | 87/507 [00:02<00:11, 37.00it/s]
Loading 0:  18%|█▊        | 91/507 [00:02<00:11, 35.01it/s]
Loading 0:  19%|█▉        | 96/507 [00:02<00:11, 35.65it/s]
Loading 0:  20%|█▉        | 100/507 [00:02<00:11, 34.44it/s]
Loading 0:  21%|██        | 105/507 [00:03<00:10, 37.57it/s]
Loading 0:  21%|██▏       | 109/507 [00:03<00:11, 35.95it/s]
Loading 0:  22%|██▏       | 113/507 [00:03<00:14, 27.21it/s]
Loading 0:  23%|██▎       | 117/507 [00:03<00:14, 26.44it/s]
Loading 0:  24%|██▍       | 122/507 [00:03<00:14, 26.39it/s]
Loading 0:  25%|██▌       | 129/507 [00:03<00:11, 33.35it/s]
Loading 0:  26%|██▌       | 133/507 [00:04<00:11, 33.44it/s]
Loading 0:  27%|██▋       | 138/507 [00:04<00:10, 36.88it/s]
Loading 0:  28%|██▊       | 142/507 [00:04<00:10, 35.41it/s]
Loading 0:  29%|██▉       | 147/507 [00:04<00:09, 38.60it/s]
Loading 0:  30%|██▉       | 152/507 [00:04<00:09, 37.61it/s]
Loading 0:  31%|███       | 157/507 [00:04<00:09, 38.33it/s]
Loading 0:  32%|███▏      | 161/507 [00:04<00:09, 36.77it/s]
Loading 0:  33%|███▎      | 165/507 [00:04<00:09, 37.53it/s]
Loading 0:  33%|███▎      | 169/507 [00:05<00:11, 28.26it/s]
Loading 0:  34%|███▍      | 173/507 [00:05<00:11, 28.54it/s]
Loading 0:  35%|███▍      | 177/507 [00:05<00:12, 26.57it/s]
Loading 0:  36%|███▌      | 181/507 [00:05<00:11, 28.87it/s]
Loading 0:  36%|███▋      | 185/507 [00:05<00:11, 27.10it/s]
Loading 0:  37%|███▋      | 190/507 [00:05<00:09, 31.72it/s]
Loading 0:  38%|███▊      | 194/507 [00:05<00:10, 29.63it/s]
Loading 0:  39%|███▉      | 199/507 [00:06<00:09, 33.48it/s]
Loading 0:  40%|████      | 203/507 [00:06<00:09, 30.51it/s]
Loading 0:  41%|████      | 208/507 [00:06<00:08, 34.53it/s]
Loading 0:  42%|████▏     | 212/507 [00:06<00:09, 30.88it/s]
Loading 0:  43%|████▎     | 217/507 [00:06<00:08, 35.02it/s]
Loading 0:  44%|████▎     | 221/507 [00:06<00:09, 31.63it/s]
Loading 0:  44%|████▍     | 225/507 [00:07<00:12, 22.89it/s]
Loading 0:  45%|████▌     | 230/507 [00:07<00:11, 24.45it/s]
Loading 0:  47%|████▋     | 236/507 [00:07<00:08, 31.16it/s]
Loading 0:  47%|████▋     | 240/507 [00:07<00:08, 29.81it/s]
Loading 0:  49%|████▊     | 246/507 [00:07<00:07, 34.72it/s]
Loading 0:  49%|████▉     | 250/507 [00:07<00:07, 34.07it/s]
Loading 0:  50%|█████     | 255/507 [00:07<00:06, 36.37it/s]
Loading 0:  51%|█████     | 259/507 [00:07<00:07, 35.25it/s]
Loading 0:  52%|█████▏    | 264/507 [00:08<00:06, 37.65it/s]
Loading 0:  53%|█████▎    | 268/507 [00:08<00:06, 35.53it/s]
Loading 0:  54%|█████▍    | 273/507 [00:08<00:06, 36.82it/s]
Loading 0:  55%|█████▍    | 277/507 [00:08<00:06, 34.94it/s]
Loading 0:  56%|█████▌    | 283/507 [00:08<00:05, 37.75it/s]
Loading 0:  57%|█████▋    | 287/507 [00:08<00:08, 25.17it/s]
Loading 0:  58%|█████▊    | 293/507 [00:09<00:07, 27.74it/s]
Loading 0:  59%|█████▉    | 299/507 [00:23<00:07, 27.74it/s]
Loading 0:  59%|█████▉    | 300/507 [00:23<02:47,  1.23it/s]
Loading 0:  60%|█████▉    | 302/507 [00:24<02:26,  1.40it/s]
Loading 0:  61%|██████    | 307/507 [00:24<01:39,  2.02it/s]
Loading 0:  61%|██████    | 310/507 [00:24<01:18,  2.50it/s]
Loading 0:  62%|██████▏   | 313/507 [00:24<01:00,  3.19it/s]
Loading 0:  63%|██████▎   | 318/507 [00:24<00:39,  4.77it/s]
Loading 0:  64%|██████▎   | 322/507 [00:24<00:29,  6.27it/s]
Loading 0:  64%|██████▍   | 327/507 [00:24<00:20,  8.85it/s]
Loading 0:  65%|██████▌   | 331/507 [00:24<00:16, 10.98it/s]
Loading 0:  66%|██████▌   | 335/507 [00:25<00:12, 13.58it/s]
Loading 0:  67%|██████▋   | 340/507 [00:25<00:10, 15.38it/s]
Loading 0:  68%|██████▊   | 343/507 [00:25<00:09, 16.57it/s]
Loading 0:  68%|██████▊   | 347/507 [00:25<00:08, 18.24it/s]
Loading 0:  70%|██████▉   | 354/507 [00:25<00:05, 25.59it/s]
Loading 0:  71%|███████   | 358/507 [00:25<00:05, 26.65it/s]
Loading 0:  72%|███████▏  | 363/507 [00:25<00:04, 30.47it/s]
Loading 0:  72%|███████▏  | 367/507 [00:26<00:04, 30.37it/s]
Loading 0:  73%|███████▎  | 372/507 [00:26<00:04, 33.67it/s]
Loading 0:  74%|███████▍  | 376/507 [00:26<00:04, 32.71it/s]
Loading 0:  75%|███████▌  | 381/507 [00:26<00:03, 35.23it/s]
Loading 0:  76%|███████▌  | 385/507 [00:26<00:03, 33.29it/s]
Loading 0:  77%|███████▋  | 389/507 [00:26<00:03, 33.82it/s]
Loading 0:  78%|███████▊  | 393/507 [00:26<00:03, 33.08it/s]
Loading 0:  78%|███████▊  | 397/507 [00:27<00:04, 25.92it/s]
Loading 0:  79%|███████▉  | 401/507 [00:27<00:04, 25.56it/s]
Loading 0:  80%|████████  | 408/507 [00:27<00:03, 32.67it/s]
Loading 0:  81%|████████▏ | 412/507 [00:27<00:03, 31.63it/s]
Loading 0:  82%|████████▏ | 417/507 [00:27<00:02, 33.58it/s]
Loading 0:  83%|████████▎ | 421/507 [00:27<00:02, 32.10it/s]
Loading 0:  84%|████████▍ | 426/507 [00:27<00:02, 34.60it/s]
Loading 0:  85%|████████▍ | 430/507 [00:28<00:02, 33.15it/s]
Loading 0:  86%|████████▌ | 435/507 [00:28<00:02, 35.27it/s]
Loading 0:  87%|████████▋ | 439/507 [00:28<00:02, 33.88it/s]
Loading 0:  88%|████████▊ | 444/507 [00:28<00:01, 35.93it/s]
Loading 0:  88%|████████▊ | 448/507 [00:28<00:01, 34.34it/s]
Loading 0:  89%|████████▉ | 453/507 [00:28<00:01, 37.47it/s]
Loading 0:  90%|█████████ | 457/507 [00:30<00:08,  5.71it/s]
Loading 0:  91%|█████████ | 460/507 [00:31<00:06,  6.87it/s]
Loading 0:  92%|█████████▏| 465/507 [00:31<00:04,  9.28it/s]
Loading 0:  93%|█████████▎| 472/507 [00:31<00:02, 14.12it/s]
Loading 0:  94%|█████████▍| 476/507 [00:31<00:01, 16.41it/s]
Loading 0:  95%|█████████▍| 481/507 [00:31<00:01, 20.32it/s]
Loading 0:  96%|█████████▌| 485/507 [00:31<00:00, 22.52it/s]
Loading 0:  97%|█████████▋| 490/507 [00:31<00:00, 25.86it/s]
Loading 0:  97%|█████████▋| 494/507 [00:32<00:00, 26.84it/s]
Loading 0:  98%|█████████▊| 499/507 [00:32<00:00, 30.14it/s]
Loading 0:  99%|█████████▉| 503/507 [00:32<00:00, 22.77it/s]
                                                            
Job zonemercy-lexical-viral-1953-v5-mkmlizer completed after 137.28s with status: succeeded
Stopping job with name zonemercy-lexical-viral-1953-v5-mkmlizer
Pipeline stage MKMLizer completed in 138.15s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.23s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-lexical-viral-1953-v5
Waiting for inference service zonemercy-lexical-viral-1953-v5 to be ready
zonemercy-lexical-viral-8360-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-lexical-viral-8360-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-lexical-viral-8360-v3
zonemercy-lexical-viral-8360-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-8360-v3/config.json
zonemercy-lexical-viral-8360-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-lexical-viral-8360-v3/special_tokens_map.json
zonemercy-lexical-viral-8360-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-8360-v3/tokenizer_config.json
zonemercy-lexical-viral-8360-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-lexical-viral-8360-v3/tokenizer.json
zonemercy-lexical-viral-8360-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-8360-v3/flywheel_model.1.safetensors
zonemercy-lexical-viral-8360-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-8360-v3/flywheel_model.0.safetensors
zonemercy-lexical-viral-8360-v3-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/507 [00:00<00:21, 22.89it/s]
Loading 0:   2%|▏         | 10/507 [00:00<00:15, 32.53it/s]
Loading 0:   3%|▎         | 14/507 [00:00<00:17, 27.88it/s]
Loading 0:   4%|▎         | 19/507 [00:00<00:15, 32.08it/s]
Loading 0:   5%|▍         | 23/507 [00:00<00:17, 28.02it/s]
Loading 0:   6%|▌         | 28/507 [00:00<00:15, 31.59it/s]
Loading 0:   6%|▋         | 32/507 [00:01<00:17, 27.34it/s]
Loading 0:   7%|▋         | 37/507 [00:01<00:14, 31.78it/s]
Loading 0:   8%|▊         | 41/507 [00:01<00:16, 28.70it/s]
Loading 0:   9%|▉         | 46/507 [00:01<00:14, 32.81it/s]
Loading 0:  10%|▉         | 50/507 [00:01<00:15, 28.87it/s]
Loading 0:  11%|█         | 54/507 [00:02<00:22, 19.89it/s]
Loading 0:  11%|█         | 57/507 [00:02<00:21, 20.46it/s]
Loading 0:  12%|█▏        | 61/507 [00:02<00:18, 23.53it/s]
Loading 0:  13%|█▎        | 65/507 [00:02<00:19, 23.15it/s]
Loading 0:  14%|█▍        | 70/507 [00:02<00:15, 27.47it/s]
Loading 0:  15%|█▍        | 74/507 [00:02<00:15, 28.51it/s]
Loading 0:  16%|█▌        | 80/507 [00:02<00:14, 28.72it/s]
Loading 0:  17%|█▋        | 85/507 [00:03<00:13, 31.64it/s]
Loading 0:  18%|█▊        | 89/507 [00:03<00:14, 28.84it/s]
Loading 0:  19%|█▊        | 94/507 [00:03<00:12, 32.48it/s]
Loading 0:  19%|█▉        | 98/507 [00:03<00:13, 29.25it/s]
Loading 0:  20%|██        | 103/507 [00:03<00:12, 32.68it/s]
Loading 0:  21%|██        | 107/507 [00:03<00:14, 28.52it/s]
Loading 0:  22%|██▏       | 112/507 [00:03<00:12, 32.04it/s]
Loading 0:  23%|██▎       | 116/507 [00:04<00:18, 21.43it/s]
Loading 0:  24%|██▍       | 122/507 [00:04<00:14, 25.67it/s]
Loading 0:  25%|██▌       | 129/507 [00:04<00:11, 32.69it/s]
Loading 0:  26%|██▌       | 133/507 [00:04<00:11, 32.54it/s]
Loading 0:  27%|██▋       | 138/507 [00:04<00:10, 36.27it/s]
Loading 0:  28%|██▊       | 143/507 [00:04<00:09, 37.21it/s]
Loading 0:  29%|██▉       | 148/507 [00:05<00:09, 38.73it/s]
Loading 0:  30%|███       | 153/507 [00:05<00:08, 40.44it/s]
Loading 0:  31%|███       | 158/507 [00:05<00:10, 34.86it/s]
Loading 0:  32%|███▏      | 164/507 [00:05<00:08, 38.55it/s]
Loading 0:  33%|███▎      | 169/507 [00:05<00:11, 30.50it/s]
Loading 0:  34%|███▍      | 173/507 [00:05<00:11, 29.22it/s]
Loading 0:  35%|███▍      | 177/507 [00:06<00:12, 26.73it/s]
Loading 0:  36%|███▌      | 181/507 [00:06<00:11, 28.80it/s]
Loading 0:  36%|███▋      | 185/507 [00:06<00:11, 27.06it/s]
Loading 0:  37%|███▋      | 190/507 [00:06<00:10, 30.94it/s]
Loading 0:  38%|███▊      | 194/507 [00:06<00:11, 28.27it/s]
Loading 0:  39%|███▉      | 199/507 [00:06<00:09, 31.77it/s]
Loading 0:  40%|████      | 203/507 [00:06<00:10, 28.88it/s]
Loading 0:  41%|████      | 208/507 [00:07<00:09, 33.08it/s]
Loading 0:  42%|████▏     | 212/507 [00:07<00:09, 29.93it/s]
Loading 0:  43%|████▎     | 217/507 [00:07<00:08, 33.74it/s]
Loading 0:  44%|████▎     | 221/507 [00:07<00:09, 30.24it/s]
Loading 0:  44%|████▍     | 225/507 [00:07<00:12, 21.99it/s]
Loading 0:  45%|████▌     | 230/507 [00:07<00:11, 23.74it/s]
Loading 0:  46%|████▋     | 235/507 [00:08<00:09, 27.32it/s]
Loading 0:  47%|████▋     | 239/507 [00:08<00:10, 25.13it/s]
Loading 0:  48%|████▊     | 244/507 [00:08<00:09, 28.87it/s]
Loading 0:  49%|████▉     | 248/507 [00:08<00:09, 27.24it/s]
Loading 0:  50%|████▉     | 253/507 [00:08<00:08, 31.19it/s]
Loading 0:  51%|█████     | 257/507 [00:08<00:09, 27.47it/s]
Loading 0:  52%|█████▏    | 262/507 [00:08<00:08, 30.29it/s]
Loading 0:  52%|█████▏    | 266/507 [00:09<00:08, 27.39it/s]
Loading 0:  53%|█████▎    | 271/507 [00:09<00:07, 31.53it/s]
Loading 0:  54%|█████▍    | 275/507 [00:09<00:07, 29.61it/s]
Loading 0:  56%|█████▌    | 282/507 [00:09<00:05, 38.53it/s]
Loading 0:  57%|█████▋    | 287/507 [00:09<00:08, 25.33it/s]
Loading 0:  58%|█████▊    | 293/507 [00:10<00:07, 28.47it/s]
Loading 0:  59%|█████▉    | 299/507 [00:24<00:07, 28.47it/s]
Loading 0:  59%|█████▉    | 300/507 [00:24<02:38,  1.31it/s]
Loading 0:  60%|█████▉    | 302/507 [00:24<02:19,  1.47it/s]
Loading 0:  61%|██████    | 307/507 [00:24<01:35,  2.10it/s]
Loading 0:  61%|██████    | 310/507 [00:25<01:16,  2.59it/s]
Loading 0:  62%|██████▏   | 313/507 [00:25<00:59,  3.28it/s]
Loading 0:  63%|██████▎   | 318/507 [00:25<00:38,  4.88it/s]
Loading 0:  64%|██████▎   | 322/507 [00:25<00:28,  6.47it/s]
Loading 0:  64%|██████▍   | 327/507 [00:25<00:19,  9.16it/s]
Loading 0:  65%|██████▌   | 331/507 [00:25<00:15, 11.32it/s]
Loading 0:  66%|██████▌   | 335/507 [00:25<00:12, 14.14it/s]
Loading 0:  67%|██████▋   | 340/507 [00:26<00:10, 15.80it/s]
Loading 0:  68%|██████▊   | 344/507 [00:26<00:08, 18.44it/s]
Loading 0:  69%|██████▊   | 348/507 [00:26<00:07, 20.23it/s]
Loading 0:  70%|██████▉   | 354/507 [00:26<00:05, 26.15it/s]
Loading 0:  71%|███████   | 358/507 [00:26<00:05, 27.73it/s]
Loading 0:  72%|███████▏  | 363/507 [00:26<00:04, 32.16it/s]
Loading 0:  72%|███████▏  | 367/507 [00:26<00:04, 32.47it/s]
Loading 0:  73%|███████▎  | 372/507 [00:26<00:03, 35.81it/s]
Loading 0:  74%|███████▍  | 376/507 [00:26<00:03, 35.42it/s]
Loading 0:  75%|███████▌  | 381/507 [00:27<00:03, 38.57it/s]
Loading 0:  76%|███████▌  | 386/507 [00:27<00:03, 38.93it/s]
Loading 0:  77%|███████▋  | 391/507 [00:27<00:03, 34.44it/s]
Loading 0:  78%|███████▊  | 395/507 [00:27<00:04, 27.18it/s]
Loading 0:  79%|███████▉  | 401/507 [00:27<00:03, 28.40it/s]
Loading 0:  80%|████████  | 408/507 [00:27<00:02, 34.90it/s]
Loading 0:  81%|████████▏ | 412/507 [00:28<00:02, 34.73it/s]
Loading 0:  82%|████████▏ | 416/507 [00:28<00:02, 35.83it/s]
Loading 0:  83%|████████▎ | 420/507 [00:28<00:02, 32.55it/s]
Loading 0:  84%|████████▍ | 426/507 [00:28<00:02, 37.41it/s]
Loading 0:  85%|████████▍ | 430/507 [00:28<00:02, 36.62it/s]
Loading 0:  86%|████████▌ | 435/507 [00:28<00:01, 39.35it/s]
Loading 0:  87%|████████▋ | 440/507 [00:28<00:01, 39.40it/s]
Loading 0:  88%|████████▊ | 445/507 [00:28<00:01, 39.87it/s]
Loading 0:  89%|████████▉ | 450/507 [00:29<00:01, 41.59it/s]
Loading 0:  90%|████████▉ | 455/507 [00:31<00:07,  6.57it/s]
Loading 0:  91%|█████████ | 459/507 [00:31<00:05,  8.12it/s]
Loading 0:  92%|█████████▏| 465/507 [00:31<00:03, 11.25it/s]
Loading 0:  93%|█████████▎| 472/507 [00:31<00:02, 16.15it/s]
Loading 0:  94%|█████████▍| 477/507 [00:31<00:01, 19.01it/s]
Loading 0:  95%|█████████▌| 482/507 [00:31<00:01, 22.47it/s]
Loading 0:  96%|█████████▌| 486/507 [00:32<00:00, 25.12it/s]
Loading 0:  97%|█████████▋| 490/507 [00:32<00:00, 27.67it/s]
Loading 0:  97%|█████████▋| 494/507 [00:32<00:00, 29.09it/s]
Loading 0:  98%|█████████▊| 499/507 [00:32<00:00, 32.49it/s]
Loading 0:  99%|█████████▉| 503/507 [00:32<00:00, 32.76it/s]
                                                            
Job zonemercy-lexical-viral-8360-v3-mkmlizer completed after 167.92s with status: succeeded
Stopping job with name zonemercy-lexical-viral-8360-v3-mkmlizer
Pipeline stage MKMLizer completed in 168.61s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.27s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-lexical-viral-8360-v3
Waiting for inference service zonemercy-lexical-viral-8360-v3 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service zonemercy-lexical-viral-1953-v5 ready after 140.51342105865479s
Pipeline stage MKMLDeployer completed in 141.33s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1858394145965576s
Received healthy response to inference request in 2.5036802291870117s
Received healthy response to inference request in 2.9590132236480713s
Received healthy response to inference request in 2.4497525691986084s
Received healthy response to inference request in 2.48455810546875s
5 requests
0 failed requests
5th percentile: 2.4567136764526367
10th percentile: 2.463674783706665
20th percentile: 2.4775969982147217
30th percentile: 2.4883825302124025
40th percentile: 2.496031379699707
50th percentile: 2.5036802291870117
60th percentile: 2.6858134269714355
70th percentile: 2.8679466247558594
80th percentile: 3.0043784618377685
90th percentile: 3.0951089382171633
95th percentile: 3.1404741764068604
99th percentile: 3.1767663669586184
mean time: 2.7165687084198
Pipeline stage StressChecker completed in 16.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.45s
Shutdown handler de-registered
zonemercy-lexical-viral-_1953_v5 status is now deployed due to DeploymentManager action
Inference service zonemercy-lexical-viral-8360-v3 ready after 140.54002046585083s
Pipeline stage MKMLDeployer completed in 141.27s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.112961530685425s
Received healthy response to inference request in 2.433258533477783s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.6895811557769775s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.4226431846618652s
Received healthy response to inference request in 3.043374538421631s
5 requests
0 failed requests
5th percentile: 2.424766254425049
10th percentile: 2.4268893241882323
20th percentile: 2.4311354637145994
30th percentile: 2.484523057937622
40th percentile: 2.5870521068573
50th percentile: 2.6895811557769775
60th percentile: 2.831098508834839
70th percentile: 2.9726158618927
80th percentile: 3.05729193687439
90th percentile: 3.0851267337799073
95th percentile: 3.099044132232666
99th percentile: 3.110178050994873
mean time: 2.7403637886047365
Pipeline stage StressChecker completed in 15.40s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.32s
Shutdown handler de-registered
zonemercy-lexical-viral-_8360_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3211.88s
Shutdown handler de-registered
zonemercy-lexical-viral-_8360_v3 status is now inactive due to auto deactivation removed underperforming models
zonemercy-lexical-viral-_8360_v3 status is now torndown due to DeploymentManager action