zonemercy-lexical-viral-_2744

developer_uid: chai_backend_admin
submission_id: zonemercy-lexical-viral-_2744_v8
model_name: tempv1-3
model_group: zonemercy/Lexical-Viral-
status: inactive
timestamp: 2024-11-21T15:17:57+00:00
num_battles: 12773
num_wins: 6672
celo_rating: 1269.37
family_friendly_score: 0.5964
family_friendly_standard_error: 0.006938400968522935
submission_type: basic
model_repo: zonemercy/Lexical-Viral-v6ava-22b11e5r256b005
model_architecture: MistralForCausalLM
model_num_parameters: 22247282688.0
best_of: 4
max_input_tokens: 1024
max_output_tokens: 64
latencies: [{'batch_size': 1, 'throughput': 0.39277971042401294, 'latency_mean': 2.5458616065979003, 'latency_p50': 2.530824661254883, 'latency_p90': 2.8286322593688964}, {'batch_size': 3, 'throughput': 0.8184275722134224, 'latency_mean': 3.653268814086914, 'latency_p50': 3.657130479812622, 'latency_p90': 4.010182332992554}, {'batch_size': 5, 'throughput': 1.0808396262306397, 'latency_mean': 4.586488080024719, 'latency_p50': 4.602334380149841, 'latency_p90': 5.132084846496582}, {'batch_size': 6, 'throughput': 1.1584464721471832, 'latency_mean': 5.141289032697678, 'latency_p50': 5.141034245491028, 'latency_p90': 5.799838614463806}, {'batch_size': 10, 'throughput': 1.3794935744235302, 'latency_mean': 7.181873301267624, 'latency_p50': 7.219284176826477, 'latency_p90': 8.073762655258179}]
gpu_counts: {'NVIDIA RTX A6000': 1}
display_name: tempv1-3
is_internal_developer: True
language_model: zonemercy/Lexical-Viral-v6ava-22b11e5r256b005
model_size: 22B
ranking_group: single
throughput_3p7s: 0.84
us_pacific_date: 2024-11-21
win_ratio: 0.5223518359038597
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-lexical-viral-2744-v8-mkmlizer
Waiting for job on zonemercy-lexical-viral-2744-v8-mkmlizer to finish
zonemercy-lexical-viral-1979-v14-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-lexical-viral-1979-v14-mkmlizer: ║     _____            __           __                                ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║       /___/                                                         ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  belonging to:                                                      ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-lexical-viral-1979-v14-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║     _____            __           __                                ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║       /___/                                                         ║
zonemercy-lexical-viral-1979-v14-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-lexical-viral-2744-v8-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  belonging to:                                                      ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-2744-v8-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-lexical-viral-1979-v14-mkmlizer: Downloaded to shared memory in 71.289s
zonemercy-lexical-viral-1979-v14-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp6v3_asr0, device:0
zonemercy-lexical-viral-1979-v14-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-lexical-viral-2744-v8-mkmlizer: Downloaded to shared memory in 68.437s
zonemercy-lexical-viral-2744-v8-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmppfpe65py, device:0
zonemercy-lexical-viral-2744-v8-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-lexical-viral-1979-v14-mkmlizer: quantized model in 47.345s
zonemercy-lexical-viral-1979-v14-mkmlizer: Processed model zonemercy/Lexical-Viral-v6ava-22b11e5r128 in 118.634s
zonemercy-lexical-viral-1979-v14-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-lexical-viral-1979-v14-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-lexical-viral-2744-v8-mkmlizer: quantized model in 46.619s
zonemercy-lexical-viral-1979-v14-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-lexical-viral-1979-v14
zonemercy-lexical-viral-2744-v8-mkmlizer: Processed model zonemercy/Lexical-Viral-v6ava-22b11e5r256b005 in 115.056s
zonemercy-lexical-viral-1979-v14-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-lexical-viral-1979-v14/special_tokens_map.json
zonemercy-lexical-viral-2744-v8-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-lexical-viral-1979-v14-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-1979-v14/config.json
zonemercy-lexical-viral-2744-v8-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-lexical-viral-2744-v8-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-lexical-viral-2744-v8
zonemercy-lexical-viral-2744-v8-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-2744-v8/config.json
zonemercy-lexical-viral-2744-v8-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-lexical-viral-2744-v8/special_tokens_map.json
zonemercy-lexical-viral-2744-v8-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-2744-v8/tokenizer_config.json
zonemercy-lexical-viral-1979-v14-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-1979-v14/flywheel_model.1.safetensors
zonemercy-lexical-viral-1979-v14-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-1979-v14/flywheel_model.0.safetensors
zonemercy-lexical-viral-2744-v8-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-2744-v8/flywheel_model.1.safetensors
zonemercy-lexical-viral-2744-v8-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-2744-v8/flywheel_model.0.safetensors
zonemercy-lexical-viral-2744-v8-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/507 [00:00<00:21, 23.49it/s]
Loading 0:   2%|▏         | 10/507 [00:00<00:15, 32.60it/s]
Loading 0:   3%|▎         | 14/507 [00:00<00:17, 28.03it/s]
Loading 0:   4%|▎         | 19/507 [00:00<00:14, 33.14it/s]
Loading 0:   5%|▍         | 23/507 [00:00<00:16, 29.55it/s]
Loading 0:   6%|▌         | 28/507 [00:00<00:14, 32.66it/s]
Loading 0:   6%|▋         | 32/507 [00:01<00:15, 29.76it/s]
Loading 0:   7%|▋         | 38/507 [00:01<00:12, 36.96it/s]
Loading 0:   8%|▊         | 43/507 [00:01<00:13, 34.37it/s]
Loading 0:   9%|▉         | 47/507 [00:01<00:13, 34.02it/s]
Loading 0:  10%|█         | 51/507 [00:01<00:13, 33.13it/s]
Loading 0:  11%|█         | 55/507 [00:01<00:20, 22.34it/s]
Loading 0:  11%|█▏        | 58/507 [00:02<00:19, 23.11it/s]
Loading 0:  12%|█▏        | 63/507 [00:02<00:16, 26.86it/s]
Loading 0:  13%|█▎        | 67/507 [00:02<00:16, 26.56it/s]
Loading 0:  14%|█▍        | 70/507 [00:02<00:16, 26.72it/s]
Loading 0:  15%|█▍        | 75/507 [00:02<00:14, 30.27it/s]
Loading 0:  16%|█▌        | 80/507 [00:02<00:14, 30.05it/s]
Loading 0:  17%|█▋        | 85/507 [00:02<00:12, 33.33it/s]
Loading 0:  18%|█▊        | 89/507 [00:03<00:14, 29.63it/s]
Loading 0:  19%|█▊        | 94/507 [00:03<00:12, 33.15it/s]
Loading 0:  19%|█▉        | 98/507 [00:03<00:14, 28.96it/s]
Loading 0:  20%|██        | 103/507 [00:03<00:12, 32.73it/s]
Loading 0:  21%|██        | 107/507 [00:03<00:13, 28.97it/s]
Loading 0:  22%|██▏       | 112/507 [00:03<00:12, 31.43it/s]
Loading 0:  23%|██▎       | 116/507 [00:04<00:18, 21.24it/s]
Loading 0:  24%|██▍       | 122/507 [00:04<00:16, 23.85it/s]
Loading 0:  25%|██▌       | 127/507 [00:04<00:13, 27.95it/s]
Loading 0:  26%|██▌       | 131/507 [00:04<00:14, 26.04it/s]
Loading 0:  27%|██▋       | 136/507 [00:04<00:12, 30.14it/s]
Loading 0:  28%|██▊       | 140/507 [00:04<00:13, 27.73it/s]
Loading 0:  29%|██▊       | 145/507 [00:04<00:11, 31.60it/s]
Loading 0:  29%|██▉       | 149/507 [00:05<00:12, 28.37it/s]
Loading 0:  30%|███       | 154/507 [00:05<00:10, 32.13it/s]
Loading 0:  31%|███       | 158/507 [00:05<00:11, 29.82it/s]
Loading 0:  32%|███▏      | 163/507 [00:05<00:10, 34.30it/s]
Loading 0:  33%|███▎      | 168/507 [00:05<00:09, 34.50it/s]
Loading 0:  34%|███▍      | 172/507 [00:05<00:14, 23.23it/s]
Loading 0:  35%|███▍      | 176/507 [00:06<00:14, 23.30it/s]
Loading 0:  36%|███▌      | 181/507 [00:06<00:11, 27.78it/s]
Loading 0:  36%|███▋      | 185/507 [00:06<00:11, 27.13it/s]
Loading 0:  37%|███▋      | 190/507 [00:06<00:10, 31.66it/s]
Loading 0:  38%|███▊      | 194/507 [00:06<00:10, 29.72it/s]
Loading 0:  39%|███▉      | 199/507 [00:06<00:09, 34.20it/s]
Loading 0:  40%|████      | 203/507 [00:06<00:09, 31.25it/s]
Loading 0:  41%|████      | 208/507 [00:07<00:08, 35.56it/s]
Loading 0:  42%|████▏     | 212/507 [00:07<00:09, 31.37it/s]
Loading 0:  43%|████▎     | 217/507 [00:07<00:08, 35.70it/s]
Loading 0:  44%|████▎     | 221/507 [00:07<00:08, 31.99it/s]
Loading 0:  44%|████▍     | 225/507 [00:07<00:12, 22.48it/s]
Loading 0:  45%|████▌     | 230/507 [00:07<00:11, 24.26it/s]
Loading 0:  46%|████▋     | 235/507 [00:08<00:09, 28.31it/s]
Loading 0:  47%|████▋     | 239/507 [00:08<00:10, 26.58it/s]
Loading 0:  48%|████▊     | 244/507 [00:08<00:08, 31.11it/s]
Loading 0:  49%|████▉     | 248/507 [00:08<00:09, 28.25it/s]
Loading 0:  50%|████▉     | 253/507 [00:08<00:07, 32.73it/s]
Loading 0:  51%|█████     | 257/507 [00:08<00:08, 29.70it/s]
Loading 0:  52%|█████▏    | 262/507 [00:08<00:07, 33.27it/s]
Loading 0:  52%|█████▏    | 266/507 [00:09<00:08, 29.00it/s]
Loading 0:  53%|█████▎    | 271/507 [00:09<00:07, 32.47it/s]
Loading 0:  54%|█████▍    | 275/507 [00:09<00:07, 29.21it/s]
Loading 0:  55%|█████▌    | 280/507 [00:09<00:06, 33.14it/s]
Loading 0:  56%|█████▌    | 284/507 [00:09<00:09, 24.75it/s]
Loading 0:  57%|█████▋    | 287/507 [00:09<00:09, 22.70it/s]
Loading 0:  58%|█████▊    | 293/507 [00:10<00:08, 25.60it/s]
Loading 0:  59%|█████▉    | 298/507 [00:10<00:07, 29.63it/s]
Loading 0:  59%|█████▉    | 299/507 [00:24<00:07, 29.63it/s]
Loading 0:  59%|█████▉    | 300/507 [00:24<04:00,  1.16s/it]
Loading 0:  60%|█████▉    | 302/507 [00:25<03:17,  1.04it/s]
Loading 0:  61%|██████    | 307/507 [00:25<02:00,  1.66it/s]
Loading 0:  61%|██████    | 310/507 [00:25<01:31,  2.16it/s]
Loading 0:  62%|██████▏   | 313/507 [00:25<01:07,  2.86it/s]
Loading 0:  63%|██████▎   | 318/507 [00:25<00:42,  4.45it/s]
Loading 0:  63%|██████▎   | 321/507 [00:25<00:33,  5.55it/s]
Loading 0:  64%|██████▍   | 325/507 [00:25<00:23,  7.67it/s]
Loading 0:  65%|██████▍   | 329/507 [00:26<00:18,  9.75it/s]
Loading 0:  66%|██████▌   | 334/507 [00:26<00:12, 13.61it/s]
Loading 0:  67%|██████▋   | 339/507 [00:26<00:09, 17.55it/s]
Loading 0:  68%|██████▊   | 343/507 [00:26<00:10, 16.12it/s]
Loading 0:  68%|██████▊   | 347/507 [00:26<00:09, 17.66it/s]
Loading 0:  69%|██████▉   | 352/507 [00:26<00:06, 22.45it/s]
Loading 0:  70%|███████   | 356/507 [00:27<00:06, 22.64it/s]
Loading 0:  71%|███████   | 361/507 [00:27<00:05, 27.18it/s]
Loading 0:  72%|███████▏  | 365/507 [00:27<00:05, 25.48it/s]
Loading 0:  73%|███████▎  | 370/507 [00:27<00:04, 30.06it/s]
Loading 0:  74%|███████▍  | 374/507 [00:27<00:04, 27.79it/s]
Loading 0:  75%|███████▍  | 379/507 [00:27<00:03, 32.22it/s]
Loading 0:  76%|███████▌  | 383/507 [00:27<00:04, 28.77it/s]
Loading 0:  77%|███████▋  | 389/507 [00:28<00:03, 33.66it/s]
Loading 0:  78%|███████▊  | 393/507 [00:28<00:03, 32.83it/s]
Loading 0:  78%|███████▊  | 397/507 [00:28<00:04, 24.22it/s]
Loading 0:  79%|███████▉  | 401/507 [00:28<00:04, 23.87it/s]
Loading 0:  80%|████████  | 406/507 [00:28<00:03, 28.15it/s]
Loading 0:  81%|████████  | 410/507 [00:28<00:03, 26.08it/s]
Loading 0:  82%|████████▏ | 415/507 [00:29<00:03, 30.13it/s]
Loading 0:  83%|████████▎ | 419/507 [00:29<00:03, 27.59it/s]
Loading 0:  84%|████████▎ | 424/507 [00:29<00:02, 31.48it/s]
Loading 0:  84%|████████▍ | 428/507 [00:29<00:02, 28.52it/s]
Loading 0:  85%|████████▌ | 433/507 [00:29<00:02, 32.75it/s]
Loading 0:  86%|████████▌ | 437/507 [00:29<00:02, 29.44it/s]
Loading 0:  87%|████████▋ | 442/507 [00:29<00:01, 33.81it/s]
Loading 0:  88%|████████▊ | 446/507 [00:30<00:02, 29.57it/s]
Loading 0:  89%|████████▉ | 451/507 [00:30<00:01, 33.92it/s]
Loading 0:  90%|████████▉ | 455/507 [00:32<00:09,  5.43it/s]
Loading 0:  91%|█████████ | 459/507 [00:32<00:06,  6.96it/s]
Loading 0:  92%|█████████▏| 465/507 [00:32<00:04,  9.91it/s]
Loading 0:  93%|█████████▎| 472/507 [00:33<00:02, 14.45it/s]
Loading 0:  94%|█████████▍| 476/507 [00:33<00:01, 16.01it/s]
Loading 0:  95%|█████████▍| 481/507 [00:33<00:01, 19.42it/s]
Loading 0:  96%|█████████▌| 485/507 [00:33<00:01, 21.12it/s]
Loading 0:  96%|█████████▋| 489/507 [00:33<00:00, 24.16it/s]
Loading 0:  97%|█████████▋| 493/507 [00:33<00:00, 23.83it/s]
Loading 0:  98%|█████████▊| 497/507 [00:33<00:00, 26.64it/s]
Loading 0:  99%|█████████▉| 501/507 [00:34<00:00, 25.97it/s]
Loading 0: 100%|█████████▉| 506/507 [00:34<00:00, 30.80it/s]
                                                            
Job zonemercy-lexical-viral-1979-v14-mkmlizer completed after 159.56s with status: succeeded
Stopping job with name zonemercy-lexical-viral-1979-v14-mkmlizer
Job zonemercy-lexical-viral-2744-v8-mkmlizer completed after 158.4s with status: succeeded
Pipeline stage MKMLizer completed in 160.44s
Stopping job with name zonemercy-lexical-viral-2744-v8-mkmlizer
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLizer completed in 159.28s
run pipeline stage %s
Pipeline stage MKMLTemplater completed in 0.28s
Running pipeline stage MKMLTemplater
run pipeline stage %s
Running pipeline stage MKMLDeployer
Pipeline stage MKMLTemplater completed in 0.29s
run pipeline stage %s
Creating inference service zonemercy-lexical-viral-1979-v14
Running pipeline stage MKMLDeployer
Waiting for inference service zonemercy-lexical-viral-1979-v14 to be ready
Creating inference service zonemercy-lexical-viral-2744-v8
Waiting for inference service zonemercy-lexical-viral-2744-v8 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service zonemercy-lexical-viral-2744-v8 ready after 220.8380308151245s
Pipeline stage MKMLDeployer completed in 221.86s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.663408041000366s
Received healthy response to inference request in 2.6316187381744385s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.2360427379608154s
Inference service zonemercy-lexical-viral-1979-v14 ready after 230.8933937549591s
Pipeline stage MKMLDeployer completed in 231.91s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4163014888763428s
Received healthy response to inference request in 2.6959891319274902s
Received healthy response to inference request in 2.757742166519165s
5 requests
0 failed requests
5th percentile: 2.272094488143921
10th percentile: 2.3081462383270264
20th percentile: 2.3802497386932373
30th percentile: 2.4593649387359617
40th percentile: 2.5454918384552
50th percentile: 2.6316187381744385
60th percentile: 2.6443344593048095
Received healthy response to inference request in 2.910633087158203s
70th percentile: 2.6570501804351805
80th percentile: 2.682274866104126
90th percentile: 2.7200085163116454
95th percentile: 2.7388753414154055
99th percentile: 2.753968801498413
mean time: 2.5410226345062257
Pipeline stage StressChecker completed in 16.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 4.804646015167236s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 2.2248663902282715s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 6.05s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 2.5803565979003906s
5 requests
0 failed requests
5th percentile: 2.2959644317626955
10th percentile: 2.367062473297119
20th percentile: 2.5092585563659666
30th percentile: 2.6034831047058105
triggered trigger_guanaco_pipeline args=%s
40th percentile: 2.6497361183166506
Pipeline stage TriggerMKMLProfilingPipeline completed in 4.21s
50th percentile: 2.6959891319274902
Shutdown handler de-registered
60th percentile: 2.7818467140197756
zonemercy-lexical-viral-_2744_v8 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3343.32s
Shutdown handler de-registered
zonemercy-lexical-viral-_2744_v8 status is now inactive due to auto deactivation removed underperforming models