zonemercy-lexical-viral_7348

developer_uid: chai_backend_admin
submission_id: zonemercy-lexical-viral_7348_v17
model_name: zonemercy-lexical-viral_7348_v17
model_group: zonemercy/Lexical-Viral-
status: inactive
timestamp: 2024-12-21T00:13:43+00:00
num_battles: 6813
num_wins: 3396
celo_rating: 1263.73
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: zonemercy/Lexical-Viral-v5ava-22b11e5r256
model_architecture: MistralForCausalLM
model_num_parameters: 22247282688.0
best_of: 8
max_input_tokens: 768
max_output_tokens: 64
display_name: zonemercy-lexical-viral_7348_v17
is_internal_developer: True
language_model: zonemercy/Lexical-Viral-v5ava-22b11e5r256
model_size: 22B
ranking_group: single
us_pacific_date: 2024-12-20
win_ratio: 0.49845882870981945
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 768, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-lexical-viral-7348-v17-mkmlizer
Waiting for job on zonemercy-lexical-viral-7348-v17-mkmlizer to finish
zonemercy-lexical-viral-7348-v17-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-lexical-viral-7348-v17-mkmlizer: ║     _____            __           __                                ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║       /___/                                                         ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  belonging to:                                                      ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-7348-v17-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-lexical-viral-7348-v17-mkmlizer: Downloaded to shared memory in 76.789s
zonemercy-lexical-viral-7348-v17-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp2t9693un, device:0
zonemercy-lexical-viral-7348-v17-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-lexical-viral-7348-v17-mkmlizer: quantized model in 45.651s
zonemercy-lexical-viral-7348-v17-mkmlizer: Processed model zonemercy/Lexical-Viral-v5ava-22b11e5r256 in 122.441s
zonemercy-lexical-viral-7348-v17-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-lexical-viral-7348-v17-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-lexical-viral-7348-v17-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-lexical-viral-7348-v17
zonemercy-lexical-viral-7348-v17-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-lexical-viral-7348-v17/special_tokens_map.json
zonemercy-lexical-viral-7348-v17-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-7348-v17/config.json
zonemercy-lexical-viral-7348-v17-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-7348-v17/tokenizer_config.json
zonemercy-lexical-viral-7348-v17-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-lexical-viral-7348-v17/tokenizer.json
zonemercy-lexical-viral-7348-v17-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-7348-v17/flywheel_model.1.safetensors
zonemercy-lexical-viral-7348-v17-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-7348-v17/flywheel_model.0.safetensors
zonemercy-lexical-viral-7348-v17-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/507 [00:00<00:22, 22.43it/s]
Loading 0:   2%|▏         | 10/507 [00:00<00:15, 32.78it/s]
Loading 0:   3%|▎         | 14/507 [00:00<00:17, 28.72it/s]
Loading 0:   4%|▍         | 21/507 [00:00<00:12, 37.51it/s]
Loading 0:   5%|▌         | 26/507 [00:00<00:13, 35.38it/s]
Loading 0:   6%|▌         | 30/507 [00:00<00:13, 35.15it/s]
Loading 0:   7%|▋         | 34/507 [00:01<00:14, 32.76it/s]
Loading 0:   8%|▊         | 39/507 [00:01<00:13, 35.10it/s]
Loading 0:   8%|▊         | 43/507 [00:01<00:14, 33.08it/s]
Loading 0:   9%|▉         | 47/507 [00:01<00:13, 32.93it/s]
Loading 0:  10%|█         | 51/507 [00:01<00:14, 32.27it/s]
Loading 0:  11%|█         | 55/507 [00:01<00:21, 21.01it/s]
Loading 0:  11%|█▏        | 58/507 [00:02<00:20, 22.14it/s]
Loading 0:  12%|█▏        | 63/507 [00:02<00:17, 26.01it/s]
Loading 0:  13%|█▎        | 66/507 [00:02<00:18, 24.03it/s]
Loading 0:  14%|█▍        | 70/507 [00:02<00:16, 27.07it/s]
Loading 0:  15%|█▍        | 75/507 [00:02<00:13, 31.43it/s]
Loading 0:  16%|█▌        | 80/507 [00:02<00:13, 30.61it/s]
Loading 0:  17%|█▋        | 85/507 [00:02<00:12, 34.40it/s]
Loading 0:  18%|█▊        | 89/507 [00:02<00:13, 30.82it/s]
Loading 0:  19%|█▊        | 95/507 [00:03<00:10, 37.51it/s]
Loading 0:  20%|█▉        | 100/507 [00:03<00:12, 33.21it/s]
Loading 0:  21%|██        | 105/507 [00:03<00:11, 34.47it/s]
Loading 0:  21%|██▏       | 109/507 [00:03<00:12, 33.02it/s]
Loading 0:  22%|██▏       | 113/507 [00:03<00:16, 24.18it/s]
Loading 0:  23%|██▎       | 116/507 [00:03<00:17, 22.42it/s]
Loading 0:  24%|██▍       | 122/507 [00:04<00:15, 25.53it/s]
Loading 0:  25%|██▌       | 127/507 [00:04<00:12, 30.20it/s]
Loading 0:  26%|██▌       | 131/507 [00:04<00:13, 28.14it/s]
Loading 0:  27%|██▋       | 138/507 [00:04<00:10, 35.09it/s]
Loading 0:  28%|██▊       | 142/507 [00:04<00:10, 33.54it/s]
Loading 0:  29%|██▉       | 147/507 [00:04<00:10, 35.69it/s]
Loading 0:  30%|██▉       | 151/507 [00:04<00:10, 33.42it/s]
Loading 0:  31%|███       | 156/507 [00:05<00:09, 35.31it/s]
Loading 0:  32%|███▏      | 160/507 [00:05<00:10, 33.80it/s]
Loading 0:  32%|███▏      | 164/507 [00:05<00:10, 33.47it/s]
Loading 0:  33%|███▎      | 168/507 [00:05<00:09, 34.75it/s]
Loading 0:  34%|███▍      | 172/507 [00:05<00:14, 23.24it/s]
Loading 0:  35%|███▍      | 176/507 [00:05<00:14, 23.06it/s]
Loading 0:  36%|███▌      | 183/507 [00:06<00:10, 30.73it/s]
Loading 0:  37%|███▋      | 187/507 [00:06<00:10, 31.04it/s]
Loading 0:  38%|███▊      | 192/507 [00:06<00:09, 33.78it/s]
Loading 0:  39%|███▊      | 196/507 [00:06<00:09, 32.28it/s]
Loading 0:  40%|███▉      | 201/507 [00:06<00:08, 35.10it/s]
Loading 0:  40%|████      | 205/507 [00:06<00:08, 33.77it/s]
Loading 0:  41%|████▏     | 210/507 [00:06<00:08, 36.22it/s]
Loading 0:  42%|████▏     | 214/507 [00:06<00:08, 34.55it/s]
Loading 0:  43%|████▎     | 218/507 [00:07<00:08, 34.04it/s]
Loading 0:  44%|████▍     | 222/507 [00:07<00:08, 33.36it/s]
Loading 0:  45%|████▍     | 226/507 [00:07<00:11, 23.98it/s]
Loading 0:  45%|████▌     | 230/507 [00:07<00:11, 24.00it/s]
Loading 0:  46%|████▋     | 235/507 [00:07<00:09, 28.80it/s]
Loading 0:  47%|████▋     | 239/507 [00:07<00:10, 26.71it/s]
Loading 0:  48%|████▊     | 244/507 [00:08<00:08, 30.81it/s]
Loading 0:  49%|████▉     | 248/507 [00:08<00:09, 28.26it/s]
Loading 0:  50%|████▉     | 253/507 [00:08<00:07, 32.51it/s]
Loading 0:  51%|█████     | 257/507 [00:08<00:08, 29.40it/s]
Loading 0:  52%|█████▏    | 262/507 [00:08<00:07, 33.71it/s]
Loading 0:  52%|█████▏    | 266/507 [00:08<00:07, 30.30it/s]
Loading 0:  53%|█████▎    | 271/507 [00:08<00:07, 33.57it/s]
Loading 0:  54%|█████▍    | 275/507 [00:09<00:07, 30.41it/s]
Loading 0:  56%|█████▌    | 282/507 [00:09<00:05, 38.67it/s]
Loading 0:  57%|█████▋    | 287/507 [00:09<00:09, 24.16it/s]
Loading 0:  58%|█████▊    | 293/507 [00:09<00:07, 26.75it/s]
Loading 0:  59%|█████▉    | 299/507 [00:20<00:07, 26.75it/s]
Loading 0:  59%|█████▉    | 300/507 [00:24<02:43,  1.27it/s]
Loading 0:  60%|█████▉    | 302/507 [00:24<02:22,  1.44it/s]
Loading 0:  61%|██████    | 307/507 [00:24<01:37,  2.05it/s]
Loading 0:  61%|██████    | 310/507 [00:25<01:17,  2.53it/s]
Loading 0:  62%|██████▏   | 313/507 [00:25<01:00,  3.20it/s]
Loading 0:  63%|██████▎   | 318/507 [00:25<00:39,  4.76it/s]
Loading 0:  64%|██████▎   | 322/507 [00:25<00:29,  6.30it/s]
Loading 0:  64%|██████▍   | 327/507 [00:25<00:20,  8.89it/s]
Loading 0:  65%|██████▌   | 331/507 [00:25<00:15, 11.04it/s]
Loading 0:  66%|██████▌   | 335/507 [00:25<00:12, 13.62it/s]
Loading 0:  67%|██████▋   | 340/507 [00:26<00:10, 15.27it/s]
Loading 0:  68%|██████▊   | 343/507 [00:26<00:09, 16.46it/s]
Loading 0:  68%|██████▊   | 347/507 [00:26<00:08, 18.03it/s]
Loading 0:  70%|██████▉   | 354/507 [00:26<00:05, 25.51it/s]
Loading 0:  71%|███████   | 358/507 [00:26<00:05, 26.51it/s]
Loading 0:  72%|███████▏  | 363/507 [00:26<00:04, 29.99it/s]
Loading 0:  72%|███████▏  | 367/507 [00:26<00:04, 29.69it/s]
Loading 0:  73%|███████▎  | 372/507 [00:27<00:04, 33.15it/s]
Loading 0:  74%|███████▍  | 376/507 [00:27<00:04, 32.70it/s]
Loading 0:  75%|███████▌  | 381/507 [00:27<00:03, 35.52it/s]
Loading 0:  76%|███████▌  | 385/507 [00:27<00:03, 33.31it/s]
Loading 0:  77%|███████▋  | 389/507 [00:27<00:03, 31.88it/s]
Loading 0:  78%|███████▊  | 393/507 [00:27<00:03, 31.25it/s]
Loading 0:  78%|███████▊  | 397/507 [00:27<00:04, 24.77it/s]
Loading 0:  79%|███████▉  | 401/507 [00:28<00:04, 24.68it/s]
Loading 0:  80%|████████  | 408/507 [00:28<00:03, 31.73it/s]
Loading 0:  81%|████████▏ | 412/507 [00:28<00:03, 30.76it/s]
Loading 0:  82%|████████▏ | 417/507 [00:28<00:02, 32.71it/s]
Loading 0:  83%|████████▎ | 421/507 [00:28<00:02, 31.62it/s]
Loading 0:  84%|████████▍ | 426/507 [00:28<00:02, 34.18it/s]
Loading 0:  85%|████████▍ | 430/507 [00:28<00:02, 32.67it/s]
Loading 0:  86%|████████▌ | 435/507 [00:29<00:02, 35.45it/s]
Loading 0:  87%|████████▋ | 439/507 [00:29<00:01, 34.50it/s]
Loading 0:  88%|████████▊ | 444/507 [00:29<00:01, 37.35it/s]
Loading 0:  88%|████████▊ | 448/507 [00:29<00:01, 34.91it/s]
Loading 0:  89%|████████▉ | 453/507 [00:29<00:01, 38.52it/s]
Loading 0:  90%|█████████ | 457/507 [00:31<00:08,  5.75it/s]
Loading 0:  91%|█████████ | 460/507 [00:31<00:06,  6.91it/s]
Loading 0:  92%|█████████▏| 465/507 [00:32<00:04,  9.40it/s]
Loading 0:  93%|█████████▎| 472/507 [00:32<00:02, 14.21it/s]
Loading 0:  94%|█████████▍| 476/507 [00:32<00:01, 16.28it/s]
Loading 0:  95%|█████████▍| 481/507 [00:32<00:01, 20.11it/s]
Loading 0:  96%|█████████▌| 485/507 [00:32<00:00, 22.12it/s]
Loading 0:  96%|█████████▋| 489/507 [00:32<00:00, 25.14it/s]
Loading 0:  97%|█████████▋| 493/507 [00:32<00:00, 24.56it/s]
Loading 0:  98%|█████████▊| 499/507 [00:32<00:00, 29.65it/s]
Loading 0:  99%|█████████▉| 503/507 [00:33<00:00, 29.88it/s]
                                                            
Job zonemercy-lexical-viral-7348-v17-mkmlizer completed after 170.14s with status: succeeded
Stopping job with name zonemercy-lexical-viral-7348-v17-mkmlizer
Pipeline stage MKMLizer completed in 171.25s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.26s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-lexical-viral-7348-v17
Waiting for inference service zonemercy-lexical-viral-7348-v17 to be ready
Inference service zonemercy-lexical-viral-7348-v17 ready after 192.34914112091064s
Pipeline stage MKMLDeployer completed in 193.59s
run pipeline stage %s
Running pipeline stage StressChecker
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.7392780780792236s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.3773038387298584s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.9129719734191895s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.3997159004211426s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.0215840339660645s
5 requests
0 failed requests
5th percentile: 2.381786251068115
10th percentile: 2.386268663406372
20th percentile: 2.395233488082886
30th percentile: 2.502367115020752
40th percentile: 2.7076695442199705
50th percentile: 2.9129719734191895
60th percentile: 2.9564167976379396
70th percentile: 2.9998616218566894
80th percentile: 3.1651228427886964
90th percentile: 3.45220046043396
95th percentile: 3.5957392692565917
99th percentile: 3.7105703163146972
mean time: 2.890170764923096
Pipeline stage StressChecker completed in 16.55s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.26s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.25s
Shutdown handler de-registered
zonemercy-lexical-viral_7348_v17 status is now deployed due to DeploymentManager action
zonemercy-lexical-viral_7348_v17 status is now inactive due to auto deactivation removed underperforming models