zonemercy-lexical-viral-_4225

developer_uid: chai_backend_admin
submission_id: zonemercy-lexical-viral-_4225_v5
model_name: tempv1-1
model_group: zonemercy/Lexical-Viral-
status: torndown
timestamp: 2024-11-01T18:54:31+00:00
num_battles: 15889
num_wins: 8287
celo_rating: 1259.91
family_friendly_score: 0.5694
family_friendly_standard_error: 0.00700262293715719
submission_type: basic
model_repo: zonemercy/Lexical-Viral-v1ava-22b11e5
model_architecture: MistralForCausalLM
model_num_parameters: 22247282688.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: tempv1-1
is_internal_developer: True
language_model: zonemercy/Lexical-Viral-v1ava-22b11e5
model_size: 22B
ranking_group: single
us_pacific_date: 2024-11-01
win_ratio: 0.5215557933161307
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-lexical-viral-4225-v5-mkmlizer
Waiting for job on zonemercy-lexical-viral-4225-v5-mkmlizer to finish
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
zonemercy-lexical-viral-4225-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-lexical-viral-4225-v5-mkmlizer: ║     _____            __           __                                ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║       /___/                                                         ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  belonging to:                                                      ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ║                                                                     ║
zonemercy-lexical-viral-4225-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-lexical-viral-4225-v5-mkmlizer: Downloaded to shared memory in 78.568s
zonemercy-lexical-viral-4225-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp2hgnfj81, device:0
zonemercy-lexical-viral-4225-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-lexical-viral-4225-v5-mkmlizer: quantized model in 47.253s
zonemercy-lexical-viral-4225-v5-mkmlizer: Processed model zonemercy/Lexical-Viral-v1ava-22b11e5 in 125.821s
zonemercy-lexical-viral-4225-v5-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-lexical-viral-4225-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-lexical-viral-4225-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-lexical-viral-4225-v5
zonemercy-lexical-viral-4225-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-lexical-viral-4225-v5/special_tokens_map.json
zonemercy-lexical-viral-4225-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-4225-v5/config.json
zonemercy-lexical-viral-4225-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-lexical-viral-4225-v5/tokenizer_config.json
zonemercy-lexical-viral-4225-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-lexical-viral-4225-v5/tokenizer.json
zonemercy-lexical-viral-4225-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-4225-v5/flywheel_model.1.safetensors
zonemercy-lexical-viral-4225-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-lexical-viral-4225-v5/flywheel_model.0.safetensors
zonemercy-lexical-viral-4225-v5-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/507 [00:00<00:24, 20.39it/s]
Loading 0:   2%|▏         | 10/507 [00:00<00:17, 28.85it/s]
Loading 0:   3%|▎         | 14/507 [00:00<00:18, 26.22it/s]
Loading 0:   4%|▎         | 19/507 [00:00<00:15, 31.34it/s]
Loading 0:   5%|▍         | 23/507 [00:00<00:17, 28.32it/s]
Loading 0:   6%|▌         | 30/507 [00:00<00:13, 36.48it/s]
Loading 0:   7%|▋         | 34/507 [00:01<00:13, 34.34it/s]
Loading 0:   8%|▊         | 39/507 [00:01<00:12, 36.38it/s]
Loading 0:   8%|▊         | 43/507 [00:01<00:13, 34.48it/s]
Loading 0:   9%|▉         | 47/507 [00:01<00:13, 34.49it/s]
Loading 0:  10%|█         | 51/507 [00:01<00:13, 33.14it/s]
Loading 0:  11%|█         | 55/507 [00:01<00:19, 23.41it/s]
Loading 0:  11%|█▏        | 58/507 [00:01<00:18, 24.28it/s]
Loading 0:  12%|█▏        | 63/507 [00:02<00:15, 28.19it/s]
Loading 0:  13%|█▎        | 67/507 [00:02<00:16, 27.41it/s]
Loading 0:  14%|█▍        | 70/507 [00:02<00:15, 27.49it/s]
Loading 0:  14%|█▍        | 73/507 [00:02<00:15, 27.59it/s]
Loading 0:  16%|█▌        | 80/507 [00:02<00:14, 29.36it/s]
Loading 0:  17%|█▋        | 85/507 [00:02<00:12, 32.51it/s]
Loading 0:  18%|█▊        | 89/507 [00:03<00:14, 29.17it/s]
Loading 0:  19%|█▊        | 94/507 [00:03<00:12, 32.64it/s]
Loading 0:  19%|█▉        | 98/507 [00:03<00:14, 28.42it/s]
Loading 0:  20%|██        | 103/507 [00:03<00:12, 31.33it/s]
Loading 0:  21%|██        | 107/507 [00:03<00:14, 27.22it/s]
Loading 0:  22%|██▏       | 112/507 [00:03<00:13, 29.81it/s]
Loading 0:  23%|██▎       | 116/507 [00:04<00:19, 19.78it/s]
Loading 0:  24%|██▍       | 122/507 [00:04<00:16, 22.90it/s]
Loading 0:  25%|██▌       | 127/507 [00:04<00:14, 26.81it/s]
Loading 0:  26%|██▌       | 131/507 [00:04<00:14, 25.12it/s]
Loading 0:  27%|██▋       | 136/507 [00:04<00:13, 28.26it/s]
Loading 0:  28%|██▊       | 140/507 [00:04<00:13, 26.47it/s]
Loading 0:  29%|██▊       | 145/507 [00:05<00:12, 29.85it/s]
Loading 0:  29%|██▉       | 149/507 [00:05<00:13, 27.54it/s]
Loading 0:  30%|███       | 154/507 [00:05<00:11, 31.19it/s]
Loading 0:  31%|███       | 158/507 [00:05<00:12, 28.66it/s]
Loading 0:  32%|███▏      | 163/507 [00:05<00:10, 31.65it/s]
Loading 0:  33%|███▎      | 168/507 [00:05<00:10, 32.29it/s]
Loading 0:  34%|███▍      | 172/507 [00:06<00:14, 23.18it/s]
Loading 0:  35%|███▍      | 176/507 [00:06<00:14, 22.94it/s]
Loading 0:  36%|███▌      | 181/507 [00:06<00:12, 27.04it/s]
Loading 0:  36%|███▋      | 185/507 [00:06<00:12, 26.06it/s]
Loading 0:  37%|███▋      | 190/507 [00:06<00:10, 29.97it/s]
Loading 0:  38%|███▊      | 194/507 [00:06<00:11, 27.98it/s]
Loading 0:  39%|███▉      | 199/507 [00:06<00:09, 31.49it/s]
Loading 0:  40%|████      | 203/507 [00:07<00:10, 29.71it/s]
Loading 0:  41%|████▏     | 210/507 [00:07<00:08, 36.84it/s]
Loading 0:  42%|████▏     | 214/507 [00:07<00:08, 34.95it/s]
Loading 0:  43%|████▎     | 218/507 [00:07<00:08, 34.55it/s]
Loading 0:  44%|████▍     | 222/507 [00:07<00:08, 33.10it/s]
Loading 0:  45%|████▍     | 226/507 [00:07<00:11, 24.40it/s]
Loading 0:  45%|████▌     | 230/507 [00:08<00:11, 24.68it/s]
Loading 0:  47%|████▋     | 237/507 [00:08<00:08, 31.61it/s]
Loading 0:  48%|████▊     | 241/507 [00:08<00:08, 31.05it/s]
Loading 0:  49%|████▊     | 246/507 [00:08<00:07, 32.94it/s]
Loading 0:  49%|████▉     | 250/507 [00:08<00:08, 30.92it/s]
Loading 0:  50%|█████     | 254/507 [00:08<00:08, 31.34it/s]
Loading 0:  51%|█████     | 258/507 [00:08<00:09, 26.97it/s]
Loading 0:  52%|█████▏    | 262/507 [00:09<00:08, 28.31it/s]
Loading 0:  52%|█████▏    | 266/507 [00:09<00:09, 25.84it/s]
Loading 0:  53%|█████▎    | 271/507 [00:09<00:08, 29.42it/s]
Loading 0:  54%|█████▍    | 275/507 [00:09<00:08, 26.28it/s]
Loading 0:  55%|█████▌    | 280/507 [00:09<00:07, 29.53it/s]
Loading 0:  56%|█████▌    | 284/507 [00:10<00:09, 22.56it/s]
Loading 0:  57%|█████▋    | 287/507 [00:10<00:10, 20.98it/s]
Loading 0:  58%|█████▊    | 293/507 [00:10<00:09, 23.46it/s]
Loading 0:  59%|█████▉    | 298/507 [00:10<00:07, 26.63it/s]
Loading 0:  59%|█████▉    | 299/507 [00:21<00:07, 26.63it/s]
Loading 0:  59%|█████▉    | 300/507 [00:25<04:07,  1.19s/it]
Loading 0:  60%|█████▉    | 302/507 [00:25<03:23,  1.01it/s]
Loading 0:  61%|██████    | 307/507 [00:25<02:03,  1.62it/s]
Loading 0:  61%|██████    | 310/507 [00:26<01:33,  2.11it/s]
Loading 0:  62%|██████▏   | 313/507 [00:26<01:09,  2.79it/s]
Loading 0:  62%|██████▏   | 316/507 [00:26<00:51,  3.71it/s]
Loading 0:  63%|██████▎   | 320/507 [00:26<00:35,  5.20it/s]
Loading 0:  64%|██████▍   | 325/507 [00:26<00:23,  7.83it/s]
Loading 0:  65%|██████▍   | 329/507 [00:26<00:18,  9.82it/s]
Loading 0:  66%|██████▌   | 334/507 [00:26<00:12, 13.56it/s]
Loading 0:  67%|██████▋   | 339/507 [00:26<00:09, 17.13it/s]
Loading 0:  68%|██████▊   | 343/507 [00:27<00:10, 15.35it/s]
Loading 0:  68%|██████▊   | 347/507 [00:27<00:09, 16.93it/s]
Loading 0:  69%|██████▉   | 352/507 [00:27<00:07, 21.66it/s]
Loading 0:  70%|███████   | 356/507 [00:27<00:06, 22.44it/s]
Loading 0:  71%|███████   | 361/507 [00:27<00:05, 27.20it/s]
Loading 0:  72%|███████▏  | 365/507 [00:28<00:05, 26.36it/s]
Loading 0:  73%|███████▎  | 370/507 [00:28<00:04, 30.81it/s]
Loading 0:  74%|███████▍  | 374/507 [00:28<00:04, 28.94it/s]
Loading 0:  75%|███████▌  | 381/507 [00:28<00:03, 35.91it/s]
Loading 0:  76%|███████▌  | 385/507 [00:28<00:03, 33.77it/s]
Loading 0:  77%|███████▋  | 389/507 [00:28<00:03, 32.85it/s]
Loading 0:  78%|███████▊  | 393/507 [00:28<00:03, 31.52it/s]
Loading 0:  78%|███████▊  | 397/507 [00:29<00:04, 23.67it/s]
Loading 0:  79%|███████▉  | 401/507 [00:29<00:04, 23.09it/s]
Loading 0:  80%|████████  | 406/507 [00:29<00:03, 27.83it/s]
Loading 0:  81%|████████  | 410/507 [00:29<00:03, 26.30it/s]
Loading 0:  82%|████████▏ | 415/507 [00:29<00:03, 30.45it/s]
Loading 0:  83%|████████▎ | 419/507 [00:29<00:03, 28.20it/s]
Loading 0:  84%|████████▎ | 424/507 [00:29<00:02, 32.33it/s]
Loading 0:  84%|████████▍ | 428/507 [00:30<00:02, 29.74it/s]
Loading 0:  85%|████████▌ | 433/507 [00:30<00:02, 33.58it/s]
Loading 0:  86%|████████▌ | 437/507 [00:30<00:02, 30.18it/s]
Loading 0:  87%|████████▋ | 442/507 [00:30<00:01, 34.15it/s]
Loading 0:  88%|████████▊ | 446/507 [00:30<00:02, 30.21it/s]
Loading 0:  89%|████████▉ | 451/507 [00:30<00:01, 34.10it/s]
Loading 0:  90%|████████▉ | 455/507 [00:33<00:09,  5.56it/s]
Loading 0:  91%|█████████ | 459/507 [00:33<00:06,  7.09it/s]
Loading 0:  92%|█████████▏| 465/507 [00:33<00:04, 10.09it/s]
Loading 0:  93%|█████████▎| 470/507 [00:33<00:02, 13.35it/s]
Loading 0:  93%|█████████▎| 474/507 [00:33<00:02, 15.00it/s]
Loading 0:  94%|█████████▍| 479/507 [00:33<00:01, 18.98it/s]
Loading 0:  95%|█████████▌| 483/507 [00:34<00:01, 20.05it/s]
Loading 0:  96%|█████████▋| 488/507 [00:34<00:00, 24.13it/s]
Loading 0:  97%|█████████▋| 492/507 [00:34<00:00, 23.68it/s]
Loading 0:  98%|█████████▊| 497/507 [00:34<00:00, 28.06it/s]
Loading 0:  99%|█████████▉| 501/507 [00:34<00:00, 26.35it/s]
Loading 0: 100%|█████████▉| 506/507 [00:34<00:00, 30.50it/s]
                                                            
Job zonemercy-lexical-viral-4225-v5-mkmlizer completed after 288.98s with status: succeeded
Stopping job with name zonemercy-lexical-viral-4225-v5-mkmlizer
Pipeline stage MKMLizer completed in 289.61s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.17s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-lexical-viral-4225-v5
Waiting for inference service zonemercy-lexical-viral-4225-v5 to be ready
Failed to get response for submission bbchicago-nana-nemo-12b-v1-0_v8: ('http://bbchicago-nana-nemo-12b-v1-0-v8-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission chaiml-lexical-nemo-v4-1k1e5_v10: ('http://chaiml-lexical-nemo-v4-1k1e5-v10-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:48814->127.0.0.1:8080: read: connection reset by peer\n')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service zonemercy-lexical-viral-4225-v5 ready after 140.9635453224182s
Pipeline stage MKMLDeployer completed in 141.61s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.534532308578491s
Received healthy response to inference request in 2.4771437644958496s
Received healthy response to inference request in 2.9533286094665527s
Received healthy response to inference request in 2.5015127658843994s
Received healthy response to inference request in 2.3965494632720947s
5 requests
0 failed requests
5th percentile: 2.412668323516846
10th percentile: 2.428787183761597
20th percentile: 2.4610249042510985
30th percentile: 2.4820175647735594
40th percentile: 2.4917651653289794
50th percentile: 2.5015127658843994
60th percentile: 2.6822391033172606
70th percentile: 2.862965440750122
80th percentile: 3.0695693492889404
90th percentile: 3.302050828933716
95th percentile: 3.4182915687561035
99th percentile: 3.5112841606140135
mean time: 2.7726133823394776
Pipeline stage StressChecker completed in 15.46s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.58s
Shutdown handler de-registered
zonemercy-lexical-viral-_4225_v5 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3243.74s
Shutdown handler de-registered
zonemercy-lexical-viral-_4225_v5 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of zonemercy-lexical-viral-_4225_v5
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLDeleter
Checking if service zonemercy-lexical-viral-4225-v5 is running
Tearing down inference service zonemercy-lexical-viral-4225-v5
Service zonemercy-lexical-viral-4225-v5 has been torndown
Pipeline stage MKMLDeleter completed in 1.99s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key zonemercy-lexical-viral-4225-v5/config.json from bucket guanaco-mkml-models
Deleting key zonemercy-lexical-viral-4225-v5/flywheel_model.0.safetensors from bucket guanaco-mkml-models
admin requested tearing down of zonemercy-lexical-viral-_7348_v1
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Deleting key zonemercy-lexical-viral-4225-v5/flywheel_model.1.safetensors from bucket guanaco-mkml-models
run pipeline stage %s
Running pipeline stage MKMLDeleter
Checking if service zonemercy-lexical-viral-7348-v1 is running
Deleting key zonemercy-lexical-viral-4225-v5/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key zonemercy-lexical-viral-4225-v5/tokenizer.json from bucket guanaco-mkml-models
Deleting key zonemercy-lexical-viral-4225-v5/tokenizer_config.json from bucket guanaco-mkml-models
Pipeline stage MKMLModelDeleter completed in 3.87s
Tearing down inference service zonemercy-lexical-viral-7348-v1
Shutdown handler de-registered
Service zonemercy-lexical-viral-7348-v1 has been torndown
Service zonemercy-lexical-viral-7348-v1 has been torndown
zonemercy-lexical-viral-_4225_v5 status is now torndown due to DeploymentManager action