zonemercy-viral-ss-v0-1e5ep2

developer_uid: zonemercy
submission_id: zonemercy-viral-ss-v0-1e5ep2_v32
model_name: zonemercy-viral-ss-v0-1e5ep2_v32
model_group: zonemercy/Viral-ss-v0-1e
status: torndown
timestamp: 2024-10-10T21:17:41+00:00
num_battles: 7234
num_wins: 3641
celo_rating: 1257.33
family_friendly_score: 0.5514063781540985
family_friendly_standard_error: 0.005954676720603549
submission_type: basic
model_repo: zonemercy/Viral-ss-v0-1e5ep2
model_architecture: MistralForCausalLM
model_num_parameters: 22247282688.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: zonemercy-viral-ss-v0-1e5ep2_v32
is_internal_developer: True
language_model: zonemercy/Viral-ss-v0-1e5ep2
model_size: 22B
ranking_group: single
us_pacific_date: 2024-10-10
win_ratio: 0.5033176665745093
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer
Waiting for job on zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer to finish
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║     _____            __           __                                ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║       /___/                                                         ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  belonging to:                                                      ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ║                                                                     ║
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: Downloaded to shared memory in 187.732s
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpt0jk78tc, device:0
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: quantized model in 52.077s
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: Processed model zonemercy/Viral-ss-v0-1e5ep2 in 239.810s
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v32
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v32/config.json
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v32/special_tokens_map.json
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v32/tokenizer_config.json
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v32/tokenizer.json
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v32/flywheel_model.1.safetensors
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-viral-ss-v0-1e5ep2-v32/flywheel_model.0.safetensors
zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 4/507 [00:00<00:15, 31.78it/s]
Loading 0:   2%|▏         | 8/507 [00:00<00:19, 25.66it/s]
Loading 0:   2%|▏         | 12/507 [00:00<00:20, 24.60it/s]
Loading 0:   3%|▎         | 15/507 [00:00<00:23, 21.11it/s]
Loading 0:   4%|▎         | 19/507 [00:00<00:19, 24.45it/s]
Loading 0:   5%|▍         | 23/507 [00:00<00:17, 27.07it/s]
Loading 0:   5%|▌         | 26/507 [00:01<00:28, 17.13it/s]
Loading 0:   6%|▌         | 29/507 [00:01<00:25, 18.66it/s]
Loading 0:   6%|▋         | 32/507 [00:01<00:29, 16.00it/s]
Loading 0:   7%|▋         | 37/507 [00:01<00:22, 21.25it/s]
Loading 0:   8%|▊         | 40/507 [00:01<00:21, 21.46it/s]
Loading 0:   8%|▊         | 43/507 [00:02<00:21, 21.57it/s]
Loading 0:   9%|▉         | 46/507 [00:02<00:20, 22.81it/s]
Loading 0:  10%|▉         | 50/507 [00:02<00:17, 25.58it/s]
Loading 0:  10%|█         | 53/507 [00:02<00:25, 17.53it/s]
Loading 0:  11%|█         | 56/507 [00:02<00:23, 18.96it/s]
Loading 0:  12%|█▏        | 59/507 [00:02<00:27, 16.28it/s]
Loading 0:  13%|█▎        | 64/507 [00:03<00:20, 21.50it/s]
Loading 0:  13%|█▎        | 67/507 [00:03<00:20, 21.88it/s]
Loading 0:  14%|█▍        | 70/507 [00:03<00:19, 22.23it/s]
Loading 0:  14%|█▍        | 73/507 [00:03<00:18, 23.69it/s]
Loading 0:  15%|█▌        | 77/507 [00:03<00:16, 26.56it/s]
Loading 0:  16%|█▌        | 80/507 [00:03<00:24, 17.73it/s]
Loading 0:  16%|█▋        | 83/507 [00:04<00:24, 17.18it/s]
Loading 0:  17%|█▋        | 87/507 [00:04<00:20, 20.68it/s]
Loading 0:  18%|█▊        | 91/507 [00:04<00:17, 23.98it/s]
Loading 0:  19%|█▊        | 94/507 [00:04<00:17, 23.17it/s]
Loading 0:  19%|█▉        | 97/507 [00:04<00:17, 23.93it/s]
Loading 0:  20%|█▉        | 100/507 [00:04<00:21, 18.66it/s]
Loading 0:  21%|██        | 105/507 [00:04<00:17, 23.21it/s]
Loading 0:  21%|██▏       | 108/507 [00:05<00:25, 15.82it/s]
Loading 0:  22%|██▏       | 112/507 [00:05<00:20, 19.06it/s]
Loading 0:  23%|██▎       | 115/507 [00:05<00:19, 19.85it/s]
Loading 0:  23%|██▎       | 118/507 [00:05<00:18, 21.54it/s]
Loading 0:  24%|██▍       | 121/507 [00:05<00:17, 22.15it/s]
Loading 0:  24%|██▍       | 124/507 [00:05<00:17, 22.43it/s]
Loading 0:  25%|██▌       | 127/507 [00:06<00:15, 23.91it/s]
Loading 0:  26%|██▌       | 131/507 [00:06<00:14, 26.77it/s]
Loading 0:  26%|██▋       | 134/507 [00:06<00:20, 18.33it/s]
Loading 0:  27%|██▋       | 137/507 [00:06<00:18, 19.77it/s]
Loading 0:  28%|██▊       | 140/507 [00:06<00:21, 16.93it/s]
Loading 0:  29%|██▊       | 145/507 [00:06<00:16, 22.33it/s]
Loading 0:  29%|██▉       | 148/507 [00:07<00:15, 22.57it/s]
Loading 0:  30%|██▉       | 151/507 [00:07<00:15, 22.36it/s]
Loading 0:  30%|███       | 154/507 [00:07<00:14, 23.59it/s]
Loading 0:  31%|███       | 158/507 [00:07<00:13, 26.59it/s]
Loading 0:  32%|███▏      | 161/507 [00:07<00:18, 18.58it/s]
Loading 0:  32%|███▏      | 164/507 [00:07<00:17, 19.99it/s]
Loading 0:  33%|███▎      | 167/507 [00:08<00:19, 17.13it/s]
Loading 0:  34%|███▍      | 172/507 [00:08<00:14, 22.56it/s]
Loading 0:  35%|███▍      | 175/507 [00:08<00:14, 22.99it/s]
Loading 0:  35%|███▌      | 178/507 [00:08<00:14, 23.03it/s]
Loading 0:  36%|███▌      | 181/507 [00:08<00:13, 24.40it/s]
Loading 0:  36%|███▋      | 185/507 [00:08<00:11, 27.40it/s]
Loading 0:  37%|███▋      | 188/507 [00:08<00:16, 18.96it/s]
Loading 0:  38%|███▊      | 191/507 [00:09<00:15, 20.36it/s]
Loading 0:  38%|███▊      | 194/507 [00:09<00:17, 17.42it/s]
Loading 0:  39%|███▉      | 199/507 [00:09<00:13, 22.92it/s]
Loading 0:  40%|███▉      | 202/507 [00:09<00:13, 23.15it/s]
Loading 0:  40%|████      | 205/507 [00:09<00:13, 22.92it/s]
Loading 0:  41%|████      | 208/507 [00:09<00:12, 24.04it/s]
Loading 0:  42%|████▏     | 212/507 [00:09<00:10, 27.02it/s]
Loading 0:  42%|████▏     | 215/507 [00:10<00:15, 18.96it/s]
Loading 0:  43%|████▎     | 218/507 [00:10<00:14, 20.39it/s]
Loading 0:  44%|████▎     | 221/507 [00:10<00:16, 17.29it/s]
Loading 0:  45%|████▍     | 226/507 [00:10<00:12, 22.74it/s]
Loading 0:  45%|████▌     | 229/507 [00:10<00:11, 23.23it/s]
Loading 0:  46%|████▌     | 232/507 [00:10<00:11, 23.31it/s]
Loading 0:  46%|████▋     | 235/507 [00:11<00:11, 24.52it/s]
Loading 0:  47%|████▋     | 239/507 [00:11<00:09, 27.44it/s]
Loading 0:  48%|████▊     | 242/507 [00:11<00:13, 18.96it/s]
Loading 0:  48%|████▊     | 245/507 [00:11<00:13, 20.05it/s]
Loading 0:  49%|████▉     | 248/507 [00:11<00:15, 16.86it/s]
Loading 0:  50%|████▉     | 253/507 [00:11<00:11, 22.01it/s]
Loading 0:  50%|█████     | 256/507 [00:12<00:11, 22.44it/s]
Loading 0:  51%|█████     | 259/507 [00:12<00:11, 22.11it/s]
Loading 0:  52%|█████▏    | 262/507 [00:12<00:10, 23.50it/s]
Loading 0:  52%|█████▏    | 266/507 [00:12<00:09, 26.52it/s]
Loading 0:  53%|█████▎    | 269/507 [00:12<00:12, 18.57it/s]
Loading 0:  54%|█████▎    | 272/507 [00:12<00:11, 19.74it/s]
Loading 0:  54%|█████▍    | 275/507 [00:13<00:13, 16.77it/s]
Loading 0:  55%|█████▌    | 280/507 [00:13<00:10, 21.90it/s]
Loading 0:  56%|█████▌    | 283/507 [00:13<00:09, 22.45it/s]
Loading 0:  56%|█████▋    | 286/507 [00:13<00:09, 22.65it/s]
Loading 0:  57%|█████▋    | 289/507 [00:13<00:09, 23.97it/s]
Loading 0:  58%|█████▊    | 293/507 [00:13<00:07, 27.06it/s]
Loading 0:  58%|█████▊    | 296/507 [00:13<00:11, 18.78it/s]
Loading 0:  59%|█████▉    | 299/507 [00:14<00:10, 20.27it/s]
Loading 0:  59%|█████▉    | 299/507 [00:24<00:10, 20.27it/s]
Loading 0:  59%|█████▉    | 300/507 [00:28<06:00,  1.74s/it]
Loading 0:  60%|█████▉    | 302/507 [00:28<04:32,  1.33s/it]
Loading 0:  60%|██████    | 306/507 [00:28<02:39,  1.26it/s]
Loading 0:  61%|██████    | 309/507 [00:29<01:51,  1.77it/s]
Loading 0:  61%|██████▏   | 311/507 [00:29<01:29,  2.19it/s]
Loading 0:  62%|██████▏   | 316/507 [00:29<00:50,  3.81it/s]
Loading 0:  63%|██████▎   | 320/507 [00:29<00:34,  5.49it/s]
Loading 0:  64%|██████▎   | 323/507 [00:29<00:29,  6.34it/s]
Loading 0:  64%|██████▍   | 326/507 [00:29<00:22,  7.98it/s]
Loading 0:  65%|██████▍   | 329/507 [00:30<00:19,  8.91it/s]
Loading 0:  66%|██████▌   | 334/507 [00:30<00:13, 13.02it/s]
Loading 0:  66%|██████▋   | 337/507 [00:30<00:11, 14.84it/s]
Loading 0:  67%|██████▋   | 340/507 [00:30<00:10, 16.38it/s]
Loading 0:  68%|██████▊   | 343/507 [00:30<00:08, 18.68it/s]
Loading 0:  68%|██████▊   | 347/507 [00:30<00:07, 22.22it/s]
Loading 0:  69%|██████▉   | 350/507 [00:30<00:09, 17.29it/s]
Loading 0:  70%|██████▉   | 353/507 [00:31<00:08, 18.83it/s]
Loading 0:  70%|███████   | 356/507 [00:31<00:09, 16.51it/s]
Loading 0:  71%|███████   | 361/507 [00:31<00:07, 20.72it/s]
Loading 0:  72%|███████▏  | 364/507 [00:31<00:06, 21.45it/s]
Loading 0:  72%|███████▏  | 367/507 [00:31<00:06, 21.86it/s]
Loading 0:  73%|███████▎  | 370/507 [00:31<00:05, 23.51it/s]
Loading 0:  74%|███████▍  | 374/507 [00:31<00:05, 26.59it/s]
Loading 0:  74%|███████▍  | 377/507 [00:32<00:06, 18.97it/s]
Loading 0:  75%|███████▍  | 380/507 [00:32<00:06, 20.27it/s]
Loading 0:  76%|███████▌  | 383/507 [00:32<00:07, 17.20it/s]
Loading 0:  77%|███████▋  | 388/507 [00:32<00:05, 22.39it/s]
Loading 0:  77%|███████▋  | 391/507 [00:32<00:05, 22.67it/s]
Loading 0:  78%|███████▊  | 394/507 [00:32<00:04, 22.79it/s]
Loading 0:  78%|███████▊  | 397/507 [00:33<00:04, 24.26it/s]
Loading 0:  79%|███████▉  | 401/507 [00:33<00:03, 27.33it/s]
Loading 0:  80%|███████▉  | 404/507 [00:33<00:05, 18.62it/s]
Loading 0:  80%|████████  | 407/507 [00:33<00:04, 20.03it/s]
Loading 0:  81%|████████  | 410/507 [00:33<00:05, 16.70it/s]
Loading 0:  82%|████████▏ | 415/507 [00:34<00:04, 21.71it/s]
Loading 0:  82%|████████▏ | 418/507 [00:34<00:04, 22.13it/s]
Loading 0:  83%|████████▎ | 421/507 [00:34<00:03, 22.40it/s]
Loading 0:  84%|████████▎ | 424/507 [00:34<00:03, 23.91it/s]
Loading 0:  84%|████████▍ | 428/507 [00:34<00:02, 26.89it/s]
Loading 0:  85%|████████▌ | 431/507 [00:34<00:04, 18.52it/s]
Loading 0:  86%|████████▌ | 434/507 [00:34<00:03, 19.69it/s]
Loading 0:  86%|████████▌ | 437/507 [00:35<00:04, 16.83it/s]
Loading 0:  87%|████████▋ | 442/507 [00:35<00:02, 21.99it/s]
Loading 0:  88%|████████▊ | 445/507 [00:35<00:02, 22.53it/s]
Loading 0:  88%|████████▊ | 448/507 [00:35<00:02, 22.46it/s]
Loading 0:  89%|████████▉ | 451/507 [00:35<00:02, 23.45it/s]
Loading 0:  90%|████████▉ | 455/507 [00:35<00:01, 26.58it/s]
Loading 0:  90%|█████████ | 458/507 [00:36<00:02, 19.06it/s]
Loading 0:  91%|█████████ | 461/507 [00:36<00:02, 20.46it/s]
Loading 0:  92%|█████████▏| 464/507 [00:36<00:02, 17.16it/s]
Loading 0:  93%|█████████▎| 469/507 [00:36<00:01, 22.48it/s]
Loading 0:  93%|█████████▎| 472/507 [00:36<00:01, 23.08it/s]
Loading 0:  94%|█████████▎| 475/507 [00:36<00:01, 23.11it/s]
Loading 0:  94%|█████████▍| 478/507 [00:36<00:01, 24.52it/s]
Loading 0:  95%|█████████▌| 482/507 [00:36<00:00, 27.32it/s]
Loading 0:  96%|█████████▌| 485/507 [00:39<00:05,  4.28it/s]
Loading 0:  96%|█████████▋| 488/507 [00:39<00:03,  5.41it/s]
Loading 0:  97%|█████████▋| 491/507 [00:39<00:02,  7.01it/s]
Loading 0:  97%|█████████▋| 494/507 [00:39<00:01,  8.84it/s]
Loading 0:  98%|█████████▊| 497/507 [00:39<00:00, 11.06it/s]
Loading 0:  99%|█████████▊| 500/507 [00:39<00:00, 13.23it/s]
Loading 0:  99%|█████████▉| 503/507 [00:40<00:00, 15.14it/s]
Loading 0: 100%|█████████▉| 506/507 [00:40<00:00, 17.55it/s]
                                                            
Job zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer completed after 267.52s with status: succeeded
Stopping job with name zonemercy-viral-ss-v0-1e5ep2-v32-mkmlizer
Pipeline stage MKMLizer completed in 268.18s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.50s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-viral-ss-v0-1e5ep2-v32
Waiting for inference service zonemercy-viral-ss-v0-1e5ep2-v32 to be ready
Inference service zonemercy-viral-ss-v0-1e5ep2-v32 ready after 140.8262870311737s
Pipeline stage MKMLDeployer completed in 141.40s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.750946283340454s
Received healthy response to inference request in 2.699573278427124s
Received healthy response to inference request in 2.4916610717773438s
Received healthy response to inference request in 2.821301221847534s
Received healthy response to inference request in 2.3813798427581787s
5 requests
0 failed requests
5th percentile: 2.4034360885620116
10th percentile: 2.4254923343658445
20th percentile: 2.469604825973511
30th percentile: 2.5332435131073
40th percentile: 2.6164083957672117
50th percentile: 2.699573278427124
60th percentile: 2.720122480392456
70th percentile: 2.740671682357788
80th percentile: 2.76501727104187
90th percentile: 2.793159246444702
95th percentile: 2.807230234146118
99th percentile: 2.818487024307251
mean time: 2.6289723396301268
Pipeline stage StressChecker completed in 14.44s
Shutdown handler de-registered
zonemercy-viral-ss-v0-1e5ep2_v32 status is now deployed due to DeploymentManager action
zonemercy-viral-ss-v0-1e5ep2_v32 status is now inactive due to auto deactivation removed underperforming models
zonemercy-viral-ss-v0-1e5ep2_v32 status is now torndown due to DeploymentManager action