neversleep-noromaid-v0_8068

submission_id: neversleep-noromaid-v0_8068_v152
developer_uid: Jellywibble
best_of: 4
celo_rating: 1204.91
display_name: asdasd
family_friendly_score: 0.5833609820836099
family_friendly_standard_error: 0.006327740666060293
formatter: {'memory_template': '<s>[INST] This is an entertaining conversation. You are {bot_name} who has the persona: {memory}.\nPlay the role of {bot_name}. Engage in a chat with {user_name} while staying in character. You should create a fun dialogue which entertains {user_name}.\n', 'prompt_template': '{prompt}\n', 'bot_template': '{bot_name}: {message}</s>', 'user_template': '[INST] {user_name}: {message} [/INST]', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
language_model: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MixtralForCausalLM
model_group: NeverSleep/Noromaid-v0.1
model_name: asdasd
model_num_parameters: 46702792704.0
model_repo: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_size: 47B
num_battles: 6273
num_wins: 2770
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-10-11T15:56:21+00:00
us_pacific_date: 2024-10-11
win_ratio: 0.44157500398533395
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name neversleep-noromaid-v0-8068-v152-mkmlizer
Waiting for job on neversleep-noromaid-v0-8068-v152-mkmlizer to finish
neversleep-noromaid-v0-8068-v152-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
neversleep-noromaid-v0-8068-v152-mkmlizer: ║     _____            __           __                                ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║       /___/                                                         ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  Version: 0.11.12                                                   ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  https://mk1.ai                                                     ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  The license key for the current software has been verified as      ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  belonging to:                                                      ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  Chai Research Corp.                                                ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v152-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
neversleep-noromaid-v0-8068-v152-mkmlizer: Downloaded to shared memory in 248.082s
neversleep-noromaid-v0-8068-v152-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpzad5fqci, device:0
neversleep-noromaid-v0-8068-v152-mkmlizer: Saving flywheel model at /dev/shm/model_cache
neversleep-noromaid-v0-8068-v152-mkmlizer: /opt/conda/lib/python3.10/site-packages/mk1/flywheel/functional/loader.py:55: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for `weights_only` will be flipped to `True`. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via `torch.serialization.add_safe_globals`. We recommend you start setting `weights_only=True` for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
neversleep-noromaid-v0-8068-v152-mkmlizer:   tensors = torch.load(model_shard_filename, map_location=torch.device(self.device), mmap=True)
neversleep-noromaid-v0-8068-v152-mkmlizer: quantized model in 109.782s
neversleep-noromaid-v0-8068-v152-mkmlizer: Processed model NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3 in 357.865s
neversleep-noromaid-v0-8068-v152-mkmlizer: creating bucket guanaco-mkml-models
neversleep-noromaid-v0-8068-v152-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
neversleep-noromaid-v0-8068-v152-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152
neversleep-noromaid-v0-8068-v152-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152/tokenizer.model
neversleep-noromaid-v0-8068-v152-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152/tokenizer_config.json
neversleep-noromaid-v0-8068-v152-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152/tokenizer.json
neversleep-noromaid-v0-8068-v152-mkmlizer: cp /dev/shm/model_cache/flywheel_model.3.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152/flywheel_model.3.safetensors
neversleep-noromaid-v0-8068-v152-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152/flywheel_model.0.safetensors
neversleep-noromaid-v0-8068-v152-mkmlizer: cp /dev/shm/model_cache/flywheel_model.2.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152/flywheel_model.2.safetensors
neversleep-noromaid-v0-8068-v152-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v152/flywheel_model.1.safetensors
neversleep-noromaid-v0-8068-v152-mkmlizer: 
Loading 0:   0%|          | 0/995 [00:00<?, ?it/s]
Loading 0:   0%|          | 4/995 [00:00<00:27, 36.09it/s]
Loading 0:   1%|          | 12/995 [00:00<00:23, 42.29it/s]
Loading 0:   2%|▏         | 18/995 [00:00<00:25, 38.26it/s]
Loading 0:   2%|▏         | 24/995 [00:00<00:25, 37.97it/s]
Loading 0:   3%|▎         | 30/995 [00:00<00:25, 37.89it/s]
Loading 0:   4%|▍         | 40/995 [00:00<00:20, 45.82it/s]
Loading 0:   5%|▍         | 46/995 [00:01<00:21, 43.14it/s]
Loading 0:   5%|▌         | 52/995 [00:07<05:13,  3.01it/s]
Loading 0:   6%|▌         | 55/995 [00:07<04:24,  3.56it/s]
Loading 0:   6%|▌         | 61/995 [00:07<03:03,  5.09it/s]
Loading 0:   7%|▋         | 71/995 [00:08<01:46,  8.64it/s]
Loading 0:   8%|▊         | 77/995 [00:08<01:23, 11.06it/s]
Loading 0:   8%|▊         | 83/995 [00:08<01:04, 14.24it/s]
Loading 0:   9%|▉         | 89/995 [00:08<00:50, 18.09it/s]
Loading 0:  10%|▉         | 97/995 [00:08<00:36, 24.48it/s]
Loading 0:  11%|█         | 105/995 [00:08<00:28, 30.92it/s]
Loading 0:  11%|█         | 111/995 [00:11<02:11,  6.74it/s]
Loading 0:  12%|█▏        | 117/995 [00:11<01:40,  8.76it/s]
Loading 0:  12%|█▏        | 123/995 [00:11<01:17, 11.22it/s]
Loading 0:  13%|█▎        | 133/995 [00:11<00:51, 16.84it/s]
Loading 0:  14%|█▍        | 139/995 [00:12<00:42, 20.18it/s]
Loading 0:  15%|█▍        | 145/995 [00:12<00:35, 23.68it/s]
Loading 0:  15%|█▌        | 151/995 [00:12<00:30, 27.23it/s]
Loading 0:  16%|█▌        | 159/995 [00:12<00:24, 34.12it/s]
Loading 0:  17%|█▋        | 165/995 [00:13<00:57, 14.33it/s]
Loading 0:  17%|█▋        | 170/995 [00:13<00:49, 16.72it/s]
Loading 0:  18%|█▊        | 176/995 [00:13<00:39, 20.54it/s]
Loading 0:  18%|█▊        | 182/995 [00:13<00:33, 24.36it/s]
Loading 0:  19%|█▉        | 190/995 [00:14<00:25, 31.11it/s]
Loading 0:  20%|█▉        | 198/995 [00:14<00:21, 37.76it/s]
Loading 0:  21%|██        | 204/995 [00:14<00:19, 40.16it/s]
Loading 0:  21%|██        | 210/995 [00:15<00:56, 13.78it/s]
Loading 0:  22%|██▏       | 216/995 [00:15<00:45, 16.96it/s]
Loading 0:  23%|██▎       | 226/995 [00:15<00:31, 24.16it/s]
Loading 0:  23%|██▎       | 232/995 [00:15<00:27, 28.25it/s]
Loading 0:  24%|██▍       | 238/995 [00:16<00:23, 32.00it/s]
Loading 0:  25%|██▍       | 244/995 [00:16<00:20, 36.20it/s]
Loading 0:  25%|██▌       | 252/995 [00:16<00:17, 43.05it/s]
Loading 0:  26%|██▌       | 260/995 [00:16<00:14, 50.12it/s]
Loading 0:  27%|██▋       | 267/995 [00:17<00:44, 16.31it/s]
Loading 0:  27%|██▋       | 272/995 [00:17<00:38, 18.87it/s]
Loading 0:  28%|██▊       | 277/995 [00:32<00:38, 18.87it/s]
Loading 0:  28%|██▊       | 278/995 [00:32<09:02,  1.32it/s]
Loading 0:  29%|██▉       | 288/995 [00:32<05:23,  2.19it/s]
Loading 0:  30%|██▉       | 294/995 [00:33<04:01,  2.90it/s]
Loading 0:  30%|███       | 300/995 [00:33<02:59,  3.87it/s]
Loading 0:  31%|███       | 306/995 [00:33<02:13,  5.18it/s]
Loading 0:  32%|███▏      | 314/995 [00:33<01:29,  7.62it/s]
Loading 0:  32%|███▏      | 320/995 [00:34<01:36,  6.99it/s]
Loading 0:  33%|███▎      | 325/995 [00:34<01:17,  8.66it/s]
Loading 0:  33%|███▎      | 331/995 [00:34<00:58, 11.43it/s]
Loading 0:  34%|███▍      | 337/995 [00:34<00:45, 14.50it/s]
Loading 0:  35%|███▍      | 345/995 [00:35<00:32, 19.91it/s]
Loading 0:  35%|███▌      | 353/995 [00:35<00:24, 25.92it/s]
Loading 0:  36%|███▌      | 359/995 [00:35<00:21, 29.48it/s]
Loading 0:  37%|███▋      | 365/995 [00:35<00:19, 32.69it/s]
Loading 0:  37%|███▋      | 370/995 [00:36<00:48, 12.82it/s]
Loading 0:  38%|███▊      | 376/995 [00:36<00:37, 16.54it/s]
Loading 0:  39%|███▊      | 384/995 [00:36<00:27, 22.36it/s]
Loading 0:  39%|███▉      | 390/995 [00:37<00:24, 24.63it/s]
Loading 0:  40%|███▉      | 396/995 [00:37<00:22, 26.70it/s]
Loading 0:  40%|████      | 402/995 [00:37<00:21, 28.09it/s]
Loading 0:  41%|████▏     | 412/995 [00:37<00:16, 35.67it/s]
Loading 0:  42%|████▏     | 418/995 [00:37<00:16, 35.75it/s]
Loading 0:  43%|████▎     | 423/995 [00:38<00:46, 12.36it/s]
Loading 0:  43%|████▎     | 427/995 [00:39<00:41, 13.69it/s]
Loading 0:  44%|████▎     | 433/995 [00:39<00:33, 16.75it/s]
Loading 0:  45%|████▍     | 443/995 [00:39<00:22, 24.06it/s]
Loading 0:  45%|████▌     | 449/995 [00:39<00:21, 25.82it/s]
Loading 0:  46%|████▌     | 455/995 [00:39<00:19, 27.50it/s]
Loading 0:  46%|████▋     | 461/995 [00:40<00:18, 28.99it/s]
Loading 0:  47%|████▋     | 467/995 [00:40<00:15, 34.05it/s]
Loading 0:  48%|████▊     | 474/995 [00:40<00:14, 35.93it/s]
Loading 0:  48%|████▊     | 479/995 [00:41<00:40, 12.61it/s]
Loading 0:  49%|████▊     | 483/995 [00:41<00:36, 14.04it/s]
Loading 0:  49%|████▉     | 489/995 [00:41<00:29, 17.40it/s]
Loading 0:  50%|████▉     | 495/995 [00:42<00:24, 20.64it/s]
Loading 0:  51%|█████     | 505/995 [00:42<00:17, 28.56it/s]
Loading 0:  51%|█████▏    | 511/995 [00:42<00:16, 29.48it/s]
Loading 0:  52%|█████▏    | 515/995 [00:42<00:15, 31.07it/s]
Loading 0:  52%|█████▏    | 520/995 [00:42<00:15, 30.62it/s]
Loading 0:  53%|█████▎    | 526/995 [00:43<00:41, 11.24it/s]
Loading 0:  54%|█████▍    | 536/995 [00:44<00:26, 17.15it/s]
Loading 0:  54%|█████▍    | 542/995 [00:44<00:22, 19.73it/s]
Loading 0:  55%|█████▌    | 548/995 [00:44<00:19, 22.50it/s]
Loading 0:  56%|█████▌    | 554/995 [00:44<00:17, 25.02it/s]
Loading 0:  56%|█████▋    | 562/995 [00:44<00:14, 29.88it/s]
Loading 0:  57%|█████▋    | 566/995 [01:00<05:55,  1.21it/s]
Loading 0:  57%|█████▋    | 570/995 [01:00<04:37,  1.53it/s]
Loading 0:  58%|█████▊    | 576/995 [01:01<03:08,  2.23it/s]
Loading 0:  58%|█████▊    | 581/995 [01:02<02:39,  2.59it/s]
Loading 0:  59%|█████▊    | 584/995 [01:02<02:17,  2.98it/s]
Loading 0:  59%|█████▉    | 588/995 [01:02<01:44,  3.88it/s]
Loading 0:  60%|██████    | 598/995 [01:02<00:54,  7.26it/s]
Loading 0:  61%|██████    | 604/995 [01:02<00:40,  9.71it/s]
Loading 0:  61%|██████▏   | 610/995 [01:03<00:30, 12.69it/s]
Loading 0:  62%|██████▏   | 616/995 [01:03<00:23, 16.29it/s]
Loading 0:  63%|██████▎   | 624/995 [01:03<00:16, 22.48it/s]
Loading 0:  64%|██████▎   | 632/995 [01:03<00:12, 28.92it/s]
Loading 0:  64%|██████▍   | 638/995 [01:04<00:28, 12.58it/s]
Loading 0:  65%|██████▍   | 644/995 [01:04<00:22, 15.37it/s]
Loading 0:  65%|██████▌   | 650/995 [01:04<00:18, 18.74it/s]
Loading 0:  66%|██████▋   | 660/995 [01:05<00:12, 27.08it/s]
Loading 0:  67%|██████▋   | 666/995 [01:05<00:11, 28.86it/s]
Loading 0:  68%|██████▊   | 672/995 [01:05<00:10, 31.15it/s]
Loading 0:  68%|██████▊   | 678/995 [01:05<00:09, 34.31it/s]
Loading 0:  69%|██████▉   | 686/995 [01:05<00:07, 41.74it/s]
Loading 0:  70%|██████▉   | 692/995 [01:06<00:20, 14.98it/s]
Loading 0:  70%|███████   | 697/995 [01:06<00:16, 17.54it/s]
Loading 0:  71%|███████   | 703/995 [01:07<00:13, 21.34it/s]
Loading 0:  71%|███████▏  | 709/995 [01:07<00:11, 24.80it/s]
Loading 0:  72%|███████▏  | 717/995 [01:07<00:08, 31.11it/s]
Loading 0:  73%|███████▎  | 725/995 [01:07<00:07, 36.32it/s]
Loading 0:  73%|███████▎  | 731/995 [01:07<00:06, 38.38it/s]
Loading 0:  74%|███████▍  | 737/995 [01:07<00:06, 40.62it/s]
Loading 0:  75%|███████▍  | 742/995 [01:08<00:19, 13.21it/s]
Loading 0:  75%|███████▌  | 748/995 [01:09<00:14, 16.66it/s]
Loading 0:  76%|███████▌  | 756/995 [01:09<00:10, 22.50it/s]
Loading 0:  77%|███████▋  | 762/995 [01:09<00:08, 25.95it/s]
Loading 0:  77%|███████▋  | 768/995 [01:09<00:07, 29.88it/s]
Loading 0:  78%|███████▊  | 774/995 [01:09<00:06, 33.53it/s]
Loading 0:  79%|███████▉  | 784/995 [01:09<00:04, 43.47it/s]
Loading 0:  79%|███████▉  | 790/995 [01:09<00:04, 44.73it/s]
Loading 0:  80%|████████  | 796/995 [01:11<00:14, 14.05it/s]
Loading 0:  81%|████████  | 802/995 [01:11<00:11, 16.99it/s]
Loading 0:  81%|████████▏ | 810/995 [01:11<00:08, 22.91it/s]
Loading 0:  82%|████████▏ | 818/995 [01:11<00:06, 28.94it/s]
Loading 0:  83%|████████▎ | 824/995 [01:11<00:05, 32.58it/s]
Loading 0:  83%|████████▎ | 830/995 [01:11<00:04, 36.36it/s]
Loading 0:  84%|████████▍ | 836/995 [01:11<00:04, 38.75it/s]
Loading 0:  85%|████████▍ | 845/995 [01:22<00:03, 38.75it/s]
Loading 0:  85%|████████▌ | 846/995 [01:27<01:34,  1.57it/s]
Loading 0:  85%|████████▌ | 849/995 [01:28<01:28,  1.65it/s]
Loading 0:  86%|████████▌ | 855/995 [01:28<01:00,  2.32it/s]
Loading 0:  87%|████████▋ | 861/995 [01:28<00:41,  3.23it/s]
Loading 0:  87%|████████▋ | 867/995 [01:28<00:28,  4.49it/s]
Loading 0:  88%|████████▊ | 877/995 [01:29<00:15,  7.41it/s]
Loading 0:  89%|████████▉ | 884/995 [01:29<00:11,  9.96it/s]
Loading 0:  90%|████████▉ | 891/995 [01:29<00:07, 13.22it/s]
Loading 0:  90%|█████████ | 898/995 [01:30<00:10,  9.63it/s]
Loading 0:  91%|█████████▏| 908/995 [01:30<00:05, 14.55it/s]
Loading 0:  92%|█████████▏| 914/995 [01:30<00:04, 17.56it/s]
Loading 0:  92%|█████████▏| 920/995 [01:30<00:03, 21.01it/s]
Loading 0:  93%|█████████▎| 926/995 [01:30<00:02, 25.25it/s]
Loading 0:  94%|█████████▍| 934/995 [01:31<00:01, 32.56it/s]
Loading 0:  95%|█████████▍| 942/995 [01:31<00:01, 39.53it/s]
Loading 0:  95%|█████████▌| 949/995 [01:31<00:01, 44.29it/s]
Loading 0:  96%|█████████▌| 956/995 [01:32<00:02, 16.80it/s]
Loading 0:  97%|█████████▋| 961/995 [01:32<00:01, 19.75it/s]
Loading 0:  97%|█████████▋| 970/995 [01:32<00:00, 27.06it/s]
Loading 0:  98%|█████████▊| 976/995 [01:32<00:00, 30.64it/s]
Loading 0:  99%|█████████▊| 982/995 [01:32<00:00, 34.29it/s]
Loading 0:  99%|█████████▉| 988/995 [01:32<00:00, 37.47it/s]
Loading 0: 100%|██████████| 995/995 [01:34<00:00, 12.42it/s]
                                                            
Job neversleep-noromaid-v0-8068-v152-mkmlizer completed after 401.81s with status: succeeded
Stopping job with name neversleep-noromaid-v0-8068-v152-mkmlizer
Pipeline stage MKMLizer completed in 402.37s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service neversleep-noromaid-v0-8068-v152
Waiting for inference service neversleep-noromaid-v0-8068-v152 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service neversleep-noromaid-v0-8068-v152 ready after 140.85695672035217s
Pipeline stage MKMLDeployer completed in 141.50s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3873372077941895s
Received healthy response to inference request in 2.2314226627349854s
Received healthy response to inference request in 2.3845553398132324s
Received healthy response to inference request in 2.472153902053833s
Received healthy response to inference request in 2.3546645641326904s
5 requests
0 failed requests
5th percentile: 2.2560710430145265
10th percentile: 2.2807194232940673
20th percentile: 2.3300161838531492
30th percentile: 2.3606427192687987
40th percentile: 2.3725990295410155
50th percentile: 2.3845553398132324
60th percentile: 2.4195947647094727
70th percentile: 2.454634189605713
80th percentile: 2.6551905632019044
90th percentile: 3.021263885498047
95th percentile: 3.204300546646118
99th percentile: 3.3507298755645754
mean time: 2.566026735305786
Pipeline stage StressChecker completed in 14.63s
Shutdown handler de-registered
neversleep-noromaid-v0_8068_v152 status is now deployed due to DeploymentManager action
neversleep-noromaid-v0_8068_v152 status is now inactive due to auto deactivation removed underperforming models
neversleep-noromaid-v0_8068_v152 status is now torndown due to DeploymentManager action