neversleep-noromaid-v0_8068

developer_uid: zonemercy
submission_id: neversleep-noromaid-v0_8068_v149
model_name: neversleep-noromaid-v0_8068_v149
model_group: NeverSleep/Noromaid-v0.1
status: torndown
timestamp: 2024-08-16T00:06:42+00:00
num_battles: 8924
num_wins: 3931
celo_rating: 1196.42
family_friendly_score: 0.0
submission_type: basic
model_repo: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_architecture: MixtralForCausalLM
model_num_parameters: 46702792704.0
best_of: 4
max_input_tokens: 512
max_output_tokens: 64
display_name: neversleep-noromaid-v0_8068_v149
is_internal_developer: True
language_model: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_size: 47B
ranking_group: single
us_pacific_date: 2024-08-15
win_ratio: 0.44049753473778575
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': '<s>[INST] This is an entertaining conversation. You are {bot_name} who has the persona: {memory}.\nPlay the role of {bot_name}. Engage in a chat with {user_name} while staying in character. You should create a fun dialogue which entertains {user_name}.\n', 'prompt_template': '{prompt}\n', 'bot_template': '{bot_name}: {message}</s>', 'user_template': '[INST] {user_name}: {message} [/INST]', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name neversleep-noromaid-v0-8068-v149-mkmlizer
Waiting for job on neversleep-noromaid-v0-8068-v149-mkmlizer to finish
neversleep-noromaid-v0-8068-v149-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
neversleep-noromaid-v0-8068-v149-mkmlizer: ║     _____            __           __                                ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║       /___/                                                         ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  Version: 0.9.11                                                    ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  https://mk1.ai                                                     ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  The license key for the current software has been verified as      ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  belonging to:                                                      ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  Chai Research Corp.                                                ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v149-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
neversleep-noromaid-v0-8068-v149-mkmlizer: Downloaded to shared memory in 112.273s
neversleep-noromaid-v0-8068-v149-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmprqux_eq_, device:0
neversleep-noromaid-v0-8068-v149-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
neversleep-noromaid-v0-8068-v149-mkmlizer: quantized model in 93.104s
neversleep-noromaid-v0-8068-v149-mkmlizer: Processed model NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3 in 205.378s
neversleep-noromaid-v0-8068-v149-mkmlizer: creating bucket guanaco-mkml-models
neversleep-noromaid-v0-8068-v149-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
neversleep-noromaid-v0-8068-v149-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/config.json
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/special_tokens_map.json
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/tokenizer_config.json
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/tokenizer.model
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/tokenizer.json
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/flywheel_model.3.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/flywheel_model.3.safetensors
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/flywheel_model.0.safetensors
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/flywheel_model.1.safetensors
neversleep-noromaid-v0-8068-v149-mkmlizer: cp /dev/shm/model_cache/flywheel_model.2.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v149/flywheel_model.2.safetensors
neversleep-noromaid-v0-8068-v149-mkmlizer: 
Loading 0:   0%|          | 0/995 [00:00<?, ?it/s]
Loading 0:   1%|          | 9/995 [00:00<00:16, 59.12it/s]
Loading 0:   2%|▏         | 15/995 [00:00<00:17, 56.31it/s]
Loading 0:   2%|▏         | 21/995 [00:00<00:17, 56.16it/s]
Loading 0:   3%|▎         | 27/995 [00:00<00:17, 55.90it/s]
Loading 0:   4%|▎         | 35/995 [00:00<00:15, 62.55it/s]
Loading 0:   4%|▍         | 43/995 [00:00<00:15, 62.47it/s]
Loading 0:   5%|▌         | 50/995 [00:00<00:15, 62.21it/s]
Loading 0:   6%|▌         | 57/995 [00:02<00:59, 15.69it/s]
Loading 0:   6%|▌         | 62/995 [00:02<00:50, 18.38it/s]
Loading 0:   7%|▋         | 71/995 [00:02<00:36, 25.20it/s]
Loading 0:   8%|▊         | 77/995 [00:02<00:31, 29.28it/s]
Loading 0:   8%|▊         | 83/995 [00:02<00:27, 32.87it/s]
Loading 0:   9%|▉         | 89/995 [00:02<00:25, 36.00it/s]
Loading 0:  10%|▉         | 97/995 [00:02<00:20, 43.81it/s]
Loading 0:  11%|█         | 105/995 [00:02<00:17, 50.70it/s]
Loading 0:  11%|█▏        | 112/995 [00:04<00:56, 15.70it/s]
Loading 0:  12%|█▏        | 117/995 [00:04<00:47, 18.49it/s]
Loading 0:  12%|█▏        | 123/995 [00:04<00:38, 22.73it/s]
Loading 0:  13%|█▎        | 133/995 [00:04<00:26, 32.53it/s]
Loading 0:  14%|█▍        | 140/995 [00:04<00:23, 36.16it/s]
Loading 0:  15%|█▍        | 146/995 [00:04<00:21, 39.19it/s]
Loading 0:  15%|█▌        | 152/995 [00:04<00:20, 41.53it/s]
Loading 0:  16%|█▌        | 159/995 [00:04<00:18, 46.15it/s]
Loading 0:  17%|█▋        | 165/995 [00:05<00:55, 15.08it/s]
Loading 0:  17%|█▋        | 170/995 [00:06<00:46, 17.61it/s]
Loading 0:  18%|█▊        | 176/995 [00:06<00:37, 21.59it/s]
Loading 0:  18%|█▊        | 182/995 [00:06<00:31, 26.19it/s]
Loading 0:  19%|█▉        | 190/995 [00:06<00:23, 33.89it/s]
Loading 0:  20%|█▉        | 198/995 [00:06<00:19, 40.43it/s]
Loading 0:  21%|██        | 204/995 [00:06<00:18, 41.92it/s]
Loading 0:  21%|██        | 210/995 [00:07<00:55, 14.08it/s]
Loading 0:  22%|██▏       | 216/995 [00:08<00:44, 17.56it/s]
Loading 0:  23%|██▎       | 226/995 [00:08<00:29, 25.65it/s]
Loading 0:  23%|██▎       | 232/995 [00:08<00:25, 29.63it/s]
Loading 0:  24%|██▍       | 238/995 [00:08<00:23, 32.80it/s]
Loading 0:  25%|██▍       | 244/995 [00:08<00:21, 35.14it/s]
Loading 0:  25%|██▌       | 252/995 [00:08<00:17, 42.80it/s]
Loading 0:  26%|██▌       | 260/995 [00:08<00:14, 49.84it/s]
Loading 0:  27%|██▋       | 267/995 [00:09<00:45, 15.84it/s]
Loading 0:  27%|██▋       | 272/995 [00:10<00:39, 18.23it/s]
Loading 0:  28%|██▊       | 278/995 [00:24<08:49,  1.35it/s]
Loading 0:  29%|██▉       | 288/995 [00:25<05:15,  2.24it/s]
Loading 0:  30%|██▉       | 294/995 [00:25<03:56,  2.97it/s]
Loading 0:  30%|███       | 300/995 [00:25<02:55,  3.97it/s]
Loading 0:  31%|███       | 306/995 [00:25<02:09,  5.34it/s]
Loading 0:  32%|███▏      | 314/995 [00:25<01:26,  7.85it/s]
Loading 0:  32%|███▏      | 320/995 [00:26<01:35,  7.10it/s]
Loading 0:  33%|███▎      | 325/995 [00:26<01:15,  8.84it/s]
Loading 0:  33%|███▎      | 331/995 [00:26<00:56, 11.68it/s]
Loading 0:  34%|███▍      | 337/995 [00:26<00:43, 15.27it/s]
Loading 0:  35%|███▍      | 345/995 [00:26<00:30, 21.42it/s]
Loading 0:  35%|███▌      | 353/995 [00:27<00:22, 27.92it/s]
Loading 0:  36%|███▌      | 359/995 [00:27<00:20, 31.66it/s]
Loading 0:  37%|███▋      | 365/995 [00:27<00:17, 35.72it/s]
Loading 0:  37%|███▋      | 371/995 [00:28<00:48, 12.95it/s]
Loading 0:  38%|███▊      | 381/995 [00:28<00:31, 19.65it/s]
Loading 0:  39%|███▉      | 387/995 [00:28<00:26, 23.22it/s]
Loading 0:  39%|███▉      | 393/995 [00:28<00:22, 26.86it/s]
Loading 0:  40%|████      | 399/995 [00:29<00:19, 30.93it/s]
Loading 0:  41%|████      | 407/995 [00:29<00:15, 38.75it/s]
Loading 0:  42%|████▏     | 415/995 [00:29<00:12, 45.30it/s]
Loading 0:  42%|████▏     | 422/995 [00:29<00:12, 46.97it/s]
Loading 0:  43%|████▎     | 428/995 [00:30<00:38, 14.86it/s]
Loading 0:  44%|████▎     | 433/995 [00:30<00:31, 17.66it/s]
Loading 0:  45%|████▍     | 443/995 [00:30<00:21, 25.85it/s]
Loading 0:  45%|████▌     | 449/995 [00:30<00:18, 29.57it/s]
Loading 0:  46%|████▌     | 455/995 [00:31<00:16, 33.17it/s]
Loading 0:  46%|████▋     | 461/995 [00:31<00:14, 37.03it/s]
Loading 0:  47%|████▋     | 469/995 [00:31<00:12, 43.68it/s]
Loading 0:  48%|████▊     | 477/995 [00:31<00:10, 49.88it/s]
Loading 0:  49%|████▊     | 484/995 [00:32<00:31, 16.17it/s]
Loading 0:  49%|████▉     | 489/995 [00:32<00:26, 18.80it/s]
Loading 0:  50%|████▉     | 495/995 [00:32<00:22, 22.53it/s]
Loading 0:  51%|█████     | 505/995 [00:32<00:15, 32.13it/s]
Loading 0:  51%|█████▏    | 511/995 [00:33<00:13, 35.75it/s]
Loading 0:  52%|█████▏    | 517/995 [00:33<00:12, 38.73it/s]
Loading 0:  53%|█████▎    | 523/995 [00:33<00:12, 39.18it/s]
Loading 0:  53%|█████▎    | 529/995 [00:34<00:32, 14.14it/s]
Loading 0:  54%|█████▍    | 536/995 [00:34<00:24, 18.82it/s]
Loading 0:  54%|█████▍    | 542/995 [00:34<00:20, 22.15it/s]
Loading 0:  55%|█████▌    | 548/995 [00:34<00:17, 25.99it/s]
Loading 0:  56%|█████▌    | 554/995 [00:34<00:14, 30.66it/s]
Loading 0:  56%|█████▋    | 562/995 [00:35<00:11, 37.65it/s]
Loading 0:  56%|█████▋    | 562/995 [00:49<00:11, 37.65it/s]
Loading 0:  57%|█████▋    | 563/995 [00:49<06:34,  1.10it/s]
Loading 0:  57%|█████▋    | 570/995 [00:50<04:05,  1.73it/s]
Loading 0:  58%|█████▊    | 576/995 [00:50<02:48,  2.49it/s]
Loading 0:  58%|█████▊    | 582/995 [00:51<02:20,  2.94it/s]
Loading 0:  59%|█████▉    | 588/995 [00:51<01:38,  4.15it/s]
Loading 0:  60%|██████    | 598/995 [00:51<00:56,  6.97it/s]
Loading 0:  61%|██████    | 604/995 [00:51<00:43,  9.06it/s]
Loading 0:  61%|██████▏   | 610/995 [00:51<00:33, 11.64it/s]
Loading 0:  62%|██████▏   | 616/995 [00:51<00:25, 14.82it/s]
Loading 0:  63%|██████▎   | 624/995 [00:51<00:18, 20.54it/s]
Loading 0:  64%|██████▎   | 632/995 [00:52<00:13, 26.64it/s]
Loading 0:  64%|██████▍   | 639/995 [00:53<00:27, 13.16it/s]
Loading 0:  65%|██████▍   | 644/995 [00:53<00:22, 15.71it/s]
Loading 0:  65%|██████▌   | 650/995 [00:53<00:17, 19.32it/s]
Loading 0:  66%|██████▋   | 660/995 [00:53<00:11, 27.93it/s]
Loading 0:  67%|██████▋   | 666/995 [00:53<00:10, 31.44it/s]
Loading 0:  68%|██████▊   | 672/995 [00:53<00:09, 35.30it/s]
Loading 0:  68%|██████▊   | 678/995 [00:54<00:08, 38.49it/s]
Loading 0:  69%|██████▉   | 686/995 [00:54<00:06, 44.51it/s]
Loading 0:  70%|██████▉   | 692/995 [00:55<00:20, 15.01it/s]
Loading 0:  70%|███████   | 697/995 [00:55<00:16, 17.97it/s]
Loading 0:  71%|███████   | 703/995 [00:55<00:13, 22.05it/s]
Loading 0:  71%|███████▏  | 709/995 [00:55<00:10, 26.21it/s]
Loading 0:  72%|███████▏  | 717/995 [00:55<00:08, 33.87it/s]
Loading 0:  73%|███████▎  | 725/995 [00:55<00:06, 40.97it/s]
Loading 0:  73%|███████▎  | 731/995 [00:55<00:06, 42.37it/s]
Loading 0:  74%|███████▍  | 737/995 [00:56<00:05, 43.47it/s]
Loading 0:  75%|███████▍  | 743/995 [00:57<00:18, 13.81it/s]
Loading 0:  76%|███████▌  | 753/995 [00:57<00:11, 20.92it/s]
Loading 0:  76%|███████▋  | 759/995 [00:57<00:09, 24.37it/s]
Loading 0:  77%|███████▋  | 765/995 [00:57<00:08, 28.49it/s]
Loading 0:  77%|███████▋  | 771/995 [00:57<00:06, 32.48it/s]
Loading 0:  78%|███████▊  | 779/995 [00:57<00:05, 39.11it/s]
Loading 0:  79%|███████▉  | 787/995 [00:58<00:04, 44.52it/s]
Loading 0:  80%|███████▉  | 793/995 [00:58<00:04, 45.84it/s]
Loading 0:  80%|████████  | 799/995 [00:59<00:13, 14.86it/s]
Loading 0:  81%|████████  | 805/995 [00:59<00:10, 18.45it/s]
Loading 0:  82%|████████▏ | 815/995 [00:59<00:06, 26.93it/s]
Loading 0:  83%|████████▎ | 821/995 [00:59<00:05, 30.40it/s]
Loading 0:  83%|████████▎ | 827/995 [00:59<00:05, 33.57it/s]
Loading 0:  84%|████████▎ | 833/995 [00:59<00:04, 36.47it/s]
Loading 0:  85%|████████▍ | 841/995 [00:59<00:03, 43.53it/s]
Loading 0:  85%|████████▍ | 845/995 [01:10<00:03, 43.53it/s]
Loading 0:  85%|████████▌ | 846/995 [01:14<01:47,  1.39it/s]
Loading 0:  85%|████████▌ | 849/995 [01:16<01:37,  1.49it/s]
Loading 0:  86%|████████▌ | 855/995 [01:16<01:04,  2.18it/s]
Loading 0:  87%|████████▋ | 861/995 [01:16<00:43,  3.11it/s]
Loading 0:  87%|████████▋ | 867/995 [01:16<00:29,  4.40it/s]
Loading 0:  88%|████████▊ | 877/995 [01:16<00:15,  7.40it/s]
Loading 0:  89%|████████▊ | 883/995 [01:16<00:11,  9.50it/s]
Loading 0:  89%|████████▉ | 889/995 [01:16<00:08, 12.27it/s]
Loading 0:  90%|████████▉ | 895/995 [01:17<00:06, 15.72it/s]
Loading 0:  91%|█████████ | 901/995 [01:18<00:09, 10.25it/s]
Loading 0:  91%|█████████▏| 908/995 [01:18<00:06, 14.13it/s]
Loading 0:  92%|█████████▏| 914/995 [01:18<00:04, 17.85it/s]
Loading 0:  92%|█████████▏| 920/995 [01:18<00:03, 22.09it/s]
Loading 0:  93%|█████████▎| 926/995 [01:18<00:02, 26.41it/s]
Loading 0:  94%|█████████▍| 934/995 [01:18<00:01, 34.10it/s]
Loading 0:  95%|█████████▍| 942/995 [01:18<00:01, 41.96it/s]
Loading 0:  95%|█████████▌| 949/995 [01:18<00:00, 46.46it/s]
Loading 0:  96%|█████████▌| 956/995 [01:19<00:02, 16.57it/s]
Loading 0:  97%|█████████▋| 961/995 [01:20<00:01, 19.02it/s]
Loading 0:  97%|█████████▋| 970/995 [01:20<00:00, 26.50it/s]
Loading 0:  98%|█████████▊| 976/995 [01:20<00:00, 29.99it/s]
Loading 0:  99%|█████████▊| 982/995 [01:20<00:00, 32.74it/s]
Loading 0:  99%|█████████▉| 988/995 [01:20<00:00, 34.95it/s]
Loading 0: 100%|██████████| 995/995 [01:21<00:00, 12.40it/s]
                                                            
Job neversleep-noromaid-v0-8068-v149-mkmlizer completed after 251.4s with status: succeeded
Stopping job with name neversleep-noromaid-v0-8068-v149-mkmlizer
Pipeline stage MKMLizer completed in 252.29s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service neversleep-noromaid-v0-8068-v149
Waiting for inference service neversleep-noromaid-v0-8068-v149 to be ready
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Inference service neversleep-noromaid-v0-8068-v149 ready after 241.7604398727417s
Pipeline stage ISVCDeployer completed in 243.30s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.157992124557495s
Received healthy response to inference request in 2.4021155834198s
Received healthy response to inference request in 2.4576244354248047s
Received healthy response to inference request in 2.2158656120300293s
Received healthy response to inference request in 2.9668805599212646s
5 requests
0 failed requests
5th percentile: 2.2531156063079836
10th percentile: 2.2903656005859374
20th percentile: 2.3648655891418455
30th percentile: 2.4132173538208006
40th percentile: 2.4354208946228026
50th percentile: 2.4576244354248047
60th percentile: 2.6613268852233887
70th percentile: 2.8650293350219727
80th percentile: 3.0051028728485107
90th percentile: 3.081547498703003
95th percentile: 3.119769811630249
99th percentile: 3.150347661972046
mean time: 2.640095663070679
Pipeline stage StressChecker completed in 13.95s
neversleep-noromaid-v0_8068_v149 status is now deployed due to DeploymentManager action
neversleep-noromaid-v0_8068_v149 status is now inactive due to auto deactivation removed underperforming models
neversleep-noromaid-v0_8068_v149 status is now torndown due to DeploymentManager action