neversleep-noromaid-v0_8068

developer_uid: robert_irvine
submission_id: neversleep-noromaid-v0_8068_v145
model_name: neversleep-noromaid-v0_8068_v145
model_group: NeverSleep/Noromaid-v0.1
status: torndown
timestamp: 2024-08-05T02:05:12+00:00
num_battles: 176991
num_wins: 79040
celo_rating: 1127.76
family_friendly_score: 0.0
submission_type: basic
model_repo: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_architecture: MixtralForCausalLM
reward_repo: ChaiML/gpt2_xl_pairwise_89m_step_347634
model_num_parameters: 46702792704.0
best_of: 1
max_input_tokens: 512
max_output_tokens: 64
display_name: neversleep-noromaid-v0_8068_v145
is_internal_developer: True
language_model: NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3
model_size: 47B
ranking_group: single
us_pacific_date: 2024-08-04
win_ratio: 0.44657637958992263
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '<|user|>', '###', '\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64, 'reward_max_token_input': 256}
formatter: {'memory_template': '<s>[INST] This is an entertaining conversation. You are {bot_name} who has the persona: {memory}.\nPlay the role of {bot_name}. Engage in a chat with {user_name} while staying in character. You should create a fun dialogue which entertains {user_name}.\n', 'prompt_template': '{prompt}\n', 'bot_template': '{bot_name}: {message}</s>', 'user_template': '[INST] {user_name}: {message} [/INST]', 'response_template': '{bot_name}:', 'truncate_by_message': False}
reward_formatter: {'bot_template': 'Bot: {message}\n', 'memory_template': '', 'prompt_template': '', 'response_template': 'Bot:', 'truncate_by_message': False, 'user_template': 'User: {message}\n'}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name neversleep-noromaid-v0-8068-v145-mkmlizer
Waiting for job on neversleep-noromaid-v0-8068-v145-mkmlizer to finish
neversleep-noromaid-v0-8068-v145-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
neversleep-noromaid-v0-8068-v145-mkmlizer: ║     _____            __           __                                ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║       /___/                                                         ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  Version: 0.9.9                                                     ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  https://mk1.ai                                                     ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  The license key for the current software has been verified as      ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  belonging to:                                                      ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  Chai Research Corp.                                                ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ║                                                                     ║
neversleep-noromaid-v0-8068-v145-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
neversleep-noromaid-v0-8068-v145-mkmlizer: Downloaded to shared memory in 122.251s
neversleep-noromaid-v0-8068-v145-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpb0t54yzn, device:0
neversleep-noromaid-v0-8068-v145-mkmlizer: Saving flywheel model at /dev/shm/model_cache
neversleep-noromaid-v0-8068-v145-mkmlizer: quantized model in 90.236s
neversleep-noromaid-v0-8068-v145-mkmlizer: Processed model NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3 in 212.487s
neversleep-noromaid-v0-8068-v145-mkmlizer: creating bucket guanaco-mkml-models
neversleep-noromaid-v0-8068-v145-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
neversleep-noromaid-v0-8068-v145-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/config.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/special_tokens_map.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/tokenizer_config.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/tokenizer.model
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/tokenizer.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/flywheel_model.3.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/flywheel_model.3.safetensors
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/flywheel_model.0.safetensors
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/flywheel_model.1.safetensors
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /dev/shm/model_cache/flywheel_model.2.safetensors s3://guanaco-mkml-models/neversleep-noromaid-v0-8068-v145/flywheel_model.2.safetensors
neversleep-noromaid-v0-8068-v145-mkmlizer: loading reward model from ChaiML/gpt2_xl_pairwise_89m_step_347634
neversleep-noromaid-v0-8068-v145-mkmlizer: 
Loading 0:   0%|          | 0/995 [00:00<?, ?it/s]
Loading 0:   1%|          | 9/995 [00:00<00:15, 61.66it/s]
Loading 0:   2%|▏         | 16/995 [00:00<00:16, 59.28it/s]
Loading 0:   2%|▏         | 22/995 [00:00<00:16, 57.39it/s]
Loading 0:   3%|▎         | 28/995 [00:00<00:17, 56.10it/s]
Loading 0:   4%|▎         | 35/995 [00:00<00:16, 59.11it/s]
Loading 0:   4%|▍         | 43/995 [00:00<00:15, 61.28it/s]
Loading 0:   5%|▌         | 50/995 [00:00<00:15, 59.08it/s]
Loading 0:   6%|▌         | 56/995 [00:02<01:03, 14.73it/s]
Loading 0:   6%|▌         | 61/995 [00:02<00:53, 17.53it/s]
Loading 0:   7%|▋         | 71/995 [00:02<00:34, 26.41it/s]
Loading 0:   8%|▊         | 77/995 [00:02<00:30, 30.10it/s]
Loading 0:   8%|▊         | 83/995 [00:02<00:27, 33.60it/s]
Loading 0:   9%|▉         | 89/995 [00:02<00:24, 37.16it/s]
Loading 0:  10%|▉         | 97/995 [00:02<00:20, 44.02it/s]
Loading 0:  11%|█         | 105/995 [00:02<00:17, 50.01it/s]
Loading 0:  11%|█▏        | 112/995 [00:04<00:55, 16.00it/s]
Loading 0:  12%|█▏        | 117/995 [00:04<00:46, 18.78it/s]
Loading 0:  12%|█▏        | 123/995 [00:04<00:37, 23.05it/s]
Loading 0:  13%|█▎        | 133/995 [00:04<00:26, 32.77it/s]
Loading 0:  14%|█▍        | 139/995 [00:04<00:24, 35.57it/s]
Loading 0:  15%|█▍        | 145/995 [00:04<00:22, 37.95it/s]
Loading 0:  15%|█▌        | 151/995 [00:04<00:20, 41.30it/s]
Loading 0:  16%|█▌        | 159/995 [00:04<00:17, 47.89it/s]
Loading 0:  17%|█▋        | 165/995 [00:05<00:52, 15.82it/s]
Loading 0:  17%|█▋        | 170/995 [00:06<00:44, 18.72it/s]
Loading 0:  18%|█▊        | 176/995 [00:06<00:35, 23.06it/s]
Loading 0:  18%|█▊        | 182/995 [00:06<00:30, 26.62it/s]
Loading 0:  19%|█▉        | 190/995 [00:06<00:23, 34.82it/s]
Loading 0:  20%|█▉        | 198/995 [00:06<00:18, 42.72it/s]
Loading 0:  21%|██        | 205/995 [00:06<00:17, 44.29it/s]
Loading 0:  21%|██        | 211/995 [00:07<00:52, 14.99it/s]
Loading 0:  22%|██▏       | 216/995 [00:07<00:43, 17.92it/s]
Loading 0:  23%|██▎       | 226/995 [00:07<00:28, 26.84it/s]
Loading 0:  23%|██▎       | 232/995 [00:08<00:25, 30.17it/s]
Loading 0:  24%|██▍       | 238/995 [00:08<00:22, 34.33it/s]
Loading 0:  25%|██▍       | 244/995 [00:08<00:19, 38.23it/s]
Loading 0:  25%|██▌       | 252/995 [00:08<00:16, 45.94it/s]
Loading 0:  26%|██▌       | 260/995 [00:08<00:15, 48.69it/s]
Loading 0:  27%|██▋       | 266/995 [00:09<00:46, 15.55it/s]
Loading 0:  27%|██▋       | 272/995 [00:09<00:37, 19.06it/s]
Loading 0:  28%|██▊       | 277/995 [00:20<00:37, 19.06it/s]
Loading 0:  28%|██▊       | 278/995 [00:24<08:24,  1.42it/s]
Loading 0:  29%|██▉       | 288/995 [00:24<05:01,  2.35it/s]
Loading 0:  30%|██▉       | 295/995 [00:24<03:36,  3.24it/s]
Loading 0:  30%|███       | 302/995 [00:24<02:35,  4.46it/s]
Loading 0:  31%|███       | 309/995 [00:24<01:53,  6.03it/s]
Loading 0:  32%|███▏      | 319/995 [00:24<01:12,  9.27it/s]
Loading 0:  33%|███▎      | 326/995 [00:25<01:20,  8.26it/s]
Loading 0:  33%|███▎      | 331/995 [00:25<01:05, 10.07it/s]
Loading 0:  34%|███▍      | 337/995 [00:26<00:50, 12.92it/s]
Loading 0:  35%|███▍      | 345/995 [00:26<00:36, 17.75it/s]
Loading 0:  35%|███▌      | 353/995 [00:26<00:27, 23.48it/s]
Loading 0:  36%|███▌      | 359/995 [00:26<00:23, 27.64it/s]
Loading 0:  37%|███▋      | 365/995 [00:26<00:19, 31.79it/s]
Loading 0:  37%|███▋      | 371/995 [00:27<00:47, 13.22it/s]
Loading 0:  38%|███▊      | 381/995 [00:27<00:30, 20.12it/s]
Loading 0:  39%|███▉      | 387/995 [00:27<00:25, 23.92it/s]
Loading 0:  39%|███▉      | 393/995 [00:27<00:22, 27.34it/s]
Loading 0:  40%|████      | 399/995 [00:28<00:19, 31.03it/s]
Loading 0:  41%|████      | 407/995 [00:28<00:15, 38.88it/s]
Loading 0:  42%|████▏     | 415/995 [00:28<00:12, 46.25it/s]
Loading 0:  42%|████▏     | 422/995 [00:28<00:11, 48.92it/s]
Loading 0:  43%|████▎     | 429/995 [00:29<00:34, 16.20it/s]
Loading 0:  44%|████▎     | 434/995 [00:29<00:29, 19.03it/s]
Loading 0:  45%|████▍     | 443/995 [00:29<00:20, 26.69it/s]
Loading 0:  45%|████▌     | 449/995 [00:29<00:17, 30.35it/s]
Loading 0:  46%|████▌     | 455/995 [00:29<00:15, 34.27it/s]
Loading 0:  46%|████▋     | 461/995 [00:30<00:13, 38.27it/s]
Loading 0:  47%|████▋     | 469/995 [00:30<00:11, 46.41it/s]
Loading 0:  48%|████▊     | 477/995 [00:30<00:10, 51.23it/s]
Loading 0:  49%|████▊     | 484/995 [00:31<00:31, 16.45it/s]
Loading 0:  49%|████▉     | 489/995 [00:31<00:26, 19.01it/s]
Loading 0:  50%|████▉     | 495/995 [00:31<00:21, 22.78it/s]
Loading 0:  51%|█████     | 505/995 [00:31<00:15, 32.05it/s]
Loading 0:  51%|█████▏    | 511/995 [00:31<00:13, 35.44it/s]
Loading 0:  52%|█████▏    | 517/995 [00:32<00:12, 39.08it/s]
Loading 0:  53%|█████▎    | 523/995 [00:32<00:11, 41.12it/s]
Loading 0:  53%|█████▎    | 529/995 [00:33<00:31, 14.82it/s]
Loading 0:  54%|█████▍    | 536/995 [00:33<00:23, 19.72it/s]
Loading 0:  54%|█████▍    | 542/995 [00:33<00:19, 23.33it/s]
Loading 0:  55%|█████▌    | 548/995 [00:33<00:16, 26.80it/s]
Loading 0:  56%|█████▌    | 554/995 [00:33<00:14, 31.07it/s]
Loading 0:  56%|█████▋    | 562/995 [00:33<00:11, 39.19it/s]
Loading 0:  57%|█████▋    | 568/995 [00:48<04:55,  1.44it/s]
Loading 0:  58%|█████▊    | 573/995 [00:48<03:42,  1.90it/s]
Loading 0:  58%|█████▊    | 579/995 [00:48<02:36,  2.66it/s]
Loading 0:  59%|█████▊    | 584/995 [00:49<02:16,  3.00it/s]
Loading 0:  59%|█████▉    | 588/995 [00:49<01:46,  3.81it/s]
Loading 0:  60%|██████    | 598/995 [00:50<00:59,  6.72it/s]
Loading 0:  61%|██████    | 604/995 [00:50<00:44,  8.84it/s]
Loading 0:  61%|██████▏   | 610/995 [00:50<00:33, 11.56it/s]
Loading 0:  62%|██████▏   | 616/995 [00:50<00:25, 14.95it/s]
Loading 0:  63%|██████▎   | 624/995 [00:50<00:17, 20.80it/s]
Loading 0:  64%|██████▎   | 632/995 [00:50<00:13, 26.67it/s]
Loading 0:  64%|██████▍   | 638/995 [00:51<00:27, 13.14it/s]
Loading 0:  65%|██████▍   | 644/995 [00:51<00:21, 16.24it/s]
Loading 0:  65%|██████▌   | 650/995 [00:51<00:17, 20.16it/s]
Loading 0:  66%|██████▋   | 660/995 [00:52<00:11, 29.24it/s]
Loading 0:  67%|██████▋   | 666/995 [00:52<00:10, 31.75it/s]
Loading 0:  68%|██████▊   | 672/995 [00:52<00:09, 34.65it/s]
Loading 0:  68%|██████▊   | 678/995 [00:52<00:08, 37.45it/s]
Loading 0:  69%|██████▉   | 686/995 [00:52<00:07, 44.07it/s]
Loading 0:  70%|██████▉   | 692/995 [00:53<00:18, 15.97it/s]
Loading 0:  70%|███████   | 697/995 [00:53<00:15, 18.85it/s]
Loading 0:  71%|███████   | 703/995 [00:53<00:12, 22.89it/s]
Loading 0:  71%|███████▏  | 709/995 [00:53<00:10, 27.51it/s]
Loading 0:  72%|███████▏  | 717/995 [00:54<00:07, 35.21it/s]
Loading 0:  73%|███████▎  | 725/995 [00:54<00:06, 42.09it/s]
Loading 0:  73%|███████▎  | 731/995 [00:54<00:05, 44.97it/s]
Loading 0:  74%|███████▍  | 737/995 [00:54<00:05, 46.75it/s]
Loading 0:  75%|███████▍  | 743/995 [00:55<00:17, 14.74it/s]
Loading 0:  76%|███████▌  | 753/995 [00:55<00:10, 22.33it/s]
Loading 0:  76%|███████▋  | 759/995 [00:55<00:08, 26.42it/s]
Loading 0:  77%|███████▋  | 765/995 [00:55<00:07, 29.88it/s]
Loading 0:  77%|███████▋  | 771/995 [00:56<00:06, 33.35it/s]
Loading 0:  78%|███████▊  | 779/995 [00:56<00:05, 41.07it/s]
Loading 0:  79%|███████▉  | 787/995 [00:56<00:04, 45.62it/s]
Loading 0:  80%|███████▉  | 793/995 [00:56<00:04, 46.36it/s]
Loading 0:  80%|████████  | 799/995 [00:57<00:12, 15.31it/s]
Loading 0:  81%|████████  | 805/995 [00:57<00:09, 19.15it/s]
Loading 0:  82%|████████▏ | 815/995 [00:57<00:06, 27.60it/s]
Loading 0:  83%|████████▎ | 821/995 [00:57<00:05, 31.24it/s]
Loading 0:  83%|████████▎ | 827/995 [00:57<00:04, 35.00it/s]
Loading 0:  84%|████████▎ | 833/995 [00:58<00:04, 38.43it/s]
Loading 0:  85%|████████▍ | 841/995 [00:58<00:03, 45.34it/s]
Loading 0:  85%|████████▍ | 845/995 [01:12<00:03, 45.34it/s]
Loading 0:  85%|████████▌ | 846/995 [01:12<01:43,  1.43it/s]
Loading 0:  85%|████████▌ | 849/995 [01:13<01:34,  1.54it/s]
Loading 0:  86%|████████▌ | 855/995 [01:13<01:02,  2.25it/s]
Loading 0:  87%|████████▋ | 861/995 [01:14<00:41,  3.23it/s]
Loading 0:  87%|████████▋ | 867/995 [01:14<00:28,  4.56it/s]
Loading 0:  88%|████████▊ | 877/995 [01:14<00:15,  7.67it/s]
Loading 0:  89%|████████▉ | 884/995 [01:14<00:10, 10.26it/s]
Loading 0:  89%|████████▉ | 890/995 [01:14<00:08, 13.00it/s]
Loading 0:  90%|█████████ | 896/995 [01:14<00:06, 16.45it/s]
Loading 0:  91%|█████████ | 902/995 [01:15<00:08, 10.75it/s]
Loading 0:  91%|█████████▏| 908/995 [01:15<00:06, 13.94it/s]
Loading 0:  92%|█████████▏| 914/995 [01:15<00:04, 17.74it/s]
Loading 0:  92%|█████████▏| 920/995 [01:16<00:03, 22.19it/s]
Loading 0:  93%|█████████▎| 926/995 [01:16<00:02, 26.73it/s]
Loading 0:  94%|█████████▍| 934/995 [01:16<00:01, 34.33it/s]
Loading 0:  95%|█████████▍| 942/995 [01:16<00:01, 41.82it/s]
Loading 0:  95%|█████████▌| 949/995 [01:16<00:00, 46.19it/s]
Loading 0:  96%|█████████▌| 956/995 [01:17<00:02, 17.75it/s]
Loading 0:  97%|█████████▋| 961/995 [01:17<00:01, 20.34it/s]
Loading 0:  97%|█████████▋| 970/995 [01:17<00:00, 27.32it/s]
Loading 0:  98%|█████████▊| 976/995 [01:17<00:00, 30.79it/s]
Loading 0:  99%|█████████▊| 982/995 [01:17<00:00, 34.70it/s]
Loading 0:  99%|█████████▉| 988/995 [01:18<00:00, 37.72it/s]
Loading 0: 100%|██████████| 995/995 [01:19<00:00, 12.68it/s]
                                                            
/opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:957: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
neversleep-noromaid-v0-8068-v145-mkmlizer:   warnings.warn(
neversleep-noromaid-v0-8068-v145-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:785: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
neversleep-noromaid-v0-8068-v145-mkmlizer:   warnings.warn(
neversleep-noromaid-v0-8068-v145-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:469: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
neversleep-noromaid-v0-8068-v145-mkmlizer:   warnings.warn(
neversleep-noromaid-v0-8068-v145-mkmlizer: 
Downloading shards:   0%|          | 0/2 [00:00<?, ?it/s]
Downloading shards:  50%|█████     | 1/2 [00:05<00:05,  5.56s/it]
Downloading shards: 100%|██████████| 2/2 [00:08<00:00,  4.30s/it]
Downloading shards: 100%|██████████| 2/2 [00:08<00:00,  4.49s/it]
neversleep-noromaid-v0-8068-v145-mkmlizer: 
Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:  50%|█████     | 1/2 [00:00<00:00,  2.44it/s]
Loading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00,  3.93it/s]
Loading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00,  3.60it/s]
neversleep-noromaid-v0-8068-v145-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
neversleep-noromaid-v0-8068-v145-mkmlizer: Saving duration: 1.289s
neversleep-noromaid-v0-8068-v145-mkmlizer: Processed model ChaiML/gpt2_xl_pairwise_89m_step_347634 in 13.780s
neversleep-noromaid-v0-8068-v145-mkmlizer: creating bucket guanaco-reward-models
neversleep-noromaid-v0-8068-v145-mkmlizer: Bucket 's3://guanaco-reward-models/' created
neversleep-noromaid-v0-8068-v145-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward/special_tokens_map.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward/config.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward/tokenizer_config.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward/merges.txt
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward/vocab.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward/tokenizer.json
neversleep-noromaid-v0-8068-v145-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/neversleep-noromaid-v0-8068-v145_reward/reward.tensors
Job neversleep-noromaid-v0-8068-v145-mkmlizer completed after 290.88s with status: succeeded
Stopping job with name neversleep-noromaid-v0-8068-v145-mkmlizer
Pipeline stage MKMLizer completed in 291.53s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.12s
Running pipeline stage ISVCDeployer
Creating inference service neversleep-noromaid-v0-8068-v145
Waiting for inference service neversleep-noromaid-v0-8068-v145 to be ready
Failed to get response for submission chaiml-elo-alignment-run-3_v23: ('http://chaiml-elo-alignment-run-3-v23-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'readfrom tcp 127.0.0.1:42672->127.0.0.1:8080: write tcp 127.0.0.1:42672->127.0.0.1:8080: use of closed network connection\n')
Inference service neversleep-noromaid-v0-8068-v145 ready after 161.02795839309692s
Pipeline stage ISVCDeployer completed in 162.60s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.823837995529175s
Received healthy response to inference request in 1.439732551574707s
Received healthy response to inference request in 1.7551052570343018s
Received healthy response to inference request in 1.7373242378234863s
Received healthy response to inference request in 1.5877130031585693s
5 requests
0 failed requests
5th percentile: 1.4693286418914795
10th percentile: 1.498924732208252
20th percentile: 1.5581169128417969
30th percentile: 1.6176352500915527
40th percentile: 1.6774797439575195
50th percentile: 1.7373242378234863
60th percentile: 1.7444366455078124
70th percentile: 1.7515490531921387
80th percentile: 1.9688518047332766
90th percentile: 2.3963449001312256
95th percentile: 2.6100914478302
99th percentile: 2.78108868598938
mean time: 1.8687426090240478
Pipeline stage StressChecker completed in 10.21s
neversleep-noromaid-v0_8068_v145 status is now deployed due to DeploymentManager action
neversleep-noromaid-v0_8068_v145 status is now inactive due to auto deactivation removed underperforming models
neversleep-noromaid-v0_8068_v145 status is now torndown due to DeploymentManager action