submission_id: amazingvince-not-wizardl_8363_v1
developer_uid: chaiverse_console_tests
status: torndown
model_repo: amazingvince/Not-WizardLM-2-7B
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2024-04-16T21:09:42+00:00
model_name: amazingvince-not-wizardl_8363_v1
model_eval_status: success
model_group: amazingvince/Not-WizardL
num_battles: 6482
num_wins: 3381
celo_rating: 1162.8
propriety_score: 0.0
propriety_total_count: 0.0
submission_type: basic
model_architecture: MistralForCausalLM
model_num_parameters: 7241732096.0
best_of: 16
max_input_tokens: 512
max_output_tokens: 64
display_name: amazingvince-not-wizardl_8363_v1
ineligible_reason: propriety_total_count < 800
language_model: amazingvince/Not-WizardLM-2-7B
model_size: 7B
reward_model: ChaiML/reward_gpt2_medium_preference_24m_e2
us_pacific_date: 2024-04-16
win_ratio: 0.521598272138229
preference_data_url: None
Resubmit model
Running pipeline stage MKMLizer
Starting job with name amazingvince-not-wizardl-8363-v1-mkmlizer
Waiting for job on amazingvince-not-wizardl-8363-v1-mkmlizer to finish
amazingvince-not-wizardl-8363-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
amazingvince-not-wizardl-8363-v1-mkmlizer: ║     _____            __           __                                ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║       /___/                                                         ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║                                                                     ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  Version: 0.6.11                                                    ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║                                                                     ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  belonging to:                                                      ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║                                                                     ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  Chai Research Corp.                                                ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ║                                                                     ║
amazingvince-not-wizardl-8363-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
amazingvince-not-wizardl-8363-v1-mkmlizer: 
.gitattributes:   0%|          | 0.00/1.56k [00:00<?, ?B/s]
.gitattributes: 100%|██████████| 1.56k/1.56k [00:00<00:00, 17.9MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
README.md:   0%|          | 0.00/3.34k [00:00<?, ?B/s]
README.md: 100%|██████████| 3.34k/3.34k [00:00<00:00, 51.9MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
config.json:   0%|          | 0.00/618 [00:00<?, ?B/s]
config.json: 100%|██████████| 618/618 [00:00<00:00, 5.28MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
generation_config.json:   0%|          | 0.00/111 [00:00<?, ?B/s]
generation_config.json: 100%|██████████| 111/111 [00:00<00:00, 950kB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
model-00001-of-00003.safetensors:   0%|          | 0.00/4.94G [00:00<?, ?B/s]
model-00001-of-00003.safetensors:   0%|          | 10.5M/4.94G [00:00<03:49, 21.5MB/s]
model-00001-of-00003.safetensors:   1%|          | 52.4M/4.94G [00:00<00:44, 109MB/s] 
model-00001-of-00003.safetensors:   2%|▏         | 115M/4.94G [00:00<00:26, 181MB/s] 
model-00001-of-00003.safetensors:   4%|▎         | 178M/4.94G [00:00<00:19, 250MB/s]
model-00001-of-00003.safetensors:   4%|▍         | 220M/4.94G [00:01<00:17, 277MB/s]
model-00001-of-00003.safetensors:   5%|▌         | 262M/4.94G [00:01<00:15, 301MB/s]
model-00001-of-00003.safetensors:   6%|▌         | 304M/4.94G [00:01<00:16, 281MB/s]
model-00001-of-00003.safetensors:   7%|▋         | 346M/4.94G [00:01<00:14, 310MB/s]
model-00001-of-00003.safetensors:   8%|▊         | 398M/4.94G [00:01<00:12, 356MB/s]
model-00001-of-00003.safetensors:   9%|▉         | 451M/4.94G [00:01<00:12, 349MB/s]
model-00001-of-00003.safetensors:  10%|█         | 514M/4.94G [00:01<00:10, 413MB/s]
model-00001-of-00003.safetensors:  11%|█▏        | 566M/4.94G [00:01<00:10, 408MB/s]
model-00001-of-00003.safetensors:  13%|█▎        | 619M/4.94G [00:02<00:11, 372MB/s]
model-00001-of-00003.safetensors:  13%|█▎        | 661M/4.94G [00:02<00:12, 350MB/s]
model-00001-of-00003.safetensors:  14%|█▍        | 713M/4.94G [00:02<00:11, 377MB/s]
model-00001-of-00003.safetensors:  15%|█▌        | 765M/4.94G [00:02<00:10, 397MB/s]
model-00001-of-00003.safetensors:  17%|█▋        | 828M/4.94G [00:02<00:09, 436MB/s]
model-00001-of-00003.safetensors:  18%|█▊        | 881M/4.94G [00:02<00:09, 448MB/s]
model-00001-of-00003.safetensors:  20%|█▉        | 975M/4.94G [00:02<00:09, 408MB/s]
model-00001-of-00003.safetensors:  21%|██        | 1.03G/4.94G [00:03<00:14, 264MB/s]
model-00001-of-00003.safetensors:  25%|██▌       | 1.24G/4.94G [00:03<00:06, 545MB/s]
model-00001-of-00003.safetensors:  38%|███▊      | 1.88G/4.94G [00:03<00:01, 1.60GB/s]
model-00001-of-00003.safetensors:  43%|████▎     | 2.13G/4.94G [00:03<00:01, 1.66GB/s]
model-00001-of-00003.safetensors:  48%|████▊     | 2.36G/4.94G [00:04<00:02, 1.26GB/s]
model-00001-of-00003.safetensors:  52%|█████▏    | 2.55G/4.94G [00:04<00:01, 1.26GB/s]
model-00001-of-00003.safetensors:  55%|█████▍    | 2.72G/4.94G [00:04<00:02, 1.07GB/s]
model-00001-of-00003.safetensors:  58%|█████▊    | 2.86G/4.94G [00:04<00:01, 1.11GB/s]
model-00001-of-00003.safetensors:  61%|██████    | 3.00G/4.94G [00:04<00:02, 947MB/s] 
model-00001-of-00003.safetensors:  63%|██████▎   | 3.12G/4.94G [00:04<00:01, 1.00GB/s]
model-00001-of-00003.safetensors:  66%|██████▌   | 3.25G/4.94G [00:05<00:01, 959MB/s] 
model-00001-of-00003.safetensors:  68%|██████▊   | 3.37G/4.94G [00:05<00:01, 932MB/s]
model-00001-of-00003.safetensors:  70%|███████   | 3.47G/4.94G [00:05<00:01, 946MB/s]
model-00001-of-00003.safetensors:  72%|███████▏  | 3.58G/4.94G [00:05<00:01, 899MB/s]
model-00001-of-00003.safetensors:  76%|███████▌  | 3.73G/4.94G [00:05<00:01, 1.00GB/s]
model-00001-of-00003.safetensors:  78%|███████▊  | 3.84G/4.94G [00:05<00:01, 917MB/s] 
model-00001-of-00003.safetensors:  80%|███████▉  | 3.94G/4.94G [00:05<00:01, 912MB/s]
model-00001-of-00003.safetensors:  83%|████████▎ | 4.10G/4.94G [00:05<00:00, 1.03GB/s]
model-00001-of-00003.safetensors:  85%|████████▌ | 4.22G/4.94G [00:05<00:00, 1.04GB/s]
model-00001-of-00003.safetensors:  88%|████████▊ | 4.33G/4.94G [00:06<00:00, 934MB/s] 
model-00001-of-00003.safetensors:  90%|████████▉ | 4.44G/4.94G [00:06<00:00, 955MB/s]
model-00001-of-00003.safetensors:  99%|█████████▉| 4.90G/4.94G [00:06<00:00, 1.90GB/s]
model-00001-of-00003.safetensors: 100%|█████████▉| 4.94G/4.94G [00:06<00:00, 772MB/s] 
amazingvince-not-wizardl-8363-v1-mkmlizer: 
model-00002-of-00003.safetensors:   0%|          | 0.00/5.00G [00:00<?, ?B/s]
model-00002-of-00003.safetensors:   0%|          | 10.5M/5.00G [00:00<04:39, 17.9MB/s]
model-00002-of-00003.safetensors:   1%|          | 31.5M/5.00G [00:00<01:37, 51.0MB/s]
model-00002-of-00003.safetensors:   1%|▏         | 73.4M/5.00G [00:00<00:40, 123MB/s] 
model-00002-of-00003.safetensors:   2%|▏         | 105M/5.00G [00:01<00:34, 142MB/s] 
model-00002-of-00003.safetensors:   3%|▎         | 126M/5.00G [00:01<00:31, 156MB/s]
model-00002-of-00003.safetensors:   3%|▎         | 157M/5.00G [00:01<00:30, 158MB/s]
model-00002-of-00003.safetensors:   4%|▍         | 189M/5.00G [00:01<00:28, 172MB/s]
model-00002-of-00003.safetensors:   5%|▍         | 241M/5.00G [00:01<00:21, 221MB/s]
model-00002-of-00003.safetensors:   5%|▌         | 273M/5.00G [00:01<00:21, 224MB/s]
model-00002-of-00003.safetensors:   6%|▌         | 304M/5.00G [00:01<00:22, 212MB/s]
model-00002-of-00003.safetensors:   7%|▋         | 367M/5.00G [00:02<00:15, 294MB/s]
model-00002-of-00003.safetensors:   8%|▊         | 409M/5.00G [00:02<00:16, 271MB/s]
model-00002-of-00003.safetensors:  10%|▉         | 482M/5.00G [00:02<00:17, 262MB/s]
model-00002-of-00003.safetensors:  10%|█         | 514M/5.00G [00:02<00:20, 217MB/s]
model-00002-of-00003.safetensors:  11%|█▏        | 566M/5.00G [00:03<00:27, 160MB/s]
model-00002-of-00003.safetensors:  13%|█▎        | 661M/5.00G [00:03<00:16, 256MB/s]
model-00002-of-00003.safetensors:  16%|█▋        | 818M/5.00G [00:03<00:09, 445MB/s]
model-00002-of-00003.safetensors:  32%|███▏      | 1.60G/5.00G [00:03<00:01, 1.73GB/s]
model-00002-of-00003.safetensors:  38%|███▊      | 1.89G/5.00G [00:03<00:02, 1.37GB/s]
model-00002-of-00003.safetensors:  42%|████▏     | 2.12G/5.00G [00:04<00:02, 1.32GB/s]
model-00002-of-00003.safetensors:  46%|████▋     | 2.32G/5.00G [00:04<00:02, 1.12GB/s]
model-00002-of-00003.safetensors:  49%|████▉     | 2.47G/5.00G [00:04<00:02, 1.01GB/s]
model-00002-of-00003.safetensors:  52%|█████▏    | 2.61G/5.00G [00:04<00:02, 929MB/s] 
model-00002-of-00003.safetensors:  55%|█████▍    | 2.73G/5.00G [00:04<00:02, 887MB/s]
model-00002-of-00003.safetensors:  57%|█████▋    | 2.83G/5.00G [00:05<00:02, 911MB/s]
model-00002-of-00003.safetensors:  59%|█████▉    | 2.95G/5.00G [00:05<00:02, 922MB/s]
model-00002-of-00003.safetensors:  61%|██████    | 3.05G/5.00G [00:05<00:02, 809MB/s]
model-00002-of-00003.safetensors:  63%|██████▎   | 3.16G/5.00G [00:05<00:02, 809MB/s]
model-00002-of-00003.safetensors:  65%|██████▌   | 3.25G/5.00G [00:05<00:02, 724MB/s]
model-00002-of-00003.safetensors:  68%|██████▊   | 3.38G/5.00G [00:05<00:01, 812MB/s]
model-00002-of-00003.safetensors:  69%|██████▉   | 3.47G/5.00G [00:06<00:02, 573MB/s]
model-00002-of-00003.safetensors:  71%|███████   | 3.54G/5.00G [00:06<00:02, 538MB/s]
model-00002-of-00003.safetensors:  72%|███████▏  | 3.61G/5.00G [00:06<00:02, 542MB/s]
model-00002-of-00003.safetensors:  76%|███████▌  | 3.77G/5.00G [00:06<00:01, 773MB/s]
model-00002-of-00003.safetensors:  83%|████████▎ | 4.15G/5.00G [00:06<00:00, 1.43GB/s]
model-00002-of-00003.safetensors:  87%|████████▋ | 4.33G/5.00G [00:06<00:00, 1.43GB/s]
model-00002-of-00003.safetensors:  91%|█████████ | 4.54G/5.00G [00:06<00:00, 1.58GB/s]
model-00002-of-00003.safetensors:  97%|█████████▋| 4.83G/5.00G [00:06<00:00, 1.91GB/s]
model-00002-of-00003.safetensors: 100%|█████████▉| 5.00G/5.00G [00:06<00:00, 716MB/s] 
amazingvince-not-wizardl-8363-v1-mkmlizer: 
model-00003-of-00003.safetensors:   0%|          | 0.00/4.54G [00:00<?, ?B/s]
model-00003-of-00003.safetensors:   0%|          | 10.5M/4.54G [00:00<03:32, 21.3MB/s]
model-00003-of-00003.safetensors:   1%|▏         | 62.9M/4.54G [00:00<00:42, 105MB/s] 
model-00003-of-00003.safetensors:   2%|▏         | 94.4M/4.54G [00:00<00:34, 129MB/s]
model-00003-of-00003.safetensors:   3%|▎         | 126M/4.54G [00:01<00:28, 156MB/s] 
model-00003-of-00003.safetensors:   3%|▎         | 157M/4.54G [00:01<00:23, 186MB/s]
model-00003-of-00003.safetensors:   4%|▍         | 189M/4.54G [00:01<00:20, 212MB/s]
model-00003-of-00003.safetensors:   5%|▍         | 220M/4.54G [00:01<00:20, 209MB/s]
model-00003-of-00003.safetensors:   6%|▌         | 262M/4.54G [00:01<00:16, 253MB/s]
model-00003-of-00003.safetensors:   6%|▋         | 294M/4.54G [00:01<00:19, 217MB/s]
model-00003-of-00003.safetensors:   7%|▋         | 325M/4.54G [00:01<00:18, 226MB/s]
model-00003-of-00003.safetensors:   8%|▊         | 357M/4.54G [00:01<00:19, 214MB/s]
model-00003-of-00003.safetensors:   9%|▊         | 388M/4.54G [00:02<00:18, 221MB/s]
model-00003-of-00003.safetensors:   9%|▉         | 419M/4.54G [00:02<00:17, 239MB/s]
model-00003-of-00003.safetensors:  10%|▉         | 451M/4.54G [00:02<00:19, 212MB/s]
model-00003-of-00003.safetensors:  11%|█         | 482M/4.54G [00:02<00:20, 195MB/s]
model-00003-of-00003.safetensors:  11%|█         | 503M/4.54G [00:02<00:22, 177MB/s]
model-00003-of-00003.safetensors:  12%|█▏        | 556M/4.54G [00:02<00:18, 217MB/s]
model-00003-of-00003.safetensors:  13%|█▎        | 587M/4.54G [00:03<00:17, 220MB/s]
model-00003-of-00003.safetensors:  14%|█▍        | 629M/4.54G [00:03<00:16, 238MB/s]
model-00003-of-00003.safetensors:  15%|█▍        | 661M/4.54G [00:03<00:23, 162MB/s]
model-00003-of-00003.safetensors:  18%|█▊        | 818M/4.54G [00:03<00:09, 394MB/s]
model-00003-of-00003.safetensors:  34%|███▎      | 1.53G/4.54G [00:03<00:01, 1.68GB/s]
model-00003-of-00003.safetensors:  39%|███▉      | 1.79G/4.54G [00:03<00:01, 1.58GB/s]
model-00003-of-00003.safetensors:  44%|████▍     | 2.01G/4.54G [00:04<00:01, 1.29GB/s]
model-00003-of-00003.safetensors:  48%|████▊     | 2.20G/4.54G [00:04<00:02, 971MB/s] 
model-00003-of-00003.safetensors:  52%|█████▏    | 2.35G/4.54G [00:04<00:02, 845MB/s]
model-00003-of-00003.safetensors:  55%|█████▍    | 2.47G/4.54G [00:05<00:02, 763MB/s]
model-00003-of-00003.safetensors:  57%|█████▋    | 2.58G/4.54G [00:05<00:02, 740MB/s]
model-00003-of-00003.safetensors:  59%|█████▉    | 2.67G/4.54G [00:05<00:02, 728MB/s]
model-00003-of-00003.safetensors:  61%|██████    | 2.76G/4.54G [00:05<00:02, 699MB/s]
model-00003-of-00003.safetensors:  63%|██████▎   | 2.84G/4.54G [00:05<00:02, 676MB/s]
model-00003-of-00003.safetensors:  64%|██████▍   | 2.93G/4.54G [00:05<00:02, 682MB/s]
model-00003-of-00003.safetensors:  67%|██████▋   | 3.06G/4.54G [00:05<00:01, 828MB/s]
model-00003-of-00003.safetensors:  70%|██████▉   | 3.16G/4.54G [00:05<00:01, 817MB/s]
model-00003-of-00003.safetensors:  72%|███████▏  | 3.26G/4.54G [00:06<00:01, 873MB/s]
model-00003-of-00003.safetensors:  74%|███████▍  | 3.38G/4.54G [00:06<00:01, 939MB/s]
model-00003-of-00003.safetensors:  77%|███████▋  | 3.48G/4.54G [00:06<00:01, 585MB/s]
model-00003-of-00003.safetensors:  80%|███████▉  | 3.62G/4.54G [00:06<00:01, 707MB/s]
model-00003-of-00003.safetensors:  90%|█████████ | 4.09G/4.54G [00:06<00:00, 1.53GB/s]
model-00003-of-00003.safetensors:  97%|█████████▋| 4.38G/4.54G [00:06<00:00, 1.85GB/s]
model-00003-of-00003.safetensors: 100%|█████████▉| 4.54G/4.54G [00:06<00:00, 651MB/s] 
amazingvince-not-wizardl-8363-v1-mkmlizer: 
model.safetensors.index.json:   0%|          | 0.00/23.9k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 23.9k/23.9k [00:00<00:00, 32.4MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/438 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 438/438 [00:00<00:00, 6.85MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
tokenizer.model:   0%|          | 0.00/493k [00:00<?, ?B/s]
tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 63.0MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/970 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 970/970 [00:00<00:00, 15.1MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
wiz.pdf:   0%|          | 0.00/2.00M [00:00<?, ?B/s]
wiz.pdf: 100%|██████████| 2.00M/2.00M [00:00<00:00, 42.1MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: Downloaded to shared memory in 22.586s
amazingvince-not-wizardl-8363-v1-mkmlizer: quantizing model to /dev/shm/model_cache
amazingvince-not-wizardl-8363-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
amazingvince-not-wizardl-8363-v1-mkmlizer: Reading /tmp/tmpto3z41s2/model.safetensors.index.json
amazingvince-not-wizardl-8363-v1-mkmlizer: 
Profiling:   0%|          | 0/291 [00:00<?, ?it/s]
Profiling:   0%|          | 1/291 [00:01<07:41,  1.59s/it]
Profiling:   4%|▍         | 13/291 [00:01<00:26, 10.44it/s]
Profiling:  10%|▉         | 28/291 [00:01<00:10, 24.82it/s]
Profiling:  15%|█▌        | 45/291 [00:01<00:05, 43.01it/s]
Profiling:  20%|██        | 59/291 [00:02<00:04, 57.63it/s]
Profiling:  25%|██▌       | 73/291 [00:02<00:03, 72.07it/s]
Profiling:  31%|███       | 90/291 [00:02<00:02, 90.08it/s]
Profiling:  36%|███▌      | 104/291 [00:02<00:03, 55.94it/s]
Profiling:  42%|████▏     | 121/291 [00:02<00:02, 72.33it/s]
Profiling:  47%|████▋     | 138/291 [00:02<00:01, 88.61it/s]
Profiling:  53%|█████▎    | 153/291 [00:03<00:01, 99.94it/s]
Profiling:  57%|█████▋    | 167/291 [00:03<00:01, 105.49it/s]
Profiling:  63%|██████▎   | 184/291 [00:03<00:00, 119.44it/s]
Profiling:  69%|██████▉   | 202/291 [00:03<00:00, 134.03it/s]
Profiling:  75%|███████▍  | 218/291 [00:05<00:02, 24.62it/s] 
Profiling:  79%|███████▉  | 231/291 [00:05<00:01, 30.84it/s]
Profiling:  85%|████████▌ | 248/291 [00:05<00:01, 41.72it/s]
Profiling:  91%|█████████ | 265/291 [00:05<00:00, 54.55it/s]
Profiling:  96%|█████████▌| 280/291 [00:05<00:00, 66.31it/s]
Profiling: 100%|██████████| 291/291 [00:06<00:00, 48.34it/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: quantized model in 17.918s
amazingvince-not-wizardl-8363-v1-mkmlizer: Processed model amazingvince/Not-WizardLM-2-7B in 42.011s
amazingvince-not-wizardl-8363-v1-mkmlizer: creating bucket guanaco-mkml-models
amazingvince-not-wizardl-8363-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
amazingvince-not-wizardl-8363-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/amazingvince-not-wizardl-8363-v1
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/amazingvince-not-wizardl-8363-v1/config.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/amazingvince-not-wizardl-8363-v1/special_tokens_map.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/amazingvince-not-wizardl-8363-v1/tokenizer.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/amazingvince-not-wizardl-8363-v1/tokenizer_config.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/amazingvince-not-wizardl-8363-v1/tokenizer.model
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/amazingvince-not-wizardl-8363-v1/mkml_model.tensors
amazingvince-not-wizardl-8363-v1-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
amazingvince-not-wizardl-8363-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
amazingvince-not-wizardl-8363-v1-mkmlizer:   warnings.warn(
amazingvince-not-wizardl-8363-v1-mkmlizer: 
config.json:   0%|          | 0.00/1.05k [00:00<?, ?B/s]
config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 12.2MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
amazingvince-not-wizardl-8363-v1-mkmlizer:   warnings.warn(
amazingvince-not-wizardl-8363-v1-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/234 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 3.21MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
vocab.json:   0%|          | 0.00/1.04M [00:00<?, ?B/s]
vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 11.1MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: 
tokenizer.json:   0%|          | 0.00/2.11M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 16.5MB/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 16.4MB/s]
amazingvince-not-wizardl-8363-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
amazingvince-not-wizardl-8363-v1-mkmlizer:   warnings.warn(
amazingvince-not-wizardl-8363-v1-mkmlizer: 
pytorch_model.bin:   0%|          | 0.00/1.44G [00:00<?, ?B/s]
pytorch_model.bin:   1%|          | 10.5M/1.44G [00:00<00:21, 67.5MB/s]
pytorch_model.bin:   2%|▏         | 31.5M/1.44G [00:00<00:16, 86.9MB/s]
pytorch_model.bin:   9%|▊         | 126M/1.44G [00:00<00:03, 346MB/s]  
pytorch_model.bin:  12%|█▏        | 178M/1.44G [00:00<00:03, 387MB/s]
pytorch_model.bin:  16%|█▌        | 231M/1.44G [00:01<00:07, 161MB/s]
pytorch_model.bin:  20%|██        | 294M/1.44G [00:01<00:05, 223MB/s]
pytorch_model.bin:  27%|██▋       | 388M/1.44G [00:01<00:03, 340MB/s]
pytorch_model.bin:  42%|████▏     | 608M/1.44G [00:01<00:01, 687MB/s]
pytorch_model.bin:  84%|████████▍ | 1.22G/1.44G [00:01<00:00, 1.82GB/s]
pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:05<00:00, 279MB/s] 
amazingvince-not-wizardl-8363-v1-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
amazingvince-not-wizardl-8363-v1-mkmlizer: Saving duration: 0.327s
amazingvince-not-wizardl-8363-v1-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 10.851s
amazingvince-not-wizardl-8363-v1-mkmlizer: creating bucket guanaco-reward-models
amazingvince-not-wizardl-8363-v1-mkmlizer: Bucket 's3://guanaco-reward-models/' created
amazingvince-not-wizardl-8363-v1-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward/special_tokens_map.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward/config.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward/merges.txt
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward/tokenizer_config.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward/vocab.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward/tokenizer.json
amazingvince-not-wizardl-8363-v1-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/amazingvince-not-wizardl-8363-v1_reward/reward.tensors
Job amazingvince-not-wizardl-8363-v1-mkmlizer completed after 76.45s with status: succeeded
Stopping job with name amazingvince-not-wizardl-8363-v1-mkmlizer
Pipeline stage MKMLizer completed in 80.02s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.12s
Running pipeline stage ISVCDeployer
Creating inference service amazingvince-not-wizardl-8363-v1
Waiting for inference service amazingvince-not-wizardl-8363-v1 to be ready
Inference service amazingvince-not-wizardl-8363-v1 ready after 40.30683517456055s
Pipeline stage ISVCDeployer completed in 47.31s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.7404141426086426s
Received healthy response to inference request in 0.9173078536987305s
Received healthy response to inference request in 1.3423497676849365s
Received healthy response to inference request in 1.1814875602722168s
Received healthy response to inference request in 1.105379581451416s
5 requests
0 failed requests
5th percentile: 0.9549221992492676
10th percentile: 0.9925365447998047
20th percentile: 1.067765235900879
30th percentile: 1.1206011772155762
40th percentile: 1.1510443687438965
50th percentile: 1.1814875602722168
60th percentile: 1.2458324432373047
70th percentile: 1.3101773262023926
80th percentile: 1.4219626426696779
90th percentile: 1.5811883926391601
95th percentile: 1.6608012676239012
99th percentile: 1.7244915676116943
mean time: 1.2573877811431884
Pipeline stage StressChecker completed in 7.08s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.04s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.05s
M-Eval Dataset for topic stay_in_character is loaded
amazingvince-not-wizardl_8363_v1 status is now deployed due to DeploymentManager action
amazingvince-not-wizardl_8363_v1 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of amazingvince-not-wizardl_8363_v1
Running pipeline stage ISVCDeleter
Checking if service amazingvince-not-wizardl-8363-v1 is running
Tearing down inference service amazingvince-not-wizardl-8363-v1
Toredown service amazingvince-not-wizardl-8363-v1
Pipeline stage ISVCDeleter completed in 3.90s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key amazingvince-not-wizardl-8363-v1/config.json from bucket guanaco-mkml-models
Deleting key amazingvince-not-wizardl-8363-v1/mkml_model.tensors from bucket guanaco-mkml-models
Deleting key amazingvince-not-wizardl-8363-v1/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key amazingvince-not-wizardl-8363-v1/tokenizer.json from bucket guanaco-mkml-models
Deleting key amazingvince-not-wizardl-8363-v1/tokenizer.model from bucket guanaco-mkml-models
Deleting key amazingvince-not-wizardl-8363-v1/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key amazingvince-not-wizardl-8363-v1_reward/config.json from bucket guanaco-reward-models
Deleting key amazingvince-not-wizardl-8363-v1_reward/merges.txt from bucket guanaco-reward-models
Deleting key amazingvince-not-wizardl-8363-v1_reward/reward.tensors from bucket guanaco-reward-models
Deleting key amazingvince-not-wizardl-8363-v1_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key amazingvince-not-wizardl-8363-v1_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key amazingvince-not-wizardl-8363-v1_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key amazingvince-not-wizardl-8363-v1_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 3.12s
amazingvince-not-wizardl_8363_v1 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics