submission_id: sanjiwatsuki-lelantos-ma_6831_v5
developer_uid: chai_backend_admin
status: torndown
model_repo: SanjiWatsuki/Lelantos-Maid-DPO-7B
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2024-04-02T05:14:58+00:00
model_name: auto_submit_ricum_woheguvaja
model_eval_status: success
model_group: SanjiWatsuki/Lelantos-Ma
num_battles: 5576
num_wins: 2353
celo_rating: 1107.64
propriety_score: 0.0
propriety_total_count: 0.0
submission_type: basic
model_architecture: MistralForCausalLM
model_num_parameters: 7241748480.0
best_of: 1
max_input_tokens: 512
max_output_tokens: 64
display_name: auto_submit_ricum_woheguvaja
ineligible_reason: propriety_total_count < 800
language_model: SanjiWatsuki/Lelantos-Maid-DPO-7B
model_size: 7B
reward_model: ChaiML/reward_gpt2_medium_preference_24m_e2
us_pacific_date: 2024-04-01
win_ratio: 0.421987087517934
preference_data_url: None
Resubmit model
Running pipeline stage MKMLizer
Running pipeline stage MKMLizer
Starting job with name sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer
Waiting for job on sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer to finish
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║     _____            __           __                                ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║       /___/                                                         ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║                                                                     ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  Version: 0.6.11                                                    ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║                                                                     ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  belonging to:                                                      ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║                                                                     ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  Chai Research Corp.                                                ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ║                                                                     ║
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
.gitattributes:   0%|          | 0.00/1.52k [00:00<?, ?B/s]
.gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 17.1MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
README.md:   0%|          | 0.00/867 [00:00<?, ?B/s]
README.md: 100%|██████████| 867/867 [00:00<00:00, 7.24MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
added_tokens.json:   0%|          | 0.00/51.0 [00:00<?, ?B/s]
added_tokens.json: 100%|██████████| 51.0/51.0 [00:00<00:00, 606kB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
config.json:   0%|          | 0.00/652 [00:00<?, ?B/s]
config.json: 100%|██████████| 652/652 [00:00<00:00, 4.81MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
mergekit_config.yml:   0%|          | 0.00/315 [00:00<?, ?B/s]
mergekit_config.yml: 100%|██████████| 315/315 [00:00<00:00, 3.00MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00001-of-00008.safetensors:   0%|          | 0.00/1.89G [00:00<?, ?B/s]
model-00001-of-00008.safetensors:   1%|          | 10.5M/1.89G [00:00<02:57, 10.6MB/s]
model-00001-of-00008.safetensors:   1%|          | 21.0M/1.89G [00:01<02:37, 11.8MB/s]
model-00001-of-00008.safetensors:   2%|▏         | 31.5M/1.89G [00:02<02:14, 13.8MB/s]
model-00001-of-00008.safetensors:   3%|▎         | 52.4M/1.89G [00:02<01:03, 28.9MB/s]
model-00001-of-00008.safetensors:   5%|▍         | 94.4M/1.89G [00:02<00:26, 67.7MB/s]
model-00001-of-00008.safetensors:   6%|▌         | 115M/1.89G [00:02<00:21, 82.8MB/s] 
model-00001-of-00008.safetensors:  10%|▉         | 189M/1.89G [00:02<00:09, 175MB/s] 
model-00001-of-00008.safetensors:  17%|█▋        | 315M/1.89G [00:02<00:04, 351MB/s]
model-00001-of-00008.safetensors:  21%|██        | 388M/1.89G [00:03<00:03, 402MB/s]
model-00001-of-00008.safetensors:  27%|██▋       | 514M/1.89G [00:03<00:02, 572MB/s]
model-00001-of-00008.safetensors:  56%|█████▌    | 1.06G/1.89G [00:03<00:00, 1.67GB/s]
model-00001-of-00008.safetensors:  68%|██████▊   | 1.28G/1.89G [00:03<00:00, 938MB/s] 
model-00001-of-00008.safetensors:  77%|███████▋  | 1.45G/1.89G [00:03<00:00, 987MB/s]
model-00001-of-00008.safetensors:  85%|████████▌ | 1.61G/1.89G [00:04<00:00, 810MB/s]
model-00001-of-00008.safetensors:  92%|█████████▏| 1.73G/1.89G [00:04<00:00, 870MB/s]
model-00001-of-00008.safetensors: 100%|█████████▉| 1.89G/1.89G [00:04<00:00, 426MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00002-of-00008.safetensors:   0%|          | 0.00/1.95G [00:00<?, ?B/s]
model-00002-of-00008.safetensors:   1%|          | 10.5M/1.95G [00:01<04:00, 8.04MB/s]
model-00002-of-00008.safetensors:   3%|▎         | 62.9M/1.95G [00:01<00:32, 58.2MB/s]
model-00002-of-00008.safetensors:   5%|▍         | 94.4M/1.95G [00:01<00:22, 82.6MB/s]
model-00002-of-00008.safetensors:   6%|▋         | 126M/1.95G [00:01<00:19, 93.6MB/s] 
model-00002-of-00008.safetensors:   9%|▉         | 178M/1.95G [00:01<00:11, 148MB/s] 
model-00002-of-00008.safetensors:  11%|█         | 210M/1.95G [00:02<00:12, 142MB/s]
model-00002-of-00008.safetensors:  13%|█▎        | 252M/1.95G [00:02<00:09, 186MB/s]
model-00002-of-00008.safetensors:  15%|█▌        | 294M/1.95G [00:02<00:07, 228MB/s]
model-00002-of-00008.safetensors:  18%|█▊        | 346M/1.95G [00:02<00:05, 287MB/s]
model-00002-of-00008.safetensors:  22%|██▏       | 419M/1.95G [00:02<00:03, 382MB/s]
model-00002-of-00008.safetensors:  31%|███       | 598M/1.95G [00:02<00:01, 686MB/s]
model-00002-of-00008.safetensors:  38%|███▊      | 744M/1.95G [00:02<00:01, 871MB/s]
model-00002-of-00008.safetensors:  44%|████▍     | 860M/1.95G [00:02<00:01, 940MB/s]
model-00002-of-00008.safetensors:  66%|██████▋   | 1.29G/1.95G [00:03<00:00, 1.73GB/s]
model-00002-of-00008.safetensors:  75%|███████▌  | 1.47G/1.95G [00:03<00:00, 660MB/s] 
model-00002-of-00008.safetensors:  82%|████████▏ | 1.60G/1.95G [00:04<00:00, 657MB/s]
model-00002-of-00008.safetensors:  88%|████████▊ | 1.72G/1.95G [00:04<00:00, 713MB/s]
model-00002-of-00008.safetensors: 100%|█████████▉| 1.95G/1.95G [00:04<00:00, 456MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00003-of-00008.safetensors:   0%|          | 0.00/1.90G [00:00<?, ?B/s]
model-00003-of-00008.safetensors:   1%|          | 10.5M/1.90G [00:00<01:09, 27.1MB/s]
model-00003-of-00008.safetensors:   1%|          | 21.0M/1.90G [00:01<02:07, 14.7MB/s]
model-00003-of-00008.safetensors:   2%|▏         | 31.5M/1.90G [00:02<02:07, 14.6MB/s]
model-00003-of-00008.safetensors:   3%|▎         | 52.4M/1.90G [00:02<01:05, 27.9MB/s]
model-00003-of-00008.safetensors:   5%|▍         | 94.4M/1.90G [00:02<00:27, 65.7MB/s]
model-00003-of-00008.safetensors:   8%|▊         | 157M/1.90G [00:02<00:13, 126MB/s]  
model-00003-of-00008.safetensors:  12%|█▏        | 220M/1.90G [00:02<00:08, 195MB/s]
model-00003-of-00008.safetensors:  18%|█▊        | 346M/1.90G [00:02<00:04, 365MB/s]
model-00003-of-00008.safetensors:  27%|██▋       | 503M/1.90G [00:02<00:02, 581MB/s]
model-00003-of-00008.safetensors:  32%|███▏      | 598M/1.90G [00:02<00:02, 630MB/s]
model-00003-of-00008.safetensors:  58%|█████▊    | 1.09G/1.90G [00:03<00:00, 1.44GB/s]
model-00003-of-00008.safetensors:  66%|██████▋   | 1.26G/1.90G [00:03<00:00, 682MB/s] 
model-00003-of-00008.safetensors:  73%|███████▎  | 1.38G/1.90G [00:04<00:00, 620MB/s]
model-00003-of-00008.safetensors:  79%|███████▊  | 1.49G/1.90G [00:04<00:00, 586MB/s]
model-00003-of-00008.safetensors:  85%|████████▌ | 1.61G/1.90G [00:04<00:00, 674MB/s]
model-00003-of-00008.safetensors:  93%|█████████▎| 1.77G/1.90G [00:04<00:00, 817MB/s]
model-00003-of-00008.safetensors: 100%|█████████▉| 1.90G/1.90G [00:04<00:00, 419MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00004-of-00008.safetensors:   0%|          | 0.00/1.95G [00:00<?, ?B/s]
model-00004-of-00008.safetensors:   1%|          | 10.5M/1.95G [00:00<01:10, 27.3MB/s]
model-00004-of-00008.safetensors:   1%|          | 21.0M/1.95G [00:01<02:09, 14.8MB/s]
model-00004-of-00008.safetensors:   2%|▏         | 31.5M/1.95G [00:02<02:30, 12.7MB/s]
model-00004-of-00008.safetensors:   2%|▏         | 41.9M/1.95G [00:02<01:46, 17.9MB/s]
model-00004-of-00008.safetensors:   3%|▎         | 52.4M/1.95G [00:02<01:27, 21.7MB/s]
model-00004-of-00008.safetensors:   5%|▍         | 94.4M/1.95G [00:02<00:31, 59.5MB/s]
model-00004-of-00008.safetensors:   9%|▉         | 178M/1.95G [00:03<00:11, 152MB/s]  
model-00004-of-00008.safetensors:  19%|█▉        | 377M/1.95G [00:03<00:03, 417MB/s]
model-00004-of-00008.safetensors:  24%|██▍       | 472M/1.95G [00:03<00:03, 467MB/s]
model-00004-of-00008.safetensors:  37%|███▋      | 724M/1.95G [00:03<00:01, 843MB/s]
model-00004-of-00008.safetensors:  58%|█████▊    | 1.12G/1.95G [00:03<00:00, 1.45GB/s]
model-00004-of-00008.safetensors:  68%|██████▊   | 1.33G/1.95G [00:04<00:00, 699MB/s] 
model-00004-of-00008.safetensors:  76%|███████▌  | 1.47G/1.95G [00:04<00:00, 565MB/s]
model-00004-of-00008.safetensors:  82%|████████▏ | 1.59G/1.95G [00:04<00:00, 578MB/s]
model-00004-of-00008.safetensors:  89%|████████▊ | 1.73G/1.95G [00:04<00:00, 677MB/s]
model-00004-of-00008.safetensors: 100%|█████████▉| 1.95G/1.95G [00:04<00:00, 390MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00005-of-00008.safetensors:   0%|          | 0.00/1.95G [00:00<?, ?B/s]
model-00005-of-00008.safetensors:   1%|          | 10.5M/1.95G [00:01<04:02, 8.00MB/s]
model-00005-of-00008.safetensors:   1%|          | 21.0M/1.95G [00:01<01:51, 17.3MB/s]
model-00005-of-00008.safetensors:   2%|▏         | 31.5M/1.95G [00:02<01:56, 16.4MB/s]
model-00005-of-00008.safetensors:   2%|▏         | 41.9M/1.95G [00:02<01:30, 21.0MB/s]
model-00005-of-00008.safetensors:   3%|▎         | 62.9M/1.95G [00:02<00:54, 34.3MB/s]
model-00005-of-00008.safetensors:   6%|▌         | 115M/1.95G [00:02<00:20, 87.8MB/s] 
model-00005-of-00008.safetensors:  11%|█▏        | 220M/1.95G [00:02<00:08, 214MB/s] 
model-00005-of-00008.safetensors:  17%|█▋        | 336M/1.95G [00:02<00:04, 359MB/s]
model-00005-of-00008.safetensors:  21%|██        | 409M/1.95G [00:03<00:03, 408MB/s]
model-00005-of-00008.safetensors:  39%|███▉      | 765M/1.95G [00:03<00:01, 1.04GB/s]
model-00005-of-00008.safetensors:  55%|█████▌    | 1.08G/1.95G [00:03<00:00, 1.45GB/s]
model-00005-of-00008.safetensors:  65%|██████▌   | 1.27G/1.95G [00:04<00:01, 655MB/s] 
model-00005-of-00008.safetensors:  73%|███████▎  | 1.42G/1.95G [00:04<00:01, 501MB/s]
model-00005-of-00008.safetensors:  78%|███████▊  | 1.53G/1.95G [00:04<00:00, 503MB/s]
model-00005-of-00008.safetensors:  85%|████████▌ | 1.66G/1.95G [00:04<00:00, 598MB/s]
model-00005-of-00008.safetensors:  99%|█████████▉| 1.93G/1.95G [00:04<00:00, 884MB/s]
model-00005-of-00008.safetensors: 100%|█████████▉| 1.95G/1.95G [00:04<00:00, 389MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00006-of-00008.safetensors:   0%|          | 0.00/1.98G [00:00<?, ?B/s]
model-00006-of-00008.safetensors:   1%|          | 10.5M/1.98G [00:02<07:38, 4.29MB/s]
model-00006-of-00008.safetensors:   1%|          | 21.0M/1.98G [00:02<03:23, 9.63MB/s]
model-00006-of-00008.safetensors:   3%|▎         | 52.4M/1.98G [00:02<01:06, 29.0MB/s]
model-00006-of-00008.safetensors:   5%|▌         | 105M/1.98G [00:02<00:26, 70.3MB/s] 
model-00006-of-00008.safetensors:  10%|▉         | 189M/1.98G [00:03<00:11, 153MB/s] 
model-00006-of-00008.safetensors:  17%|█▋        | 336M/1.98G [00:03<00:05, 327MB/s]
model-00006-of-00008.safetensors:  22%|██▏       | 440M/1.98G [00:03<00:03, 426MB/s]
model-00006-of-00008.safetensors:  30%|███       | 598M/1.98G [00:03<00:02, 632MB/s]
model-00006-of-00008.safetensors:  53%|█████▎    | 1.05G/1.98G [00:03<00:00, 1.35GB/s]
model-00006-of-00008.safetensors:  62%|██████▏   | 1.24G/1.98G [00:04<00:01, 611MB/s] 
model-00006-of-00008.safetensors:  69%|██████▉   | 1.37G/1.98G [00:04<00:01, 553MB/s]
model-00006-of-00008.safetensors:  75%|███████▌  | 1.49G/1.98G [00:04<00:00, 534MB/s]
model-00006-of-00008.safetensors:  80%|███████▉  | 1.58G/1.98G [00:04<00:00, 554MB/s]
model-00006-of-00008.safetensors:  86%|████████▌ | 1.71G/1.98G [00:05<00:00, 652MB/s]
model-00006-of-00008.safetensors:  94%|█████████▎| 1.85G/1.98G [00:05<00:00, 790MB/s]
model-00006-of-00008.safetensors: 100%|█████████▉| 1.98G/1.98G [00:05<00:00, 380MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00007-of-00008.safetensors:   0%|          | 0.00/1.98G [00:00<?, ?B/s]
model-00007-of-00008.safetensors:   1%|          | 10.5M/1.98G [00:00<01:12, 27.3MB/s]
model-00007-of-00008.safetensors:   1%|          | 21.0M/1.98G [00:01<02:43, 12.0MB/s]
model-00007-of-00008.safetensors:   2%|▏         | 31.5M/1.98G [00:02<02:22, 13.7MB/s]
model-00007-of-00008.safetensors:   3%|▎         | 52.4M/1.98G [00:02<01:13, 26.2MB/s]
model-00007-of-00008.safetensors:   4%|▎         | 73.4M/1.98G [00:02<00:48, 39.4MB/s]
model-00007-of-00008.safetensors:   6%|▋         | 126M/1.98G [00:02<00:20, 89.8MB/s] 
model-00007-of-00008.safetensors:   9%|▉         | 178M/1.98G [00:02<00:12, 146MB/s] 
model-00007-of-00008.safetensors:  15%|█▍        | 294M/1.98G [00:02<00:05, 304MB/s]
model-00007-of-00008.safetensors:  19%|█▊        | 367M/1.98G [00:03<00:04, 375MB/s]
model-00007-of-00008.safetensors:  25%|██▌       | 503M/1.98G [00:03<00:02, 570MB/s]
model-00007-of-00008.safetensors:  55%|█████▌    | 1.09G/1.98G [00:03<00:00, 1.30GB/s]
model-00007-of-00008.safetensors:  62%|██████▏   | 1.23G/1.98G [00:03<00:01, 736MB/s] 
model-00007-of-00008.safetensors:  68%|██████▊   | 1.34G/1.98G [00:04<00:00, 756MB/s]
model-00007-of-00008.safetensors:  73%|███████▎  | 1.44G/1.98G [00:04<00:00, 639MB/s]
model-00007-of-00008.safetensors:  77%|███████▋  | 1.52G/1.98G [00:04<00:00, 550MB/s]
model-00007-of-00008.safetensors:  80%|████████  | 1.59G/1.98G [00:04<00:00, 556MB/s]
model-00007-of-00008.safetensors:  87%|████████▋ | 1.73G/1.98G [00:04<00:00, 691MB/s]
model-00007-of-00008.safetensors: 100%|█████████▉| 1.98G/1.98G [00:04<00:00, 400MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model-00008-of-00008.safetensors:   0%|          | 0.00/900M [00:00<?, ?B/s]
model-00008-of-00008.safetensors:   1%|          | 8.44M/900M [00:02<04:00, 3.71MB/s]
model-00008-of-00008.safetensors:   7%|▋         | 60.9M/900M [00:02<00:26, 31.9MB/s]
model-00008-of-00008.safetensors:  14%|█▍        | 124M/900M [00:02<00:10, 74.0MB/s] 
model-00008-of-00008.safetensors:  30%|███       | 271M/900M [00:02<00:03, 202MB/s] 
model-00008-of-00008.safetensors:  39%|███▉      | 354M/900M [00:02<00:02, 272MB/s]
model-00008-of-00008.safetensors:  70%|██████▉   | 627M/900M [00:02<00:00, 617MB/s]
model-00008-of-00008.safetensors: 100%|█████████▉| 900M/900M [00:03<00:00, 299MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
model.safetensors.index.json:   0%|          | 0.00/22.8k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 22.8k/22.8k [00:00<00:00, 151MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/557 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 557/557 [00:00<00:00, 6.35MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
tokenizer.json:   0%|          | 0.00/1.80M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 21.7MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
tokenizer.model:   0%|          | 0.00/493k [00:00<?, ?B/s]
tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 46.2MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/1.38k [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 1.38k/1.38k [00:00<00:00, 17.3MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: Downloaded to shared memory in 67.546s
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: quantizing model to /dev/shm/model_cache
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: Saving mkml model at /dev/shm/model_cache
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: Reading /tmp/tmp5m1mh1vd/model.safetensors.index.json
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
Profiling:   0%|          | 0/291 [00:00<?, ?it/s]
Profiling:   0%|          | 1/291 [00:01<06:06,  1.26s/it]
Profiling:   6%|▌         | 18/291 [00:01<00:15, 17.96it/s]
Profiling:  12%|█▏        | 36/291 [00:01<00:07, 34.35it/s]
Profiling:  20%|█▉        | 57/291 [00:01<00:03, 58.71it/s]
Profiling:  27%|██▋       | 79/291 [00:01<00:02, 74.91it/s]
Profiling:  33%|███▎      | 95/291 [00:01<00:02, 89.08it/s]
Profiling:  39%|███▉      | 113/291 [00:02<00:01, 91.81it/s]
Profiling:  47%|████▋     | 136/291 [00:02<00:01, 118.56it/s]
Profiling:  54%|█████▎    | 156/291 [00:02<00:01, 116.83it/s]
Profiling:  60%|██████    | 176/291 [00:02<00:00, 132.64it/s]
Profiling:  68%|██████▊   | 197/291 [00:02<00:00, 130.20it/s]
Profiling:  74%|███████▍  | 216/291 [00:02<00:00, 143.11it/s]
Profiling:  81%|████████▏ | 237/291 [00:02<00:00, 134.13it/s]
Profiling:  88%|████████▊ | 257/291 [00:03<00:00, 147.16it/s]
Profiling:  95%|█████████▍| 275/291 [00:04<00:00, 38.47it/s] 
Profiling: 100%|██████████| 291/291 [00:04<00:00, 64.25it/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: quantized model in 14.235s
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: Processed model SanjiWatsuki/Lelantos-Maid-DPO-7B in 82.629s
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: creating bucket guanaco-mkml-models
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5/tokenizer_config.json
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5/special_tokens_map.json
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5/config.json
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5/added_tokens.json
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5/tokenizer.json
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5/tokenizer.model
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/sanjiwatsuki-lelantos-ma-6831-v5/mkml_model.tensors
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer:   warnings.warn(
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
config.json:   0%|          | 0.00/1.05k [00:00<?, ?B/s]
config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 12.0MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer:   warnings.warn(
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/234 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 1.67MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
vocab.json:   0%|          | 0.00/1.04M [00:00<?, ?B/s]
vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 44.5MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
tokenizer.json:   0%|          | 0.00/2.11M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 25.5MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer:   warnings.warn(
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: 
pytorch_model.bin:   0%|          | 0.00/1.44G [00:00<?, ?B/s]
pytorch_model.bin:   1%|          | 10.5M/1.44G [00:03<07:08, 3.34MB/s]
pytorch_model.bin:   3%|▎         | 41.9M/1.44G [00:03<01:23, 16.9MB/s]
pytorch_model.bin:  12%|█▏        | 178M/1.44G [00:03<00:13, 91.9MB/s] 
pytorch_model.bin:  20%|█▉        | 283M/1.44G [00:03<00:07, 161MB/s] 
pytorch_model.bin:  25%|██▌       | 367M/1.44G [00:03<00:04, 222MB/s]
pytorch_model.bin:  30%|███       | 440M/1.44G [00:03<00:03, 270MB/s]
pytorch_model.bin:  36%|███▌      | 514M/1.44G [00:03<00:02, 328MB/s]
pytorch_model.bin:  58%|█████▊    | 839M/1.44G [00:03<00:00, 804MB/s]
pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:04<00:00, 351MB/s]
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/sanjiwatsuki-lelantos-ma-6831-v5_reward/reward.tensors
Job sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer completed after 116.05s with status: succeeded
Stopping job with name sanjiwatsuki-lelantos-ma-6831-v5-mkmlizer
Pipeline stage MKMLizer completed in 118.67s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.11s
Running pipeline stage ISVCDeployer
Creating inference service sanjiwatsuki-lelantos-ma-6831-v5
Waiting for inference service sanjiwatsuki-lelantos-ma-6831-v5 to be ready
%s
%s
Failed to get response for submission chaiml-phase2-winner-13b2_v256: HTTPConnectionPool(host='chaiml-phase2-winner-13b2-v256-predictor-default.tenant-chaiml-guanaco.knative.ord1.coreweave.cloud', port=80): Read timed out. (read timeout=5.5)
Inference service sanjiwatsuki-lelantos-ma-6831-v5 ready after 191.08046627044678s
Pipeline stage ISVCDeployer completed in 198.03s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.2479753494262695s
Received healthy response to inference request in 0.6345658302307129s
Received healthy response to inference request in 0.4490480422973633s
Received healthy response to inference request in 1.0917975902557373s
Received healthy response to inference request in 0.9335072040557861s
5 requests
0 failed requests
5th percentile: 0.4861515998840332
10th percentile: 0.5232551574707032
20th percentile: 0.597462272644043
30th percentile: 0.6943541049957276
40th percentile: 0.8139306545257569
50th percentile: 0.9335072040557861
60th percentile: 0.9968233585357666
70th percentile: 1.060139513015747
80th percentile: 1.1230331420898438
90th percentile: 1.1855042457580567
95th percentile: 1.216739797592163
99th percentile: 1.2417282390594482
mean time: 0.8713788032531739
Pipeline stage StressChecker completed in 5.25s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.04s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.04s
M-Eval Dataset for topic stay_in_character is loaded
sanjiwatsuki-lelantos-ma_6831_v5 status is now deployed due to DeploymentManager action
sanjiwatsuki-lelantos-ma_6831_v5 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of sanjiwatsuki-lelantos-ma_6831_v5
Running pipeline stage ISVCDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage ISVCDeleter completed in 0.10s
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 0.07s
sanjiwatsuki-lelantos-ma_6831_v5 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics