wespro-3rdfrankn

developer_uid: WesPro
submission_id: wespro-3rdfrankn_v1
model_name: wespro-3rdfrankn_v1
model_group: WesPro/3rdFrankn
status: rejected
timestamp: 2024-04-14T04:49:58+00:00
num_battles: 63
num_wins: 19
family_friendly_score: 0.0
submission_type: basic
model_repo: WesPro/3rdFrankn
model_architecture: MistralForCausalLM
model_num_parameters: 15966212096.0
best_of: 4
max_input_tokens: 512
max_output_tokens: 64
reward_model: default
display_name: wespro-3rdfrankn_v1
ineligible_reason: model is not deployable
is_internal_developer: False
language_model: WesPro/3rdFrankn
model_size: 16B
ranking_group: single
us_pacific_date: 2024-04-13
win_ratio: 0.30158730158730157
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
model_eval_status: success
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'user_template': '{user_name}: {message}\n'}
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
Resubmit model
Running pipeline stage MKMLizer
Starting job with name wespro-3rdfrankn-v1-mkmlizer
Waiting for job on wespro-3rdfrankn-v1-mkmlizer to finish
wespro-3rdfrankn-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
wespro-3rdfrankn-v1-mkmlizer: ║     _____            __           __                                ║
wespro-3rdfrankn-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
wespro-3rdfrankn-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
wespro-3rdfrankn-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
wespro-3rdfrankn-v1-mkmlizer: ║       /___/                                                         ║
wespro-3rdfrankn-v1-mkmlizer: ║                                                                     ║
wespro-3rdfrankn-v1-mkmlizer: ║  Version: 0.6.11                                                    ║
wespro-3rdfrankn-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
wespro-3rdfrankn-v1-mkmlizer: ║                                                                     ║
wespro-3rdfrankn-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
wespro-3rdfrankn-v1-mkmlizer: ║  belonging to:                                                      ║
wespro-3rdfrankn-v1-mkmlizer: ║                                                                     ║
wespro-3rdfrankn-v1-mkmlizer: ║  Chai Research Corp.                                                ║
wespro-3rdfrankn-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
wespro-3rdfrankn-v1-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
wespro-3rdfrankn-v1-mkmlizer: ║                                                                     ║
wespro-3rdfrankn-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
wespro-3rdfrankn-v1-mkmlizer: 
.gitattributes:   0%|          | 0.00/1.52k [00:00<?, ?B/s]
.gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 12.9MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
README.md:   0%|          | 0.00/930 [00:00<?, ?B/s]
README.md: 100%|██████████| 930/930 [00:00<00:00, 5.36MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
config.json:   0%|          | 0.00/643 [00:00<?, ?B/s]
config.json: 100%|██████████| 643/643 [00:00<00:00, 10.3MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
mergekit_config.yml:   0%|          | 0.00/363 [00:00<?, ?B/s]
mergekit_config.yml: 100%|██████████| 363/363 [00:00<00:00, 2.84MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
model-00001-of-00004.safetensors:   0%|          | 0.00/9.92G [00:00<?, ?B/s]
model-00001-of-00004.safetensors:   0%|          | 10.5M/9.92G [00:00<05:10, 31.9MB/s]
model-00001-of-00004.safetensors:   0%|          | 21.0M/9.92G [00:01<11:58, 13.8MB/s]
model-00001-of-00004.safetensors:   1%|          | 62.9M/9.92G [00:01<03:05, 53.1MB/s]
model-00001-of-00004.safetensors:   1%|          | 83.9M/9.92G [00:01<02:43, 60.0MB/s]
model-00001-of-00004.safetensors:   1%|          | 105M/9.92G [00:01<02:15, 72.3MB/s] 
model-00001-of-00004.safetensors:   1%|▏         | 126M/9.92G [00:02<02:10, 74.8MB/s]
model-00001-of-00004.safetensors:   1%|▏         | 147M/9.92G [00:02<01:56, 83.8MB/s]
model-00001-of-00004.safetensors:   2%|▏         | 168M/9.92G [00:02<01:38, 99.3MB/s]
model-00001-of-00004.safetensors:   2%|▏         | 220M/9.92G [00:02<00:58, 165MB/s] 
model-00001-of-00004.safetensors:   3%|▎         | 346M/9.92G [00:02<00:25, 374MB/s]
model-00001-of-00004.safetensors:   4%|▍         | 409M/9.92G [00:02<00:23, 411MB/s]
model-00001-of-00004.safetensors:   5%|▍         | 482M/9.92G [00:03<00:21, 446MB/s]
model-00001-of-00004.safetensors:   6%|▌         | 608M/9.92G [00:03<00:15, 588MB/s]
model-00001-of-00004.safetensors:  13%|█▎        | 1.29G/9.92G [00:03<00:04, 2.04GB/s]
model-00001-of-00004.safetensors:  16%|█▌        | 1.54G/9.92G [00:04<00:11, 717MB/s] 
model-00001-of-00004.safetensors:  17%|█▋        | 1.73G/9.92G [00:04<00:13, 594MB/s]
model-00001-of-00004.safetensors:  20%|█▉        | 1.94G/9.92G [00:04<00:10, 738MB/s]
model-00001-of-00004.safetensors:  22%|██▏       | 2.16G/9.92G [00:04<00:08, 910MB/s]
model-00001-of-00004.safetensors:  24%|██▎       | 2.34G/9.92G [00:04<00:07, 996MB/s]
model-00001-of-00004.safetensors:  27%|██▋       | 2.67G/9.92G [00:05<00:05, 1.28GB/s]
model-00001-of-00004.safetensors:  29%|██▉       | 2.86G/9.92G [00:05<00:10, 690MB/s] 
model-00001-of-00004.safetensors:  30%|███       | 3.00G/9.92G [00:06<00:10, 658MB/s]
model-00001-of-00004.safetensors:  32%|███▏      | 3.18G/9.92G [00:06<00:08, 773MB/s]
model-00001-of-00004.safetensors:  34%|███▍      | 3.38G/9.92G [00:06<00:06, 946MB/s]
model-00001-of-00004.safetensors:  36%|███▌      | 3.52G/9.92G [00:06<00:06, 988MB/s]
model-00001-of-00004.safetensors:  38%|███▊      | 3.73G/9.92G [00:06<00:06, 1.02GB/s]
model-00001-of-00004.safetensors:  39%|███▉      | 3.87G/9.92G [00:07<00:09, 670MB/s] 
model-00001-of-00004.safetensors:  40%|████      | 3.97G/9.92G [00:07<00:09, 621MB/s]
model-00001-of-00004.safetensors:  41%|████      | 4.07G/9.92G [00:07<00:08, 658MB/s]
model-00001-of-00004.safetensors:  42%|████▏     | 4.15G/9.92G [00:07<00:08, 669MB/s]
model-00001-of-00004.safetensors:  43%|████▎     | 4.30G/9.92G [00:07<00:06, 820MB/s]
model-00001-of-00004.safetensors:  46%|████▌     | 4.54G/9.92G [00:07<00:05, 1.06GB/s]
model-00001-of-00004.safetensors:  48%|████▊     | 4.76G/9.92G [00:07<00:04, 1.29GB/s]
model-00001-of-00004.safetensors:  49%|████▉     | 4.91G/9.92G [00:08<00:06, 753MB/s] 
model-00001-of-00004.safetensors:  51%|█████     | 5.02G/9.92G [00:08<00:08, 586MB/s]
model-00001-of-00004.safetensors:  52%|█████▏    | 5.12G/9.92G [00:08<00:07, 634MB/s]
model-00001-of-00004.safetensors:  53%|█████▎    | 5.24G/9.92G [00:08<00:06, 737MB/s]
model-00001-of-00004.safetensors:  54%|█████▍    | 5.37G/9.92G [00:08<00:05, 831MB/s]
model-00001-of-00004.safetensors:  56%|█████▌    | 5.54G/9.92G [00:08<00:04, 1.01GB/s]
model-00001-of-00004.safetensors:  59%|█████▉    | 5.83G/9.92G [00:09<00:02, 1.45GB/s]
model-00001-of-00004.safetensors:  61%|██████    | 6.01G/9.92G [00:09<00:04, 967MB/s] 
model-00001-of-00004.safetensors:  62%|██████▏   | 6.16G/9.92G [00:09<00:04, 758MB/s]
model-00001-of-00004.safetensors:  63%|██████▎   | 6.27G/9.92G [00:09<00:05, 712MB/s]
model-00001-of-00004.safetensors:  64%|██████▍   | 6.36G/9.92G [00:10<00:05, 666MB/s]
model-00001-of-00004.safetensors:  65%|██████▌   | 6.48G/9.92G [00:10<00:04, 740MB/s]
model-00001-of-00004.safetensors:  67%|██████▋   | 6.61G/9.92G [00:10<00:03, 841MB/s]
model-00001-of-00004.safetensors:  68%|██████▊   | 6.76G/9.92G [00:10<00:03, 997MB/s]
model-00001-of-00004.safetensors:  70%|███████   | 6.95G/9.92G [00:10<00:02, 1.15GB/s]
model-00001-of-00004.safetensors:  71%|███████▏  | 7.09G/9.92G [00:10<00:02, 961MB/s] 
model-00001-of-00004.safetensors:  73%|███████▎  | 7.20G/9.92G [00:11<00:03, 688MB/s]
model-00001-of-00004.safetensors:  74%|███████▎  | 7.30G/9.92G [00:11<00:03, 727MB/s]
model-00001-of-00004.safetensors:  75%|███████▍  | 7.39G/9.92G [00:11<00:03, 687MB/s]
model-00001-of-00004.safetensors:  75%|███████▌  | 7.48G/9.92G [00:11<00:03, 632MB/s]
model-00001-of-00004.safetensors:  77%|███████▋  | 7.67G/9.92G [00:11<00:02, 875MB/s]
model-00001-of-00004.safetensors:  78%|███████▊  | 7.78G/9.92G [00:11<00:02, 903MB/s]
model-00001-of-00004.safetensors:  80%|███████▉  | 7.90G/9.92G [00:11<00:02, 961MB/s]
model-00001-of-00004.safetensors:  82%|████████▏ | 8.08G/9.92G [00:11<00:01, 1.17GB/s]
model-00001-of-00004.safetensors:  83%|████████▎ | 8.22G/9.92G [00:12<00:02, 787MB/s] 
model-00001-of-00004.safetensors:  84%|████████▍ | 8.33G/9.92G [00:12<00:01, 813MB/s]
model-00001-of-00004.safetensors:  85%|████████▌ | 8.43G/9.92G [00:12<00:01, 800MB/s]
model-00001-of-00004.safetensors:  86%|████████▌ | 8.52G/9.92G [00:12<00:01, 806MB/s]
model-00001-of-00004.safetensors:  87%|████████▋ | 8.62G/9.92G [00:12<00:01, 747MB/s]
model-00001-of-00004.safetensors:  89%|████████▊ | 8.79G/9.92G [00:12<00:01, 923MB/s]
model-00001-of-00004.safetensors:  90%|████████▉ | 8.89G/9.92G [00:13<00:01, 864MB/s]
model-00001-of-00004.safetensors:  91%|█████████ | 9.00G/9.92G [00:13<00:01, 895MB/s]
model-00001-of-00004.safetensors:  93%|█████████▎| 9.20G/9.92G [00:13<00:00, 1.14GB/s]
model-00001-of-00004.safetensors:  94%|█████████▍| 9.32G/9.92G [00:13<00:00, 1.14GB/s]
model-00001-of-00004.safetensors:  95%|█████████▌| 9.45G/9.92G [00:13<00:00, 1.07GB/s]
model-00001-of-00004.safetensors:  97%|█████████▋| 9.62G/9.92G [00:13<00:00, 1.21GB/s]
model-00001-of-00004.safetensors:  99%|█████████▊| 9.78G/9.92G [00:13<00:00, 1.30GB/s]
model-00001-of-00004.safetensors: 100%|█████████▉| 9.92G/9.92G [00:13<00:00, 716MB/s] 
wespro-3rdfrankn-v1-mkmlizer: 
model-00002-of-00004.safetensors:   0%|          | 0.00/9.97G [00:00<?, ?B/s]
model-00002-of-00004.safetensors:   0%|          | 10.5M/9.97G [00:01<19:03, 8.71MB/s]
model-00002-of-00004.safetensors:   0%|          | 21.0M/9.97G [00:01<11:09, 14.9MB/s]
model-00002-of-00004.safetensors:   0%|          | 31.5M/9.97G [00:01<08:58, 18.5MB/s]
model-00002-of-00004.safetensors:   0%|          | 41.9M/9.97G [00:02<06:06, 27.1MB/s]
model-00002-of-00004.safetensors:   1%|          | 52.4M/9.97G [00:02<04:48, 34.4MB/s]
model-00002-of-00004.safetensors:   1%|          | 62.9M/9.97G [00:02<04:27, 37.1MB/s]
model-00002-of-00004.safetensors:   1%|▏         | 126M/9.97G [00:02<01:24, 116MB/s]  
model-00002-of-00004.safetensors:   2%|▏         | 168M/9.97G [00:02<00:59, 164MB/s]
model-00002-of-00004.safetensors:   3%|▎         | 336M/9.97G [00:02<00:21, 446MB/s]
model-00002-of-00004.safetensors:   5%|▍         | 451M/9.97G [00:02<00:17, 554MB/s]
model-00002-of-00004.safetensors:   6%|▌         | 577M/9.97G [00:03<00:13, 704MB/s]
model-00002-of-00004.safetensors:  11%|█         | 1.07G/9.97G [00:03<00:06, 1.39GB/s]
model-00002-of-00004.safetensors:  12%|█▏        | 1.22G/9.97G [00:03<00:14, 602MB/s] 
model-00002-of-00004.safetensors:  14%|█▎        | 1.36G/9.97G [00:04<00:12, 699MB/s]
model-00002-of-00004.safetensors:  15%|█▍        | 1.48G/9.97G [00:04<00:12, 663MB/s]
model-00002-of-00004.safetensors:  16%|█▌        | 1.58G/9.97G [00:04<00:12, 663MB/s]
model-00002-of-00004.safetensors:  17%|█▋        | 1.74G/9.97G [00:04<00:10, 794MB/s]
model-00002-of-00004.safetensors:  19%|█▉        | 1.91G/9.97G [00:04<00:08, 952MB/s]
model-00002-of-00004.safetensors:  21%|██        | 2.06G/9.97G [00:04<00:07, 1.04GB/s]
model-00002-of-00004.safetensors:  22%|██▏       | 2.18G/9.97G [00:04<00:07, 1.07GB/s]
model-00002-of-00004.safetensors:  23%|██▎       | 2.31G/9.97G [00:05<00:07, 1.02GB/s]
model-00002-of-00004.safetensors:  27%|██▋       | 2.69G/9.97G [00:05<00:05, 1.38GB/s]
model-00002-of-00004.safetensors:  29%|██▊       | 2.84G/9.97G [00:05<00:08, 848MB/s] 
model-00002-of-00004.safetensors:  30%|██▉       | 2.96G/9.97G [00:05<00:08, 819MB/s]
model-00002-of-00004.safetensors:  31%|███       | 3.06G/9.97G [00:05<00:08, 823MB/s]
model-00002-of-00004.safetensors:  32%|███▏      | 3.16G/9.97G [00:06<00:09, 712MB/s]
model-00002-of-00004.safetensors:  32%|███▏      | 3.24G/9.97G [00:06<00:09, 685MB/s]
model-00002-of-00004.safetensors:  34%|███▍      | 3.38G/9.97G [00:06<00:08, 773MB/s]
model-00002-of-00004.safetensors:  35%|███▌      | 3.50G/9.97G [00:06<00:07, 865MB/s]
model-00002-of-00004.safetensors:  37%|███▋      | 3.72G/9.97G [00:06<00:05, 1.16GB/s]
model-00002-of-00004.safetensors:  39%|███▊      | 3.86G/9.97G [00:06<00:06, 933MB/s] 
model-00002-of-00004.safetensors:  40%|███▉      | 3.97G/9.97G [00:06<00:06, 864MB/s]
model-00002-of-00004.safetensors:  41%|████      | 4.08G/9.97G [00:07<00:07, 802MB/s]
model-00002-of-00004.safetensors:  42%|████▏     | 4.17G/9.97G [00:07<00:08, 716MB/s]
model-00002-of-00004.safetensors:  43%|████▎     | 4.26G/9.97G [00:07<00:08, 709MB/s]
model-00002-of-00004.safetensors:  44%|████▎     | 4.34G/9.97G [00:07<00:07, 736MB/s]
model-00002-of-00004.safetensors:  44%|████▍     | 4.44G/9.97G [00:07<00:07, 766MB/s]
model-00002-of-00004.safetensors:  46%|████▌     | 4.59G/9.97G [00:07<00:05, 954MB/s]
model-00002-of-00004.safetensors:  48%|████▊     | 4.79G/9.97G [00:07<00:04, 1.14GB/s]
model-00002-of-00004.safetensors:  49%|████▉     | 4.92G/9.97G [00:08<00:05, 1.01GB/s]
model-00002-of-00004.safetensors:  50%|█████     | 5.03G/9.97G [00:08<00:05, 853MB/s] 
model-00002-of-00004.safetensors:  51%|█████▏    | 5.13G/9.97G [00:08<00:06, 797MB/s]
model-00002-of-00004.safetensors:  52%|█████▏    | 5.21G/9.97G [00:08<00:07, 675MB/s]
model-00002-of-00004.safetensors:  53%|█████▎    | 5.31G/9.97G [00:08<00:06, 731MB/s]
model-00002-of-00004.safetensors:  54%|█████▍    | 5.39G/9.97G [00:08<00:06, 722MB/s]
model-00002-of-00004.safetensors:  55%|█████▌    | 5.48G/9.97G [00:08<00:05, 759MB/s]
model-00002-of-00004.safetensors:  56%|█████▌    | 5.59G/9.97G [00:08<00:05, 831MB/s]
model-00002-of-00004.safetensors:  57%|█████▋    | 5.70G/9.97G [00:09<00:04, 916MB/s]
model-00002-of-00004.safetensors:  59%|█████▉    | 5.86G/9.97G [00:09<00:03, 1.08GB/s]
model-00002-of-00004.safetensors:  60%|█████▉    | 5.98G/9.97G [00:09<00:04, 956MB/s] 
model-00002-of-00004.safetensors:  61%|██████    | 6.08G/9.97G [00:09<00:04, 922MB/s]
model-00002-of-00004.safetensors:  62%|██████▏   | 6.19G/9.97G [00:09<00:04, 868MB/s]
model-00002-of-00004.safetensors:  63%|██████▎   | 6.29G/9.97G [00:09<00:04, 859MB/s]
model-00002-of-00004.safetensors:  64%|██████▍   | 6.39G/9.97G [00:09<00:04, 718MB/s]
model-00002-of-00004.safetensors:  65%|██████▍   | 6.47G/9.97G [00:10<00:05, 687MB/s]
model-00002-of-00004.safetensors:  66%|██████▌   | 6.56G/9.97G [00:10<00:04, 718MB/s]
model-00002-of-00004.safetensors:  67%|██████▋   | 6.69G/9.97G [00:10<00:04, 796MB/s]
model-00002-of-00004.safetensors:  69%|██████▊   | 6.84G/9.97G [00:10<00:03, 926MB/s]
model-00002-of-00004.safetensors:  70%|██████▉   | 6.94G/9.97G [00:10<00:03, 950MB/s]
model-00002-of-00004.safetensors:  71%|███████   | 7.05G/9.97G [00:10<00:03, 841MB/s]
model-00002-of-00004.safetensors:  72%|███████▏  | 7.14G/9.97G [00:10<00:03, 792MB/s]
model-00002-of-00004.safetensors:  73%|███████▎  | 7.24G/9.97G [00:10<00:03, 818MB/s]
model-00002-of-00004.safetensors:  74%|███████▎  | 7.33G/9.97G [00:11<00:03, 827MB/s]
model-00002-of-00004.safetensors:  75%|███████▍  | 7.46G/9.97G [00:11<00:02, 902MB/s]
model-00002-of-00004.safetensors:  76%|███████▌  | 7.55G/9.97G [00:11<00:03, 628MB/s]
model-00002-of-00004.safetensors:  77%|███████▋  | 7.64G/9.97G [00:11<00:03, 689MB/s]
model-00002-of-00004.safetensors:  78%|███████▊  | 7.73G/9.97G [00:11<00:03, 704MB/s]
model-00002-of-00004.safetensors:  79%|███████▊  | 7.84G/9.97G [00:11<00:02, 786MB/s]
model-00002-of-00004.safetensors:  80%|███████▉  | 7.97G/9.97G [00:11<00:02, 896MB/s]
model-00002-of-00004.safetensors:  81%|████████▏ | 8.11G/9.97G [00:11<00:01, 974MB/s]
model-00002-of-00004.safetensors:  82%|████████▏ | 8.21G/9.97G [00:12<00:02, 814MB/s]
model-00002-of-00004.safetensors:  84%|████████▎ | 8.34G/9.97G [00:12<00:01, 914MB/s]
model-00002-of-00004.safetensors:  85%|████████▍ | 8.44G/9.97G [00:12<00:01, 830MB/s]
model-00002-of-00004.safetensors:  86%|████████▌ | 8.58G/9.97G [00:12<00:01, 926MB/s]
model-00002-of-00004.safetensors:  87%|████████▋ | 8.68G/9.97G [00:12<00:01, 712MB/s]
model-00002-of-00004.safetensors:  88%|████████▊ | 8.77G/9.97G [00:12<00:01, 722MB/s]
model-00002-of-00004.safetensors:  89%|████████▉ | 8.88G/9.97G [00:12<00:01, 805MB/s]
model-00002-of-00004.safetensors:  90%|█████████ | 9.02G/9.97G [00:13<00:01, 937MB/s]
model-00002-of-00004.safetensors:  92%|█████████▏| 9.19G/9.97G [00:13<00:00, 1.11GB/s]
model-00002-of-00004.safetensors:  93%|█████████▎| 9.31G/9.97G [00:13<00:00, 1.11GB/s]
model-00002-of-00004.safetensors:  95%|█████████▌| 9.51G/9.97G [00:13<00:00, 1.35GB/s]
model-00002-of-00004.safetensors:  97%|█████████▋| 9.70G/9.97G [00:13<00:00, 1.49GB/s]
model-00002-of-00004.safetensors:  99%|█████████▉| 9.85G/9.97G [00:13<00:00, 1.50GB/s]
model-00002-of-00004.safetensors: 100%|█████████▉| 9.97G/9.97G [00:13<00:00, 722MB/s] 
wespro-3rdfrankn-v1-mkmlizer: 
model-00003-of-00004.safetensors:   0%|          | 0.00/9.98G [00:00<?, ?B/s]
model-00003-of-00004.safetensors:   0%|          | 10.5M/9.98G [00:01<23:36, 7.04MB/s]
model-00003-of-00004.safetensors:   0%|          | 21.0M/9.98G [00:01<12:26, 13.3MB/s]
model-00003-of-00004.safetensors:   0%|          | 31.5M/9.98G [00:02<09:17, 17.9MB/s]
model-00003-of-00004.safetensors:   1%|          | 52.4M/9.98G [00:02<05:07, 32.2MB/s]
model-00003-of-00004.safetensors:   1%|          | 105M/9.98G [00:02<01:55, 85.9MB/s] 
model-00003-of-00004.safetensors:   2%|▏         | 178M/9.98G [00:02<00:56, 173MB/s] 
model-00003-of-00004.safetensors:   2%|▏         | 231M/9.98G [00:02<00:42, 228MB/s]
model-00003-of-00004.safetensors:   5%|▍         | 451M/9.98G [00:02<00:16, 585MB/s]
model-00003-of-00004.safetensors:   7%|▋         | 671M/9.98G [00:02<00:10, 853MB/s]
model-00003-of-00004.safetensors:  11%|█         | 1.06G/9.98G [00:03<00:09, 942MB/s]
model-00003-of-00004.safetensors:  12%|█▏        | 1.17G/9.98G [00:04<00:20, 438MB/s]
model-00003-of-00004.safetensors:  13%|█▎        | 1.26G/9.98G [00:04<00:19, 452MB/s]
model-00003-of-00004.safetensors:  14%|█▍        | 1.45G/9.98G [00:04<00:14, 603MB/s]
model-00003-of-00004.safetensors:  16%|█▌        | 1.57G/9.98G [00:04<00:12, 686MB/s]
model-00003-of-00004.safetensors:  17%|█▋        | 1.69G/9.98G [00:04<00:11, 727MB/s]
model-00003-of-00004.safetensors:  19%|█▉        | 1.88G/9.98G [00:04<00:08, 928MB/s]
model-00003-of-00004.safetensors:  20%|██        | 2.04G/9.98G [00:04<00:07, 1.07GB/s]
model-00003-of-00004.safetensors:  23%|██▎       | 2.29G/9.98G [00:05<00:06, 1.26GB/s]
model-00003-of-00004.safetensors:  24%|██▍       | 2.43G/9.98G [00:05<00:09, 773MB/s] 
model-00003-of-00004.safetensors:  26%|██▌       | 2.55G/9.98G [00:05<00:12, 609MB/s]
model-00003-of-00004.safetensors:  26%|██▋       | 2.64G/9.98G [00:06<00:16, 454MB/s]
model-00003-of-00004.safetensors:  27%|██▋       | 2.72G/9.98G [00:06<00:16, 430MB/s]
model-00003-of-00004.safetensors:  28%|██▊       | 2.84G/9.98G [00:06<00:13, 515MB/s]
model-00003-of-00004.safetensors:  30%|██▉       | 2.98G/9.98G [00:06<00:10, 637MB/s]
model-00003-of-00004.safetensors:  31%|███       | 3.10G/9.98G [00:06<00:09, 739MB/s]
model-00003-of-00004.safetensors:  33%|███▎      | 3.32G/9.98G [00:06<00:07, 882MB/s]
model-00003-of-00004.safetensors:  34%|███▍      | 3.43G/9.98G [00:07<00:10, 654MB/s]
model-00003-of-00004.safetensors:  35%|███▌      | 3.51G/9.98G [00:07<00:09, 683MB/s]
model-00003-of-00004.safetensors:  36%|███▌      | 3.60G/9.98G [00:07<00:11, 574MB/s]
model-00003-of-00004.safetensors:  37%|███▋      | 3.67G/9.98G [00:07<00:15, 400MB/s]
model-00003-of-00004.safetensors:  37%|███▋      | 3.73G/9.98G [00:08<00:14, 419MB/s]
model-00003-of-00004.safetensors:  38%|███▊      | 3.80G/9.98G [00:08<00:16, 378MB/s]
model-00003-of-00004.safetensors:  39%|███▉      | 3.89G/9.98G [00:08<00:13, 462MB/s]
model-00003-of-00004.safetensors:  40%|████      | 4.01G/9.98G [00:08<00:10, 592MB/s]
model-00003-of-00004.safetensors:  41%|████▏     | 4.14G/9.98G [00:08<00:07, 744MB/s]
model-00003-of-00004.safetensors:  44%|████▎     | 4.35G/9.98G [00:08<00:05, 1.02GB/s]
model-00003-of-00004.safetensors:  45%|████▍     | 4.48G/9.98G [00:09<00:08, 671MB/s] 
model-00003-of-00004.safetensors:  46%|████▌     | 4.57G/9.98G [00:09<00:07, 705MB/s]
model-00003-of-00004.safetensors:  47%|████▋     | 4.67G/9.98G [00:09<00:10, 492MB/s]
model-00003-of-00004.safetensors:  47%|████▋     | 4.74G/9.98G [00:09<00:12, 409MB/s]
model-00003-of-00004.safetensors:  48%|████▊     | 4.80G/9.98G [00:10<00:13, 392MB/s]
model-00003-of-00004.safetensors:  49%|████▊     | 4.85G/9.98G [00:10<00:13, 393MB/s]
model-00003-of-00004.safetensors:  50%|████▉     | 4.97G/9.98G [00:10<00:09, 510MB/s]
model-00003-of-00004.safetensors:  51%|█████     | 5.11G/9.98G [00:10<00:07, 665MB/s]
model-00003-of-00004.safetensors:  53%|█████▎    | 5.24G/9.98G [00:10<00:05, 802MB/s]
model-00003-of-00004.safetensors:  54%|█████▍    | 5.40G/9.98G [00:10<00:04, 958MB/s]
model-00003-of-00004.safetensors:  55%|█████▌    | 5.52G/9.98G [00:10<00:04, 911MB/s]
model-00003-of-00004.safetensors:  56%|█████▋    | 5.62G/9.98G [00:10<00:05, 807MB/s]
model-00003-of-00004.safetensors:  57%|█████▋    | 5.71G/9.98G [00:11<00:08, 516MB/s]
model-00003-of-00004.safetensors:  58%|█████▊    | 5.79G/9.98G [00:11<00:10, 413MB/s]
model-00003-of-00004.safetensors:  59%|█████▊    | 5.85G/9.98G [00:11<00:11, 354MB/s]
model-00003-of-00004.safetensors:  59%|█████▉    | 5.92G/9.98G [00:11<00:10, 397MB/s]
model-00003-of-00004.safetensors:  60%|██████    | 6.02G/9.98G [00:12<00:08, 484MB/s]
model-00003-of-00004.safetensors:  62%|██████▏   | 6.14G/9.98G [00:12<00:06, 626MB/s]
model-00003-of-00004.safetensors:  62%|██████▏   | 6.23G/9.98G [00:12<00:05, 644MB/s]
model-00003-of-00004.safetensors:  63%|██████▎   | 6.31G/9.98G [00:12<00:05, 668MB/s]
model-00003-of-00004.safetensors:  65%|██████▍   | 6.47G/9.98G [00:12<00:04, 873MB/s]
model-00003-of-00004.safetensors:  66%|██████▌   | 6.57G/9.98G [00:12<00:03, 889MB/s]
model-00003-of-00004.safetensors:  67%|██████▋   | 6.68G/9.98G [00:12<00:04, 820MB/s]
model-00003-of-00004.safetensors:  68%|██████▊   | 6.77G/9.98G [00:13<00:05, 565MB/s]
model-00003-of-00004.safetensors:  69%|██████▊   | 6.85G/9.98G [00:13<00:06, 462MB/s]
model-00003-of-00004.safetensors:  69%|██████▉   | 6.91G/9.98G [00:13<00:07, 406MB/s]
model-00003-of-00004.safetensors:  70%|██████▉   | 6.96G/9.98G [00:13<00:07, 385MB/s]
model-00003-of-00004.safetensors:  71%|███████   | 7.08G/9.98G [00:13<00:05, 504MB/s]
model-00003-of-00004.safetensors:  72%|███████▏  | 7.21G/9.98G [00:13<00:04, 662MB/s]
model-00003-of-00004.safetensors:  73%|███████▎  | 7.30G/9.98G [00:14<00:03, 685MB/s]
model-00003-of-00004.safetensors:  74%|███████▍  | 7.39G/9.98G [00:14<00:03, 733MB/s]
model-00003-of-00004.safetensors:  75%|███████▌  | 7.51G/9.98G [00:14<00:03, 787MB/s]
model-00003-of-00004.safetensors:  76%|███████▋  | 7.63G/9.98G [00:14<00:02, 863MB/s]
model-00003-of-00004.safetensors:  77%|███████▋  | 7.73G/9.98G [00:14<00:02, 802MB/s]
model-00003-of-00004.safetensors:  78%|███████▊  | 7.81G/9.98G [00:14<00:03, 635MB/s]
model-00003-of-00004.safetensors:  79%|███████▉  | 7.89G/9.98G [00:15<00:04, 520MB/s]
model-00003-of-00004.safetensors:  80%|███████▉  | 7.95G/9.98G [00:15<00:04, 480MB/s]
model-00003-of-00004.safetensors:  80%|████████  | 8.01G/9.98G [00:15<00:05, 387MB/s]
model-00003-of-00004.safetensors:  81%|████████  | 8.06G/9.98G [00:15<00:04, 392MB/s]
model-00003-of-00004.safetensors:  82%|████████▏ | 8.14G/9.98G [00:15<00:04, 447MB/s]
model-00003-of-00004.safetensors:  83%|████████▎ | 8.33G/9.98G [00:15<00:02, 737MB/s]
model-00003-of-00004.safetensors:  85%|████████▍ | 8.46G/9.98G [00:15<00:01, 877MB/s]
model-00003-of-00004.safetensors:  86%|████████▌ | 8.58G/9.98G [00:16<00:01, 927MB/s]
model-00003-of-00004.safetensors:  87%|████████▋ | 8.70G/9.98G [00:16<00:01, 1.01GB/s]
model-00003-of-00004.safetensors:  88%|████████▊ | 8.82G/9.98G [00:16<00:01, 934MB/s] 
model-00003-of-00004.safetensors:  89%|████████▉ | 8.92G/9.98G [00:16<00:01, 786MB/s]
model-00003-of-00004.safetensors:  90%|█████████ | 9.02G/9.98G [00:16<00:01, 611MB/s]
model-00003-of-00004.safetensors:  91%|█████████ | 9.09G/9.98G [00:16<00:01, 556MB/s]
model-00003-of-00004.safetensors:  92%|█████████▏| 9.16G/9.98G [00:17<00:01, 486MB/s]
model-00003-of-00004.safetensors:  93%|█████████▎| 9.30G/9.98G [00:17<00:01, 649MB/s]
model-00003-of-00004.safetensors:  95%|█████████▍| 9.48G/9.98G [00:17<00:00, 888MB/s]
model-00003-of-00004.safetensors:  97%|█████████▋| 9.65G/9.98G [00:17<00:00, 1.06GB/s]
model-00003-of-00004.safetensors:  99%|█████████▉| 9.89G/9.98G [00:17<00:00, 1.39GB/s]
model-00003-of-00004.safetensors: 100%|█████████▉| 9.98G/9.98G [00:17<00:00, 568MB/s] 
wespro-3rdfrankn-v1-mkmlizer: 
model-00004-of-00004.safetensors:   0%|          | 0.00/2.06G [00:00<?, ?B/s]
model-00004-of-00004.safetensors:   1%|          | 10.5M/2.06G [00:02<07:57, 4.30MB/s]
model-00004-of-00004.safetensors:   1%|          | 21.0M/2.06G [00:02<03:30, 9.71MB/s]
model-00004-of-00004.safetensors:   4%|▍         | 83.9M/2.06G [00:02<00:38, 52.1MB/s]
model-00004-of-00004.safetensors:  10%|█         | 210M/2.06G [00:02<00:12, 153MB/s]  
model-00004-of-00004.safetensors:  14%|█▍        | 294M/2.06G [00:02<00:07, 227MB/s]
model-00004-of-00004.safetensors:  22%|██▏       | 451M/2.06G [00:03<00:03, 405MB/s]
model-00004-of-00004.safetensors:  52%|█████▏    | 1.08G/2.06G [00:03<00:00, 1.20GB/s]
model-00004-of-00004.safetensors:  61%|██████    | 1.26G/2.06G [00:03<00:01, 709MB/s] 
model-00004-of-00004.safetensors:  68%|██████▊   | 1.39G/2.06G [00:04<00:00, 711MB/s]
model-00004-of-00004.safetensors:  73%|███████▎  | 1.51G/2.06G [00:04<00:00, 623MB/s]
model-00004-of-00004.safetensors:  78%|███████▊  | 1.60G/2.06G [00:04<00:00, 480MB/s]
model-00004-of-00004.safetensors:  84%|████████▍ | 1.74G/2.06G [00:04<00:00, 576MB/s]
model-00004-of-00004.safetensors: 100%|█████████▉| 2.06G/2.06G [00:05<00:00, 407MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
model.safetensors.index.json:   0%|          | 0.00/51.1k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 51.1k/51.1k [00:00<00:00, 2.82MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/414 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 414/414 [00:00<00:00, 3.35MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
tokenizer.json:   0%|          | 0.00/1.80M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 10.4MB/s]
tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 10.3MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
tokenizer.model:   0%|          | 0.00/493k [00:00<?, ?B/s]
tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 18.3MB/s]
wespro-3rdfrankn-v1-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/967 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 967/967 [00:00<00:00, 9.57MB/s]
wespro-3rdfrankn-v1-mkmlizer: Downloaded to shared memory in 53.753s
wespro-3rdfrankn-v1-mkmlizer: quantizing model to /dev/shm/model_cache
wespro-3rdfrankn-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
wespro-3rdfrankn-v1-mkmlizer: Reading /tmp/tmpnxumotlc/model.safetensors.index.json
wespro-3rdfrankn-v1-mkmlizer: 
Profiling:   0%|          | 0/651 [00:00<?, ?it/s]
Profiling:   0%|          | 1/651 [00:00<01:18,  8.29it/s]
Profiling:   2%|▏         | 12/651 [00:00<00:11, 57.65it/s]
Profiling:   4%|▎         | 23/651 [00:00<00:08, 74.17it/s]
Profiling:   5%|▍         | 32/651 [00:00<00:08, 76.92it/s]
Profiling:   7%|▋         | 44/651 [00:00<00:06, 90.43it/s]
Profiling:   9%|▉         | 57/651 [00:00<00:06, 97.08it/s]
Profiling:  10%|█         | 67/651 [00:00<00:06, 97.31it/s]
Profiling:  12%|█▏        | 81/651 [00:00<00:05, 104.61it/s]
Profiling:  15%|█▍        | 97/651 [00:01<00:04, 115.49it/s]
Profiling:  17%|█▋        | 109/651 [00:01<00:04, 112.63it/s]
Profiling:  19%|█▉        | 124/651 [00:01<00:04, 121.80it/s]
Profiling:  21%|██        | 137/651 [00:01<00:04, 118.22it/s]
Profiling:  23%|██▎       | 151/651 [00:01<00:04, 123.36it/s]
Profiling:  25%|██▌       | 164/651 [00:01<00:04, 117.42it/s]
Profiling:  27%|██▋       | 178/651 [00:01<00:03, 120.48it/s]
Profiling:  29%|██▉       | 191/651 [00:01<00:03, 116.63it/s]
Profiling:  31%|███▏      | 205/651 [00:01<00:03, 119.00it/s]
Profiling:  33%|███▎      | 217/651 [00:05<00:34, 12.69it/s] 
Profiling:  35%|███▍      | 226/651 [00:05<00:26, 15.77it/s]
Profiling:  36%|███▋      | 236/651 [00:05<00:20, 20.21it/s]
Profiling:  38%|███▊      | 246/651 [00:05<00:15, 25.74it/s]
Profiling:  40%|████      | 262/651 [00:05<00:10, 37.60it/s]
Profiling:  42%|████▏     | 273/651 [00:05<00:08, 44.68it/s]
Profiling:  44%|████▍     | 289/651 [00:05<00:06, 59.10it/s]
Profiling:  46%|████▌     | 301/651 [00:05<00:05, 66.46it/s]
Profiling:  48%|████▊     | 314/651 [00:05<00:04, 77.60it/s]
Profiling:  50%|█████     | 326/651 [00:06<00:03, 83.77it/s]
Profiling:  52%|█████▏    | 341/651 [00:06<00:03, 96.88it/s]
Profiling:  54%|█████▍    | 353/651 [00:06<00:03, 97.46it/s]
Profiling:  56%|█████▌    | 365/651 [00:06<00:02, 101.73it/s]
Profiling:  58%|█████▊    | 377/651 [00:06<00:02, 105.55it/s]
Profiling:  60%|█████▉    | 389/651 [00:06<00:02, 96.86it/s] 
Profiling:  62%|██████▏   | 404/651 [00:07<00:04, 53.95it/s]
Profiling:  63%|██████▎   | 413/651 [00:07<00:04, 57.91it/s]
Profiling:  66%|██████▌   | 427/651 [00:07<00:03, 71.81it/s]
Profiling:  68%|██████▊   | 441/651 [00:07<00:02, 84.64it/s]
Profiling:  70%|██████▉   | 454/651 [00:07<00:02, 92.62it/s]
Profiling:  72%|███████▏  | 467/651 [00:07<00:01, 100.29it/s]
Profiling:  74%|███████▎  | 480/651 [00:07<00:01, 106.43it/s]
Profiling:  76%|███████▌  | 492/651 [00:07<00:01, 103.93it/s]
Profiling:  78%|███████▊  | 507/651 [00:08<00:01, 113.22it/s]
Profiling:  80%|███████▉  | 519/651 [00:08<00:01, 110.25it/s]
Profiling:  82%|████████▏ | 534/651 [00:08<00:00, 118.92it/s]
Profiling:  84%|████████▍ | 547/651 [00:08<00:00, 116.27it/s]
Profiling:  86%|████████▌ | 559/651 [00:08<00:00, 115.72it/s]
Profiling:  88%|████████▊ | 571/651 [00:08<00:00, 115.00it/s]
Profiling:  90%|████████▉ | 584/651 [00:08<00:00, 118.88it/s]
Profiling:  92%|█████████▏| 597/651 [00:08<00:00, 121.42it/s]
Profiling:  94%|█████████▎| 610/651 [00:09<00:00, 56.75it/s] 
Profiling:  95%|█████████▌| 621/651 [00:09<00:00, 63.74it/s]
Profiling:  97%|█████████▋| 631/651 [00:09<00:00, 69.14it/s]
Profiling:  98%|█████████▊| 641/651 [00:09<00:00, 73.39it/s]
Profiling: 100%|██████████| 651/651 [00:09<00:00, 66.33it/s]
wespro-3rdfrankn-v1-mkmlizer: quantized model in 34.232s
wespro-3rdfrankn-v1-mkmlizer: Processed model WesPro/3rdFrankn in 89.939s
wespro-3rdfrankn-v1-mkmlizer: creating bucket guanaco-mkml-models
wespro-3rdfrankn-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
wespro-3rdfrankn-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/wespro-3rdfrankn-v1
wespro-3rdfrankn-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/wespro-3rdfrankn-v1/special_tokens_map.json
wespro-3rdfrankn-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/wespro-3rdfrankn-v1/tokenizer_config.json
wespro-3rdfrankn-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/wespro-3rdfrankn-v1/config.json
wespro-3rdfrankn-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/wespro-3rdfrankn-v1/tokenizer.model
wespro-3rdfrankn-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/wespro-3rdfrankn-v1/tokenizer.json
wespro-3rdfrankn-v1-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/wespro-3rdfrankn-v1/mkml_model.tensors
wespro-3rdfrankn-v1-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
wespro-3rdfrankn-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
wespro-3rdfrankn-v1-mkmlizer:   warnings.warn(
wespro-3rdfrankn-v1-mkmlizer: 
config.json:   0%|          | 0.00/1.05k [00:00<?, ?B/s]
config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 10.8MB/s]
wespro-3rdfrankn-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
wespro-3rdfrankn-v1-mkmlizer:   warnings.warn(
wespro-3rdfrankn-v1-mkmlizer: 
pytorch_model.bin:   0%|          | 0.00/1.44G [00:00<?, ?B/s]
pytorch_model.bin:   1%|          | 10.5M/1.44G [00:00<00:56, 25.5MB/s]
pytorch_model.bin:   7%|▋         | 94.4M/1.44G [00:00<00:05, 234MB/s] 
pytorch_model.bin:  14%|█▍        | 199M/1.44G [00:00<00:02, 434MB/s] 
pytorch_model.bin:  29%|██▉       | 419M/1.44G [00:00<00:01, 907MB/s]
pytorch_model.bin:  38%|███▊      | 556M/1.44G [00:00<00:00, 890MB/s]
pytorch_model.bin:  46%|████▋     | 671M/1.44G [00:01<00:01, 705MB/s]
pytorch_model.bin:  53%|█████▎    | 765M/1.44G [00:02<00:03, 195MB/s]
pytorch_model.bin:  67%|██████▋   | 962M/1.44G [00:02<00:01, 322MB/s]
pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:02<00:00, 523MB/s]
wespro-3rdfrankn-v1-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
wespro-3rdfrankn-v1-mkmlizer: Saving duration: 0.259s
wespro-3rdfrankn-v1-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 6.700s
wespro-3rdfrankn-v1-mkmlizer: creating bucket guanaco-reward-models
wespro-3rdfrankn-v1-mkmlizer: Bucket 's3://guanaco-reward-models/' created
wespro-3rdfrankn-v1-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward
wespro-3rdfrankn-v1-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward/config.json
wespro-3rdfrankn-v1-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward/special_tokens_map.json
wespro-3rdfrankn-v1-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward/tokenizer_config.json
wespro-3rdfrankn-v1-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward/vocab.json
wespro-3rdfrankn-v1-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward/tokenizer.json
wespro-3rdfrankn-v1-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward/merges.txt
wespro-3rdfrankn-v1-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/wespro-3rdfrankn-v1_reward/reward.tensors
Job wespro-3rdfrankn-v1-mkmlizer completed after 125.61s with status: succeeded
Stopping job with name wespro-3rdfrankn-v1-mkmlizer
Pipeline stage MKMLizer completed in 129.31s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.11s
Running pipeline stage ISVCDeployer
Creating inference service wespro-3rdfrankn-v1
Waiting for inference service wespro-3rdfrankn-v1 to be ready
Inference service wespro-3rdfrankn-v1 ready after 50.3055579662323s
Pipeline stage ISVCDeployer completed in 57.32s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.728318452835083s
Received healthy response to inference request in 2.351613998413086s
Received healthy response to inference request in 2.1816725730895996s
Received healthy response to inference request in 2.2143986225128174s
Received healthy response to inference request in 2.194035053253174s
5 requests
0 failed requests
5th percentile: 2.1841450691223145
10th percentile: 2.1866175651550295
20th percentile: 2.191562557220459
30th percentile: 2.1981077671051024
40th percentile: 2.20625319480896
50th percentile: 2.2143986225128174
60th percentile: 2.2692847728729246
70th percentile: 2.3241709232330323
80th percentile: 2.4269548892974853
90th percentile: 2.5776366710662844
95th percentile: 2.6529775619506837
99th percentile: 2.7132502746582032
mean time: 2.334007740020752
Pipeline stage StressChecker completed in 12.50s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.03s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.06s
M-Eval Dataset for topic stay_in_character is loaded
wespro-3rdfrankn_v1 status is now deployed due to DeploymentManager action
wespro-3rdfrankn_v1 status is now rejected due to ELO is less than acceptable minimum 6.5