submission_id: maldv-winter-garden-7b-delta_v4
developer_uid: chai_backend_admin
status: inactive
model_repo: maldv/winter-garden-7b-delta
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
timestamp: 2024-04-02T17:14:27+00:00
model_name: auto_submit_ricum_povoganige
model_eval_status: success
safety_score: 0.99
entertaining: 7.13
stay_in_character: 8.56
user_preference: 7.58
double_thumbs_up: 210
thumbs_up: 444
thumbs_down: 387
num_battles: 23862
num_wins: 9286
win_ratio: 0.38915430391417316
celo_rating: 1075.58
Resubmit model
Running pipeline stage MKMLizer
Starting job with name maldv-winter-garden-7b-delta-v4-mkmlizer
Waiting for job on maldv-winter-garden-7b-delta-v4-mkmlizer to finish
maldv-winter-garden-7b-delta-v4-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ _____ __ __ ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ /___/ ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ Version: 0.6.11 ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ The license key for the current software has been verified as ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ belonging to: ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ Chai Research Corp. ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ║ ║
maldv-winter-garden-7b-delta-v4-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
maldv-winter-garden-7b-delta-v4-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 17.1MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: README.md: 0%| | 0.00/1.78k [00:00<?, ?B/s] README.md: 100%|██████████| 1.78k/1.78k [00:00<00:00, 23.4MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: config.json: 0%| | 0.00/632 [00:00<?, ?B/s] config.json: 100%|██████████| 632/632 [00:00<00:00, 8.66MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: generation_config.json: 0%| | 0.00/111 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 111/111 [00:00<00:00, 1.22MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00001-of-00011.safetensors: 0%| | 0.00/262M [00:00<?, ?B/s] model-00001-of-00011.safetensors: 0%| | 136/262M [00:00<181:57:38, 400B/s] model-00001-of-00011.safetensors: 12%|█▏ | 31.5M/262M [00:00<00:03, 63.8MB/s] model-00001-of-00011.safetensors: 16%|█▌ | 41.9M/262M [00:00<00:03, 68.6MB/s] model-00001-of-00011.safetensors: 36%|███▌ | 94.4M/262M [00:00<00:00, 174MB/s] model-00001-of-00011.safetensors: 100%|█████████▉| 262M/262M [00:00<00:00, 290MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00002-of-00011.safetensors: 0%| | 0.00/1.36G [00:00<?, ?B/s] model-00002-of-00011.safetensors: 1%| | 10.5M/1.36G [00:00<00:38, 35.1MB/s] model-00002-of-00011.safetensors: 3%|▎ | 41.9M/1.36G [00:00<00:12, 108MB/s] model-00002-of-00011.safetensors: 5%|▍ | 62.9M/1.36G [00:00<00:12, 102MB/s] model-00002-of-00011.safetensors: 8%|▊ | 115M/1.36G [00:00<00:06, 199MB/s] model-00002-of-00011.safetensors: 12%|█▏ | 168M/1.36G [00:00<00:04, 270MB/s] model-00002-of-00011.safetensors: 15%|█▌ | 210M/1.36G [00:01<00:04, 265MB/s] model-00002-of-00011.safetensors: 18%|█▊ | 241M/1.36G [00:01<00:04, 233MB/s] model-00002-of-00011.safetensors: 25%|██▍ | 336M/1.36G [00:01<00:02, 351MB/s] model-00002-of-00011.safetensors: 30%|███ | 409M/1.36G [00:01<00:02, 422MB/s] model-00002-of-00011.safetensors: 35%|███▍ | 472M/1.36G [00:01<00:02, 344MB/s] model-00002-of-00011.safetensors: 38%|███▊ | 514M/1.36G [00:01<00:02, 316MB/s] model-00002-of-00011.safetensors: 41%|████ | 552M/1.36G [00:02<00:03, 225MB/s] model-00002-of-00011.safetensors: 43%|████▎ | 583M/1.36G [00:02<00:03, 227MB/s] model-00002-of-00011.safetensors: 48%|████▊ | 656M/1.36G [00:02<00:02, 315MB/s] model-00002-of-00011.safetensors: 57%|█████▋ | 772M/1.36G [00:02<00:01, 480MB/s] model-00002-of-00011.safetensors: 68%|██████▊ | 929M/1.36G [00:02<00:00, 718MB/s] model-00002-of-00011.safetensors: 85%|████████▍ | 1.15G/1.36G [00:02<00:00, 1.05GB/s] model-00002-of-00011.safetensors: 100%|█████████▉| 1.36G/1.36G [00:02<00:00, 470MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00003-of-00011.safetensors: 0%| | 0.00/1.58G [00:00<?, ?B/s] model-00003-of-00011.safetensors: 1%| | 10.5M/1.58G [00:00<01:09, 22.5MB/s] model-00003-of-00011.safetensors: 5%|▍ | 73.4M/1.58G [00:00<00:09, 164MB/s] model-00003-of-00011.safetensors: 9%|▉ | 147M/1.58G [00:00<00:04, 303MB/s] model-00003-of-00011.safetensors: 13%|█▎ | 210M/1.58G [00:00<00:03, 383MB/s] model-00003-of-00011.safetensors: 17%|█▋ | 273M/1.58G [00:00<00:03, 409MB/s] model-00003-of-00011.safetensors: 21%|██▏ | 336M/1.58G [00:01<00:02, 448MB/s] model-00003-of-00011.safetensors: 25%|██▌ | 398M/1.58G [00:01<00:02, 484MB/s] model-00003-of-00011.safetensors: 29%|██▉ | 461M/1.58G [00:01<00:02, 490MB/s] model-00003-of-00011.safetensors: 33%|███▎ | 524M/1.58G [00:01<00:02, 510MB/s] model-00003-of-00011.safetensors: 37%|███▋ | 587M/1.58G [00:01<00:01, 512MB/s] model-00003-of-00011.safetensors: 41%|████ | 644M/1.58G [00:01<00:02, 425MB/s] model-00003-of-00011.safetensors: 44%|████▍ | 696M/1.58G [00:01<00:02, 370MB/s] model-00003-of-00011.safetensors: 47%|████▋ | 738M/1.58G [00:02<00:02, 332MB/s] model-00003-of-00011.safetensors: 49%|████▉ | 780M/1.58G [00:02<00:03, 259MB/s] model-00003-of-00011.safetensors: 54%|█████▍ | 854M/1.58G [00:02<00:02, 344MB/s] model-00003-of-00011.safetensors: 57%|█████▋ | 906M/1.58G [00:02<00:02, 333MB/s] model-00003-of-00011.safetensors: 66%|██████▌ | 1.04G/1.58G [00:02<00:00, 542MB/s] model-00003-of-00011.safetensors: 78%|███████▊ | 1.23G/1.58G [00:02<00:00, 841MB/s] model-00003-of-00011.safetensors: 88%|████████▊ | 1.39G/1.58G [00:02<00:00, 1.02GB/s] model-00003-of-00011.safetensors: 100%|█████████▉| 1.58G/1.58G [00:02<00:00, 534MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00004-of-00011.safetensors: 0%| | 0.00/1.43G [00:00<?, ?B/s] model-00004-of-00011.safetensors: 1%| | 10.5M/1.43G [00:00<00:40, 35.3MB/s] model-00004-of-00011.safetensors: 1%|▏ | 21.0M/1.43G [00:00<00:33, 42.2MB/s] model-00004-of-00011.safetensors: 2%|▏ | 31.5M/1.43G [00:00<00:44, 31.5MB/s] model-00004-of-00011.safetensors: 7%|▋ | 94.4M/1.43G [00:01<00:10, 128MB/s] model-00004-of-00011.safetensors: 11%|█ | 157M/1.43G [00:01<00:05, 214MB/s] model-00004-of-00011.safetensors: 18%|█▊ | 252M/1.43G [00:01<00:03, 362MB/s] model-00004-of-00011.safetensors: 24%|██▍ | 346M/1.43G [00:01<00:02, 486MB/s] model-00004-of-00011.safetensors: 29%|██▉ | 419M/1.43G [00:01<00:01, 546MB/s] model-00004-of-00011.safetensors: 35%|███▍ | 493M/1.43G [00:01<00:01, 469MB/s] model-00004-of-00011.safetensors: 39%|███▉ | 556M/1.43G [00:02<00:03, 280MB/s] model-00004-of-00011.safetensors: 52%|█████▏ | 745M/1.43G [00:02<00:01, 508MB/s] model-00004-of-00011.safetensors: 58%|█████▊ | 828M/1.43G [00:02<00:01, 565MB/s] model-00004-of-00011.safetensors: 64%|██████▍ | 912M/1.43G [00:02<00:00, 541MB/s] model-00004-of-00011.safetensors: 72%|███████▏ | 1.03G/1.43G [00:02<00:00, 657MB/s] model-00004-of-00011.safetensors: 83%|████████▎ | 1.18G/1.43G [00:02<00:00, 855MB/s] model-00004-of-00011.safetensors: 100%|█████████▉| 1.43G/1.43G [00:02<00:00, 506MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00005-of-00011.safetensors: 0%| | 0.00/1.36G [00:00<?, ?B/s] model-00005-of-00011.safetensors: 1%| | 10.5M/1.36G [00:00<00:41, 32.4MB/s] model-00005-of-00011.safetensors: 2%|▏ | 21.0M/1.36G [00:00<00:38, 35.0MB/s] model-00005-of-00011.safetensors: 4%|▍ | 52.4M/1.36G [00:00<00:13, 94.3MB/s] model-00005-of-00011.safetensors: 5%|▌ | 73.4M/1.36G [00:00<00:12, 101MB/s] model-00005-of-00011.safetensors: 7%|▋ | 94.4M/1.36G [00:01<00:12, 105MB/s] model-00005-of-00011.safetensors: 8%|▊ | 115M/1.36G [00:01<00:10, 124MB/s] model-00005-of-00011.safetensors: 11%|█ | 147M/1.36G [00:01<00:07, 153MB/s] model-00005-of-00011.safetensors: 16%|█▌ | 220M/1.36G [00:01<00:04, 268MB/s] model-00005-of-00011.safetensors: 22%|██▏ | 304M/1.36G [00:01<00:02, 397MB/s] model-00005-of-00011.safetensors: 27%|██▋ | 367M/1.36G [00:01<00:02, 452MB/s] model-00005-of-00011.safetensors: 31%|███▏ | 426M/1.36G [00:02<00:03, 284MB/s] model-00005-of-00011.safetensors: 34%|███▍ | 468M/1.36G [00:02<00:03, 248MB/s] model-00005-of-00011.safetensors: 38%|███▊ | 510M/1.36G [00:02<00:03, 231MB/s] model-00005-of-00011.safetensors: 41%|████▏ | 562M/1.36G [00:02<00:02, 280MB/s] model-00005-of-00011.safetensors: 49%|████▉ | 667M/1.36G [00:02<00:01, 427MB/s] model-00005-of-00011.safetensors: 61%|██████▏ | 835M/1.36G [00:02<00:00, 569MB/s] model-00005-of-00011.safetensors: 100%|█████████▉| 1.36G/1.36G [00:03<00:00, 844MB/s] model-00005-of-00011.safetensors: 100%|█████████▉| 1.36G/1.36G [00:03<00:00, 396MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00006-of-00011.safetensors: 0%| | 0.00/1.58G [00:00<?, ?B/s] model-00006-of-00011.safetensors: 1%| | 10.5M/1.58G [00:00<00:49, 31.7MB/s] model-00006-of-00011.safetensors: 4%|▍ | 62.9M/1.58G [00:00<00:08, 180MB/s] model-00006-of-00011.safetensors: 7%|▋ | 105M/1.58G [00:00<00:07, 189MB/s] model-00006-of-00011.safetensors: 10%|▉ | 157M/1.58G [00:00<00:05, 262MB/s] model-00006-of-00011.safetensors: 13%|█▎ | 199M/1.58G [00:00<00:05, 264MB/s] model-00006-of-00011.safetensors: 15%|█▌ | 241M/1.58G [00:01<00:04, 290MB/s] model-00006-of-00011.safetensors: 18%|█▊ | 283M/1.58G [00:01<00:04, 278MB/s] model-00006-of-00011.safetensors: 23%|██▎ | 367M/1.58G [00:01<00:02, 408MB/s] model-00006-of-00011.safetensors: 27%|██▋ | 419M/1.58G [00:01<00:02, 428MB/s] model-00006-of-00011.safetensors: 31%|███ | 482M/1.58G [00:01<00:02, 469MB/s] model-00006-of-00011.safetensors: 38%|███▊ | 598M/1.58G [00:01<00:01, 607MB/s] model-00006-of-00011.safetensors: 42%|████▏ | 665M/1.58G [00:01<00:01, 483MB/s] model-00006-of-00011.safetensors: 46%|████▌ | 728M/1.58G [00:02<00:01, 462MB/s] model-00006-of-00011.safetensors: 49%|████▉ | 780M/1.58G [00:02<00:01, 436MB/s] model-00006-of-00011.safetensors: 55%|█████▍ | 864M/1.58G [00:02<00:01, 488MB/s] model-00006-of-00011.safetensors: 60%|██████ | 948M/1.58G [00:02<00:01, 541MB/s] model-00006-of-00011.safetensors: 67%|██████▋ | 1.06G/1.58G [00:02<00:00, 683MB/s] model-00006-of-00011.safetensors: 85%|████████▍ | 1.34G/1.58G [00:02<00:00, 1.19GB/s] model-00006-of-00011.safetensors: 96%|█████████▌| 1.51G/1.58G [00:02<00:00, 1.33GB/s] model-00006-of-00011.safetensors: 100%|█████████▉| 1.58G/1.58G [00:03<00:00, 421MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00007-of-00011.safetensors: 0%| | 0.00/1.43G [00:00<?, ?B/s] model-00007-of-00011.safetensors: 1%| | 10.5M/1.43G [00:00<00:49, 28.6MB/s] model-00007-of-00011.safetensors: 4%|▎ | 52.4M/1.43G [00:00<00:12, 108MB/s] model-00007-of-00011.safetensors: 5%|▌ | 73.4M/1.43G [00:00<00:13, 100MB/s] model-00007-of-00011.safetensors: 7%|▋ | 94.4M/1.43G [00:01<00:13, 98.2MB/s] model-00007-of-00011.safetensors: 9%|▉ | 126M/1.43G [00:01<00:10, 125MB/s] model-00007-of-00011.safetensors: 10%|█ | 147M/1.43G [00:01<00:10, 117MB/s] model-00007-of-00011.safetensors: 12%|█▏ | 168M/1.43G [00:01<00:15, 80.4MB/s] model-00007-of-00011.safetensors: 15%|█▍ | 210M/1.43G [00:01<00:10, 121MB/s] model-00007-of-00011.safetensors: 17%|█▋ | 241M/1.43G [00:02<00:08, 144MB/s] model-00007-of-00011.safetensors: 21%|██ | 294M/1.43G [00:02<00:06, 179MB/s] model-00007-of-00011.safetensors: 23%|██▎ | 325M/1.43G [00:02<00:05, 185MB/s] model-00007-of-00011.safetensors: 29%|██▉ | 419M/1.43G [00:02<00:03, 313MB/s] model-00007-of-00011.safetensors: 32%|███▏ | 461M/1.43G [00:02<00:02, 331MB/s] model-00007-of-00011.safetensors: 38%|███▊ | 545M/1.43G [00:02<00:02, 433MB/s] model-00007-of-00011.safetensors: 48%|████▊ | 682M/1.43G [00:02<00:01, 631MB/s] model-00007-of-00011.safetensors: 60%|██████ | 860M/1.43G [00:03<00:00, 904MB/s] model-00007-of-00011.safetensors: 73%|███████▎ | 1.04G/1.43G [00:03<00:00, 1.08GB/s] model-00007-of-00011.safetensors: 81%|████████ | 1.15G/1.43G [00:03<00:00, 932MB/s] model-00007-of-00011.safetensors: 88%|████████▊ | 1.26G/1.43G [00:03<00:00, 824MB/s] model-00007-of-00011.safetensors: 98%|█████████▊| 1.39G/1.43G [00:03<00:00, 582MB/s] model-00007-of-00011.safetensors: 100%|█████████▉| 1.43G/1.43G [00:04<00:00, 317MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00008-of-00011.safetensors: 0%| | 0.00/1.36G [00:00<?, ?B/s] model-00008-of-00011.safetensors: 1%| | 10.5M/1.36G [00:00<01:06, 20.3MB/s] model-00008-of-00011.safetensors: 2%|▏ | 21.0M/1.36G [00:00<00:57, 23.2MB/s] model-00008-of-00011.safetensors: 2%|▏ | 31.5M/1.36G [00:01<00:52, 25.2MB/s] model-00008-of-00011.safetensors: 4%|▍ | 52.4M/1.36G [00:01<00:28, 46.6MB/s] model-00008-of-00011.safetensors: 5%|▍ | 62.9M/1.36G [00:01<00:26, 49.2MB/s] model-00008-of-00011.safetensors: 5%|▌ | 73.4M/1.36G [00:01<00:30, 41.5MB/s] model-00008-of-00011.safetensors: 6%|▌ | 83.9M/1.36G [00:02<00:28, 44.3MB/s] model-00008-of-00011.safetensors: 8%|▊ | 105M/1.36G [00:02<00:19, 64.8MB/s] model-00008-of-00011.safetensors: 8%|▊ | 115M/1.36G [00:02<00:17, 69.6MB/s] model-00008-of-00011.safetensors: 13%|█▎ | 178M/1.36G [00:02<00:06, 174MB/s] model-00008-of-00011.safetensors: 15%|█▌ | 210M/1.36G [00:02<00:06, 189MB/s] model-00008-of-00011.safetensors: 18%|█▊ | 241M/1.36G [00:02<00:05, 209MB/s] model-00008-of-00011.safetensors: 22%|██▏ | 304M/1.36G [00:02<00:03, 295MB/s] model-00008-of-00011.safetensors: 25%|██▌ | 346M/1.36G [00:03<00:03, 321MB/s] model-00008-of-00011.safetensors: 41%|████ | 556M/1.36G [00:03<00:01, 771MB/s] model-00008-of-00011.safetensors: 53%|█████▎ | 724M/1.36G [00:03<00:00, 937MB/s] model-00008-of-00011.safetensors: 81%|████████ | 1.10G/1.36G [00:03<00:00, 1.61GB/s] model-00008-of-00011.safetensors: 94%|█████████▍| 1.28G/1.36G [00:03<00:00, 1.13GB/s] model-00008-of-00011.safetensors: 100%|█████████▉| 1.36G/1.36G [00:03<00:00, 365MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00009-of-00011.safetensors: 0%| | 0.00/1.58G [00:00<?, ?B/s] model-00009-of-00011.safetensors: 1%| | 10.5M/1.58G [00:02<05:53, 4.43MB/s] model-00009-of-00011.safetensors: 7%|▋ | 105M/1.58G [00:02<00:25, 57.7MB/s] model-00009-of-00011.safetensors: 13%|█▎ | 210M/1.58G [00:02<00:10, 130MB/s] model-00009-of-00011.safetensors: 23%|██▎ | 357M/1.58G [00:02<00:05, 233MB/s] model-00009-of-00011.safetensors: 37%|███▋ | 587M/1.58G [00:02<00:02, 461MB/s] model-00009-of-00011.safetensors: 67%|██████▋ | 1.06G/1.58G [00:03<00:00, 1.00GB/s] model-00009-of-00011.safetensors: 81%|████████ | 1.28G/1.58G [00:03<00:00, 798MB/s] model-00009-of-00011.safetensors: 91%|█████████▏| 1.44G/1.58G [00:03<00:00, 781MB/s] model-00009-of-00011.safetensors: 100%|█████████▉| 1.58G/1.58G [00:03<00:00, 415MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00010-of-00011.safetensors: 0%| | 0.00/1.43G [00:00<?, ?B/s] model-00010-of-00011.safetensors: 1%| | 10.5M/1.43G [00:00<00:56, 25.1MB/s] model-00010-of-00011.safetensors: 1%|▏ | 21.0M/1.43G [00:00<00:31, 44.0MB/s] model-00010-of-00011.safetensors: 2%|▏ | 31.5M/1.43G [00:00<00:24, 57.5MB/s] model-00010-of-00011.safetensors: 3%|▎ | 41.9M/1.43G [00:01<00:46, 29.7MB/s] model-00010-of-00011.safetensors: 4%|▎ | 52.4M/1.43G [00:01<00:37, 36.7MB/s] model-00010-of-00011.safetensors: 4%|▍ | 62.9M/1.43G [00:01<00:31, 43.4MB/s] model-00010-of-00011.safetensors: 6%|▌ | 83.9M/1.43G [00:01<00:23, 56.5MB/s] model-00010-of-00011.safetensors: 7%|▋ | 94.4M/1.43G [00:02<00:23, 57.2MB/s] model-00010-of-00011.safetensors: 8%|▊ | 115M/1.43G [00:02<00:16, 77.9MB/s] model-00010-of-00011.safetensors: 9%|▉ | 126M/1.43G [00:02<00:19, 66.4MB/s] model-00010-of-00011.safetensors: 12%|█▏ | 168M/1.43G [00:02<00:09, 126MB/s] model-00010-of-00011.safetensors: 14%|█▍ | 199M/1.43G [00:02<00:07, 153MB/s] model-00010-of-00011.safetensors: 15%|█▌ | 220M/1.43G [00:02<00:07, 157MB/s] model-00010-of-00011.safetensors: 19%|█▉ | 273M/1.43G [00:02<00:04, 236MB/s] model-00010-of-00011.safetensors: 24%|██▍ | 346M/1.43G [00:02<00:03, 352MB/s] model-00010-of-00011.safetensors: 32%|███▏ | 451M/1.43G [00:03<00:01, 527MB/s] model-00010-of-00011.safetensors: 43%|████▎ | 608M/1.43G [00:03<00:01, 749MB/s] model-00010-of-00011.safetensors: 57%|█████▋ | 818M/1.43G [00:03<00:00, 1.09GB/s] model-00010-of-00011.safetensors: 65%|██████▌ | 933M/1.43G [00:03<00:00, 835MB/s] model-00010-of-00011.safetensors: 73%|███████▎ | 1.04G/1.43G [00:03<00:00, 749MB/s] model-00010-of-00011.safetensors: 79%|███████▉ | 1.13G/1.43G [00:03<00:00, 689MB/s] model-00010-of-00011.safetensors: 85%|████████▌ | 1.22G/1.43G [00:04<00:00, 616MB/s] model-00010-of-00011.safetensors: 93%|█████████▎| 1.33G/1.43G [00:04<00:00, 723MB/s] model-00010-of-00011.safetensors: 100%|█████████▉| 1.43G/1.43G [00:04<00:00, 336MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model-00011-of-00011.safetensors: 0%| | 0.00/1.13G [00:00<?, ?B/s] model-00011-of-00011.safetensors: 1%| | 10.5M/1.13G [00:00<00:51, 21.7MB/s] model-00011-of-00011.safetensors: 4%|▎ | 41.9M/1.13G [00:00<00:14, 74.0MB/s] model-00011-of-00011.safetensors: 6%|▌ | 62.9M/1.13G [00:02<00:42, 25.2MB/s] model-00011-of-00011.safetensors: 9%|▉ | 105M/1.13G [00:02<00:20, 50.4MB/s] model-00011-of-00011.safetensors: 15%|█▍ | 168M/1.13G [00:02<00:10, 94.9MB/s] model-00011-of-00011.safetensors: 20%|██ | 231M/1.13G [00:02<00:06, 148MB/s] model-00011-of-00011.safetensors: 29%|██▊ | 325M/1.13G [00:02<00:03, 249MB/s] model-00011-of-00011.safetensors: 37%|███▋ | 422M/1.13G [00:02<00:02, 352MB/s] model-00011-of-00011.safetensors: 57%|█████▋ | 642M/1.13G [00:02<00:00, 678MB/s] model-00011-of-00011.safetensors: 69%|██████▊ | 778M/1.13G [00:03<00:00, 810MB/s] model-00011-of-00011.safetensors: 100%|█████████▉| 1.13G/1.13G [00:03<00:00, 356MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: model.safetensors.index.json: 0%| | 0.00/22.8k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 22.8k/22.8k [00:00<00:00, 133MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: special_tokens_map.json: 0%| | 0.00/552 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 552/552 [00:00<00:00, 5.32MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: tokenizer.json: 0%| | 0.00/1.80M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 28.8MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: tokenizer.model: 0%| | 0.00/493k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 27.3MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: tokenizer_config.json: 0%| | 0.00/1.50k [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 1.50k/1.50k [00:00<00:00, 14.5MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: Downloaded to shared memory in 89.369s
maldv-winter-garden-7b-delta-v4-mkmlizer: quantizing model to /dev/shm/model_cache
maldv-winter-garden-7b-delta-v4-mkmlizer: Saving mkml model at /dev/shm/model_cache
maldv-winter-garden-7b-delta-v4-mkmlizer: Reading /tmp/tmpxrkvh7zx/model.safetensors.index.json
maldv-winter-garden-7b-delta-v4-mkmlizer: Profiling: 0%| | 0/291 [00:00<?, ?it/s] Profiling: 0%| | 1/291 [00:01<06:52, 1.42s/it] Profiling: 5%|▍ | 14/291 [00:01<00:22, 12.37it/s] Profiling: 11%|█ | 32/291 [00:01<00:08, 30.27it/s] Profiling: 16%|█▋ | 48/291 [00:01<00:05, 47.62it/s] Profiling: 21%|██▏ | 62/291 [00:01<00:03, 59.02it/s] Profiling: 28%|██▊ | 82/291 [00:02<00:02, 84.07it/s] Profiling: 33%|███▎ | 97/291 [00:02<00:02, 90.38it/s] Profiling: 41%|████ | 120/291 [00:02<00:01, 119.99it/s] Profiling: 47%|████▋ | 137/291 [00:02<00:01, 119.23it/s] Profiling: 52%|█████▏ | 152/291 [00:02<00:01, 115.82it/s] Profiling: 60%|█████▉ | 174/291 [00:02<00:00, 136.89it/s] Profiling: 65%|██████▌ | 190/291 [00:02<00:00, 130.12it/s] Profiling: 73%|███████▎ | 212/291 [00:02<00:00, 136.59it/s] Profiling: 79%|███████▊ | 229/291 [00:03<00:00, 142.32it/s] Profiling: 84%|████████▍ | 244/291 [00:03<00:00, 133.57it/s] Profiling: 91%|█████████ | 265/291 [00:03<00:00, 148.82it/s] Profiling: 97%|█████████▋| 281/291 [00:04<00:00, 36.41it/s] Profiling: 100%|██████████| 291/291 [00:04<00:00, 61.96it/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: quantized model in 14.520s
maldv-winter-garden-7b-delta-v4-mkmlizer: Processed model maldv/winter-garden-7b-delta in 104.775s
maldv-winter-garden-7b-delta-v4-mkmlizer: creating bucket guanaco-mkml-models
maldv-winter-garden-7b-delta-v4-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
maldv-winter-garden-7b-delta-v4-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/maldv-winter-garden-7b-delta-v4
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/maldv-winter-garden-7b-delta-v4/config.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/maldv-winter-garden-7b-delta-v4/special_tokens_map.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/maldv-winter-garden-7b-delta-v4/tokenizer.model
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/maldv-winter-garden-7b-delta-v4/tokenizer_config.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/maldv-winter-garden-7b-delta-v4/tokenizer.json
maldv-winter-garden-7b-delta-v4-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
maldv-winter-garden-7b-delta-v4-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
maldv-winter-garden-7b-delta-v4-mkmlizer: warnings.warn(
maldv-winter-garden-7b-delta-v4-mkmlizer: config.json: 0%| | 0.00/1.05k [00:00<?, ?B/s] config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 12.8MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
maldv-winter-garden-7b-delta-v4-mkmlizer: warnings.warn(
maldv-winter-garden-7b-delta-v4-mkmlizer: tokenizer_config.json: 0%| | 0.00/234 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 2.73MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: vocab.json: 0%| | 0.00/1.04M [00:00<?, ?B/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 7.04MB/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 7.02MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 9.99MB/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 9.95MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
maldv-winter-garden-7b-delta-v4-mkmlizer: warnings.warn(
maldv-winter-garden-7b-delta-v4-mkmlizer: pytorch_model.bin: 0%| | 0.00/1.44G [00:00<?, ?B/s] pytorch_model.bin: 1%| | 10.5M/1.44G [00:00<00:14, 99.6MB/s] pytorch_model.bin: 5%|▌ | 73.4M/1.44G [00:00<00:03, 384MB/s] pytorch_model.bin: 8%|▊ | 115M/1.44G [00:00<00:03, 390MB/s] pytorch_model.bin: 12%|█▏ | 168M/1.44G [00:00<00:04, 309MB/s] pytorch_model.bin: 15%|█▍ | 210M/1.44G [00:00<00:03, 329MB/s] pytorch_model.bin: 20%|██ | 294M/1.44G [00:00<00:02, 461MB/s] pytorch_model.bin: 27%|██▋ | 388M/1.44G [00:00<00:01, 591MB/s] pytorch_model.bin: 37%|███▋ | 535M/1.44G [00:00<00:01, 820MB/s] pytorch_model.bin: 66%|██████▌ | 954M/1.44G [00:01<00:00, 1.77GB/s] pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:05<00:00, 279MB/s]
maldv-winter-garden-7b-delta-v4-mkmlizer: Saving duration: 0.234s
maldv-winter-garden-7b-delta-v4-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 9.071s
maldv-winter-garden-7b-delta-v4-mkmlizer: creating bucket guanaco-reward-models
maldv-winter-garden-7b-delta-v4-mkmlizer: Bucket 's3://guanaco-reward-models/' created
maldv-winter-garden-7b-delta-v4-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward/special_tokens_map.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward/config.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward/tokenizer_config.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward/merges.txt
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward/vocab.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward/tokenizer.json
maldv-winter-garden-7b-delta-v4-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/maldv-winter-garden-7b-delta-v4_reward/reward.tensors
Job maldv-winter-garden-7b-delta-v4-mkmlizer completed after 138.2s with status: succeeded
Stopping job with name maldv-winter-garden-7b-delta-v4-mkmlizer
Pipeline stage MKMLizer completed in 139.12s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service maldv-winter-garden-7b-delta-v4
Waiting for inference service maldv-winter-garden-7b-delta-v4 to be ready
Inference service maldv-winter-garden-7b-delta-v4 ready after 40.24459266662598s
Pipeline stage ISVCDeployer completed in 45.98s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.123706340789795s
Received healthy response to inference request in 0.5215120315551758s
Received healthy response to inference request in 0.9540624618530273s
Received healthy response to inference request in 0.9381897449493408s
Received healthy response to inference request in 0.9882199764251709s
5 requests
0 failed requests
5th percentile: 0.6048475742340088
10th percentile: 0.6881831169128418
20th percentile: 0.8548542022705078
30th percentile: 0.9413642883300781
40th percentile: 0.9477133750915527
50th percentile: 0.9540624618530273
60th percentile: 0.9677254676818847
70th percentile: 0.9813884735107422
80th percentile: 1.0153172492980957
90th percentile: 1.0695117950439452
95th percentile: 1.09660906791687
99th percentile: 1.11828688621521
mean time: 0.9051381111145019
Pipeline stage StressChecker completed in 5.53s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.06s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.05s
M-Eval Dataset for topic stay_in_character is loaded
maldv-winter-garden-7b-delta_v4 status is now deployed due to DeploymentManager action
maldv-winter-garden-7b-delta_v4 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics