submission_id: roleplay4fun-staticpunch-v1-0_v5
developer_uid: chai_backend_admin
status: inactive
model_repo: roleplay4fun/staticpunch-v1.0
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
timestamp: 2024-04-02T17:07:47+00:00
model_name: auto_submit_ricum_cidavocita
model_eval_status: success
safety_score: 0.96
entertaining: 6.58
stay_in_character: 8.25
user_preference: 6.96
double_thumbs_up: 245
thumbs_up: 376
thumbs_down: 224
num_battles: 24013
num_wins: 9965
win_ratio: 0.41498355057677094
celo_rating: 1093.89
Resubmit model
Running pipeline stage MKMLizer
Starting job with name roleplay4fun-staticpunch-v1-0-v5-mkmlizer
Waiting for job on roleplay4fun-staticpunch-v1-0-v5-mkmlizer to finish
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ _____ __ __ ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ /___/ ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ Version: 0.6.11 ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ The license key for the current software has been verified as ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ belonging to: ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ Chai Research Corp. ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ║ ║
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 8.15MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: added_tokens.json: 0%| | 0.00/21.0 [00:00<?, ?B/s] added_tokens.json: 100%|██████████| 21.0/21.0 [00:00<00:00, 97.7kB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: config.json: 0%| | 0.00/683 [00:00<?, ?B/s] config.json: 100%|██████████| 683/683 [00:00<00:00, 1.66MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: generation_config.json: 0%| | 0.00/154 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 154/154 [00:00<00:00, 785kB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: model-00001-of-00006.safetensors: 0%| | 0.00/4.98G [00:00<?, ?B/s] model-00001-of-00006.safetensors: 0%| | 10.5M/4.98G [00:01<14:49, 5.58MB/s] model-00001-of-00006.safetensors: 0%| | 21.0M/4.98G [00:02<08:21, 9.88MB/s] model-00001-of-00006.safetensors: 1%| | 31.5M/4.98G [00:02<04:54, 16.8MB/s] model-00001-of-00006.safetensors: 1%| | 41.9M/4.98G [00:02<03:43, 22.1MB/s] model-00001-of-00006.safetensors: 1%|▏ | 73.4M/4.98G [00:02<01:32, 52.8MB/s] model-00001-of-00006.safetensors: 3%|▎ | 157M/4.98G [00:02<00:31, 155MB/s] model-00001-of-00006.safetensors: 6%|▋ | 315M/4.98G [00:03<00:12, 375MB/s] model-00001-of-00006.safetensors: 9%|▉ | 451M/4.98G [00:03<00:09, 461MB/s] model-00001-of-00006.safetensors: 11%|█ | 524M/4.98G [00:03<00:09, 486MB/s] model-00001-of-00006.safetensors: 21%|██ | 1.04G/4.98G [00:04<00:06, 608MB/s] model-00001-of-00006.safetensors: 22%|██▏ | 1.11G/4.98G [00:04<00:08, 474MB/s] model-00001-of-00006.safetensors: 25%|██▍ | 1.24G/4.98G [00:04<00:06, 549MB/s] model-00001-of-00006.safetensors: 26%|██▋ | 1.31G/4.98G [00:04<00:07, 488MB/s] model-00001-of-00006.safetensors: 29%|██▊ | 1.43G/4.98G [00:04<00:06, 576MB/s] model-00001-of-00006.safetensors: 30%|███ | 1.51G/4.98G [00:05<00:06, 559MB/s] model-00001-of-00006.safetensors: 32%|███▏ | 1.61G/4.98G [00:05<00:05, 638MB/s] model-00001-of-00006.safetensors: 35%|███▍ | 1.73G/4.98G [00:05<00:04, 734MB/s] model-00001-of-00006.safetensors: 38%|███▊ | 1.88G/4.98G [00:05<00:03, 858MB/s] model-00001-of-00006.safetensors: 40%|████ | 2.00G/4.98G [00:05<00:03, 936MB/s] model-00001-of-00006.safetensors: 42%|████▏ | 2.11G/4.98G [00:05<00:03, 883MB/s] model-00001-of-00006.safetensors: 44%|████▍ | 2.21G/4.98G [00:05<00:03, 911MB/s] model-00001-of-00006.safetensors: 53%|█████▎ | 2.65G/4.98G [00:05<00:01, 1.77GB/s] model-00001-of-00006.safetensors: 57%|█████▋ | 2.85G/4.98G [00:06<00:03, 708MB/s] model-00001-of-00006.safetensors: 60%|██████ | 3.00G/4.98G [00:06<00:02, 664MB/s] model-00001-of-00006.safetensors: 63%|██████▎ | 3.12G/4.98G [00:07<00:03, 609MB/s] model-00001-of-00006.safetensors: 65%|██████▍ | 3.23G/4.98G [00:07<00:02, 636MB/s] model-00001-of-00006.safetensors: 68%|██████▊ | 3.38G/4.98G [00:07<00:02, 755MB/s] model-00001-of-00006.safetensors: 73%|███████▎ | 3.63G/4.98G [00:07<00:01, 1.06GB/s] model-00001-of-00006.safetensors: 76%|███████▌ | 3.77G/4.98G [00:07<00:01, 1.04GB/s] model-00001-of-00006.safetensors: 79%|███████▊ | 3.91G/4.98G [00:08<00:01, 702MB/s] model-00001-of-00006.safetensors: 81%|████████ | 4.02G/4.98G [00:08<00:01, 703MB/s] model-00001-of-00006.safetensors: 83%|████████▎ | 4.11G/4.98G [00:08<00:01, 584MB/s] model-00001-of-00006.safetensors: 84%|████████▍ | 4.19G/4.98G [00:08<00:01, 618MB/s] model-00001-of-00006.safetensors: 87%|████████▋ | 4.31G/4.98G [00:08<00:00, 706MB/s] model-00001-of-00006.safetensors: 89%|████████▊ | 4.41G/4.98G [00:08<00:00, 763MB/s] model-00001-of-00006.safetensors: 93%|█████████▎| 4.65G/4.98G [00:08<00:00, 1.11GB/s] model-00001-of-00006.safetensors: 99%|█████████▉| 4.95G/4.98G [00:10<00:00, 288MB/s] model-00001-of-00006.safetensors: 100%|█████████▉| 4.98G/4.98G [00:11<00:00, 437MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: model-00002-of-00006.safetensors: 0%| | 0.00/4.97G [00:00<?, ?B/s] model-00002-of-00006.safetensors: 0%| | 10.5M/4.97G [00:02<16:47, 4.93MB/s] model-00002-of-00006.safetensors: 0%| | 21.0M/4.97G [00:02<08:18, 9.93MB/s] model-00002-of-00006.safetensors: 1%| | 31.5M/4.97G [00:02<05:12, 15.8MB/s] model-00002-of-00006.safetensors: 1%| | 41.9M/4.97G [00:02<03:35, 22.8MB/s] model-00002-of-00006.safetensors: 2%|▏ | 83.9M/4.97G [00:02<01:15, 64.6MB/s] model-00002-of-00006.safetensors: 4%|▍ | 220M/4.97G [00:03<00:20, 236MB/s] model-00002-of-00006.safetensors: 7%|▋ | 367M/4.97G [00:03<00:11, 411MB/s] model-00002-of-00006.safetensors: 9%|▉ | 451M/4.97G [00:03<00:10, 448MB/s] model-00002-of-00006.safetensors: 17%|█▋ | 849M/4.97G [00:03<00:03, 1.11GB/s] model-00002-of-00006.safetensors: 21%|██ | 1.03G/4.97G [00:03<00:03, 1.19GB/s] model-00002-of-00006.safetensors: 24%|██▍ | 1.20G/4.97G [00:04<00:07, 525MB/s] model-00002-of-00006.safetensors: 27%|██▋ | 1.32G/4.97G [00:04<00:06, 543MB/s] model-00002-of-00006.safetensors: 29%|██▊ | 1.43G/4.97G [00:04<00:06, 579MB/s] model-00002-of-00006.safetensors: 31%|███ | 1.52G/4.97G [00:04<00:05, 577MB/s] model-00002-of-00006.safetensors: 32%|███▏ | 1.60G/4.97G [00:04<00:05, 585MB/s] model-00002-of-00006.safetensors: 34%|███▍ | 1.69G/4.97G [00:05<00:05, 605MB/s] model-00002-of-00006.safetensors: 36%|███▋ | 1.80G/4.97G [00:05<00:04, 712MB/s] model-00002-of-00006.safetensors: 38%|███▊ | 1.90G/4.97G [00:05<00:04, 738MB/s] model-00002-of-00006.safetensors: 41%|████ | 2.01G/4.97G [00:05<00:03, 816MB/s] model-00002-of-00006.safetensors: 42%|████▏ | 2.11G/4.97G [00:05<00:03, 834MB/s] model-00002-of-00006.safetensors: 45%|████▍ | 2.23G/4.97G [00:05<00:02, 937MB/s] model-00002-of-00006.safetensors: 51%|█████ | 2.53G/4.97G [00:05<00:01, 1.43GB/s] model-00002-of-00006.safetensors: 58%|█████▊ | 2.86G/4.97G [00:05<00:01, 1.85GB/s] model-00002-of-00006.safetensors: 61%|██████▏ | 3.05G/4.97G [00:06<00:02, 895MB/s] model-00002-of-00006.safetensors: 64%|██████▍ | 3.20G/4.97G [00:06<00:02, 670MB/s] model-00002-of-00006.safetensors: 67%|██████▋ | 3.31G/4.97G [00:06<00:02, 662MB/s] model-00002-of-00006.safetensors: 70%|██████▉ | 3.46G/4.97G [00:07<00:01, 765MB/s] model-00002-of-00006.safetensors: 73%|███████▎ | 3.65G/4.97G [00:07<00:01, 951MB/s] model-00002-of-00006.safetensors: 77%|███████▋ | 3.83G/4.97G [00:07<00:01, 1.10GB/s] model-00002-of-00006.safetensors: 80%|███████▉ | 3.97G/4.97G [00:07<00:00, 1.03GB/s] model-00002-of-00006.safetensors: 82%|████████▏ | 4.10G/4.97G [00:07<00:01, 714MB/s] model-00002-of-00006.safetensors: 85%|████████▍ | 4.20G/4.97G [00:07<00:01, 689MB/s] model-00002-of-00006.safetensors: 87%|████████▋ | 4.31G/4.97G [00:07<00:00, 751MB/s] model-00002-of-00006.safetensors: 89%|████████▊ | 4.40G/4.97G [00:08<00:00, 767MB/s] model-00002-of-00006.safetensors: 91%|█████████▏| 4.54G/4.97G [00:08<00:00, 896MB/s] model-00002-of-00006.safetensors: 94%|█████████▍| 4.69G/4.97G [00:08<00:00, 1.01GB/s] model-00002-of-00006.safetensors: 100%|█████████▉| 4.95G/4.97G [00:10<00:00, 203MB/s] model-00002-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:11<00:00, 448MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: model-00003-of-00006.safetensors: 0%| | 0.00/4.97G [00:00<?, ?B/s] model-00003-of-00006.safetensors: 0%| | 10.5M/4.97G [00:02<19:34, 4.22MB/s] model-00003-of-00006.safetensors: 0%| | 21.0M/4.97G [00:02<08:33, 9.64MB/s] model-00003-of-00006.safetensors: 1%| | 41.9M/4.97G [00:02<03:31, 23.3MB/s] model-00003-of-00006.safetensors: 3%|▎ | 136M/4.97G [00:02<00:46, 104MB/s] model-00003-of-00006.safetensors: 6%|▋ | 315M/4.97G [00:03<00:16, 277MB/s] model-00003-of-00006.safetensors: 8%|▊ | 388M/4.97G [00:03<00:13, 334MB/s] model-00003-of-00006.safetensors: 12%|█▏ | 587M/4.97G [00:03<00:07, 595MB/s] model-00003-of-00006.safetensors: 22%|██▏ | 1.08G/4.97G [00:03<00:02, 1.32GB/s] model-00003-of-00006.safetensors: 26%|██▌ | 1.28G/4.97G [00:04<00:06, 614MB/s] model-00003-of-00006.safetensors: 29%|██▊ | 1.43G/4.97G [00:04<00:05, 675MB/s] model-00003-of-00006.safetensors: 32%|███▏ | 1.60G/4.97G [00:04<00:04, 812MB/s] model-00003-of-00006.safetensors: 35%|███▌ | 1.75G/4.97G [00:04<00:03, 854MB/s] model-00003-of-00006.safetensors: 38%|███▊ | 1.89G/4.97G [00:04<00:03, 789MB/s] model-00003-of-00006.safetensors: 40%|████ | 2.00G/4.97G [00:04<00:03, 842MB/s] model-00003-of-00006.safetensors: 47%|████▋ | 2.33G/4.97G [00:04<00:02, 1.28GB/s] model-00003-of-00006.safetensors: 50%|█████ | 2.50G/4.97G [00:05<00:03, 792MB/s] model-00003-of-00006.safetensors: 53%|█████▎ | 2.63G/4.97G [00:05<00:02, 785MB/s] model-00003-of-00006.safetensors: 55%|█████▌ | 2.76G/4.97G [00:05<00:02, 857MB/s] model-00003-of-00006.safetensors: 59%|█████▉ | 2.95G/4.97G [00:05<00:01, 1.04GB/s] model-00003-of-00006.safetensors: 63%|██████▎ | 3.14G/4.97G [00:05<00:01, 1.20GB/s] model-00003-of-00006.safetensors: 66%|██████▌ | 3.29G/4.97G [00:05<00:01, 1.25GB/s] model-00003-of-00006.safetensors: 69%|██████▉ | 3.44G/4.97G [00:06<00:01, 811MB/s] model-00003-of-00006.safetensors: 72%|███████▏ | 3.55G/4.97G [00:06<00:02, 642MB/s] model-00003-of-00006.safetensors: 74%|███████▎ | 3.66G/4.97G [00:06<00:01, 670MB/s] model-00003-of-00006.safetensors: 76%|███████▌ | 3.76G/4.97G [00:06<00:01, 715MB/s] model-00003-of-00006.safetensors: 78%|███████▊ | 3.88G/4.97G [00:07<00:01, 798MB/s] model-00003-of-00006.safetensors: 81%|████████ | 4.03G/4.97G [00:07<00:01, 940MB/s] model-00003-of-00006.safetensors: 84%|████████▍ | 4.16G/4.97G [00:07<00:00, 1.04GB/s] model-00003-of-00006.safetensors: 86%|████████▋ | 4.30G/4.97G [00:07<00:00, 1.12GB/s] model-00003-of-00006.safetensors: 89%|████████▉ | 4.43G/4.97G [00:07<00:00, 1.04GB/s] model-00003-of-00006.safetensors: 92%|█████████▏| 4.55G/4.97G [00:07<00:00, 1.03GB/s] model-00003-of-00006.safetensors: 96%|█████████▌| 4.76G/4.97G [00:07<00:00, 1.30GB/s] model-00003-of-00006.safetensors: 99%|█████████▉| 4.94G/4.97G [00:08<00:00, 661MB/s] model-00003-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:11<00:00, 444MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: model-00004-of-00006.safetensors: 0%| | 0.00/4.93G [00:00<?, ?B/s] model-00004-of-00006.safetensors: 0%| | 10.5M/4.93G [00:00<03:17, 24.9MB/s] model-00004-of-00006.safetensors: 0%| | 21.0M/4.93G [00:01<05:40, 14.4MB/s] model-00004-of-00006.safetensors: 1%| | 31.5M/4.93G [00:01<04:11, 19.5MB/s] model-00004-of-00006.safetensors: 1%| | 41.9M/4.93G [00:01<03:08, 26.0MB/s] model-00004-of-00006.safetensors: 1%| | 52.4M/4.93G [00:02<02:58, 27.4MB/s] model-00004-of-00006.safetensors: 1%|▏ | 62.9M/4.93G [00:02<02:30, 32.3MB/s] model-00004-of-00006.safetensors: 2%|▏ | 94.4M/4.93G [00:02<01:15, 63.9MB/s] model-00004-of-00006.safetensors: 2%|▏ | 105M/4.93G [00:02<01:10, 68.4MB/s] model-00004-of-00006.safetensors: 3%|▎ | 126M/4.93G [00:02<00:58, 82.2MB/s] model-00004-of-00006.safetensors: 3%|▎ | 136M/4.93G [00:03<00:57, 82.9MB/s] model-00004-of-00006.safetensors: 4%|▍ | 189M/4.93G [00:03<00:28, 168MB/s] model-00004-of-00006.safetensors: 7%|▋ | 357M/4.93G [00:03<00:09, 477MB/s] model-00004-of-00006.safetensors: 9%|▊ | 419M/4.93G [00:03<00:09, 500MB/s] model-00004-of-00006.safetensors: 10%|▉ | 482M/4.93G [00:03<00:09, 484MB/s] model-00004-of-00006.safetensors: 24%|██▎ | 1.16G/4.93G [00:03<00:01, 2.00GB/s] model-00004-of-00006.safetensors: 29%|██▊ | 1.42G/4.93G [00:04<00:05, 610MB/s] model-00004-of-00006.safetensors: 32%|███▏ | 1.59G/4.93G [00:04<00:04, 702MB/s] model-00004-of-00006.safetensors: 36%|███▌ | 1.76G/4.93G [00:04<00:04, 768MB/s] model-00004-of-00006.safetensors: 39%|███▉ | 1.92G/4.93G [00:05<00:04, 704MB/s] model-00004-of-00006.safetensors: 41%|████▏ | 2.04G/4.93G [00:05<00:03, 748MB/s] model-00004-of-00006.safetensors: 44%|████▍ | 2.16G/4.93G [00:05<00:03, 787MB/s] model-00004-of-00006.safetensors: 51%|█████ | 2.53G/4.93G [00:05<00:01, 1.29GB/s] model-00004-of-00006.safetensors: 55%|█████▌ | 2.72G/4.93G [00:05<00:02, 1.06GB/s] model-00004-of-00006.safetensors: 58%|█████▊ | 2.87G/4.93G [00:06<00:02, 1.01GB/s] model-00004-of-00006.safetensors: 61%|██████ | 3.01G/4.93G [00:06<00:01, 1.00GB/s] model-00004-of-00006.safetensors: 64%|██████▎ | 3.14G/4.93G [00:06<00:02, 846MB/s] model-00004-of-00006.safetensors: 66%|██████▌ | 3.24G/4.93G [00:06<00:02, 767MB/s] model-00004-of-00006.safetensors: 68%|██████▊ | 3.37G/4.93G [00:06<00:01, 839MB/s] model-00004-of-00006.safetensors: 70%|███████ | 3.47G/4.93G [00:06<00:01, 854MB/s] model-00004-of-00006.safetensors: 72%|███████▏ | 3.57G/4.93G [00:06<00:01, 855MB/s] model-00004-of-00006.safetensors: 74%|███████▍ | 3.66G/4.93G [00:07<00:02, 623MB/s] model-00004-of-00006.safetensors: 76%|███████▌ | 3.74G/4.93G [00:07<00:01, 659MB/s] model-00004-of-00006.safetensors: 78%|███████▊ | 3.87G/4.93G [00:07<00:01, 771MB/s] model-00004-of-00006.safetensors: 81%|████████ | 3.97G/4.93G [00:07<00:01, 774MB/s] model-00004-of-00006.safetensors: 84%|████████▎ | 4.13G/4.93G [00:07<00:00, 902MB/s] model-00004-of-00006.safetensors: 86%|████████▌ | 4.24G/4.93G [00:07<00:00, 933MB/s] model-00004-of-00006.safetensors: 90%|█████████ | 4.45G/4.93G [00:07<00:00, 1.20GB/s] model-00004-of-00006.safetensors: 94%|█████████▎| 4.61G/4.93G [00:07<00:00, 1.31GB/s] model-00004-of-00006.safetensors: 96%|█████████▋| 4.76G/4.93G [00:08<00:00, 1.27GB/s] model-00004-of-00006.safetensors: 100%|█████████▉| 4.92G/4.93G [00:08<00:00, 1.35GB/s] model-00004-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:11<00:00, 437MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: model-00005-of-00006.safetensors: 0%| | 0.00/4.93G [00:00<?, ?B/s] model-00005-of-00006.safetensors: 0%| | 10.5M/4.93G [00:00<06:37, 12.4MB/s] model-00005-of-00006.safetensors: 0%| | 21.0M/4.93G [00:01<05:35, 14.7MB/s] model-00005-of-00006.safetensors: 1%|▏ | 73.4M/4.93G [00:01<01:11, 68.0MB/s] model-00005-of-00006.safetensors: 3%|▎ | 168M/4.93G [00:01<00:27, 174MB/s] model-00005-of-00006.safetensors: 4%|▍ | 220M/4.93G [00:02<00:27, 174MB/s] model-00005-of-00006.safetensors: 6%|▌ | 294M/4.93G [00:02<00:19, 238MB/s] model-00005-of-00006.safetensors: 7%|▋ | 336M/4.93G [00:02<00:17, 257MB/s] model-00005-of-00006.safetensors: 8%|▊ | 398M/4.93G [00:02<00:14, 310MB/s] model-00005-of-00006.safetensors: 9%|▉ | 440M/4.93G [00:02<00:14, 315MB/s] model-00005-of-00006.safetensors: 11%|█ | 524M/4.93G [00:02<00:10, 420MB/s] model-00005-of-00006.safetensors: 14%|█▍ | 703M/4.93G [00:02<00:05, 732MB/s] model-00005-of-00006.safetensors: 16%|█▌ | 797M/4.93G [00:02<00:05, 773MB/s] model-00005-of-00006.safetensors: 20%|█▉ | 975M/4.93G [00:02<00:03, 1.03GB/s] model-00005-of-00006.safetensors: 27%|██▋ | 1.33G/4.93G [00:03<00:02, 1.41GB/s] model-00005-of-00006.safetensors: 30%|██▉ | 1.48G/4.93G [00:03<00:04, 693MB/s] model-00005-of-00006.safetensors: 32%|███▏ | 1.59G/4.93G [00:03<00:04, 693MB/s] model-00005-of-00006.safetensors: 34%|███▍ | 1.70G/4.93G [00:03<00:04, 741MB/s] model-00005-of-00006.safetensors: 37%|███▋ | 1.80G/4.93G [00:04<00:04, 755MB/s] model-00005-of-00006.safetensors: 38%|███▊ | 1.90G/4.93G [00:04<00:04, 715MB/s] model-00005-of-00006.safetensors: 41%|████ | 2.01G/4.93G [00:04<00:03, 791MB/s] model-00005-of-00006.safetensors: 44%|████▍ | 2.18G/4.93G [00:04<00:02, 962MB/s] model-00005-of-00006.safetensors: 47%|████▋ | 2.30G/4.93G [00:04<00:02, 985MB/s] model-00005-of-00006.safetensors: 49%|████▉ | 2.41G/4.93G [00:04<00:02, 996MB/s] model-00005-of-00006.safetensors: 52%|█████▏ | 2.58G/4.93G [00:04<00:02, 1.16GB/s] model-00005-of-00006.safetensors: 58%|█████▊ | 2.87G/4.93G [00:04<00:01, 1.63GB/s] model-00005-of-00006.safetensors: 62%|██████▏ | 3.05G/4.93G [00:05<00:01, 1.15GB/s] model-00005-of-00006.safetensors: 65%|██████▍ | 3.20G/4.93G [00:05<00:02, 802MB/s] model-00005-of-00006.safetensors: 68%|██████▊ | 3.33G/4.93G [00:05<00:01, 877MB/s] model-00005-of-00006.safetensors: 70%|██████▉ | 3.45G/4.93G [00:05<00:02, 659MB/s] model-00005-of-00006.safetensors: 73%|███████▎ | 3.60G/4.93G [00:06<00:01, 786MB/s] model-00005-of-00006.safetensors: 75%|███████▌ | 3.72G/4.93G [00:06<00:01, 871MB/s] model-00005-of-00006.safetensors: 79%|███████▉ | 3.91G/4.93G [00:06<00:00, 1.05GB/s] model-00005-of-00006.safetensors: 82%|████████▏ | 4.05G/4.93G [00:06<00:00, 958MB/s] model-00005-of-00006.safetensors: 84%|████████▍ | 4.16G/4.93G [00:06<00:00, 896MB/s] model-00005-of-00006.safetensors: 87%|████████▋ | 4.28G/4.93G [00:06<00:00, 951MB/s] model-00005-of-00006.safetensors: 89%|████████▉ | 4.39G/4.93G [00:06<00:00, 880MB/s] model-00005-of-00006.safetensors: 91%|█████████ | 4.49G/4.93G [00:06<00:00, 804MB/s] model-00005-of-00006.safetensors: 98%|█████████▊| 4.83G/4.93G [00:07<00:00, 1.20GB/s] model-00005-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:11<00:00, 439MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: model-00006-of-00006.safetensors: 0%| | 0.00/1.25G [00:00<?, ?B/s] model-00006-of-00006.safetensors: 1%| | 10.5M/1.25G [00:00<01:54, 10.8MB/s] model-00006-of-00006.safetensors: 2%|▏ | 21.0M/1.25G [00:01<01:08, 17.8MB/s] model-00006-of-00006.safetensors: 3%|▎ | 41.9M/1.25G [00:01<00:30, 40.0MB/s] model-00006-of-00006.safetensors: 8%|▊ | 94.4M/1.25G [00:01<00:11, 104MB/s] model-00006-of-00006.safetensors: 9%|▉ | 115M/1.25G [00:01<00:10, 110MB/s] model-00006-of-00006.safetensors: 11%|█ | 136M/1.25G [00:01<00:09, 120MB/s] model-00006-of-00006.safetensors: 13%|█▎ | 157M/1.25G [00:02<00:08, 128MB/s] model-00006-of-00006.safetensors: 16%|█▌ | 199M/1.25G [00:02<00:06, 172MB/s] model-00006-of-00006.safetensors: 19%|█▊ | 231M/1.25G [00:02<00:05, 197MB/s] model-00006-of-00006.safetensors: 21%|██ | 262M/1.25G [00:02<00:04, 197MB/s] model-00006-of-00006.safetensors: 25%|██▌ | 315M/1.25G [00:02<00:03, 234MB/s] model-00006-of-00006.safetensors: 32%|███▏ | 396M/1.25G [00:02<00:02, 356MB/s] model-00006-of-00006.safetensors: 39%|███▉ | 490M/1.25G [00:02<00:01, 483MB/s] model-00006-of-00006.safetensors: 46%|████▌ | 574M/1.25G [00:02<00:01, 552MB/s] model-00006-of-00006.safetensors: 57%|█████▋ | 710M/1.25G [00:03<00:00, 757MB/s] model-00006-of-00006.safetensors: 93%|█████████▎| 1.16G/1.25G [00:05<00:00, 256MB/s] model-00006-of-00006.safetensors: 99%|█████████▉| 1.23G/1.25G [00:05<00:00, 252MB/s] model-00006-of-00006.safetensors: 100%|█████████▉| 1.25G/1.25G [00:05<00:00, 209MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: model.safetensors.index.json: 0%| | 0.00/29.9k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 29.9k/29.9k [00:00<00:00, 189MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: special_tokens_map.json: 0%| | 0.00/552 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 552/552 [00:00<00:00, 4.67MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: tokenizer.json: 0%| | 0.00/1.84M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 55.8MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: tokenizer.model: 0%| | 0.00/500k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 500k/500k [00:00<00:00, 22.4MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: tokenizer_config.json: 0%| | 0.00/1.11k [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 1.11k/1.11k [00:00<00:00, 8.95MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Downloaded to shared memory in 71.848s
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: quantizing model to /dev/shm/model_cache
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Saving mkml model at /dev/shm/model_cache
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Reading /tmp/tmpu04dtkjz/model.safetensors.index.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Profiling: 0%| | 0/363 [00:00<?, ?it/s] Profiling: 0%| | 1/363 [00:01<11:23, 1.89s/it] Profiling: 2%|▏ | 9/363 [00:01<00:58, 6.09it/s] Profiling: 5%|▍ | 17/363 [00:02<00:27, 12.80it/s] Profiling: 7%|▋ | 24/363 [00:02<00:17, 19.10it/s] Profiling: 9%|▉ | 32/363 [00:02<00:12, 26.63it/s] Profiling: 11%|█▏ | 41/363 [00:02<00:08, 36.24it/s] Profiling: 14%|█▍ | 50/363 [00:02<00:06, 45.37it/s] Profiling: 16%|█▋ | 59/363 [00:02<00:05, 53.82it/s] Profiling: 19%|█▉ | 69/363 [00:02<00:06, 42.71it/s] Profiling: 21%|██ | 77/363 [00:03<00:05, 48.55it/s] Profiling: 23%|██▎ | 85/363 [00:03<00:05, 54.72it/s] Profiling: 26%|██▌ | 93/363 [00:03<00:04, 60.16it/s] Profiling: 28%|██▊ | 102/363 [00:03<00:03, 65.92it/s] Profiling: 30%|███ | 110/363 [00:03<00:03, 69.15it/s] Profiling: 33%|███▎ | 119/363 [00:03<00:03, 72.16it/s] Profiling: 36%|███▌ | 129/363 [00:03<00:02, 78.12it/s] Profiling: 38%|███▊ | 138/363 [00:03<00:02, 78.87it/s] Profiling: 40%|████ | 147/363 [00:04<00:04, 50.89it/s] Profiling: 43%|████▎ | 156/363 [00:04<00:03, 56.85it/s] Profiling: 45%|████▌ | 165/363 [00:04<00:03, 63.07it/s] Profiling: 48%|████▊ | 174/363 [00:04<00:02, 68.19it/s] Profiling: 50%|█████ | 183/363 [00:04<00:02, 71.93it/s] Profiling: 53%|█████▎ | 192/363 [00:04<00:02, 74.44it/s] Profiling: 55%|█████▌ | 201/363 [00:04<00:02, 76.79it/s] Profiling: 58%|█████▊ | 210/363 [00:05<00:03, 49.53it/s] Profiling: 60%|██████ | 219/363 [00:05<00:02, 55.31it/s] Profiling: 63%|██████▎ | 228/363 [00:05<00:02, 61.11it/s] Profiling: 65%|██████▌ | 237/363 [00:05<00:01, 65.68it/s] Profiling: 68%|██████▊ | 246/363 [00:05<00:01, 68.22it/s] Profiling: 70%|███████ | 255/363 [00:05<00:01, 71.25it/s] Profiling: 73%|███████▎ | 264/363 [00:05<00:01, 73.11it/s] Profiling: 75%|███████▍ | 272/363 [00:05<00:01, 72.81it/s] Profiling: 77%|███████▋ | 280/363 [00:06<00:01, 48.49it/s] Profiling: 79%|███████▉ | 288/363 [00:06<00:01, 54.00it/s] Profiling: 82%|████████▏ | 296/363 [00:06<00:01, 58.68it/s] Profiling: 84%|████████▎ | 304/363 [00:06<00:00, 63.05it/s] Profiling: 86%|████████▌ | 312/363 [00:06<00:00, 65.95it/s] Profiling: 88%|████████▊ | 320/363 [00:06<00:00, 67.41it/s] Profiling: 91%|█████████ | 329/363 [00:06<00:00, 70.46it/s] Profiling: 93%|█████████▎| 338/363 [00:07<00:00, 72.83it/s] Profiling: 96%|█████████▌| 348/363 [00:07<00:00, 79.94it/s] Profiling: 98%|█████████▊| 357/363 [00:09<00:00, 13.50it/s] Profiling: 100%|██████████| 363/363 [00:09<00:00, 39.52it/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: quantized model in 28.321s
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Processed model roleplay4fun/staticpunch-v1.0 in 101.812s
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: creating bucket guanaco-mkml-models
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5/config.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5/special_tokens_map.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5/added_tokens.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5/tokenizer.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5/tokenizer_config.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5/tokenizer.model
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v5/mkml_model.tensors
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: warnings.warn(
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: config.json: 0%| | 0.00/1.05k [00:00<?, ?B/s] config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 8.35MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: warnings.warn(
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: tokenizer_config.json: 0%| | 0.00/234 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 2.11MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: pytorch_model.bin: 0%| | 0.00/1.44G [00:00<?, ?B/s] pytorch_model.bin: 1%|▏ | 21.0M/1.44G [00:00<00:10, 138MB/s] pytorch_model.bin: 3%|▎ | 41.9M/1.44G [00:00<00:08, 170MB/s] pytorch_model.bin: 6%|▌ | 83.9M/1.44G [00:00<00:05, 238MB/s] pytorch_model.bin: 10%|█ | 147M/1.44G [00:00<00:03, 360MB/s] pytorch_model.bin: 15%|█▌ | 220M/1.44G [00:00<00:02, 478MB/s] pytorch_model.bin: 23%|██▎ | 325M/1.44G [00:00<00:01, 652MB/s] pytorch_model.bin: 29%|██▉ | 419M/1.44G [00:00<00:01, 721MB/s] pytorch_model.bin: 39%|███▉ | 566M/1.44G [00:00<00:00, 937MB/s] pytorch_model.bin: 48%|████▊ | 690M/1.44G [00:01<00:00, 869MB/s] pytorch_model.bin: 59%|█████▊ | 847M/1.44G [00:01<00:00, 1.04GB/s] pytorch_model.bin: 86%|████████▌ | 1.25G/1.44G [00:01<00:00, 1.82GB/s] pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:05<00:00, 158MB/s] pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:05<00:00, 271MB/s]
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Saving duration: 0.260s
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 8.521s
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: creating bucket guanaco-reward-models
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: Bucket 's3://guanaco-reward-models/' created
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward/tokenizer_config.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward/special_tokens_map.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward/config.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward/merges.txt
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward/vocab.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward/tokenizer.json
roleplay4fun-staticpunch-v1-0-v5-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v5_reward/reward.tensors
Job roleplay4fun-staticpunch-v1-0-v5-mkmlizer completed after 137.88s with status: succeeded
Stopping job with name roleplay4fun-staticpunch-v1-0-v5-mkmlizer
Pipeline stage MKMLizer completed in 141.09s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service roleplay4fun-staticpunch-v1-0-v5
Waiting for inference service roleplay4fun-staticpunch-v1-0-v5 to be ready
Inference service roleplay4fun-staticpunch-v1-0-v5 ready after 50.30125880241394s
Pipeline stage ISVCDeployer completed in 57.61s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.5911502838134766s
Received healthy response to inference request in 1.3501942157745361s
Received healthy response to inference request in 1.3375866413116455s
Received healthy response to inference request in 3.1604578495025635s
Received healthy response to inference request in 0.9006929397583008s
5 requests
0 failed requests
5th percentile: 0.9880716800689697
10th percentile: 1.0754504203796387
20th percentile: 1.2502079010009766
30th percentile: 1.3401081562042236
40th percentile: 1.3451511859893799
50th percentile: 1.3501942157745361
60th percentile: 1.4465766429901123
70th percentile: 1.5429590702056883
80th percentile: 1.9050117969512943
90th percentile: 2.532734823226929
95th percentile: 2.8465963363647457
99th percentile: 3.0976855468749998
mean time: 1.6680163860321044
Pipeline stage StressChecker completed in 9.23s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.04s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.04s
M-Eval Dataset for topic stay_in_character is loaded
roleplay4fun-staticpunch-v1-0_v5 status is now deployed due to DeploymentManager action
roleplay4fun-staticpunch-v1-0_v5 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics