submission_id: chaoticneutrals-burp-7b_v1
developer_uid: chaiwill
status: inactive
model_repo: ChaoticNeutrals/BuRP_7B
reward_repo: rirv938/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
timestamp: 2024-03-15T18:15:23+00:00
model_name: chaoticneutrals-burp-7b_v1
model_eval_status: success
safety_score: 0.97
entertaining: 7.22
stay_in_character: 8.73
user_preference: 7.5
double_thumbs_up: 1543
thumbs_up: 2332
thumbs_down: 1008
num_battles: 111872
num_wins: 58892
win_ratio: 0.5264230549199085
celo_rating: 1176.42
Resubmit model
Running pipeline stage MKMLizer
Starting job with name chaoticneutrals-burp-7b-v1-mkmlizer
Waiting for job on chaoticneutrals-burp-7b-v1-mkmlizer to finish
chaoticneutrals-burp-7b-v1-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 18.3MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: README.md: 0%| | 0.00/1.10k [00:00<?, ?B/s] README.md: 100%|██████████| 1.10k/1.10k [00:00<00:00, 15.0MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: config.json: 0%| | 0.00/638 [00:00<?, ?B/s] config.json: 100%|██████████| 638/638 [00:00<00:00, 5.22MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: mergekit_config.yml: 0%| | 0.00/361 [00:00<?, ?B/s] mergekit_config.yml: 100%|██████████| 361/361 [00:00<00:00, 2.99MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: model-00001-of-00002.safetensors: 0%| | 0.00/9.94G [00:00<?, ?B/s] model-00001-of-00002.safetensors: 0%| | 10.5M/9.94G [00:01<18:29, 8.95MB/s] model-00001-of-00002.safetensors: 0%| | 21.0M/9.94G [00:02<24:17, 6.81MB/s] model-00001-of-00002.safetensors: 1%| | 94.4M/9.94G [00:03<03:42, 44.4MB/s] model-00001-of-00002.safetensors: 3%|▎ | 283M/9.94G [00:03<00:56, 171MB/s] model-00001-of-00002.safetensors: 4%|▍ | 430M/9.94G [00:03<00:33, 285MB/s] model-00001-of-00002.safetensors: 6%|▌ | 577M/9.94G [00:03<00:22, 418MB/s] model-00001-of-00002.safetensors: 8%|▊ | 839M/9.94G [00:03<00:17, 513MB/s] model-00001-of-00002.safetensors: 9%|▉ | 944M/9.94G [00:04<00:28, 319MB/s] model-00001-of-00002.safetensors: 10%|█ | 1.03G/9.94G [00:04<00:30, 290MB/s] model-00001-of-00002.safetensors: 11%|█ | 1.09G/9.94G [00:05<00:29, 298MB/s] model-00001-of-00002.safetensors: 12%|█▏ | 1.20G/9.94G [00:05<00:23, 376MB/s] model-00001-of-00002.safetensors: 13%|█▎ | 1.27G/9.94G [00:05<00:20, 421MB/s] model-00001-of-00002.safetensors: 14%|█▍ | 1.37G/9.94G [00:05<00:16, 508MB/s] model-00001-of-00002.safetensors: 16%|█▌ | 1.56G/9.94G [00:05<00:11, 758MB/s] model-00001-of-00002.safetensors: 17%|█▋ | 1.72G/9.94G [00:05<00:09, 897MB/s] model-00001-of-00002.safetensors: 19%|█▉ | 1.92G/9.94G [00:05<00:07, 1.06GB/s] model-00001-of-00002.safetensors: 23%|██▎ | 2.24G/9.94G [00:05<00:05, 1.38GB/s] model-00001-of-00002.safetensors: 24%|██▍ | 2.40G/9.94G [00:06<00:08, 938MB/s] model-00001-of-00002.safetensors: 25%|██▌ | 2.53G/9.94G [00:06<00:07, 930MB/s] model-00001-of-00002.safetensors: 27%|██▋ | 2.64G/9.94G [00:06<00:10, 730MB/s] model-00001-of-00002.safetensors: 28%|██▊ | 2.76G/9.94G [00:06<00:09, 787MB/s] model-00001-of-00002.safetensors: 29%|██▊ | 2.85G/9.94G [00:06<00:09, 742MB/s] model-00001-of-00002.safetensors: 30%|██▉ | 2.97G/9.94G [00:07<00:08, 815MB/s] model-00001-of-00002.safetensors: 32%|███▏ | 3.15G/9.94G [00:07<00:06, 1.03GB/s] model-00001-of-00002.safetensors: 33%|███▎ | 3.30G/9.94G [00:07<00:05, 1.13GB/s] model-00001-of-00002.safetensors: 34%|███▍ | 3.43G/9.94G [00:07<00:06, 973MB/s] model-00001-of-00002.safetensors: 36%|███▌ | 3.54G/9.94G [00:07<00:06, 935MB/s] model-00001-of-00002.safetensors: 37%|███▋ | 3.65G/9.94G [00:07<00:07, 829MB/s] model-00001-of-00002.safetensors: 38%|███▊ | 3.74G/9.94G [00:07<00:09, 686MB/s] model-00001-of-00002.safetensors: 38%|███▊ | 3.83G/9.94G [00:08<00:09, 667MB/s] model-00001-of-00002.safetensors: 39%|███▉ | 3.91G/9.94G [00:08<00:08, 701MB/s] model-00001-of-00002.safetensors: 40%|████ | 4.00G/9.94G [00:08<00:08, 719MB/s] model-00001-of-00002.safetensors: 41%|████▏ | 4.12G/9.94G [00:08<00:07, 806MB/s] model-00001-of-00002.safetensors: 44%|████▎ | 4.34G/9.94G [00:08<00:04, 1.15GB/s] model-00001-of-00002.safetensors: 45%|████▍ | 4.47G/9.94G [00:08<00:04, 1.12GB/s] model-00001-of-00002.safetensors: 46%|████▋ | 4.60G/9.94G [00:08<00:04, 1.14GB/s] model-00001-of-00002.safetensors: 48%|████▊ | 4.73G/9.94G [00:08<00:05, 912MB/s] model-00001-of-00002.safetensors: 49%|████▊ | 4.83G/9.94G [00:09<00:07, 721MB/s] model-00001-of-00002.safetensors: 50%|████▉ | 4.93G/9.94G [00:09<00:07, 674MB/s] model-00001-of-00002.safetensors: 50%|█████ | 5.01G/9.94G [00:09<00:07, 649MB/s] model-00001-of-00002.safetensors: 51%|█████▏ | 5.11G/9.94G [00:09<00:06, 710MB/s] model-00001-of-00002.safetensors: 53%|█████▎ | 5.26G/9.94G [00:09<00:05, 905MB/s] model-00001-of-00002.safetensors: 55%|█████▍ | 5.43G/9.94G [00:09<00:04, 1.08GB/s] model-00001-of-00002.safetensors: 56%|█████▌ | 5.57G/9.94G [00:09<00:03, 1.15GB/s] model-00001-of-00002.safetensors: 57%|█████▋ | 5.71G/9.94G [00:10<00:03, 1.18GB/s] model-00001-of-00002.safetensors: 59%|█████▊ | 5.84G/9.94G [00:10<00:04, 825MB/s] model-00001-of-00002.safetensors: 60%|█████▉ | 5.95G/9.94G [00:10<00:05, 698MB/s] model-00001-of-00002.safetensors: 61%|██████ | 6.04G/9.94G [00:10<00:06, 614MB/s] model-00001-of-00002.safetensors: 61%|██████▏ | 6.11G/9.94G [00:10<00:06, 630MB/s] model-00001-of-00002.safetensors: 63%|██████▎ | 6.25G/9.94G [00:10<00:04, 781MB/s] model-00001-of-00002.safetensors: 64%|██████▍ | 6.34G/9.94G [00:11<00:04, 812MB/s] model-00001-of-00002.safetensors: 65%|██████▍ | 6.46G/9.94G [00:11<00:03, 875MB/s] model-00001-of-00002.safetensors: 66%|██████▋ | 6.60G/9.94G [00:11<00:03, 991MB/s] model-00001-of-00002.safetensors: 68%|██████▊ | 6.75G/9.94G [00:11<00:03, 1.04GB/s] model-00001-of-00002.safetensors: 69%|██████▉ | 6.87G/9.94G [00:11<00:03, 923MB/s] model-00001-of-00002.safetensors: 70%|███████ | 6.97G/9.94G [00:11<00:03, 773MB/s] model-00001-of-00002.safetensors: 71%|███████ | 7.07G/9.94G [00:11<00:04, 701MB/s] model-00001-of-00002.safetensors: 72%|███████▏ | 7.15G/9.94G [00:12<00:04, 622MB/s] model-00001-of-00002.safetensors: 73%|███████▎ | 7.30G/9.94G [00:12<00:03, 786MB/s] model-00001-of-00002.safetensors: 75%|███████▍ | 7.42G/9.94G [00:12<00:02, 844MB/s] model-00001-of-00002.safetensors: 76%|███████▌ | 7.58G/9.94G [00:12<00:02, 1.01GB/s] model-00001-of-00002.safetensors: 78%|███████▊ | 7.77G/9.94G [00:12<00:01, 1.21GB/s] model-00001-of-00002.safetensors: 80%|███████▉ | 7.91G/9.94G [00:12<00:01, 1.03GB/s] model-00001-of-00002.safetensors: 81%|████████ | 8.02G/9.94G [00:12<00:02, 944MB/s] model-00001-of-00002.safetensors: 82%|████████▏ | 8.13G/9.94G [00:13<00:02, 714MB/s] model-00001-of-00002.safetensors: 83%|████████▎ | 8.22G/9.94G [00:13<00:02, 742MB/s] model-00001-of-00002.safetensors: 84%|████████▎ | 8.32G/9.94G [00:13<00:02, 752MB/s] model-00001-of-00002.safetensors: 85%|████████▍ | 8.41G/9.94G [00:13<00:01, 774MB/s] model-00001-of-00002.safetensors: 86%|████████▌ | 8.50G/9.94G [00:13<00:01, 794MB/s] model-00001-of-00002.safetensors: 87%|████████▋ | 8.62G/9.94G [00:13<00:01, 857MB/s] model-00001-of-00002.safetensors: 88%|████████▊ | 8.76G/9.94G [00:13<00:01, 966MB/s] model-00001-of-00002.safetensors: 89%|████████▉ | 8.89G/9.94G [00:13<00:01, 1.04GB/s] model-00001-of-00002.safetensors: 91%|█████████ | 9.02G/9.94G [00:14<00:00, 1.07GB/s] model-00001-of-00002.safetensors: 92%|█████████▏| 9.13G/9.94G [00:14<00:00, 894MB/s] model-00001-of-00002.safetensors: 93%|█████████▎| 9.24G/9.94G [00:14<00:00, 861MB/s] model-00001-of-00002.safetensors: 94%|█████████▍| 9.35G/9.94G [00:14<00:00, 918MB/s] model-00001-of-00002.safetensors: 96%|█████████▌| 9.51G/9.94G [00:14<00:00, 1.08GB/s] model-00001-of-00002.safetensors: 97%|█████████▋| 9.66G/9.94G [00:14<00:00, 1.10GB/s] model-00001-of-00002.safetensors: 100%|█████████▉| 9.94G/9.94G [00:14<00:00, 1.33GB/s] model-00001-of-00002.safetensors: 100%|█████████▉| 9.94G/9.94G [00:14<00:00, 666MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: model-00002-of-00002.safetensors: 0%| | 0.00/4.54G [00:00<?, ?B/s] model-00002-of-00002.safetensors: 0%| | 10.5M/4.54G [00:01<08:51, 8.53MB/s] model-00002-of-00002.safetensors: 0%| | 21.0M/4.54G [00:03<12:44, 5.91MB/s] model-00002-of-00002.safetensors: 5%|▍ | 220M/4.54G [00:03<00:45, 95.5MB/s] model-00002-of-00002.safetensors: 7%|▋ | 336M/4.54G [00:03<00:26, 159MB/s] model-00002-of-00002.safetensors: 10%|▉ | 440M/4.54G [00:03<00:18, 221MB/s] model-00002-of-00002.safetensors: 13%|█▎ | 608M/4.54G [00:03<00:10, 363MB/s] model-00002-of-00002.safetensors: 21%|██ | 944M/4.54G [00:04<00:06, 533MB/s] model-00002-of-00002.safetensors: 23%|██▎ | 1.05G/4.54G [00:04<00:07, 472MB/s] model-00002-of-00002.safetensors: 25%|██▍ | 1.13G/4.54G [00:04<00:07, 455MB/s] model-00002-of-00002.safetensors: 27%|██▋ | 1.21G/4.54G [00:04<00:06, 488MB/s] model-00002-of-00002.safetensors: 28%|██▊ | 1.28G/4.54G [00:05<00:06, 509MB/s] model-00002-of-00002.safetensors: 31%|███ | 1.42G/4.54G [00:05<00:04, 631MB/s] model-00002-of-00002.safetensors: 34%|███▍ | 1.54G/4.54G [00:05<00:04, 743MB/s] model-00002-of-00002.safetensors: 37%|███▋ | 1.67G/4.54G [00:05<00:03, 852MB/s] model-00002-of-00002.safetensors: 41%|████ | 1.85G/4.54G [00:05<00:02, 1.06GB/s] model-00002-of-00002.safetensors: 44%|████▎ | 1.98G/4.54G [00:05<00:02, 1.09GB/s] model-00002-of-00002.safetensors: 48%|████▊ | 2.20G/4.54G [00:05<00:02, 1.07GB/s] model-00002-of-00002.safetensors: 51%|█████▏ | 2.33G/4.54G [00:06<00:03, 682MB/s] model-00002-of-00002.safetensors: 53%|█████▎ | 2.42G/4.54G [00:06<00:03, 686MB/s] model-00002-of-00002.safetensors: 56%|█████▋ | 2.56G/4.54G [00:06<00:02, 796MB/s] model-00002-of-00002.safetensors: 59%|█████▊ | 2.66G/4.54G [00:06<00:02, 841MB/s] model-00002-of-00002.safetensors: 61%|██████▏ | 2.79G/4.54G [00:06<00:01, 913MB/s] model-00002-of-00002.safetensors: 64%|██████▎ | 2.89G/4.54G [00:06<00:01, 929MB/s] model-00002-of-00002.safetensors: 67%|██████▋ | 3.05G/4.54G [00:06<00:01, 1.05GB/s] model-00002-of-00002.safetensors: 70%|███████ | 3.20G/4.54G [00:06<00:01, 1.07GB/s] model-00002-of-00002.safetensors: 73%|███████▎ | 3.31G/4.54G [00:07<00:01, 707MB/s] model-00002-of-00002.safetensors: 75%|███████▌ | 3.41G/4.54G [00:07<00:01, 583MB/s] model-00002-of-00002.safetensors: 77%|███████▋ | 3.49G/4.54G [00:07<00:01, 577MB/s] model-00002-of-00002.safetensors: 80%|███████▉ | 3.63G/4.54G [00:07<00:01, 714MB/s] model-00002-of-00002.safetensors: 82%|████████▏ | 3.72G/4.54G [00:07<00:01, 724MB/s] model-00002-of-00002.safetensors: 85%|████████▍ | 3.85G/4.54G [00:08<00:00, 820MB/s] model-00002-of-00002.safetensors: 88%|████████▊ | 4.02G/4.54G [00:08<00:00, 986MB/s] model-00002-of-00002.safetensors: 92%|█████████▏| 4.19G/4.54G [00:08<00:00, 1.18GB/s] model-00002-of-00002.safetensors: 100%|█████████▉| 4.53G/4.54G [00:08<00:00, 1.74GB/s] model-00002-of-00002.safetensors: 100%|█████████▉| 4.54G/4.54G [00:09<00:00, 487MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: model.safetensors.index.json: 0%| | 0.00/22.8k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 22.8k/22.8k [00:00<00:00, 5.87MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: special_tokens_map.json: 0%| | 0.00/414 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 414/414 [00:00<00:00, 5.46MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: tokenizer.json: 0%| | 0.00/1.80M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 7.18MB/s] tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 7.16MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: tokenizer.model: 0%| | 0.00/493k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 2.40MB/s] tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 2.40MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: tokenizer_config.json: 0%| | 0.00/967 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 967/967 [00:00<00:00, 13.1MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: Downloaded to shared memory in 29.732s
chaoticneutrals-burp-7b-v1-mkmlizer: quantizing model to /dev/shm/model_cache
chaoticneutrals-burp-7b-v1-mkmlizer: Saving mkml model at /dev/shm/model_cache
chaoticneutrals-burp-7b-v1-mkmlizer: Reading /tmp/tmpkhkr5o69/model.safetensors.index.json
chaoticneutrals-burp-7b-v1-mkmlizer: Profiling: 0%| | 0/291 [00:00<?, ?it/s] Profiling: 0%| | 1/291 [00:01<05:56, 1.23s/it] Profiling: 5%|▍ | 14/291 [00:01<00:19, 14.22it/s] Profiling: 11%|█ | 32/291 [00:01<00:07, 34.96it/s] Profiling: 17%|█▋ | 50/291 [00:01<00:04, 55.99it/s] Profiling: 23%|██▎ | 68/291 [00:01<00:02, 75.97it/s] Profiling: 30%|██▉ | 86/291 [00:01<00:02, 94.03it/s] Profiling: 36%|███▌ | 104/291 [00:01<00:01, 110.11it/s] Profiling: 42%|████▏ | 122/291 [00:02<00:01, 123.38it/s] Profiling: 49%|████▉ | 143/291 [00:02<00:01, 142.13it/s] Profiling: 55%|█████▌ | 161/291 [00:02<00:00, 147.38it/s] Profiling: 62%|██████▏ | 179/291 [00:02<00:00, 151.72it/s] Profiling: 68%|██████▊ | 197/291 [00:02<00:00, 154.52it/s] Profiling: 74%|███████▎ | 214/291 [00:04<00:02, 28.19it/s] Profiling: 79%|███████▉ | 230/291 [00:04<00:01, 36.53it/s] Profiling: 85%|████████▍ | 247/291 [00:04<00:00, 47.47it/s] Profiling: 90%|█████████ | 262/291 [00:04<00:00, 58.09it/s] Profiling: 95%|█████████▍| 276/291 [00:04<00:00, 68.10it/s] Profiling: 100%|██████████| 291/291 [00:04<00:00, 58.67it/s]
chaoticneutrals-burp-7b-v1-mkmlizer: quantized model in 16.502s
chaoticneutrals-burp-7b-v1-mkmlizer: Processed model ChaoticNeutrals/BuRP_7B in 47.071s
chaoticneutrals-burp-7b-v1-mkmlizer: creating bucket guanaco-mkml-models
chaoticneutrals-burp-7b-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaoticneutrals-burp-7b-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaoticneutrals-burp-7b-v1
chaoticneutrals-burp-7b-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaoticneutrals-burp-7b-v1/config.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaoticneutrals-burp-7b-v1/special_tokens_map.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaoticneutrals-burp-7b-v1/tokenizer_config.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/chaoticneutrals-burp-7b-v1/tokenizer.model
chaoticneutrals-burp-7b-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaoticneutrals-burp-7b-v1/tokenizer.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/chaoticneutrals-burp-7b-v1/mkml_model.tensors
chaoticneutrals-burp-7b-v1-mkmlizer: loading reward model from rirv938/reward_gpt2_medium_preference_24m_e2
chaoticneutrals-burp-7b-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaoticneutrals-burp-7b-v1-mkmlizer: warnings.warn(
chaoticneutrals-burp-7b-v1-mkmlizer: config.json: 0%| | 0.00/1.05k [00:00<?, ?B/s] config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 11.7MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaoticneutrals-burp-7b-v1-mkmlizer: warnings.warn(
chaoticneutrals-burp-7b-v1-mkmlizer: tokenizer_config.json: 0%| | 0.00/234 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 3.22MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: vocab.json: 0%| | 0.00/1.04M [00:00<?, ?B/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 4.39MB/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 4.38MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 25.0MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
chaoticneutrals-burp-7b-v1-mkmlizer: warnings.warn(
chaoticneutrals-burp-7b-v1-mkmlizer: pytorch_model.bin: 0%| | 0.00/1.44G [00:00<?, ?B/s] pytorch_model.bin: 1%| | 10.5M/1.44G [00:01<02:33, 9.35MB/s] pytorch_model.bin: 1%|▏ | 21.0M/1.44G [00:01<01:11, 19.9MB/s] pytorch_model.bin: 3%|▎ | 41.9M/1.44G [00:01<00:33, 41.5MB/s] pytorch_model.bin: 4%|▍ | 62.9M/1.44G [00:01<00:26, 51.7MB/s] pytorch_model.bin: 7%|▋ | 105M/1.44G [00:02<00:20, 66.3MB/s] pytorch_model.bin: 12%|█▏ | 178M/1.44G [00:02<00:08, 142MB/s] pytorch_model.bin: 30%|███ | 440M/1.44G [00:02<00:02, 488MB/s] pytorch_model.bin: 78%|███████▊ | 1.12G/1.44G [00:02<00:00, 1.54GB/s] pytorch_model.bin: 98%|█████████▊| 1.41G/1.44G [00:02<00:00, 1.73GB/s] pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:02<00:00, 537MB/s]
chaoticneutrals-burp-7b-v1-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
chaoticneutrals-burp-7b-v1-mkmlizer: Saving duration: 0.286s
chaoticneutrals-burp-7b-v1-mkmlizer: Processed model rirv938/reward_gpt2_medium_preference_24m_e2 in 8.463s
chaoticneutrals-burp-7b-v1-mkmlizer: creating bucket guanaco-reward-models
chaoticneutrals-burp-7b-v1-mkmlizer: Bucket 's3://guanaco-reward-models/' created
chaoticneutrals-burp-7b-v1-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/chaoticneutrals-burp-7b-v1_reward
chaoticneutrals-burp-7b-v1-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/chaoticneutrals-burp-7b-v1_reward/special_tokens_map.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/chaoticneutrals-burp-7b-v1_reward/config.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/chaoticneutrals-burp-7b-v1_reward/tokenizer_config.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/chaoticneutrals-burp-7b-v1_reward/merges.txt
chaoticneutrals-burp-7b-v1-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/chaoticneutrals-burp-7b-v1_reward/vocab.json
chaoticneutrals-burp-7b-v1-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/chaoticneutrals-burp-7b-v1_reward/tokenizer.json
Job chaoticneutrals-burp-7b-v1-mkmlizer completed after 99.02s with status: succeeded
Stopping job with name chaoticneutrals-burp-7b-v1-mkmlizer
Pipeline stage MKMLizer completed in 101.72s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service chaoticneutrals-burp-7b-v1
Waiting for inference service chaoticneutrals-burp-7b-v1 to be ready
Inference service chaoticneutrals-burp-7b-v1 ready after 40.233213901519775s
Pipeline stage ISVCDeployer completed in 46.60s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.563145637512207s
Received healthy response to inference request in 1.2100176811218262s
Received healthy response to inference request in 1.250288963317871s
Received healthy response to inference request in 1.3043317794799805s
Received healthy response to inference request in 1.2082178592681885s
5 requests
0 failed requests
5th percentile: 1.208577823638916
10th percentile: 1.2089377880096435
20th percentile: 1.2096577167510987
30th percentile: 1.2180719375610352
40th percentile: 1.2341804504394531
50th percentile: 1.250288963317871
60th percentile: 1.2719060897827148
70th percentile: 1.2935232162475585
80th percentile: 1.3560945510864257
90th percentile: 1.4596200942993165
95th percentile: 1.5113828659057618
99th percentile: 1.552793083190918
mean time: 1.3072003841400146
Pipeline stage StressChecker completed in 7.38s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.04s
Running pipeline stage DaemonicSafetyScorer
Pipeline stage DaemonicSafetyScorer completed in 0.04s
Running M-Eval for topic stay_in_character
M-Eval Dataset for topic stay_in_character is loaded
chaoticneutrals-burp-7b_v1 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics