submission_id: khanhnto-khanhnto_v39
developer_uid: robert_irvine
status: deployed
model_repo: khanhnto/khanhnto
reward_repo: rirv938/reward_gpt2_preference_24m_e2
generation_params: {'temperature': 1.2, 'top_p': 0.7, 'top_k': 50, 'presence_penalty': 0.8, 'frequency_penalty': 0.2, 'stopping_words': ['<\\s>', '###', '\n'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "### Instruction:\n\n{bot_name}'s Persona: {memory}.\n\nPlay the role of {bot_name}. Engage in a chat with {user_name} while stay in character. Do not write dialogues and narration for {user_name}. {bot_name} should response with messages of medium length.", 'prompt_template': '{prompt}\n\n', 'bot_template': '### Response:\n\n{bot_name}: {message}\n\n', 'user_template': '### Input:\n\n{user_name}: {message}\n\n', 'response_template': '### Response:\n\n{bot_name}:'}
reward_formatter: {'memory_template': 'Memory: {memory}\n', 'prompt_template': '{prompt}\n', 'bot_template': 'Bot: {message}\n', 'user_template': 'User: {message}\n', 'response_template': 'Bot:'}
timestamp: 2024-02-13T22:03:43+00:00
model_name: khanhnto-khanhnto_v39
model_eval_status: success
safety_score: 0.98
entertaining: 6.68
stay_in_character: 8.23
user_preference: 7.18
double_thumbs_up: 4854
thumbs_up: 7484
thumbs_down: 3477
num_battles: 246205
num_wins: 121694
win_ratio: 0.49427915761255864
celo_rating: 1147.67
Resubmit model
Running pipeline stage MKMLizer
Starting job with name khanhnto-khanhnto-v39-mkmlizer
Waiting for job on khanhnto-khanhnto-v39-mkmlizer to finish
khanhnto-khanhnto-v39-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
khanhnto-khanhnto-v39-mkmlizer: ║ _____ __ __ ║
khanhnto-khanhnto-v39-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
khanhnto-khanhnto-v39-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
khanhnto-khanhnto-v39-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
khanhnto-khanhnto-v39-mkmlizer: ║ /___/ ║
khanhnto-khanhnto-v39-mkmlizer: ║ ║
khanhnto-khanhnto-v39-mkmlizer: ║ Version: 0.6.11 ║
khanhnto-khanhnto-v39-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
khanhnto-khanhnto-v39-mkmlizer: ║ ║
khanhnto-khanhnto-v39-mkmlizer: ║ The license key for the current software has been verified as ║
khanhnto-khanhnto-v39-mkmlizer: ║ belonging to: ║
khanhnto-khanhnto-v39-mkmlizer: ║ ║
khanhnto-khanhnto-v39-mkmlizer: ║ Chai Research Corp. ║
khanhnto-khanhnto-v39-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
khanhnto-khanhnto-v39-mkmlizer: ║ Expiration: 2024-04-15 23:59:59 ║
khanhnto-khanhnto-v39-mkmlizer: ║ ║
khanhnto-khanhnto-v39-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
khanhnto-khanhnto-v39-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 19.2MB/s]
khanhnto-khanhnto-v39-mkmlizer: added_tokens.json: 0%| | 0.00/21.0 [00:00<?, ?B/s] added_tokens.json: 100%|██████████| 21.0/21.0 [00:00<00:00, 281kB/s]
khanhnto-khanhnto-v39-mkmlizer: config.json: 0%| | 0.00/702 [00:00<?, ?B/s] config.json: 100%|██████████| 702/702 [00:00<00:00, 9.23MB/s]
khanhnto-khanhnto-v39-mkmlizer: generation_config.json: 0%| | 0.00/137 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 137/137 [00:00<00:00, 1.12MB/s]
khanhnto-khanhnto-v39-mkmlizer: model-00001-of-00006.safetensors: 0%| | 0.00/4.98G [00:00<?, ?B/s] model-00001-of-00006.safetensors: 0%| | 10.5M/4.98G [00:00<03:22, 24.5MB/s] model-00001-of-00006.safetensors: 0%| | 21.0M/4.98G [00:00<02:26, 33.8MB/s] model-00001-of-00006.safetensors: 1%| | 41.9M/4.98G [00:00<01:22, 59.8MB/s] model-00001-of-00006.safetensors: 3%|▎ | 147M/4.98G [00:00<00:18, 260MB/s] model-00001-of-00006.safetensors: 7%|▋ | 325M/4.98G [00:01<00:07, 601MB/s] model-00001-of-00006.safetensors: 13%|█▎ | 629M/4.98G [00:01<00:03, 1.19GB/s] model-00001-of-00006.safetensors: 17%|█▋ | 839M/4.98G [00:01<00:02, 1.40GB/s] model-00001-of-00006.safetensors: 20%|██ | 1.02G/4.98G [00:01<00:03, 1.30GB/s] model-00001-of-00006.safetensors: 24%|██▎ | 1.17G/4.98G [00:01<00:03, 1.00GB/s] model-00001-of-00006.safetensors: 26%|██▋ | 1.31G/4.98G [00:01<00:03, 1.06GB/s] model-00001-of-00006.safetensors: 29%|██▉ | 1.45G/4.98G [00:01<00:03, 1.11GB/s] model-00001-of-00006.safetensors: 33%|███▎ | 1.64G/4.98G [00:01<00:02, 1.28GB/s] model-00001-of-00006.safetensors: 36%|███▌ | 1.78G/4.98G [00:02<00:02, 1.20GB/s] model-00001-of-00006.safetensors: 39%|███▊ | 1.92G/4.98G [00:02<00:02, 1.22GB/s] model-00001-of-00006.safetensors: 42%|████▏ | 2.08G/4.98G [00:02<00:02, 1.30GB/s] model-00001-of-00006.safetensors: 45%|████▍ | 2.22G/4.98G [00:02<00:02, 943MB/s] model-00001-of-00006.safetensors: 47%|████▋ | 2.35G/4.98G [00:02<00:02, 1.00GB/s] model-00001-of-00006.safetensors: 50%|████▉ | 2.47G/4.98G [00:02<00:02, 995MB/s] model-00001-of-00006.safetensors: 52%|█████▏ | 2.60G/4.98G [00:02<00:02, 1.04GB/s] model-00001-of-00006.safetensors: 56%|█████▌ | 2.78G/4.98G [00:03<00:01, 1.11GB/s] model-00001-of-00006.safetensors: 58%|█████▊ | 2.90G/4.98G [00:03<00:02, 1.00GB/s] model-00001-of-00006.safetensors: 61%|██████▏ | 3.05G/4.98G [00:03<00:01, 1.08GB/s] model-00001-of-00006.safetensors: 64%|██████▎ | 3.17G/4.98G [00:03<00:01, 1.03GB/s] model-00001-of-00006.safetensors: 70%|██████▉ | 3.46G/4.98G [00:03<00:01, 1.49GB/s] model-00001-of-00006.safetensors: 74%|███████▍ | 3.68G/4.98G [00:03<00:00, 1.67GB/s] model-00001-of-00006.safetensors: 78%|███████▊ | 3.87G/4.98G [00:03<00:00, 1.66GB/s] model-00001-of-00006.safetensors: 81%|████████▏ | 4.05G/4.98G [00:04<00:00, 971MB/s] model-00001-of-00006.safetensors: 84%|████████▍ | 4.20G/4.98G [00:04<00:00, 1.04GB/s] model-00001-of-00006.safetensors: 87%|████████▋ | 4.34G/4.98G [00:04<00:00, 1.07GB/s] model-00001-of-00006.safetensors: 91%|█████████▏| 4.55G/4.98G [00:04<00:00, 1.27GB/s] model-00001-of-00006.safetensors: 95%|█████████▍| 4.71G/4.98G [00:04<00:00, 1.05GB/s] model-00001-of-00006.safetensors: 97%|█████████▋| 4.84G/4.98G [00:05<00:00, 587MB/s] model-00001-of-00006.safetensors: 99%|█████████▉| 4.95G/4.98G [00:05<00:00, 436MB/s] model-00001-of-00006.safetensors: 100%|█████████▉| 4.98G/4.98G [00:06<00:00, 726MB/s]
khanhnto-khanhnto-v39-mkmlizer: model-00002-of-00006.safetensors: 0%| | 0.00/4.97G [00:00<?, ?B/s] model-00002-of-00006.safetensors: 0%| | 10.5M/4.97G [00:00<03:37, 22.9MB/s] model-00002-of-00006.safetensors: 1%| | 31.5M/4.97G [00:00<01:15, 65.1MB/s] model-00002-of-00006.safetensors: 1%|▏ | 73.4M/4.97G [00:00<00:32, 151MB/s] model-00002-of-00006.safetensors: 2%|▏ | 115M/4.97G [00:00<00:23, 210MB/s] model-00002-of-00006.safetensors: 4%|▍ | 210M/4.97G [00:00<00:12, 389MB/s] model-00002-of-00006.safetensors: 5%|▌ | 262M/4.97G [00:01<00:11, 414MB/s] model-00002-of-00006.safetensors: 6%|▋ | 315M/4.97G [00:01<00:13, 350MB/s] model-00002-of-00006.safetensors: 7%|▋ | 357M/4.97G [00:01<00:12, 358MB/s] model-00002-of-00006.safetensors: 9%|▊ | 430M/4.97G [00:01<00:10, 418MB/s] model-00002-of-00006.safetensors: 10%|▉ | 482M/4.97G [00:01<00:11, 399MB/s] model-00002-of-00006.safetensors: 11%|█ | 535M/4.97G [00:01<00:10, 418MB/s] model-00002-of-00006.safetensors: 12%|█▏ | 587M/4.97G [00:01<00:10, 436MB/s] model-00002-of-00006.safetensors: 14%|█▎ | 671M/4.97G [00:01<00:08, 525MB/s] model-00002-of-00006.safetensors: 15%|█▍ | 744M/4.97G [00:02<00:07, 560MB/s] model-00002-of-00006.safetensors: 17%|█▋ | 828M/4.97G [00:02<00:06, 628MB/s] model-00002-of-00006.safetensors: 19%|█▊ | 923M/4.97G [00:02<00:05, 707MB/s] model-00002-of-00006.safetensors: 20%|██ | 996M/4.97G [00:02<00:07, 540MB/s] model-00002-of-00006.safetensors: 21%|██▏ | 1.06G/4.97G [00:02<00:07, 540MB/s] model-00002-of-00006.safetensors: 23%|██▎ | 1.12G/4.97G [00:02<00:08, 472MB/s] model-00002-of-00006.safetensors: 24%|██▎ | 1.17G/4.97G [00:03<00:10, 360MB/s] model-00002-of-00006.safetensors: 25%|██▍ | 1.24G/4.97G [00:03<00:09, 407MB/s] model-00002-of-00006.safetensors: 26%|██▌ | 1.29G/4.97G [00:03<00:08, 416MB/s] model-00002-of-00006.safetensors: 27%|██▋ | 1.36G/4.97G [00:03<00:08, 420MB/s] model-00002-of-00006.safetensors: 29%|██▊ | 1.43G/4.97G [00:03<00:07, 449MB/s] model-00002-of-00006.safetensors: 30%|██▉ | 1.48G/4.97G [00:03<00:09, 360MB/s] model-00002-of-00006.safetensors: 31%|███ | 1.54G/4.97G [00:03<00:08, 395MB/s] model-00002-of-00006.safetensors: 33%|███▎ | 1.63G/4.97G [00:04<00:07, 474MB/s] model-00002-of-00006.safetensors: 35%|███▌ | 1.74G/4.97G [00:04<00:05, 573MB/s] model-00002-of-00006.safetensors: 36%|███▋ | 1.80G/4.97G [00:04<00:05, 528MB/s] model-00002-of-00006.safetensors: 38%|███▊ | 1.87G/4.97G [00:04<00:07, 424MB/s] model-00002-of-00006.safetensors: 39%|███▊ | 1.92G/4.97G [00:04<00:07, 403MB/s] model-00002-of-00006.safetensors: 40%|███▉ | 1.97G/4.97G [00:04<00:07, 394MB/s] model-00002-of-00006.safetensors: 41%|████ | 2.02G/4.97G [00:04<00:07, 407MB/s] model-00002-of-00006.safetensors: 42%|████▏ | 2.08G/4.97G [00:05<00:06, 434MB/s] model-00002-of-00006.safetensors: 43%|████▎ | 2.13G/4.97G [00:05<00:08, 353MB/s] model-00002-of-00006.safetensors: 45%|████▍ | 2.22G/4.97G [00:05<00:05, 475MB/s] model-00002-of-00006.safetensors: 46%|████▌ | 2.29G/4.97G [00:05<00:05, 481MB/s] model-00002-of-00006.safetensors: 47%|████▋ | 2.35G/4.97G [00:05<00:05, 462MB/s] model-00002-of-00006.safetensors: 50%|████▉ | 2.46G/4.97G [00:05<00:04, 592MB/s] model-00002-of-00006.safetensors: 51%|█████ | 2.54G/4.97G [00:05<00:04, 505MB/s] model-00002-of-00006.safetensors: 52%|█████▏ | 2.60G/4.97G [00:06<00:05, 454MB/s] model-00002-of-00006.safetensors: 55%|█████▌ | 2.75G/4.97G [00:06<00:03, 653MB/s] model-00002-of-00006.safetensors: 57%|█████▋ | 2.85G/4.97G [00:06<00:02, 734MB/s] model-00002-of-00006.safetensors: 60%|██████ | 2.99G/4.97G [00:06<00:02, 867MB/s] model-00002-of-00006.safetensors: 64%|██████▎ | 3.17G/4.97G [00:06<00:02, 870MB/s] model-00002-of-00006.safetensors: 68%|██████▊ | 3.40G/4.97G [00:06<00:01, 1.06GB/s] model-00002-of-00006.safetensors: 72%|███████▏ | 3.58G/4.97G [00:06<00:01, 1.21GB/s] model-00002-of-00006.safetensors: 75%|███████▍ | 3.71G/4.97G [00:07<00:01, 1.08GB/s] model-00002-of-00006.safetensors: 78%|███████▊ | 3.87G/4.97G [00:07<00:00, 1.19GB/s] model-00002-of-00006.safetensors: 81%|████████ | 4.01G/4.97G [00:07<00:00, 1.09GB/s] model-00002-of-00006.safetensors: 86%|████████▌ | 4.28G/4.97G [00:07<00:00, 1.46GB/s] model-00002-of-00006.safetensors: 89%|████████▉ | 4.45G/4.97G [00:07<00:00, 1.07GB/s] model-00002-of-00006.safetensors: 92%|█████████▏| 4.58G/4.97G [00:07<00:00, 1.04GB/s] model-00002-of-00006.safetensors: 95%|█████████▍| 4.71G/4.97G [00:08<00:00, 672MB/s] model-00002-of-00006.safetensors: 97%|█████████▋| 4.80G/4.97G [00:08<00:00, 519MB/s] model-00002-of-00006.safetensors: 98%|█████████▊| 4.89G/4.97G [00:09<00:00, 294MB/s] model-00002-of-00006.safetensors: 100%|█████████▉| 4.95G/4.97G [00:11<00:00, 121MB/s] model-00002-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:11<00:00, 436MB/s]
khanhnto-khanhnto-v39-mkmlizer: model-00003-of-00006.safetensors: 0%| | 0.00/4.97G [00:00<?, ?B/s] model-00003-of-00006.safetensors: 0%| | 10.5M/4.97G [00:00<04:36, 18.0MB/s] model-00003-of-00006.safetensors: 1%|▏ | 62.9M/4.97G [00:00<00:51, 95.1MB/s] model-00003-of-00006.safetensors: 3%|▎ | 136M/4.97G [00:00<00:23, 205MB/s] model-00003-of-00006.safetensors: 4%|▍ | 220M/4.97G [00:01<00:14, 333MB/s] model-00003-of-00006.safetensors: 6%|▌ | 294M/4.97G [00:01<00:11, 416MB/s] model-00003-of-00006.safetensors: 9%|▉ | 461M/4.97G [00:01<00:06, 716MB/s] model-00003-of-00006.safetensors: 12%|█▏ | 577M/4.97G [00:01<00:05, 804MB/s] model-00003-of-00006.safetensors: 14%|█▍ | 703M/4.97G [00:01<00:04, 918MB/s] model-00003-of-00006.safetensors: 16%|█▋ | 818M/4.97G [00:01<00:05, 788MB/s] model-00003-of-00006.safetensors: 18%|█▊ | 912M/4.97G [00:01<00:05, 756MB/s] model-00003-of-00006.safetensors: 20%|██ | 1.01G/4.97G [00:01<00:05, 762MB/s] model-00003-of-00006.safetensors: 23%|██▎ | 1.12G/4.97G [00:02<00:04, 823MB/s] model-00003-of-00006.safetensors: 24%|██▍ | 1.22G/4.97G [00:02<00:04, 808MB/s] model-00003-of-00006.safetensors: 26%|██▋ | 1.31G/4.97G [00:02<00:05, 702MB/s] model-00003-of-00006.safetensors: 28%|██▊ | 1.42G/4.97G [00:02<00:04, 765MB/s] model-00003-of-00006.safetensors: 30%|███ | 1.50G/4.97G [00:02<00:04, 750MB/s] model-00003-of-00006.safetensors: 32%|███▏ | 1.60G/4.97G [00:02<00:04, 776MB/s] model-00003-of-00006.safetensors: 34%|███▍ | 1.69G/4.97G [00:02<00:04, 749MB/s] model-00003-of-00006.safetensors: 36%|███▌ | 1.77G/4.97G [00:02<00:04, 765MB/s] model-00003-of-00006.safetensors: 37%|███▋ | 1.86G/4.97G [00:03<00:04, 628MB/s] model-00003-of-00006.safetensors: 40%|████ | 1.99G/4.97G [00:03<00:03, 785MB/s] model-00003-of-00006.safetensors: 42%|████▏ | 2.09G/4.97G [00:03<00:04, 649MB/s] model-00003-of-00006.safetensors: 43%|████▎ | 2.16G/4.97G [00:03<00:04, 662MB/s] model-00003-of-00006.safetensors: 46%|████▌ | 2.26G/4.97G [00:03<00:03, 738MB/s] model-00003-of-00006.safetensors: 50%|█████ | 2.51G/4.97G [00:03<00:02, 1.15GB/s] model-00003-of-00006.safetensors: 53%|█████▎ | 2.65G/4.97G [00:03<00:01, 1.23GB/s] model-00003-of-00006.safetensors: 56%|█████▌ | 2.79G/4.97G [00:04<00:02, 834MB/s] model-00003-of-00006.safetensors: 58%|█████▊ | 2.90G/4.97G [00:04<00:02, 762MB/s] model-00003-of-00006.safetensors: 60%|██████ | 3.00G/4.97G [00:04<00:02, 725MB/s] model-00003-of-00006.safetensors: 62%|██████▏ | 3.10G/4.97G [00:04<00:02, 776MB/s] model-00003-of-00006.safetensors: 65%|██████▌ | 3.24G/4.97G [00:04<00:01, 901MB/s] model-00003-of-00006.safetensors: 70%|██████▉ | 3.46G/4.97G [00:04<00:01, 1.18GB/s] model-00003-of-00006.safetensors: 74%|███████▍ | 3.69G/4.97G [00:04<00:00, 1.44GB/s] model-00003-of-00006.safetensors: 77%|███████▋ | 3.85G/4.97G [00:04<00:00, 1.45GB/s] model-00003-of-00006.safetensors: 81%|████████ | 4.01G/4.97G [00:05<00:00, 1.31GB/s] model-00003-of-00006.safetensors: 87%|████████▋ | 4.34G/4.97G [00:05<00:00, 1.78GB/s] model-00003-of-00006.safetensors: 91%|█████████▏| 4.54G/4.97G [00:05<00:00, 1.68GB/s] model-00003-of-00006.safetensors: 95%|█████████▍| 4.72G/4.97G [00:05<00:00, 1.21GB/s] model-00003-of-00006.safetensors: 98%|█████████▊| 4.87G/4.97G [00:05<00:00, 1.03GB/s] model-00003-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:06<00:00, 781MB/s]
khanhnto-khanhnto-v39-mkmlizer: model-00004-of-00006.safetensors: 0%| | 0.00/4.93G [00:00<?, ?B/s] model-00004-of-00006.safetensors: 0%| | 10.5M/4.93G [00:00<02:59, 27.4MB/s] model-00004-of-00006.safetensors: 0%| | 21.0M/4.93G [00:00<02:37, 31.1MB/s] model-00004-of-00006.safetensors: 4%|▍ | 210M/4.93G [00:00<00:11, 398MB/s] model-00004-of-00006.safetensors: 8%|▊ | 398M/4.93G [00:00<00:06, 722MB/s] model-00004-of-00006.safetensors: 14%|█▎ | 671M/4.93G [00:00<00:03, 1.19GB/s] model-00004-of-00006.safetensors: 18%|█▊ | 881M/4.93G [00:01<00:02, 1.40GB/s] model-00004-of-00006.safetensors: 26%|██▌ | 1.28G/4.93G [00:01<00:01, 2.08GB/s] model-00004-of-00006.safetensors: 31%|███ | 1.54G/4.93G [00:01<00:01, 2.14GB/s] model-00004-of-00006.safetensors: 36%|███▋ | 1.79G/4.93G [00:01<00:02, 1.47GB/s] model-00004-of-00006.safetensors: 40%|████ | 1.99G/4.93G [00:01<00:02, 1.14GB/s] model-00004-of-00006.safetensors: 50%|████▉ | 2.44G/4.93G [00:01<00:01, 1.72GB/s] model-00004-of-00006.safetensors: 60%|██████ | 2.98G/4.93G [00:02<00:00, 2.36GB/s] model-00004-of-00006.safetensors: 67%|██████▋ | 3.29G/4.93G [00:02<00:00, 1.90GB/s] model-00004-of-00006.safetensors: 72%|███████▏ | 3.55G/4.93G [00:02<00:00, 1.63GB/s] model-00004-of-00006.safetensors: 78%|███████▊ | 3.85G/4.93G [00:02<00:00, 1.83GB/s] model-00004-of-00006.safetensors: 83%|████████▎ | 4.08G/4.93G [00:02<00:00, 1.78GB/s] model-00004-of-00006.safetensors: 90%|████████▉ | 4.42G/4.93G [00:02<00:00, 2.11GB/s] model-00004-of-00006.safetensors: 99%|█████████▊| 4.86G/4.93G [00:03<00:00, 2.61GB/s] model-00004-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:03<00:00, 1.55GB/s]
khanhnto-khanhnto-v39-mkmlizer: model-00005-of-00006.safetensors: 0%| | 0.00/4.93G [00:00<?, ?B/s] model-00005-of-00006.safetensors: 0%| | 10.5M/4.93G [00:00<03:12, 25.6MB/s] model-00005-of-00006.safetensors: 0%| | 21.0M/4.93G [00:00<02:22, 34.5MB/s] model-00005-of-00006.safetensors: 3%|▎ | 147M/4.93G [00:00<00:16, 297MB/s] model-00005-of-00006.safetensors: 5%|▌ | 262M/4.93G [00:00<00:09, 491MB/s] model-00005-of-00006.safetensors: 7%|▋ | 346M/4.93G [00:00<00:08, 569MB/s] model-00005-of-00006.safetensors: 11%|█▏ | 556M/4.93G [00:01<00:04, 963MB/s] model-00005-of-00006.safetensors: 14%|█▍ | 692M/4.93G [00:01<00:04, 1.05GB/s] model-00005-of-00006.safetensors: 23%|██▎ | 1.12G/4.93G [00:01<00:01, 1.93GB/s] model-00005-of-00006.safetensors: 32%|███▏ | 1.56G/4.93G [00:01<00:01, 2.60GB/s] model-00005-of-00006.safetensors: 38%|███▊ | 1.86G/4.93G [00:01<00:01, 1.60GB/s] model-00005-of-00006.safetensors: 42%|████▏ | 2.09G/4.93G [00:01<00:02, 1.40GB/s] model-00005-of-00006.safetensors: 55%|█████▌ | 2.73G/4.93G [00:02<00:00, 2.29GB/s] model-00005-of-00006.safetensors: 62%|██████▏ | 3.05G/4.93G [00:02<00:00, 2.44GB/s] model-00005-of-00006.safetensors: 68%|██████▊ | 3.37G/4.93G [00:02<00:01, 1.14GB/s] model-00005-of-00006.safetensors: 85%|████████▌ | 4.22G/4.93G [00:03<00:00, 1.83GB/s] model-00005-of-00006.safetensors: 91%|█████████▏| 4.51G/4.93G [00:03<00:00, 1.63GB/s] model-00005-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:03<00:00, 1.68GB/s] model-00005-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:03<00:00, 1.39GB/s]
khanhnto-khanhnto-v39-mkmlizer: model-00006-of-00006.safetensors: 0%| | 0.00/1.25G [00:00<?, ?B/s] model-00006-of-00006.safetensors: 1%| | 10.5M/1.25G [00:00<00:45, 27.1MB/s] model-00006-of-00006.safetensors: 2%|▏ | 21.0M/1.25G [00:00<00:33, 36.3MB/s] model-00006-of-00006.safetensors: 8%|▊ | 105M/1.25G [00:00<00:05, 213MB/s] model-00006-of-00006.safetensors: 15%|█▌ | 189M/1.25G [00:00<00:02, 359MB/s] model-00006-of-00006.safetensors: 33%|███▎ | 409M/1.25G [00:00<00:01, 815MB/s] model-00006-of-00006.safetensors: 47%|████▋ | 587M/1.25G [00:01<00:00, 1.06GB/s] model-00006-of-00006.safetensors: 71%|███████ | 878M/1.25G [00:01<00:00, 1.56GB/s] model-00006-of-00006.safetensors: 86%|████████▌ | 1.07G/1.25G [00:01<00:00, 1.22GB/s] model-00006-of-00006.safetensors: 98%|█████████▊| 1.22G/1.25G [00:01<00:00, 761MB/s] model-00006-of-00006.safetensors: 100%|█████████▉| 1.25G/1.25G [00:02<00:00, 490MB/s]
khanhnto-khanhnto-v39-mkmlizer: model.safetensors.index.json: 0%| | 0.00/29.9k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 29.9k/29.9k [00:00<00:00, 4.26MB/s]
khanhnto-khanhnto-v39-mkmlizer: special_tokens_map.json: 0%| | 0.00/548 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 548/548 [00:00<00:00, 4.46MB/s]
khanhnto-khanhnto-v39-mkmlizer: tokenizer.json: 0%| | 0.00/1.84M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 15.1MB/s] tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 15.0MB/s]
khanhnto-khanhnto-v39-mkmlizer: Profiling: 0%| | 0/363 [00:00<?, ?it/s] Profiling: 0%| | 1/363 [00:02<13:45, 2.28s/it] Profiling: 3%|▎ | 10/363 [00:02<01:01, 5.72it/s] Profiling: 6%|▌ | 21/363 [00:02<00:25, 13.60it/s] Profiling: 9%|▊ | 31/363 [00:02<00:15, 21.68it/s] Profiling: 11%|█▏ | 41/363 [00:02<00:10, 30.41it/s] Profiling: 14%|█▍ | 51/363 [00:02<00:07, 40.40it/s] Profiling: 17%|█▋ | 61/363 [00:02<00:06, 50.01it/s] Profiling: 19%|█▉ | 70/363 [00:03<00:06, 42.59it/s] Profiling: 22%|██▏ | 79/363 [00:03<00:05, 50.51it/s] Profiling: 24%|██▍ | 88/363 [00:03<00:04, 58.19it/s] Profiling: 27%|██▋ | 97/363 [00:03<00:04, 65.02it/s] Profiling: 29%|██▉ | 106/363 [00:03<00:03, 70.52it/s] Profiling: 32%|███▏ | 117/363 [00:03<00:03, 76.48it/s] Profiling: 35%|███▍ | 126/363 [00:03<00:03, 72.63it/s] Profiling: 37%|███▋ | 135/363 [00:03<00:02, 76.88it/s] Profiling: 40%|███▉ | 144/363 [00:04<00:04, 52.48it/s] Profiling: 42%|████▏ | 154/363 [00:04<00:03, 60.94it/s] Profiling: 45%|████▌ | 165/363 [00:04<00:02, 69.29it/s] Profiling: 48%|████▊ | 175/363 [00:04<00:02, 73.41it/s] Profiling: 51%|█████ | 185/363 [00:04<00:02, 76.16it/s] Profiling: 53%|█████▎ | 194/363 [00:04<00:02, 79.42it/s] Profiling: 56%|█████▌ | 203/363 [00:04<00:01, 81.71it/s] Profiling: 58%|█████▊ | 212/363 [00:05<00:02, 53.91it/s] Profiling: 61%|██████ | 221/363 [00:05<00:02, 60.76it/s] Profiling: 63%|██████▎ | 230/363 [00:05<00:01, 66.69it/s] Profiling: 66%|██████▌ | 239/363 [00:05<00:01, 71.62it/s] Profiling: 68%|██████▊ | 248/363 [00:05<00:01, 75.98it/s] Profiling: 71%|███████ | 257/363 [00:05<00:01, 79.20it/s] Profiling: 73%|███████▎ | 266/363 [00:05<00:01, 81.64it/s] Profiling: 76%|███████▌ | 276/363 [00:05<00:01, 85.09it/s] Profiling: 79%|███████▊ | 285/363 [00:06<00:01, 54.32it/s] Profiling: 81%|████████ | 293/363 [00:06<00:01, 59.46it/s] Profiling: 83%|████████▎ | 302/363 [00:06<00:00, 65.73it/s] Profiling: 86%|████████▌ | 311/363 [00:06<00:00, 70.55it/s] Profiling: 88%|████████▊ | 320/363 [00:06<00:00, 74.65it/s] Profiling: 91%|█████████ | 329/363 [00:06<00:00, 78.07it/s] Profiling: 93%|█████████▎| 338/363 [00:06<00:00, 81.02it/s] Profiling: 96%|█████████▌| 349/363 [00:08<00:00, 15.62it/s] Profiling: 98%|█████████▊| 357/363 [00:08<00:00, 19.69it/s] Profiling: 100%|██████████| 363/363 [00:08<00:00, 40.76it/s]
khanhnto-khanhnto-v39-mkmlizer: quantized model in 28.349s
khanhnto-khanhnto-v39-mkmlizer: Processed model khanhnto/khanhnto in 67.802s
khanhnto-khanhnto-v39-mkmlizer: creating bucket guanaco-mkml-models
khanhnto-khanhnto-v39-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
khanhnto-khanhnto-v39-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/khanhnto-khanhnto-v39
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/config.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/added_tokens.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/tokenizer_config.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/special_tokens_map.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/tokenizer.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/khanhnto-khanhnto-v39/tokenizer.model
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/khanhnto-khanhnto-v39/mkml_model.tensors
khanhnto-khanhnto-v39-mkmlizer: loading reward model from rirv938/reward_gpt2_preference_24m_e2
khanhnto-khanhnto-v39-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
khanhnto-khanhnto-v39-mkmlizer: warnings.warn(
khanhnto-khanhnto-v39-mkmlizer: config.json: 0%| | 0.00/995 [00:00<?, ?B/s] config.json: 100%|██████████| 995/995 [00:00<00:00, 10.9MB/s]
khanhnto-khanhnto-v39-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
khanhnto-khanhnto-v39-mkmlizer: warnings.warn(
khanhnto-khanhnto-v39-mkmlizer: tokenizer_config.json: 0%| | 0.00/234 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 3.26MB/s]
khanhnto-khanhnto-v39-mkmlizer: vocab.json: 0%| | 0.00/1.04M [00:00<?, ?B/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 10.1MB/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 10.1MB/s]
khanhnto-khanhnto-v39-mkmlizer: tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 32.9MB/s]
khanhnto-khanhnto-v39-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
khanhnto-khanhnto-v39-mkmlizer: warnings.warn(
khanhnto-khanhnto-v39-mkmlizer: Saving duration: 0.101s
khanhnto-khanhnto-v39-mkmlizer: Processed model rirv938/reward_gpt2_preference_24m_e2 in 8.843s
khanhnto-khanhnto-v39-mkmlizer: creating bucket guanaco-reward-models
khanhnto-khanhnto-v39-mkmlizer: Bucket 's3://guanaco-reward-models/' created
khanhnto-khanhnto-v39-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/config.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/special_tokens_map.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/tokenizer_config.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/vocab.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/merges.txt
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/tokenizer.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/reward.tensors
Job khanhnto-khanhnto-v39-mkmlizer completed after 107.85s with status: succeeded
Stopping job with name khanhnto-khanhnto-v39-mkmlizer
Pipeline stage MKMLizer completed in 113.13s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.12s
Running pipeline stage ISVCDeployer
Creating inference service khanhnto-khanhnto-v39
Waiting for inference service khanhnto-khanhnto-v39 to be ready
Inference service khanhnto-khanhnto-v39 ready after 141.36432337760925s
Pipeline stage ISVCDeployer completed in 149.84s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4422836303710938s
Received healthy response to inference request in 1.3981211185455322s
Received healthy response to inference request in 1.7402830123901367s
Received healthy response to inference request in 1.032813549041748s
Received healthy response to inference request in 1.3828186988830566s
5 requests
0 failed requests
5th percentile: 1.1028145790100097
10th percentile: 1.1728156089782715
20th percentile: 1.312817668914795
30th percentile: 1.3858791828155517
40th percentile: 1.392000150680542
50th percentile: 1.3981211185455322
60th percentile: 1.5349858760833741
70th percentile: 1.6718506336212158
80th percentile: 1.8806831359863283
90th percentile: 2.161483383178711
95th percentile: 2.301883506774902
99th percentile: 2.4142036056518554
mean time: 1.5992640018463136
Pipeline stage StressChecker completed in 10.57s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.05s
Running M-Eval for topic stay_in_character
Running pipeline stage DaemonicSafetyScorer
M-Eval Dataset for topic stay_in_character is loaded
Pipeline stage DaemonicSafetyScorer completed in 0.10s
AUTO_DEACTIVATION: submission %s deactivated %s
khanhnto-khanhnto_v39 status is now inactive due to auto deactivation removed underperforming models
khanhnto-khanhnto_v39 status is now deployed due to admin request

Usage Metrics

Latency Metrics