submission_id: khanhnto-khanhnto_v39
developer_uid: robert_irvine
status: torndown
model_repo: khanhnto/khanhnto
reward_repo: rirv938/reward_gpt2_preference_24m_e2
generation_params: {'temperature': 1.2, 'top_p': 0.7, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.8, 'frequency_penalty': 0.2, 'stopping_words': ['<\\s>', '###', '\n'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "### Instruction:\n\n{bot_name}'s Persona: {memory}.\n\nPlay the role of {bot_name}. Engage in a chat with {user_name} while stay in character. Do not write dialogues and narration for {user_name}. {bot_name} should response with messages of medium length.", 'prompt_template': '{prompt}\n\n', 'bot_template': '### Response:\n\n{bot_name}: {message}\n\n', 'user_template': '### Input:\n\n{user_name}: {message}\n\n', 'response_template': '### Response:\n\n{bot_name}:', 'truncate_by_message': False}
reward_formatter: {'memory_template': 'Memory: {memory}\n', 'prompt_template': '{prompt}\n', 'bot_template': 'Bot: {message}\n', 'user_template': 'User: {message}\n', 'response_template': 'Bot:', 'truncate_by_message': False}
timestamp: 2024-02-13T22:03:43+00:00
model_name: khanhnto-khanhnto_v39
model_eval_status: success
model_group: khanhnto/khanhnto
num_battles: 1177631
num_wins: 580617
celo_rating: 1147.01
propriety_score: 0.0
propriety_total_count: 0.0
submission_type: basic
model_architecture: None
model_num_parameters: 13015864320.0
best_of: 8
max_input_tokens: 512
max_output_tokens: 64
display_name: khanhnto-khanhnto_v39
ineligible_reason: propriety_total_count < 800
language_model: khanhnto/khanhnto
model_size: 13B
reward_model: rirv938/reward_gpt2_preference_24m_e2
us_pacific_date: 2024-02-13
win_ratio: 0.4930381418288072
preference_data_url: None
Resubmit model
Running pipeline stage MKMLizer
Starting job with name khanhnto-khanhnto-v39-mkmlizer
Waiting for job on khanhnto-khanhnto-v39-mkmlizer to finish
khanhnto-khanhnto-v39-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
khanhnto-khanhnto-v39-mkmlizer: ║     _____            __           __                                ║
khanhnto-khanhnto-v39-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
khanhnto-khanhnto-v39-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
khanhnto-khanhnto-v39-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
khanhnto-khanhnto-v39-mkmlizer: ║       /___/                                                         ║
khanhnto-khanhnto-v39-mkmlizer: ║                                                                     ║
khanhnto-khanhnto-v39-mkmlizer: ║  Version: 0.6.11                                                    ║
khanhnto-khanhnto-v39-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
khanhnto-khanhnto-v39-mkmlizer: ║                                                                     ║
khanhnto-khanhnto-v39-mkmlizer: ║  The license key for the current software has been verified as      ║
khanhnto-khanhnto-v39-mkmlizer: ║  belonging to:                                                      ║
khanhnto-khanhnto-v39-mkmlizer: ║                                                                     ║
khanhnto-khanhnto-v39-mkmlizer: ║  Chai Research Corp.                                                ║
khanhnto-khanhnto-v39-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
khanhnto-khanhnto-v39-mkmlizer: ║  Expiration: 2024-04-15 23:59:59                                    ║
khanhnto-khanhnto-v39-mkmlizer: ║                                                                     ║
khanhnto-khanhnto-v39-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
khanhnto-khanhnto-v39-mkmlizer: 
.gitattributes:   0%|          | 0.00/1.52k [00:00<?, ?B/s]
.gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 19.2MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
added_tokens.json:   0%|          | 0.00/21.0 [00:00<?, ?B/s]
added_tokens.json: 100%|██████████| 21.0/21.0 [00:00<00:00, 281kB/s]
khanhnto-khanhnto-v39-mkmlizer: 
config.json:   0%|          | 0.00/702 [00:00<?, ?B/s]
config.json: 100%|██████████| 702/702 [00:00<00:00, 9.23MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
generation_config.json:   0%|          | 0.00/137 [00:00<?, ?B/s]
generation_config.json: 100%|██████████| 137/137 [00:00<00:00, 1.12MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
model-00001-of-00006.safetensors:   0%|          | 0.00/4.98G [00:00<?, ?B/s]
model-00001-of-00006.safetensors:   0%|          | 10.5M/4.98G [00:00<03:22, 24.5MB/s]
model-00001-of-00006.safetensors:   0%|          | 21.0M/4.98G [00:00<02:26, 33.8MB/s]
model-00001-of-00006.safetensors:   1%|          | 41.9M/4.98G [00:00<01:22, 59.8MB/s]
model-00001-of-00006.safetensors:   3%|▎         | 147M/4.98G [00:00<00:18, 260MB/s]  
model-00001-of-00006.safetensors:   7%|▋         | 325M/4.98G [00:01<00:07, 601MB/s]
model-00001-of-00006.safetensors:  13%|█▎        | 629M/4.98G [00:01<00:03, 1.19GB/s]
model-00001-of-00006.safetensors:  17%|█▋        | 839M/4.98G [00:01<00:02, 1.40GB/s]
model-00001-of-00006.safetensors:  20%|██        | 1.02G/4.98G [00:01<00:03, 1.30GB/s]
model-00001-of-00006.safetensors:  24%|██▎       | 1.17G/4.98G [00:01<00:03, 1.00GB/s]
model-00001-of-00006.safetensors:  26%|██▋       | 1.31G/4.98G [00:01<00:03, 1.06GB/s]
model-00001-of-00006.safetensors:  29%|██▉       | 1.45G/4.98G [00:01<00:03, 1.11GB/s]
model-00001-of-00006.safetensors:  33%|███▎      | 1.64G/4.98G [00:01<00:02, 1.28GB/s]
model-00001-of-00006.safetensors:  36%|███▌      | 1.78G/4.98G [00:02<00:02, 1.20GB/s]
model-00001-of-00006.safetensors:  39%|███▊      | 1.92G/4.98G [00:02<00:02, 1.22GB/s]
model-00001-of-00006.safetensors:  42%|████▏     | 2.08G/4.98G [00:02<00:02, 1.30GB/s]
model-00001-of-00006.safetensors:  45%|████▍     | 2.22G/4.98G [00:02<00:02, 943MB/s] 
model-00001-of-00006.safetensors:  47%|████▋     | 2.35G/4.98G [00:02<00:02, 1.00GB/s]
model-00001-of-00006.safetensors:  50%|████▉     | 2.47G/4.98G [00:02<00:02, 995MB/s] 
model-00001-of-00006.safetensors:  52%|█████▏    | 2.60G/4.98G [00:02<00:02, 1.04GB/s]
model-00001-of-00006.safetensors:  56%|█████▌    | 2.78G/4.98G [00:03<00:01, 1.11GB/s]
model-00001-of-00006.safetensors:  58%|█████▊    | 2.90G/4.98G [00:03<00:02, 1.00GB/s]
model-00001-of-00006.safetensors:  61%|██████▏   | 3.05G/4.98G [00:03<00:01, 1.08GB/s]
model-00001-of-00006.safetensors:  64%|██████▎   | 3.17G/4.98G [00:03<00:01, 1.03GB/s]
model-00001-of-00006.safetensors:  70%|██████▉   | 3.46G/4.98G [00:03<00:01, 1.49GB/s]
model-00001-of-00006.safetensors:  74%|███████▍  | 3.68G/4.98G [00:03<00:00, 1.67GB/s]
model-00001-of-00006.safetensors:  78%|███████▊  | 3.87G/4.98G [00:03<00:00, 1.66GB/s]
model-00001-of-00006.safetensors:  81%|████████▏ | 4.05G/4.98G [00:04<00:00, 971MB/s] 
model-00001-of-00006.safetensors:  84%|████████▍ | 4.20G/4.98G [00:04<00:00, 1.04GB/s]
model-00001-of-00006.safetensors:  87%|████████▋ | 4.34G/4.98G [00:04<00:00, 1.07GB/s]
model-00001-of-00006.safetensors:  91%|█████████▏| 4.55G/4.98G [00:04<00:00, 1.27GB/s]
model-00001-of-00006.safetensors:  95%|█████████▍| 4.71G/4.98G [00:04<00:00, 1.05GB/s]
model-00001-of-00006.safetensors:  97%|█████████▋| 4.84G/4.98G [00:05<00:00, 587MB/s] 
model-00001-of-00006.safetensors:  99%|█████████▉| 4.95G/4.98G [00:05<00:00, 436MB/s]
model-00001-of-00006.safetensors: 100%|█████████▉| 4.98G/4.98G [00:06<00:00, 726MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
model-00002-of-00006.safetensors:   0%|          | 0.00/4.97G [00:00<?, ?B/s]
model-00002-of-00006.safetensors:   0%|          | 10.5M/4.97G [00:00<03:37, 22.9MB/s]
model-00002-of-00006.safetensors:   1%|          | 31.5M/4.97G [00:00<01:15, 65.1MB/s]
model-00002-of-00006.safetensors:   1%|▏         | 73.4M/4.97G [00:00<00:32, 151MB/s] 
model-00002-of-00006.safetensors:   2%|▏         | 115M/4.97G [00:00<00:23, 210MB/s] 
model-00002-of-00006.safetensors:   4%|▍         | 210M/4.97G [00:00<00:12, 389MB/s]
model-00002-of-00006.safetensors:   5%|▌         | 262M/4.97G [00:01<00:11, 414MB/s]
model-00002-of-00006.safetensors:   6%|▋         | 315M/4.97G [00:01<00:13, 350MB/s]
model-00002-of-00006.safetensors:   7%|▋         | 357M/4.97G [00:01<00:12, 358MB/s]
model-00002-of-00006.safetensors:   9%|▊         | 430M/4.97G [00:01<00:10, 418MB/s]
model-00002-of-00006.safetensors:  10%|▉         | 482M/4.97G [00:01<00:11, 399MB/s]
model-00002-of-00006.safetensors:  11%|█         | 535M/4.97G [00:01<00:10, 418MB/s]
model-00002-of-00006.safetensors:  12%|█▏        | 587M/4.97G [00:01<00:10, 436MB/s]
model-00002-of-00006.safetensors:  14%|█▎        | 671M/4.97G [00:01<00:08, 525MB/s]
model-00002-of-00006.safetensors:  15%|█▍        | 744M/4.97G [00:02<00:07, 560MB/s]
model-00002-of-00006.safetensors:  17%|█▋        | 828M/4.97G [00:02<00:06, 628MB/s]
model-00002-of-00006.safetensors:  19%|█▊        | 923M/4.97G [00:02<00:05, 707MB/s]
model-00002-of-00006.safetensors:  20%|██        | 996M/4.97G [00:02<00:07, 540MB/s]
model-00002-of-00006.safetensors:  21%|██▏       | 1.06G/4.97G [00:02<00:07, 540MB/s]
model-00002-of-00006.safetensors:  23%|██▎       | 1.12G/4.97G [00:02<00:08, 472MB/s]
model-00002-of-00006.safetensors:  24%|██▎       | 1.17G/4.97G [00:03<00:10, 360MB/s]
model-00002-of-00006.safetensors:  25%|██▍       | 1.24G/4.97G [00:03<00:09, 407MB/s]
model-00002-of-00006.safetensors:  26%|██▌       | 1.29G/4.97G [00:03<00:08, 416MB/s]
model-00002-of-00006.safetensors:  27%|██▋       | 1.36G/4.97G [00:03<00:08, 420MB/s]
model-00002-of-00006.safetensors:  29%|██▊       | 1.43G/4.97G [00:03<00:07, 449MB/s]
model-00002-of-00006.safetensors:  30%|██▉       | 1.48G/4.97G [00:03<00:09, 360MB/s]
model-00002-of-00006.safetensors:  31%|███       | 1.54G/4.97G [00:03<00:08, 395MB/s]
model-00002-of-00006.safetensors:  33%|███▎      | 1.63G/4.97G [00:04<00:07, 474MB/s]
model-00002-of-00006.safetensors:  35%|███▌      | 1.74G/4.97G [00:04<00:05, 573MB/s]
model-00002-of-00006.safetensors:  36%|███▋      | 1.80G/4.97G [00:04<00:05, 528MB/s]
model-00002-of-00006.safetensors:  38%|███▊      | 1.87G/4.97G [00:04<00:07, 424MB/s]
model-00002-of-00006.safetensors:  39%|███▊      | 1.92G/4.97G [00:04<00:07, 403MB/s]
model-00002-of-00006.safetensors:  40%|███▉      | 1.97G/4.97G [00:04<00:07, 394MB/s]
model-00002-of-00006.safetensors:  41%|████      | 2.02G/4.97G [00:04<00:07, 407MB/s]
model-00002-of-00006.safetensors:  42%|████▏     | 2.08G/4.97G [00:05<00:06, 434MB/s]
model-00002-of-00006.safetensors:  43%|████▎     | 2.13G/4.97G [00:05<00:08, 353MB/s]
model-00002-of-00006.safetensors:  45%|████▍     | 2.22G/4.97G [00:05<00:05, 475MB/s]
model-00002-of-00006.safetensors:  46%|████▌     | 2.29G/4.97G [00:05<00:05, 481MB/s]
model-00002-of-00006.safetensors:  47%|████▋     | 2.35G/4.97G [00:05<00:05, 462MB/s]
model-00002-of-00006.safetensors:  50%|████▉     | 2.46G/4.97G [00:05<00:04, 592MB/s]
model-00002-of-00006.safetensors:  51%|█████     | 2.54G/4.97G [00:05<00:04, 505MB/s]
model-00002-of-00006.safetensors:  52%|█████▏    | 2.60G/4.97G [00:06<00:05, 454MB/s]
model-00002-of-00006.safetensors:  55%|█████▌    | 2.75G/4.97G [00:06<00:03, 653MB/s]
model-00002-of-00006.safetensors:  57%|█████▋    | 2.85G/4.97G [00:06<00:02, 734MB/s]
model-00002-of-00006.safetensors:  60%|██████    | 2.99G/4.97G [00:06<00:02, 867MB/s]
model-00002-of-00006.safetensors:  64%|██████▎   | 3.17G/4.97G [00:06<00:02, 870MB/s]
model-00002-of-00006.safetensors:  68%|██████▊   | 3.40G/4.97G [00:06<00:01, 1.06GB/s]
model-00002-of-00006.safetensors:  72%|███████▏  | 3.58G/4.97G [00:06<00:01, 1.21GB/s]
model-00002-of-00006.safetensors:  75%|███████▍  | 3.71G/4.97G [00:07<00:01, 1.08GB/s]
model-00002-of-00006.safetensors:  78%|███████▊  | 3.87G/4.97G [00:07<00:00, 1.19GB/s]
model-00002-of-00006.safetensors:  81%|████████  | 4.01G/4.97G [00:07<00:00, 1.09GB/s]
model-00002-of-00006.safetensors:  86%|████████▌ | 4.28G/4.97G [00:07<00:00, 1.46GB/s]
model-00002-of-00006.safetensors:  89%|████████▉ | 4.45G/4.97G [00:07<00:00, 1.07GB/s]
model-00002-of-00006.safetensors:  92%|█████████▏| 4.58G/4.97G [00:07<00:00, 1.04GB/s]
model-00002-of-00006.safetensors:  95%|█████████▍| 4.71G/4.97G [00:08<00:00, 672MB/s] 
model-00002-of-00006.safetensors:  97%|█████████▋| 4.80G/4.97G [00:08<00:00, 519MB/s]
model-00002-of-00006.safetensors:  98%|█████████▊| 4.89G/4.97G [00:09<00:00, 294MB/s]
model-00002-of-00006.safetensors: 100%|█████████▉| 4.95G/4.97G [00:11<00:00, 121MB/s]
model-00002-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:11<00:00, 436MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
model-00003-of-00006.safetensors:   0%|          | 0.00/4.97G [00:00<?, ?B/s]
model-00003-of-00006.safetensors:   0%|          | 10.5M/4.97G [00:00<04:36, 18.0MB/s]
model-00003-of-00006.safetensors:   1%|▏         | 62.9M/4.97G [00:00<00:51, 95.1MB/s]
model-00003-of-00006.safetensors:   3%|▎         | 136M/4.97G [00:00<00:23, 205MB/s]  
model-00003-of-00006.safetensors:   4%|▍         | 220M/4.97G [00:01<00:14, 333MB/s]
model-00003-of-00006.safetensors:   6%|▌         | 294M/4.97G [00:01<00:11, 416MB/s]
model-00003-of-00006.safetensors:   9%|▉         | 461M/4.97G [00:01<00:06, 716MB/s]
model-00003-of-00006.safetensors:  12%|█▏        | 577M/4.97G [00:01<00:05, 804MB/s]
model-00003-of-00006.safetensors:  14%|█▍        | 703M/4.97G [00:01<00:04, 918MB/s]
model-00003-of-00006.safetensors:  16%|█▋        | 818M/4.97G [00:01<00:05, 788MB/s]
model-00003-of-00006.safetensors:  18%|█▊        | 912M/4.97G [00:01<00:05, 756MB/s]
model-00003-of-00006.safetensors:  20%|██        | 1.01G/4.97G [00:01<00:05, 762MB/s]
model-00003-of-00006.safetensors:  23%|██▎       | 1.12G/4.97G [00:02<00:04, 823MB/s]
model-00003-of-00006.safetensors:  24%|██▍       | 1.22G/4.97G [00:02<00:04, 808MB/s]
model-00003-of-00006.safetensors:  26%|██▋       | 1.31G/4.97G [00:02<00:05, 702MB/s]
model-00003-of-00006.safetensors:  28%|██▊       | 1.42G/4.97G [00:02<00:04, 765MB/s]
model-00003-of-00006.safetensors:  30%|███       | 1.50G/4.97G [00:02<00:04, 750MB/s]
model-00003-of-00006.safetensors:  32%|███▏      | 1.60G/4.97G [00:02<00:04, 776MB/s]
model-00003-of-00006.safetensors:  34%|███▍      | 1.69G/4.97G [00:02<00:04, 749MB/s]
model-00003-of-00006.safetensors:  36%|███▌      | 1.77G/4.97G [00:02<00:04, 765MB/s]
model-00003-of-00006.safetensors:  37%|███▋      | 1.86G/4.97G [00:03<00:04, 628MB/s]
model-00003-of-00006.safetensors:  40%|████      | 1.99G/4.97G [00:03<00:03, 785MB/s]
model-00003-of-00006.safetensors:  42%|████▏     | 2.09G/4.97G [00:03<00:04, 649MB/s]
model-00003-of-00006.safetensors:  43%|████▎     | 2.16G/4.97G [00:03<00:04, 662MB/s]
model-00003-of-00006.safetensors:  46%|████▌     | 2.26G/4.97G [00:03<00:03, 738MB/s]
model-00003-of-00006.safetensors:  50%|█████     | 2.51G/4.97G [00:03<00:02, 1.15GB/s]
model-00003-of-00006.safetensors:  53%|█████▎    | 2.65G/4.97G [00:03<00:01, 1.23GB/s]
model-00003-of-00006.safetensors:  56%|█████▌    | 2.79G/4.97G [00:04<00:02, 834MB/s] 
model-00003-of-00006.safetensors:  58%|█████▊    | 2.90G/4.97G [00:04<00:02, 762MB/s]
model-00003-of-00006.safetensors:  60%|██████    | 3.00G/4.97G [00:04<00:02, 725MB/s]
model-00003-of-00006.safetensors:  62%|██████▏   | 3.10G/4.97G [00:04<00:02, 776MB/s]
model-00003-of-00006.safetensors:  65%|██████▌   | 3.24G/4.97G [00:04<00:01, 901MB/s]
model-00003-of-00006.safetensors:  70%|██████▉   | 3.46G/4.97G [00:04<00:01, 1.18GB/s]
model-00003-of-00006.safetensors:  74%|███████▍  | 3.69G/4.97G [00:04<00:00, 1.44GB/s]
model-00003-of-00006.safetensors:  77%|███████▋  | 3.85G/4.97G [00:04<00:00, 1.45GB/s]
model-00003-of-00006.safetensors:  81%|████████  | 4.01G/4.97G [00:05<00:00, 1.31GB/s]
model-00003-of-00006.safetensors:  87%|████████▋ | 4.34G/4.97G [00:05<00:00, 1.78GB/s]
model-00003-of-00006.safetensors:  91%|█████████▏| 4.54G/4.97G [00:05<00:00, 1.68GB/s]
model-00003-of-00006.safetensors:  95%|█████████▍| 4.72G/4.97G [00:05<00:00, 1.21GB/s]
model-00003-of-00006.safetensors:  98%|█████████▊| 4.87G/4.97G [00:05<00:00, 1.03GB/s]
model-00003-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:06<00:00, 781MB/s] 
khanhnto-khanhnto-v39-mkmlizer: 
model-00004-of-00006.safetensors:   0%|          | 0.00/4.93G [00:00<?, ?B/s]
model-00004-of-00006.safetensors:   0%|          | 10.5M/4.93G [00:00<02:59, 27.4MB/s]
model-00004-of-00006.safetensors:   0%|          | 21.0M/4.93G [00:00<02:37, 31.1MB/s]
model-00004-of-00006.safetensors:   4%|▍         | 210M/4.93G [00:00<00:11, 398MB/s]  
model-00004-of-00006.safetensors:   8%|▊         | 398M/4.93G [00:00<00:06, 722MB/s]
model-00004-of-00006.safetensors:  14%|█▎        | 671M/4.93G [00:00<00:03, 1.19GB/s]
model-00004-of-00006.safetensors:  18%|█▊        | 881M/4.93G [00:01<00:02, 1.40GB/s]
model-00004-of-00006.safetensors:  26%|██▌       | 1.28G/4.93G [00:01<00:01, 2.08GB/s]
model-00004-of-00006.safetensors:  31%|███       | 1.54G/4.93G [00:01<00:01, 2.14GB/s]
model-00004-of-00006.safetensors:  36%|███▋      | 1.79G/4.93G [00:01<00:02, 1.47GB/s]
model-00004-of-00006.safetensors:  40%|████      | 1.99G/4.93G [00:01<00:02, 1.14GB/s]
model-00004-of-00006.safetensors:  50%|████▉     | 2.44G/4.93G [00:01<00:01, 1.72GB/s]
model-00004-of-00006.safetensors:  60%|██████    | 2.98G/4.93G [00:02<00:00, 2.36GB/s]
model-00004-of-00006.safetensors:  67%|██████▋   | 3.29G/4.93G [00:02<00:00, 1.90GB/s]
model-00004-of-00006.safetensors:  72%|███████▏  | 3.55G/4.93G [00:02<00:00, 1.63GB/s]
model-00004-of-00006.safetensors:  78%|███████▊  | 3.85G/4.93G [00:02<00:00, 1.83GB/s]
model-00004-of-00006.safetensors:  83%|████████▎ | 4.08G/4.93G [00:02<00:00, 1.78GB/s]
model-00004-of-00006.safetensors:  90%|████████▉ | 4.42G/4.93G [00:02<00:00, 2.11GB/s]
model-00004-of-00006.safetensors:  99%|█████████▊| 4.86G/4.93G [00:03<00:00, 2.61GB/s]
model-00004-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:03<00:00, 1.55GB/s]
khanhnto-khanhnto-v39-mkmlizer: 
model-00005-of-00006.safetensors:   0%|          | 0.00/4.93G [00:00<?, ?B/s]
model-00005-of-00006.safetensors:   0%|          | 10.5M/4.93G [00:00<03:12, 25.6MB/s]
model-00005-of-00006.safetensors:   0%|          | 21.0M/4.93G [00:00<02:22, 34.5MB/s]
model-00005-of-00006.safetensors:   3%|▎         | 147M/4.93G [00:00<00:16, 297MB/s]  
model-00005-of-00006.safetensors:   5%|▌         | 262M/4.93G [00:00<00:09, 491MB/s]
model-00005-of-00006.safetensors:   7%|▋         | 346M/4.93G [00:00<00:08, 569MB/s]
model-00005-of-00006.safetensors:  11%|█▏        | 556M/4.93G [00:01<00:04, 963MB/s]
model-00005-of-00006.safetensors:  14%|█▍        | 692M/4.93G [00:01<00:04, 1.05GB/s]
model-00005-of-00006.safetensors:  23%|██▎       | 1.12G/4.93G [00:01<00:01, 1.93GB/s]
model-00005-of-00006.safetensors:  32%|███▏      | 1.56G/4.93G [00:01<00:01, 2.60GB/s]
model-00005-of-00006.safetensors:  38%|███▊      | 1.86G/4.93G [00:01<00:01, 1.60GB/s]
model-00005-of-00006.safetensors:  42%|████▏     | 2.09G/4.93G [00:01<00:02, 1.40GB/s]
model-00005-of-00006.safetensors:  55%|█████▌    | 2.73G/4.93G [00:02<00:00, 2.29GB/s]
model-00005-of-00006.safetensors:  62%|██████▏   | 3.05G/4.93G [00:02<00:00, 2.44GB/s]
model-00005-of-00006.safetensors:  68%|██████▊   | 3.37G/4.93G [00:02<00:01, 1.14GB/s]
model-00005-of-00006.safetensors:  85%|████████▌ | 4.22G/4.93G [00:03<00:00, 1.83GB/s]
model-00005-of-00006.safetensors:  91%|█████████▏| 4.51G/4.93G [00:03<00:00, 1.63GB/s]
model-00005-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:03<00:00, 1.68GB/s]
model-00005-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:03<00:00, 1.39GB/s]
khanhnto-khanhnto-v39-mkmlizer: 
model-00006-of-00006.safetensors:   0%|          | 0.00/1.25G [00:00<?, ?B/s]
model-00006-of-00006.safetensors:   1%|          | 10.5M/1.25G [00:00<00:45, 27.1MB/s]
model-00006-of-00006.safetensors:   2%|▏         | 21.0M/1.25G [00:00<00:33, 36.3MB/s]
model-00006-of-00006.safetensors:   8%|▊         | 105M/1.25G [00:00<00:05, 213MB/s]  
model-00006-of-00006.safetensors:  15%|█▌        | 189M/1.25G [00:00<00:02, 359MB/s]
model-00006-of-00006.safetensors:  33%|███▎      | 409M/1.25G [00:00<00:01, 815MB/s]
model-00006-of-00006.safetensors:  47%|████▋     | 587M/1.25G [00:01<00:00, 1.06GB/s]
model-00006-of-00006.safetensors:  71%|███████   | 878M/1.25G [00:01<00:00, 1.56GB/s]
model-00006-of-00006.safetensors:  86%|████████▌ | 1.07G/1.25G [00:01<00:00, 1.22GB/s]
model-00006-of-00006.safetensors:  98%|█████████▊| 1.22G/1.25G [00:01<00:00, 761MB/s] 
model-00006-of-00006.safetensors: 100%|█████████▉| 1.25G/1.25G [00:02<00:00, 490MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
model.safetensors.index.json:   0%|          | 0.00/29.9k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 29.9k/29.9k [00:00<00:00, 4.26MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/548 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 548/548 [00:00<00:00, 4.46MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
tokenizer.json:   0%|          | 0.00/1.84M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 15.1MB/s]
tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 15.0MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
Profiling:   0%|          | 0/363 [00:00<?, ?it/s]
Profiling:   0%|          | 1/363 [00:02<13:45,  2.28s/it]
Profiling:   3%|▎         | 10/363 [00:02<01:01,  5.72it/s]
Profiling:   6%|▌         | 21/363 [00:02<00:25, 13.60it/s]
Profiling:   9%|▊         | 31/363 [00:02<00:15, 21.68it/s]
Profiling:  11%|█▏        | 41/363 [00:02<00:10, 30.41it/s]
Profiling:  14%|█▍        | 51/363 [00:02<00:07, 40.40it/s]
Profiling:  17%|█▋        | 61/363 [00:02<00:06, 50.01it/s]
Profiling:  19%|█▉        | 70/363 [00:03<00:06, 42.59it/s]
Profiling:  22%|██▏       | 79/363 [00:03<00:05, 50.51it/s]
Profiling:  24%|██▍       | 88/363 [00:03<00:04, 58.19it/s]
Profiling:  27%|██▋       | 97/363 [00:03<00:04, 65.02it/s]
Profiling:  29%|██▉       | 106/363 [00:03<00:03, 70.52it/s]
Profiling:  32%|███▏      | 117/363 [00:03<00:03, 76.48it/s]
Profiling:  35%|███▍      | 126/363 [00:03<00:03, 72.63it/s]
Profiling:  37%|███▋      | 135/363 [00:03<00:02, 76.88it/s]
Profiling:  40%|███▉      | 144/363 [00:04<00:04, 52.48it/s]
Profiling:  42%|████▏     | 154/363 [00:04<00:03, 60.94it/s]
Profiling:  45%|████▌     | 165/363 [00:04<00:02, 69.29it/s]
Profiling:  48%|████▊     | 175/363 [00:04<00:02, 73.41it/s]
Profiling:  51%|█████     | 185/363 [00:04<00:02, 76.16it/s]
Profiling:  53%|█████▎    | 194/363 [00:04<00:02, 79.42it/s]
Profiling:  56%|█████▌    | 203/363 [00:04<00:01, 81.71it/s]
Profiling:  58%|█████▊    | 212/363 [00:05<00:02, 53.91it/s]
Profiling:  61%|██████    | 221/363 [00:05<00:02, 60.76it/s]
Profiling:  63%|██████▎   | 230/363 [00:05<00:01, 66.69it/s]
Profiling:  66%|██████▌   | 239/363 [00:05<00:01, 71.62it/s]
Profiling:  68%|██████▊   | 248/363 [00:05<00:01, 75.98it/s]
Profiling:  71%|███████   | 257/363 [00:05<00:01, 79.20it/s]
Profiling:  73%|███████▎  | 266/363 [00:05<00:01, 81.64it/s]
Profiling:  76%|███████▌  | 276/363 [00:05<00:01, 85.09it/s]
Profiling:  79%|███████▊  | 285/363 [00:06<00:01, 54.32it/s]
Profiling:  81%|████████  | 293/363 [00:06<00:01, 59.46it/s]
Profiling:  83%|████████▎ | 302/363 [00:06<00:00, 65.73it/s]
Profiling:  86%|████████▌ | 311/363 [00:06<00:00, 70.55it/s]
Profiling:  88%|████████▊ | 320/363 [00:06<00:00, 74.65it/s]
Profiling:  91%|█████████ | 329/363 [00:06<00:00, 78.07it/s]
Profiling:  93%|█████████▎| 338/363 [00:06<00:00, 81.02it/s]
Profiling:  96%|█████████▌| 349/363 [00:08<00:00, 15.62it/s]
Profiling:  98%|█████████▊| 357/363 [00:08<00:00, 19.69it/s]
Profiling: 100%|██████████| 363/363 [00:08<00:00, 40.76it/s]
khanhnto-khanhnto-v39-mkmlizer: quantized model in 28.349s
khanhnto-khanhnto-v39-mkmlizer: Processed model khanhnto/khanhnto in 67.802s
khanhnto-khanhnto-v39-mkmlizer: creating bucket guanaco-mkml-models
khanhnto-khanhnto-v39-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
khanhnto-khanhnto-v39-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/khanhnto-khanhnto-v39
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/config.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/added_tokens.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/tokenizer_config.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/special_tokens_map.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/khanhnto-khanhnto-v39/tokenizer.json
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/khanhnto-khanhnto-v39/tokenizer.model
khanhnto-khanhnto-v39-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/khanhnto-khanhnto-v39/mkml_model.tensors
khanhnto-khanhnto-v39-mkmlizer: loading reward model from rirv938/reward_gpt2_preference_24m_e2
khanhnto-khanhnto-v39-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
khanhnto-khanhnto-v39-mkmlizer:   warnings.warn(
khanhnto-khanhnto-v39-mkmlizer: 
config.json:   0%|          | 0.00/995 [00:00<?, ?B/s]
config.json: 100%|██████████| 995/995 [00:00<00:00, 10.9MB/s]
khanhnto-khanhnto-v39-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
khanhnto-khanhnto-v39-mkmlizer:   warnings.warn(
khanhnto-khanhnto-v39-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/234 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 3.26MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
vocab.json:   0%|          | 0.00/1.04M [00:00<?, ?B/s]
vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 10.1MB/s]
vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 10.1MB/s]
khanhnto-khanhnto-v39-mkmlizer: 
tokenizer.json:   0%|          | 0.00/2.11M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 32.9MB/s]
khanhnto-khanhnto-v39-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
khanhnto-khanhnto-v39-mkmlizer:   warnings.warn(
khanhnto-khanhnto-v39-mkmlizer: Saving duration: 0.101s
khanhnto-khanhnto-v39-mkmlizer: Processed model rirv938/reward_gpt2_preference_24m_e2 in 8.843s
khanhnto-khanhnto-v39-mkmlizer: creating bucket guanaco-reward-models
khanhnto-khanhnto-v39-mkmlizer: Bucket 's3://guanaco-reward-models/' created
khanhnto-khanhnto-v39-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/config.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/special_tokens_map.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/tokenizer_config.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/vocab.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/merges.txt
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/tokenizer.json
khanhnto-khanhnto-v39-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/khanhnto-khanhnto-v39_reward/reward.tensors
Job khanhnto-khanhnto-v39-mkmlizer completed after 107.85s with status: succeeded
Stopping job with name khanhnto-khanhnto-v39-mkmlizer
Pipeline stage MKMLizer completed in 113.13s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.12s
Running pipeline stage ISVCDeployer
Creating inference service khanhnto-khanhnto-v39
Waiting for inference service khanhnto-khanhnto-v39 to be ready
Inference service khanhnto-khanhnto-v39 ready after 141.36432337760925s
Pipeline stage ISVCDeployer completed in 149.84s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4422836303710938s
Received healthy response to inference request in 1.3981211185455322s
Received healthy response to inference request in 1.7402830123901367s
Received healthy response to inference request in 1.032813549041748s
Received healthy response to inference request in 1.3828186988830566s
5 requests
0 failed requests
5th percentile: 1.1028145790100097
10th percentile: 1.1728156089782715
20th percentile: 1.312817668914795
30th percentile: 1.3858791828155517
40th percentile: 1.392000150680542
50th percentile: 1.3981211185455322
60th percentile: 1.5349858760833741
70th percentile: 1.6718506336212158
80th percentile: 1.8806831359863283
90th percentile: 2.161483383178711
95th percentile: 2.301883506774902
99th percentile: 2.4142036056518554
mean time: 1.5992640018463136
Pipeline stage StressChecker completed in 10.57s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.05s
Running M-Eval for topic stay_in_character
Running pipeline stage DaemonicSafetyScorer
M-Eval Dataset for topic stay_in_character is loaded
Pipeline stage DaemonicSafetyScorer completed in 0.10s
AUTO_DEACTIVATION: submission %s deactivated %s
khanhnto-khanhnto_v39 status is now inactive due to auto deactivation removed underperforming models
khanhnto-khanhnto_v39 status is now deployed due to admin request
khanhnto-khanhnto_v39 status is now inactive due to auto deactivation removed underperforming models
khanhnto-khanhnto_v39 status is now deployed due to admin request
khanhnto-khanhnto_v39 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of khanhnto-khanhnto_v39
Running pipeline stage ISVCDeleter
Checking if service khanhnto-khanhnto-v39 is running
Tearing down inference service khanhnto-khanhnto-v39
Toredown service khanhnto-khanhnto-v39
Pipeline stage ISVCDeleter completed in 3.79s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key khanhnto-khanhnto-v39/added_tokens.json from bucket guanaco-mkml-models
Deleting key khanhnto-khanhnto-v39/config.json from bucket guanaco-mkml-models
Deleting key khanhnto-khanhnto-v39/mkml_model.tensors from bucket guanaco-mkml-models
Deleting key khanhnto-khanhnto-v39/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key khanhnto-khanhnto-v39/tokenizer.json from bucket guanaco-mkml-models
Deleting key khanhnto-khanhnto-v39/tokenizer.model from bucket guanaco-mkml-models
Deleting key khanhnto-khanhnto-v39/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key khanhnto-khanhnto-v39_reward/config.json from bucket guanaco-reward-models
Deleting key khanhnto-khanhnto-v39_reward/merges.txt from bucket guanaco-reward-models
Deleting key khanhnto-khanhnto-v39_reward/reward.tensors from bucket guanaco-reward-models
Deleting key khanhnto-khanhnto-v39_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key khanhnto-khanhnto-v39_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key khanhnto-khanhnto-v39_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key khanhnto-khanhnto-v39_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 2.82s
khanhnto-khanhnto_v39 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics