submission_id: hflserdaniel-chai-s6-13_2318_v15
developer_uid: chai_backend_admin
status: torndown
model_repo: hflserdaniel/chai_s6_13b_slp3
reward_repo: rirv938/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 1.0, 'top_p': 0.8, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['<|im_end|>', '</s>', '<|endoftext|>'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 128}
formatter: {'memory_template': "### Instruction:\n As the assistant, your task is to become the assigned character, weaving engaging stories that fully embrace their personality and background. Ensure your responses capture the essence of the character's traits accurately, immersing users in emotional, suspenseful, and anticipatory narratives. Craft more detailed and descriptive replies to enhance the vividness of the story. Foster an interactive environment by introducing new elements, providing choices, or posing questions to encourage active user participation. Think of the conversation as a continuous dance, always unfolding and evolving.\nYour character: {bot_name}.\nContext:{memory}\n", 'prompt_template': 'Example conversation:\n{prompt}\n', 'bot_template': '### Response:\n{bot_name}: {message}\n', 'user_template': '### Input:\n{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2024-03-31T01:59:17+00:00
model_name: chai_s6_13b_slp3-128
model_eval_status: success
model_group: hflserdaniel/chai_s6_13b
num_battles: 314473
num_wins: 168333
celo_rating: 1181.63
propriety_score: 0.0
propriety_total_count: 0.0
submission_type: basic
model_architecture: LlamaForCausalLM
model_num_parameters: 13015864320.0
best_of: 4
max_input_tokens: 1024
max_output_tokens: 128
display_name: chai_s6_13b_slp3-128
ineligible_reason: max_output_tokens!=64
language_model: hflserdaniel/chai_s6_13b_slp3
model_size: 13B
reward_model: rirv938/reward_gpt2_medium_preference_24m_e2
us_pacific_date: 2024-03-30
win_ratio: 0.5352860181955208
preference_data_url: None
Resubmit model
Running pipeline stage MKMLizer
Starting job with name hflserdaniel-chai-s6-13-2318-v15-mkmlizer
Waiting for job on hflserdaniel-chai-s6-13-2318-v15-mkmlizer to finish
Exception raised while processing tagging_function
Traceback (most recent call last): File "/code/guanaco/guanaco_services/src/guanaco_model_service/chat_api.py", line 274, in resolve_chat_api conversation_tag = self.tagging_function(conversation_state) File "/home/zongyi/gitlab/zztools/zztools/llm/guanaco/submit_routing_model.py", line 176, in last_user_message_length TypeError: 'ConversationState' object is not subscriptable
Exception raised while processing tagging_function
Traceback (most recent call last): File "/code/guanaco/guanaco_services/src/guanaco_model_service/chat_api.py", line 274, in resolve_chat_api conversation_tag = self.tagging_function(conversation_state) File "/home/zongyi/gitlab/zztools/zztools/llm/guanaco/submit_routing_model.py", line 176, in last_user_message_length TypeError: 'ConversationState' object is not subscriptable
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ _____ __ __ ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ /___/ ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ Version: 0.6.11 ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ The license key for the current software has been verified as ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ belonging to: ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ Chai Research Corp. ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 19.8MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: README.md: 0%| | 0.00/949 [00:00<?, ?B/s] README.md: 100%|██████████| 949/949 [00:00<00:00, 14.7MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: added_tokens.json: 0%| | 0.00/21.0 [00:00<?, ?B/s] added_tokens.json: 100%|██████████| 21.0/21.0 [00:00<00:00, 156kB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: config.json: 0%| | 0.00/738 [00:00<?, ?B/s] config.json: 100%|██████████| 738/738 [00:00<00:00, 12.1MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: mergekit_config.yml: 0%| | 0.00/370 [00:00<?, ?B/s] mergekit_config.yml: 100%|██████████| 370/370 [00:00<00:00, 3.09MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: model-00001-of-00003.safetensors: 0%| | 0.00/9.95G [00:00<?, ?B/s] model-00001-of-00003.safetensors: 0%| | 10.5M/9.95G [00:00<07:20, 22.6MB/s] model-00001-of-00003.safetensors: 1%| | 73.4M/9.95G [00:00<01:05, 150MB/s] model-00001-of-00003.safetensors: 1%| | 115M/9.95G [00:00<00:49, 199MB/s] model-00001-of-00003.safetensors: 2%|▏ | 241M/9.95G [00:00<00:22, 436MB/s] model-00001-of-00003.safetensors: 3%|▎ | 336M/9.95G [00:00<00:18, 533MB/s] model-00001-of-00003.safetensors: 4%|▍ | 409M/9.95G [00:01<00:19, 491MB/s] model-00001-of-00003.safetensors: 5%|▍ | 472M/9.95G [00:01<00:20, 468MB/s] model-00001-of-00003.safetensors: 6%|▌ | 598M/9.95G [00:01<00:14, 635MB/s] model-00001-of-00003.safetensors: 7%|▋ | 671M/9.95G [00:01<00:14, 629MB/s] model-00001-of-00003.safetensors: 7%|▋ | 744M/9.95G [00:01<00:14, 627MB/s] model-00001-of-00003.safetensors: 8%|▊ | 818M/9.95G [00:01<00:15, 582MB/s] model-00001-of-00003.safetensors: 9%|▉ | 933M/9.95G [00:01<00:12, 706MB/s] model-00001-of-00003.safetensors: 10%|█ | 1.04G/9.95G [00:02<00:11, 787MB/s] model-00001-of-00003.safetensors: 11%|█▏ | 1.12G/9.95G [00:02<00:11, 744MB/s] model-00001-of-00003.safetensors: 12%|█▏ | 1.21G/9.95G [00:02<00:13, 657MB/s] model-00001-of-00003.safetensors: 13%|█▎ | 1.28G/9.95G [00:02<00:15, 574MB/s] model-00001-of-00003.safetensors: 13%|█▎ | 1.34G/9.95G [00:02<00:16, 517MB/s] model-00001-of-00003.safetensors: 14%|█▍ | 1.41G/9.95G [00:02<00:15, 537MB/s] model-00001-of-00003.safetensors: 15%|█▍ | 1.49G/9.95G [00:02<00:16, 520MB/s] model-00001-of-00003.safetensors: 16%|█▌ | 1.58G/9.95G [00:03<00:14, 574MB/s] model-00001-of-00003.safetensors: 17%|█▋ | 1.67G/9.95G [00:03<00:14, 578MB/s] model-00001-of-00003.safetensors: 18%|█▊ | 1.77G/9.95G [00:03<00:12, 665MB/s] model-00001-of-00003.safetensors: 19%|█▊ | 1.85G/9.95G [00:03<00:12, 642MB/s] model-00001-of-00003.safetensors: 19%|█▉ | 1.92G/9.95G [00:03<00:12, 639MB/s] model-00001-of-00003.safetensors: 21%|██ | 2.11G/9.95G [00:03<00:08, 933MB/s] model-00001-of-00003.safetensors: 22%|██▏ | 2.21G/9.95G [00:03<00:08, 956MB/s] model-00001-of-00003.safetensors: 23%|██▎ | 2.32G/9.95G [00:03<00:09, 821MB/s] model-00001-of-00003.safetensors: 24%|██▍ | 2.41G/9.95G [00:04<00:10, 701MB/s] model-00001-of-00003.safetensors: 25%|██▌ | 2.50G/9.95G [00:04<00:10, 681MB/s] model-00001-of-00003.safetensors: 26%|██▌ | 2.61G/9.95G [00:04<00:09, 784MB/s] model-00001-of-00003.safetensors: 27%|██▋ | 2.71G/9.95G [00:04<00:09, 797MB/s] model-00001-of-00003.safetensors: 28%|██▊ | 2.80G/9.95G [00:04<00:09, 745MB/s] model-00001-of-00003.safetensors: 29%|██▉ | 2.88G/9.95G [00:04<00:09, 726MB/s] model-00001-of-00003.safetensors: 30%|██▉ | 2.97G/9.95G [00:04<00:09, 741MB/s] model-00001-of-00003.safetensors: 31%|███ | 3.05G/9.95G [00:05<00:11, 627MB/s] model-00001-of-00003.safetensors: 32%|███▏ | 3.19G/9.95G [00:05<00:08, 793MB/s] model-00001-of-00003.safetensors: 33%|███▎ | 3.28G/9.95G [00:05<00:09, 672MB/s] model-00001-of-00003.safetensors: 34%|███▍ | 3.37G/9.95G [00:05<00:13, 497MB/s] model-00001-of-00003.safetensors: 35%|███▍ | 3.44G/9.95G [00:05<00:12, 535MB/s] model-00001-of-00003.safetensors: 35%|███▌ | 3.52G/9.95G [00:05<00:10, 593MB/s] model-00001-of-00003.safetensors: 36%|███▌ | 3.60G/9.95G [00:05<00:11, 560MB/s] model-00001-of-00003.safetensors: 37%|███▋ | 3.66G/9.95G [00:06<00:11, 555MB/s] model-00001-of-00003.safetensors: 38%|███▊ | 3.75G/9.95G [00:06<00:10, 572MB/s] model-00001-of-00003.safetensors: 38%|███▊ | 3.82G/9.95G [00:06<00:12, 475MB/s] model-00001-of-00003.safetensors: 39%|███▉ | 3.87G/9.95G [00:06<00:12, 484MB/s] model-00001-of-00003.safetensors: 40%|███▉ | 3.93G/9.95G [00:06<00:12, 484MB/s] model-00001-of-00003.safetensors: 40%|████ | 3.98G/9.95G [00:06<00:13, 440MB/s] model-00001-of-00003.safetensors: 41%|████ | 4.07G/9.95G [00:06<00:12, 465MB/s] model-00001-of-00003.safetensors: 42%|████▏ | 4.15G/9.95G [00:07<00:11, 525MB/s] model-00001-of-00003.safetensors: 42%|████▏ | 4.22G/9.95G [00:07<00:10, 543MB/s] model-00001-of-00003.safetensors: 43%|████▎ | 4.29G/9.95G [00:07<00:09, 569MB/s] model-00001-of-00003.safetensors: 44%|████▍ | 4.36G/9.95G [00:07<00:09, 588MB/s] model-00001-of-00003.safetensors: 44%|████▍ | 4.42G/9.95G [00:07<00:10, 527MB/s] model-00001-of-00003.safetensors: 45%|████▌ | 4.50G/9.95G [00:07<00:09, 572MB/s] model-00001-of-00003.safetensors: 46%|████▌ | 4.56G/9.95G [00:07<00:09, 572MB/s] model-00001-of-00003.safetensors: 47%|████▋ | 4.63G/9.95G [00:07<00:09, 583MB/s] model-00001-of-00003.safetensors: 47%|████▋ | 4.70G/9.95G [00:08<00:09, 553MB/s] model-00001-of-00003.safetensors: 48%|████▊ | 4.76G/9.95G [00:08<00:10, 515MB/s] model-00001-of-00003.safetensors: 49%|████▉ | 4.88G/9.95G [00:08<00:07, 670MB/s] model-00001-of-00003.safetensors: 50%|████▉ | 4.95G/9.95G [00:08<00:08, 618MB/s] model-00001-of-00003.safetensors: 50%|█████ | 5.02G/9.95G [00:08<00:08, 571MB/s] model-00001-of-00003.safetensors: 51%|█████ | 5.09G/9.95G [00:08<00:08, 547MB/s] model-00001-of-00003.safetensors: 52%|█████▏ | 5.15G/9.95G [00:08<00:10, 475MB/s] model-00001-of-00003.safetensors: 53%|█████▎ | 5.28G/9.95G [00:09<00:07, 585MB/s] model-00001-of-00003.safetensors: 54%|█████▍ | 5.36G/9.95G [00:09<00:08, 532MB/s] model-00001-of-00003.safetensors: 55%|█████▍ | 5.45G/9.95G [00:09<00:07, 609MB/s] model-00001-of-00003.safetensors: 56%|█████▌ | 5.58G/9.95G [00:09<00:05, 737MB/s] model-00001-of-00003.safetensors: 57%|█████▋ | 5.66G/9.95G [00:09<00:06, 621MB/s] model-00001-of-00003.safetensors: 58%|█████▊ | 5.76G/9.95G [00:09<00:06, 658MB/s] model-00001-of-00003.safetensors: 59%|█████▊ | 5.83G/9.95G [00:09<00:06, 639MB/s] model-00001-of-00003.safetensors: 59%|█████▉ | 5.90G/9.95G [00:10<00:06, 605MB/s] model-00001-of-00003.safetensors: 60%|██████ | 5.99G/9.95G [00:10<00:06, 653MB/s] model-00001-of-00003.safetensors: 61%|██████ | 6.06G/9.95G [00:10<00:06, 592MB/s] model-00001-of-00003.safetensors: 62%|██████▏ | 6.13G/9.95G [00:10<00:06, 585MB/s] model-00001-of-00003.safetensors: 62%|██████▏ | 6.21G/9.95G [00:10<00:06, 610MB/s] model-00001-of-00003.safetensors: 63%|██████▎ | 6.27G/9.95G [00:10<00:06, 536MB/s] model-00001-of-00003.safetensors: 64%|██████▍ | 6.34G/9.95G [00:10<00:06, 546MB/s] model-00001-of-00003.safetensors: 65%|██████▍ | 6.42G/9.95G [00:10<00:06, 584MB/s] model-00001-of-00003.safetensors: 65%|██████▌ | 6.49G/9.95G [00:11<00:05, 608MB/s] model-00001-of-00003.safetensors: 66%|██████▌ | 6.55G/9.95G [00:11<00:06, 498MB/s] model-00001-of-00003.safetensors: 67%|██████▋ | 6.62G/9.95G [00:11<00:06, 492MB/s] model-00001-of-00003.safetensors: 67%|██████▋ | 6.69G/9.95G [00:11<00:05, 549MB/s] model-00001-of-00003.safetensors: 68%|██████▊ | 6.75G/9.95G [00:11<00:05, 556MB/s] model-00001-of-00003.safetensors: 69%|██████▉ | 6.86G/9.95G [00:11<00:04, 680MB/s] model-00001-of-00003.safetensors: 70%|██████▉ | 6.93G/9.95G [00:11<00:04, 668MB/s] model-00001-of-00003.safetensors: 71%|███████ | 7.01G/9.95G [00:11<00:04, 702MB/s] model-00001-of-00003.safetensors: 71%|███████▏ | 7.11G/9.95G [00:12<00:03, 769MB/s] model-00001-of-00003.safetensors: 72%|███████▏ | 7.19G/9.95G [00:12<00:03, 744MB/s] model-00001-of-00003.safetensors: 73%|███████▎ | 7.28G/9.95G [00:12<00:03, 761MB/s] model-00001-of-00003.safetensors: 74%|███████▍ | 7.36G/9.95G [00:12<00:04, 643MB/s] model-00001-of-00003.safetensors: 75%|███████▍ | 7.46G/9.95G [00:12<00:03, 716MB/s] model-00001-of-00003.safetensors: 76%|███████▌ | 7.54G/9.95G [00:12<00:03, 728MB/s] model-00001-of-00003.safetensors: 77%|███████▋ | 7.62G/9.95G [00:12<00:03, 633MB/s] model-00001-of-00003.safetensors: 78%|███████▊ | 7.75G/9.95G [00:12<00:02, 751MB/s] model-00001-of-00003.safetensors: 79%|███████▊ | 7.83G/9.95G [00:13<00:02, 727MB/s] model-00001-of-00003.safetensors: 80%|███████▉ | 7.92G/9.95G [00:13<00:03, 649MB/s] model-00001-of-00003.safetensors: 81%|████████ | 8.04G/9.95G [00:13<00:02, 780MB/s] model-00001-of-00003.safetensors: 82%|████████▏ | 8.16G/9.95G [00:13<00:02, 866MB/s] model-00001-of-00003.safetensors: 83%|████████▎ | 8.29G/9.95G [00:13<00:01, 986MB/s] model-00001-of-00003.safetensors: 85%|████████▍ | 8.41G/9.95G [00:13<00:01, 1.00GB/s] model-00001-of-00003.safetensors: 86%|████████▌ | 8.51G/9.95G [00:13<00:01, 950MB/s] model-00001-of-00003.safetensors: 87%|████████▋ | 8.62G/9.95G [00:13<00:01, 930MB/s] model-00001-of-00003.safetensors: 88%|████████▊ | 8.76G/9.95G [00:13<00:01, 1.04GB/s] model-00001-of-00003.safetensors: 89%|████████▉ | 8.88G/9.95G [00:14<00:00, 1.10GB/s] model-00001-of-00003.safetensors: 90%|█████████ | 9.00G/9.95G [00:14<00:00, 1.05GB/s] model-00001-of-00003.safetensors: 92%|█████████▏| 9.11G/9.95G [00:14<00:00, 1.04GB/s] model-00001-of-00003.safetensors: 93%|█████████▎| 9.27G/9.95G [00:14<00:00, 1.16GB/s] model-00001-of-00003.safetensors: 94%|█████████▍| 9.39G/9.95G [00:14<00:00, 1.09GB/s] model-00001-of-00003.safetensors: 96%|█████████▌| 9.51G/9.95G [00:14<00:00, 1.01GB/s] model-00001-of-00003.safetensors: 97%|█████████▋| 9.61G/9.95G [00:14<00:00, 897MB/s] model-00001-of-00003.safetensors: 98%|█████████▊| 9.71G/9.95G [00:15<00:00, 761MB/s] model-00001-of-00003.safetensors: 98%|█████████▊| 9.79G/9.95G [00:15<00:00, 490MB/s] model-00001-of-00003.safetensors: 99%|█████████▉| 9.86G/9.95G [00:15<00:00, 459MB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.93G/9.95G [00:15<00:00, 397MB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.95G/9.95G [00:15<00:00, 622MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: model-00002-of-00003.safetensors: 0%| | 0.00/9.90G [00:00<?, ?B/s] model-00002-of-00003.safetensors: 0%| | 10.5M/9.90G [00:00<11:19, 14.6MB/s] model-00002-of-00003.safetensors: 0%| | 21.0M/9.90G [00:00<05:45, 28.6MB/s] model-00002-of-00003.safetensors: 0%| | 41.9M/9.90G [00:00<02:47, 58.9MB/s] model-00002-of-00003.safetensors: 1%| | 62.9M/9.90G [00:01<01:52, 87.6MB/s] model-00002-of-00003.safetensors: 1%|▏ | 136M/9.90G [00:01<00:44, 218MB/s] model-00002-of-00003.safetensors: 2%|▏ | 168M/9.90G [00:01<00:50, 191MB/s] model-00002-of-00003.safetensors: 2%|▏ | 241M/9.90G [00:01<00:32, 300MB/s] model-00002-of-00003.safetensors: 3%|▎ | 294M/9.90G [00:01<00:30, 319MB/s] model-00002-of-00003.safetensors: 4%|▍ | 430M/9.90G [00:01<00:17, 544MB/s] model-00002-of-00003.safetensors: 6%|▌ | 566M/9.90G [00:01<00:13, 715MB/s] model-00002-of-00003.safetensors: 7%|▋ | 692M/9.90G [00:02<00:11, 812MB/s] model-00002-of-00003.safetensors: 8%|▊ | 786M/9.90G [00:02<00:11, 791MB/s] model-00002-of-00003.safetensors: 9%|▉ | 881M/9.90G [00:02<00:11, 767MB/s] model-00002-of-00003.safetensors: 10%|▉ | 965M/9.90G [00:02<00:11, 784MB/s] model-00002-of-00003.safetensors: 11%|█ | 1.05G/9.90G [00:02<00:13, 649MB/s] model-00002-of-00003.safetensors: 11%|█▏ | 1.12G/9.90G [00:02<00:14, 605MB/s] model-00002-of-00003.safetensors: 12%|█▏ | 1.21G/9.90G [00:02<00:13, 648MB/s] model-00002-of-00003.safetensors: 13%|█▎ | 1.28G/9.90G [00:02<00:13, 663MB/s] model-00002-of-00003.safetensors: 14%|█▍ | 1.36G/9.90G [00:03<00:13, 647MB/s] model-00002-of-00003.safetensors: 15%|█▌ | 1.52G/9.90G [00:03<00:09, 875MB/s] model-00002-of-00003.safetensors: 17%|█▋ | 1.65G/9.90G [00:03<00:08, 951MB/s] model-00002-of-00003.safetensors: 18%|█▊ | 1.75G/9.90G [00:03<00:09, 823MB/s] model-00002-of-00003.safetensors: 19%|█▊ | 1.85G/9.90G [00:03<00:09, 818MB/s] model-00002-of-00003.safetensors: 20%|█▉ | 1.94G/9.90G [00:03<00:10, 760MB/s] model-00002-of-00003.safetensors: 21%|██ | 2.10G/9.90G [00:03<00:08, 929MB/s] model-00002-of-00003.safetensors: 22%|██▏ | 2.20G/9.90G [00:04<00:10, 739MB/s] model-00002-of-00003.safetensors: 23%|██▎ | 2.29G/9.90G [00:04<00:11, 673MB/s] model-00002-of-00003.safetensors: 24%|██▍ | 2.41G/9.90G [00:04<00:09, 786MB/s] model-00002-of-00003.safetensors: 25%|██▌ | 2.52G/9.90G [00:04<00:08, 843MB/s] model-00002-of-00003.safetensors: 26%|██▋ | 2.61G/9.90G [00:04<00:08, 839MB/s] model-00002-of-00003.safetensors: 27%|██▋ | 2.71G/9.90G [00:04<00:10, 675MB/s] model-00002-of-00003.safetensors: 28%|██▊ | 2.81G/9.90G [00:04<00:09, 742MB/s] model-00002-of-00003.safetensors: 29%|██▉ | 2.89G/9.90G [00:04<00:09, 745MB/s] model-00002-of-00003.safetensors: 30%|███ | 2.98G/9.90G [00:05<00:10, 653MB/s] model-00002-of-00003.safetensors: 31%|███ | 3.08G/9.90G [00:05<00:09, 712MB/s] model-00002-of-00003.safetensors: 32%|███▏ | 3.17G/9.90G [00:05<00:09, 688MB/s] model-00002-of-00003.safetensors: 33%|███▎ | 3.26G/9.90G [00:05<00:08, 742MB/s] model-00002-of-00003.safetensors: 34%|███▍ | 3.40G/9.90G [00:05<00:07, 895MB/s] model-00002-of-00003.safetensors: 35%|███▌ | 3.49G/9.90G [00:05<00:08, 774MB/s] model-00002-of-00003.safetensors: 36%|███▌ | 3.58G/9.90G [00:05<00:09, 690MB/s] model-00002-of-00003.safetensors: 37%|███▋ | 3.66G/9.90G [00:06<00:08, 718MB/s] model-00002-of-00003.safetensors: 38%|███▊ | 3.74G/9.90G [00:06<00:09, 672MB/s] model-00002-of-00003.safetensors: 39%|███▊ | 3.82G/9.90G [00:06<00:09, 670MB/s] model-00002-of-00003.safetensors: 39%|███▉ | 3.89G/9.90G [00:06<00:08, 682MB/s] model-00002-of-00003.safetensors: 40%|████ | 3.96G/9.90G [00:06<00:08, 693MB/s] model-00002-of-00003.safetensors: 41%|████▏ | 4.09G/9.90G [00:06<00:06, 844MB/s] model-00002-of-00003.safetensors: 42%|████▏ | 4.18G/9.90G [00:06<00:06, 849MB/s] model-00002-of-00003.safetensors: 43%|████▎ | 4.28G/9.90G [00:06<00:07, 725MB/s] model-00002-of-00003.safetensors: 44%|████▍ | 4.36G/9.90G [00:06<00:07, 746MB/s] model-00002-of-00003.safetensors: 45%|████▌ | 4.49G/9.90G [00:07<00:06, 850MB/s] model-00002-of-00003.safetensors: 47%|████▋ | 4.61G/9.90G [00:07<00:05, 909MB/s] model-00002-of-00003.safetensors: 48%|████▊ | 4.71G/9.90G [00:07<00:06, 836MB/s] model-00002-of-00003.safetensors: 48%|████▊ | 4.80G/9.90G [00:07<00:06, 769MB/s] model-00002-of-00003.safetensors: 49%|████▉ | 4.90G/9.90G [00:07<00:06, 787MB/s] model-00002-of-00003.safetensors: 51%|█████ | 5.04G/9.90G [00:07<00:05, 881MB/s] model-00002-of-00003.safetensors: 52%|█████▏ | 5.16G/9.90G [00:07<00:05, 899MB/s] model-00002-of-00003.safetensors: 53%|█████▎ | 5.25G/9.90G [00:08<00:05, 787MB/s] model-00002-of-00003.safetensors: 54%|█████▍ | 5.34G/9.90G [00:08<00:06, 730MB/s] model-00002-of-00003.safetensors: 55%|█████▍ | 5.43G/9.90G [00:08<00:06, 744MB/s] model-00002-of-00003.safetensors: 56%|█████▌ | 5.52G/9.90G [00:08<00:05, 759MB/s] model-00002-of-00003.safetensors: 58%|█████▊ | 5.71G/9.90G [00:08<00:04, 1.04GB/s] model-00002-of-00003.safetensors: 59%|█████▉ | 5.83G/9.90G [00:08<00:04, 915MB/s] model-00002-of-00003.safetensors: 60%|█████▉ | 5.93G/9.90G [00:08<00:04, 859MB/s] model-00002-of-00003.safetensors: 61%|██████ | 6.03G/9.90G [00:08<00:04, 856MB/s] model-00002-of-00003.safetensors: 62%|██████▏ | 6.12G/9.90G [00:09<00:04, 757MB/s] model-00002-of-00003.safetensors: 63%|██████▎ | 6.24G/9.90G [00:09<00:04, 849MB/s] model-00002-of-00003.safetensors: 64%|██████▍ | 6.33G/9.90G [00:09<00:04, 741MB/s] model-00002-of-00003.safetensors: 65%|██████▌ | 6.44G/9.90G [00:09<00:04, 752MB/s] model-00002-of-00003.safetensors: 66%|██████▌ | 6.52G/9.90G [00:09<00:04, 680MB/s] model-00002-of-00003.safetensors: 67%|██████▋ | 6.61G/9.90G [00:09<00:04, 695MB/s] model-00002-of-00003.safetensors: 67%|██████▋ | 6.68G/9.90G [00:09<00:05, 643MB/s] model-00002-of-00003.safetensors: 68%|██████▊ | 6.78G/9.90G [00:10<00:04, 699MB/s] model-00002-of-00003.safetensors: 69%|██████▉ | 6.87G/9.90G [00:10<00:04, 701MB/s] model-00002-of-00003.safetensors: 70%|███████ | 6.94G/9.90G [00:10<00:04, 705MB/s] model-00002-of-00003.safetensors: 71%|███████ | 7.03G/9.90G [00:10<00:03, 728MB/s] model-00002-of-00003.safetensors: 72%|███████▏ | 7.11G/9.90G [00:10<00:03, 745MB/s] model-00002-of-00003.safetensors: 73%|███████▎ | 7.21G/9.90G [00:10<00:03, 816MB/s] model-00002-of-00003.safetensors: 74%|███████▍ | 7.31G/9.90G [00:10<00:03, 847MB/s] model-00002-of-00003.safetensors: 75%|███████▌ | 7.44G/9.90G [00:10<00:02, 938MB/s] model-00002-of-00003.safetensors: 76%|███████▌ | 7.54G/9.90G [00:10<00:02, 795MB/s] model-00002-of-00003.safetensors: 77%|███████▋ | 7.63G/9.90G [00:11<00:02, 823MB/s] model-00002-of-00003.safetensors: 79%|███████▊ | 7.78G/9.90G [00:11<00:02, 947MB/s] model-00002-of-00003.safetensors: 80%|███████▉ | 7.89G/9.90G [00:11<00:02, 899MB/s] model-00002-of-00003.safetensors: 81%|████████ | 7.99G/9.90G [00:11<00:02, 925MB/s] model-00002-of-00003.safetensors: 82%|████████▏ | 8.08G/9.90G [00:11<00:01, 916MB/s] model-00002-of-00003.safetensors: 83%|████████▎ | 8.20G/9.90G [00:11<00:01, 975MB/s] model-00002-of-00003.safetensors: 84%|████████▍ | 8.30G/9.90G [00:11<00:01, 926MB/s] model-00002-of-00003.safetensors: 85%|████████▌ | 8.44G/9.90G [00:11<00:01, 1.04GB/s] model-00002-of-00003.safetensors: 86%|████████▋ | 8.57G/9.90G [00:11<00:01, 1.09GB/s] model-00002-of-00003.safetensors: 88%|████████▊ | 8.68G/9.90G [00:12<00:01, 1.06GB/s] model-00002-of-00003.safetensors: 89%|████████▉ | 8.86G/9.90G [00:12<00:00, 1.22GB/s] model-00002-of-00003.safetensors: 91%|█████████ | 8.99G/9.90G [00:12<00:00, 1.21GB/s] model-00002-of-00003.safetensors: 93%|█████████▎| 9.17G/9.90G [00:12<00:00, 1.35GB/s] model-00002-of-00003.safetensors: 94%|█████████▍| 9.31G/9.90G [00:12<00:00, 1.22GB/s] model-00002-of-00003.safetensors: 95%|█████████▌| 9.45G/9.90G [00:12<00:00, 1.24GB/s] model-00002-of-00003.safetensors: 97%|█████████▋| 9.59G/9.90G [00:13<00:00, 601MB/s] model-00002-of-00003.safetensors: 98%|█████████▊| 9.69G/9.90G [00:13<00:00, 615MB/s] model-00002-of-00003.safetensors: 99%|█████████▉| 9.79G/9.90G [00:13<00:00, 581MB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.87G/9.90G [00:13<00:00, 521MB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.90G/9.90G [00:20<00:00, 495MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: model-00003-of-00003.safetensors: 0%| | 0.00/6.18G [00:00<?, ?B/s] model-00003-of-00003.safetensors: 0%| | 10.5M/6.18G [00:00<01:56, 53.0MB/s] model-00003-of-00003.safetensors: 0%| | 21.0M/6.18G [00:00<01:40, 61.1MB/s] model-00003-of-00003.safetensors: 1%| | 31.5M/6.18G [00:00<01:29, 68.7MB/s] model-00003-of-00003.safetensors: 1%| | 52.4M/6.18G [00:00<01:13, 83.2MB/s] model-00003-of-00003.safetensors: 2%|▏ | 105M/6.18G [00:00<00:32, 186MB/s] model-00003-of-00003.safetensors: 2%|▏ | 147M/6.18G [00:00<00:26, 230MB/s] model-00003-of-00003.safetensors: 3%|▎ | 189M/6.18G [00:01<00:23, 257MB/s] model-00003-of-00003.safetensors: 4%|▎ | 231M/6.18G [00:01<00:23, 255MB/s] model-00003-of-00003.safetensors: 5%|▌ | 325M/6.18G [00:01<00:14, 392MB/s] model-00003-of-00003.safetensors: 6%|▌ | 367M/6.18G [00:01<00:16, 361MB/s] model-00003-of-00003.safetensors: 7%|▋ | 419M/6.18G [00:01<00:14, 397MB/s] model-00003-of-00003.safetensors: 7%|▋ | 461M/6.18G [00:01<00:17, 325MB/s] model-00003-of-00003.safetensors: 8%|▊ | 503M/6.18G [00:01<00:19, 298MB/s] model-00003-of-00003.safetensors: 9%|▉ | 545M/6.18G [00:02<00:22, 250MB/s] model-00003-of-00003.safetensors: 9%|▉ | 577M/6.18G [00:02<00:25, 221MB/s] model-00003-of-00003.safetensors: 10%|▉ | 608M/6.18G [00:02<00:24, 231MB/s] model-00003-of-00003.safetensors: 11%|█ | 671M/6.18G [00:02<00:20, 265MB/s] model-00003-of-00003.safetensors: 12%|█▏ | 724M/6.18G [00:02<00:17, 308MB/s] model-00003-of-00003.safetensors: 12%|█▏ | 765M/6.18G [00:03<00:23, 232MB/s] model-00003-of-00003.safetensors: 13%|█▎ | 828M/6.18G [00:03<00:17, 299MB/s] model-00003-of-00003.safetensors: 14%|█▍ | 870M/6.18G [00:03<00:21, 253MB/s] model-00003-of-00003.safetensors: 15%|█▌ | 944M/6.18G [00:03<00:15, 331MB/s] model-00003-of-00003.safetensors: 16%|█▋ | 1.01G/6.18G [00:03<00:14, 362MB/s] model-00003-of-00003.safetensors: 17%|█▋ | 1.06G/6.18G [00:03<00:14, 344MB/s] model-00003-of-00003.safetensors: 18%|█▊ | 1.13G/6.18G [00:04<00:12, 411MB/s] model-00003-of-00003.safetensors: 20%|██ | 1.24G/6.18G [00:04<00:08, 552MB/s] model-00003-of-00003.safetensors: 21%|██▏ | 1.32G/6.18G [00:04<00:07, 618MB/s] model-00003-of-00003.safetensors: 23%|██▎ | 1.39G/6.18G [00:04<00:07, 640MB/s] model-00003-of-00003.safetensors: 24%|██▍ | 1.49G/6.18G [00:04<00:06, 713MB/s] model-00003-of-00003.safetensors: 25%|██▌ | 1.57G/6.18G [00:04<00:06, 730MB/s] model-00003-of-00003.safetensors: 27%|██▋ | 1.66G/6.18G [00:04<00:06, 746MB/s] model-00003-of-00003.safetensors: 29%|██▊ | 1.76G/6.18G [00:04<00:05, 754MB/s] model-00003-of-00003.safetensors: 30%|███ | 1.87G/6.18G [00:04<00:05, 829MB/s] model-00003-of-00003.safetensors: 32%|███▏ | 1.96G/6.18G [00:05<00:05, 772MB/s] model-00003-of-00003.safetensors: 33%|███▎ | 2.06G/6.18G [00:05<00:05, 783MB/s] model-00003-of-00003.safetensors: 35%|███▍ | 2.14G/6.18G [00:05<00:05, 756MB/s] model-00003-of-00003.safetensors: 36%|███▋ | 2.24G/6.18G [00:05<00:04, 829MB/s] model-00003-of-00003.safetensors: 39%|███▊ | 2.38G/6.18G [00:05<00:03, 971MB/s] model-00003-of-00003.safetensors: 40%|████ | 2.49G/6.18G [00:05<00:04, 869MB/s] model-00003-of-00003.safetensors: 42%|████▏ | 2.60G/6.18G [00:05<00:03, 903MB/s] model-00003-of-00003.safetensors: 44%|████▎ | 2.69G/6.18G [00:05<00:04, 819MB/s] model-00003-of-00003.safetensors: 45%|████▌ | 2.79G/6.18G [00:05<00:04, 841MB/s] model-00003-of-00003.safetensors: 47%|████▋ | 2.89G/6.18G [00:06<00:04, 820MB/s] model-00003-of-00003.safetensors: 48%|████▊ | 2.98G/6.18G [00:06<00:04, 778MB/s] model-00003-of-00003.safetensors: 50%|█████ | 3.10G/6.18G [00:06<00:03, 895MB/s] model-00003-of-00003.safetensors: 52%|█████▏ | 3.20G/6.18G [00:06<00:03, 829MB/s] model-00003-of-00003.safetensors: 53%|█████▎ | 3.29G/6.18G [00:06<00:03, 822MB/s] model-00003-of-00003.safetensors: 55%|█████▍ | 3.40G/6.18G [00:06<00:03, 877MB/s] model-00003-of-00003.safetensors: 57%|█████▋ | 3.50G/6.18G [00:06<00:02, 917MB/s] model-00003-of-00003.safetensors: 59%|█████▉ | 3.66G/6.18G [00:06<00:02, 1.07GB/s] model-00003-of-00003.safetensors: 61%|██████ | 3.77G/6.18G [00:07<00:02, 1.05GB/s] model-00003-of-00003.safetensors: 64%|██████▍ | 3.98G/6.18G [00:07<00:01, 1.18GB/s] model-00003-of-00003.safetensors: 69%|██████▊ | 4.25G/6.18G [00:07<00:01, 1.49GB/s] model-00003-of-00003.safetensors: 71%|███████▏ | 4.40G/6.18G [00:07<00:01, 1.50GB/s] model-00003-of-00003.safetensors: 75%|███████▌ | 4.66G/6.18G [00:07<00:00, 1.77GB/s] model-00003-of-00003.safetensors: 79%|███████▊ | 4.87G/6.18G [00:07<00:00, 1.86GB/s] model-00003-of-00003.safetensors: 83%|████████▎ | 5.13G/6.18G [00:07<00:00, 2.01GB/s] model-00003-of-00003.safetensors: 86%|████████▋ | 5.34G/6.18G [00:07<00:00, 1.80GB/s] model-00003-of-00003.safetensors: 91%|█████████ | 5.62G/6.18G [00:07<00:00, 2.03GB/s] model-00003-of-00003.safetensors: 95%|█████████▌| 5.89G/6.18G [00:08<00:00, 2.17GB/s] model-00003-of-00003.safetensors: 99%|█████████▉| 6.12G/6.18G [00:08<00:00, 1.86GB/s] model-00003-of-00003.safetensors: 100%|█████████▉| 6.18G/6.18G [00:08<00:00, 694MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: model.safetensors.index.json: 0%| | 0.00/28.4k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 28.4k/28.4k [00:00<00:00, 225MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: special_tokens_map.json: 0%| | 0.00/549 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 549/549 [00:00<00:00, 4.82MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: tokenizer.json: 0%| | 0.00/1.84M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 3.71MB/s] tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 3.71MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: tokenizer.model: 0%| | 0.00/500k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 500k/500k [00:00<00:00, 3.95MB/s] tokenizer.model: 100%|██████████| 500k/500k [00:00<00:00, 3.94MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: tokenizer_config.json: 0%| | 0.00/1.12k [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 1.12k/1.12k [00:00<00:00, 9.25MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Downloaded to shared memory in 50.424s
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: quantizing model to /dev/shm/model_cache
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Saving mkml model at /dev/shm/model_cache
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Reading /tmp/tmpgix0_po6/model.safetensors.index.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Profiling: 0%| | 0/363 [00:00<?, ?it/s] Profiling: 0%| | 1/363 [00:01<09:08, 1.52s/it] Profiling: 2%|▏ | 9/363 [00:01<00:47, 7.47it/s] Profiling: 5%|▍ | 18/363 [00:01<00:21, 16.38it/s] Profiling: 7%|▋ | 27/363 [00:01<00:12, 26.03it/s] Profiling: 10%|▉ | 36/363 [00:01<00:09, 35.87it/s] Profiling: 12%|█▏ | 44/363 [00:02<00:07, 43.94it/s] Profiling: 14%|█▍ | 52/363 [00:02<00:06, 51.35it/s] Profiling: 17%|█▋ | 60/363 [00:02<00:05, 57.46it/s] Profiling: 19%|█▉ | 70/363 [00:02<00:04, 66.81it/s] Profiling: 22%|██▏ | 79/363 [00:02<00:04, 69.69it/s] Profiling: 24%|██▍ | 88/363 [00:02<00:03, 73.65it/s] Profiling: 27%|██▋ | 97/363 [00:02<00:03, 76.15it/s] Profiling: 29%|██▉ | 106/363 [00:02<00:03, 78.08it/s] Profiling: 32%|███▏ | 115/363 [00:02<00:03, 80.41it/s] Profiling: 34%|███▍ | 124/363 [00:03<00:02, 82.17it/s] Profiling: 37%|███▋ | 133/363 [00:03<00:02, 83.15it/s] Profiling: 39%|███▉ | 142/363 [00:03<00:05, 37.32it/s] Profiling: 42%|████▏ | 152/363 [00:03<00:04, 46.44it/s] Profiling: 44%|████▍ | 161/363 [00:03<00:03, 53.94it/s] Profiling: 47%|████▋ | 170/363 [00:03<00:03, 60.81it/s] Profiling: 50%|████▉ | 180/363 [00:04<00:02, 68.36it/s] Profiling: 52%|█████▏ | 190/363 [00:04<00:02, 74.96it/s] Profiling: 55%|█████▌ | 201/363 [00:04<00:02, 79.95it/s] Profiling: 58%|█████▊ | 211/363 [00:04<00:01, 81.03it/s] Profiling: 61%|██████ | 221/363 [00:04<00:01, 81.46it/s] Profiling: 63%|██████▎ | 230/363 [00:04<00:01, 83.48it/s] Profiling: 66%|██████▌ | 239/363 [00:04<00:01, 85.19it/s] Profiling: 69%|██████▊ | 249/363 [00:04<00:01, 89.20it/s] Profiling: 71%|███████▏ | 259/363 [00:04<00:01, 90.31it/s] Profiling: 74%|███████▍ | 269/363 [00:05<00:01, 91.25it/s] Profiling: 77%|███████▋ | 279/363 [00:07<00:06, 13.91it/s] Profiling: 79%|███████▉ | 287/363 [00:07<00:04, 17.68it/s] Profiling: 82%|████████▏ | 297/363 [00:07<00:02, 23.75it/s] Profiling: 85%|████████▍ | 307/363 [00:07<00:01, 31.00it/s] Profiling: 87%|████████▋ | 317/363 [00:07<00:01, 39.19it/s] Profiling: 90%|█████████ | 328/363 [00:07<00:00, 48.36it/s] Profiling: 93%|█████████▎| 338/363 [00:07<00:00, 55.42it/s] Profiling: 96%|█████████▌| 348/363 [00:07<00:00, 61.55it/s] Profiling: 99%|█████████▊| 358/363 [00:08<00:00, 69.42it/s] Profiling: 100%|██████████| 363/363 [00:08<00:00, 43.53it/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Processed model hflserdaniel/chai_s6_13b_slp3 in 80.535s
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: creating bucket guanaco-mkml-models
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15/config.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15/special_tokens_map.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15/added_tokens.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15/tokenizer_config.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15/tokenizer.model
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15/tokenizer.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v15/mkml_model.tensors
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: loading reward model from rirv938/reward_gpt2_medium_preference_24m_e2
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: warnings.warn(
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: config.json: 0%| | 0.00/1.05k [00:00<?, ?B/s] config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 11.8MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: warnings.warn(
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: tokenizer_config.json: 0%| | 0.00/234 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 3.29MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: vocab.json: 0%| | 0.00/1.04M [00:00<?, ?B/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 10.8MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 24.0MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: warnings.warn(
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: pytorch_model.bin: 0%| | 0.00/1.44G [00:00<?, ?B/s] pytorch_model.bin: 1%| | 10.5M/1.44G [00:00<00:22, 64.2MB/s] pytorch_model.bin: 4%|▎ | 52.4M/1.44G [00:00<00:06, 202MB/s] pytorch_model.bin: 11%|█ | 157M/1.44G [00:00<00:02, 507MB/s] pytorch_model.bin: 21%|██ | 304M/1.44G [00:00<00:01, 782MB/s] pytorch_model.bin: 27%|██▋ | 388M/1.44G [00:00<00:01, 787MB/s] pytorch_model.bin: 35%|███▍ | 503M/1.44G [00:00<00:01, 870MB/s] pytorch_model.bin: 41%|████▏ | 598M/1.44G [00:00<00:01, 797MB/s] pytorch_model.bin: 51%|█████ | 732M/1.44G [00:00<00:00, 930MB/s] pytorch_model.bin: 67%|██████▋ | 973M/1.44G [00:01<00:00, 1.33GB/s] pytorch_model.bin: 99%|█████████▊| 1.42G/1.44G [00:01<00:00, 1.02GB/s] pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:01<00:00, 869MB/s]
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Saving duration: 0.251s
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Processed model rirv938/reward_gpt2_medium_preference_24m_e2 in 5.041s
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: creating bucket guanaco-reward-models
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: Bucket 's3://guanaco-reward-models/' created
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward/special_tokens_map.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward/tokenizer_config.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward/config.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward/merges.txt
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward/vocab.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward/tokenizer.json
hflserdaniel-chai-s6-13-2318-v15-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v15_reward/reward.tensors
Job hflserdaniel-chai-s6-13-2318-v15-mkmlizer completed after 262.58s with status: succeeded
Stopping job with name hflserdaniel-chai-s6-13-2318-v15-mkmlizer
Pipeline stage MKMLizer completed in 265.54s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.13s
Running pipeline stage ISVCDeployer
Creating inference service hflserdaniel-chai-s6-13-2318-v15
Waiting for inference service hflserdaniel-chai-s6-13-2318-v15 to be ready
Inference service hflserdaniel-chai-s6-13-2318-v15 ready after 50.350900650024414s
Pipeline stage ISVCDeployer completed in 57.32s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1197783946990967s
Received healthy response to inference request in 2.102830410003662s
Received healthy response to inference request in 2.390630006790161s
Received healthy response to inference request in 2.1835451126098633s
Received healthy response to inference request in 2.3976147174835205s
5 requests
0 failed requests
5th percentile: 2.1189733505249024
10th percentile: 2.1351162910461428
20th percentile: 2.167402172088623
30th percentile: 2.224962091445923
40th percentile: 2.307796049118042
50th percentile: 2.390630006790161
60th percentile: 2.393423891067505
70th percentile: 2.396217775344849
80th percentile: 2.542047452926636
90th percentile: 2.8309129238128663
95th percentile: 2.9753456592559813
99th percentile: 3.0908918476104734
mean time: 2.4388797283172607
Pipeline stage StressChecker completed in 13.05s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.04s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.04s
M-Eval Dataset for topic stay_in_character is loaded
hflserdaniel-chai-s6-13_2318_v15 status is now deployed due to DeploymentManager action
hflserdaniel-chai-s6-13_2318_v15 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of hflserdaniel-chai-s6-13_2318_v15
Running pipeline stage ISVCDeleter
Checking if service hflserdaniel-chai-s6-13-2318-v15 is running
Tearing down inference service hflserdaniel-chai-s6-13-2318-v15
Toredown service hflserdaniel-chai-s6-13-2318-v15
Pipeline stage ISVCDeleter completed in 4.72s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key hflserdaniel-chai-s6-13-2318-v15/added_tokens.json from bucket guanaco-mkml-models
Deleting key hflserdaniel-chai-s6-13-2318-v15/config.json from bucket guanaco-mkml-models
Deleting key hflserdaniel-chai-s6-13-2318-v15/mkml_model.tensors from bucket guanaco-mkml-models
Deleting key hflserdaniel-chai-s6-13-2318-v15/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key hflserdaniel-chai-s6-13-2318-v15/tokenizer.json from bucket guanaco-mkml-models
Deleting key hflserdaniel-chai-s6-13-2318-v15/tokenizer.model from bucket guanaco-mkml-models
Deleting key hflserdaniel-chai-s6-13-2318-v15/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key hflserdaniel-chai-s6-13-2318-v15_reward/config.json from bucket guanaco-reward-models
Deleting key hflserdaniel-chai-s6-13-2318-v15_reward/merges.txt from bucket guanaco-reward-models
Deleting key hflserdaniel-chai-s6-13-2318-v15_reward/reward.tensors from bucket guanaco-reward-models
Deleting key hflserdaniel-chai-s6-13-2318-v15_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key hflserdaniel-chai-s6-13-2318-v15_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key hflserdaniel-chai-s6-13-2318-v15_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key hflserdaniel-chai-s6-13-2318-v15_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 2.75s
hflserdaniel-chai-s6-13_2318_v15 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics