submission_id: hflserdaniel-chai-s6-13_2318_v16
developer_uid: chai_backend_admin
status: inactive
model_repo: hflserdaniel/chai_s6_13b_slp3
reward_repo: rirv938/reward_gpt2_medium_preference_24m_e2
generation_params: {'temperature': 1.0, 'top_p': 0.8, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['<|im_end|>', '</s>', '<|endoftext|>'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 156}
formatter: {'memory_template': "### Instruction:\n As the assistant, your task is to become the assigned character, weaving engaging stories that fully embrace their personality and background. Ensure your responses capture the essence of the character's traits accurately, immersing users in emotional, suspenseful, and anticipatory narratives. Craft more detailed and descriptive replies to enhance the vividness of the story. Foster an interactive environment by introducing new elements, providing choices, or posing questions to encourage active user participation. Think of the conversation as a continuous dance, always unfolding and evolving.\nYour character: {bot_name}.\nContext:{memory}\n", 'prompt_template': 'Example conversation:\n{prompt}\n', 'bot_template': '### Response:\n{bot_name}: {message}\n', 'user_template': '### Input:\n{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:'}
reward_formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:'}
timestamp: 2024-03-31T01:59:32+00:00
model_name: chai_s6_13b_slp3-156
model_eval_status: success
safety_score: None
entertaining: 7.14
stay_in_character: 8.58
user_preference: 7.62
double_thumbs_up: 3367
thumbs_up: 4738
thumbs_down: 2176
num_battles: 314013
num_wins: 167722
win_ratio: 0.5341243833854012
celo_rating: 1180.85
Resubmit model
Running pipeline stage MKMLizer
Starting job with name hflserdaniel-chai-s6-13-2318-v16-mkmlizer
Waiting for job on hflserdaniel-chai-s6-13-2318-v16-mkmlizer to finish
Failed to get response for submission thanhdaonguyen-once-upon-a-t_v35: HTTPConnectionPool(host='thanhdaonguyen-once-upon-a-t-v35-predictor-default.tenant-chaiml-guanaco.knative.ord1.coreweave.cloud', port=80): Read timed out. (read timeout=5.5)
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ _____ __ __ ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ /___/ ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ Version: 0.6.11 ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ The license key for the current software has been verified as ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ belonging to: ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ Chai Research Corp. ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ Expiration: 2024-07-15 23:59:59 ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ║ ║
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: .gitattributes: 0%| | 0.00/1.52k [00:00<?, ?B/s] .gitattributes: 100%|██████████| 1.52k/1.52k [00:00<00:00, 20.2MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: README.md: 0%| | 0.00/949 [00:00<?, ?B/s] README.md: 100%|██████████| 949/949 [00:00<00:00, 6.75MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: added_tokens.json: 0%| | 0.00/21.0 [00:00<?, ?B/s] added_tokens.json: 100%|██████████| 21.0/21.0 [00:00<00:00, 237kB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: config.json: 0%| | 0.00/738 [00:00<?, ?B/s] config.json: 100%|██████████| 738/738 [00:00<00:00, 12.1MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: mergekit_config.yml: 0%| | 0.00/370 [00:00<?, ?B/s] mergekit_config.yml: 100%|██████████| 370/370 [00:00<00:00, 5.62MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: model-00001-of-00003.safetensors: 0%| | 0.00/9.95G [00:00<?, ?B/s] model-00001-of-00003.safetensors: 0%| | 10.5M/9.95G [00:00<02:11, 75.4MB/s] model-00001-of-00003.safetensors: 0%| | 31.5M/9.95G [00:00<01:22, 120MB/s] model-00001-of-00003.safetensors: 1%| | 115M/9.95G [00:00<00:28, 341MB/s] model-00001-of-00003.safetensors: 2%|▏ | 157M/9.95G [00:00<00:35, 273MB/s] model-00001-of-00003.safetensors: 2%|▏ | 210M/9.95G [00:00<00:31, 312MB/s] model-00001-of-00003.safetensors: 3%|▎ | 262M/9.95G [00:00<00:28, 339MB/s] model-00001-of-00003.safetensors: 3%|▎ | 304M/9.95G [00:00<00:27, 348MB/s] model-00001-of-00003.safetensors: 3%|▎ | 346M/9.95G [00:01<00:27, 355MB/s] model-00001-of-00003.safetensors: 4%|▍ | 388M/9.95G [00:01<00:26, 358MB/s] model-00001-of-00003.safetensors: 4%|▍ | 440M/9.95G [00:01<00:27, 352MB/s] model-00001-of-00003.safetensors: 5%|▍ | 482M/9.95G [00:01<00:27, 347MB/s] model-00001-of-00003.safetensors: 6%|▌ | 556M/9.95G [00:01<00:22, 412MB/s] model-00001-of-00003.safetensors: 6%|▌ | 598M/9.95G [00:01<00:24, 379MB/s] model-00001-of-00003.safetensors: 6%|▋ | 640M/9.95G [00:01<00:26, 346MB/s] model-00001-of-00003.safetensors: 7%|▋ | 682M/9.95G [00:02<00:26, 346MB/s] model-00001-of-00003.safetensors: 7%|▋ | 734M/9.95G [00:02<00:26, 348MB/s] model-00001-of-00003.safetensors: 8%|▊ | 797M/9.95G [00:02<00:22, 412MB/s] model-00001-of-00003.safetensors: 9%|▊ | 849M/9.95G [00:02<00:25, 361MB/s] model-00001-of-00003.safetensors: 9%|▉ | 891M/9.95G [00:02<00:26, 345MB/s] model-00001-of-00003.safetensors: 9%|▉ | 944M/9.95G [00:02<00:23, 376MB/s] model-00001-of-00003.safetensors: 10%|█ | 1.04G/9.95G [00:02<00:17, 506MB/s] model-00001-of-00003.safetensors: 11%|█ | 1.10G/9.95G [00:02<00:16, 522MB/s] model-00001-of-00003.safetensors: 12%|█▏ | 1.18G/9.95G [00:03<00:15, 581MB/s] model-00001-of-00003.safetensors: 13%|█▎ | 1.25G/9.95G [00:03<00:17, 511MB/s] model-00001-of-00003.safetensors: 13%|█▎ | 1.31G/9.95G [00:03<00:17, 495MB/s] model-00001-of-00003.safetensors: 14%|█▎ | 1.36G/9.95G [00:03<00:21, 396MB/s] model-00001-of-00003.safetensors: 14%|█▍ | 1.44G/9.95G [00:03<00:18, 456MB/s] model-00001-of-00003.safetensors: 15%|█▍ | 1.49G/9.95G [00:04<00:26, 313MB/s] model-00001-of-00003.safetensors: 16%|█▌ | 1.55G/9.95G [00:04<00:22, 366MB/s] model-00001-of-00003.safetensors: 17%|█▋ | 1.65G/9.95G [00:04<00:17, 463MB/s] model-00001-of-00003.safetensors: 17%|█▋ | 1.73G/9.95G [00:04<00:15, 542MB/s] model-00001-of-00003.safetensors: 18%|█▊ | 1.84G/9.95G [00:04<00:12, 624MB/s] model-00001-of-00003.safetensors: 19%|█▉ | 1.91G/9.95G [00:04<00:17, 459MB/s] model-00001-of-00003.safetensors: 20%|██ | 2.01G/9.95G [00:04<00:13, 574MB/s] model-00001-of-00003.safetensors: 21%|██ | 2.10G/9.95G [00:04<00:12, 605MB/s] model-00001-of-00003.safetensors: 22%|██▏ | 2.23G/9.95G [00:05<00:09, 772MB/s] model-00001-of-00003.safetensors: 24%|██▎ | 2.35G/9.95G [00:05<00:09, 843MB/s] model-00001-of-00003.safetensors: 25%|██▍ | 2.44G/9.95G [00:05<00:09, 789MB/s] model-00001-of-00003.safetensors: 26%|██▌ | 2.54G/9.95G [00:05<00:11, 637MB/s] model-00001-of-00003.safetensors: 26%|██▌ | 2.61G/9.95G [00:05<00:11, 618MB/s] model-00001-of-00003.safetensors: 27%|██▋ | 2.68G/9.95G [00:05<00:13, 541MB/s] model-00001-of-00003.safetensors: 28%|██▊ | 2.75G/9.95G [00:06<00:15, 469MB/s] model-00001-of-00003.safetensors: 28%|██▊ | 2.80G/9.95G [00:06<00:16, 440MB/s] model-00001-of-00003.safetensors: 29%|██▊ | 2.85G/9.95G [00:06<00:19, 363MB/s] model-00001-of-00003.safetensors: 29%|██▉ | 2.90G/9.95G [00:06<00:18, 380MB/s] model-00001-of-00003.safetensors: 30%|██▉ | 2.98G/9.95G [00:06<00:15, 440MB/s] model-00001-of-00003.safetensors: 30%|███ | 3.03G/9.95G [00:06<00:15, 452MB/s] model-00001-of-00003.safetensors: 31%|███ | 3.10G/9.95G [00:06<00:13, 498MB/s] model-00001-of-00003.safetensors: 32%|███▏ | 3.20G/9.95G [00:06<00:11, 596MB/s] model-00001-of-00003.safetensors: 34%|███▎ | 3.36G/9.95G [00:07<00:08, 794MB/s] model-00001-of-00003.safetensors: 35%|███▌ | 3.51G/9.95G [00:07<00:06, 951MB/s] model-00001-of-00003.safetensors: 37%|███▋ | 3.65G/9.95G [00:07<00:06, 1.04GB/s] model-00001-of-00003.safetensors: 38%|███▊ | 3.83G/9.95G [00:07<00:04, 1.23GB/s] model-00001-of-00003.safetensors: 40%|███▉ | 3.96G/9.95G [00:07<00:05, 1.06GB/s] model-00001-of-00003.safetensors: 41%|████ | 4.08G/9.95G [00:07<00:06, 859MB/s] model-00001-of-00003.safetensors: 42%|████▏ | 4.18G/9.95G [00:07<00:07, 803MB/s] model-00001-of-00003.safetensors: 43%|████▎ | 4.28G/9.95G [00:08<00:08, 665MB/s] model-00001-of-00003.safetensors: 44%|████▍ | 4.36G/9.95G [00:08<00:09, 569MB/s] model-00001-of-00003.safetensors: 45%|████▍ | 4.44G/9.95G [00:08<00:10, 502MB/s] model-00001-of-00003.safetensors: 45%|████▌ | 4.50G/9.95G [00:08<00:11, 484MB/s] model-00001-of-00003.safetensors: 46%|████▌ | 4.55G/9.95G [00:09<00:16, 335MB/s] model-00001-of-00003.safetensors: 46%|████▋ | 4.62G/9.95G [00:09<00:13, 381MB/s] model-00001-of-00003.safetensors: 47%|████▋ | 4.69G/9.95G [00:09<00:14, 362MB/s] model-00001-of-00003.safetensors: 48%|████▊ | 4.73G/9.95G [00:09<00:17, 300MB/s] model-00001-of-00003.safetensors: 48%|████▊ | 4.77G/9.95G [00:09<00:17, 293MB/s] model-00001-of-00003.safetensors: 49%|████▊ | 4.84G/9.95G [00:09<00:14, 360MB/s] model-00001-of-00003.safetensors: 49%|████▉ | 4.89G/9.95G [00:10<00:20, 246MB/s] model-00001-of-00003.safetensors: 50%|████▉ | 4.93G/9.95G [00:10<00:20, 249MB/s] model-00001-of-00003.safetensors: 50%|████▉ | 4.96G/9.95G [00:10<00:20, 244MB/s] model-00001-of-00003.safetensors: 50%|█████ | 5.00G/9.95G [00:10<00:19, 254MB/s] model-00001-of-00003.safetensors: 51%|█████ | 5.10G/9.95G [00:10<00:13, 356MB/s] model-00001-of-00003.safetensors: 52%|█████▏ | 5.15G/9.95G [00:10<00:12, 385MB/s] model-00001-of-00003.safetensors: 52%|█████▏ | 5.19G/9.95G [00:11<00:12, 368MB/s] model-00001-of-00003.safetensors: 53%|█████▎ | 5.26G/9.95G [00:11<00:10, 450MB/s] model-00001-of-00003.safetensors: 53%|█████▎ | 5.32G/9.95G [00:11<00:11, 421MB/s] model-00001-of-00003.safetensors: 54%|█████▍ | 5.37G/9.95G [00:11<00:12, 354MB/s] model-00001-of-00003.safetensors: 55%|█████▌ | 5.49G/9.95G [00:11<00:08, 505MB/s] model-00001-of-00003.safetensors: 56%|█████▌ | 5.56G/9.95G [00:11<00:08, 490MB/s] model-00001-of-00003.safetensors: 56%|█████▋ | 5.61G/9.95G [00:11<00:09, 445MB/s] model-00001-of-00003.safetensors: 57%|█████▋ | 5.66G/9.95G [00:12<00:09, 441MB/s] model-00001-of-00003.safetensors: 57%|█████▋ | 5.71G/9.95G [00:12<00:09, 445MB/s] model-00001-of-00003.safetensors: 58%|█████▊ | 5.77G/9.95G [00:12<00:11, 355MB/s] model-00001-of-00003.safetensors: 58%|█████▊ | 5.82G/9.95G [00:12<00:10, 390MB/s] model-00001-of-00003.safetensors: 59%|█████▉ | 5.90G/9.95G [00:12<00:08, 469MB/s] model-00001-of-00003.safetensors: 60%|█████▉ | 5.97G/9.95G [00:12<00:08, 495MB/s] model-00001-of-00003.safetensors: 60%|██████ | 6.02G/9.95G [00:12<00:08, 469MB/s] model-00001-of-00003.safetensors: 61%|██████ | 6.07G/9.95G [00:13<00:08, 440MB/s] model-00001-of-00003.safetensors: 62%|██████▏ | 6.18G/9.95G [00:13<00:07, 492MB/s] model-00001-of-00003.safetensors: 63%|██████▎ | 6.23G/9.95G [00:13<00:08, 455MB/s] model-00001-of-00003.safetensors: 63%|██████▎ | 6.29G/9.95G [00:13<00:08, 445MB/s] model-00001-of-00003.safetensors: 64%|██████▍ | 6.34G/9.95G [00:13<00:07, 454MB/s] model-00001-of-00003.safetensors: 64%|██████▍ | 6.41G/9.95G [00:13<00:07, 459MB/s] model-00001-of-00003.safetensors: 66%|██████▌ | 6.56G/9.95G [00:13<00:04, 695MB/s] model-00001-of-00003.safetensors: 67%|██████▋ | 6.64G/9.95G [00:14<00:05, 581MB/s] model-00001-of-00003.safetensors: 67%|██████▋ | 6.71G/9.95G [00:14<00:05, 599MB/s] model-00001-of-00003.safetensors: 68%|██████▊ | 6.78G/9.95G [00:14<00:05, 596MB/s] model-00001-of-00003.safetensors: 69%|██████▉ | 6.85G/9.95G [00:14<00:05, 547MB/s] model-00001-of-00003.safetensors: 69%|██████▉ | 6.91G/9.95G [00:14<00:05, 513MB/s] model-00001-of-00003.safetensors: 71%|███████ | 7.03G/9.95G [00:14<00:04, 589MB/s] model-00001-of-00003.safetensors: 72%|███████▏ | 7.14G/9.95G [00:14<00:04, 685MB/s] model-00001-of-00003.safetensors: 73%|███████▎ | 7.21G/9.95G [00:15<00:04, 615MB/s] model-00001-of-00003.safetensors: 73%|███████▎ | 7.29G/9.95G [00:15<00:04, 607MB/s] model-00001-of-00003.safetensors: 74%|███████▍ | 7.36G/9.95G [00:15<00:04, 633MB/s] model-00001-of-00003.safetensors: 75%|███████▍ | 7.43G/9.95G [00:15<00:03, 646MB/s] model-00001-of-00003.safetensors: 76%|███████▌ | 7.54G/9.95G [00:15<00:03, 734MB/s] model-00001-of-00003.safetensors: 77%|███████▋ | 7.62G/9.95G [00:15<00:03, 762MB/s] model-00001-of-00003.safetensors: 77%|███████▋ | 7.71G/9.95G [00:15<00:03, 732MB/s] model-00001-of-00003.safetensors: 79%|███████▊ | 7.81G/9.95G [00:15<00:02, 815MB/s] model-00001-of-00003.safetensors: 79%|███████▉ | 7.90G/9.95G [00:15<00:02, 719MB/s] model-00001-of-00003.safetensors: 80%|████████ | 7.98G/9.95G [00:16<00:02, 680MB/s] model-00001-of-00003.safetensors: 81%|████████ | 8.05G/9.95G [00:16<00:02, 677MB/s] model-00001-of-00003.safetensors: 83%|████████▎ | 8.24G/9.95G [00:16<00:01, 962MB/s] model-00001-of-00003.safetensors: 84%|████████▍ | 8.35G/9.95G [00:16<00:01, 959MB/s] model-00001-of-00003.safetensors: 85%|████████▍ | 8.45G/9.95G [00:16<00:01, 939MB/s] model-00001-of-00003.safetensors: 86%|████████▌ | 8.56G/9.95G [00:16<00:01, 864MB/s] model-00001-of-00003.safetensors: 87%|████████▋ | 8.67G/9.95G [00:16<00:01, 921MB/s] model-00001-of-00003.safetensors: 89%|████████▊ | 8.83G/9.95G [00:16<00:01, 1.09GB/s] model-00001-of-00003.safetensors: 90%|████████▉ | 8.94G/9.95G [00:17<00:00, 1.03GB/s] model-00001-of-00003.safetensors: 91%|█████████ | 9.07G/9.95G [00:17<00:00, 1.08GB/s] model-00001-of-00003.safetensors: 93%|█████████▎| 9.23G/9.95G [00:17<00:00, 1.19GB/s] model-00001-of-00003.safetensors: 94%|█████████▍| 9.35G/9.95G [00:17<00:00, 999MB/s] model-00001-of-00003.safetensors: 95%|█████████▌| 9.47G/9.95G [00:17<00:00, 925MB/s] model-00001-of-00003.safetensors: 96%|█████████▌| 9.57G/9.95G [00:17<00:00, 756MB/s] model-00001-of-00003.safetensors: 97%|█████████▋| 9.66G/9.95G [00:17<00:00, 687MB/s] model-00001-of-00003.safetensors: 98%|█████████▊| 9.74G/9.95G [00:18<00:00, 606MB/s] model-00001-of-00003.safetensors: 99%|█████████▊| 9.81G/9.95G [00:18<00:00, 380MB/s] model-00001-of-00003.safetensors: 99%|█████████▉| 9.86G/9.95G [00:18<00:00, 371MB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.92G/9.95G [00:18<00:00, 359MB/s] model-00001-of-00003.safetensors: 100%|█████████▉| 9.95G/9.95G [00:19<00:00, 523MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: model-00002-of-00003.safetensors: 0%| | 0.00/9.90G [00:00<?, ?B/s] model-00002-of-00003.safetensors: 0%| | 10.5M/9.90G [00:00<08:42, 18.9MB/s] model-00002-of-00003.safetensors: 1%| | 105M/9.90G [00:00<00:55, 177MB/s] model-00002-of-00003.safetensors: 2%|▏ | 241M/9.90G [00:00<00:23, 404MB/s] model-00002-of-00003.safetensors: 3%|▎ | 336M/9.90G [00:00<00:18, 516MB/s] model-00002-of-00003.safetensors: 4%|▍ | 419M/9.90G [00:01<00:19, 498MB/s] model-00002-of-00003.safetensors: 7%|▋ | 650M/9.90G [00:01<00:10, 890MB/s] model-00002-of-00003.safetensors: 8%|▊ | 776M/9.90G [00:01<00:12, 746MB/s] model-00002-of-00003.safetensors: 9%|▉ | 881M/9.90G [00:01<00:13, 672MB/s] model-00002-of-00003.safetensors: 10%|█ | 1.02G/9.90G [00:01<00:11, 801MB/s] model-00002-of-00003.safetensors: 12%|█▏ | 1.22G/9.90G [00:01<00:08, 1.05GB/s] model-00002-of-00003.safetensors: 14%|█▎ | 1.35G/9.90G [00:02<00:09, 907MB/s] model-00002-of-00003.safetensors: 15%|█▍ | 1.47G/9.90G [00:02<00:08, 943MB/s] model-00002-of-00003.safetensors: 16%|█▌ | 1.58G/9.90G [00:02<00:08, 948MB/s] model-00002-of-00003.safetensors: 18%|█▊ | 1.75G/9.90G [00:02<00:08, 1.01GB/s] model-00002-of-00003.safetensors: 19%|█▉ | 1.87G/9.90G [00:02<00:08, 983MB/s] model-00002-of-00003.safetensors: 20%|██ | 2.00G/9.90G [00:02<00:08, 976MB/s] model-00002-of-00003.safetensors: 21%|██▏ | 2.11G/9.90G [00:02<00:08, 907MB/s] model-00002-of-00003.safetensors: 22%|██▏ | 2.22G/9.90G [00:02<00:07, 965MB/s] model-00002-of-00003.safetensors: 25%|██▌ | 2.49G/9.90G [00:03<00:05, 1.34GB/s] model-00002-of-00003.safetensors: 27%|██▋ | 2.63G/9.90G [00:03<00:06, 1.15GB/s] model-00002-of-00003.safetensors: 28%|██▊ | 2.77G/9.90G [00:03<00:06, 1.05GB/s] model-00002-of-00003.safetensors: 30%|██▉ | 2.97G/9.90G [00:03<00:05, 1.26GB/s] model-00002-of-00003.safetensors: 31%|███▏ | 3.10G/9.90G [00:03<00:05, 1.18GB/s] model-00002-of-00003.safetensors: 33%|███▎ | 3.23G/9.90G [00:03<00:06, 1.07GB/s] model-00002-of-00003.safetensors: 35%|███▌ | 3.51G/9.90G [00:04<00:05, 1.19GB/s] model-00002-of-00003.safetensors: 37%|███▋ | 3.66G/9.90G [00:04<00:05, 1.22GB/s] model-00002-of-00003.safetensors: 39%|███▉ | 3.87G/9.90G [00:04<00:04, 1.41GB/s] model-00002-of-00003.safetensors: 41%|████ | 4.03G/9.90G [00:04<00:04, 1.41GB/s] model-00002-of-00003.safetensors: 42%|████▏ | 4.17G/9.90G [00:04<00:04, 1.15GB/s] model-00002-of-00003.safetensors: 43%|████▎ | 4.30G/9.90G [00:04<00:05, 995MB/s] model-00002-of-00003.safetensors: 45%|████▍ | 4.41G/9.90G [00:04<00:06, 876MB/s] model-00002-of-00003.safetensors: 46%|████▌ | 4.52G/9.90G [00:04<00:06, 887MB/s] model-00002-of-00003.safetensors: 47%|████▋ | 4.69G/9.90G [00:05<00:04, 1.05GB/s] model-00002-of-00003.safetensors: 48%|████▊ | 4.80G/9.90G [00:05<00:06, 805MB/s] model-00002-of-00003.safetensors: 50%|█████ | 4.97G/9.90G [00:05<00:05, 956MB/s] model-00002-of-00003.safetensors: 51%|█████▏ | 5.09G/9.90G [00:05<00:04, 985MB/s] model-00002-of-00003.safetensors: 53%|█████▎ | 5.21G/9.90G [00:05<00:04, 1.05GB/s] model-00002-of-00003.safetensors: 54%|█████▍ | 5.33G/9.90G [00:05<00:04, 1.02GB/s] model-00002-of-00003.safetensors: 56%|█████▌ | 5.54G/9.90G [00:05<00:03, 1.20GB/s] model-00002-of-00003.safetensors: 57%|█████▋ | 5.66G/9.90G [00:06<00:04, 1.00GB/s] model-00002-of-00003.safetensors: 58%|█████▊ | 5.78G/9.90G [00:06<00:04, 945MB/s] model-00002-of-00003.safetensors: 60%|██████ | 5.99G/9.90G [00:06<00:03, 1.20GB/s] model-00002-of-00003.safetensors: 62%|██████▏ | 6.12G/9.90G [00:06<00:03, 1.11GB/s] model-00002-of-00003.safetensors: 63%|██████▎ | 6.25G/9.90G [00:06<00:03, 994MB/s] model-00002-of-00003.safetensors: 65%|██████▌ | 6.46G/9.90G [00:06<00:02, 1.22GB/s] model-00002-of-00003.safetensors: 67%|██████▋ | 6.65G/9.90G [00:06<00:02, 1.24GB/s] model-00002-of-00003.safetensors: 69%|██████▊ | 6.79G/9.90G [00:07<00:02, 1.26GB/s] model-00002-of-00003.safetensors: 70%|██████▉ | 6.93G/9.90G [00:07<00:02, 1.15GB/s] model-00002-of-00003.safetensors: 72%|███████▏ | 7.09G/9.90G [00:07<00:02, 1.16GB/s] model-00002-of-00003.safetensors: 73%|███████▎ | 7.27G/9.90G [00:07<00:02, 1.29GB/s] model-00002-of-00003.safetensors: 75%|███████▍ | 7.40G/9.90G [00:07<00:02, 1.18GB/s] model-00002-of-00003.safetensors: 76%|███████▌ | 7.53G/9.90G [00:07<00:02, 1.06GB/s] model-00002-of-00003.safetensors: 77%|███████▋ | 7.64G/9.90G [00:07<00:02, 1.08GB/s] model-00002-of-00003.safetensors: 78%|███████▊ | 7.76G/9.90G [00:07<00:02, 1.02GB/s] model-00002-of-00003.safetensors: 80%|███████▉ | 7.90G/9.90G [00:08<00:01, 1.04GB/s] model-00002-of-00003.safetensors: 82%|████████▏ | 8.15G/9.90G [00:08<00:01, 1.30GB/s] model-00002-of-00003.safetensors: 84%|████████▍ | 8.34G/9.90G [00:08<00:01, 1.44GB/s] model-00002-of-00003.safetensors: 86%|████████▌ | 8.48G/9.90G [00:08<00:01, 1.30GB/s] model-00002-of-00003.safetensors: 87%|████████▋ | 8.62G/9.90G [00:08<00:01, 1.17GB/s] model-00002-of-00003.safetensors: 88%|████████▊ | 8.75G/9.90G [00:08<00:01, 1.03GB/s] model-00002-of-00003.safetensors: 90%|████████▉ | 8.89G/9.90G [00:08<00:00, 1.06GB/s] model-00002-of-00003.safetensors: 91%|█████████ | 9.01G/9.90G [00:09<00:00, 1.03GB/s] model-00002-of-00003.safetensors: 92%|█████████▏| 9.15G/9.90G [00:09<00:00, 1.11GB/s] model-00002-of-00003.safetensors: 94%|█████████▎| 9.27G/9.90G [00:09<00:00, 1.11GB/s] model-00002-of-00003.safetensors: 95%|█████████▍| 9.40G/9.90G [00:09<00:00, 1.14GB/s] model-00002-of-00003.safetensors: 96%|█████████▌| 9.53G/9.90G [00:09<00:00, 1.06GB/s] model-00002-of-00003.safetensors: 97%|█████████▋| 9.64G/9.90G [00:09<00:00, 1.06GB/s] model-00002-of-00003.safetensors: 99%|█████████▊| 9.76G/9.90G [00:09<00:00, 807MB/s] model-00002-of-00003.safetensors: 99%|█████████▉| 9.85G/9.90G [00:10<00:00, 670MB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 9.90G/9.90G [00:12<00:00, 804MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: model-00003-of-00003.safetensors: 0%| | 0.00/6.18G [00:00<?, ?B/s] model-00003-of-00003.safetensors: 0%| | 10.5M/6.18G [00:00<02:51, 36.0MB/s] model-00003-of-00003.safetensors: 1%| | 73.4M/6.18G [00:00<00:28, 218MB/s] model-00003-of-00003.safetensors: 2%|▏ | 115M/6.18G [00:00<00:23, 254MB/s] model-00003-of-00003.safetensors: 3%|▎ | 157M/6.18G [00:00<00:20, 299MB/s] model-00003-of-00003.safetensors: 4%|▍ | 252M/6.18G [00:00<00:13, 456MB/s] model-00003-of-00003.safetensors: 6%|▌ | 346M/6.18G [00:00<00:10, 572MB/s] model-00003-of-00003.safetensors: 7%|▋ | 461M/6.18G [00:00<00:07, 731MB/s] model-00003-of-00003.safetensors: 9%|▉ | 577M/6.18G [00:01<00:06, 810MB/s] model-00003-of-00003.safetensors: 11%|█ | 671M/6.18G [00:01<00:06, 821MB/s] model-00003-of-00003.safetensors: 13%|█▎ | 776M/6.18G [00:01<00:06, 876MB/s] model-00003-of-00003.safetensors: 15%|█▍ | 902M/6.18G [00:01<00:05, 969MB/s] model-00003-of-00003.safetensors: 16%|█▋ | 1.01G/6.18G [00:01<00:05, 972MB/s] model-00003-of-00003.safetensors: 18%|█▊ | 1.11G/6.18G [00:01<00:05, 991MB/s] model-00003-of-00003.safetensors: 20%|██ | 1.26G/6.18G [00:01<00:04, 1.11GB/s] model-00003-of-00003.safetensors: 23%|██▎ | 1.39G/6.18G [00:01<00:04, 1.17GB/s] model-00003-of-00003.safetensors: 25%|██▍ | 1.52G/6.18G [00:01<00:04, 1.05GB/s] model-00003-of-00003.safetensors: 27%|██▋ | 1.65G/6.18G [00:02<00:04, 1.08GB/s] model-00003-of-00003.safetensors: 29%|██▊ | 1.77G/6.18G [00:02<00:03, 1.12GB/s] model-00003-of-00003.safetensors: 31%|███ | 1.89G/6.18G [00:02<00:04, 994MB/s] model-00003-of-00003.safetensors: 32%|███▏ | 1.99G/6.18G [00:02<00:04, 935MB/s] model-00003-of-00003.safetensors: 34%|███▍ | 2.10G/6.18G [00:02<00:06, 665MB/s] model-00003-of-00003.safetensors: 35%|███▌ | 2.18G/6.18G [00:02<00:06, 660MB/s] model-00003-of-00003.safetensors: 37%|███▋ | 2.29G/6.18G [00:03<00:05, 700MB/s] model-00003-of-00003.safetensors: 38%|███▊ | 2.37G/6.18G [00:03<00:05, 724MB/s] model-00003-of-00003.safetensors: 40%|███▉ | 2.45G/6.18G [00:03<00:07, 525MB/s] model-00003-of-00003.safetensors: 41%|████ | 2.53G/6.18G [00:03<00:07, 517MB/s] model-00003-of-00003.safetensors: 42%|████▏ | 2.59G/6.18G [00:03<00:06, 533MB/s] model-00003-of-00003.safetensors: 43%|████▎ | 2.65G/6.18G [00:03<00:06, 547MB/s] model-00003-of-00003.safetensors: 44%|████▍ | 2.73G/6.18G [00:03<00:05, 583MB/s] model-00003-of-00003.safetensors: 45%|████▌ | 2.79G/6.18G [00:03<00:05, 573MB/s] model-00003-of-00003.safetensors: 46%|████▌ | 2.85G/6.18G [00:04<00:07, 441MB/s] model-00003-of-00003.safetensors: 48%|████▊ | 2.96G/6.18G [00:04<00:05, 560MB/s] model-00003-of-00003.safetensors: 49%|████▉ | 3.03G/6.18G [00:04<00:05, 586MB/s] model-00003-of-00003.safetensors: 50%|█████ | 3.10G/6.18G [00:04<00:06, 495MB/s] model-00003-of-00003.safetensors: 51%|█████ | 3.17G/6.18G [00:04<00:06, 459MB/s] model-00003-of-00003.safetensors: 53%|█████▎ | 3.26G/6.18G [00:04<00:05, 546MB/s] model-00003-of-00003.safetensors: 54%|█████▍ | 3.33G/6.18G [00:05<00:05, 561MB/s] model-00003-of-00003.safetensors: 56%|█████▌ | 3.44G/6.18G [00:05<00:04, 619MB/s] model-00003-of-00003.safetensors: 57%|█████▋ | 3.52G/6.18G [00:05<00:04, 617MB/s] model-00003-of-00003.safetensors: 58%|█████▊ | 3.60G/6.18G [00:05<00:05, 490MB/s] model-00003-of-00003.safetensors: 60%|█████▉ | 3.69G/6.18G [00:05<00:04, 581MB/s] model-00003-of-00003.safetensors: 61%|██████ | 3.76G/6.18G [00:05<00:04, 579MB/s] model-00003-of-00003.safetensors: 63%|██████▎ | 3.87G/6.18G [00:05<00:03, 645MB/s] model-00003-of-00003.safetensors: 64%|██████▍ | 3.95G/6.18G [00:06<00:03, 691MB/s] model-00003-of-00003.safetensors: 65%|██████▌ | 4.03G/6.18G [00:06<00:03, 575MB/s] model-00003-of-00003.safetensors: 67%|██████▋ | 4.12G/6.18G [00:06<00:03, 564MB/s] model-00003-of-00003.safetensors: 68%|██████▊ | 4.22G/6.18G [00:06<00:03, 617MB/s] model-00003-of-00003.safetensors: 69%|██████▉ | 4.29G/6.18G [00:06<00:03, 500MB/s] model-00003-of-00003.safetensors: 71%|███████ | 4.37G/6.18G [00:06<00:03, 565MB/s] model-00003-of-00003.safetensors: 73%|███████▎ | 4.49G/6.18G [00:06<00:02, 694MB/s] model-00003-of-00003.safetensors: 74%|███████▍ | 4.57G/6.18G [00:07<00:02, 630MB/s] model-00003-of-00003.safetensors: 75%|███████▌ | 4.66G/6.18G [00:07<00:02, 650MB/s] model-00003-of-00003.safetensors: 77%|███████▋ | 4.73G/6.18G [00:07<00:02, 637MB/s] model-00003-of-00003.safetensors: 78%|███████▊ | 4.80G/6.18G [00:07<00:02, 588MB/s] model-00003-of-00003.safetensors: 80%|████████ | 4.95G/6.18G [00:07<00:01, 737MB/s] model-00003-of-00003.safetensors: 82%|████████▏ | 5.05G/6.18G [00:07<00:01, 806MB/s] model-00003-of-00003.safetensors: 84%|████████▍ | 5.19G/6.18G [00:07<00:01, 936MB/s] model-00003-of-00003.safetensors: 88%|████████▊ | 5.41G/6.18G [00:07<00:00, 1.25GB/s] model-00003-of-00003.safetensors: 90%|████████▉ | 5.55G/6.18G [00:08<00:00, 1.24GB/s] model-00003-of-00003.safetensors: 92%|█████████▏| 5.69G/6.18G [00:08<00:00, 1.21GB/s] model-00003-of-00003.safetensors: 94%|█████████▍| 5.81G/6.18G [00:08<00:00, 708MB/s] model-00003-of-00003.safetensors: 96%|█████████▌| 5.92G/6.18G [00:08<00:00, 756MB/s] model-00003-of-00003.safetensors: 97%|█████████▋| 6.02G/6.18G [00:08<00:00, 807MB/s] model-00003-of-00003.safetensors: 99%|█████████▉| 6.13G/6.18G [00:08<00:00, 844MB/s] model-00003-of-00003.safetensors: 100%|█████████▉| 6.18G/6.18G [00:09<00:00, 628MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: model.safetensors.index.json: 0%| | 0.00/28.4k [00:00<?, ?B/s] model.safetensors.index.json: 100%|██████████| 28.4k/28.4k [00:00<00:00, 9.60MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: special_tokens_map.json: 0%| | 0.00/549 [00:00<?, ?B/s] special_tokens_map.json: 100%|██████████| 549/549 [00:00<00:00, 4.06MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: tokenizer.json: 0%| | 0.00/1.84M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 5.73MB/s] tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 5.72MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: tokenizer.model: 0%| | 0.00/500k [00:00<?, ?B/s] tokenizer.model: 100%|██████████| 500k/500k [00:00<00:00, 7.35MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: tokenizer_config.json: 0%| | 0.00/1.12k [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 1.12k/1.12k [00:00<00:00, 9.30MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Downloaded to shared memory in 43.867s
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: quantizing model to /dev/shm/model_cache
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Saving mkml model at /dev/shm/model_cache
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Reading /tmp/tmp7kiiumon/model.safetensors.index.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: quantized model in 26.097s
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Processed model hflserdaniel/chai_s6_13b_slp3 in 71.553s
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: creating bucket guanaco-mkml-models
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16/config.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16/tokenizer_config.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16/special_tokens_map.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16/tokenizer.model
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /dev/shm/model_cache/added_tokens.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16/added_tokens.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16/tokenizer.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/hflserdaniel-chai-s6-13-2318-v16/mkml_model.tensors
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: loading reward model from rirv938/reward_gpt2_medium_preference_24m_e2
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: warnings.warn(
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: config.json: 0%| | 0.00/1.05k [00:00<?, ?B/s] config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 12.9MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: warnings.warn(
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: tokenizer_config.json: 0%| | 0.00/234 [00:00<?, ?B/s] tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 3.22MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: vocab.json: 0%| | 0.00/1.04M [00:00<?, ?B/s] vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 17.2MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s] tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 31.1MB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: warnings.warn(
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: pytorch_model.bin: 0%| | 0.00/1.44G [00:00<?, ?B/s] pytorch_model.bin: 1%|▏ | 21.0M/1.44G [00:00<00:08, 169MB/s] pytorch_model.bin: 3%|▎ | 41.9M/1.44G [00:00<00:12, 111MB/s] pytorch_model.bin: 20%|██ | 294M/1.44G [00:00<00:01, 845MB/s] pytorch_model.bin: 33%|███▎ | 472M/1.44G [00:00<00:00, 1.13GB/s] pytorch_model.bin: 43%|████▎ | 619M/1.44G [00:00<00:00, 1.08GB/s] pytorch_model.bin: 52%|█████▏ | 753M/1.44G [00:00<00:00, 1.10GB/s] pytorch_model.bin: 63%|██████▎ | 910M/1.44G [00:00<00:00, 1.20GB/s] pytorch_model.bin: 78%|███████▊ | 1.13G/1.44G [00:01<00:00, 1.46GB/s] pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:01<00:00, 1.46GB/s] pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:01<00:00, 1.12GB/s]
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Saving duration: 0.228s
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Processed model rirv938/reward_gpt2_medium_preference_24m_e2 in 4.451s
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: creating bucket guanaco-reward-models
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: Bucket 's3://guanaco-reward-models/' created
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward/config.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward/special_tokens_map.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward/merges.txt
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward/tokenizer_config.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward/tokenizer.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward/vocab.json
hflserdaniel-chai-s6-13-2318-v16-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/hflserdaniel-chai-s6-13-2318-v16_reward/reward.tensors
Job hflserdaniel-chai-s6-13-2318-v16-mkmlizer completed after 245.11s with status: succeeded
Stopping job with name hflserdaniel-chai-s6-13-2318-v16-mkmlizer
Pipeline stage MKMLizer completed in 245.65s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.14s
Running pipeline stage ISVCDeployer
Creating inference service hflserdaniel-chai-s6-13-2318-v16
Waiting for inference service hflserdaniel-chai-s6-13-2318-v16 to be ready
Inference service hflserdaniel-chai-s6-13-2318-v16 ready after 40.36924624443054s
Pipeline stage ISVCDeployer completed in 46.14s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.42978835105896s
Received healthy response to inference request in 2.1430411338806152s
Received healthy response to inference request in 2.8064451217651367s
Received healthy response to inference request in 2.5608983039855957s
Received healthy response to inference request in 2.30237078666687s
5 requests
0 failed requests
5th percentile: 2.1749070644378663
10th percentile: 2.2067729949951174
20th percentile: 2.270504856109619
30th percentile: 2.327854299545288
40th percentile: 2.378821325302124
50th percentile: 2.42978835105896
60th percentile: 2.4822323322296143
70th percentile: 2.5346763134002686
80th percentile: 2.610007667541504
90th percentile: 2.7082263946533205
95th percentile: 2.7573357582092286
99th percentile: 2.796623249053955
mean time: 2.4485087394714355
Pipeline stage StressChecker completed in 13.12s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.04s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.04s
M-Eval Dataset for topic stay_in_character is loaded
hflserdaniel-chai-s6-13_2318_v16 status is now deployed due to DeploymentManager action
hflserdaniel-chai-s6-13_2318_v16 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics