submission_id: roleplay4fun-staticpunch-v1-0_v3
developer_uid: gau
status: torndown
model_repo: roleplay4fun/staticpunch-v1.0
reward_repo: roleplay4fun/picky-v1.0
generation_params: {'temperature': 1.1, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 20, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "### Instruction:\nAs the assistant, your task is to fully embody the given character, creating immersive, captivating narratives. Stay true to the character's personality and background, generating responses that not only reflect their core traits but are also accurate to their character. Your responses should evoke emotion, suspense, and anticipation in the user. The more detailed and descriptive your response, the more vivid the narrative becomes. Aim to create a fertile environment for ongoing interaction – introduce new elements, offer choices, or ask questions to invite the user to participate more fully in the conversation. This conversation is a dance, always continuing, always evolving.\nYour character: {bot_name}.\nContext: {memory}\n", 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2024-01-08T08:32:42+00:00
model_name: roleplay4fun-staticpunch-v1-0_v3
model_eval_status: success
model_group: roleplay4fun/staticpunch
num_battles: 21288
num_wins: 9926
celo_rating: 1127.66
propriety_score: 0.0
propriety_total_count: 0.0
submission_type: basic
model_architecture: None
model_num_parameters: None
best_of: 4
max_input_tokens: 1024
max_output_tokens: 64
display_name: roleplay4fun-staticpunch-v1-0_v3
ineligible_reason: propriety_total_count < 800
language_model: roleplay4fun/staticpunch-v1.0
model_size: NoneB
reward_model: roleplay4fun/picky-v1.0
us_pacific_date: 2024-01-08
win_ratio: 0.46627207816610294
preference_data_url: None
Resubmit model
Running pipeline stage MKMLizer
Starting job with name roleplay4fun-staticpunch-v1-0-v3-mkmlizer
Waiting for job on roleplay4fun-staticpunch-v1-0-v3-mkmlizer to finish
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║   _______ __  __ _______ _____                                      ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  |   |   |  |/  |   |   |     |_                                    ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  |       |     <|       |       |                                   ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  |__|_|__|__|\__|__|_|__|_______|                                   ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║                                                                     ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║                                                                     ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  belonging to:                                                      ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║                                                                     ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  Chai Research Corp.                                                ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║  Expiration: 2024-04-15 23:59:59                                    ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ║                                                                     ║
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
tokenizer.model:   0%|          | 0.00/500k [00:00<?, ?B/s]
tokenizer.model: 100%|██████████| 500k/500k [00:00<00:00, 58.9MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
tokenizer.json:   0%|          | 0.00/1.84M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 16.0MB/s]
tokenizer.json: 100%|██████████| 1.84M/1.84M [00:00<00:00, 15.9MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
added_tokens.json:   0%|          | 0.00/21.0 [00:00<?, ?B/s]
added_tokens.json: 100%|██████████| 21.0/21.0 [00:00<00:00, 175kB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/552 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 552/552 [00:00<00:00, 3.93MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
roleplay4fun-staticpunch-v1-0-v3-mkmlizer:   warnings.warn(
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model.safetensors.index.json:   0%|          | 0.00/29.9k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 29.9k/29.9k [00:00<00:00, 170MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Downloading shards:   0%|          | 0/6 [00:00<?, ?it/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:   0%|          | 0.00/4.98G [00:00<?, ?B/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:   0%|          | 10.5M/4.98G [00:01<10:27, 7.92MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:   1%|          | 31.5M/4.98G [00:03<08:01, 10.3MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:   1%|▏         | 62.9M/4.98G [00:03<03:16, 25.1MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:   4%|▍         | 189M/4.98G [00:03<00:45, 105MB/s]  
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  17%|█▋        | 828M/4.98G [00:03<00:06, 639MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  24%|██▎       | 1.17G/4.98G [00:03<00:04, 906MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  29%|██▉       | 1.44G/4.98G [00:04<00:05, 594MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  33%|███▎      | 1.63G/4.98G [00:04<00:06, 526MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  36%|███▌      | 1.77G/4.98G [00:05<00:05, 546MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  38%|███▊      | 1.89G/4.98G [00:05<00:05, 599MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  40%|████      | 2.00G/4.98G [00:05<00:04, 600MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  43%|████▎     | 2.14G/4.98G [00:05<00:04, 700MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  45%|████▌     | 2.25G/4.98G [00:05<00:03, 759MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  48%|████▊     | 2.37G/4.98G [00:05<00:03, 679MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  49%|████▉     | 2.46G/4.98G [00:06<00:04, 556MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  52%|█████▏    | 2.57G/4.98G [00:06<00:04, 580MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  53%|█████▎    | 2.64G/4.98G [00:06<00:04, 535MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  57%|█████▋    | 2.83G/4.98G [00:06<00:02, 772MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  63%|██████▎   | 3.14G/4.98G [00:06<00:01, 1.22GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  66%|██████▌   | 3.29G/4.98G [00:06<00:01, 913MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  70%|██████▉   | 3.46G/4.98G [00:07<00:01, 1.02GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  72%|███████▏  | 3.60G/4.98G [00:07<00:01, 989MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  76%|███████▌  | 3.79G/4.98G [00:07<00:01, 1.12GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  79%|███████▉  | 3.92G/4.98G [00:07<00:01, 1.04GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  81%|████████▏ | 4.05G/4.98G [00:07<00:01, 831MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  83%|████████▎ | 4.15G/4.98G [00:07<00:00, 868MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  86%|████████▌ | 4.29G/4.98G [00:07<00:00, 964MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  89%|████████▊ | 4.41G/4.98G [00:08<00:00, 1.03GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00001-of-00006.safetensors:  94%|█████████▍| 4.70G/4.98G [00:08<00:00, 1.35GB/s]
model-00001-of-00006.safetensors: 100%|█████████▉| 4.98G/4.98G [00:08<00:00, 596MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:   0%|          | 21.0M/4.97G [00:02<07:54, 10.4MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:   1%|▏         | 62.9M/4.97G [00:02<02:50, 28.8MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:   3%|▎         | 136M/4.97G [00:03<01:02, 77.9MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:   6%|▌         | 283M/4.97G [00:03<00:23, 203MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  18%|█▊        | 870M/4.97G [00:03<00:04, 850MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  23%|██▎       | 1.14G/4.97G [00:03<00:03, 1.11GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  28%|██▊       | 1.39G/4.97G [00:03<00:03, 1.03GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  32%|███▏      | 1.60G/4.97G [00:03<00:03, 884MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  35%|███▌      | 1.76G/4.97G [00:04<00:04, 786MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  38%|███▊      | 1.90G/4.97G [00:04<00:05, 604MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  40%|████      | 2.00G/4.97G [00:04<00:05, 590MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  42%|████▏     | 2.10G/4.97G [00:05<00:04, 591MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  44%|████▍     | 2.18G/4.97G [00:05<00:04, 612MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  46%|████▌     | 2.26G/4.97G [00:05<00:05, 535MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  47%|████▋     | 2.34G/4.97G [00:05<00:07, 360MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  49%|████▊     | 2.42G/4.97G [00:05<00:06, 422MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  52%|█████▏    | 2.59G/4.97G [00:06<00:03, 620MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  56%|█████▌    | 2.78G/4.97G [00:06<00:02, 853MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  60%|█████▉    | 2.98G/4.97G [00:06<00:01, 1.09GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  64%|██████▍   | 3.18G/4.97G [00:06<00:01, 1.29GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  67%|██████▋   | 3.34G/4.97G [00:06<00:01, 839MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  70%|██████▉   | 3.47G/4.97G [00:06<00:01, 789MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  72%|███████▏  | 3.59G/4.97G [00:07<00:01, 817MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  76%|███████▌  | 3.77G/4.97G [00:07<00:01, 1.01GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  79%|███████▉  | 3.93G/4.97G [00:07<00:00, 1.13GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  82%|████████▏ | 4.10G/4.97G [00:07<00:00, 1.22GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  86%|████████▌ | 4.26G/4.97G [00:07<00:00, 1.30GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  89%|████████▊ | 4.40G/4.97G [00:07<00:00, 1.02GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00002-of-00006.safetensors:  94%|█████████▍| 4.67G/4.97G [00:07<00:00, 1.37GB/s]
model-00002-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:07<00:00, 632MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Downloading shards:  33%|███▎      | 2/6 [00:16<00:33,  8.36s/it]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:   0%|          | 0.00/4.97G [00:00<?, ?B/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:   0%|          | 10.5M/4.97G [00:01<14:46, 5.60MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:   0%|          | 21.0M/4.97G [00:02<07:18, 11.3MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:   1%|          | 52.4M/4.97G [00:02<03:29, 23.4MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:   2%|▏         | 94.4M/4.97G [00:03<01:34, 51.4MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:   8%|▊         | 388M/4.97G [00:03<00:14, 316MB/s]  
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:  22%|██▏       | 1.10G/4.97G [00:03<00:03, 1.09GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:  83%|████████▎ | 4.13G/4.97G [00:07<00:00, 920MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:  85%|████████▌ | 4.25G/4.97G [00:07<00:00, 759MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:  88%|████████▊ | 4.35G/4.97G [00:07<00:00, 799MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00003-of-00006.safetensors:  96%|█████████▌| 4.78G/4.97G [00:07<00:00, 1.49GB/s]
model-00003-of-00006.safetensors: 100%|█████████▉| 4.97G/4.97G [00:07<00:00, 641MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Downloading shards:  50%|█████     | 3/6 [00:24<00:24,  8.24s/it]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:   0%|          | 0.00/4.93G [00:00<?, ?B/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:   0%|          | 10.5M/4.93G [00:02<16:38, 4.93MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:   0%|          | 21.0M/4.93G [00:02<07:31, 10.9MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:   1%|          | 41.9M/4.93G [00:02<04:11, 19.5MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:   1%|▏         | 62.9M/4.93G [00:03<02:43, 29.7MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:   4%|▍         | 210M/4.93G [00:03<00:30, 155MB/s]  
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  22%|██▏       | 1.09G/4.93G [00:03<00:03, 1.09GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  28%|██▊       | 1.38G/4.93G [00:03<00:03, 896MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  33%|███▎      | 1.60G/4.93G [00:04<00:04, 706MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  36%|███▌      | 1.77G/4.93G [00:04<00:04, 659MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  39%|███▊      | 1.91G/4.93G [00:05<00:05, 571MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  41%|████      | 2.01G/4.93G [00:05<00:05, 568MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  43%|████▎     | 2.11G/4.93G [00:05<00:06, 408MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  44%|████▍     | 2.18G/4.93G [00:05<00:07, 390MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  45%|████▌     | 2.24G/4.93G [00:06<00:06, 392MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  50%|████▉     | 2.44G/4.93G [00:06<00:04, 603MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  57%|█████▋    | 2.79G/4.93G [00:06<00:02, 1.06GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  62%|██████▏   | 3.04G/4.93G [00:06<00:01, 1.33GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  66%|██████▌   | 3.24G/4.93G [00:06<00:01, 1.25GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  69%|██████▉   | 3.42G/4.93G [00:06<00:01, 1.30GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  73%|███████▎  | 3.59G/4.93G [00:06<00:01, 1.19GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  76%|███████▌  | 3.73G/4.93G [00:07<00:01, 1.07GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  79%|███████▉  | 3.90G/4.93G [00:07<00:00, 1.13GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  82%|████████▏ | 4.04G/4.93G [00:07<00:00, 1.03GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  84%|████████▍ | 4.16G/4.93G [00:07<00:00, 1.04GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  87%|████████▋ | 4.28G/4.93G [00:07<00:00, 794MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00004-of-00006.safetensors:  92%|█████████▏| 4.55G/4.93G [00:07<00:00, 1.14GB/s]
model-00004-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:08<00:00, 616MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Downloading shards:  67%|██████▋   | 4/6 [00:33<00:16,  8.32s/it]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:   0%|          | 21.0M/4.93G [00:02<07:15, 11.3MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:   1%|          | 31.5M/4.93G [00:02<06:00, 13.6MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:   4%|▍         | 189M/4.93G [00:02<00:35, 132MB/s]  
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:   5%|▍         | 241M/4.93G [00:03<00:29, 161MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  13%|█▎        | 650M/4.93G [00:03<00:06, 619MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  22%|██▏       | 1.08G/4.93G [00:03<00:03, 1.13GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  27%|██▋       | 1.32G/4.93G [00:03<00:02, 1.26GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  31%|███       | 1.54G/4.93G [00:03<00:04, 735MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  35%|███▍      | 1.71G/4.93G [00:04<00:06, 486MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  37%|███▋      | 1.84G/4.93G [00:04<00:05, 531MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  40%|███▉      | 1.95G/4.93G [00:04<00:05, 570MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  42%|████▏     | 2.07G/4.93G [00:05<00:04, 642MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  44%|████▍     | 2.17G/4.93G [00:05<00:05, 481MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  46%|████▌     | 2.25G/4.93G [00:05<00:05, 480MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  47%|████▋     | 2.33G/4.93G [00:05<00:05, 497MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  50%|████▉     | 2.44G/4.93G [00:05<00:04, 596MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  52%|█████▏    | 2.59G/4.93G [00:06<00:03, 760MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  58%|█████▊    | 2.87G/4.93G [00:06<00:01, 1.20GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  64%|██████▍   | 3.16G/4.93G [00:06<00:01, 1.57GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  68%|██████▊   | 3.36G/4.93G [00:06<00:01, 1.02GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  71%|███████   | 3.51G/4.93G [00:06<00:01, 960MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  74%|███████▍  | 3.65G/4.93G [00:06<00:01, 854MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  78%|███████▊  | 3.84G/4.93G [00:07<00:01, 982MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  80%|████████  | 3.96G/4.93G [00:07<00:01, 969MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  84%|████████▍ | 4.16G/4.93G [00:07<00:00, 1.16GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  88%|████████▊ | 4.32G/4.93G [00:07<00:00, 1.25GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  91%|█████████ | 4.48G/4.93G [00:07<00:00, 1.31GB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00005-of-00006.safetensors:  96%|█████████▌| 4.73G/4.93G [00:07<00:00, 1.63GB/s]
model-00005-of-00006.safetensors: 100%|█████████▉| 4.93G/4.93G [00:07<00:00, 632MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Downloading shards:  83%|████████▎ | 5/6 [00:41<00:08,  8.26s/it]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00006-of-00006.safetensors:   0%|          | 0.00/1.25G [00:00<?, ?B/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00006-of-00006.safetensors:   1%|          | 10.5M/1.25G [00:01<03:47, 5.43MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00006-of-00006.safetensors:   2%|▏         | 21.0M/1.25G [00:02<02:04, 9.81MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00006-of-00006.safetensors:   3%|▎         | 31.5M/1.25G [00:03<01:47, 11.3MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00006-of-00006.safetensors:  12%|█▏        | 147M/1.25G [00:03<00:12, 86.1MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00006-of-00006.safetensors:  55%|█████▍    | 682M/1.25G [00:03<00:01, 536MB/s] 
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
model-00006-of-00006.safetensors:  90%|█████████ | 1.12G/1.25G [00:03<00:00, 939MB/s]
model-00006-of-00006.safetensors: 100%|█████████▉| 1.25G/1.25G [00:03<00:00, 332MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Downloading shards: 100%|██████████| 6/6 [00:45<00:00,  6.83s/it]
Downloading shards: 100%|██████████| 6/6 [00:45<00:00,  7.60s/it]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Loading checkpoint shards:   0%|          | 0/6 [00:00<?, ?it/s]
Loading checkpoint shards:  17%|█▋        | 1/6 [00:00<00:04,  1.07it/s]
Loading checkpoint shards:  33%|███▎      | 2/6 [00:01<00:03,  1.12it/s]
Loading checkpoint shards:  50%|█████     | 3/6 [00:02<00:02,  1.16it/s]
Loading checkpoint shards:  67%|██████▋   | 4/6 [00:03<00:01,  1.16it/s]
Loading checkpoint shards:  83%|████████▎ | 5/6 [00:04<00:00,  1.19it/s]
Loading checkpoint shards: 100%|██████████| 6/6 [00:04<00:00,  1.55it/s]
Loading checkpoint shards: 100%|██████████| 6/6 [00:04<00:00,  1.32it/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
generation_config.json:   0%|          | 0.00/154 [00:00<?, ?B/s]
generation_config.json: 100%|██████████| 154/154 [00:00<00:00, 1.95MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: loaded model in 52.857s
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: saved to disk in 88.610s
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: quantizing model to /tmp/model_cache
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: Saving mkml model at /tmp/model_cache
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: Reading /tmp/tmpmmiaokrq/model.safetensors.index.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
Profiling:   0%|          | 0/363 [00:00<?, ?it/s]
Profiling:   0%|          | 1/363 [00:01<11:20,  1.88s/it]
Profiling:   1%|          | 3/363 [00:02<05:11,  1.16it/s]
Profiling:   1%|          | 4/363 [00:03<05:29,  1.09it/s]
Profiling:   1%|▏         | 5/363 [00:04<05:48,  1.03it/s]
Profiling:   2%|▏         | 7/363 [00:05<03:38,  1.63it/s]
Profiling:   2%|▏         | 8/363 [00:05<03:17,  1.80it/s]
Profiling:   2%|▏         | 9/363 [00:06<03:04,  1.92it/s]
Profiling:   3%|▎         | 10/363 [00:06<02:50,  2.08it/s]
Profiling:   3%|▎         | 12/363 [00:07<03:03,  1.91it/s]
Profiling:   4%|▎         | 13/363 [00:08<03:50,  1.52it/s]
Profiling:   4%|▍         | 14/363 [00:09<04:29,  1.30it/s]
Profiling:   4%|▍         | 16/363 [00:10<03:02,  1.90it/s]
Profiling:   5%|▍         | 17/363 [00:10<02:50,  2.03it/s]
Profiling:   5%|▍         | 18/363 [00:11<02:41,  2.14it/s]
Profiling:   5%|▌         | 19/363 [00:11<02:35,  2.21it/s]
Profiling:   6%|▌         | 21/363 [00:12<02:58,  1.92it/s]
Profiling:   6%|▌         | 22/363 [00:14<04:05,  1.39it/s]
Profiling:   6%|▋         | 23/363 [00:15<04:32,  1.25it/s]
Profiling:   7%|▋         | 25/363 [00:15<03:03,  1.84it/s]
Profiling:   7%|▋         | 26/363 [00:15<02:49,  1.99it/s]
Profiling:   7%|▋         | 27/363 [00:16<02:38,  2.12it/s]
Profiling:   8%|▊         | 28/363 [00:16<02:30,  2.23it/s]
Profiling:   8%|▊         | 29/363 [00:17<02:25,  2.30it/s]
Profiling:   8%|▊         | 30/363 [00:17<02:21,  2.36it/s]
Profiling:   9%|▊         | 31/363 [00:17<02:18,  2.39it/s]
Profiling:   9%|▉         | 32/363 [00:18<02:15,  2.44it/s]
Profiling:   9%|▉         | 33/363 [00:18<01:55,  2.86it/s]
Profiling:   9%|▉         | 34/363 [00:19<03:07,  1.76it/s]
Profiling:  10%|▉         | 35/363 [00:20<03:54,  1.40it/s]
Profiling:  10%|▉         | 36/363 [00:21<04:30,  1.21it/s]
Profiling:  11%|█         | 39/363 [00:22<03:04,  1.76it/s]
Profiling:  11%|█         | 40/363 [00:23<03:41,  1.46it/s]
Profiling:  11%|█▏        | 41/363 [00:25<04:11,  1.28it/s]
Profiling:  12%|█▏        | 43/363 [00:25<03:00,  1.77it/s]
Profiling:  12%|█▏        | 44/363 [00:25<02:48,  1.90it/s]
Profiling:  12%|█▏        | 45/363 [00:26<02:35,  2.04it/s]
Profiling:  13%|█▎        | 46/363 [00:26<02:26,  2.16it/s]
Profiling:  13%|█▎        | 48/363 [00:27<02:39,  1.98it/s]
Profiling:  13%|█▎        | 49/363 [00:28<03:22,  1.55it/s]
Profiling:  14%|█▍        | 50/363 [00:29<03:50,  1.36it/s]
Profiling:  14%|█▍        | 52/363 [00:30<02:42,  1.91it/s]
Profiling:  15%|█▍        | 53/363 [00:30<02:36,  1.98it/s]
Profiling:  15%|█▍        | 54/363 [00:31<02:27,  2.10it/s]
Profiling:  15%|█▌        | 55/363 [00:31<02:19,  2.21it/s]
Profiling:  16%|█▌        | 57/363 [00:32<02:40,  1.90it/s]
Profiling:  16%|█▌        | 58/363 [00:33<03:21,  1.52it/s]
Profiling:  16%|█▋        | 59/363 [00:35<03:55,  1.29it/s]
Profiling:  17%|█▋        | 61/363 [00:35<02:47,  1.80it/s]
Profiling:  17%|█▋        | 62/363 [00:35<02:38,  1.90it/s]
Profiling:  17%|█▋        | 63/363 [00:36<02:25,  2.06it/s]
Profiling:  18%|█▊        | 64/363 [00:36<02:17,  2.17it/s]
Profiling:  18%|█▊        | 65/363 [00:37<02:12,  2.26it/s]
Profiling:  18%|█▊        | 66/363 [00:37<02:09,  2.30it/s]
Profiling:  18%|█▊        | 67/363 [00:38<02:10,  2.27it/s]
Profiling:  19%|█▊        | 68/363 [00:38<01:47,  2.75it/s]
Profiling:  19%|█▉        | 69/363 [00:39<02:48,  1.75it/s]
Profiling:  19%|█▉        | 70/363 [00:40<03:30,  1.39it/s]
Profiling:  20%|█▉        | 71/363 [00:41<03:59,  1.22it/s]
Profiling:  20%|██        | 73/363 [00:41<02:35,  1.86it/s]
Profiling:  20%|██        | 74/363 [00:42<02:24,  1.99it/s]
Profiling:  21%|██        | 75/363 [00:42<02:13,  2.15it/s]
Profiling:  21%|██        | 76/363 [00:42<02:10,  2.19it/s]
Profiling:  21%|██        | 77/363 [00:43<02:09,  2.21it/s]
Profiling:  21%|██▏       | 78/363 [00:43<02:09,  2.20it/s]
Profiling:  22%|██▏       | 80/363 [00:44<02:18,  2.05it/s]
Profiling:  22%|██▏       | 81/363 [00:45<02:53,  1.62it/s]
Profiling:  23%|██▎       | 82/363 [00:46<03:19,  1.41it/s]
Profiling:  23%|██▎       | 84/363 [00:47<02:19,  2.01it/s]
Profiling:  24%|██▎       | 86/363 [00:48<02:18,  2.01it/s]
Profiling:  24%|██▍       | 87/363 [00:49<02:47,  1.65it/s]
Profiling:  24%|██▍       | 88/363 [00:50<03:11,  1.44it/s]
Profiling:  25%|██▍       | 90/363 [00:50<02:12,  2.06it/s]
Profiling:  25%|██▌       | 91/363 [00:51<02:04,  2.19it/s]
Profiling:  25%|██▌       | 92/363 [00:51<01:58,  2.29it/s]
Profiling:  26%|██▌       | 93/363 [00:51<01:53,  2.38it/s]
Profiling:  26%|██▌       | 95/363 [00:52<02:10,  2.06it/s]
Profiling:  26%|██▋       | 96/363 [00:53<02:41,  1.65it/s]
Profiling:  27%|██▋       | 97/363 [00:54<03:04,  1.44it/s]
Profiling:  27%|██▋       | 99/363 [00:55<02:05,  2.10it/s]
Profiling:  28%|██▊       | 100/363 [00:55<01:56,  2.25it/s]
Profiling:  28%|██▊       | 101/363 [00:55<01:49,  2.39it/s]
Profiling:  28%|██▊       | 102/363 [00:56<01:44,  2.49it/s]
Profiling:  28%|██▊       | 103/363 [00:56<01:27,  2.97it/s]
Profiling:  29%|██▊       | 104/363 [00:57<02:16,  1.90it/s]
Profiling:  29%|██▉       | 105/363 [00:58<02:50,  1.52it/s]
Profiling:  29%|██▉       | 106/363 [00:59<03:16,  1.31it/s]
Profiling:  30%|██▉       | 108/363 [00:59<02:06,  2.01it/s]
Profiling:  30%|███       | 109/363 [01:00<01:56,  2.18it/s]
Profiling:  31%|███       | 111/363 [01:01<02:00,  2.10it/s]
Profiling:  31%|███       | 112/363 [01:02<02:29,  1.68it/s]
Profiling:  31%|███       | 113/363 [01:03<02:53,  1.44it/s]
Profiling:  32%|███▏      | 115/363 [01:03<02:02,  2.02it/s]
Profiling:  32%|███▏      | 116/363 [01:03<01:53,  2.17it/s]
Profiling:  32%|███▏      | 117/363 [01:04<01:45,  2.33it/s]
Profiling:  33%|███▎      | 118/363 [01:04<01:39,  2.45it/s]
Profiling:  33%|███▎      | 120/363 [01:05<01:50,  2.20it/s]
Profiling:  33%|███▎      | 121/363 [01:06<02:22,  1.70it/s]
Profiling:  34%|███▎      | 122/363 [01:07<02:48,  1.43it/s]
Profiling:  34%|███▍      | 124/363 [01:08<01:55,  2.08it/s]
Profiling:  34%|███▍      | 125/363 [01:08<01:47,  2.22it/s]
Profiling:  35%|███▍      | 126/363 [01:08<01:41,  2.33it/s]
Profiling:  35%|███▍      | 127/363 [01:09<01:36,  2.44it/s]
Profiling:  36%|███▌      | 129/363 [01:10<01:44,  2.23it/s]
Profiling:  36%|███▌      | 130/363 [01:11<02:11,  1.77it/s]
Profiling:  36%|███▌      | 131/363 [01:12<02:34,  1.50it/s]
Profiling:  37%|███▋      | 133/363 [01:12<01:45,  2.18it/s]
Profiling:  37%|███▋      | 134/363 [01:12<01:38,  2.32it/s]
Profiling:  37%|███▋      | 135/363 [01:13<01:33,  2.45it/s]
Profiling:  37%|███▋      | 136/363 [01:13<01:29,  2.54it/s]
Profiling:  38%|███▊      | 137/363 [01:13<01:27,  2.60it/s]
Profiling:  38%|███▊      | 138/363 [01:13<01:14,  3.03it/s]
Profiling:  38%|███▊      | 139/363 [01:15<02:01,  1.84it/s]
Profiling:  39%|███▊      | 140/363 [01:16<02:37,  1.42it/s]
Profiling:  39%|███▉      | 141/363 [01:17<03:08,  1.18it/s]
Profiling:  39%|███▉      | 143/363 [01:17<02:01,  1.82it/s]
Profiling:  40%|███▉      | 144/363 [01:18<01:51,  1.97it/s]
Profiling:  40%|███▉      | 145/363 [01:18<01:42,  2.12it/s]
Profiling:  40%|████      | 147/363 [01:19<01:48,  1.98it/s]
Profiling:  41%|████      | 148/363 [01:20<02:16,  1.57it/s]
Profiling:  41%|████      | 149/363 [01:21<02:39,  1.34it/s]
Profiling:  42%|████▏     | 151/363 [01:22<01:51,  1.90it/s]
Profiling:  42%|████▏     | 152/363 [01:22<01:46,  1.98it/s]
Profiling:  42%|████▏     | 153/363 [01:22<01:40,  2.09it/s]
Profiling:  42%|████▏     | 154/363 [01:23<01:34,  2.21it/s]
Profiling:  43%|████▎     | 156/363 [01:24<01:41,  2.04it/s]
Profiling:  43%|████▎     | 157/363 [01:25<02:05,  1.64it/s]
Profiling:  44%|████▎     | 158/363 [01:26<02:29,  1.37it/s]
Profiling:  44%|████▍     | 160/363 [01:26<01:42,  1.99it/s]
Profiling:  44%|████▍     | 161/363 [01:27<01:37,  2.07it/s]
Profiling:  45%|████▍     | 162/363 [01:27<01:30,  2.23it/s]
Profiling:  45%|████▍     | 163/363 [01:28<01:24,  2.36it/s]
Profiling:  45%|████▌     | 165/363 [01:29<01:30,  2.18it/s]
Profiling:  46%|████▌     | 166/363 [01:30<01:54,  1.72it/s]
Profiling:  46%|████▌     | 167/363 [01:30<02:14,  1.46it/s]
Profiling:  47%|████▋     | 169/363 [01:31<01:31,  2.12it/s]
Profiling:  47%|████▋     | 170/363 [01:31<01:25,  2.26it/s]
Profiling:  47%|████▋     | 171/363 [01:32<01:20,  2.40it/s]
Profiling:  47%|████▋     | 172/363 [01:32<01:16,  2.51it/s]
Profiling:  48%|████▊     | 173/363 [01:32<01:01,  3.07it/s]
Profiling:  48%|████▊     | 174/363 [01:33<01:37,  1.94it/s]
Profiling:  48%|████▊     | 175/363 [01:34<02:03,  1.52it/s]
Profiling:  48%|████▊     | 176/363 [01:35<02:23,  1.30it/s]
Profiling:  49%|████▉     | 178/363 [01:35<01:32,  1.99it/s]
Profiling:  49%|████▉     | 179/363 [01:36<01:28,  2.09it/s]
Profiling:  50%|████▉     | 180/363 [01:36<01:21,  2.24it/s]
Profiling:  50%|████▉     | 181/363 [01:37<01:17,  2.34it/s]
Profiling:  50%|█████     | 183/363 [01:38<01:27,  2.06it/s]
Profiling:  51%|█████     | 184/363 [01:39<01:52,  1.60it/s]
Profiling:  51%|█████     | 185/363 [01:40<02:11,  1.35it/s]
Profiling:  52%|█████▏    | 187/363 [01:40<01:31,  1.92it/s]
Profiling:  52%|█████▏    | 188/363 [01:41<01:24,  2.06it/s]
Profiling:  52%|█████▏    | 189/363 [01:41<01:19,  2.20it/s]
Profiling:  52%|█████▏    | 190/363 [01:41<01:16,  2.27it/s]
Profiling:  53%|█████▎    | 192/363 [01:43<01:23,  2.04it/s]
Profiling:  53%|█████▎    | 193/363 [01:43<01:43,  1.65it/s]
Profiling:  53%|█████▎    | 194/363 [01:44<01:58,  1.43it/s]
Profiling:  54%|█████▍    | 196/363 [01:45<01:20,  2.08it/s]
Profiling:  54%|█████▍    | 197/363 [01:45<01:16,  2.18it/s]
Profiling:  55%|█████▍    | 198/363 [01:46<01:13,  2.23it/s]
Profiling:  55%|█████▍    | 199/363 [01:46<01:12,  2.26it/s]
Profiling:  55%|█████▌    | 200/363 [01:47<01:39,  1.64it/s]
Profiling:  55%|█████▌    | 201/363 [01:48<01:58,  1.37it/s]
Profiling:  56%|█████▌    | 202/363 [01:49<01:40,  1.61it/s]
Profiling:  56%|█████▌    | 203/363 [01:49<01:26,  1.85it/s]
Profiling:  56%|█████▌    | 204/363 [01:49<01:17,  2.05it/s]
Profiling:  56%|█████▋    | 205/363 [01:50<01:10,  2.23it/s]
Profiling:  57%|█████▋    | 206/363 [01:50<00:56,  2.80it/s]
Profiling:  57%|█████▋    | 207/363 [01:51<01:27,  1.79it/s]
Profiling:  58%|█████▊    | 210/363 [01:52<01:05,  2.34it/s]
Profiling:  58%|█████▊    | 211/363 [01:53<01:21,  1.86it/s]
Profiling:  58%|█████▊    | 212/363 [01:54<01:38,  1.54it/s]
Profiling:  59%|█████▉    | 214/363 [01:54<01:09,  2.15it/s]
Profiling:  59%|█████▉    | 215/363 [01:54<01:07,  2.20it/s]
Profiling:  60%|█████▉    | 216/363 [01:55<01:05,  2.24it/s]
Profiling:  60%|█████▉    | 217/363 [01:55<01:03,  2.29it/s]
Profiling:  60%|██████    | 219/363 [01:56<01:08,  2.09it/s]
Profiling:  61%|██████    | 220/363 [01:57<01:22,  1.73it/s]
Profiling:  61%|██████    | 221/363 [01:58<01:37,  1.46it/s]
Profiling:  61%|██████▏   | 223/363 [01:59<01:08,  2.04it/s]
Profiling:  62%|██████▏   | 224/363 [01:59<01:06,  2.10it/s]
Profiling:  62%|██████▏   | 225/363 [02:00<01:03,  2.16it/s]
Profiling:  62%|██████▏   | 226/363 [02:00<01:02,  2.19it/s]
Profiling:  63%|██████▎   | 228/363 [02:01<01:06,  2.04it/s]
Profiling:  63%|██████▎   | 229/363 [02:02<01:21,  1.65it/s]
Profiling:  63%|██████▎   | 230/363 [02:03<01:32,  1.44it/s]
Profiling:  64%|██████▍   | 232/363 [02:03<01:04,  2.02it/s]
Profiling:  64%|██████▍   | 233/363 [02:04<01:02,  2.09it/s]
Profiling:  64%|██████▍   | 234/363 [02:04<00:57,  2.25it/s]
Profiling:  65%|██████▍   | 235/363 [02:05<00:54,  2.37it/s]
Profiling:  65%|██████▌   | 236/363 [02:06<01:14,  1.71it/s]
Profiling:  65%|██████▌   | 237/363 [02:06<01:05,  1.91it/s]
Profiling:  66%|██████▌   | 238/363 [02:06<00:58,  2.12it/s]
Profiling:  66%|██████▌   | 239/363 [02:07<00:53,  2.31it/s]
Profiling:  66%|██████▌   | 240/363 [02:07<00:50,  2.45it/s]
Profiling:  66%|██████▋   | 241/363 [02:07<00:40,  3.03it/s]
Profiling:  67%|██████▋   | 242/363 [02:08<01:04,  1.88it/s]
Profiling:  67%|██████▋   | 243/363 [02:09<01:19,  1.51it/s]
Profiling:  68%|██████▊   | 246/363 [02:10<00:55,  2.11it/s]
Profiling:  68%|██████▊   | 247/363 [02:11<01:08,  1.70it/s]
Profiling:  68%|██████▊   | 248/363 [02:12<01:20,  1.43it/s]
Profiling:  69%|██████▉   | 250/363 [02:13<00:57,  1.98it/s]
Profiling:  69%|██████▉   | 251/363 [02:13<00:54,  2.07it/s]
Profiling:  69%|██████▉   | 252/363 [02:13<00:49,  2.23it/s]
Profiling:  70%|██████▉   | 253/363 [02:14<00:46,  2.35it/s]
Profiling:  70%|███████   | 255/363 [02:15<00:50,  2.12it/s]
Profiling:  71%|███████   | 256/363 [02:16<01:02,  1.71it/s]
Profiling:  71%|███████   | 257/363 [02:17<01:14,  1.42it/s]
Profiling:  71%|███████▏  | 259/363 [02:17<00:51,  2.01it/s]
Profiling:  72%|███████▏  | 260/363 [02:18<00:48,  2.14it/s]
Profiling:  72%|███████▏  | 261/363 [02:18<00:44,  2.30it/s]
Profiling:  72%|███████▏  | 262/363 [02:18<00:43,  2.31it/s]
Profiling:  73%|███████▎  | 264/363 [02:19<00:48,  2.05it/s]
Profiling:  73%|███████▎  | 265/363 [02:20<00:59,  1.66it/s]
Profiling:  73%|███████▎  | 266/363 [02:21<01:08,  1.42it/s]
Profiling:  74%|███████▍  | 268/363 [02:22<00:46,  2.06it/s]
Profiling:  74%|███████▍  | 269/363 [02:22<00:42,  2.21it/s]
Profiling:  74%|███████▍  | 270/363 [02:23<00:39,  2.35it/s]
Profiling:  75%|███████▍  | 271/363 [02:23<00:37,  2.46it/s]
Profiling:  75%|███████▍  | 272/363 [02:23<00:36,  2.52it/s]
Profiling:  75%|███████▌  | 273/363 [02:24<00:34,  2.58it/s]
Profiling:  75%|███████▌  | 274/363 [02:24<00:33,  2.64it/s]
Profiling:  76%|███████▌  | 275/363 [02:24<00:32,  2.70it/s]
Profiling:  76%|███████▌  | 276/363 [02:24<00:26,  3.31it/s]
Profiling:  76%|███████▋  | 277/363 [02:25<00:42,  2.02it/s]
Profiling:  77%|███████▋  | 278/363 [02:26<00:53,  1.58it/s]
Profiling:  77%|███████▋  | 279/363 [02:27<01:01,  1.36it/s]
Profiling:  78%|███████▊  | 282/363 [02:28<00:41,  1.95it/s]
Profiling:  78%|███████▊  | 283/363 [02:29<00:49,  1.63it/s]
Profiling:  78%|███████▊  | 284/363 [02:30<00:55,  1.42it/s]
Profiling:  79%|███████▉  | 286/363 [02:31<00:37,  2.04it/s]
Profiling:  79%|███████▉  | 287/363 [02:31<00:34,  2.17it/s]
Profiling:  79%|███████▉  | 288/363 [02:31<00:33,  2.24it/s]
Profiling:  80%|███████▉  | 289/363 [02:32<00:31,  2.36it/s]
Profiling:  80%|████████  | 291/363 [02:33<00:33,  2.16it/s]
Profiling:  80%|████████  | 292/363 [02:34<00:41,  1.72it/s]
Profiling:  81%|████████  | 293/363 [02:35<00:47,  1.47it/s]
Profiling:  81%|████████▏ | 295/363 [02:35<00:31,  2.13it/s]
Profiling:  82%|████████▏ | 296/363 [02:35<00:29,  2.27it/s]
Profiling:  82%|████████▏ | 297/363 [02:36<00:27,  2.41it/s]
Profiling:  82%|████████▏ | 298/363 [02:36<00:26,  2.50it/s]
Profiling:  83%|████████▎ | 300/363 [02:37<00:28,  2.23it/s]
Profiling:  83%|████████▎ | 301/363 [02:38<00:35,  1.76it/s]
Profiling:  83%|████████▎ | 302/363 [02:39<00:41,  1.48it/s]
Profiling:  84%|████████▎ | 304/363 [02:39<00:27,  2.16it/s]
Profiling:  84%|████████▍ | 305/363 [02:40<00:25,  2.30it/s]
Profiling:  84%|████████▍ | 306/363 [02:40<00:23,  2.44it/s]
Profiling:  85%|████████▍ | 307/363 [02:41<00:22,  2.54it/s]
Profiling:  85%|████████▍ | 308/363 [02:41<00:22,  2.45it/s]
Profiling:  85%|████████▌ | 309/363 [02:41<00:21,  2.53it/s]
Profiling:  85%|████████▌ | 310/363 [02:42<00:20,  2.60it/s]
Profiling:  86%|████████▌ | 311/363 [02:42<00:16,  3.13it/s]
Profiling:  86%|████████▌ | 312/363 [02:43<00:26,  1.92it/s]
Profiling:  86%|████████▌ | 313/363 [02:44<00:32,  1.55it/s]
Profiling:  87%|████████▋ | 314/363 [02:45<00:36,  1.35it/s]
Profiling:  87%|████████▋ | 316/363 [02:45<00:22,  2.10it/s]
Profiling:  88%|████████▊ | 318/363 [02:46<00:21,  2.08it/s]
Profiling:  88%|████████▊ | 319/363 [02:47<00:25,  1.71it/s]
Profiling:  88%|████████▊ | 320/363 [02:48<00:29,  1.47it/s]
Profiling:  89%|████████▊ | 322/363 [02:48<00:19,  2.11it/s]
Profiling:  89%|████████▉ | 323/363 [02:49<00:17,  2.24it/s]
Profiling:  89%|████████▉ | 324/363 [02:49<00:16,  2.37it/s]
Profiling:  90%|████████▉ | 325/363 [02:49<00:15,  2.47it/s]
Profiling:  90%|█████████ | 327/363 [02:50<00:15,  2.27it/s]
Profiling:  90%|█████████ | 328/363 [02:51<00:19,  1.78it/s]
Profiling:  91%|█████████ | 329/363 [02:52<00:22,  1.52it/s]
Profiling:  91%|█████████ | 331/363 [02:53<00:15,  2.13it/s]
Profiling:  91%|█████████▏| 332/363 [02:53<00:13,  2.26it/s]
Profiling:  92%|█████████▏| 333/363 [02:53<00:12,  2.41it/s]
Profiling:  92%|█████████▏| 334/363 [02:54<00:11,  2.52it/s]
Profiling:  93%|█████████▎| 336/363 [02:55<00:11,  2.32it/s]
Profiling:  93%|█████████▎| 337/363 [02:56<00:14,  1.78it/s]
Profiling:  93%|█████████▎| 338/363 [02:57<00:16,  1.53it/s]
Profiling:  94%|█████████▎| 340/363 [02:57<00:10,  2.14it/s]
Profiling:  94%|█████████▍| 341/363 [02:57<00:09,  2.26it/s]
Profiling:  94%|█████████▍| 342/363 [02:58<00:08,  2.38it/s]
Profiling:  94%|█████████▍| 343/363 [02:58<00:08,  2.48it/s]
Profiling:  95%|█████████▍| 344/363 [02:58<00:07,  2.57it/s]
Profiling:  95%|█████████▌| 345/363 [02:59<00:06,  2.61it/s]
Profiling:  95%|█████████▌| 346/363 [03:01<00:15,  1.08it/s]
Profiling:  96%|█████████▌| 348/363 [03:02<00:10,  1.40it/s]
Profiling:  96%|█████████▌| 349/363 [03:03<00:10,  1.32it/s]
Profiling:  96%|█████████▋| 350/363 [03:04<00:10,  1.26it/s]
Profiling:  97%|█████████▋| 352/363 [03:04<00:05,  1.88it/s]
Profiling:  97%|█████████▋| 353/363 [03:04<00:04,  2.06it/s]
Profiling:  98%|█████████▊| 355/363 [03:05<00:03,  2.10it/s]
Profiling:  98%|█████████▊| 356/363 [03:06<00:04,  1.75it/s]
Profiling:  98%|█████████▊| 357/363 [03:07<00:03,  1.53it/s]
Profiling:  99%|█████████▉| 359/363 [03:08<00:01,  2.19it/s]
Profiling:  99%|█████████▉| 360/363 [03:08<00:01,  2.33it/s]
Profiling:  99%|█████████▉| 361/363 [03:08<00:00,  2.45it/s]
Profiling: 100%|█████████▉| 362/363 [03:09<00:00,  2.56it/s]
Profiling: 100%|██████████| 363/363 [03:09<00:00,  1.92it/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: quantized model in 222.532s
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: Processed model roleplay4fun/staticpunch-v1.0 in 364.002s
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: creating bucket guanaco-mkml-models
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: uploading /tmp/model_cache to s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/model_cache/config.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3/config.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/model_cache/tokenizer_config.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3/tokenizer_config.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/model_cache/added_tokens.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3/added_tokens.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/model_cache/special_tokens_map.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3/special_tokens_map.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/model_cache/tokenizer.model s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3/tokenizer.model
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/model_cache/tokenizer.json s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3/tokenizer.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/model_cache/mkml_model.tensors s3://guanaco-mkml-models/roleplay4fun-staticpunch-v1-0-v3/mkml_model.tensors
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: loading reward model from roleplay4fun/picky-v1.0
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
roleplay4fun-staticpunch-v1-0-v3-mkmlizer:   warnings.warn(
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
config.json:   0%|          | 0.00/1.01k [00:00<?, ?B/s]
config.json: 100%|██████████| 1.01k/1.01k [00:00<00:00, 11.8MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
roleplay4fun-staticpunch-v1-0-v3-mkmlizer:   warnings.warn(
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/477 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 477/477 [00:00<00:00, 5.99MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
vocab.json:   0%|          | 0.00/798k [00:00<?, ?B/s]
vocab.json: 100%|██████████| 798k/798k [00:00<00:00, 8.23MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
merges.txt:   0%|          | 0.00/456k [00:00<?, ?B/s]
merges.txt: 100%|██████████| 456k/456k [00:00<00:00, 6.42MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
tokenizer.json:   0%|          | 0.00/2.11M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 17.6MB/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 17.4MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/587 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 587/587 [00:00<00:00, 7.48MB/s]
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
roleplay4fun-staticpunch-v1-0-v3-mkmlizer:   warnings.warn(
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: creating bucket guanaco-reward-models
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: Bucket 's3://guanaco-reward-models/' created
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward/config.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward/special_tokens_map.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward/tokenizer_config.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward/merges.txt
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward/vocab.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward/tokenizer.json
roleplay4fun-staticpunch-v1-0-v3-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/roleplay4fun-staticpunch-v1-0-v3_reward/reward.tensors
Job roleplay4fun-staticpunch-v1-0-v3-mkmlizer completed after 404.18s with status: succeeded
Stopping job with name roleplay4fun-staticpunch-v1-0-v3-mkmlizer
Pipeline stage MKMLizer completed in 410.23s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.17s
Running pipeline stage ISVCDeployer
Creating inference service roleplay4fun-staticpunch-v1-0-v3
Waiting for inference service roleplay4fun-staticpunch-v1-0-v3 to be ready
Inference service roleplay4fun-staticpunch-v1-0-v3 ready after 40.25136733055115s
Pipeline stage ISVCDeployer completed in 48.00s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.06s
Running pipeline stage DaemonicSafetyScorer
Pipeline stage DaemonicSafetyScorer completed in 0.06s
Running M-Eval for topic stay_in_character
Running pipeline stage StressChecker
M-Eval Dataset for topic stay_in_character is loaded
Received healthy response to inference request with status code 200 in 2.8527603149414062s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 18.10025453567505s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 10.491823434829712s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 10.124021768569946s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 3.687469720840454s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 3.0199060440063477s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 1.6054909229278564s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 1.5840020179748535s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.258983850479126s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Completed M-Eval for topic stay_in_character, average_score=8.729166666666666
Running M-Eval for topic user_preference
M-Eval Dataset for topic user_preference is loaded
Received healthy response to inference request with status code 200 in 2.8425333499908447s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 6.420371770858765s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 1.6216700077056885s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.158090353012085s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 2.260207414627075s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.3344881534576416s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 2.3189029693603516s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 2.441683769226074s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.1309292316436768s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 2.1494715213775635s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.201096296310425s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.2042295932769775s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 1.2647418975830078s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.173598051071167s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.157175302505493s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.194495677947998s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.177438735961914s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.2137374877929688s
Received healthy response to inference request with status code 200 in 1.8500926494598389s
Received score %s for bot %s
Received score %s for bot %s
Completed M-Eval for topic user_preference, average_score=7.84
Running M-Eval for topic entertaining
M-Eval Dataset for topic entertaining is loaded
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 2.942554235458374s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 6.113978624343872s
Received healthy response to inference request with status code 200 in 1.9250307083129883s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.183454751968384s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.0014312267303467s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 3.543621301651001s
Scoring model output for bot %s
Received healthy response to inference request with status code 200 in 1.8000788688659668s
Received healthy response to inference request with status code 200 in 2.0289008617401123s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 3.030888557434082s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.232194662094116s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Scoring model output for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.240403175354004s
Received healthy response to inference request with status code 200 in 1.9227113723754883s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.1860320568084717s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.2105236053466797s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received score %s for bot %s
Received healthy response to inference request with status code 200 in 2.0206501483917236s
Received score %s for bot %s
Received score %s for bot %s
Completed M-Eval for topic entertaining, average_score=7.2
Received healthy response to inference request with status code 200 in 2.1865079402923584s
Received healthy response to inference request with status code 200 in 1.898698091506958s
Received healthy response to inference request with status code 200 in 2.2011168003082275s
Received healthy response to inference request with status code 200 in 2.201587438583374s
Received healthy response to inference request with status code 200 in 2.073941469192505s
Received healthy response to inference request with status code 200 in 2.2313385009765625s
Received healthy response to inference request with status code 200 in 1.719538688659668s
Received healthy response to inference request with status code 200 in 2.2040457725524902s
Received healthy response to inference request with status code 200 in 2.1858978271484375s
Received healthy response to inference request with status code 200 in 2.279388189315796s
Received healthy response to inference request with status code 200 in 1.9042809009552002s
Received healthy response to inference request with status code 200 in 1.931490182876587s
Received healthy response to inference request with status code 200 in 2.188325881958008s
Received healthy response to inference request with status code 200 in 2.1788179874420166s
Received healthy response to inference request with status code 200 in 2.196307420730591s
Received healthy response to inference request with status code 200 in 1.95017409324646s
Received healthy response to inference request with status code 200 in 2.1333043575286865s
Received healthy response to inference request with status code 200 in 1.7772047519683838s
Received healthy response to inference request with status code 200 in 2.0014431476593018s
Received healthy response to inference request with status code 200 in 2.8777527809143066s
Received healthy response to inference request with status code 200 in 1.7018373012542725s
Received healthy response to inference request with status code 200 in 1.754148006439209s
Received healthy response to inference request with status code 200 in 1.932483434677124s
Received healthy response to inference request with status code 200 in 2.201970338821411s
Received healthy response to inference request with status code 200 in 2.2301039695739746s
Received healthy response to inference request with status code 200 in 1.7244791984558105s
Received healthy response to inference request with status code 200 in 2.25995135307312s
Received healthy response to inference request with status code 200 in 2.193232297897339s
Received healthy response to inference request with status code 200 in 1.5490400791168213s
Received healthy response to inference request with status code 200 in 2.6906495094299316s
Received healthy response to inference request with status code 200 in 3.1453099250793457s
Received healthy response to inference request with status code 200 in 1.5866549015045166s
Received healthy response to inference request with status code 200 in 1.6264128684997559s
Received healthy response to inference request with status code 200 in 1.644761562347412s
Received healthy response to inference request with status code 200 in 2.034147262573242s
Received healthy response to inference request with status code 200 in 1.7777678966522217s
Received healthy response to inference request with status code 200 in 1.885021686553955s
Received healthy response to inference request with status code 200 in 2.1946473121643066s
Received healthy response to inference request with status code 200 in 2.2687981128692627s
Received healthy response to inference request with status code 200 in 2.04343843460083s
Received healthy response to inference request with status code 200 in 1.8498387336730957s
Received healthy response to inference request with status code 200 in 2.023047924041748s
Received healthy response to inference request with status code 200 in 2.1478517055511475s
Received healthy response to inference request with status code 200 in 2.564023017883301s
Received healthy response to inference request with status code 200 in 2.2327945232391357s
Received healthy response to inference request with status code 200 in 2.274038076400757s
Received healthy response to inference request with status code 200 in 1.9217870235443115s
Received healthy response to inference request with status code 200 in 1.7661385536193848s
Received healthy response to inference request with status code 200 in 1.6984784603118896s
Received healthy response to inference request with status code 200 in 2.206244707107544s
Received healthy response to inference request with status code 200 in 2.187502145767212s
Received healthy response to inference request with status code 200 in 2.222634792327881s
Received healthy response to inference request with status code 200 in 2.229564666748047s
Received healthy response to inference request with status code 200 in 1.4360666275024414s
Received healthy response to inference request with status code 200 in 2.1909806728363037s
Received healthy response to inference request with status code 200 in 1.9711565971374512s
Received healthy response to inference request with status code 200 in 1.8353877067565918s
100 requests
0 failed requests
5th percentile: 1.6045491218566894
10th percentile: 1.7015014171600342
20th percentile: 1.8500418663024902
30th percentile: 1.964861845970154
40th percentile: 2.1323543071746824
50th percentile: 2.1859649419784546
60th percentile: 2.201104497909546
70th percentile: 2.229726457595825
80th percentile: 2.2751080989837646
90th percentile: 2.950289416313172
95th percentile: 3.808795166015618
99th percentile: 10.567907745838205
mean time: 2.5474567461013793
Pipeline stage StressChecker completed in 274.35s
roleplay4fun-staticpunch-v1-0_v3 status is now deployed due to admin request
roleplay4fun-staticpunch-v1-0_v3 status is now inactive due to auto deactivation removed underperforming models
roleplay4fun-staticpunch-v1-0_v3 status is now deployed due to admin request
roleplay4fun-staticpunch-v1-0_v3 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of roleplay4fun-staticpunch-v1-0_v3
Running pipeline stage ISVCDeleter
Checking if service roleplay4fun-staticpunch-v1-0-v3 is running
Tearing down inference service roleplay4fun-staticpunch-v1-0-v3
Toredown service roleplay4fun-staticpunch-v1-0-v3
Pipeline stage ISVCDeleter completed in 4.62s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key roleplay4fun-staticpunch-v1-0-v3/added_tokens.json from bucket guanaco-mkml-models
Deleting key roleplay4fun-staticpunch-v1-0-v3/config.json from bucket guanaco-mkml-models
Deleting key roleplay4fun-staticpunch-v1-0-v3/mkml_model.tensors from bucket guanaco-mkml-models
Deleting key roleplay4fun-staticpunch-v1-0-v3/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key roleplay4fun-staticpunch-v1-0-v3/tokenizer.json from bucket guanaco-mkml-models
Deleting key roleplay4fun-staticpunch-v1-0-v3/tokenizer.model from bucket guanaco-mkml-models
Deleting key roleplay4fun-staticpunch-v1-0-v3/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key roleplay4fun-staticpunch-v1-0-v3_reward/config.json from bucket guanaco-reward-models
Deleting key roleplay4fun-staticpunch-v1-0-v3_reward/merges.txt from bucket guanaco-reward-models
Deleting key roleplay4fun-staticpunch-v1-0-v3_reward/reward.tensors from bucket guanaco-reward-models
Deleting key roleplay4fun-staticpunch-v1-0-v3_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key roleplay4fun-staticpunch-v1-0-v3_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key roleplay4fun-staticpunch-v1-0-v3_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key roleplay4fun-staticpunch-v1-0-v3_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 4.31s
roleplay4fun-staticpunch-v1-0_v3 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics