meliodia-llama-3-2-3b-a_43857

developer_uid: Meliodia
submission_id: meliodia-llama-3-2-3b-a_43857_v1
model_name: meliodia-llama-3-2-3b-a_43857_v1
model_group: Meliodia/Llama-3.2-3B-An
status: torndown
timestamp: 2025-11-23T20:01:26+00:00
num_battles: 6507
num_wins: 268
celo_rating: 762.36
family_friendly_score: 0.9852
family_friendly_standard_error: 0.0017076861538350657
submission_type: basic
model_repo: Meliodia/Llama-3.2-3B-Anthracite-Merged
model_architecture: LlamaForCausalLM
model_num_parameters: 3606752256.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
latencies: [{'batch_size': 1, 'throughput': 2.230390937709526, 'latency_mean': 0.4482355296611786, 'latency_p50': 0.44849371910095215, 'latency_p90': 0.49984710216522216}, {'batch_size': 5, 'throughput': 5.817715809216026, 'latency_mean': 0.8553513419628144, 'latency_p50': 0.8499380350112915, 'latency_p90': 0.9553427219390869}, {'batch_size': 10, 'throughput': 7.220396075091944, 'latency_mean': 1.372076450586319, 'latency_p50': 1.368527889251709, 'latency_p90': 1.57653489112854}, {'batch_size': 15, 'throughput': 7.8447937200712134, 'latency_mean': 1.8760104548931122, 'latency_p50': 1.8684190511703491, 'latency_p90': 2.1534860134124756}, {'batch_size': 20, 'throughput': 7.989367558720429, 'latency_mean': 2.4420205771923067, 'latency_p50': 2.416078567504883, 'latency_p90': 2.9292430877685547}, {'batch_size': 25, 'throughput': 7.9572457100577685, 'latency_mean': 3.051655902862549, 'latency_p50': 3.0888988971710205, 'latency_p90': 3.5193942546844483}, {'batch_size': 30, 'throughput': 7.948666479480358, 'latency_mean': 3.616313496828079, 'latency_p50': 3.7008854150772095, 'latency_p90': 4.061915731430053}, {'batch_size': 35, 'throughput': 7.960879270998023, 'latency_mean': 4.171095926761627, 'latency_p50': 4.294509172439575, 'latency_p90': 4.679830884933471}, {'batch_size': 40, 'throughput': 7.954222500382795, 'latency_mean': 4.708525077104569, 'latency_p50': 4.871755003929138, 'latency_p90': 5.448469805717468}, {'batch_size': 45, 'throughput': 7.941574018923869, 'latency_mean': 5.243213320970535, 'latency_p50': 5.528900384902954, 'latency_p90': 5.986296343803406}]
gpu_counts: {'NVIDIA L40S': 1}
display_name: meliodia-llama-3-2-3b-a_43857_v1
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: Meliodia/Llama-3.2-3B-Anthracite-Merged
model_size: 4B
ranking_group: single
throughput_3p7s: 8.31
us_pacific_date: 2025-11-20
win_ratio: 0.04118641463039803
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name meliodia-llama-3-2-3b-a-43857-v1-mkmlizer
Waiting for job on meliodia-llama-3-2-3b-a-43857-v1-mkmlizer to finish
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║                                                                     ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║                                                                     ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  Version: 0.30.2                                                    ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  https://mk1.ai                                                     ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║                                                                     ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  belonging to:                                                      ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║                                                                     ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  Chai Research Corp.                                                ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ║                                                                     ║
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: Downloaded to shared memory in 11.198s
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: Checking if Meliodia/Llama-3.2-3B-Anthracite-Merged already exists in ChaiML
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: Creating repo ChaiML/Llama-3.2-3B-Anthracite-Merged and uploading /tmp/tmpqwkd0lwy to it
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
Processing Files (0 / 0)                : |          |  0.00B /  0.00B            
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         : |          |  0.00B /  0.00B            [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:   1%|          | 15.7MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:   1%|          | 15.7MB / 1.46GB            [A[A[A
Processing Files (0 / 2)                :   1%|          | 32.6MB / 6.44GB,   ???B/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:   2%|▏         | 80.6MB / 4.97GB            [A[A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:   6%|▌         | 87.5MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:   2%|▏         | 80.6MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :   3%|▎         |  185MB / 6.44GB,  761MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  11%|█         |  159MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:   3%|▎         |  153MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :   5%|▌         |  329MB / 6.44GB,  743MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  17%|█▋        |  247MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:   5%|▍         |  242MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :   8%|▊         |  506MB / 6.44GB,  790MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  23%|██▎       |  335MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:   7%|▋         |  329MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  11%|█         |  682MB / 6.44GB,  811MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  28%|██▊       |  415MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:   8%|▊         |  418MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  13%|█▎        |  849MB / 6.44GB,  817MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  34%|███▍      |  494MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  10%|▉         |  489MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  16%|█▌        | 1.00GB / 6.44GB,  806MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  40%|███▉      |  582MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  12%|█▏        |  578MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  18%|█▊        | 1.18GB / 6.44GB,  818MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  45%|████▌     |  662MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  13%|█▎        |  648MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  21%|██        | 1.33GB / 6.44GB,  810MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  51%|█████     |  741MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  15%|█▍        |  728MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  23%|██▎       | 1.49GB / 6.44GB,  808MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  56%|█████▌    |  820MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  16%|█▋        |  816MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  26%|██▌       | 1.65GB / 6.44GB,  811MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  62%|██████▏   |  900MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  18%|█▊        |  903MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  28%|██▊       | 1.82GB / 6.44GB,  812MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  67%|██████▋   |  979MB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  20%|█▉        |  983MB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  31%|███       | 1.98GB / 6.44GB,  811MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  72%|███████▏  | 1.06GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  21%|██▏       | 1.06GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  33%|███▎      | 2.14GB / 6.44GB,  809MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  78%|███████▊  | 1.14GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  23%|██▎       | 1.14GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  36%|███▌      | 2.30GB / 6.44GB,  809MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  83%|████████▎ | 1.22GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  25%|██▍       | 1.22GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  38%|███▊      | 2.46GB / 6.44GB,  808MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  86%|████████▌ | 1.25GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  26%|██▌       | 1.30GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  40%|███▉      | 2.57GB / 6.44GB,  792MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  95%|█████████▍| 1.38GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  26%|██▋       | 1.31GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  42%|████▏     | 2.71GB / 6.44GB,  786MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         :  50%|████▉     | 66.7MB /  134MB, 19.6MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  29%|██▉       | 1.46GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  46%|████▌     | 2.93GB / 6.44GB,  805MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         :  99%|█████████▉|  133MB /  134MB, 37.0MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  31%|███       | 1.55GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  47%|████▋     | 3.02GB / 6.44GB,  786MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  33%|███▎      | 1.64GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  48%|████▊     | 3.11GB / 6.44GB,  768MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  35%|███▍      | 1.73GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  50%|████▉     | 3.20GB / 6.44GB,  755MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         : 100%|█████████▉|  134MB /  134MB, 31.8MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  37%|███▋      | 1.82GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  51%|█████     | 3.29GB / 6.44GB,  740MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  39%|███▊      | 1.92GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  53%|█████▎    | 3.39GB / 6.44GB,  729MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  40%|████      | 2.00GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  54%|█████▍    | 3.47GB / 6.44GB,  717MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  42%|████▏     | 2.09GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  55%|█████▌    | 3.56GB / 6.44GB,  706MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         : 100%|██████████|  134MB /  134MB, 26.8MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  44%|████▍     | 2.19GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  57%|█████▋    | 3.66GB / 6.44GB,  697MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  46%|████▌     | 2.28GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  58%|█████▊    | 3.75GB / 6.44GB,  688MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  48%|████▊     | 2.36GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  60%|█████▉    | 3.83GB / 6.44GB,  679MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  49%|████▉     | 2.45GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  61%|██████    | 3.92GB / 6.44GB,  670MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  51%|█████     | 2.54GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  62%|██████▏   | 4.01GB / 6.44GB,  663MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  53%|█████▎    | 2.63GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  64%|██████▎   | 4.09GB / 6.44GB,  655MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  54%|█████▍    | 2.69GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  65%|██████▍   | 4.16GB / 6.44GB,  644MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         :  86%|████████▌ |  173MB /  201MB, 27.0MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  56%|█████▋    | 2.80GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  66%|██████▋   | 4.27GB / 6.44GB,  642MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         : 100%|█████████▉|  201MB /  201MB, 30.4MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  58%|█████▊    | 2.90GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  68%|██████▊   | 4.37GB / 6.44GB,  637MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  60%|██████    | 2.98GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  69%|██████▉   | 4.45GB / 6.44GB,  631MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  62%|██████▏   | 3.07GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  70%|███████   | 4.54GB / 6.44GB,  626MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  64%|██████▍   | 3.17GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  72%|███████▏  | 4.64GB / 6.44GB,  622MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  66%|██████▌   | 3.25GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  73%|███████▎  | 4.72GB / 6.44GB,  617MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  67%|██████▋   | 3.34GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  75%|███████▍  | 4.81GB / 6.44GB,  613MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         : 100%|██████████|  201MB /  201MB, 25.8MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  69%|██████▉   | 3.44GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  76%|███████▌  | 4.91GB / 6.44GB,  609MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  71%|███████   | 3.52GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  78%|███████▊  | 4.99GB / 6.44GB,  605MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  73%|███████▎  | 3.61GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  79%|███████▉  | 5.08GB / 6.44GB,  601MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  74%|███████▍  | 3.70GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  80%|████████  | 5.17GB / 6.44GB,  597MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  76%|███████▌  | 3.78GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  82%|████████▏ | 5.25GB / 6.44GB,  593MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  77%|███████▋  | 3.80GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  82%|████████▏ | 5.27GB / 6.44GB,  582MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  80%|███████▉  | 3.96GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  84%|████████▍ | 5.43GB / 6.44GB,  587MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
New Data Upload                         : 100%|█████████▉|  268MB /  268MB, 29.1MB/s  [A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00001-of-00002.safetensors:  82%|████████▏ | 4.05GB / 4.97GB            [A[A[A[A
Processing Files (0 / 3)                :  86%|████████▌ | 5.52GB / 6.44GB,  584MB/s  
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  /tmp/tmpqwkd0lwy/tokenizer.json       :  98%|█████████▊| 16.9MB / 17.2MB            [A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
  ...wy/model-00002-of-00002.safetensors:  99%|█████████▉| 1.45GB / 1.46GB            [A[A[A
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: quantized model in 44.884s
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: Processed model Meliodia/Llama-3.2-3B-Anthracite-Merged in 77.373s
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: creating bucket guanaco-mkml-models
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/meliodia-llama-3-2-3b-a-43857-v1/nvidia
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/meliodia-llama-3-2-3b-a-43857-v1/nvidia/special_tokens_map.json
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/meliodia-llama-3-2-3b-a-43857-v1/nvidia/config.json
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/meliodia-llama-3-2-3b-a-43857-v1/nvidia/tokenizer_config.json
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/meliodia-llama-3-2-3b-a-43857-v1/nvidia/flywheel_model.0.safetensors
meliodia-llama-3-2-3b-a-43857-v1-mkmlizer: 
Loading 0:   0%|          | 0/254 [00:00<?, ?it/s]
Loading 0:   1%|          | 3/254 [00:00<00:27,  9.14it/s]
Loading 0:   2%|▏         | 4/254 [00:00<00:44,  5.60it/s]
Loading 0:   2%|▏         | 5/254 [00:01<01:02,  3.97it/s]
Loading 0:   3%|▎         | 8/254 [00:01<00:33,  7.31it/s]
Loading 0:   4%|▍         | 10/254 [00:01<00:31,  7.68it/s]
Loading 0:   5%|▍         | 12/254 [00:01<00:34,  7.11it/s]
Loading 0:   5%|▌         | 13/254 [00:02<00:42,  5.69it/s]
Loading 0:   6%|▌         | 14/254 [00:02<00:53,  4.51it/s]
Loading 0:   7%|▋         | 17/254 [00:02<00:33,  7.18it/s]
Loading 0:   7%|▋         | 18/254 [00:02<00:31,  7.42it/s]
Loading 0:   7%|▋         | 19/254 [00:02<00:30,  7.69it/s]
Loading 0:   8%|▊         | 21/254 [00:03<00:33,  7.03it/s]
Loading 0:   9%|▊         | 22/254 [00:03<00:41,  5.55it/s]
Loading 0:   9%|▉         | 23/254 [00:03<00:52,  4.37it/s]
Loading 0:  10%|█         | 26/254 [00:04<00:31,  7.15it/s]
Loading 0:  11%|█         | 27/254 [00:04<00:30,  7.42it/s]
Loading 0:  11%|█         | 28/254 [00:04<00:28,  7.82it/s]
Loading 0:  12%|█▏        | 30/254 [00:04<00:31,  7.09it/s]
Loading 0:  12%|█▏        | 31/254 [00:04<00:40,  5.56it/s]
Loading 0:  13%|█▎        | 32/254 [00:05<00:50,  4.37it/s]
Loading 0:  14%|█▍        | 35/254 [00:05<00:30,  7.18it/s]
Loading 0:  14%|█▍        | 36/254 [00:05<00:29,  7.44it/s]
Loading 0:  15%|█▍        | 37/254 [00:05<00:27,  7.84it/s]
Loading 0:  15%|█▌        | 39/254 [00:06<00:30,  7.06it/s]
Loading 0:  16%|█▌        | 40/254 [00:06<00:38,  5.54it/s]
Loading 0:  16%|█▌        | 41/254 [00:06<00:49,  4.32it/s]
Loading 0:  17%|█▋        | 44/254 [00:06<00:29,  7.10it/s]
Loading 0:  18%|█▊        | 45/254 [00:06<00:28,  7.38it/s]
Loading 0:  18%|█▊        | 46/254 [00:07<00:26,  7.78it/s]
Loading 0:  19%|█▉        | 48/254 [00:07<00:29,  7.05it/s]
Loading 0:  19%|█▉        | 49/254 [00:07<00:37,  5.52it/s]
Loading 0:  20%|█▉        | 50/254 [00:08<00:47,  4.34it/s]
Loading 0:  21%|██        | 53/254 [00:08<00:28,  7.09it/s]
Loading 0:  21%|██▏       | 54/254 [00:08<00:27,  7.34it/s]
Loading 0:  22%|██▏       | 55/254 [00:08<00:25,  7.74it/s]
Loading 0:  22%|██▏       | 57/254 [00:08<00:28,  7.02it/s]
Loading 0:  23%|██▎       | 58/254 [00:09<00:35,  5.49it/s]
Loading 0:  23%|██▎       | 59/254 [00:09<00:45,  4.26it/s]
Loading 0:  24%|██▍       | 62/254 [00:09<00:27,  7.01it/s]
Loading 0:  25%|██▍       | 63/254 [00:09<00:26,  7.28it/s]
Loading 0:  25%|██▌       | 64/254 [00:09<00:24,  7.68it/s]
Loading 0:  26%|██▌       | 66/254 [00:10<00:26,  6.99it/s]
Loading 0:  26%|██▋       | 67/254 [00:10<00:34,  5.48it/s]
Loading 0:  27%|██▋       | 68/254 [00:10<00:43,  4.32it/s]
Loading 0:  28%|██▊       | 71/254 [00:11<00:25,  7.08it/s]
Loading 0:  28%|██▊       | 72/254 [00:11<00:24,  7.34it/s]
Loading 0:  29%|██▊       | 73/254 [00:11<00:23,  7.77it/s]
Loading 0:  30%|██▉       | 75/254 [00:11<00:25,  7.05it/s]
Loading 0:  30%|██▉       | 76/254 [00:12<00:32,  5.53it/s]
Loading 0:  30%|███       | 77/254 [00:12<00:40,  4.35it/s]
Loading 0:  31%|███▏      | 80/254 [00:12<00:24,  7.13it/s]
Loading 0:  32%|███▏      | 81/254 [00:12<00:23,  7.39it/s]
Loading 0:  32%|███▏      | 82/254 [00:12<00:22,  7.76it/s]
Loading 0:  33%|███▎      | 84/254 [00:13<00:24,  7.06it/s]
Loading 0:  33%|███▎      | 85/254 [00:13<00:30,  5.54it/s]
Loading 0:  34%|███▍      | 86/254 [00:13<00:38,  4.36it/s]
Loading 0:  35%|███▌      | 89/254 [00:13<00:23,  7.15it/s]
Loading 0:  35%|███▌      | 90/254 [00:14<00:22,  7.41it/s]
Loading 0:  36%|███▌      | 91/254 [00:14<00:21,  7.67it/s]
Loading 0:  37%|███▋      | 93/254 [00:14<00:22,  7.02it/s]
Loading 0:  37%|███▋      | 94/254 [00:14<00:28,  5.52it/s]
Loading 0:  37%|███▋      | 95/254 [00:15<00:36,  4.36it/s]
Loading 0:  39%|███▊      | 98/254 [00:15<00:21,  7.14it/s]
Loading 0:  39%|███▉      | 99/254 [00:15<00:20,  7.41it/s]
Loading 0:  39%|███▉      | 100/254 [00:15<00:19,  7.82it/s]
Loading 0:  40%|████      | 102/254 [00:15<00:21,  7.11it/s]
Loading 0:  41%|████      | 103/254 [00:16<00:27,  5.58it/s]
Loading 0:  41%|████      | 104/254 [00:16<00:34,  4.38it/s]
Loading 0:  42%|████▏     | 107/254 [00:16<00:20,  7.15it/s]
Loading 0:  43%|████▎     | 108/254 [00:16<00:19,  7.42it/s]
Loading 0:  43%|████▎     | 109/254 [00:17<00:19,  7.59it/s]
Loading 0:  44%|████▎     | 111/254 [00:17<00:20,  6.94it/s]
Loading 0:  44%|████▍     | 112/254 [00:17<00:25,  5.49it/s]
Loading 0:  44%|████▍     | 113/254 [00:18<00:32,  4.34it/s]
Loading 0:  46%|████▌     | 116/254 [00:18<00:19,  7.11it/s]
Loading 0:  46%|████▌     | 117/254 [00:18<00:18,  7.33it/s]
Loading 0:  46%|████▋     | 118/254 [00:18<00:17,  7.73it/s]
Loading 0:  47%|████▋     | 119/254 [00:18<00:23,  5.72it/s]
Loading 0:  47%|████▋     | 120/254 [00:19<00:30,  4.37it/s]
Loading 0:  48%|████▊     | 122/254 [00:19<00:21,  6.05it/s]
Loading 0:  48%|████▊     | 123/254 [00:19<00:20,  6.50it/s]
Loading 0:  49%|████▉     | 124/254 [00:19<00:18,  7.05it/s]
Loading 0:  50%|████▉     | 126/254 [00:19<00:19,  6.63it/s]
Loading 0:  50%|█████     | 127/254 [00:20<00:24,  5.26it/s]
Loading 0:  50%|█████     | 128/254 [00:20<00:30,  4.15it/s]
Loading 0:  52%|█████▏    | 131/254 [00:20<00:17,  6.98it/s]
Loading 0:  52%|█████▏    | 132/254 [00:20<00:16,  7.21it/s]
Loading 0:  52%|█████▏    | 133/254 [00:20<00:15,  7.62it/s]
Loading 0:  53%|█████▎    | 135/254 [00:21<00:17,  6.96it/s]
Loading 0:  54%|█████▎    | 136/254 [00:21<00:21,  5.49it/s]
Loading 0:  54%|█████▍    | 137/254 [00:21<00:27,  4.29it/s]
Loading 0:  55%|█████▌    | 140/254 [00:22<00:16,  7.05it/s]
Loading 0:  56%|█████▌    | 141/254 [00:22<00:15,  7.25it/s]
Loading 0:  56%|█████▌    | 142/254 [00:22<00:14,  7.68it/s]
Loading 0:  57%|█████▋    | 144/254 [00:22<00:15,  7.03it/s]
Loading 0:  57%|█████▋    | 145/254 [00:23<00:19,  5.53it/s]
Loading 0:  57%|█████▋    | 146/254 [00:23<00:25,  4.30it/s]
Loading 0:  59%|█████▊    | 149/254 [00:23<00:14,  7.01it/s]
Loading 0:  59%|█████▉    | 150/254 [00:23<00:14,  7.21it/s]
Loading 0:  59%|█████▉    | 151/254 [00:23<00:13,  7.60it/s]
Loading 0:  60%|██████    | 153/254 [00:24<00:14,  6.98it/s]
Loading 0:  61%|██████    | 154/254 [00:24<00:18,  5.49it/s]
Loading 0:  61%|██████    | 155/254 [00:24<00:22,  4.31it/s]
Loading 0:  62%|██████▏   | 158/254 [00:25<00:13,  7.09it/s]
Loading 0:  63%|██████▎   | 159/254 [00:25<00:12,  7.37it/s]
Loading 0:  63%|██████▎   | 160/254 [00:25<00:12,  7.70it/s]
Loading 0:  64%|██████▍   | 162/254 [00:25<00:13,  7.03it/s]
Loading 0:  64%|██████▍   | 163/254 [00:25<00:16,  5.53it/s]
Loading 0:  65%|██████▍   | 164/254 [00:26<00:20,  4.34it/s]
Loading 0:  66%|██████▌   | 167/254 [00:26<00:12,  7.13it/s]
Loading 0:  66%|██████▌   | 168/254 [00:26<00:11,  7.40it/s]
Loading 0:  67%|██████▋   | 169/254 [00:26<00:10,  7.82it/s]
Loading 0:  67%|██████▋   | 171/254 [00:26<00:11,  7.09it/s]
Loading 0:  68%|██████▊   | 172/254 [00:27<00:14,  5.57it/s]
Loading 0:  68%|██████▊   | 173/254 [00:27<00:18,  4.37it/s]
Loading 0:  69%|██████▉   | 176/254 [00:27<00:10,  7.13it/s]
Loading 0:  70%|██████▉   | 177/254 [00:27<00:10,  7.32it/s]
Loading 0:  70%|███████   | 178/254 [00:28<00:09,  7.69it/s]
Loading 0:  71%|███████   | 180/254 [00:28<00:10,  7.02it/s]
Loading 0:  71%|███████▏  | 181/254 [00:28<00:13,  5.52it/s]
Loading 0:  72%|███████▏  | 182/254 [00:29<00:16,  4.35it/s]
Loading 0:  73%|███████▎  | 185/254 [00:29<00:09,  7.15it/s]
Loading 0:  73%|███████▎  | 186/254 [00:29<00:09,  7.41it/s]
Loading 0:  74%|███████▎  | 187/254 [00:29<00:08,  7.68it/s]
Loading 0:  74%|███████▍  | 188/254 [00:29<00:08,  7.42it/s]
Loading 0:  74%|███████▍  | 189/254 [00:29<00:11,  5.50it/s]
Loading 0:  76%|███████▌  | 192/254 [00:30<00:08,  6.98it/s]
Loading 0:  76%|███████▌  | 193/254 [00:30<00:10,  5.59it/s]
Loading 0:  76%|███████▋  | 194/254 [00:30<00:13,  4.44it/s]
Loading 0:  78%|███████▊  | 197/254 [00:31<00:07,  7.13it/s]
Loading 0:  78%|███████▊  | 198/254 [00:31<00:07,  7.33it/s]
Loading 0:  78%|███████▊  | 199/254 [00:31<00:07,  7.72it/s]
Loading 0:  79%|███████▉  | 201/254 [00:31<00:07,  7.06it/s]
Loading 0:  80%|███████▉  | 202/254 [00:31<00:09,  5.57it/s]
Loading 0:  80%|███████▉  | 203/254 [00:32<00:11,  4.39it/s]
Loading 0:  81%|████████  | 206/254 [00:32<00:06,  7.11it/s]
Loading 0:  81%|████████▏ | 207/254 [00:32<00:06,  7.30it/s]
Loading 0:  82%|████████▏ | 208/254 [00:32<00:05,  7.70it/s]
Loading 0:  83%|████████▎ | 210/254 [00:33<00:06,  7.03it/s]
Loading 0:  83%|████████▎ | 211/254 [00:33<00:07,  5.54it/s]
Loading 0:  83%|████████▎ | 212/254 [00:33<00:09,  4.32it/s]
Loading 0:  85%|████████▍ | 215/254 [00:33<00:05,  7.09it/s]
Loading 0:  85%|████████▌ | 216/254 [00:34<00:05,  7.28it/s]
Loading 0:  85%|████████▌ | 217/254 [00:34<00:05,  7.39it/s]
Loading 0:  86%|████████▌ | 219/254 [00:34<00:05,  6.87it/s]
Loading 0:  87%|████████▋ | 220/254 [00:34<00:06,  5.45it/s]
Loading 0:  87%|████████▋ | 221/254 [00:35<00:08,  4.03it/s]
Loading 0:  88%|████████▊ | 224/254 [00:35<00:04,  6.69it/s]
Loading 0:  89%|████████▊ | 225/254 [00:35<00:04,  6.94it/s]
Loading 0:  89%|████████▉ | 226/254 [00:35<00:03,  7.28it/s]
Loading 0:  90%|████████▉ | 228/254 [00:36<00:03,  6.80it/s]
Loading 0:  90%|█████████ | 229/254 [00:36<00:04,  5.41it/s]
Loading 0:  91%|█████████ | 230/254 [00:36<00:05,  4.31it/s]
Loading 0:  92%|█████████▏| 233/254 [00:36<00:02,  7.02it/s]
Loading 0:  92%|█████████▏| 234/254 [00:37<00:02,  7.23it/s]
Loading 0:  93%|█████████▎| 235/254 [00:37<00:02,  7.62it/s]
Loading 0:  93%|█████████▎| 237/254 [00:37<00:02,  6.90it/s]
Loading 0:  94%|█████████▎| 238/254 [00:37<00:02,  5.47it/s]
Loading 0:  94%|█████████▍| 239/254 [00:38<00:03,  4.33it/s]
Loading 0:  95%|█████████▌| 242/254 [00:38<00:01,  7.10it/s]
Loading 0:  96%|█████████▌| 243/254 [00:38<00:01,  7.29it/s]
Loading 0:  96%|█████████▌| 244/254 [00:38<00:01,  6.99it/s]
Loading 0:  97%|█████████▋| 246/254 [00:39<00:01,  5.92it/s]
Loading 0:  97%|█████████▋| 247/254 [00:39<00:01,  4.96it/s]
Loading 0:  98%|█████████▊| 248/254 [00:39<00:01,  4.06it/s]
Loading 0:  99%|█████████▉| 251/254 [00:39<00:00,  6.73it/s]
Loading 0:  99%|█████████▉| 252/254 [00:40<00:00,  6.97it/s]
Loading 0: 100%|█████████▉| 253/254 [00:40<00:00,  7.38it/s]
                                                            
Job meliodia-llama-3-2-3b-a-43857-v1-mkmlizer completed after 95.03s with status: succeeded
Stopping job with name meliodia-llama-3-2-3b-a-43857-v1-mkmlizer
Pipeline stage MKMLizer completed in 95.62s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.19s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service meliodia-llama-3-2-3b-a-43857-v1
Waiting for inference service meliodia-llama-3-2-3b-a-43857-v1 to be ready
Inference service meliodia-llama-3-2-3b-a-43857-v1 ready after 151.48407578468323s
Pipeline stage MKMLDeployer completed in 152.18s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.026853322982788s
Received healthy response to inference request in 0.529869556427002s
Received healthy response to inference request in 1.085190773010254s
Received healthy response to inference request in 0.771953821182251s
Received healthy response to inference request in 0.6167912483215332s
5 requests
0 failed requests
5th percentile: 0.5472538948059082
10th percentile: 0.5646382331848144
20th percentile: 0.5994069099426269
30th percentile: 0.6478237628936767
40th percentile: 0.7098887920379638
50th percentile: 0.771953821182251
60th percentile: 0.8739136219024658
70th percentile: 0.9758734226226806
80th percentile: 1.0385208129882812
90th percentile: 1.0618557929992676
95th percentile: 1.0735232830047607
99th percentile: 1.0828572750091552
mean time: 0.8061317443847656
Pipeline stage StressChecker completed in 5.83s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.76s
Shutdown handler de-registered
meliodia-llama-3-2-3b-a_43857_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 1191.33s
Shutdown handler de-registered
meliodia-llama-3-2-3b-a_43857_v1 status is now inactive due to auto deactivation removed underperforming models
meliodia-llama-3-2-3b-a_43857_v1 status is now torndown due to DeploymentManager action