nothingiisreal-mn-12b-s_43653

developer_uid: ChaiHarshitSheoran
submission_id: nothingiisreal-mn-12b-s_43653_v3
model_name: nothingiisreal-mn-12b-s_43653_v3
model_group: nothingiisreal/MN-12B-St
status: torndown
timestamp: 2025-09-12T23:41:40+00:00
num_battles: 6609
num_wins: 3368
celo_rating: 1253.17
family_friendly_score: 0.5412
family_friendly_standard_error: 0.007047021498477211
submission_type: basic
model_repo: nothingiisreal/MN-12B-Starcannon-v3
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
latencies: [{'batch_size': 1, 'throughput': 0.9276062774829679, 'latency_mean': 1.0779215800762176, 'latency_p50': 1.0806095600128174, 'latency_p90': 1.2038894891738892}, {'batch_size': 5, 'throughput': 2.4902436531850833, 'latency_mean': 1.9950964283943176, 'latency_p50': 1.976562738418579, 'latency_p90': 2.2169512033462526}, {'batch_size': 10, 'throughput': 3.1197893847019236, 'latency_mean': 3.1789529013633726, 'latency_p50': 3.2046996355056763, 'latency_p90': 3.593255019187927}, {'batch_size': 15, 'throughput': 3.377651501815344, 'latency_mean': 4.374989511966706, 'latency_p50': 4.333549618721008, 'latency_p90': 5.12305223941803}, {'batch_size': 20, 'throughput': 3.3984181963629085, 'latency_mean': 5.7702743637561795, 'latency_p50': 5.817918181419373, 'latency_p90': 6.616897535324097}]
gpu_counts: {'NVIDIA L40S': 1}
display_name: nothingiisreal-mn-12b-s_43653_v3
is_internal_developer: False
language_model: nothingiisreal/MN-12B-Starcannon-v3
model_size: 13B
ranking_group: single
throughput_3p7s: 3.29
us_pacific_date: 2025-09-12
win_ratio: 0.5096081101528219
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name nothingiisreal-mn-12b-s-43653-v3-mkmlizer
Waiting for job on nothingiisreal-mn-12b-s-43653-v3-mkmlizer to finish
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║                                                                     ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║                                                                     ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  Version: 0.30.2                                                    ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  https://mk1.ai                                                     ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║                                                                     ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  belonging to:                                                      ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║                                                                     ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  Chai Research Corp.                                                ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ║                                                                     ║
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: Downloaded to shared memory in 23.538s
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: Checking if nothingiisreal/MN-12B-Starcannon-v3 already exists in ChaiML
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: Creating repo ChaiML/MN-12B-Starcannon-v3 and uploading /tmp/tmpdgrjtsbz to it
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: 
  0%|          | 0/5 [00:00<?, ?it/s]
 20%|██        | 1/5 [00:07<00:30,  7.62s/it]
 40%|████      | 2/5 [00:11<00:16,  5.35s/it]
 60%|██████    | 3/5 [00:15<00:09,  4.83s/it]
 80%|████████  | 4/5 [00:19<00:04,  4.34s/it]
100%|██████████| 5/5 [00:26<00:00,  5.60s/it]
100%|██████████| 5/5 [00:26<00:00,  5.40s/it]
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpdgrjtsbz, device:0
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: quantized model in 144.629s
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: Processed model nothingiisreal/MN-12B-Starcannon-v3 in 217.589s
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: creating bucket guanaco-mkml-models
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia/special_tokens_map.json
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia/config.json
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia/tokenizer_config.json
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: cp /dev/shm/model_cache/merges.txt s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia/merges.txt
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: cp /dev/shm/model_cache/vocab.json s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia/vocab.json
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia/tokenizer.json
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/nothingiisreal-mn-12b-s-43653-v3/nvidia/flywheel_model.0.safetensors
nothingiisreal-mn-12b-s-43653-v3-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/363 [00:00<00:28, 12.53it/s]
Loading 0:   1%|          | 4/363 [00:01<01:42,  3.49it/s]
Loading 0:   1%|▏         | 5/363 [00:01<02:43,  2.18it/s]
Loading 0:   2%|▏         | 6/363 [00:02<03:35,  1.66it/s]
Loading 0:   2%|▏         | 9/363 [00:03<01:53,  3.12it/s]
Loading 0:   3%|▎         | 10/363 [00:03<01:49,  3.24it/s]
Loading 0:   3%|▎         | 11/363 [00:03<01:35,  3.70it/s]
Loading 0:   4%|▎         | 13/363 [00:04<01:56,  3.01it/s]
Loading 0:   4%|▍         | 14/363 [00:05<02:36,  2.23it/s]
Loading 0:   4%|▍         | 15/363 [00:06<03:14,  1.79it/s]
Loading 0:   5%|▍         | 18/363 [00:06<01:53,  3.05it/s]
Loading 0:   5%|▌         | 19/363 [00:06<01:47,  3.20it/s]
Loading 0:   6%|▌         | 20/363 [00:06<01:32,  3.70it/s]
Loading 0:   6%|▌         | 22/363 [00:07<01:53,  3.00it/s]
Loading 0:   6%|▋         | 23/363 [00:08<02:31,  2.24it/s]
Loading 0:   7%|▋         | 24/363 [00:09<03:10,  1.78it/s]
Loading 0:   7%|▋         | 27/363 [00:09<01:49,  3.06it/s]
Loading 0:   8%|▊         | 28/363 [00:10<01:43,  3.24it/s]
Loading 0:   8%|▊         | 29/363 [00:10<01:29,  3.74it/s]
Loading 0:   9%|▊         | 31/363 [00:10<01:49,  3.04it/s]
Loading 0:   9%|▉         | 32/363 [00:11<02:26,  2.26it/s]
Loading 0:   9%|▉         | 33/363 [00:12<03:02,  1.81it/s]
Loading 0:  10%|▉         | 36/363 [00:13<01:46,  3.08it/s]
Loading 0:  10%|█         | 37/363 [00:13<01:39,  3.26it/s]
Loading 0:  10%|█         | 38/363 [00:13<01:26,  3.76it/s]
Loading 0:  11%|█         | 40/363 [00:14<01:53,  2.83it/s]
Loading 0:  11%|█▏        | 41/363 [00:15<02:28,  2.17it/s]
Loading 0:  12%|█▏        | 42/363 [00:16<03:02,  1.76it/s]
Loading 0:  12%|█▏        | 45/363 [00:16<01:46,  2.98it/s]
Loading 0:  13%|█▎        | 46/363 [00:16<01:40,  3.14it/s]
Loading 0:  13%|█▎        | 47/363 [00:16<01:28,  3.59it/s]
Loading 0:  13%|█▎        | 49/363 [00:17<01:45,  2.97it/s]
Loading 0:  14%|█▍        | 50/363 [00:18<02:20,  2.23it/s]
Loading 0:  14%|█▍        | 51/363 [00:19<02:54,  1.79it/s]
Loading 0:  15%|█▍        | 54/363 [00:19<01:41,  3.03it/s]
Loading 0:  15%|█▌        | 55/363 [00:20<01:36,  3.19it/s]
Loading 0:  15%|█▌        | 56/363 [00:20<01:23,  3.67it/s]
Loading 0:  16%|█▌        | 58/363 [00:21<01:41,  3.00it/s]
Loading 0:  16%|█▋        | 59/363 [00:21<02:15,  2.24it/s]
Loading 0:  17%|█▋        | 60/363 [00:22<02:49,  1.79it/s]
Loading 0:  17%|█▋        | 63/363 [00:23<01:39,  3.03it/s]
Loading 0:  18%|█▊        | 64/363 [00:23<01:34,  3.18it/s]
Loading 0:  18%|█▊        | 65/363 [00:23<01:21,  3.67it/s]
Loading 0:  18%|█▊        | 67/363 [00:24<01:38,  2.99it/s]
Loading 0:  19%|█▊        | 68/363 [00:25<02:11,  2.23it/s]
Loading 0:  19%|█▉        | 69/363 [00:26<02:45,  1.78it/s]
Loading 0:  20%|█▉        | 72/363 [00:26<01:36,  3.01it/s]
Loading 0:  20%|██        | 73/363 [00:26<01:31,  3.16it/s]
Loading 0:  20%|██        | 74/363 [00:26<01:19,  3.65it/s]
Loading 0:  21%|██        | 76/363 [00:27<01:36,  2.99it/s]
Loading 0:  21%|██        | 77/363 [00:28<02:07,  2.23it/s]
Loading 0:  21%|██▏       | 78/363 [00:29<02:39,  1.79it/s]
Loading 0:  22%|██▏       | 81/363 [00:29<01:33,  3.02it/s]
Loading 0:  23%|██▎       | 82/363 [00:30<01:28,  3.18it/s]
Loading 0:  23%|██▎       | 83/363 [00:30<01:16,  3.66it/s]
Loading 0:  23%|██▎       | 85/363 [00:31<01:32,  2.99it/s]
Loading 0:  24%|██▎       | 86/363 [00:31<02:04,  2.23it/s]
Loading 0:  24%|██▍       | 87/363 [00:32<02:35,  1.78it/s]
Loading 0:  25%|██▍       | 90/363 [00:33<01:30,  3.02it/s]
Loading 0:  25%|██▌       | 91/363 [00:33<01:25,  3.17it/s]
Loading 0:  25%|██▌       | 92/363 [00:33<01:13,  3.66it/s]
Loading 0:  26%|██▌       | 94/363 [00:34<01:29,  2.99it/s]
Loading 0:  26%|██▌       | 95/363 [00:35<01:59,  2.24it/s]
Loading 0:  26%|██▋       | 96/363 [00:36<02:29,  1.79it/s]
Loading 0:  27%|██▋       | 99/363 [00:36<01:27,  3.03it/s]
Loading 0:  28%|██▊       | 100/363 [00:36<01:22,  3.18it/s]
Loading 0:  28%|██▊       | 101/363 [00:36<01:11,  3.67it/s]
Loading 0:  28%|██▊       | 103/363 [00:37<01:26,  3.00it/s]
Loading 0:  29%|██▊       | 104/363 [00:38<01:55,  2.24it/s]
Loading 0:  29%|██▉       | 105/363 [00:39<02:23,  1.80it/s]
Loading 0:  30%|██▉       | 108/363 [00:39<01:23,  3.04it/s]
Loading 0:  30%|███       | 109/363 [00:40<01:19,  3.19it/s]
Loading 0:  30%|███       | 110/363 [00:40<01:08,  3.68it/s]
Loading 0:  31%|███       | 112/363 [00:41<01:23,  3.01it/s]
Loading 0:  31%|███       | 113/363 [00:41<01:51,  2.25it/s]
Loading 0:  31%|███▏      | 114/363 [00:42<02:18,  1.79it/s]
Loading 0:  32%|███▏      | 117/363 [00:43<01:21,  3.02it/s]
Loading 0:  33%|███▎      | 118/363 [00:43<01:17,  3.18it/s]
Loading 0:  33%|███▎      | 119/363 [00:43<01:07,  3.63it/s]
Loading 0:  33%|███▎      | 121/363 [00:44<01:26,  2.79it/s]
Loading 0:  34%|███▎      | 122/363 [00:45<01:51,  2.15it/s]
Loading 0:  34%|███▍      | 123/363 [00:46<02:17,  1.75it/s]
Loading 0:  35%|███▍      | 126/363 [00:46<01:19,  2.97it/s]
Loading 0:  35%|███▍      | 127/363 [00:46<01:15,  3.13it/s]
Loading 0:  35%|███▌      | 128/363 [00:46<01:05,  3.61it/s]
Loading 0:  36%|███▌      | 130/363 [00:47<01:18,  2.98it/s]
Loading 0:  36%|███▌      | 131/363 [00:48<01:43,  2.24it/s]
Loading 0:  36%|███▋      | 132/363 [00:49<02:09,  1.79it/s]
Loading 0:  37%|███▋      | 135/363 [00:49<01:15,  3.02it/s]
Loading 0:  37%|███▋      | 136/363 [00:50<01:11,  3.18it/s]
Loading 0:  38%|███▊      | 137/363 [00:50<01:01,  3.67it/s]
Loading 0:  38%|███▊      | 139/363 [00:51<01:14,  3.01it/s]
Loading 0:  39%|███▊      | 140/363 [00:51<01:39,  2.25it/s]
Loading 0:  39%|███▉      | 141/363 [00:52<02:03,  1.79it/s]
Loading 0:  40%|███▉      | 144/363 [00:53<01:12,  3.03it/s]
Loading 0:  40%|███▉      | 145/363 [00:53<01:08,  3.18it/s]
Loading 0:  40%|████      | 146/363 [00:53<00:59,  3.67it/s]
Loading 0:  41%|████      | 148/363 [00:54<01:11,  3.00it/s]
Loading 0:  41%|████      | 149/363 [00:55<01:35,  2.25it/s]
Loading 0:  41%|████▏     | 150/363 [00:56<01:58,  1.79it/s]
Loading 0:  42%|████▏     | 153/363 [00:56<01:09,  3.03it/s]
Loading 0:  42%|████▏     | 154/363 [00:56<01:05,  3.18it/s]
Loading 0:  43%|████▎     | 155/363 [00:56<00:56,  3.66it/s]
Loading 0:  43%|████▎     | 157/363 [00:57<01:08,  3.00it/s]
Loading 0:  44%|████▎     | 158/363 [00:58<01:31,  2.25it/s]
Loading 0:  44%|████▍     | 159/363 [00:59<01:53,  1.80it/s]
Loading 0:  45%|████▍     | 162/363 [00:59<01:05,  3.05it/s]
Loading 0:  45%|████▍     | 163/363 [01:00<01:02,  3.20it/s]
Loading 0:  45%|████▌     | 164/363 [01:00<00:54,  3.68it/s]
Loading 0:  46%|████▌     | 166/363 [01:01<01:05,  3.01it/s]
Loading 0:  46%|████▌     | 167/363 [01:01<01:26,  2.25it/s]
Loading 0:  46%|████▋     | 168/363 [01:02<01:48,  1.80it/s]
Loading 0:  47%|████▋     | 171/363 [01:03<01:03,  3.04it/s]
Loading 0:  47%|████▋     | 172/363 [01:03<00:59,  3.19it/s]
Loading 0:  48%|████▊     | 173/363 [01:03<00:51,  3.67it/s]
Loading 0:  48%|████▊     | 175/363 [01:04<01:02,  3.01it/s]
Loading 0:  48%|████▊     | 176/363 [01:05<01:23,  2.25it/s]
Loading 0:  49%|████▉     | 177/363 [01:06<01:43,  1.80it/s]
Loading 0:  50%|████▉     | 180/363 [01:06<00:59,  3.05it/s]
Loading 0:  50%|████▉     | 181/363 [01:06<00:56,  3.20it/s]
Loading 0:  50%|█████     | 182/363 [01:06<00:48,  3.70it/s]
Loading 0:  51%|█████     | 184/363 [01:07<00:59,  3.02it/s]
Loading 0:  51%|█████     | 185/363 [01:08<01:18,  2.26it/s]
Loading 0:  51%|█████     | 186/363 [01:09<01:38,  1.79it/s]
Loading 0:  52%|█████▏    | 189/363 [01:09<00:57,  3.03it/s]
Loading 0:  52%|█████▏    | 190/363 [01:10<00:54,  3.19it/s]
Loading 0:  53%|█████▎    | 191/363 [01:10<00:46,  3.66it/s]
Loading 0:  53%|█████▎    | 193/363 [01:11<00:56,  3.00it/s]
Loading 0:  53%|█████▎    | 194/363 [01:11<01:15,  2.25it/s]
Loading 0:  54%|█████▎    | 195/363 [01:12<01:33,  1.80it/s]
Loading 0:  55%|█████▍    | 198/363 [01:13<00:54,  3.05it/s]
Loading 0:  55%|█████▍    | 199/363 [01:13<00:51,  3.20it/s]
Loading 0:  55%|█████▌    | 200/363 [01:13<00:44,  3.69it/s]
Loading 0:  56%|█████▌    | 202/363 [01:14<00:57,  2.81it/s]
Loading 0:  56%|█████▌    | 203/363 [01:15<01:14,  2.16it/s]
Loading 0:  56%|█████▌    | 204/363 [01:16<01:30,  1.75it/s]
Loading 0:  57%|█████▋    | 207/363 [01:16<00:52,  2.98it/s]
Loading 0:  57%|█████▋    | 208/363 [01:16<00:49,  3.14it/s]
Loading 0:  58%|█████▊    | 209/363 [01:16<00:42,  3.63it/s]
Loading 0:  58%|█████▊    | 211/363 [01:17<00:50,  2.99it/s]
Loading 0:  58%|█████▊    | 212/363 [01:18<01:07,  2.24it/s]
Loading 0:  59%|█████▊    | 213/363 [01:19<01:24,  1.78it/s]
Loading 0:  60%|█████▉    | 216/363 [01:19<00:48,  3.01it/s]
Loading 0:  60%|█████▉    | 217/363 [01:20<00:46,  3.17it/s]
Loading 0:  60%|██████    | 218/363 [01:20<00:39,  3.65it/s]
Loading 0:  61%|██████    | 220/363 [01:21<00:47,  3.00it/s]
Loading 0:  61%|██████    | 221/363 [01:21<01:03,  2.25it/s]
Loading 0:  61%|██████    | 222/363 [01:22<01:18,  1.79it/s]
Loading 0:  62%|██████▏   | 225/363 [01:23<00:45,  3.03it/s]
Loading 0:  62%|██████▏   | 226/363 [01:23<00:42,  3.19it/s]
Loading 0:  63%|██████▎   | 227/363 [01:23<00:37,  3.67it/s]
Loading 0:  63%|██████▎   | 229/363 [01:24<00:44,  3.01it/s]
Loading 0:  63%|██████▎   | 230/363 [01:25<00:59,  2.25it/s]
Loading 0:  64%|██████▎   | 231/363 [01:26<01:13,  1.80it/s]
Loading 0:  64%|██████▍   | 234/363 [01:26<00:42,  3.05it/s]
Loading 0:  65%|██████▍   | 235/363 [01:26<00:39,  3.21it/s]
Loading 0:  65%|██████▌   | 236/363 [01:26<00:34,  3.69it/s]
Loading 0:  66%|██████▌   | 238/363 [01:27<00:41,  3.01it/s]
Loading 0:  66%|██████▌   | 239/363 [01:28<00:54,  2.25it/s]
Loading 0:  66%|██████▌   | 240/363 [01:29<01:08,  1.80it/s]
Loading 0:  67%|██████▋   | 243/363 [01:29<00:39,  3.04it/s]
Loading 0:  67%|██████▋   | 244/363 [01:30<00:37,  3.19it/s]
Loading 0:  67%|██████▋   | 245/363 [01:30<00:32,  3.67it/s]
Loading 0:  68%|██████▊   | 247/363 [01:31<00:38,  3.01it/s]
Loading 0:  68%|██████▊   | 248/363 [01:31<00:51,  2.25it/s]
Loading 0:  69%|██████▊   | 249/363 [01:32<01:03,  1.80it/s]
Loading 0:  69%|██████▉   | 252/363 [01:33<00:36,  3.04it/s]
Loading 0:  70%|██████▉   | 253/363 [01:33<00:34,  3.20it/s]
Loading 0:  70%|██████▉   | 254/363 [01:33<00:29,  3.69it/s]
Loading 0:  71%|███████   | 256/363 [01:34<00:35,  3.02it/s]
Loading 0:  71%|███████   | 257/363 [01:35<00:46,  2.26it/s]
Loading 0:  71%|███████   | 258/363 [01:36<00:58,  1.80it/s]
Loading 0:  72%|███████▏  | 261/363 [01:36<00:33,  3.04it/s]
Loading 0:  72%|███████▏  | 262/363 [01:36<00:31,  3.20it/s]
Loading 0:  72%|███████▏  | 263/363 [01:36<00:27,  3.67it/s]
Loading 0:  73%|███████▎  | 265/363 [01:37<00:32,  3.01it/s]
Loading 0:  73%|███████▎  | 266/363 [01:38<00:43,  2.25it/s]
Loading 0:  74%|███████▎  | 267/363 [01:39<00:53,  1.80it/s]
Loading 0:  74%|███████▍  | 270/363 [01:39<00:30,  3.05it/s]
Loading 0:  75%|███████▍  | 271/363 [01:39<00:28,  3.20it/s]
Loading 0:  75%|███████▍  | 272/363 [01:40<00:24,  3.68it/s]
Loading 0:  75%|███████▌  | 274/363 [01:40<00:29,  3.01it/s]
Loading 0:  76%|███████▌  | 275/363 [01:41<00:39,  2.25it/s]
Loading 0:  76%|███████▌  | 276/363 [01:42<00:48,  1.80it/s]
Loading 0:  77%|███████▋  | 279/363 [01:43<00:27,  3.05it/s]
Loading 0:  77%|███████▋  | 280/363 [01:43<00:25,  3.20it/s]
Loading 0:  77%|███████▋  | 281/363 [01:43<00:22,  3.69it/s]
Loading 0:  78%|███████▊  | 283/363 [01:44<00:28,  2.80it/s]
Loading 0:  78%|███████▊  | 284/363 [01:45<00:36,  2.16it/s]
Loading 0:  79%|███████▊  | 285/363 [01:46<00:44,  1.75it/s]
Loading 0:  79%|███████▉  | 288/363 [01:46<00:25,  2.97it/s]
Loading 0:  80%|███████▉  | 289/363 [01:46<00:23,  3.13it/s]
Loading 0:  80%|███████▉  | 290/363 [01:46<00:20,  3.60it/s]
Loading 0:  80%|████████  | 292/363 [01:47<00:23,  2.96it/s]
Loading 0:  81%|████████  | 293/363 [01:48<00:31,  2.23it/s]
Loading 0:  81%|████████  | 294/363 [01:49<00:38,  1.79it/s]
Loading 0:  82%|████████▏ | 297/363 [01:49<00:21,  3.03it/s]
Loading 0:  82%|████████▏ | 298/363 [01:50<00:20,  3.18it/s]
Loading 0:  82%|████████▏ | 299/363 [01:50<00:17,  3.66it/s]
Loading 0:  83%|████████▎ | 301/363 [01:51<00:20,  2.96it/s]
Loading 0:  83%|████████▎ | 302/363 [01:51<00:27,  2.23it/s]
Loading 0:  83%|████████▎ | 303/363 [01:52<00:33,  1.79it/s]
Loading 0:  84%|████████▍ | 306/363 [01:53<00:18,  3.03it/s]
Loading 0:  85%|████████▍ | 307/363 [01:53<00:17,  3.19it/s]
Loading 0:  85%|████████▍ | 308/363 [01:53<00:14,  3.67it/s]
Loading 0:  85%|████████▌ | 310/363 [01:54<00:17,  3.00it/s]
Loading 0:  86%|████████▌ | 311/363 [01:55<00:23,  2.24it/s]
Loading 0:  86%|████████▌ | 312/363 [01:56<00:28,  1.79it/s]
Loading 0:  87%|████████▋ | 315/363 [01:56<00:15,  3.02it/s]
Loading 0:  87%|████████▋ | 316/363 [01:56<00:14,  3.17it/s]
Loading 0:  87%|████████▋ | 317/363 [01:56<00:12,  3.63it/s]
Loading 0:  88%|████████▊ | 319/363 [01:57<00:14,  2.98it/s]
Loading 0:  88%|████████▊ | 320/363 [01:58<00:19,  2.23it/s]
Loading 0:  88%|████████▊ | 321/363 [01:59<00:23,  1.78it/s]
Loading 0:  89%|████████▉ | 324/363 [01:59<00:12,  3.01it/s]
Loading 0:  90%|████████▉ | 325/363 [02:00<00:12,  3.16it/s]
Loading 0:  90%|████████▉ | 326/363 [02:00<00:10,  3.64it/s]
Loading 0:  90%|█████████ | 328/363 [02:01<00:11,  2.99it/s]
Loading 0:  91%|█████████ | 329/363 [02:01<00:15,  2.24it/s]
Loading 0:  91%|█████████ | 330/363 [02:02<00:18,  1.80it/s]
Loading 0:  92%|█████████▏| 333/363 [02:03<00:09,  3.03it/s]
Loading 0:  92%|█████████▏| 334/363 [02:03<00:09,  3.18it/s]
Loading 0:  92%|█████████▏| 335/363 [02:03<00:07,  3.66it/s]
Loading 0:  93%|█████████▎| 337/363 [02:04<00:08,  3.00it/s]
Loading 0:  93%|█████████▎| 338/363 [02:05<00:11,  2.25it/s]
Loading 0:  93%|█████████▎| 339/363 [02:06<00:13,  1.79it/s]
Loading 0:  94%|█████████▍| 342/363 [02:06<00:06,  3.03it/s]
Loading 0:  94%|█████████▍| 343/363 [02:06<00:06,  3.19it/s]
Loading 0:  95%|█████████▍| 344/363 [02:06<00:05,  3.67it/s]
Loading 0:  95%|█████████▌| 346/363 [02:07<00:05,  3.00it/s]
Loading 0:  96%|█████████▌| 347/363 [02:08<00:07,  2.24it/s]
Loading 0:  96%|█████████▌| 348/363 [02:09<00:08,  1.79it/s]
Loading 0:  97%|█████████▋| 351/363 [02:09<00:03,  3.03it/s]
Loading 0:  97%|█████████▋| 352/363 [02:10<00:03,  3.19it/s]
Loading 0:  97%|█████████▋| 353/363 [02:10<00:02,  3.67it/s]
Loading 0:  98%|█████████▊| 355/363 [02:11<00:02,  2.99it/s]
Loading 0:  98%|█████████▊| 356/363 [02:11<00:03,  2.24it/s]
Loading 0:  98%|█████████▊| 357/363 [02:12<00:03,  1.79it/s]
Loading 0:  99%|█████████▉| 360/363 [02:13<00:00,  3.03it/s]
Loading 0:  99%|█████████▉| 361/363 [02:13<00:00,  3.18it/s]
Loading 0: 100%|█████████▉| 362/363 [02:13<00:00,  3.66it/s]
                                                            
Job nothingiisreal-mn-12b-s-43653-v3-mkmlizer completed after 296.57s with status: succeeded
Stopping job with name nothingiisreal-mn-12b-s-43653-v3-mkmlizer
Pipeline stage MKMLizer completed in 297.26s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service nothingiisreal-mn-12b-s-43653-v3
Waiting for inference service nothingiisreal-mn-12b-s-43653-v3 to be ready
Inference service nothingiisreal-mn-12b-s-43653-v3 ready after 30.124003648757935s
Pipeline stage MKMLDeployer completed in 30.62s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.341571569442749s
Received healthy response to inference request in 1.0762646198272705s
Received healthy response to inference request in 0.5725233554840088s
Received healthy response to inference request in 1.0672662258148193s
5 requests
1 failed requests
5th percentile: 0.6714719295501709
10th percentile: 0.770420503616333
20th percentile: 0.9683176517486572
30th percentile: 1.0690659046173097
40th percentile: 1.07266526222229
50th percentile: 1.0762646198272705
60th percentile: 1.182387399673462
70th percentile: 1.2885101795196532
80th percentile: 5.099267244338993
90th percentile: 12.614658594131472
95th percentile: 16.372354269027706
99th percentile: 19.3785108089447
mean time: 4.83753514289856
%s, retrying in %s seconds...
Received healthy response to inference request in 1.056779146194458s
Received healthy response to inference request in 0.5960111618041992s
Received healthy response to inference request in 1.161367654800415s
Received healthy response to inference request in 1.482102394104004s
Received healthy response to inference request in 1.1461312770843506s
5 requests
0 failed requests
5th percentile: 0.688164758682251
10th percentile: 0.7803183555603027
20th percentile: 0.9646255493164063
30th percentile: 1.0746495723724365
40th percentile: 1.1103904247283936
50th percentile: 1.1461312770843506
60th percentile: 1.1522258281707765
70th percentile: 1.158320379257202
80th percentile: 1.2255146026611328
90th percentile: 1.3538084983825684
95th percentile: 1.4179554462432862
99th percentile: 1.4692730045318603
mean time: 1.0884783267974854
Pipeline stage StressChecker completed in 32.42s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.66s
Shutdown handler de-registered
nothingiisreal-mn-12b-s_43653_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2562.63s
Shutdown handler de-registered
nothingiisreal-mn-12b-s_43653_v3 status is now inactive due to auto deactivation removed underperforming models
nothingiisreal-mn-12b-s_43653_v3 status is now torndown due to DeploymentManager action