chaiml-rirv938-0sw-96p-_18713

developer_uid: NischayDnk
submission_id: chaiml-rirv938-0sw-96p-_18713_v9
model_name: chaiml-rirv938-0sw-96p-_18713_v9
model_group: ChaiML/rirv938-0sw-96p-4
status: torndown
timestamp: 2025-08-20T16:11:04+00:00
num_battles: 5342
num_wins: 2989
celo_rating: 1289.94
family_friendly_score: 0.492
family_friendly_standard_error: 0.007070162657251953
submission_type: basic
model_repo: ChaiML/rirv938-0sw-96p-4ff-cha_93234_v2_w0
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 7
max_input_tokens: 1400
max_output_tokens: 70
reward_model: default
display_name: chaiml-rirv938-0sw-96p-_18713_v9
ineligible_reason: model is not deployable
is_internal_developer: False
language_model: ChaiML/rirv938-0sw-96p-4ff-cha_93234_v2_w0
model_size: 13B
ranking_group: single
us_pacific_date: 2025-08-20
win_ratio: 0.5595282665668289
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|im_start|>', 'User:', 'You:', '<|eot_id|>', 'Bot:', '</s>', '####', '<|im_end|>'], 'max_input_tokens': 1400, 'best_of': 7, 'max_output_tokens': 70}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-rirv938-0sw-96p-18713-v9-mkmlizer
Waiting for job on chaiml-rirv938-0sw-96p-18713-v9-mkmlizer to finish
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║                                                                     ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║                                                                     ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  Version: 0.30.2                                                    ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║                                                                     ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  belonging to:                                                      ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║                                                                     ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ║                                                                     ║
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: Downloaded to shared memory in 16.101s
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: Checking if ChaiML/rirv938-0sw-96p-4ff-cha_93234_v2_w0 already exists in ChaiML
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmp_trxt7zm, device:0
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: quantized model in 160.589s
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: Processed model ChaiML/rirv938-0sw-96p-4ff-cha_93234_v2_w0 in 176.690s
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: creating bucket guanaco-mkml-models
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-rirv938-0sw-96p-18713-v9/nvidia
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-rirv938-0sw-96p-18713-v9/nvidia/config.json
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-rirv938-0sw-96p-18713-v9/nvidia/special_tokens_map.json
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-rirv938-0sw-96p-18713-v9/nvidia/tokenizer_config.json
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-rirv938-0sw-96p-18713-v9/nvidia/tokenizer.json
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-rirv938-0sw-96p-18713-v9/nvidia/flywheel_model.0.safetensors
chaiml-rirv938-0sw-96p-18713-v9-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/363 [00:00<00:30, 12.01it/s]
Loading 0:   1%|          | 4/363 [00:01<01:55,  3.11it/s]
Loading 0:   1%|▏         | 5/363 [00:02<03:04,  1.94it/s]
Loading 0:   2%|▏         | 6/363 [00:03<04:01,  1.48it/s]
Loading 0:   2%|▏         | 9/363 [00:03<02:08,  2.75it/s]
Loading 0:   3%|▎         | 10/363 [00:03<02:03,  2.85it/s]
Loading 0:   3%|▎         | 11/363 [00:03<01:46,  3.32it/s]
Loading 0:   4%|▎         | 13/363 [00:04<02:12,  2.65it/s]
Loading 0:   4%|▍         | 14/363 [00:05<02:56,  1.97it/s]
Loading 0:   4%|▍         | 15/363 [00:06<03:40,  1.58it/s]
Loading 0:   5%|▍         | 18/363 [00:07<02:08,  2.69it/s]
Loading 0:   5%|▌         | 19/363 [00:07<02:01,  2.83it/s]
Loading 0:   6%|▌         | 20/363 [00:07<01:45,  3.25it/s]
Loading 0:   6%|▌         | 22/363 [00:08<02:08,  2.65it/s]
Loading 0:   6%|▋         | 23/363 [00:09<02:51,  1.98it/s]
Loading 0:   7%|▋         | 24/363 [00:10<03:34,  1.58it/s]
Loading 0:   7%|▋         | 27/363 [00:11<02:05,  2.68it/s]
Loading 0:   8%|▊         | 28/363 [00:11<01:58,  2.82it/s]
Loading 0:   8%|▊         | 29/363 [00:11<01:42,  3.26it/s]
Loading 0:   9%|▊         | 31/363 [00:12<02:04,  2.66it/s]
Loading 0:   9%|▉         | 32/363 [00:13<02:46,  1.99it/s]
Loading 0:   9%|▉         | 33/363 [00:14<03:28,  1.58it/s]
Loading 0:  10%|▉         | 36/363 [00:14<02:01,  2.68it/s]
Loading 0:  10%|█         | 37/363 [00:15<01:55,  2.82it/s]
Loading 0:  10%|█         | 38/363 [00:15<01:39,  3.26it/s]
Loading 0:  11%|█         | 40/363 [00:16<02:01,  2.66it/s]
Loading 0:  11%|█▏        | 41/363 [00:17<02:41,  1.99it/s]
Loading 0:  12%|█▏        | 42/363 [00:18<03:21,  1.59it/s]
Loading 0:  12%|█▏        | 45/363 [00:18<01:57,  2.70it/s]
Loading 0:  13%|█▎        | 46/363 [00:18<01:51,  2.83it/s]
Loading 0:  13%|█▎        | 47/363 [00:18<01:37,  3.24it/s]
Loading 0:  13%|█▎        | 49/363 [00:19<01:58,  2.66it/s]
Loading 0:  14%|█▍        | 50/363 [00:20<02:37,  1.99it/s]
Loading 0:  14%|█▍        | 51/363 [00:21<03:14,  1.60it/s]
Loading 0:  15%|█▍        | 54/363 [00:22<01:54,  2.70it/s]
Loading 0:  15%|█▌        | 55/363 [00:22<01:48,  2.84it/s]
Loading 0:  15%|█▌        | 56/363 [00:22<01:33,  3.29it/s]
Loading 0:  16%|█▌        | 58/363 [00:23<01:53,  2.68it/s]
Loading 0:  16%|█▋        | 59/363 [00:24<02:32,  2.00it/s]
Loading 0:  17%|█▋        | 60/363 [00:25<03:11,  1.58it/s]
Loading 0:  17%|█▋        | 63/363 [00:26<01:52,  2.67it/s]
Loading 0:  18%|█▊        | 64/363 [00:26<01:46,  2.81it/s]
Loading 0:  18%|█▊        | 65/363 [00:26<01:34,  3.16it/s]
Loading 0:  18%|█▊        | 67/363 [00:27<01:52,  2.62it/s]
Loading 0:  19%|█▊        | 68/363 [00:28<02:29,  1.97it/s]
Loading 0:  19%|█▉        | 69/363 [00:29<03:04,  1.59it/s]
Loading 0:  20%|█▉        | 72/363 [00:29<01:47,  2.70it/s]
Loading 0:  20%|██        | 73/363 [00:30<01:42,  2.83it/s]
Loading 0:  20%|██        | 74/363 [00:30<01:28,  3.25it/s]
Loading 0:  21%|██        | 76/363 [00:31<01:47,  2.66it/s]
Loading 0:  21%|██        | 77/363 [00:32<02:24,  1.97it/s]
Loading 0:  21%|██▏       | 78/363 [00:33<03:01,  1.57it/s]
Loading 0:  22%|██▏       | 81/363 [00:33<01:45,  2.66it/s]
Loading 0:  23%|██▎       | 82/363 [00:33<01:40,  2.81it/s]
Loading 0:  23%|██▎       | 83/363 [00:34<01:26,  3.25it/s]
Loading 0:  23%|██▎       | 85/363 [00:34<01:44,  2.66it/s]
Loading 0:  24%|██▎       | 86/363 [00:35<02:19,  1.99it/s]
Loading 0:  24%|██▍       | 87/363 [00:36<02:53,  1.59it/s]
Loading 0:  25%|██▍       | 90/363 [00:37<01:41,  2.70it/s]
Loading 0:  25%|██▌       | 91/363 [00:37<01:36,  2.83it/s]
Loading 0:  25%|██▌       | 92/363 [00:37<01:23,  3.24it/s]
Loading 0:  26%|██▌       | 94/363 [00:38<01:41,  2.66it/s]
Loading 0:  26%|██▌       | 95/363 [00:39<02:14,  1.99it/s]
Loading 0:  26%|██▋       | 96/363 [00:40<02:47,  1.60it/s]
Loading 0:  27%|██▋       | 99/363 [00:41<01:37,  2.70it/s]
Loading 0:  28%|██▊       | 100/363 [00:41<01:32,  2.84it/s]
Loading 0:  28%|██▊       | 101/363 [00:41<01:20,  3.25it/s]
Loading 0:  28%|██▊       | 103/363 [00:42<01:37,  2.67it/s]
Loading 0:  29%|██▊       | 104/363 [00:43<02:09,  1.99it/s]
Loading 0:  29%|██▉       | 105/363 [00:44<02:42,  1.59it/s]
Loading 0:  30%|██▉       | 108/363 [00:44<01:34,  2.69it/s]
Loading 0:  30%|███       | 109/363 [00:45<01:29,  2.83it/s]
Loading 0:  30%|███       | 110/363 [00:45<01:17,  3.28it/s]
Loading 0:  31%|███       | 112/363 [00:46<01:33,  2.68it/s]
Loading 0:  31%|███       | 113/363 [00:47<02:04,  2.00it/s]
Loading 0:  31%|███▏      | 114/363 [00:48<02:35,  1.60it/s]
Loading 0:  32%|███▏      | 117/363 [00:48<01:30,  2.71it/s]
Loading 0:  33%|███▎      | 118/363 [00:48<01:25,  2.85it/s]
Loading 0:  33%|███▎      | 119/363 [00:48<01:14,  3.29it/s]
Loading 0:  33%|███▎      | 121/363 [00:49<01:30,  2.68it/s]
Loading 0:  34%|███▎      | 122/363 [00:50<02:00,  2.00it/s]
Loading 0:  34%|███▍      | 123/363 [00:51<02:30,  1.60it/s]
Loading 0:  35%|███▍      | 126/363 [00:52<01:27,  2.69it/s]
Loading 0:  35%|███▍      | 127/363 [00:52<01:23,  2.83it/s]
Loading 0:  35%|███▌      | 128/363 [00:52<01:11,  3.28it/s]
Loading 0:  36%|███▌      | 130/363 [00:53<01:26,  2.68it/s]
Loading 0:  36%|███▌      | 131/363 [00:54<01:55,  2.01it/s]
Loading 0:  36%|███▋      | 132/363 [00:55<02:39,  1.45it/s]
Loading 0:  37%|███▋      | 135/363 [00:56<01:31,  2.49it/s]
Loading 0:  37%|███▋      | 136/363 [00:56<01:25,  2.65it/s]
Loading 0:  38%|███▊      | 137/363 [00:56<01:13,  3.06it/s]
Loading 0:  38%|███▊      | 139/363 [00:57<01:26,  2.59it/s]
Loading 0:  39%|███▊      | 140/363 [00:58<01:53,  1.96it/s]
Loading 0:  39%|███▉      | 141/363 [00:59<02:20,  1.58it/s]
Loading 0:  40%|███▉      | 144/363 [00:59<01:21,  2.68it/s]
Loading 0:  40%|███▉      | 145/363 [01:00<01:17,  2.82it/s]
Loading 0:  40%|████      | 146/363 [01:00<01:06,  3.27it/s]
Loading 0:  41%|████      | 148/363 [01:01<01:20,  2.67it/s]
Loading 0:  41%|████      | 149/363 [01:02<01:47,  2.00it/s]
Loading 0:  41%|████▏     | 150/363 [01:03<02:13,  1.60it/s]
Loading 0:  42%|████▏     | 153/363 [01:03<01:17,  2.71it/s]
Loading 0:  42%|████▏     | 154/363 [01:03<01:13,  2.85it/s]
Loading 0:  43%|████▎     | 155/363 [01:04<01:03,  3.27it/s]
Loading 0:  43%|████▎     | 157/363 [01:05<01:16,  2.68it/s]
Loading 0:  44%|████▎     | 158/363 [01:06<01:42,  2.01it/s]
Loading 0:  44%|████▍     | 159/363 [01:07<02:06,  1.61it/s]
Loading 0:  45%|████▍     | 162/363 [01:07<01:13,  2.73it/s]
Loading 0:  45%|████▍     | 163/363 [01:07<01:09,  2.87it/s]
Loading 0:  45%|████▌     | 164/363 [01:07<00:59,  3.32it/s]
Loading 0:  46%|████▌     | 166/363 [01:08<01:13,  2.70it/s]
Loading 0:  46%|████▌     | 167/363 [01:09<01:37,  2.01it/s]
Loading 0:  46%|████▋     | 168/363 [01:10<02:01,  1.61it/s]
Loading 0:  47%|████▋     | 171/363 [01:11<01:10,  2.71it/s]
Loading 0:  47%|████▋     | 172/363 [01:11<01:06,  2.85it/s]
Loading 0:  48%|████▊     | 173/363 [01:11<00:57,  3.28it/s]
Loading 0:  48%|████▊     | 175/363 [01:12<01:09,  2.69it/s]
Loading 0:  48%|████▊     | 176/363 [01:13<01:33,  2.01it/s]
Loading 0:  49%|████▉     | 177/363 [01:14<01:55,  1.61it/s]
Loading 0:  50%|████▉     | 180/363 [01:14<01:07,  2.73it/s]
Loading 0:  50%|████▉     | 181/363 [01:15<01:03,  2.87it/s]
Loading 0:  50%|█████     | 182/363 [01:15<00:54,  3.31it/s]
Loading 0:  51%|█████     | 184/363 [01:16<01:06,  2.70it/s]
Loading 0:  51%|█████     | 185/363 [01:17<01:28,  2.02it/s]
Loading 0:  51%|█████     | 186/363 [01:18<01:50,  1.61it/s]
Loading 0:  52%|█████▏    | 189/363 [01:18<01:03,  2.72it/s]
Loading 0:  52%|█████▏    | 190/363 [01:18<01:00,  2.86it/s]
Loading 0:  53%|█████▎    | 191/363 [01:18<00:52,  3.31it/s]
Loading 0:  53%|█████▎    | 193/363 [01:19<01:03,  2.70it/s]
Loading 0:  53%|█████▎    | 194/363 [01:20<01:23,  2.02it/s]
Loading 0:  54%|█████▎    | 195/363 [01:21<01:44,  1.61it/s]
Loading 0:  55%|█████▍    | 198/363 [01:22<01:00,  2.72it/s]
Loading 0:  55%|█████▍    | 199/363 [01:22<00:57,  2.86it/s]
Loading 0:  55%|█████▌    | 200/363 [01:22<00:49,  3.30it/s]
Loading 0:  56%|█████▌    | 202/363 [01:23<00:59,  2.69it/s]
Loading 0:  56%|█████▌    | 203/363 [01:24<01:19,  2.02it/s]
Loading 0:  56%|█████▌    | 204/363 [01:25<01:38,  1.62it/s]
Loading 0:  57%|█████▋    | 207/363 [01:25<00:57,  2.73it/s]
Loading 0:  57%|█████▋    | 208/363 [01:26<00:54,  2.87it/s]
Loading 0:  58%|█████▊    | 209/363 [01:26<00:46,  3.28it/s]
Loading 0:  58%|█████▊    | 211/363 [01:27<00:56,  2.69it/s]
Loading 0:  58%|█████▊    | 212/363 [01:28<01:15,  2.01it/s]
Loading 0:  59%|█████▊    | 213/363 [01:29<01:33,  1.61it/s]
Loading 0:  60%|█████▉    | 216/363 [01:29<00:54,  2.72it/s]
Loading 0:  60%|█████▉    | 217/363 [01:29<00:51,  2.85it/s]
Loading 0:  60%|██████    | 218/363 [01:30<00:43,  3.30it/s]
Loading 0:  61%|██████    | 220/363 [01:30<00:52,  2.70it/s]
Loading 0:  61%|██████    | 221/363 [01:31<01:10,  2.02it/s]
Loading 0:  61%|██████    | 222/363 [01:32<01:27,  1.62it/s]
Loading 0:  62%|██████▏   | 225/363 [01:33<00:50,  2.73it/s]
Loading 0:  62%|██████▏   | 226/363 [01:33<00:47,  2.87it/s]
Loading 0:  63%|██████▎   | 227/363 [01:33<00:41,  3.30it/s]
Loading 0:  63%|██████▎   | 229/363 [01:34<00:49,  2.70it/s]
Loading 0:  63%|██████▎   | 230/363 [01:35<01:05,  2.02it/s]
Loading 0:  64%|██████▎   | 231/363 [01:36<01:21,  1.62it/s]
Loading 0:  64%|██████▍   | 234/363 [01:36<00:47,  2.74it/s]
Loading 0:  65%|██████▍   | 235/363 [01:37<00:44,  2.87it/s]
Loading 0:  65%|██████▌   | 236/363 [01:37<00:38,  3.33it/s]
Loading 0:  66%|██████▌   | 238/363 [01:38<00:46,  2.71it/s]
Loading 0:  66%|██████▌   | 239/363 [01:39<01:01,  2.02it/s]
Loading 0:  66%|██████▌   | 240/363 [01:40<01:16,  1.61it/s]
Loading 0:  67%|██████▋   | 243/363 [01:40<00:44,  2.72it/s]
Loading 0:  67%|██████▋   | 244/363 [01:40<00:41,  2.86it/s]
Loading 0:  67%|██████▋   | 245/363 [01:41<00:35,  3.31it/s]
Loading 0:  68%|██████▊   | 247/363 [01:42<00:42,  2.70it/s]
Loading 0:  68%|██████▊   | 248/363 [01:42<00:56,  2.02it/s]
Loading 0:  69%|██████▊   | 249/363 [01:44<01:10,  1.61it/s]
Loading 0:  69%|██████▉   | 252/363 [01:44<00:40,  2.73it/s]
Loading 0:  70%|██████▉   | 253/363 [01:44<00:38,  2.87it/s]
Loading 0:  70%|██████▉   | 254/363 [01:44<00:32,  3.32it/s]
Loading 0:  71%|███████   | 256/363 [01:45<00:39,  2.71it/s]
Loading 0:  71%|███████   | 257/363 [01:46<00:52,  2.02it/s]
Loading 0:  71%|███████   | 258/363 [01:47<01:04,  1.62it/s]
Loading 0:  72%|███████▏  | 261/363 [01:48<00:37,  2.74it/s]
Loading 0:  72%|███████▏  | 262/363 [01:48<00:35,  2.87it/s]
Loading 0:  72%|███████▏  | 263/363 [01:48<00:30,  3.32it/s]
Loading 0:  73%|███████▎  | 265/363 [01:49<00:36,  2.71it/s]
Loading 0:  73%|███████▎  | 266/363 [01:50<00:47,  2.02it/s]
Loading 0:  74%|███████▎  | 267/363 [01:51<00:59,  1.61it/s]
Loading 0:  74%|███████▍  | 270/363 [01:51<00:34,  2.73it/s]
Loading 0:  75%|███████▍  | 271/363 [01:52<00:32,  2.87it/s]
Loading 0:  75%|███████▍  | 272/363 [01:52<00:27,  3.31it/s]
Loading 0:  75%|███████▌  | 274/363 [01:53<00:32,  2.70it/s]
Loading 0:  76%|███████▌  | 275/363 [01:54<00:43,  2.02it/s]
Loading 0:  76%|███████▌  | 276/363 [01:55<00:53,  1.62it/s]
Loading 0:  77%|███████▋  | 279/363 [01:55<00:30,  2.73it/s]
Loading 0:  77%|███████▋  | 280/363 [01:55<00:28,  2.87it/s]
Loading 0:  77%|███████▋  | 281/363 [01:55<00:24,  3.31it/s]
Loading 0:  78%|███████▊  | 283/363 [01:56<00:29,  2.70it/s]
Loading 0:  78%|███████▊  | 284/363 [01:57<00:39,  2.02it/s]
Loading 0:  79%|███████▊  | 285/363 [01:58<00:48,  1.61it/s]
Loading 0:  79%|███████▉  | 288/363 [01:59<00:27,  2.72it/s]
Loading 0:  80%|███████▉  | 289/363 [01:59<00:25,  2.86it/s]
Loading 0:  80%|███████▉  | 290/363 [01:59<00:22,  3.31it/s]
Loading 0:  80%|████████  | 292/363 [02:00<00:26,  2.69it/s]
Loading 0:  81%|████████  | 293/363 [02:01<00:34,  2.02it/s]
Loading 0:  81%|████████  | 294/363 [02:02<00:42,  1.62it/s]
Loading 0:  82%|████████▏ | 297/363 [02:02<00:24,  2.73it/s]
Loading 0:  82%|████████▏ | 298/363 [02:03<00:22,  2.86it/s]
Loading 0:  82%|████████▏ | 299/363 [02:03<00:19,  3.31it/s]
Loading 0:  83%|████████▎ | 301/363 [02:04<00:23,  2.67it/s]
Loading 0:  83%|████████▎ | 302/363 [02:05<00:30,  2.01it/s]
Loading 0:  83%|████████▎ | 303/363 [02:06<00:37,  1.60it/s]
Loading 0:  84%|████████▍ | 306/363 [02:06<00:21,  2.71it/s]
Loading 0:  85%|████████▍ | 307/363 [02:06<00:19,  2.85it/s]
Loading 0:  85%|████████▍ | 308/363 [02:06<00:16,  3.29it/s]
Loading 0:  85%|████████▌ | 310/363 [02:08<00:22,  2.39it/s]
Loading 0:  86%|████████▌ | 311/363 [02:09<00:27,  1.88it/s]
Loading 0:  86%|████████▌ | 312/363 [02:10<00:33,  1.54it/s]
Loading 0:  87%|████████▋ | 315/363 [02:10<00:18,  2.63it/s]
Loading 0:  87%|████████▋ | 316/363 [02:10<00:16,  2.77it/s]
Loading 0:  87%|████████▋ | 317/363 [02:10<00:14,  3.22it/s]
Loading 0:  88%|████████▊ | 319/363 [02:11<00:16,  2.66it/s]
Loading 0:  88%|████████▊ | 320/363 [02:12<00:21,  2.00it/s]
Loading 0:  88%|████████▊ | 321/363 [02:13<00:26,  1.60it/s]
Loading 0:  89%|████████▉ | 324/363 [02:14<00:14,  2.71it/s]
Loading 0:  90%|████████▉ | 325/363 [02:14<00:13,  2.85it/s]
Loading 0:  90%|████████▉ | 326/363 [02:14<00:11,  3.29it/s]
Loading 0:  90%|█████████ | 328/363 [02:15<00:13,  2.69it/s]
Loading 0:  91%|█████████ | 329/363 [02:16<00:16,  2.01it/s]
Loading 0:  91%|█████████ | 330/363 [02:17<00:20,  1.61it/s]
Loading 0:  92%|█████████▏| 333/363 [02:17<00:11,  2.72it/s]
Loading 0:  92%|█████████▏| 334/363 [02:18<00:10,  2.86it/s]
Loading 0:  92%|█████████▏| 335/363 [02:18<00:08,  3.31it/s]
Loading 0:  93%|█████████▎| 337/363 [02:19<00:09,  2.70it/s]
Loading 0:  93%|█████████▎| 338/363 [02:20<00:12,  2.02it/s]
Loading 0:  93%|█████████▎| 339/363 [02:21<00:14,  1.61it/s]
Loading 0:  94%|█████████▍| 342/363 [02:21<00:07,  2.72it/s]
Loading 0:  94%|█████████▍| 343/363 [02:21<00:06,  2.86it/s]
Loading 0:  95%|█████████▍| 344/363 [02:21<00:05,  3.31it/s]
Loading 0:  95%|█████████▌| 346/363 [02:22<00:06,  2.67it/s]
Loading 0:  96%|█████████▌| 347/363 [02:23<00:07,  2.01it/s]
Loading 0:  96%|█████████▌| 348/363 [02:24<00:09,  1.61it/s]
Loading 0:  97%|█████████▋| 351/363 [02:25<00:04,  2.72it/s]
Loading 0:  97%|█████████▋| 352/363 [02:25<00:03,  2.86it/s]
Loading 0:  97%|█████████▋| 353/363 [02:25<00:03,  3.31it/s]
Loading 0:  98%|█████████▊| 355/363 [02:26<00:02,  2.70it/s]
Loading 0:  98%|█████████▊| 356/363 [02:27<00:03,  2.02it/s]
Loading 0:  98%|█████████▊| 357/363 [02:28<00:03,  1.62it/s]
Loading 0:  99%|█████████▉| 360/363 [02:28<00:01,  2.73it/s]
Loading 0:  99%|█████████▉| 361/363 [02:29<00:00,  2.87it/s]
Loading 0: 100%|█████████▉| 362/363 [02:29<00:00,  3.32it/s]
                                                            
Job chaiml-rirv938-0sw-96p-18713-v9-mkmlizer completed after 205.13s with status: succeeded
Stopping job with name chaiml-rirv938-0sw-96p-18713-v9-mkmlizer
Pipeline stage MKMLizer completed in 205.53s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-rirv938-0sw-96p-18713-v9
Waiting for inference service chaiml-rirv938-0sw-96p-18713-v9 to be ready
Inference service chaiml-rirv938-0sw-96p-18713-v9 ready after 80.6551296710968s
Pipeline stage MKMLDeployer completed in 81.09s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.5780367851257324s
Received healthy response to inference request in 1.599278211593628s
Received healthy response to inference request in 1.2543766498565674s
Received healthy response to inference request in 1.575535535812378s
Received healthy response to inference request in 1.779475212097168s
5 requests
0 failed requests
5th percentile: 1.3186084270477294
10th percentile: 1.3828402042388916
20th percentile: 1.511303758621216
30th percentile: 1.5760357856750489
40th percentile: 1.5770362854003905
50th percentile: 1.5780367851257324
60th percentile: 1.5865333557128907
70th percentile: 1.595029926300049
80th percentile: 1.635317611694336
90th percentile: 1.7073964118957519
95th percentile: 1.74343581199646
99th percentile: 1.7722673320770264
mean time: 1.5573404788970948
Pipeline stage StressChecker completed in 9.22s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.63s
Shutdown handler de-registered
chaiml-rirv938-0sw-96p-_18713_v9 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.14s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.12s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service chaiml-rirv938-0sw-96p-18713-v9-profiler
Waiting for inference service chaiml-rirv938-0sw-96p-18713-v9-profiler to be ready
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2456.15s
Shutdown handler de-registered
chaiml-rirv938-0sw-96p-_18713_v9 status is now protected due to ABTestQueueItem
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.53s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.44s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service chaiml-rirv938-0sw-96p-18713-v9-profiler
Waiting for inference service chaiml-rirv938-0sw-96p-18713-v9-profiler to be ready
Inference service chaiml-rirv938-0sw-96p-18713-v9-profiler ready after 71.20587944984436s
Pipeline stage MKMLProfilerDeployer completed in 72.51s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl --kubeconfig /opt/project/guanaco_services/resources/cks_kube_config cp /opt/project/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/chaiml-rirv938-0sw-9ace2c9d89ff3b84235f47378735b0828-deplotkrb4:/code/chaiverse_profiler_1757955138 --namespace tenant-chaiml-guanaco
kubectl --kubeconfig /opt/project/guanaco_services/resources/cks_kube_config exec -it chaiml-rirv938-0sw-9ace2c9d89ff3b84235f47378735b0828-deplotkrb4 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1757955138 && python profiles.py profile --best_of_n 7 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 1400 --output_tokens 70 --summary /code/chaiverse_profiler_1757955138/summary.json'
kubectl --kubeconfig /opt/project/guanaco_services/resources/cks_kube_config exec -it chaiml-rirv938-0sw-9ace2c9d89ff3b84235f47378735b0828-deplotkrb4 --namespace tenant-chaiml-guanaco -- bash -c 'cat /code/chaiverse_profiler_1757955138/summary.json'
Pipeline stage MKMLProfilerRunner completed in 765.13s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service chaiml-rirv938-0sw-96p-18713-v9-profiler is running
Tearing down inference service chaiml-rirv938-0sw-96p-18713-v9-profiler
Service chaiml-rirv938-0sw-96p-18713-v9-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 2.35s
Shutdown handler de-registered
chaiml-rirv938-0sw-96p-_18713_v9 status is now torndown due to DeploymentManager action