kaoeiri-pantheramax-l3-r_7856

submission_id: kaoeiri-pantheramax-l3-r_7856_v3
developer_uid: helkero
best_of: 4
celo_rating: 1136.86
display_name: kaoeiri-pantheramax-l3-r_7856_v3
family_friendly_score: 0.0
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.075, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: False
language_model: Kaoeiri/PantheraMax-L3-RP-TestProbe-5-8x8B
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MixtralForCausalLM
model_group: Kaoeiri/PantheraMax-L3-R
model_name: kaoeiri-pantheramax-l3-r_7856_v3
model_num_parameters: 47491321856.0
model_repo: Kaoeiri/PantheraMax-L3-RP-TestProbe-5-8x8B
model_size: 47B
num_battles: 19830
num_wins: 8583
ranking_group: single
reward_formatter: {'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '<|im_start|>user\n{prompt}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': False, 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n'}
reward_repo: Jellywibble/CHAI_alignment_reward_model
status: torndown
submission_type: basic
timestamp: 2024-07-04T18:41:51+00:00
us_pacific_date: 2024-07-04
win_ratio: 0.43282904689863844
Resubmit model
Running pipeline stage MKMLizer
Starting job with name kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer
Waiting for job on kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer to finish
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║     _____            __           __                                ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║       /___/                                                         ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║                                                                     ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  Version: 0.8.14                                                    ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  https://mk1.ai                                                     ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║                                                                     ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  belonging to:                                                      ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║                                                                     ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  Chai Research Corp.                                                ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ║                                                                     ║
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Downloaded to shared memory in 181.490s
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: quantizing model to /dev/shm/model_cache
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission trace2333-joint-filtered_3791_v5: ('http://trace2333-joint-filtered-3791-v5-predictor-default.tenant-chaiml-guanaco.knative.ord1.coreweave.cloud/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:42738->127.0.0.1:8080: read: connection reset by peer\n')
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: 
Loading 0:   0%|          | 0/995 [00:00<?, ?it/s]
Loading 0:   1%|          | 6/995 [00:00<00:16, 58.69it/s]
Loading 0:   1%|          | 12/995 [00:00<00:18, 54.58it/s]
Loading 0:   2%|▏         | 18/995 [00:00<00:18, 53.50it/s]
Loading 0:   2%|▏         | 24/995 [00:00<00:18, 53.05it/s]
Loading 0:   4%|▎         | 35/995 [00:00<00:13, 69.23it/s]
Loading 0:   4%|▍         | 42/995 [00:00<00:15, 61.38it/s]
Loading 0:   5%|▍         | 49/995 [00:00<00:16, 56.36it/s]
Loading 0:   6%|▌         | 55/995 [00:00<00:17, 54.91it/s]
Loading 0:   7%|▋         | 66/995 [00:01<00:13, 67.56it/s]
Loading 0:   7%|▋         | 73/995 [00:01<00:15, 60.89it/s]
Loading 0:   8%|▊         | 80/995 [00:01<00:15, 57.66it/s]
Loading 0:   9%|▉         | 88/995 [00:01<00:14, 63.18it/s]
Loading 0:  10%|▉         | 99/995 [00:02<00:32, 27.52it/s]
Loading 0:  11%|█         | 105/995 [00:02<00:28, 30.70it/s]
Loading 0:  11%|█         | 111/995 [00:02<00:26, 33.97it/s]
Loading 0:  12%|█▏        | 117/995 [00:02<00:23, 36.81it/s]
Loading 0:  12%|█▏        | 122/995 [00:02<00:22, 38.88it/s]
Loading 0:  13%|█▎        | 128/995 [00:02<00:20, 41.70it/s]
Loading 0:  13%|█▎        | 133/995 [00:02<00:19, 43.29it/s]
Loading 0:  14%|█▍        | 139/995 [00:03<00:19, 45.03it/s]
Loading 0:  14%|█▍        | 144/995 [00:03<00:18, 45.94it/s]
Loading 0:  16%|█▌        | 155/995 [00:03<00:14, 59.94it/s]
Loading 0:  16%|█▋        | 162/995 [00:03<00:14, 56.75it/s]
Loading 0:  17%|█▋        | 168/995 [00:03<00:15, 53.95it/s]
Loading 0:  17%|█▋        | 174/995 [00:03<00:15, 52.10it/s]
Loading 0:  19%|█▊        | 185/995 [00:03<00:12, 64.55it/s]
Loading 0:  19%|█▉        | 192/995 [00:03<00:13, 60.35it/s]
Loading 0:  20%|██        | 200/995 [00:04<00:31, 25.15it/s]
Loading 0:  21%|██        | 206/995 [00:04<00:27, 28.85it/s]
Loading 0:  21%|██        | 211/995 [00:04<00:24, 31.66it/s]
Loading 0:  22%|██▏       | 216/995 [00:04<00:22, 34.70it/s]
Loading 0:  22%|██▏       | 222/995 [00:05<00:20, 38.51it/s]
Loading 0:  23%|██▎       | 228/995 [00:05<00:18, 41.56it/s]
Loading 0:  23%|██▎       | 233/995 [00:05<00:17, 43.43it/s]
Loading 0:  25%|██▍       | 244/995 [00:05<00:13, 57.04it/s]
Loading 0:  25%|██▌       | 251/995 [00:05<00:13, 55.50it/s]
Loading 0:  26%|██▌       | 256/995 [00:26<00:13, 55.50it/s]
Loading 0:  26%|██▌       | 257/995 [00:26<11:35,  1.06it/s]
Loading 0:  26%|██▋       | 263/995 [00:26<08:25,  1.45it/s]
Loading 0:  28%|██▊       | 274/995 [00:26<04:53,  2.46it/s]
Loading 0:  28%|██▊       | 282/995 [00:27<03:26,  3.45it/s]
Loading 0:  29%|██▉       | 289/995 [00:27<02:31,  4.65it/s]
Loading 0:  30%|██▉       | 298/995 [00:27<01:42,  6.81it/s]
Loading 0:  31%|███       | 305/995 [00:28<01:37,  7.09it/s]
Loading 0:  31%|███▏      | 311/995 [00:28<01:15,  9.05it/s]
Loading 0:  32%|███▏      | 317/995 [00:28<00:58, 11.58it/s]
Loading 0:  32%|███▏      | 323/995 [00:28<00:45, 14.71it/s]
Loading 0:  34%|███▎      | 334/995 [00:28<00:28, 22.84it/s]
Loading 0:  34%|███▍      | 341/995 [00:28<00:24, 27.14it/s]
Loading 0:  35%|███▍      | 348/995 [00:28<00:20, 31.16it/s]
Loading 0:  36%|███▌      | 354/995 [00:29<00:18, 34.68it/s]
Loading 0:  37%|███▋      | 365/995 [00:29<00:13, 47.15it/s]
Loading 0:  37%|███▋      | 373/995 [00:29<00:12, 48.70it/s]
Loading 0:  38%|███▊      | 380/995 [00:29<00:12, 48.37it/s]
Loading 0:  39%|███▉      | 391/995 [00:29<00:10, 60.28it/s]
Loading 0:  40%|████      | 399/995 [00:29<00:10, 58.23it/s]
Loading 0:  41%|████      | 407/995 [00:30<00:21, 27.14it/s]
Loading 0:  42%|████▏     | 413/995 [00:30<00:19, 30.54it/s]
Loading 0:  42%|████▏     | 419/995 [00:30<00:16, 34.18it/s]
Loading 0:  43%|████▎     | 425/995 [00:30<00:15, 37.23it/s]
Loading 0:  43%|████▎     | 431/995 [00:30<00:13, 40.49it/s]
Loading 0:  44%|████▍     | 437/995 [00:30<00:12, 43.46it/s]
Loading 0:  45%|████▍     | 443/995 [00:31<00:12, 45.97it/s]
Loading 0:  46%|████▌     | 454/995 [00:31<00:09, 58.71it/s]
Loading 0:  46%|████▋     | 461/995 [00:31<00:09, 56.54it/s]
Loading 0:  47%|████▋     | 468/995 [00:31<00:09, 55.48it/s]
Loading 0:  48%|████▊     | 474/995 [00:31<00:09, 54.19it/s]
Loading 0:  49%|████▊     | 485/995 [00:31<00:07, 65.94it/s]
Loading 0:  49%|████▉     | 492/995 [00:31<00:08, 61.84it/s]
Loading 0:  50%|█████     | 499/995 [00:31<00:08, 58.87it/s]
Loading 0:  51%|█████     | 508/995 [00:32<00:18, 26.43it/s]
Loading 0:  52%|█████▏    | 514/995 [00:32<00:15, 30.08it/s]
Loading 0:  52%|█████▏    | 520/995 [00:32<00:14, 33.83it/s]
Loading 0:  53%|█████▎    | 525/995 [00:33<00:12, 36.38it/s]
Loading 0:  53%|█████▎    | 528/995 [00:46<00:12, 36.38it/s]
Loading 0:  53%|█████▎    | 529/995 [00:53<08:46,  1.13s/it]
Loading 0:  54%|█████▍    | 535/995 [00:54<06:00,  1.28it/s]
Loading 0:  55%|█████▍    | 546/995 [00:54<03:15,  2.30it/s]
Loading 0:  56%|█████▌    | 553/995 [00:54<02:18,  3.18it/s]
Loading 0:  56%|█████▋    | 560/995 [00:54<01:39,  4.39it/s]
Loading 0:  57%|█████▋    | 569/995 [00:54<01:04,  6.58it/s]
Loading 0:  58%|█████▊    | 576/995 [00:54<00:47,  8.81it/s]
Loading 0:  59%|█████▊    | 583/995 [00:54<00:35, 11.55it/s]
Loading 0:  59%|█████▉    | 590/995 [00:54<00:27, 14.92it/s]
Loading 0:  60%|██████    | 599/995 [00:55<00:18, 20.93it/s]
Loading 0:  61%|██████    | 606/995 [00:55<00:14, 25.98it/s]
Loading 0:  62%|██████▏   | 614/995 [00:56<00:25, 14.71it/s]
Loading 0:  62%|██████▏   | 620/995 [00:56<00:21, 17.70it/s]
Loading 0:  63%|██████▎   | 625/995 [00:56<00:18, 20.43it/s]
Loading 0:  63%|██████▎   | 630/995 [00:56<00:15, 23.81it/s]
Loading 0:  64%|██████▍   | 635/995 [00:56<00:13, 27.46it/s]
Loading 0:  64%|██████▍   | 640/995 [00:56<00:11, 30.68it/s]
Loading 0:  65%|██████▍   | 645/995 [00:56<00:10, 33.29it/s]
Loading 0:  65%|██████▌   | 650/995 [00:56<00:09, 35.97it/s]
Loading 0:  66%|██████▌   | 655/995 [00:57<00:08, 37.83it/s]
Loading 0:  67%|██████▋   | 666/995 [00:57<00:06, 53.20it/s]
Loading 0:  68%|██████▊   | 673/995 [00:57<00:06, 50.87it/s]
Loading 0:  68%|██████▊   | 679/995 [00:57<00:06, 49.47it/s]
Loading 0:  69%|██████▉   | 685/995 [00:57<00:06, 46.68it/s]
Loading 0:  70%|██████▉   | 695/995 [00:57<00:05, 59.02it/s]
Loading 0:  71%|███████   | 702/995 [00:57<00:05, 57.93it/s]
Loading 0:  71%|███████▏  | 709/995 [00:57<00:04, 59.57it/s]
Loading 0:  72%|███████▏  | 716/995 [00:58<00:11, 25.28it/s]
Loading 0:  73%|███████▎  | 722/995 [00:58<00:09, 29.23it/s]
Loading 0:  73%|███████▎  | 727/995 [00:58<00:08, 32.25it/s]
Loading 0:  74%|███████▎  | 733/995 [00:58<00:07, 36.11it/s]
Loading 0:  74%|███████▍  | 739/995 [00:59<00:06, 39.75it/s]
Loading 0:  75%|███████▍  | 745/995 [00:59<00:05, 42.73it/s]
Loading 0:  76%|███████▌  | 756/995 [00:59<00:04, 55.91it/s]
Loading 0:  77%|███████▋  | 763/995 [00:59<00:04, 54.03it/s]
Loading 0:  77%|███████▋  | 769/995 [00:59<00:04, 54.19it/s]
Loading 0:  78%|███████▊  | 775/995 [00:59<00:04, 54.05it/s]
Loading 0:  79%|███████▉  | 786/995 [00:59<00:03, 65.92it/s]
Loading 0:  80%|███████▉  | 793/995 [00:59<00:03, 62.28it/s]
Loading 0:  80%|████████  | 800/995 [01:00<00:03, 60.06it/s]
Loading 0:  80%|████████  | 800/995 [01:21<00:03, 60.06it/s]
Loading 0:  81%|████████  | 801/995 [01:21<03:43,  1.15s/it]
Loading 0:  82%|████████▏ | 812/995 [01:21<01:54,  1.59it/s]
Loading 0:  83%|████████▎ | 821/995 [01:22<01:16,  2.27it/s]
Loading 0:  83%|████████▎ | 827/995 [01:22<00:56,  2.98it/s]
Loading 0:  84%|████████▎ | 833/995 [01:22<00:40,  3.96it/s]
Loading 0:  84%|████████▍ | 839/995 [01:22<00:29,  5.30it/s]
Loading 0:  85%|████████▍ | 845/995 [01:22<00:21,  7.10it/s]
Loading 0:  86%|████████▌ | 851/995 [01:22<00:15,  9.44it/s]
Loading 0:  86%|████████▌ | 857/995 [01:22<00:11, 12.40it/s]
Loading 0:  87%|████████▋ | 863/995 [01:22<00:08, 15.92it/s]
Loading 0:  88%|████████▊ | 874/995 [01:22<00:04, 25.11it/s]
Loading 0:  89%|████████▊ | 881/995 [01:23<00:03, 29.49it/s]
Loading 0:  89%|████████▉ | 888/995 [01:23<00:03, 33.60it/s]
Loading 0:  90%|████████▉ | 894/995 [01:23<00:02, 37.09it/s]
Loading 0:  91%|█████████ | 905/995 [01:23<00:01, 50.33it/s]
Loading 0:  92%|█████████▏| 913/995 [01:23<00:01, 50.54it/s]
Loading 0:  93%|█████████▎| 922/995 [01:30<00:19,  3.71it/s]
Loading 0:  96%|█████████▌| 952/995 [01:30<00:04,  9.21it/s]
Loading 0:  97%|█████████▋| 964/995 [01:31<00:02, 11.77it/s]
Loading 0:  98%|█████████▊| 974/995 [01:31<00:01, 14.41it/s]
Loading 0:  99%|█████████▉| 983/995 [01:31<00:00, 17.65it/s]
                                                            
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: quantized model in 111.865s
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Processed model Kaoeiri/PantheraMax-L3-RP-TestProbe-5-8x8B in 293.356s
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: creating bucket guanaco-mkml-models
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/tokenizer_config.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/config.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/special_tokens_map.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/tokenizer.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.3.safetensors s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.3.safetensors
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.0.safetensors
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.2.safetensors s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.2.safetensors
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.1.safetensors
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: loading reward model from Jellywibble/CHAI_alignment_reward_model
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:919: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer:   warnings.warn(
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer:   warnings.warn(
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:769: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer:   warnings.warn(
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:468: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer:   warnings.warn(
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Saving duration: 0.240s
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Processed model Jellywibble/CHAI_alignment_reward_model in 2.666s
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: creating bucket guanaco-reward-models
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: Bucket 's3://guanaco-reward-models/' created
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward/config.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward/tokenizer_config.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward/special_tokens_map.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward/merges.txt
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward/vocab.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward/tokenizer.json
kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/kaoeiri-pantheramax-l3-r-7856-v3_reward/reward.tensors
Job kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer completed after 341.94s with status: succeeded
Stopping job with name kaoeiri-pantheramax-l3-r-7856-v3-mkmlizer
Pipeline stage MKMLizer completed in 342.87s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service kaoeiri-pantheramax-l3-r-7856-v3
Waiting for inference service kaoeiri-pantheramax-l3-r-7856-v3 to be ready
Inference service kaoeiri-pantheramax-l3-r-7856-v3 ready after 90.94127440452576s
Pipeline stage ISVCDeployer completed in 97.97s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.3348400592803955s
Received healthy response to inference request in 3.3805909156799316s
Received healthy response to inference request in 2.767019033432007s
Received healthy response to inference request in 3.398029327392578s
Received healthy response to inference request in 3.3652727603912354s
5 requests
0 failed requests
5th percentile: 2.8866697788238525
10th percentile: 3.006320524215698
20th percentile: 3.2456220149993897
30th percentile: 3.368336391448975
40th percentile: 3.374463653564453
50th percentile: 3.3805909156799316
60th percentile: 3.3875662803649904
70th percentile: 3.3945416450500487
80th percentile: 3.585391473770142
90th percentile: 3.9601157665252686
95th percentile: 4.147477912902832
99th percentile: 4.297367630004882
mean time: 3.4491504192352296
Pipeline stage StressChecker completed in 18.05s
kaoeiri-pantheramax-l3-r_7856_v3 status is now deployed due to DeploymentManager action
kaoeiri-pantheramax-l3-r_7856_v3 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of kaoeiri-pantheramax-l3-r_7856_v3
Running pipeline stage ISVCDeleter
Checking if service kaoeiri-pantheramax-l3-r-7856-v3 is running
Skipping teardown as no inference service was found
Pipeline stage ISVCDeleter completed in 4.92s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/config.json from bucket guanaco-mkml-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.0.safetensors from bucket guanaco-mkml-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.1.safetensors from bucket guanaco-mkml-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.2.safetensors from bucket guanaco-mkml-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/flywheel_model.3.safetensors from bucket guanaco-mkml-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/tokenizer.json from bucket guanaco-mkml-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key kaoeiri-pantheramax-l3-r-7856-v3_reward/config.json from bucket guanaco-reward-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3_reward/merges.txt from bucket guanaco-reward-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3_reward/reward.tensors from bucket guanaco-reward-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key kaoeiri-pantheramax-l3-r-7856-v3_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 9.54s
kaoeiri-pantheramax-l3-r_7856_v3 status is now torndown due to DeploymentManager action