juvi21-kumiho-v1-rp-uwu-8b

submission_id: juvi21-kumiho-v1-rp-uwu-8b_v2

developer_uid: juvi21

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 1.4, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64, 'reward_max_token_input': 1024}

model_name: juvi21-kumiho-v1-rp-uwu-8b_v1

model_repo: juvi21/Kumiho-v1-rp-UwU-8B

reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}

reward_repo: ChaiML/gpt2_xl_pairwise_89m_step_347634

status: torndown

timestamp: 2024-08-03T12:43:47+00:00

Resubmit model

Running pipeline stage MKMLizer
Starting job with name juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer
Waiting for job on juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer to finish
Stopping job with name juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer
Waiting for job on juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer to finish
Stopping job with name juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer
Waiting for job on juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer to finish
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║     _____            __           __                                ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║       /___/                                                         ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║                                                                     ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  Version: 0.9.9                                                     ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  https://mk1.ai                                                     ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║                                                                     ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  belonging to:                                                      ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║                                                                     ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  Chai Research Corp.                                                ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ║                                                                     ║
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: Downloaded to shared memory in 22.409s
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmphnu8j9ca, device:0
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: quantized model in 26.079s
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: Processed model juvi21/Kumiho-v1-rp-UwU-8B in 48.488s
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: creating bucket guanaco-mkml-models
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/juvi21-kumiho-v1-rp-uwu-8b-v2
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/juvi21-kumiho-v1-rp-uwu-8b-v2/config.json
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/juvi21-kumiho-v1-rp-uwu-8b-v2/special_tokens_map.json
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/juvi21-kumiho-v1-rp-uwu-8b-v2/tokenizer_config.json
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/juvi21-kumiho-v1-rp-uwu-8b-v2/tokenizer.json
juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/291 [00:04<11:32,  2.40s/it]
Loading 0:   2%|▏         | 6/291 [00:04<03:04,  1.55it/s]
Loading 0:   4%|▍         | 13/291 [00:05<01:05,  4.23it/s]
Loading 0:   7%|▋         | 19/291 [00:05<00:37,  7.17it/s]
Loading 0:   8%|▊         | 24/291 [00:05<00:27,  9.79it/s]
Loading 0:  11%|█▏        | 33/291 [00:05<00:16, 15.82it/s]
Loading 0:  14%|█▍        | 42/291 [00:05<00:11, 22.04it/s]
Loading 0:  17%|█▋        | 50/291 [00:05<00:08, 29.09it/s]
Loading 0:  19%|█▉        | 56/291 [00:05<00:07, 31.76it/s]
Loading 0:  21%|██▏       | 62/291 [00:06<00:08, 27.24it/s]
Loading 0:  23%|██▎       | 68/291 [00:06<00:07, 31.84it/s]
Loading 0:  25%|██▌       | 74/291 [00:06<00:06, 34.15it/s]
Loading 0:  27%|██▋       | 79/291 [00:06<00:05, 36.70it/s]
Loading 0:  30%|██▉       | 86/291 [00:06<00:04, 43.38it/s]
Loading 0:  32%|███▏      | 92/291 [00:06<00:04, 41.18it/s]
Loading 0:  33%|███▎      | 97/291 [00:06<00:04, 42.37it/s]
Loading 0:  36%|███▌      | 104/291 [00:07<00:03, 48.44it/s]
Loading 0:  38%|███▊      | 110/291 [00:07<00:03, 45.30it/s]
Loading 0:  40%|███▉      | 115/291 [00:07<00:03, 45.17it/s]
Loading 0:  42%|████▏     | 122/291 [00:07<00:03, 50.92it/s]
Loading 0:  44%|████▍     | 128/291 [00:07<00:03, 46.98it/s]
Loading 0:  46%|████▌     | 133/291 [00:07<00:03, 46.04it/s]
Loading 0:  48%|████▊     | 140/291 [00:07<00:02, 51.52it/s]
Loading 0:  50%|█████     | 146/291 [00:07<00:02, 48.59it/s]
Loading 0:  52%|█████▏    | 152/291 [00:08<00:02, 49.93it/s]
Loading 0:  54%|█████▍    | 158/291 [00:08<00:02, 52.25it/s]
Loading 0:  56%|█████▋    | 164/291 [00:08<00:02, 47.05it/s]
Loading 0:  58%|█████▊    | 169/291 [00:08<00:03, 32.07it/s]
Loading 0:  60%|██████    | 176/291 [00:08<00:02, 39.19it/s]
Loading 0:  63%|██████▎   | 182/291 [00:08<00:02, 40.36it/s]
Loading 0:  64%|██████▍   | 187/291 [00:08<00:02, 41.82it/s]
Loading 0:  67%|██████▋   | 194/291 [00:09<00:02, 47.85it/s]
Loading 0:  69%|██████▊   | 200/291 [00:09<00:01, 46.27it/s]
Loading 0:  70%|███████   | 205/291 [00:09<00:01, 46.01it/s]
Loading 0:  73%|███████▎  | 212/291 [00:09<00:01, 50.98it/s]
Loading 0:  75%|███████▍  | 218/291 [00:09<00:01, 47.87it/s]
Loading 0:  77%|███████▋  | 223/291 [00:09<00:01, 47.65it/s]
Loading 0:  79%|███████▉  | 230/291 [00:09<00:01, 51.82it/s]
Loading 0:  81%|████████  | 236/291 [00:09<00:01, 47.58it/s]
Loading 0:  83%|████████▎ | 241/291 [00:10<00:01, 45.52it/s]
Loading 0:  85%|████████▌ | 248/291 [00:10<00:00, 50.43it/s]
Loading 0:  87%|████████▋ | 254/291 [00:10<00:00, 47.84it/s]
Loading 0:  89%|████████▉ | 259/291 [00:10<00:00, 47.16it/s]
Loading 0:  91%|█████████▏| 266/291 [00:10<00:00, 35.99it/s]
Loading 0:  93%|█████████▎| 272/291 [00:10<00:00, 37.43it/s]
Loading 0:  95%|█████████▌| 277/291 [00:10<00:00, 38.99it/s]
Loading 0:  98%|█████████▊| 284/291 [00:11<00:00, 45.28it/s]
Loading 0: 100%|█████████▉| 290/291 [00:11<00:00, 44.04it/s]
                                                            
ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/juvi21-kumiho-v1-rp-uwu-8b-v2/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~y3PCCcSh8ORiIGOtqieQ5fE0I1x3jqK caused by: QuotaExceeded:  status code: 403, request id: tx00000b5a77e02b7e8bd63-0066ae2654-a438a3bd5-default, host id:
Job juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer completed after 73.34s with status: failed
Stopping job with name juvi21-kumiho-v1-rp-uwu-8b-v2-mkmlizer
MKMLizerError('')
juvi21-kumiho-v1-rp-uwu-8b_v2 status is now failed due to DeploymentManager action
admin requested tearing down of juvi21-kumiho-v1-rp-uwu-8b_v2
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.12s
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.15s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.12s
juvi21-kumiho-v1-rp-uwu-8b_v2 status is now torndown due to DeploymentManager action