alkahestry-llmama3-monol_3361

submission_id: alkahestry-llmama3-monol_3361_v3

developer_uid: alkacchi

formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system\nYou are now in roleplay chat mode. Engage in an endless chat with {user_name}. Always wait {user_name} turn, next actions and responses. You will fully embody the given character, creating immersive, captivating narratives. Stay true to the character's personality and background, generating responses that not only reflect their core traits but are also accurate to their character. Your responses should evoke emotion, suspense, and anticipation in the user. The more detailed and descriptive your response, the more vivid the narrative becomes. Aim to create a fertile environment for ongoing interaction – introduce new elements, offer choices, or ask questions to invite the user to participate more fully in the conversation. This conversation is a dance, always continuing, always evolving.\nYour character: {bot_name}.\nContext: {memory}<|end_header_id|>", 'prompt_template': '{prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>', 'bot_template': '{bot_name}: {message}<|end_header_id|>', 'user_template': '{user_name}: {message}<|end_header_id|>', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.72, 'top_p': 0.73, 'min_p': 0.075, 'top_k': 1000, 'presence_penalty': 0.82, 'frequency_penalty': 0.2, 'stopping_words': ['\n', '</s>', '<|im_end|>', '\n{{User}}', '<|eot_id|>', '<|end_of_text|>', '\n<'], 'max_input_tokens': 1900, 'best_of': 4, 'max_output_tokens': 64}

model_name: alkacchi-monologue-8B

model_repo: alkahestry/Llmama3-Monologue-8B

reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}

reward_repo: Jellywibble/CHAI_alignment_reward_model

status: torndown

timestamp: 2024-06-23T01:06:58+00:00

Resubmit model

Running pipeline stage MKMLizer
Starting job with name alkahestry-llmama3-monol-3361-v3-mkmlizer
Waiting for job on alkahestry-llmama3-monol-3361-v3-mkmlizer to finish
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║     _____            __           __                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║       /___/                                                         ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Version: 0.8.14                                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  https://mk1.ai                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  belonging to:                                                      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Chai Research Corp.                                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
alkahestry-llmama3-monol-3361-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py:131: FutureWarning: 'list_files_info' (from 'huggingface_hub.hf_api') is deprecated and will be removed from version '0.23'. Use `list_repo_tree` and `get_paths_info` instead.
alkahestry-llmama3-monol-3361-v3-mkmlizer:   warnings.warn(warning_message, FutureWarning)
alkahestry-llmama3-monol-3361-v3-mkmlizer: Downloaded to shared memory in 27.871s
alkahestry-llmama3-monol-3361-v3-mkmlizer: quantizing model to /dev/shm/model_cache
alkahestry-llmama3-monol-3361-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
alkahestry-llmama3-monol-3361-v3-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   5%|▍         | 14/291 [00:00<00:01, 138.99it/s]
Loading 0:  11%|█         | 32/291 [00:00<00:01, 154.10it/s]
Loading 0:  17%|█▋        | 49/291 [00:00<00:01, 160.53it/s]
Loading 0:  23%|██▎       | 67/291 [00:00<00:01, 161.81it/s]
Loading 0:  29%|██▉       | 84/291 [00:00<00:02, 87.23it/s] 
Loading 0:  35%|███▌      | 102/291 [00:00<00:01, 104.53it/s]
Loading 0:  41%|████      | 120/291 [00:00<00:01, 119.79it/s]
Loading 0:  47%|████▋     | 138/291 [00:01<00:01, 131.39it/s]
Loading 0:  54%|█████▎    | 156/291 [00:01<00:00, 141.38it/s]
Loading 0:  59%|█████▉    | 172/291 [00:01<00:00, 132.05it/s]
Loading 0:  64%|██████▍   | 187/291 [00:01<00:01, 84.97it/s] 
Loading 0:  69%|██████▉   | 201/291 [00:01<00:00, 94.06it/s]
Loading 0:  75%|███████▌  | 219/291 [00:01<00:00, 110.75it/s]
Loading 0:  81%|████████▏ | 237/291 [00:02<00:00, 124.72it/s]
Loading 0:  88%|████████▊ | 255/291 [00:02<00:00, 135.50it/s]
Loading 0:  94%|█████████▍| 273/291 [00:02<00:00, 145.43it/s]
Loading 0:  99%|█████████▉| 289/291 [00:07<00:00,  9.97it/s] 
                                                            
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
alkahestry-llmama3-monol-3361-v3-mkmlizer: quantized model in 22.726s
alkahestry-llmama3-monol-3361-v3-mkmlizer: Processed model alkahestry/Llmama3-Monologue-8B in 53.099s
alkahestry-llmama3-monol-3361-v3-mkmlizer: creating bucket guanaco-mkml-models
alkahestry-llmama3-monol-3361-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
alkahestry-llmama3-monol-3361-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/alkahestry-llmama3-monol-3361-v3
alkahestry-llmama3-monol-3361-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/alkahestry-llmama3-monol-3361-v3/config.json
alkahestry-llmama3-monol-3361-v3-mkmlizer: ERROR "cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/alkahestry-llmama3-monol-3361-v3/special_tokens_map.json": QuotaExceeded:  status code: 403, request id: tx00000841bc4ae65ae3758-006677756d-a41e00e2b-default, host id:
alkahestry-llmama3-monol-3361-v3-mkmlizer: ERROR "cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/alkahestry-llmama3-monol-3361-v3/tokenizer_config.json": QuotaExceeded:  status code: 403, request id: tx00000073e19fddf4084da-006677756d-a41e00e2b-default, host id:
alkahestry-llmama3-monol-3361-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/alkahestry-llmama3-monol-3361-v3/tokenizer.json
alkahestry-llmama3-monol-3361-v3-mkmlizer: ERROR "cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/alkahestry-llmama3-monol-3361-v3/flywheel_model.0.safetensors": MultipartUpload: upload multipart failed upload id: 2~pymFjzCv1bve3tL0SEjT5-KWxPbIgO3 caused by: QuotaExceeded:  status code: 403, request id: tx00000bf15ce8564fed448-006677756e-a41e00e2b-default, host id:
Job alkahestry-llmama3-monol-3361-v3-mkmlizer completed after 62.46s with status: failed
Stopping job with name alkahestry-llmama3-monol-3361-v3-mkmlizer
%s, retrying in %s seconds...
Starting job with name alkahestry-llmama3-monol-3361-v3-mkmlizer
Waiting for job on alkahestry-llmama3-monol-3361-v3-mkmlizer to finish
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║     _____            __           __                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║       /___/                                                         ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Version: 0.8.14                                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  https://mk1.ai                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  belonging to:                                                      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Chai Research Corp.                                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
alkahestry-llmama3-monol-3361-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py:131: FutureWarning: 'list_files_info' (from 'huggingface_hub.hf_api') is deprecated and will be removed from version '0.23'. Use `list_repo_tree` and `get_paths_info` instead.
alkahestry-llmama3-monol-3361-v3-mkmlizer:   warnings.warn(warning_message, FutureWarning)
alkahestry-llmama3-monol-3361-v3-mkmlizer: Downloaded to shared memory in 22.107s
alkahestry-llmama3-monol-3361-v3-mkmlizer: quantizing model to /dev/shm/model_cache
alkahestry-llmama3-monol-3361-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║     _____            __           __                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║       /___/                                                         ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Version: 0.8.14                                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  https://mk1.ai                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  belonging to:                                                      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Chai Research Corp.                                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
alkahestry-llmama3-monol-3361-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py:131: FutureWarning: 'list_files_info' (from 'huggingface_hub.hf_api') is deprecated and will be removed from version '0.23'. Use `list_repo_tree` and `get_paths_info` instead.
alkahestry-llmama3-monol-3361-v3-mkmlizer:   warnings.warn(warning_message, FutureWarning)
Job alkahestry-llmama3-monol-3361-v3-mkmlizer completed after 52.78s with status: failed
Stopping job with name alkahestry-llmama3-monol-3361-v3-mkmlizer
%s, retrying in %s seconds...
Starting job with name alkahestry-llmama3-monol-3361-v3-mkmlizer
Waiting for job on alkahestry-llmama3-monol-3361-v3-mkmlizer to finish
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║     _____            __           __                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║       /___/                                                         ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Version: 0.8.14                                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  https://mk1.ai                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  belonging to:                                                      ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Chai Research Corp.                                                ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ║                                                                     ║
alkahestry-llmama3-monol-3361-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
alkahestry-llmama3-monol-3361-v3-mkmlizer: /opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/_deprecation.py:131: FutureWarning: 'list_files_info' (from 'huggingface_hub.hf_api') is deprecated and will be removed from version '0.23'. Use `list_repo_tree` and `get_paths_info` instead.
alkahestry-llmama3-monol-3361-v3-mkmlizer:   warnings.warn(warning_message, FutureWarning)
alkahestry-llmama3-monol-3361-v3-mkmlizer: Downloaded to shared memory in 20.053s
alkahestry-llmama3-monol-3361-v3-mkmlizer: quantizing model to /dev/shm/model_cache
alkahestry-llmama3-monol-3361-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
alkahestry-llmama3-monol-3361-v3-mkmlizer: unable to retrieve container logs for containerd://37f656258e8c2a17c6ea2
Job alkahestry-llmama3-monol-3361-v3-mkmlizer completed after 52.32s with status: failed
Stopping job with name alkahestry-llmama3-monol-3361-v3-mkmlizer
MKMLizerError('')
alkahestry-llmama3-monol_3361_v3 status is now failed due to DeploymentManager action
admin requested tearing down of alkahestry-llmama3-monol_3361_v3
Running pipeline stage ISVCDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage ISVCDeleter completed in 0.20s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.19s
alkahestry-llmama3-monol_3361_v3 status is now torndown due to DeploymentManager action