maldv-dragonwar-7b-alpha

developer_uid: maldevide
submission_id: maldv-dragonwar-7b-alpha_v2
model_name: maldv-dragonwar-7b-alpha_v2
model_group: maldv/dragonwar-7b-alpha
status: torndown
timestamp: 2024-04-05T17:45:19+00:00
num_battles: 107759
num_wins: 48652
celo_rating: 1123.41
family_friendly_score: 0.0
submission_type: basic
model_repo: maldv/dragonwar-7b-alpha
model_architecture: MistralForCausalLM
model_num_parameters: 7241732096.0
best_of: 4
max_input_tokens: 1900
max_output_tokens: 64
reward_model: default
display_name: maldv-dragonwar-7b-alpha_v2
is_internal_developer: False
language_model: maldv/dragonwar-7b-alpha
model_size: 7B
ranking_group: single
us_pacific_date: 2024-04-05
win_ratio: 0.45148897075882294
generation_params: {'temperature': 0.7, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.05, 'stopping_words': ['\n'], 'max_input_tokens': 1900, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n\n***\n\n", 'prompt_template': '{prompt}\n\n***\n\n', 'bot_template': '{bot_name}: {message}\n\n', 'user_template': '{user_name}: {message}\n\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
model_eval_status: success
reward_formatter: {'bot_template': '{bot_name}: {message}\n', 'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'response_template': '{bot_name}:', 'truncate_by_message': False, 'user_template': '{user_name}: {message}\n'}
reward_repo: ChaiML/reward_gpt2_medium_preference_24m_e2
Resubmit model
Running pipeline stage MKMLizer
Starting job with name maldv-dragonwar-7b-alpha-v2-mkmlizer
Waiting for job on maldv-dragonwar-7b-alpha-v2-mkmlizer to finish
maldv-dragonwar-7b-alpha-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║     _____            __           __                                ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║       /___/                                                         ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║                                                                     ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  Version: 0.6.11                                                    ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║                                                                     ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  belonging to:                                                      ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║                                                                     ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  Chai Research Corp.                                                ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║  Expiration: 2024-07-15 23:59:59                                    ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ║                                                                     ║
maldv-dragonwar-7b-alpha-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
generation_config.json:   0%|          | 0.00/111 [00:00<?, ?B/s]
generation_config.json: 100%|██████████| 111/111 [00:00<00:00, 1.52MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
model-00001-of-00003.safetensors:   0%|          | 0.00/4.94G [00:00<?, ?B/s]
model-00001-of-00003.safetensors:   0%|          | 10.5M/4.94G [00:01<11:16, 7.29MB/s]
model-00001-of-00003.safetensors:   0%|          | 21.0M/4.94G [00:02<11:03, 7.42MB/s]
model-00001-of-00003.safetensors:   1%|          | 41.9M/4.94G [00:03<05:11, 15.7MB/s]
model-00001-of-00003.safetensors:   3%|▎         | 126M/4.94G [00:03<01:11, 67.2MB/s] 
model-00001-of-00003.safetensors:  18%|█▊        | 870M/4.94G [00:03<00:06, 673MB/s] 
model-00001-of-00003.safetensors:  24%|██▎       | 1.16G/4.94G [00:03<00:05, 748MB/s]
model-00001-of-00003.safetensors:  28%|██▊       | 1.39G/4.94G [00:04<00:05, 674MB/s]
model-00001-of-00003.safetensors:  32%|███▏      | 1.56G/4.94G [00:04<00:04, 702MB/s]
model-00001-of-00003.safetensors:  35%|███▍      | 1.71G/4.94G [00:04<00:05, 616MB/s]
model-00001-of-00003.safetensors:  38%|███▊      | 1.86G/4.94G [00:04<00:04, 711MB/s]
model-00001-of-00003.safetensors:  40%|████      | 1.98G/4.94G [00:05<00:04, 732MB/s]
model-00001-of-00003.safetensors:  42%|████▏     | 2.10G/4.94G [00:05<00:04, 653MB/s]
model-00001-of-00003.safetensors:  45%|████▍     | 2.22G/4.94G [00:05<00:04, 679MB/s]
model-00001-of-00003.safetensors:  47%|████▋     | 2.32G/4.94G [00:05<00:04, 646MB/s]
model-00001-of-00003.safetensors:  49%|████▊     | 2.40G/4.94G [00:05<00:03, 651MB/s]
model-00001-of-00003.safetensors:  53%|█████▎    | 2.63G/4.94G [00:05<00:02, 967MB/s]
model-00001-of-00003.safetensors:  56%|█████▌    | 2.76G/4.94G [00:06<00:02, 882MB/s]
model-00001-of-00003.safetensors:  58%|█████▊    | 2.88G/4.94G [00:06<00:02, 954MB/s]
model-00001-of-00003.safetensors:  68%|██████▊   | 3.34G/4.94G [00:06<00:00, 1.77GB/s]
model-00001-of-00003.safetensors:  73%|███████▎  | 3.59G/4.94G [00:06<00:00, 1.92GB/s]
model-00001-of-00003.safetensors:  77%|███████▋  | 3.81G/4.94G [00:06<00:00, 1.85GB/s]
model-00001-of-00003.safetensors:  81%|████████  | 4.02G/4.94G [00:06<00:00, 1.71GB/s]
model-00001-of-00003.safetensors:  85%|████████▌ | 4.20G/4.94G [00:06<00:00, 1.64GB/s]
model-00001-of-00003.safetensors:  91%|█████████ | 4.48G/4.94G [00:06<00:00, 1.92GB/s]
model-00001-of-00003.safetensors: 100%|█████████▉| 4.94G/4.94G [00:06<00:00, 714MB/s] 
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
model-00002-of-00003.safetensors:   0%|          | 0.00/5.00G [00:00<?, ?B/s]
model-00002-of-00003.safetensors:   0%|          | 10.5M/5.00G [00:02<21:06, 3.94MB/s]
model-00002-of-00003.safetensors:   1%|          | 31.5M/5.00G [00:03<06:26, 12.9MB/s]
model-00002-of-00003.safetensors:   4%|▍         | 199M/5.00G [00:03<00:42, 114MB/s]  
model-00002-of-00003.safetensors:  22%|██▏       | 1.08G/5.00G [00:03<00:05, 746MB/s]
model-00002-of-00003.safetensors:  26%|██▌       | 1.30G/5.00G [00:03<00:05, 635MB/s]
model-00002-of-00003.safetensors:  29%|██▉       | 1.46G/5.00G [00:04<00:05, 598MB/s]
model-00002-of-00003.safetensors:  32%|███▏      | 1.58G/5.00G [00:04<00:06, 536MB/s]
model-00002-of-00003.safetensors:  34%|███▎      | 1.68G/5.00G [00:04<00:06, 527MB/s]
model-00002-of-00003.safetensors:  35%|███▌      | 1.76G/5.00G [00:04<00:06, 501MB/s]
model-00002-of-00003.safetensors:  38%|███▊      | 1.88G/5.00G [00:05<00:05, 571MB/s]
model-00002-of-00003.safetensors:  39%|███▉      | 1.97G/5.00G [00:05<00:04, 624MB/s]
model-00002-of-00003.safetensors:  41%|████      | 2.06G/5.00G [00:05<00:04, 651MB/s]
model-00002-of-00003.safetensors:  44%|████▎     | 2.18G/5.00G [00:05<00:03, 766MB/s]
model-00002-of-00003.safetensors:  46%|████▌     | 2.31G/5.00G [00:05<00:03, 754MB/s]
model-00002-of-00003.safetensors:  48%|████▊     | 2.40G/5.00G [00:05<00:03, 671MB/s]
model-00002-of-00003.safetensors:  51%|█████     | 2.54G/5.00G [00:05<00:03, 784MB/s]
model-00002-of-00003.safetensors:  66%|██████▌   | 3.29G/5.00G [00:05<00:00, 2.26GB/s]
model-00002-of-00003.safetensors:  73%|███████▎  | 3.63G/5.00G [00:06<00:00, 2.50GB/s]
model-00002-of-00003.safetensors:  79%|███████▊  | 3.93G/5.00G [00:06<00:00, 1.89GB/s]
model-00002-of-00003.safetensors:  84%|████████▎ | 4.18G/5.00G [00:06<00:00, 1.81GB/s]
model-00002-of-00003.safetensors:  93%|█████████▎| 4.67G/5.00G [00:06<00:00, 1.82GB/s]
model-00002-of-00003.safetensors:  98%|█████████▊| 4.88G/5.00G [00:06<00:00, 1.45GB/s]
model-00002-of-00003.safetensors: 100%|█████████▉| 5.00G/5.00G [00:07<00:00, 712MB/s] 
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
model-00003-of-00003.safetensors:   0%|          | 0.00/4.54G [00:00<?, ?B/s]
model-00003-of-00003.safetensors:   0%|          | 10.5M/4.54G [00:02<18:18, 4.12MB/s]
model-00003-of-00003.safetensors:   0%|          | 21.0M/4.54G [00:02<08:05, 9.30MB/s]
model-00003-of-00003.safetensors:   1%|          | 41.9M/4.54G [00:02<03:20, 22.5MB/s]
model-00003-of-00003.safetensors:   1%|▏         | 62.9M/4.54G [00:02<01:57, 38.2MB/s]
model-00003-of-00003.safetensors:   3%|▎         | 126M/4.54G [00:03<00:51, 84.9MB/s] 
model-00003-of-00003.safetensors:   3%|▎         | 157M/4.54G [00:03<00:40, 109MB/s] 
model-00003-of-00003.safetensors:   4%|▍         | 178M/4.54G [00:03<00:38, 112MB/s]
model-00003-of-00003.safetensors:  14%|█▍        | 629M/4.54G [00:03<00:05, 782MB/s]
model-00003-of-00003.safetensors:  27%|██▋       | 1.22G/4.54G [00:03<00:01, 1.68GB/s]
model-00003-of-00003.safetensors:  33%|███▎      | 1.51G/4.54G [00:04<00:02, 1.15GB/s]
model-00003-of-00003.safetensors:  38%|███▊      | 1.74G/4.54G [00:04<00:02, 1.24GB/s]
model-00003-of-00003.safetensors:  43%|████▎     | 1.95G/4.54G [00:04<00:02, 963MB/s] 
model-00003-of-00003.safetensors:  46%|████▋     | 2.11G/4.54G [00:04<00:02, 880MB/s]
model-00003-of-00003.safetensors:  49%|████▉     | 2.24G/4.54G [00:05<00:02, 840MB/s]
model-00003-of-00003.safetensors:  52%|█████▏    | 2.36G/4.54G [00:05<00:02, 827MB/s]
model-00003-of-00003.safetensors:  54%|█████▍    | 2.46G/4.54G [00:05<00:02, 714MB/s]
model-00003-of-00003.safetensors:  56%|█████▋    | 2.56G/4.54G [00:05<00:02, 731MB/s]
model-00003-of-00003.safetensors:  59%|█████▉    | 2.69G/4.54G [00:05<00:02, 846MB/s]
model-00003-of-00003.safetensors:  62%|██████▏   | 2.83G/4.54G [00:05<00:01, 951MB/s]
model-00003-of-00003.safetensors:  65%|██████▍   | 2.95G/4.54G [00:05<00:01, 904MB/s]
model-00003-of-00003.safetensors:  67%|██████▋   | 3.05G/4.54G [00:06<00:01, 922MB/s]
model-00003-of-00003.safetensors:  77%|███████▋  | 3.50G/4.54G [00:06<00:00, 1.75GB/s]
model-00003-of-00003.safetensors:  82%|████████▏ | 3.70G/4.54G [00:06<00:00, 1.72GB/s]
model-00003-of-00003.safetensors:  87%|████████▋ | 3.93G/4.54G [00:06<00:00, 1.85GB/s]
model-00003-of-00003.safetensors:  94%|█████████▍| 4.26G/4.54G [00:06<00:00, 2.19GB/s]
model-00003-of-00003.safetensors: 100%|█████████▉| 4.54G/4.54G [00:06<00:00, 690MB/s] 
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
model.safetensors.index.json:   0%|          | 0.00/23.9k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 23.9k/23.9k [00:00<00:00, 92.8MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
special_tokens_map.json:   0%|          | 0.00/552 [00:00<?, ?B/s]
special_tokens_map.json: 100%|██████████| 552/552 [00:00<00:00, 8.90MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
tokenizer.json:   0%|          | 0.00/1.80M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 1.80M/1.80M [00:00<00:00, 29.2MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
tokenizer.model:   0%|          | 0.00/493k [00:00<?, ?B/s]
tokenizer.model: 100%|██████████| 493k/493k [00:00<00:00, 17.9MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/1.16k [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 1.16k/1.16k [00:00<00:00, 15.7MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: Downloaded to shared memory in 24.559s
maldv-dragonwar-7b-alpha-v2-mkmlizer: quantizing model to /dev/shm/model_cache
maldv-dragonwar-7b-alpha-v2-mkmlizer: Saving mkml model at /dev/shm/model_cache
maldv-dragonwar-7b-alpha-v2-mkmlizer: Reading /tmp/tmpnbq46_9i/model.safetensors.index.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
Profiling:   0%|          | 0/291 [00:00<?, ?it/s]
Profiling:   0%|          | 1/291 [00:01<06:09,  1.28s/it]
Profiling:   6%|▌         | 17/291 [00:01<00:16, 16.80it/s]
Profiling:  13%|█▎        | 37/291 [00:01<00:06, 39.55it/s]
Profiling:  19%|█▉        | 56/291 [00:01<00:03, 61.26it/s]
Profiling:  25%|██▌       | 73/291 [00:01<00:02, 79.61it/s]
Profiling:  31%|███▏      | 91/291 [00:01<00:02, 98.02it/s]
Profiling:  37%|███▋      | 107/291 [00:02<00:02, 75.31it/s]
Profiling:  44%|████▍     | 129/291 [00:02<00:01, 99.07it/s]
Profiling:  51%|█████     | 148/291 [00:02<00:01, 114.59it/s]
Profiling:  57%|█████▋    | 167/291 [00:02<00:00, 129.66it/s]
Profiling:  65%|██████▌   | 190/291 [00:02<00:00, 152.83it/s]
Profiling:  72%|███████▏  | 209/291 [00:04<00:02, 35.79it/s] 
Profiling:  77%|███████▋  | 223/291 [00:04<00:01, 43.35it/s]
Profiling:  84%|████████▍ | 244/291 [00:04<00:00, 58.95it/s]
Profiling:  91%|█████████ | 265/291 [00:04<00:00, 75.98it/s]
Profiling:  98%|█████████▊| 284/291 [00:04<00:00, 90.90it/s]
Profiling: 100%|██████████| 291/291 [00:04<00:00, 61.39it/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: quantized model in 14.567s
maldv-dragonwar-7b-alpha-v2-mkmlizer: Processed model maldv/dragonwar-7b-alpha in 40.089s
maldv-dragonwar-7b-alpha-v2-mkmlizer: creating bucket guanaco-mkml-models
maldv-dragonwar-7b-alpha-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
maldv-dragonwar-7b-alpha-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/maldv-dragonwar-7b-alpha-v2
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/maldv-dragonwar-7b-alpha-v2/tokenizer_config.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.model s3://guanaco-mkml-models/maldv-dragonwar-7b-alpha-v2/tokenizer.model
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/maldv-dragonwar-7b-alpha-v2/special_tokens_map.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/maldv-dragonwar-7b-alpha-v2/config.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/maldv-dragonwar-7b-alpha-v2/tokenizer.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /dev/shm/model_cache/mkml_model.tensors s3://guanaco-mkml-models/maldv-dragonwar-7b-alpha-v2/mkml_model.tensors
maldv-dragonwar-7b-alpha-v2-mkmlizer: loading reward model from ChaiML/reward_gpt2_medium_preference_24m_e2
maldv-dragonwar-7b-alpha-v2-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py:1067: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
maldv-dragonwar-7b-alpha-v2-mkmlizer:   warnings.warn(
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
config.json:   0%|          | 0.00/1.05k [00:00<?, ?B/s]
config.json: 100%|██████████| 1.05k/1.05k [00:00<00:00, 11.6MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py:690: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
maldv-dragonwar-7b-alpha-v2-mkmlizer:   warnings.warn(
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
tokenizer_config.json:   0%|          | 0.00/234 [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 234/234 [00:00<00:00, 3.20MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
vocab.json:   0%|          | 0.00/1.04M [00:00<?, ?B/s]
vocab.json: 100%|██████████| 1.04M/1.04M [00:00<00:00, 15.0MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
tokenizer.json:   0%|          | 0.00/2.11M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 55.9MB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: /opt/conda/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py:472: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.
maldv-dragonwar-7b-alpha-v2-mkmlizer:   warnings.warn(
maldv-dragonwar-7b-alpha-v2-mkmlizer: 
pytorch_model.bin:   0%|          | 0.00/1.44G [00:00<?, ?B/s]
pytorch_model.bin:   1%|          | 10.5M/1.44G [00:00<00:15, 93.8MB/s]
pytorch_model.bin:   1%|▏         | 21.0M/1.44G [00:00<00:16, 85.5MB/s]
pytorch_model.bin:   8%|▊         | 115M/1.44G [00:00<00:03, 396MB/s]  
pytorch_model.bin:  15%|█▌        | 220M/1.44G [00:00<00:02, 574MB/s]
pytorch_model.bin:  21%|██        | 304M/1.44G [00:00<00:02, 563MB/s]
pytorch_model.bin:  25%|██▌       | 367M/1.44G [00:00<00:01, 573MB/s]
pytorch_model.bin:  30%|██▉       | 430M/1.44G [00:00<00:01, 550MB/s]
pytorch_model.bin:  46%|████▋     | 671M/1.44G [00:00<00:00, 1.05GB/s]
pytorch_model.bin: 100%|█████████▉| 1.44G/1.44G [00:01<00:00, 1.29GB/s]
maldv-dragonwar-7b-alpha-v2-mkmlizer: Saving model to /tmp/reward_cache/reward.tensors
maldv-dragonwar-7b-alpha-v2-mkmlizer: Saving duration: 0.226s
maldv-dragonwar-7b-alpha-v2-mkmlizer: Processed model ChaiML/reward_gpt2_medium_preference_24m_e2 in 4.504s
maldv-dragonwar-7b-alpha-v2-mkmlizer: creating bucket guanaco-reward-models
maldv-dragonwar-7b-alpha-v2-mkmlizer: Bucket 's3://guanaco-reward-models/' created
maldv-dragonwar-7b-alpha-v2-mkmlizer: uploading /tmp/reward_cache to s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /tmp/reward_cache/config.json s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward/config.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /tmp/reward_cache/tokenizer_config.json s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward/tokenizer_config.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /tmp/reward_cache/special_tokens_map.json s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward/special_tokens_map.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /tmp/reward_cache/merges.txt s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward/merges.txt
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /tmp/reward_cache/vocab.json s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward/vocab.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /tmp/reward_cache/tokenizer.json s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward/tokenizer.json
maldv-dragonwar-7b-alpha-v2-mkmlizer: cp /tmp/reward_cache/reward.tensors s3://guanaco-reward-models/maldv-dragonwar-7b-alpha-v2_reward/reward.tensors
Job maldv-dragonwar-7b-alpha-v2-mkmlizer completed after 74.64s with status: succeeded
Stopping job with name maldv-dragonwar-7b-alpha-v2-mkmlizer
Pipeline stage MKMLizer completed in 79.62s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service maldv-dragonwar-7b-alpha-v2
Waiting for inference service maldv-dragonwar-7b-alpha-v2 to be ready
Failed to get response for submission thanhdaonguyen-once-upon-a-t_v37: HTTPConnectionPool(host='thanhdaonguyen-once-upon-a-t-v37-predictor-default.tenant-chaiml-guanaco.knative.ord1.coreweave.cloud', port=80): Read timed out. (read timeout=5.5)
Inference service maldv-dragonwar-7b-alpha-v2 ready after 40.24853301048279s
Pipeline stage ISVCDeployer completed in 48.05s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.426546335220337s
Received healthy response to inference request in 0.8799207210540771s
Received healthy response to inference request in 1.2806870937347412s
Received healthy response to inference request in 1.0099163055419922s
Received healthy response to inference request in 0.7516579627990723s
5 requests
0 failed requests
5th percentile: 0.7773105144500733
10th percentile: 0.8029630661010743
20th percentile: 0.8542681694030761
30th percentile: 0.9059198379516602
40th percentile: 0.9579180717468262
50th percentile: 1.0099163055419922
60th percentile: 1.1182246208190918
70th percentile: 1.2265329360961914
80th percentile: 1.3098589420318605
90th percentile: 1.3682026386260986
95th percentile: 1.3973744869232176
99th percentile: 1.420711965560913
mean time: 1.0697456836700439
Pipeline stage StressChecker completed in 10.59s
Running pipeline stage DaemonicModelEvalScorer
Pipeline stage DaemonicModelEvalScorer completed in 0.04s
Running pipeline stage DaemonicSafetyScorer
Running M-Eval for topic stay_in_character
Pipeline stage DaemonicSafetyScorer completed in 0.05s
M-Eval Dataset for topic stay_in_character is loaded
maldv-dragonwar-7b-alpha_v2 status is now deployed due to DeploymentManager action
maldv-dragonwar-7b-alpha_v2 status is now inactive due to auto deactivation removed underperforming models
admin requested tearing down of maldv-dragonwar-7b-alpha_v2
Running pipeline stage ISVCDeleter
Checking if service maldv-dragonwar-7b-alpha-v2 is running
Tearing down inference service maldv-dragonwar-7b-alpha-v2
Toredown service maldv-dragonwar-7b-alpha-v2
Pipeline stage ISVCDeleter completed in 3.40s
Running pipeline stage MKMLModelDeleter
Cleaning model data from S3
Cleaning model data from model cache
Deleting key maldv-dragonwar-7b-alpha-v2/config.json from bucket guanaco-mkml-models
Deleting key maldv-dragonwar-7b-alpha-v2/mkml_model.tensors from bucket guanaco-mkml-models
Deleting key maldv-dragonwar-7b-alpha-v2/special_tokens_map.json from bucket guanaco-mkml-models
Deleting key maldv-dragonwar-7b-alpha-v2/tokenizer.json from bucket guanaco-mkml-models
Deleting key maldv-dragonwar-7b-alpha-v2/tokenizer.model from bucket guanaco-mkml-models
Deleting key maldv-dragonwar-7b-alpha-v2/tokenizer_config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key maldv-dragonwar-7b-alpha-v2_reward/config.json from bucket guanaco-reward-models
Deleting key maldv-dragonwar-7b-alpha-v2_reward/merges.txt from bucket guanaco-reward-models
Deleting key maldv-dragonwar-7b-alpha-v2_reward/reward.tensors from bucket guanaco-reward-models
Deleting key maldv-dragonwar-7b-alpha-v2_reward/special_tokens_map.json from bucket guanaco-reward-models
Deleting key maldv-dragonwar-7b-alpha-v2_reward/tokenizer.json from bucket guanaco-reward-models
Deleting key maldv-dragonwar-7b-alpha-v2_reward/tokenizer_config.json from bucket guanaco-reward-models
Deleting key maldv-dragonwar-7b-alpha-v2_reward/vocab.json from bucket guanaco-reward-models
Pipeline stage MKMLModelDeleter completed in 2.02s
maldv-dragonwar-7b-alpha_v2 status is now torndown due to DeploymentManager action