epiculous-crimson-dawn-v0-1

developer_uid: Epiculous

submission_id: epiculous-crimson-dawn-v0-1_v5

model_name: Crimson_Dawn-V01_Alpha

model_group: Epiculous/Crimson_Dawn-V

status: torndown

timestamp: 2024-08-17T20:33:06+00:00

num_battles: 12624

num_wins: 6569

celo_rating: 1242.13

family_friendly_score: 0.0

submission_type: basic

model_repo: Epiculous/Crimson_Dawn-V0.1

model_architecture: MistralForCausalLM

model_num_parameters: 12772070400.0

best_of: 8

max_input_tokens: 512

max_output_tokens: 64

display_name: Crimson_Dawn-V01_Alpha

is_internal_developer: False

language_model: Epiculous/Crimson_Dawn-V0.1

model_size: 13B

ranking_group: single

us_pacific_date: 2024-08-17

win_ratio: 0.5203580481622306

generation_params: {'temperature': 1.25, 'top_p': 1.0, 'min_p': 0.075, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '[/INST]'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "<s>{bot_name}'s Persona: {memory}\\\\\n\\\\\n", 'prompt_template': '{prompt} [/INST]', 'bot_template': '{bot_name}: {message}</s>', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Running pipeline stage MKMLizer
Starting job with name epiculous-crimson-dawn-v0-1-v5-mkmlizer
Waiting for job on epiculous-crimson-dawn-v0-1-v5-mkmlizer to finish
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║     _____            __           __                                ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║       /___/                                                         ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Version: 0.9.11                                                    ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  https://mk1.ai                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  belonging to:                                                      ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Chai Research Corp.                                                ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Downloaded to shared memory in 34.493s
epiculous-crimson-dawn-v0-1-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp_v9qzelv, device:0
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
epiculous-crimson-dawn-v0-1-v5-mkmlizer: quantized model in 36.020s
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Processed model Epiculous/Crimson_Dawn-V0.1 in 70.513s
epiculous-crimson-dawn-v0-1-v5-mkmlizer: creating bucket guanaco-mkml-models
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
epiculous-crimson-dawn-v0-1-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/config.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/special_tokens_map.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/tokenizer_config.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/tokenizer.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/flywheel_model.0.safetensors
epiculous-crimson-dawn-v0-1-v5-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:10, 32.89it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:06, 51.29it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:08, 42.57it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:08, 42.15it/s]
Loading 0:   9%|▊         | 31/363 [00:00<00:06, 48.34it/s]
Loading 0:  10%|█         | 37/363 [00:00<00:07, 44.33it/s]
Loading 0:  12%|█▏        | 42/363 [00:00<00:07, 42.92it/s]
Loading 0:  13%|█▎        | 49/363 [00:01<00:06, 47.73it/s]
Loading 0:  15%|█▌        | 55/363 [00:01<00:06, 44.36it/s]
Loading 0:  17%|█▋        | 61/363 [00:01<00:09, 33.54it/s]
Loading 0:  18%|█▊        | 65/363 [00:01<00:08, 33.18it/s]
Loading 0:  20%|█▉        | 72/363 [00:01<00:07, 39.24it/s]
Loading 0:  21%|██        | 77/363 [00:01<00:06, 41.10it/s]
Loading 0:  23%|██▎       | 82/363 [00:02<00:08, 34.39it/s]
Loading 0:  25%|██▍       | 89/363 [00:02<00:06, 41.66it/s]
Loading 0:  26%|██▌       | 94/363 [00:02<00:06, 41.10it/s]
Loading 0:  27%|██▋       | 99/363 [00:02<00:06, 41.90it/s]
Loading 0:  29%|██▊       | 104/363 [00:02<00:05, 43.61it/s]
Loading 0:  30%|███       | 110/363 [00:02<00:06, 41.42it/s]
Loading 0:  32%|███▏      | 115/363 [00:02<00:05, 42.23it/s]
Loading 0:  33%|███▎      | 120/363 [00:02<00:06, 40.42it/s]
Loading 0:  34%|███▍      | 125/363 [00:03<00:05, 42.36it/s]
Loading 0:  36%|███▌      | 130/363 [00:03<00:05, 42.42it/s]
Loading 0:  37%|███▋      | 135/363 [00:03<00:05, 42.68it/s]
Loading 0:  39%|███▊      | 140/363 [00:03<00:05, 43.73it/s]
Loading 0:  40%|███▉      | 145/363 [00:03<00:08, 25.81it/s]
Loading 0:  41%|████      | 149/363 [00:03<00:07, 26.89it/s]
Loading 0:  43%|████▎     | 156/363 [00:04<00:06, 34.24it/s]
Loading 0:  44%|████▍     | 161/363 [00:04<00:05, 35.84it/s]
Loading 0:  46%|████▌     | 166/363 [00:04<00:05, 37.37it/s]
Loading 0:  47%|████▋     | 172/363 [00:04<00:05, 37.64it/s]
Loading 0:  49%|████▉     | 177/363 [00:04<00:04, 38.46it/s]
Loading 0:  50%|█████     | 183/363 [00:04<00:04, 43.11it/s]
Loading 0:  52%|█████▏    | 188/363 [00:04<00:04, 42.83it/s]
Loading 0:  53%|█████▎    | 193/363 [00:04<00:03, 42.61it/s]
Loading 0:  55%|█████▍    | 199/363 [00:05<00:03, 41.79it/s]
Loading 0:  56%|█████▌    | 204/363 [00:05<00:03, 41.60it/s]
Loading 0:  58%|█████▊    | 210/363 [00:05<00:03, 45.15it/s]
Loading 0:  59%|█████▉    | 215/363 [00:05<00:03, 44.79it/s]
Loading 0:  61%|██████    | 221/363 [00:05<00:02, 48.54it/s]
Loading 0:  62%|██████▏   | 226/363 [00:05<00:04, 30.05it/s]
Loading 0:  63%|██████▎   | 230/363 [00:05<00:04, 30.61it/s]
Loading 0:  65%|██████▌   | 237/363 [00:06<00:03, 38.41it/s]
Loading 0:  67%|██████▋   | 242/363 [00:06<00:03, 39.60it/s]
Loading 0:  68%|██████▊   | 247/363 [00:06<00:02, 40.69it/s]
Loading 0:  70%|██████▉   | 253/363 [00:06<00:02, 40.37it/s]
Loading 0:  71%|███████   | 258/363 [00:06<00:02, 40.34it/s]
Loading 0:  73%|███████▎  | 264/363 [00:06<00:02, 43.82it/s]
Loading 0:  74%|███████▍  | 269/363 [00:06<00:02, 43.73it/s]
Loading 0:  75%|███████▌  | 274/363 [00:06<00:02, 44.03it/s]
Loading 0:  77%|███████▋  | 280/363 [00:07<00:01, 42.30it/s]
Loading 0:  79%|███████▊  | 285/363 [00:07<00:01, 41.09it/s]
Loading 0:  80%|████████  | 291/363 [00:07<00:01, 44.64it/s]
Loading 0:  82%|████████▏ | 296/363 [00:07<00:01, 44.32it/s]
Loading 0:  83%|████████▎ | 302/363 [00:07<00:01, 48.20it/s]
Loading 0:  85%|████████▍ | 307/363 [00:14<00:22,  2.51it/s]
Loading 0:  86%|████████▌ | 312/363 [00:14<00:14,  3.42it/s]
Loading 0:  88%|████████▊ | 320/363 [00:14<00:07,  5.48it/s]
Loading 0:  90%|████████▉ | 326/363 [00:14<00:05,  7.37it/s]
Loading 0:  91%|█████████ | 331/363 [00:14<00:03,  9.42it/s]
Loading 0:  93%|█████████▎| 338/363 [00:14<00:01, 13.31it/s]
Loading 0:  95%|█████████▍| 344/363 [00:15<00:01, 16.66it/s]
Loading 0:  96%|█████████▌| 349/363 [00:15<00:00, 19.86it/s]
Loading 0:  98%|█████████▊| 356/363 [00:15<00:00, 26.03it/s]
Loading 0: 100%|█████████▉| 362/363 [00:15<00:00, 29.30it/s]
                                                            
Job epiculous-crimson-dawn-v0-1-v5-mkmlizer completed after 94.95s with status: succeeded
Stopping job with name epiculous-crimson-dawn-v0-1-v5-mkmlizer
Pipeline stage MKMLizer completed in 95.85s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service epiculous-crimson-dawn-v0-1-v5
Waiting for inference service epiculous-crimson-dawn-v0-1-v5 to be ready
Inference service epiculous-crimson-dawn-v0-1-v5 ready after 241.673113822937s
Pipeline stage ISVCDeployer completed in 243.31s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1692099571228027s
Received healthy response to inference request in 1.555760383605957s
Received healthy response to inference request in 1.657496452331543s
Received healthy response to inference request in 3.3636832237243652s
Received healthy response to inference request in 2.104604959487915s
5 requests
0 failed requests
5th percentile: 1.5761075973510743
10th percentile: 1.5964548110961914
20th percentile: 1.6371492385864257
30th percentile: 1.7469181537628173
40th percentile: 1.9257615566253663
50th percentile: 2.104604959487915
60th percentile: 2.13044695854187
70th percentile: 2.1562889575958253
80th percentile: 2.4081046104431154
90th percentile: 2.8858939170837403
95th percentile: 3.1247885704040526
99th percentile: 3.315904293060303
mean time: 2.1701509952545166
Pipeline stage StressChecker completed in 11.63s
epiculous-crimson-dawn-v0-1_v5 status is now deployed due to DeploymentManager action
epiculous-crimson-dawn-v0-1_v5 status is now inactive due to auto deactivation removed underperforming models
epiculous-crimson-dawn-v0-1_v5 status is now torndown due to DeploymentManager action