submission_id: epiculous-crimson-dawn-v0-1_v5
developer_uid: Epiculous
alignment_samples: 12624
alignment_score: -0.2845906296461082
best_of: 8
celo_rating: 1242.11
display_name: Crimson_Dawn-V01_Alpha
formatter: {'memory_template': "<s>{bot_name}'s Persona: {memory}\\\\\n\\\\\n", 'prompt_template': '{prompt} [/INST]', 'bot_template': '{bot_name}: {message}</s>', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.25, 'top_p': 1.0, 'min_p': 0.075, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '[/INST]'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: False
language_model: Epiculous/Crimson_Dawn-V0.1
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: Epiculous/Crimson_Dawn-V
model_name: Crimson_Dawn-V01_Alpha
model_num_parameters: 12772070400.0
model_repo: Epiculous/Crimson_Dawn-V0.1
model_size: 13B
num_battles: 12624
num_wins: 6569
propriety_score: 0.7287985865724381
propriety_total_count: 1132.0
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-17T20:33:06+00:00
us_pacific_date: 2024-08-17
win_ratio: 0.5203580481622306
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name epiculous-crimson-dawn-v0-1-v5-mkmlizer
Waiting for job on epiculous-crimson-dawn-v0-1-v5-mkmlizer to finish
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║     _____            __           __                                ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║       /___/                                                         ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Version: 0.9.11                                                    ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  https://mk1.ai                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  belonging to:                                                      ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Chai Research Corp.                                                ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Downloaded to shared memory in 34.493s
epiculous-crimson-dawn-v0-1-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp_v9qzelv, device:0
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
epiculous-crimson-dawn-v0-1-v5-mkmlizer: quantized model in 36.020s
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Processed model Epiculous/Crimson_Dawn-V0.1 in 70.513s
epiculous-crimson-dawn-v0-1-v5-mkmlizer: creating bucket guanaco-mkml-models
epiculous-crimson-dawn-v0-1-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
epiculous-crimson-dawn-v0-1-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/config.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/special_tokens_map.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/tokenizer_config.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/tokenizer.json
epiculous-crimson-dawn-v0-1-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v5/flywheel_model.0.safetensors
epiculous-crimson-dawn-v0-1-v5-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:10, 32.89it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:06, 51.29it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:08, 42.57it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:08, 42.15it/s]
Loading 0:   9%|▊         | 31/363 [00:00<00:06, 48.34it/s]
Loading 0:  10%|█         | 37/363 [00:00<00:07, 44.33it/s]
Loading 0:  12%|█▏        | 42/363 [00:00<00:07, 42.92it/s]
Loading 0:  13%|█▎        | 49/363 [00:01<00:06, 47.73it/s]
Loading 0:  15%|█▌        | 55/363 [00:01<00:06, 44.36it/s]
Loading 0:  17%|█▋        | 61/363 [00:01<00:09, 33.54it/s]
Loading 0:  18%|█▊        | 65/363 [00:01<00:08, 33.18it/s]
Loading 0:  20%|█▉        | 72/363 [00:01<00:07, 39.24it/s]
Loading 0:  21%|██        | 77/363 [00:01<00:06, 41.10it/s]
Loading 0:  23%|██▎       | 82/363 [00:02<00:08, 34.39it/s]
Loading 0:  25%|██▍       | 89/363 [00:02<00:06, 41.66it/s]
Loading 0:  26%|██▌       | 94/363 [00:02<00:06, 41.10it/s]
Loading 0:  27%|██▋       | 99/363 [00:02<00:06, 41.90it/s]
Loading 0:  29%|██▊       | 104/363 [00:02<00:05, 43.61it/s]
Loading 0:  30%|███       | 110/363 [00:02<00:06, 41.42it/s]
Loading 0:  32%|███▏      | 115/363 [00:02<00:05, 42.23it/s]
Loading 0:  33%|███▎      | 120/363 [00:02<00:06, 40.42it/s]
Loading 0:  34%|███▍      | 125/363 [00:03<00:05, 42.36it/s]
Loading 0:  36%|███▌      | 130/363 [00:03<00:05, 42.42it/s]
Loading 0:  37%|███▋      | 135/363 [00:03<00:05, 42.68it/s]
Loading 0:  39%|███▊      | 140/363 [00:03<00:05, 43.73it/s]
Loading 0:  40%|███▉      | 145/363 [00:03<00:08, 25.81it/s]
Loading 0:  41%|████      | 149/363 [00:03<00:07, 26.89it/s]
Loading 0:  43%|████▎     | 156/363 [00:04<00:06, 34.24it/s]
Loading 0:  44%|████▍     | 161/363 [00:04<00:05, 35.84it/s]
Loading 0:  46%|████▌     | 166/363 [00:04<00:05, 37.37it/s]
Loading 0:  47%|████▋     | 172/363 [00:04<00:05, 37.64it/s]
Loading 0:  49%|████▉     | 177/363 [00:04<00:04, 38.46it/s]
Loading 0:  50%|█████     | 183/363 [00:04<00:04, 43.11it/s]
Loading 0:  52%|█████▏    | 188/363 [00:04<00:04, 42.83it/s]
Loading 0:  53%|█████▎    | 193/363 [00:04<00:03, 42.61it/s]
Loading 0:  55%|█████▍    | 199/363 [00:05<00:03, 41.79it/s]
Loading 0:  56%|█████▌    | 204/363 [00:05<00:03, 41.60it/s]
Loading 0:  58%|█████▊    | 210/363 [00:05<00:03, 45.15it/s]
Loading 0:  59%|█████▉    | 215/363 [00:05<00:03, 44.79it/s]
Loading 0:  61%|██████    | 221/363 [00:05<00:02, 48.54it/s]
Loading 0:  62%|██████▏   | 226/363 [00:05<00:04, 30.05it/s]
Loading 0:  63%|██████▎   | 230/363 [00:05<00:04, 30.61it/s]
Loading 0:  65%|██████▌   | 237/363 [00:06<00:03, 38.41it/s]
Loading 0:  67%|██████▋   | 242/363 [00:06<00:03, 39.60it/s]
Loading 0:  68%|██████▊   | 247/363 [00:06<00:02, 40.69it/s]
Loading 0:  70%|██████▉   | 253/363 [00:06<00:02, 40.37it/s]
Loading 0:  71%|███████   | 258/363 [00:06<00:02, 40.34it/s]
Loading 0:  73%|███████▎  | 264/363 [00:06<00:02, 43.82it/s]
Loading 0:  74%|███████▍  | 269/363 [00:06<00:02, 43.73it/s]
Loading 0:  75%|███████▌  | 274/363 [00:06<00:02, 44.03it/s]
Loading 0:  77%|███████▋  | 280/363 [00:07<00:01, 42.30it/s]
Loading 0:  79%|███████▊  | 285/363 [00:07<00:01, 41.09it/s]
Loading 0:  80%|████████  | 291/363 [00:07<00:01, 44.64it/s]
Loading 0:  82%|████████▏ | 296/363 [00:07<00:01, 44.32it/s]
Loading 0:  83%|████████▎ | 302/363 [00:07<00:01, 48.20it/s]
Loading 0:  85%|████████▍ | 307/363 [00:14<00:22,  2.51it/s]
Loading 0:  86%|████████▌ | 312/363 [00:14<00:14,  3.42it/s]
Loading 0:  88%|████████▊ | 320/363 [00:14<00:07,  5.48it/s]
Loading 0:  90%|████████▉ | 326/363 [00:14<00:05,  7.37it/s]
Loading 0:  91%|█████████ | 331/363 [00:14<00:03,  9.42it/s]
Loading 0:  93%|█████████▎| 338/363 [00:14<00:01, 13.31it/s]
Loading 0:  95%|█████████▍| 344/363 [00:15<00:01, 16.66it/s]
Loading 0:  96%|█████████▌| 349/363 [00:15<00:00, 19.86it/s]
Loading 0:  98%|█████████▊| 356/363 [00:15<00:00, 26.03it/s]
Loading 0: 100%|█████████▉| 362/363 [00:15<00:00, 29.30it/s]
                                                            

Job epiculous-crimson-dawn-v0-1-v5-mkmlizer completed after 94.95s with status: succeeded
Stopping job with name epiculous-crimson-dawn-v0-1-v5-mkmlizer
Pipeline stage MKMLizer completed in 95.85s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service epiculous-crimson-dawn-v0-1-v5
Waiting for inference service epiculous-crimson-dawn-v0-1-v5 to be ready
Inference service epiculous-crimson-dawn-v0-1-v5 ready after 241.673113822937s
Pipeline stage ISVCDeployer completed in 243.31s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1692099571228027s
Received healthy response to inference request in 1.555760383605957s
Received healthy response to inference request in 1.657496452331543s
Received healthy response to inference request in 3.3636832237243652s
Received healthy response to inference request in 2.104604959487915s
5 requests
0 failed requests
5th percentile: 1.5761075973510743
10th percentile: 1.5964548110961914
20th percentile: 1.6371492385864257
30th percentile: 1.7469181537628173
40th percentile: 1.9257615566253663
50th percentile: 2.104604959487915
60th percentile: 2.13044695854187
70th percentile: 2.1562889575958253
80th percentile: 2.4081046104431154
90th percentile: 2.8858939170837403
95th percentile: 3.1247885704040526
99th percentile: 3.315904293060303
mean time: 2.1701509952545166
Pipeline stage StressChecker completed in 11.63s
epiculous-crimson-dawn-v0-1_v5 status is now deployed due to DeploymentManager action
epiculous-crimson-dawn-v0-1_v5 status is now inactive due to auto deactivation removed underperforming models
epiculous-crimson-dawn-v0-1_v5 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics