submission_id: epiculous-crimson-dawn-v0-1_v3
developer_uid: Epiculous
alignment_samples: 11924
alignment_score: -0.1593926072888218
best_of: 8
celo_rating: 1245.63
display_name: Crimson_Dawn-V01_Alpha
formatter: {'memory_template': "<s>{bot_name}'s Persona: {memory}\\\\\n\\\\\n", 'prompt_template': '{prompt} [/INST]', 'bot_template': '{bot_name}: {message}</s>', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.25, 'top_p': 1.0, 'min_p': 0.075, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '[/INST]'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: False
language_model: Epiculous/Crimson_Dawn-V0.1
max_input_tokens: 512
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: Epiculous/Crimson_Dawn-V
model_name: Crimson_Dawn-V01_Alpha
model_num_parameters: 12772070400.0
model_repo: Epiculous/Crimson_Dawn-V0.1
model_size: 13B
num_battles: 11924
num_wins: 6257
propriety_score: 0.7252641690682037
propriety_total_count: 1041.0
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-17T20:12:59+00:00
us_pacific_date: 2024-08-17
win_ratio: 0.524740020127474
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name epiculous-crimson-dawn-v0-1-v3-mkmlizer
Waiting for job on epiculous-crimson-dawn-v0-1-v3-mkmlizer to finish
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║     _____            __           __                                ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║       /___/                                                         ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  Version: 0.9.11                                                    ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  https://mk1.ai                                                     ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  belonging to:                                                      ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  Chai Research Corp.                                                ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ║                                                                     ║
epiculous-crimson-dawn-v0-1-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
epiculous-crimson-dawn-v0-1-v3-mkmlizer: Downloaded to shared memory in 29.075s
epiculous-crimson-dawn-v0-1-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpg4zg5_kz, device:0
epiculous-crimson-dawn-v0-1-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission blend_jenes_2024-08-16: ('http://mistralai-mixtral-8x7b-3473-v130-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:51550->127.0.0.1:8080: read: connection reset by peer\n')
epiculous-crimson-dawn-v0-1-v3-mkmlizer: quantized model in 35.831s
epiculous-crimson-dawn-v0-1-v3-mkmlizer: Processed model Epiculous/Crimson_Dawn-V0.1 in 64.907s
epiculous-crimson-dawn-v0-1-v3-mkmlizer: creating bucket guanaco-mkml-models
epiculous-crimson-dawn-v0-1-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
epiculous-crimson-dawn-v0-1-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v3
epiculous-crimson-dawn-v0-1-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v3/config.json
epiculous-crimson-dawn-v0-1-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v3/special_tokens_map.json
epiculous-crimson-dawn-v0-1-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v3/tokenizer_config.json
epiculous-crimson-dawn-v0-1-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/epiculous-crimson-dawn-v0-1-v3/tokenizer.json
epiculous-crimson-dawn-v0-1-v3-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:10, 33.82it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:06, 53.49it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:07, 47.31it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:07, 45.66it/s]
Loading 0:   9%|▊         | 31/363 [00:00<00:06, 51.62it/s]
Loading 0:  10%|█         | 37/363 [00:00<00:06, 48.18it/s]
Loading 0:  12%|█▏        | 42/363 [00:00<00:06, 46.36it/s]
Loading 0:  13%|█▎        | 49/363 [00:01<00:06, 51.26it/s]
Loading 0:  15%|█▌        | 55/363 [00:01<00:06, 48.20it/s]
Loading 0:  17%|█▋        | 61/363 [00:01<00:08, 35.49it/s]
Loading 0:  18%|█▊        | 66/363 [00:01<00:08, 35.22it/s]
Loading 0:  20%|█▉        | 72/363 [00:01<00:07, 39.64it/s]
Loading 0:  21%|██▏       | 78/363 [00:01<00:07, 40.10it/s]
Loading 0:  23%|██▎       | 83/363 [00:01<00:06, 40.53it/s]
Loading 0:  25%|██▍       | 90/363 [00:02<00:05, 45.70it/s]
Loading 0:  26%|██▋       | 96/363 [00:02<00:06, 44.19it/s]
Loading 0:  28%|██▊       | 101/363 [00:02<00:06, 42.77it/s]
Loading 0:  29%|██▉       | 106/363 [00:02<00:05, 44.41it/s]
Loading 0:  31%|███       | 112/363 [00:02<00:05, 48.32it/s]
Loading 0:  32%|███▏      | 117/363 [00:02<00:05, 46.19it/s]
Loading 0:  34%|███▍      | 123/363 [00:02<00:05, 43.74it/s]
Loading 0:  35%|███▌      | 128/363 [00:02<00:05, 43.05it/s]
Loading 0:  37%|███▋      | 134/363 [00:03<00:04, 47.30it/s]
Loading 0:  38%|███▊      | 139/363 [00:03<00:04, 45.99it/s]
Loading 0:  40%|███▉      | 144/363 [00:03<00:07, 29.01it/s]
Loading 0:  41%|████      | 149/363 [00:03<00:06, 31.30it/s]
Loading 0:  43%|████▎     | 156/363 [00:03<00:05, 37.65it/s]
Loading 0:  44%|████▍     | 161/363 [00:03<00:05, 39.01it/s]
Loading 0:  46%|████▌     | 166/363 [00:03<00:04, 40.09it/s]
Loading 0:  47%|████▋     | 171/363 [00:04<00:04, 41.46it/s]
Loading 0:  48%|████▊     | 176/363 [00:04<00:05, 35.17it/s]
Loading 0:  51%|█████     | 184/363 [00:04<00:04, 43.28it/s]
Loading 0:  52%|█████▏    | 190/363 [00:04<00:04, 42.38it/s]
Loading 0:  54%|█████▎    | 195/363 [00:04<00:04, 41.41it/s]
Loading 0:  56%|█████▌    | 202/363 [00:04<00:03, 45.99it/s]
Loading 0:  57%|█████▋    | 208/363 [00:04<00:03, 44.18it/s]
Loading 0:  59%|█████▊    | 213/363 [00:05<00:03, 42.01it/s]
Loading 0:  60%|██████    | 218/363 [00:05<00:03, 42.90it/s]
Loading 0:  61%|██████▏   | 223/363 [00:05<00:04, 32.51it/s]
Loading 0:  63%|██████▎   | 228/363 [00:05<00:03, 33.89it/s]
Loading 0:  64%|██████▍   | 232/363 [00:05<00:03, 34.83it/s]
Loading 0:  65%|██████▌   | 237/363 [00:05<00:03, 38.23it/s]
Loading 0:  67%|██████▋   | 242/363 [00:05<00:03, 40.02it/s]
Loading 0:  68%|██████▊   | 247/363 [00:05<00:02, 41.27it/s]
Loading 0:  70%|██████▉   | 253/363 [00:06<00:02, 40.57it/s]
Loading 0:  71%|███████   | 258/363 [00:06<00:02, 40.14it/s]
Loading 0:  73%|███████▎  | 264/363 [00:06<00:02, 44.64it/s]
Loading 0:  74%|███████▍  | 269/363 [00:06<00:02, 44.01it/s]
Loading 0:  75%|███████▌  | 274/363 [00:06<00:02, 42.62it/s]
Loading 0:  77%|███████▋  | 280/363 [00:06<00:01, 41.64it/s]
Loading 0:  79%|███████▊  | 285/363 [00:06<00:01, 41.28it/s]
Loading 0:  80%|████████  | 291/363 [00:06<00:01, 45.63it/s]
Loading 0:  82%|████████▏ | 296/363 [00:07<00:01, 45.59it/s]
Loading 0:  83%|████████▎ | 302/363 [00:07<00:01, 49.30it/s]
Loading 0:  85%|████████▍ | 308/363 [00:14<00:20,  2.66it/s]
Loading 0:  86%|████████▌ | 312/363 [00:14<00:15,  3.38it/s]
Loading 0:  88%|████████▊ | 320/363 [00:14<00:07,  5.44it/s]
Loading 0:  90%|████████▉ | 326/363 [00:14<00:05,  7.36it/s]
Loading 0:  91%|█████████ | 331/363 [00:14<00:03,  9.41it/s]
Loading 0:  93%|█████████▎| 338/363 [00:14<00:01, 13.33it/s]
Loading 0:  95%|█████████▍| 344/363 [00:14<00:01, 16.71it/s]
Loading 0:  96%|█████████▌| 349/363 [00:14<00:00, 19.64it/s]
Loading 0:  98%|█████████▊| 356/363 [00:15<00:00, 25.79it/s]
Loading 0: 100%|█████████▉| 362/363 [00:15<00:00, 28.86it/s]
                                                            

Job epiculous-crimson-dawn-v0-1-v3-mkmlizer completed after 94.63s with status: succeeded
Stopping job with name epiculous-crimson-dawn-v0-1-v3-mkmlizer
Pipeline stage MKMLizer completed in 95.96s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service epiculous-crimson-dawn-v0-1-v3
Waiting for inference service epiculous-crimson-dawn-v0-1-v3 to be ready
Failed to get response for submission blend_filor_2024-08-16: ('http://zonemercy-cogent-nemo-v2-5e6-v13-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission blend_berib_2024-08-16: ('http://mistralai-mixtral-8x7b-3473-v130-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '{"error":"ValueError : [TypeError(\\"\'numpy.int64\' object is not iterable\\"), TypeError(\'vars() argument must have __dict__ attribute\')]"}')
Inference service epiculous-crimson-dawn-v0-1-v3 ready after 241.49703121185303s
Pipeline stage ISVCDeployer completed in 242.78s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1143927574157715s
Received healthy response to inference request in 1.5344383716583252s
Received healthy response to inference request in 1.8668804168701172s
Received healthy response to inference request in 1.6625959873199463s
Received healthy response to inference request in 2.0942392349243164s
5 requests
0 failed requests
5th percentile: 1.5600698947906495
10th percentile: 1.5857014179229736
20th percentile: 1.636964464187622
30th percentile: 1.7034528732299805
40th percentile: 1.7851666450500487
50th percentile: 1.8668804168701172
60th percentile: 1.9578239440917968
70th percentile: 2.0487674713134765
80th percentile: 2.0982699394226074
90th percentile: 2.1063313484191895
95th percentile: 2.1103620529174805
99th percentile: 2.1135866165161135
mean time: 1.8545093536376953
Pipeline stage StressChecker completed in 9.94s
epiculous-crimson-dawn-v0-1_v3 status is now deployed due to DeploymentManager action
epiculous-crimson-dawn-v0-1_v3 status is now inactive due to auto deactivation removed underperforming models
epiculous-crimson-dawn-v0-1_v3 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics