submission_id: stark2000s-axolotl-ultra_3888_v1
developer_uid: stark2000s
alignment_samples: 11416
alignment_score: 0.5820050309277754
best_of: 1
celo_rating: 1112.0
display_name: stark2000s-axolotl-ultra_3888_v1
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 64}
is_internal_developer: False
language_model: stark2000s/axolotl-ultrachat-default
max_input_tokens: 512
max_output_tokens: 64
model_architecture: LlamaForCausalLM
model_group: stark2000s/axolotl-ultra
model_name: stark2000s-axolotl-ultra_3888_v1
model_num_parameters: 8030261248.0
model_repo: stark2000s/axolotl-ultrachat-default
model_size: 8B
num_battles: 11416
num_wins: 3815
propriety_score: 0.7408123791102514
propriety_total_count: 1034.0
ranking_group: single
status: inactive
submission_type: basic
timestamp: 2024-08-30T08:26:50+00:00
us_pacific_date: 2024-08-30
win_ratio: 0.3341800981079187
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name stark2000s-axolotl-ultra-3888-v1-mkmlizer
Waiting for job on stark2000s-axolotl-ultra-3888-v1-mkmlizer to finish
Stopping job with name stark2000s-axolotl-ultra-3888-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name stark2000s-axolotl-ultra-3888-v1-mkmlizer
Waiting for job on stark2000s-axolotl-ultra-3888-v1-mkmlizer to finish
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║     _____            __           __                                ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║       /___/                                                         ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║                                                                     ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  https://mk1.ai                                                     ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║                                                                     ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  belonging to:                                                      ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║                                                                     ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  Chai Research Corp.                                                ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ║                                                                     ║
stark2000s-axolotl-ultra-3888-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
stark2000s-axolotl-ultra-3888-v1-mkmlizer: Downloaded to shared memory in 37.134s
stark2000s-axolotl-ultra-3888-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpzqxr83mz, device:0
stark2000s-axolotl-ultra-3888-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
stark2000s-axolotl-ultra-3888-v1-mkmlizer: quantized model in 26.025s
stark2000s-axolotl-ultra-3888-v1-mkmlizer: Processed model stark2000s/axolotl-ultrachat-default in 63.160s
stark2000s-axolotl-ultra-3888-v1-mkmlizer: creating bucket guanaco-mkml-models
stark2000s-axolotl-ultra-3888-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
stark2000s-axolotl-ultra-3888-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/stark2000s-axolotl-ultra-3888-v1
stark2000s-axolotl-ultra-3888-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/stark2000s-axolotl-ultra-3888-v1/config.json
stark2000s-axolotl-ultra-3888-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/stark2000s-axolotl-ultra-3888-v1/special_tokens_map.json
stark2000s-axolotl-ultra-3888-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/stark2000s-axolotl-ultra-3888-v1/tokenizer_config.json
stark2000s-axolotl-ultra-3888-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/stark2000s-axolotl-ultra-3888-v1/tokenizer.json
stark2000s-axolotl-ultra-3888-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/stark2000s-axolotl-ultra-3888-v1/flywheel_model.0.safetensors
stark2000s-axolotl-ultra-3888-v1-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 7/291 [00:00<00:05, 52.43it/s]
Loading 0:   6%|▌         | 17/291 [00:00<00:03, 76.74it/s]
Loading 0:   9%|▉         | 26/291 [00:00<00:03, 82.24it/s]
Loading 0:  12%|█▏        | 35/291 [00:00<00:03, 84.48it/s]
Loading 0:  15%|█▌        | 44/291 [00:00<00:02, 84.37it/s]
Loading 0:  18%|█▊        | 53/291 [00:00<00:03, 77.56it/s]
Loading 0:  21%|██        | 61/291 [00:00<00:03, 71.94it/s]
Loading 0:  24%|██▍       | 70/291 [00:00<00:02, 75.75it/s]
Loading 0:  29%|██▊       | 83/291 [00:02<00:08, 23.79it/s]
Loading 0:  31%|███       | 89/291 [00:02<00:07, 26.14it/s]
Loading 0:  33%|███▎      | 97/291 [00:02<00:06, 32.32it/s]
Loading 0:  38%|███▊      | 112/291 [00:02<00:03, 45.98it/s]
Loading 0:  42%|████▏     | 121/291 [00:02<00:03, 52.94it/s]
Loading 0:  45%|████▌     | 131/291 [00:02<00:02, 61.66it/s]
Loading 0:  49%|████▉     | 142/291 [00:02<00:02, 65.54it/s]
Loading 0:  52%|█████▏    | 151/291 [00:02<00:01, 70.07it/s]
Loading 0:  55%|█████▍    | 160/291 [00:02<00:01, 72.17it/s]
Loading 0:  58%|█████▊    | 170/291 [00:03<00:01, 78.55it/s]
Loading 0:  62%|██████▏   | 179/291 [00:03<00:01, 81.36it/s]
Loading 0:  65%|██████▍   | 188/291 [00:04<00:04, 22.02it/s]
Loading 0:  69%|██████▉   | 202/291 [00:04<00:02, 31.59it/s]
Loading 0:  73%|███████▎  | 211/291 [00:04<00:02, 37.76it/s]
Loading 0:  76%|███████▌  | 220/291 [00:04<00:01, 44.61it/s]
Loading 0:  79%|███████▊  | 229/291 [00:04<00:01, 51.82it/s]
Loading 0:  82%|████████▏ | 240/291 [00:04<00:00, 62.60it/s]
Loading 0:  86%|████████▌ | 250/291 [00:05<00:00, 63.49it/s]
Loading 0:  89%|████████▉ | 259/291 [00:05<00:00, 68.61it/s]
Loading 0:  94%|█████████▍| 274/291 [00:05<00:00, 79.56it/s]
Loading 0:  98%|█████████▊| 284/291 [00:05<00:00, 84.10it/s]
                                                            

Job stark2000s-axolotl-ultra-3888-v1-mkmlizer completed after 83.67s with status: succeeded
Stopping job with name stark2000s-axolotl-ultra-3888-v1-mkmlizer
Pipeline stage MKMLizer completed in 85.73s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.20s
Running pipeline stage ISVCDeployer
Creating inference service stark2000s-axolotl-ultra-3888-v1
Waiting for inference service stark2000s-axolotl-ultra-3888-v1 to be ready
Inference service stark2000s-axolotl-ultra-3888-v1 ready after 181.3046314716339s
Pipeline stage ISVCDeployer completed in 181.66s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.232283592224121s
Received healthy response to inference request in 0.9082400798797607s
Received healthy response to inference request in 0.5465528964996338s
Received healthy response to inference request in 0.7974240779876709s
Received healthy response to inference request in 0.9447362422943115s
5 requests
0 failed requests
5th percentile: 0.5967271327972412
10th percentile: 0.6469013690948486
20th percentile: 0.7472498416900635
30th percentile: 0.8195872783660889
40th percentile: 0.8639136791229248
50th percentile: 0.9082400798797607
60th percentile: 0.922838544845581
70th percentile: 0.9374370098114013
80th percentile: 1.0022457122802735
90th percentile: 1.1172646522521972
95th percentile: 1.1747741222381591
99th percentile: 1.2207816982269286
mean time: 0.8858473777770997
Pipeline stage StressChecker completed in 5.23s
stark2000s-axolotl-ultra_3888_v1 status is now deployed due to DeploymentManager action
stark2000s-axolotl-ultra_3888_v1 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics