submission_id: deverdever-heavenly-mouse-v11_v1
developer_uid: clover0103
alignment_samples: 12446
alignment_score: 0.3440065283740499
best_of: 16
celo_rating: 1215.63
display_name: deverdever-heavenly-mouse-v11_v1
formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': True}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|end_header_id|>', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: False
language_model: DeverDever/heavenly-mouse-v11
max_input_tokens: 512
max_output_tokens: 64
model_architecture: LlamaForCausalLM
model_group: DeverDever/heavenly-mous
model_name: deverdever-heavenly-mouse-v11_v1
model_num_parameters: 8030261248.0
model_repo: DeverDever/heavenly-mouse-v11
model_size: 8B
num_battles: 12446
num_wins: 5921
propriety_score: 0.7317073170731707
propriety_total_count: 1107.0
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-20T12:22:53+00:00
us_pacific_date: 2024-08-20
win_ratio: 0.47573517596014786
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name deverdever-heavenly-mouse-v11-v1-mkmlizer
Waiting for job on deverdever-heavenly-mouse-v11-v1-mkmlizer to finish
deverdever-heavenly-mouse-v11-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ _____ __ __ ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ / _/ /_ ___ __/ / ___ ___ / / ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ / _/ / // / |/|/ / _ \/ -_) -_) / ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ /_//_/\_, /|__,__/_//_/\__/\__/_/ ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ /___/ ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ Version: 0.9.11 ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ Copyright 2023 MK ONE TECHNOLOGIES Inc. ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ https://mk1.ai ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ The license key for the current software has been verified as ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ belonging to: ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ Chai Research Corp. ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ Expiration: 2024-10-15 23:59:59 ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║ ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
deverdever-heavenly-mouse-v11-v1-mkmlizer: Downloaded to shared memory in 40.570s
deverdever-heavenly-mouse-v11-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpos10y2dv, device:0
deverdever-heavenly-mouse-v11-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
deverdever-heavenly-mouse-v11-v1-mkmlizer: quantized model in 25.692s
deverdever-heavenly-mouse-v11-v1-mkmlizer: Processed model DeverDever/heavenly-mouse-v11 in 66.262s
deverdever-heavenly-mouse-v11-v1-mkmlizer: creating bucket guanaco-mkml-models
deverdever-heavenly-mouse-v11-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
deverdever-heavenly-mouse-v11-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/config.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/special_tokens_map.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/tokenizer_config.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/tokenizer.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/flywheel_model.0.safetensors
deverdever-heavenly-mouse-v11-v1-mkmlizer: Loading 0: 0%| | 0/291 [00:00<?, ?it/s] Loading 0: 2%|▏ | 5/291 [00:00<00:07, 37.27it/s] Loading 0: 4%|▍ | 13/291 [00:00<00:04, 59.25it/s] Loading 0: 7%|▋ | 20/291 [00:00<00:04, 55.23it/s] Loading 0: 9%|▉ | 26/291 [00:00<00:04, 54.54it/s] Loading 0: 11%|█ | 32/291 [00:00<00:05, 46.48it/s] Loading 0: 14%|█▍ | 41/291 [00:00<00:05, 48.65it/s] Loading 0: 17%|█▋ | 50/291 [00:00<00:04, 49.99it/s] Loading 0: 20%|█▉ | 58/291 [00:01<00:04, 56.39it/s] Loading 0: 22%|██▏ | 64/291 [00:01<00:04, 51.06it/s] Loading 0: 24%|██▍ | 70/291 [00:01<00:04, 51.26it/s] Loading 0: 26%|██▌ | 76/291 [00:01<00:04, 53.11it/s] Loading 0: 28%|██▊ | 82/291 [00:01<00:04, 49.10it/s] Loading 0: 30%|███ | 88/291 [00:01<00:05, 34.21it/s] Loading 0: 32%|███▏ | 94/291 [00:02<00:05, 38.76it/s] Loading 0: 34%|███▍ | 100/291 [00:02<00:04, 39.28it/s] Loading 0: 36%|███▌ | 105/291 [00:02<00:04, 40.43it/s] Loading 0: 38%|███▊ | 112/291 [00:02<00:03, 46.31it/s] Loading 0: 41%|████ | 118/291 [00:02<00:03, 44.67it/s] Loading 0: 42%|████▏ | 123/291 [00:02<00:03, 42.51it/s] Loading 0: 45%|████▍ | 130/291 [00:02<00:03, 47.51it/s] Loading 0: 47%|████▋ | 136/291 [00:02<00:03, 45.26it/s] Loading 0: 48%|████▊ | 141/291 [00:03<00:03, 43.78it/s] Loading 0: 51%|█████ | 148/291 [00:03<00:02, 48.55it/s] Loading 0: 53%|█████▎ | 154/291 [00:03<00:03, 45.16it/s] Loading 0: 55%|█████▍ | 159/291 [00:03<00:02, 44.28it/s] Loading 0: 57%|█████▋ | 166/291 [00:03<00:02, 48.46it/s] Loading 0: 59%|█████▉ | 172/291 [00:03<00:02, 45.41it/s] Loading 0: 62%|██████▏ | 179/291 [00:03<00:02, 49.89it/s] Loading 0: 64%|██████▎ | 185/291 [00:03<00:02, 51.65it/s] Loading 0: 66%|██████▌ | 191/291 [00:04<00:02, 33.38it/s] Loading 0: 67%|██████▋ | 196/291 [00:04<00:02, 34.81it/s] Loading 0: 69%|██████▉ | 202/291 [00:04<00:02, 38.93it/s] Loading 0: 71%|███████▏ | 208/291 [00:04<00:02, 39.77it/s] Loading 0: 73%|███████▎ | 213/291 [00:04<00:01, 41.32it/s] Loading 0: 75%|███████▌ | 219/291 [00:04<00:01, 45.72it/s] Loading 0: 77%|███████▋ | 224/291 [00:04<00:01, 46.58it/s] Loading 0: 79%|███████▉ | 230/291 [00:05<00:01, 42.47it/s] Loading 0: 82%|████████▏ | 238/291 [00:05<00:01, 50.71it/s] Loading 0: 84%|████████▍ | 244/291 [00:05<00:00, 47.05it/s] Loading 0: 86%|████████▌ | 249/291 [00:05<00:00, 45.95it/s] Loading 0: 88%|████████▊ | 256/291 [00:05<00:00, 50.71it/s] Loading 0: 90%|█████████ | 262/291 [00:05<00:00, 46.37it/s] Loading 0: 92%|█████████▏| 267/291 [00:05<00:00, 45.08it/s] Loading 0: 94%|█████████▍| 274/291 [00:05<00:00, 50.14it/s] Loading 0: 96%|█████████▌| 280/291 [00:06<00:00, 47.66it/s] Loading 0: 98%|█████████▊| 285/291 [00:06<00:00, 47.24it/s] Loading 0: 100%|█████████▉| 290/291 [00:11<00:00, 3.30it/s]
Job deverdever-heavenly-mouse-v11-v1-mkmlizer completed after 94.01s with status: succeeded
Stopping job with name deverdever-heavenly-mouse-v11-v1-mkmlizer
Pipeline stage MKMLizer completed in 95.29s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service deverdever-heavenly-mouse-v11-v1
Waiting for inference service deverdever-heavenly-mouse-v11-v1 to be ready
Inference service deverdever-heavenly-mouse-v11-v1 ready after 241.86760187149048s
Pipeline stage ISVCDeployer completed in 244.02s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.905378818511963s
Received healthy response to inference request in 1.4800448417663574s
Received healthy response to inference request in 2.4102864265441895s
Received healthy response to inference request in 1.5376038551330566s
Received healthy response to inference request in 1.8983547687530518s
5 requests
0 failed requests
5th percentile: 1.4915566444396973
10th percentile: 1.503068447113037
20th percentile: 1.5260920524597168
30th percentile: 1.6097540378570556
40th percentile: 1.7540544033050538
50th percentile: 1.8983547687530518
60th percentile: 1.9011643886566163
70th percentile: 1.9039740085601806
80th percentile: 2.0063603401184085
90th percentile: 2.2083233833312987
95th percentile: 2.309304904937744
99th percentile: 2.3900901222229005
mean time: 1.8463337421417236
Pipeline stage StressChecker completed in 9.91s
deverdever-heavenly-mouse-v11_v1 status is now deployed due to DeploymentManager action
deverdever-heavenly-mouse-v11_v1 status is now inactive due to auto deactivation removed underperforming models
deverdever-heavenly-mouse-v11_v1 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics