deverdever-heavenly-mouse-v11

developer_uid: clover0103

submission_id: deverdever-heavenly-mouse-v11_v1

model_name: deverdever-heavenly-mouse-v11_v1

model_group: DeverDever/heavenly-mous

status: torndown

timestamp: 2024-08-20T12:22:53+00:00

num_battles: 12446

num_wins: 5921

celo_rating: 1215.65

family_friendly_score: 0.0

submission_type: basic

model_repo: DeverDever/heavenly-mouse-v11

model_architecture: LlamaForCausalLM

model_num_parameters: 8030261248.0

best_of: 16

max_input_tokens: 512

max_output_tokens: 64

display_name: deverdever-heavenly-mouse-v11_v1

is_internal_developer: False

language_model: DeverDever/heavenly-mouse-v11

model_size: 8B

ranking_group: single

us_pacific_date: 2024-08-20

win_ratio: 0.47573517596014786

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|end_header_id|>', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}

formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': True}

Resubmit model

Running pipeline stage MKMLizer
Starting job with name deverdever-heavenly-mouse-v11-v1-mkmlizer
Waiting for job on deverdever-heavenly-mouse-v11-v1-mkmlizer to finish
deverdever-heavenly-mouse-v11-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║     _____            __           __                                ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║       /___/                                                         ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║                                                                     ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  Version: 0.9.11                                                    ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  https://mk1.ai                                                     ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║                                                                     ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  belonging to:                                                      ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║                                                                     ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  Chai Research Corp.                                                ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ║                                                                     ║
deverdever-heavenly-mouse-v11-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
deverdever-heavenly-mouse-v11-v1-mkmlizer: Downloaded to shared memory in 40.570s
deverdever-heavenly-mouse-v11-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpos10y2dv, device:0
deverdever-heavenly-mouse-v11-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
deverdever-heavenly-mouse-v11-v1-mkmlizer: quantized model in 25.692s
deverdever-heavenly-mouse-v11-v1-mkmlizer: Processed model DeverDever/heavenly-mouse-v11 in 66.262s
deverdever-heavenly-mouse-v11-v1-mkmlizer: creating bucket guanaco-mkml-models
deverdever-heavenly-mouse-v11-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
deverdever-heavenly-mouse-v11-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/config.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/special_tokens_map.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/tokenizer_config.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/tokenizer.json
deverdever-heavenly-mouse-v11-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/deverdever-heavenly-mouse-v11-v1/flywheel_model.0.safetensors
deverdever-heavenly-mouse-v11-v1-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/291 [00:00<00:07, 37.27it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:04, 59.25it/s]
Loading 0:   7%|▋         | 20/291 [00:00<00:04, 55.23it/s]
Loading 0:   9%|▉         | 26/291 [00:00<00:04, 54.54it/s]
Loading 0:  11%|█         | 32/291 [00:00<00:05, 46.48it/s]
Loading 0:  14%|█▍        | 41/291 [00:00<00:05, 48.65it/s]
Loading 0:  17%|█▋        | 50/291 [00:00<00:04, 49.99it/s]
Loading 0:  20%|█▉        | 58/291 [00:01<00:04, 56.39it/s]
Loading 0:  22%|██▏       | 64/291 [00:01<00:04, 51.06it/s]
Loading 0:  24%|██▍       | 70/291 [00:01<00:04, 51.26it/s]
Loading 0:  26%|██▌       | 76/291 [00:01<00:04, 53.11it/s]
Loading 0:  28%|██▊       | 82/291 [00:01<00:04, 49.10it/s]
Loading 0:  30%|███       | 88/291 [00:01<00:05, 34.21it/s]
Loading 0:  32%|███▏      | 94/291 [00:02<00:05, 38.76it/s]
Loading 0:  34%|███▍      | 100/291 [00:02<00:04, 39.28it/s]
Loading 0:  36%|███▌      | 105/291 [00:02<00:04, 40.43it/s]
Loading 0:  38%|███▊      | 112/291 [00:02<00:03, 46.31it/s]
Loading 0:  41%|████      | 118/291 [00:02<00:03, 44.67it/s]
Loading 0:  42%|████▏     | 123/291 [00:02<00:03, 42.51it/s]
Loading 0:  45%|████▍     | 130/291 [00:02<00:03, 47.51it/s]
Loading 0:  47%|████▋     | 136/291 [00:02<00:03, 45.26it/s]
Loading 0:  48%|████▊     | 141/291 [00:03<00:03, 43.78it/s]
Loading 0:  51%|█████     | 148/291 [00:03<00:02, 48.55it/s]
Loading 0:  53%|█████▎    | 154/291 [00:03<00:03, 45.16it/s]
Loading 0:  55%|█████▍    | 159/291 [00:03<00:02, 44.28it/s]
Loading 0:  57%|█████▋    | 166/291 [00:03<00:02, 48.46it/s]
Loading 0:  59%|█████▉    | 172/291 [00:03<00:02, 45.41it/s]
Loading 0:  62%|██████▏   | 179/291 [00:03<00:02, 49.89it/s]
Loading 0:  64%|██████▎   | 185/291 [00:03<00:02, 51.65it/s]
Loading 0:  66%|██████▌   | 191/291 [00:04<00:02, 33.38it/s]
Loading 0:  67%|██████▋   | 196/291 [00:04<00:02, 34.81it/s]
Loading 0:  69%|██████▉   | 202/291 [00:04<00:02, 38.93it/s]
Loading 0:  71%|███████▏  | 208/291 [00:04<00:02, 39.77it/s]
Loading 0:  73%|███████▎  | 213/291 [00:04<00:01, 41.32it/s]
Loading 0:  75%|███████▌  | 219/291 [00:04<00:01, 45.72it/s]
Loading 0:  77%|███████▋  | 224/291 [00:04<00:01, 46.58it/s]
Loading 0:  79%|███████▉  | 230/291 [00:05<00:01, 42.47it/s]
Loading 0:  82%|████████▏ | 238/291 [00:05<00:01, 50.71it/s]
Loading 0:  84%|████████▍ | 244/291 [00:05<00:00, 47.05it/s]
Loading 0:  86%|████████▌ | 249/291 [00:05<00:00, 45.95it/s]
Loading 0:  88%|████████▊ | 256/291 [00:05<00:00, 50.71it/s]
Loading 0:  90%|█████████ | 262/291 [00:05<00:00, 46.37it/s]
Loading 0:  92%|█████████▏| 267/291 [00:05<00:00, 45.08it/s]
Loading 0:  94%|█████████▍| 274/291 [00:05<00:00, 50.14it/s]
Loading 0:  96%|█████████▌| 280/291 [00:06<00:00, 47.66it/s]
Loading 0:  98%|█████████▊| 285/291 [00:06<00:00, 47.24it/s]
Loading 0: 100%|█████████▉| 290/291 [00:11<00:00,  3.30it/s]
                                                            
Job deverdever-heavenly-mouse-v11-v1-mkmlizer completed after 94.01s with status: succeeded
Stopping job with name deverdever-heavenly-mouse-v11-v1-mkmlizer
Pipeline stage MKMLizer completed in 95.29s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service deverdever-heavenly-mouse-v11-v1
Waiting for inference service deverdever-heavenly-mouse-v11-v1 to be ready
Inference service deverdever-heavenly-mouse-v11-v1 ready after 241.86760187149048s
Pipeline stage ISVCDeployer completed in 244.02s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.905378818511963s
Received healthy response to inference request in 1.4800448417663574s
Received healthy response to inference request in 2.4102864265441895s
Received healthy response to inference request in 1.5376038551330566s
Received healthy response to inference request in 1.8983547687530518s
5 requests
0 failed requests
5th percentile: 1.4915566444396973
10th percentile: 1.503068447113037
20th percentile: 1.5260920524597168
30th percentile: 1.6097540378570556
40th percentile: 1.7540544033050538
50th percentile: 1.8983547687530518
60th percentile: 1.9011643886566163
70th percentile: 1.9039740085601806
80th percentile: 2.0063603401184085
90th percentile: 2.2083233833312987
95th percentile: 2.309304904937744
99th percentile: 2.3900901222229005
mean time: 1.8463337421417236
Pipeline stage StressChecker completed in 9.91s
deverdever-heavenly-mouse-v11_v1 status is now deployed due to DeploymentManager action
deverdever-heavenly-mouse-v11_v1 status is now inactive due to auto deactivation removed underperforming models
deverdever-heavenly-mouse-v11_v1 status is now torndown due to DeploymentManager action