rica40325-yui-new-chai

developer_uid: rica40325

submission_id: rica40325-yui-new-chai_v12

model_name: rica40325-yui-new-chai_v10

model_group: rica40325/yui-new-chai

status: torndown

timestamp: 2024-08-26T08:32:07+00:00

num_battles: 10835

num_wins: 5230

celo_rating: 1223.29

family_friendly_score: 0.0

submission_type: basic

model_repo: rica40325/yui-new-chai

model_architecture: LlamaForCausalLM

model_num_parameters: 8030261248.0

best_of: 16

max_input_tokens: 512

max_output_tokens: 64

display_name: rica40325-yui-new-chai_v10

is_internal_developer: False

language_model: rica40325/yui-new-chai

model_size: 8B

ranking_group: single

us_pacific_date: 2024-08-26

win_ratio: 0.4826949700046147

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Running pipeline stage MKMLizer
Starting job with name rica40325-yui-new-chai-v12-mkmlizer
Waiting for job on rica40325-yui-new-chai-v12-mkmlizer to finish
rica40325-yui-new-chai-v12-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rica40325-yui-new-chai-v12-mkmlizer: ║     _____            __           __                                ║
rica40325-yui-new-chai-v12-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rica40325-yui-new-chai-v12-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rica40325-yui-new-chai-v12-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rica40325-yui-new-chai-v12-mkmlizer: ║       /___/                                                         ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Version: 0.10.1                                                    ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rica40325-yui-new-chai-v12-mkmlizer: ║  https://mk1.ai                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║  The license key for the current software has been verified as      ║
rica40325-yui-new-chai-v12-mkmlizer: ║  belonging to:                                                      ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Chai Research Corp.                                                ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rica40325-yui-new-chai-v12-mkmlizer: Downloaded to shared memory in 21.913s
rica40325-yui-new-chai-v12-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp218l7kxo, device:0
rica40325-yui-new-chai-v12-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
rica40325-yui-new-chai-v12-mkmlizer: quantized model in 26.136s
rica40325-yui-new-chai-v12-mkmlizer: Processed model rica40325/yui-new-chai in 48.049s
rica40325-yui-new-chai-v12-mkmlizer: creating bucket guanaco-mkml-models
rica40325-yui-new-chai-v12-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rica40325-yui-new-chai-v12-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rica40325-yui-new-chai-v12
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/config.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/special_tokens_map.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/tokenizer_config.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/tokenizer.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/flywheel_model.0.safetensors
rica40325-yui-new-chai-v12-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 4/291 [00:00<00:07, 38.95it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:04, 59.86it/s]
Loading 0:   8%|▊         | 22/291 [00:00<00:04, 65.29it/s]
Loading 0:  11%|█         | 31/291 [00:00<00:03, 70.34it/s]
Loading 0:  14%|█▎        | 40/291 [00:00<00:03, 73.00it/s]
Loading 0:  17%|█▋        | 49/291 [00:00<00:03, 74.04it/s]
Loading 0:  20%|█▉        | 58/291 [00:00<00:03, 74.99it/s]
Loading 0:  23%|██▎       | 67/291 [00:00<00:02, 74.72it/s]
Loading 0:  26%|██▌       | 76/291 [00:01<00:02, 74.73it/s]
Loading 0:  29%|██▉       | 84/291 [00:02<00:10, 20.47it/s]
Loading 0:  31%|███       | 90/291 [00:02<00:08, 23.45it/s]
Loading 0:  33%|███▎      | 97/291 [00:02<00:06, 28.19it/s]
Loading 0:  36%|███▋      | 106/291 [00:02<00:05, 35.64it/s]
Loading 0:  40%|███▉      | 115/291 [00:02<00:04, 43.35it/s]
Loading 0:  43%|████▎     | 124/291 [00:02<00:03, 50.51it/s]
Loading 0:  46%|████▌     | 133/291 [00:02<00:02, 56.56it/s]
Loading 0:  49%|████▉     | 142/291 [00:03<00:02, 61.54it/s]
Loading 0:  52%|█████▏    | 151/291 [00:03<00:02, 65.82it/s]
Loading 0:  55%|█████▍    | 160/291 [00:03<00:01, 68.79it/s]
Loading 0:  58%|█████▊    | 169/291 [00:03<00:01, 70.48it/s]
Loading 0:  61%|██████    | 178/291 [00:03<00:01, 70.29it/s]
Loading 0:  64%|██████▍   | 187/291 [00:04<00:05, 20.77it/s]
Loading 0:  67%|██████▋   | 196/291 [00:04<00:03, 26.67it/s]
Loading 0:  70%|███████   | 205/291 [00:04<00:02, 33.32it/s]
Loading 0:  74%|███████▎  | 214/291 [00:04<00:01, 40.32it/s]
Loading 0:  77%|███████▋  | 223/291 [00:05<00:01, 47.35it/s]
Loading 0:  80%|███████▉  | 232/291 [00:05<00:01, 53.69it/s]
Loading 0:  83%|████████▎ | 241/291 [00:05<00:00, 59.02it/s]
Loading 0:  86%|████████▌ | 250/291 [00:05<00:00, 65.15it/s]
Loading 0:  89%|████████▉ | 259/291 [00:05<00:00, 69.63it/s]
Loading 0:  92%|█████████▏| 268/291 [00:05<00:00, 73.39it/s]
Loading 0:  95%|█████████▌| 277/291 [00:05<00:00, 76.46it/s]
Loading 0:  98%|█████████▊| 286/291 [00:05<00:00, 78.69it/s]
                                                            
Job rica40325-yui-new-chai-v12-mkmlizer completed after 75.46s with status: succeeded
Stopping job with name rica40325-yui-new-chai-v12-mkmlizer
Pipeline stage MKMLizer completed in 76.48s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.40s
Running pipeline stage ISVCDeployer
Creating inference service rica40325-yui-new-chai-v12
Waiting for inference service rica40325-yui-new-chai-v12 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service rica40325-yui-new-chai-v12 ready after 161.3501033782959s
Pipeline stage ISVCDeployer completed in 162.70s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.076188802719116s
Received healthy response to inference request in 1.5113375186920166s
Received healthy response to inference request in 1.9369115829467773s
Received healthy response to inference request in 1.6329619884490967s
Received healthy response to inference request in 1.7824747562408447s
5 requests
0 failed requests
5th percentile: 1.5356624126434326
10th percentile: 1.5599873065948486
20th percentile: 1.6086370944976807
30th percentile: 1.6628645420074464
40th percentile: 1.7226696491241456
50th percentile: 1.7824747562408447
60th percentile: 1.8442494869232178
70th percentile: 1.9060242176055908
80th percentile: 1.9647670269012452
90th percentile: 2.0204779148101806
95th percentile: 2.0483333587646486
99th percentile: 2.0706177139282227
mean time: 1.7879749298095704
Pipeline stage StressChecker completed in 10.51s
rica40325-yui-new-chai_v12 status is now deployed due to DeploymentManager action
rica40325-yui-new-chai_v12 status is now inactive due to auto deactivation removed underperforming models
rica40325-yui-new-chai_v12 status is now torndown due to DeploymentManager action
rica40325-yui-new-chai_v12 status is now torndown due to DeploymentManager action