submission_id: rica40325-yui-new-chai_v12
developer_uid: rica40325
alignment_samples: 10835
alignment_score: 0.2537216981929404
best_of: 16
celo_rating: 1223.21
display_name: rica40325-yui-new-chai_v10
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: False
language_model: rica40325/yui-new-chai
max_input_tokens: 512
max_output_tokens: 64
model_architecture: LlamaForCausalLM
model_group: rica40325/yui-new-chai
model_name: rica40325-yui-new-chai_v10
model_num_parameters: 8030261248.0
model_repo: rica40325/yui-new-chai
model_size: 8B
num_battles: 10835
num_wins: 5230
propriety_score: 0.7425531914893617
propriety_total_count: 940.0
ranking_group: single
status: inactive
submission_type: basic
timestamp: 2024-08-26T08:32:07+00:00
us_pacific_date: 2024-08-26
win_ratio: 0.4826949700046147
Download Preference Data
Resubmit model
Running pipeline stage MKMLizer
Starting job with name rica40325-yui-new-chai-v12-mkmlizer
Waiting for job on rica40325-yui-new-chai-v12-mkmlizer to finish
rica40325-yui-new-chai-v12-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rica40325-yui-new-chai-v12-mkmlizer: ║     _____            __           __                                ║
rica40325-yui-new-chai-v12-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rica40325-yui-new-chai-v12-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rica40325-yui-new-chai-v12-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rica40325-yui-new-chai-v12-mkmlizer: ║       /___/                                                         ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Version: 0.10.1                                                    ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rica40325-yui-new-chai-v12-mkmlizer: ║  https://mk1.ai                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║  The license key for the current software has been verified as      ║
rica40325-yui-new-chai-v12-mkmlizer: ║  belonging to:                                                      ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Chai Research Corp.                                                ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rica40325-yui-new-chai-v12-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
rica40325-yui-new-chai-v12-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v12-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rica40325-yui-new-chai-v12-mkmlizer: Downloaded to shared memory in 21.913s
rica40325-yui-new-chai-v12-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp218l7kxo, device:0
rica40325-yui-new-chai-v12-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
rica40325-yui-new-chai-v12-mkmlizer: quantized model in 26.136s
rica40325-yui-new-chai-v12-mkmlizer: Processed model rica40325/yui-new-chai in 48.049s
rica40325-yui-new-chai-v12-mkmlizer: creating bucket guanaco-mkml-models
rica40325-yui-new-chai-v12-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rica40325-yui-new-chai-v12-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rica40325-yui-new-chai-v12
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/config.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/special_tokens_map.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/tokenizer_config.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/tokenizer.json
rica40325-yui-new-chai-v12-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rica40325-yui-new-chai-v12/flywheel_model.0.safetensors
rica40325-yui-new-chai-v12-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 4/291 [00:00<00:07, 38.95it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:04, 59.86it/s]
Loading 0:   8%|▊         | 22/291 [00:00<00:04, 65.29it/s]
Loading 0:  11%|█         | 31/291 [00:00<00:03, 70.34it/s]
Loading 0:  14%|█▎        | 40/291 [00:00<00:03, 73.00it/s]
Loading 0:  17%|█▋        | 49/291 [00:00<00:03, 74.04it/s]
Loading 0:  20%|█▉        | 58/291 [00:00<00:03, 74.99it/s]
Loading 0:  23%|██▎       | 67/291 [00:00<00:02, 74.72it/s]
Loading 0:  26%|██▌       | 76/291 [00:01<00:02, 74.73it/s]
Loading 0:  29%|██▉       | 84/291 [00:02<00:10, 20.47it/s]
Loading 0:  31%|███       | 90/291 [00:02<00:08, 23.45it/s]
Loading 0:  33%|███▎      | 97/291 [00:02<00:06, 28.19it/s]
Loading 0:  36%|███▋      | 106/291 [00:02<00:05, 35.64it/s]
Loading 0:  40%|███▉      | 115/291 [00:02<00:04, 43.35it/s]
Loading 0:  43%|████▎     | 124/291 [00:02<00:03, 50.51it/s]
Loading 0:  46%|████▌     | 133/291 [00:02<00:02, 56.56it/s]
Loading 0:  49%|████▉     | 142/291 [00:03<00:02, 61.54it/s]
Loading 0:  52%|█████▏    | 151/291 [00:03<00:02, 65.82it/s]
Loading 0:  55%|█████▍    | 160/291 [00:03<00:01, 68.79it/s]
Loading 0:  58%|█████▊    | 169/291 [00:03<00:01, 70.48it/s]
Loading 0:  61%|██████    | 178/291 [00:03<00:01, 70.29it/s]
Loading 0:  64%|██████▍   | 187/291 [00:04<00:05, 20.77it/s]
Loading 0:  67%|██████▋   | 196/291 [00:04<00:03, 26.67it/s]
Loading 0:  70%|███████   | 205/291 [00:04<00:02, 33.32it/s]
Loading 0:  74%|███████▎  | 214/291 [00:04<00:01, 40.32it/s]
Loading 0:  77%|███████▋  | 223/291 [00:05<00:01, 47.35it/s]
Loading 0:  80%|███████▉  | 232/291 [00:05<00:01, 53.69it/s]
Loading 0:  83%|████████▎ | 241/291 [00:05<00:00, 59.02it/s]
Loading 0:  86%|████████▌ | 250/291 [00:05<00:00, 65.15it/s]
Loading 0:  89%|████████▉ | 259/291 [00:05<00:00, 69.63it/s]
Loading 0:  92%|█████████▏| 268/291 [00:05<00:00, 73.39it/s]
Loading 0:  95%|█████████▌| 277/291 [00:05<00:00, 76.46it/s]
Loading 0:  98%|█████████▊| 286/291 [00:05<00:00, 78.69it/s]
                                                            

Job rica40325-yui-new-chai-v12-mkmlizer completed after 75.46s with status: succeeded
Stopping job with name rica40325-yui-new-chai-v12-mkmlizer
Pipeline stage MKMLizer completed in 76.48s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.40s
Running pipeline stage ISVCDeployer
Creating inference service rica40325-yui-new-chai-v12
Waiting for inference service rica40325-yui-new-chai-v12 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service rica40325-yui-new-chai-v12 ready after 161.3501033782959s
Pipeline stage ISVCDeployer completed in 162.70s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.076188802719116s
Received healthy response to inference request in 1.5113375186920166s
Received healthy response to inference request in 1.9369115829467773s
Received healthy response to inference request in 1.6329619884490967s
Received healthy response to inference request in 1.7824747562408447s
5 requests
0 failed requests
5th percentile: 1.5356624126434326
10th percentile: 1.5599873065948486
20th percentile: 1.6086370944976807
30th percentile: 1.6628645420074464
40th percentile: 1.7226696491241456
50th percentile: 1.7824747562408447
60th percentile: 1.8442494869232178
70th percentile: 1.9060242176055908
80th percentile: 1.9647670269012452
90th percentile: 2.0204779148101806
95th percentile: 2.0483333587646486
99th percentile: 2.0706177139282227
mean time: 1.7879749298095704
Pipeline stage StressChecker completed in 10.51s
rica40325-yui-new-chai_v12 status is now deployed due to DeploymentManager action
rica40325-yui-new-chai_v12 status is now inactive due to auto deactivation removed underperforming models

Usage Metrics

Latency Metrics