developer_uid: rica40325
submission_id: rica40325-yui-new-chai_v13
model_name: rica40325-yui-new-chai_v13
model_group: rica40325/yui-new-chai
status: torndown
timestamp: 2024-08-26T14:15:15+00:00
num_battles: 11376
num_wins: 5401
celo_rating: 1213.54
family_friendly_score: 0.0
submission_type: basic
model_repo: rica40325/yui-new-chai
model_architecture: LlamaForCausalLM
model_num_parameters: 8030261248.0
best_of: 16
max_input_tokens: 512
max_output_tokens: 64
display_name: rica40325-yui-new-chai_v13
is_internal_developer: False
language_model: rica40325/yui-new-chai
model_size: 8B
ranking_group: single
us_pacific_date: 2024-08-26
win_ratio: 0.47477144866385373
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "<|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\nYou: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name rica40325-yui-new-chai-v13-mkmlizer
Waiting for job on rica40325-yui-new-chai-v13-mkmlizer to finish
rica40325-yui-new-chai-v13-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
rica40325-yui-new-chai-v13-mkmlizer: ║     _____            __           __                                ║
rica40325-yui-new-chai-v13-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
rica40325-yui-new-chai-v13-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
rica40325-yui-new-chai-v13-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
rica40325-yui-new-chai-v13-mkmlizer: ║       /___/                                                         ║
rica40325-yui-new-chai-v13-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v13-mkmlizer: ║  Version: 0.10.1                                                    ║
rica40325-yui-new-chai-v13-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
rica40325-yui-new-chai-v13-mkmlizer: ║  https://mk1.ai                                                     ║
rica40325-yui-new-chai-v13-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v13-mkmlizer: ║  The license key for the current software has been verified as      ║
rica40325-yui-new-chai-v13-mkmlizer: ║  belonging to:                                                      ║
rica40325-yui-new-chai-v13-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v13-mkmlizer: ║  Chai Research Corp.                                                ║
rica40325-yui-new-chai-v13-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
rica40325-yui-new-chai-v13-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
rica40325-yui-new-chai-v13-mkmlizer: ║                                                                     ║
rica40325-yui-new-chai-v13-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
rica40325-yui-new-chai-v13-mkmlizer: Downloaded to shared memory in 24.521s
rica40325-yui-new-chai-v13-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpudxchwse, device:0
rica40325-yui-new-chai-v13-mkmlizer: Saving flywheel model at /dev/shm/model_cache
rica40325-yui-new-chai-v13-mkmlizer: quantized model in 25.894s
rica40325-yui-new-chai-v13-mkmlizer: Processed model rica40325/yui-new-chai in 50.416s
rica40325-yui-new-chai-v13-mkmlizer: creating bucket guanaco-mkml-models
rica40325-yui-new-chai-v13-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
rica40325-yui-new-chai-v13-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/rica40325-yui-new-chai-v13
rica40325-yui-new-chai-v13-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v13/config.json
rica40325-yui-new-chai-v13-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v13/special_tokens_map.json
rica40325-yui-new-chai-v13-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v13/tokenizer_config.json
rica40325-yui-new-chai-v13-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/rica40325-yui-new-chai-v13/tokenizer.json
rica40325-yui-new-chai-v13-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/rica40325-yui-new-chai-v13/flywheel_model.0.safetensors
rica40325-yui-new-chai-v13-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 4/291 [00:00<00:07, 39.93it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:04, 68.46it/s]
Loading 0:   8%|▊         | 24/291 [00:00<00:03, 87.28it/s]
Loading 0:  11%|█▏        | 33/291 [00:00<00:02, 86.06it/s]
Loading 0:  14%|█▍        | 42/291 [00:00<00:03, 80.47it/s]
Loading 0:  18%|█▊        | 51/291 [00:00<00:02, 80.82it/s]
Loading 0:  21%|██        | 60/291 [00:00<00:02, 77.10it/s]
Loading 0:  23%|██▎       | 68/291 [00:00<00:02, 75.54it/s]
Loading 0:  27%|██▋       | 79/291 [00:01<00:02, 76.41it/s]
Loading 0:  30%|██▉       | 87/291 [00:02<00:09, 20.94it/s]
Loading 0:  32%|███▏      | 94/291 [00:02<00:07, 25.51it/s]
Loading 0:  36%|███▋      | 106/291 [00:02<00:05, 34.97it/s]
Loading 0:  42%|████▏     | 121/291 [00:02<00:03, 47.95it/s]
Loading 0:  46%|████▌     | 133/291 [00:02<00:02, 55.24it/s]
Loading 0:  49%|████▉     | 142/291 [00:02<00:02, 60.12it/s]
Loading 0:  54%|█████▍    | 157/291 [00:02<00:01, 68.88it/s]
Loading 0:  57%|█████▋    | 166/291 [00:03<00:01, 72.28it/s]
Loading 0:  60%|██████    | 175/291 [00:03<00:01, 74.62it/s]
Loading 0:  63%|██████▎   | 184/291 [00:03<00:01, 78.03it/s]
Loading 0:  66%|██████▋   | 193/291 [00:04<00:04, 22.39it/s]
Loading 0:  69%|██████▉   | 202/291 [00:04<00:03, 28.43it/s]
Loading 0:  73%|███████▎  | 211/291 [00:04<00:02, 35.43it/s]
Loading 0:  76%|███████▌  | 220/291 [00:04<00:01, 42.81it/s]
Loading 0:  79%|███████▊  | 229/291 [00:04<00:01, 50.27it/s]
Loading 0:  82%|████████▏ | 238/291 [00:04<00:00, 55.55it/s]
Loading 0:  85%|████████▌ | 248/291 [00:05<00:00, 64.74it/s]
Loading 0:  89%|████████▉ | 259/291 [00:05<00:00, 68.79it/s]
Loading 0:  94%|█████████▍| 274/291 [00:05<00:00, 79.17it/s]
Loading 0:  98%|█████████▊| 286/291 [00:05<00:00, 77.64it/s]
                                                            

Job rica40325-yui-new-chai-v13-mkmlizer completed after 73.82s with status: succeeded
Stopping job with name rica40325-yui-new-chai-v13-mkmlizer
Pipeline stage MKMLizer completed in 75.19s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.33s
Running pipeline stage ISVCDeployer
Creating inference service rica40325-yui-new-chai-v13
Waiting for inference service rica40325-yui-new-chai-v13 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service rica40325-yui-new-chai-v13 ready after 160.85366463661194s
Pipeline stage ISVCDeployer completed in 161.17s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.913804054260254s
Received healthy response to inference request in 2.491668701171875s
Received healthy response to inference request in 2.173532724380493s
Received healthy response to inference request in 1.7320165634155273s
Received healthy response to inference request in 1.6789298057556152s
5 requests
0 failed requests
5th percentile: 1.6895471572875977
10th percentile: 1.70016450881958
20th percentile: 1.7213992118835448
30th percentile: 1.8203197956085204
40th percentile: 1.9969262599945068
50th percentile: 2.173532724380493
60th percentile: 2.300787115097046
70th percentile: 2.4280415058135985
80th percentile: 2.576095771789551
90th percentile: 2.7449499130249024
95th percentile: 2.829376983642578
99th percentile: 2.8969186401367186
mean time: 2.197990369796753
Pipeline stage StressChecker completed in 11.70s
rica40325-yui-new-chai_v13 status is now deployed due to DeploymentManager action
rica40325-yui-new-chai_v13 status is now inactive due to auto deactivation removed underperforming models
rica40325-yui-new-chai_v13 status is now torndown due to DeploymentManager action
rica40325-yui-new-chai_v13 status is now torndown due to DeploymentManager action