cycy233-l3i-star-v0-c4

developer_uid: shiroe40

submission_id: cycy233-l3i-star-v0-c4_v1

model_name: auto

model_group: cycy233/L3i-star-v0-c4

status: torndown

timestamp: 2024-08-17T00:47:32+00:00

num_battles: 10034

num_wins: 4760

celo_rating: 1203.79

family_friendly_score: 0.0

submission_type: basic

model_repo: cycy233/L3i-star-v0-c4

model_architecture: LlamaForCausalLM

model_num_parameters: 8030261248.0

best_of: 16

max_input_tokens: 512

max_output_tokens: 64

display_name: auto

is_internal_developer: False

language_model: cycy233/L3i-star-v0-c4

model_size: 8B

ranking_group: single

us_pacific_date: 2024-08-16

win_ratio: 0.47438708391469003

generation_params: {'temperature': 1.0, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|end_header_id|>', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}

formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Running pipeline stage MKMLizer
Starting job with name cycy233-l3i-star-v0-c4-v1-mkmlizer
Waiting for job on cycy233-l3i-star-v0-c4-v1-mkmlizer to finish
Stopping job with name cycy233-l3i-star-v0-c4-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name cycy233-l3i-star-v0-c4-v1-mkmlizer
Waiting for job on cycy233-l3i-star-v0-c4-v1-mkmlizer to finish
cycy233-l3i-star-v0-c4-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║     _____            __           __                                ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║       /___/                                                         ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║                                                                     ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  Version: 0.9.11                                                    ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  https://mk1.ai                                                     ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║                                                                     ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  belonging to:                                                      ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║                                                                     ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  Chai Research Corp.                                                ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ║                                                                     ║
cycy233-l3i-star-v0-c4-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
cycy233-l3i-star-v0-c4-v1-mkmlizer: Downloaded to shared memory in 33.692s
cycy233-l3i-star-v0-c4-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmps6irzt87, device:0
cycy233-l3i-star-v0-c4-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
cycy233-l3i-star-v0-c4-v1-mkmlizer: quantized model in 26.595s
cycy233-l3i-star-v0-c4-v1-mkmlizer: Processed model cycy233/L3i-star-v0-c4 in 60.287s
cycy233-l3i-star-v0-c4-v1-mkmlizer: creating bucket guanaco-mkml-models
cycy233-l3i-star-v0-c4-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
cycy233-l3i-star-v0-c4-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/cycy233-l3i-star-v0-c4-v1
cycy233-l3i-star-v0-c4-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/cycy233-l3i-star-v0-c4-v1/config.json
cycy233-l3i-star-v0-c4-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/cycy233-l3i-star-v0-c4-v1/special_tokens_map.json
cycy233-l3i-star-v0-c4-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/cycy233-l3i-star-v0-c4-v1/tokenizer_config.json
cycy233-l3i-star-v0-c4-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/cycy233-l3i-star-v0-c4-v1/tokenizer.json
cycy233-l3i-star-v0-c4-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/cycy233-l3i-star-v0-c4-v1/flywheel_model.0.safetensors
cycy233-l3i-star-v0-c4-v1-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 4/291 [00:00<00:07, 37.58it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:04, 61.53it/s]
Loading 0:   8%|▊         | 22/291 [00:00<00:03, 72.96it/s]
Loading 0:  11%|█         | 31/291 [00:00<00:03, 76.55it/s]
Loading 0:  14%|█▎        | 40/291 [00:00<00:03, 80.37it/s]
Loading 0:  17%|█▋        | 49/291 [00:00<00:02, 82.85it/s]
Loading 0:  20%|█▉        | 58/291 [00:00<00:02, 84.73it/s]
Loading 0:  23%|██▎       | 67/291 [00:00<00:02, 82.01it/s]
Loading 0:  26%|██▌       | 76/291 [00:00<00:02, 82.40it/s]
Loading 0:  29%|██▉       | 85/291 [00:02<00:10, 20.11it/s]
Loading 0:  32%|███▏      | 94/291 [00:02<00:07, 26.20it/s]
Loading 0:  35%|███▌      | 103/291 [00:02<00:05, 33.33it/s]
Loading 0:  38%|███▊      | 112/291 [00:02<00:04, 40.88it/s]
Loading 0:  42%|████▏     | 121/291 [00:02<00:03, 47.91it/s]
Loading 0:  45%|████▍     | 130/291 [00:02<00:02, 54.28it/s]
Loading 0:  48%|████▊     | 139/291 [00:02<00:02, 60.14it/s]
Loading 0:  51%|█████     | 148/291 [00:02<00:02, 64.92it/s]
Loading 0:  54%|█████▍    | 157/291 [00:03<00:02, 66.95it/s]
Loading 0:  58%|█████▊    | 169/291 [00:03<00:01, 71.91it/s]
Loading 0:  63%|██████▎   | 184/291 [00:03<00:01, 82.08it/s]
Loading 0:  66%|██████▋   | 193/291 [00:04<00:04, 24.29it/s]
Loading 0:  69%|██████▉   | 202/291 [00:04<00:03, 29.53it/s]
Loading 0:  73%|███████▎  | 211/291 [00:04<00:02, 35.64it/s]
Loading 0:  76%|███████▌  | 220/291 [00:04<00:01, 42.47it/s]
Loading 0:  79%|███████▊  | 229/291 [00:04<00:01, 48.99it/s]
Loading 0:  82%|████████▏ | 238/291 [00:05<00:00, 55.11it/s]
Loading 0:  85%|████████▍ | 247/291 [00:05<00:00, 60.78it/s]
Loading 0:  88%|████████▊ | 256/291 [00:05<00:00, 64.64it/s]
Loading 0:  91%|█████████ | 265/291 [00:05<00:00, 69.82it/s]
Loading 0:  95%|█████████▌| 277/291 [00:05<00:00, 74.66it/s]
Loading 0:  99%|█████████▊| 287/291 [00:05<00:00, 44.15it/s]
                                                            
Job cycy233-l3i-star-v0-c4-v1-mkmlizer completed after 83.94s with status: succeeded
Stopping job with name cycy233-l3i-star-v0-c4-v1-mkmlizer
Pipeline stage MKMLizer completed in 85.34s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service cycy233-l3i-star-v0-c4-v1
Waiting for inference service cycy233-l3i-star-v0-c4-v1 to be ready
Inference service cycy233-l3i-star-v0-c4-v1 ready after 231.61599278450012s
Pipeline stage ISVCDeployer completed in 232.44s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1029255390167236s
Received healthy response to inference request in 1.5860819816589355s
Received healthy response to inference request in 1.4303960800170898s
Received healthy response to inference request in 1.36173677444458s
Received healthy response to inference request in 1.4092764854431152s
5 requests
0 failed requests
5th percentile: 1.3712447166442872
10th percentile: 1.3807526588439942
20th percentile: 1.3997685432434082
30th percentile: 1.4135004043579102
40th percentile: 1.4219482421875
50th percentile: 1.4303960800170898
60th percentile: 1.492670440673828
70th percentile: 1.5549448013305665
80th percentile: 1.6894506931304933
90th percentile: 1.8961881160736085
95th percentile: 1.9995568275451658
99th percentile: 2.082251796722412
mean time: 1.578083372116089
Pipeline stage StressChecker completed in 8.56s
cycy233-l3i-star-v0-c4_v1 status is now deployed due to DeploymentManager action
cycy233-l3i-star-v0-c4_v1 status is now inactive due to auto deactivation removed underperforming models
cycy233-l3i-star-v0-c4_v1 status is now torndown due to DeploymentManager action