cycy233-l3-e-v2-c1

developer_uid: shiroe40

submission_id: cycy233-l3-e-v2-c1_v36

model_name: auto

model_group: cycy233/L3-e-v2-c1

status: torndown

timestamp: 2024-08-20T05:46:55+00:00

num_battles: 11858

num_wins: 6748

celo_rating: 1285.58

family_friendly_score: 0.0

submission_type: basic

model_repo: cycy233/L3-e-v2-c1

model_architecture: LlamaForCausalLM

model_num_parameters: 8030261248.0

best_of: 16

max_input_tokens: 512

max_output_tokens: 64

display_name: auto

is_internal_developer: False

language_model: cycy233/L3-e-v2-c1

model_size: 8B

ranking_group: single

us_pacific_date: 2024-08-19

win_ratio: 0.5690672963400236

generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|end_header_id|>', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}

formatter: {'memory_template': "<|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Running pipeline stage MKMLizer
Starting job with name cycy233-l3-e-v2-c1-v36-mkmlizer
Waiting for job on cycy233-l3-e-v2-c1-v36-mkmlizer to finish
cycy233-l3-e-v2-c1-v36-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
cycy233-l3-e-v2-c1-v36-mkmlizer: ║     _____            __           __                                ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║       /___/                                                         ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║                                                                     ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  Version: 0.9.11                                                    ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  https://mk1.ai                                                     ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║                                                                     ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  The license key for the current software has been verified as      ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  belonging to:                                                      ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║                                                                     ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  Chai Research Corp.                                                ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ║                                                                     ║
cycy233-l3-e-v2-c1-v36-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
cycy233-l3-e-v2-c1-v36-mkmlizer: Downloaded to shared memory in 23.532s
cycy233-l3-e-v2-c1-v36-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpk3re8bzf, device:0
cycy233-l3-e-v2-c1-v36-mkmlizer: Saving flywheel model at /dev/shm/model_cache
cycy233-l3-e-v2-c1-v36-mkmlizer: quantized model in 27.103s
cycy233-l3-e-v2-c1-v36-mkmlizer: Processed model cycy233/L3-e-v2-c1 in 50.635s
cycy233-l3-e-v2-c1-v36-mkmlizer: creating bucket guanaco-mkml-models
cycy233-l3-e-v2-c1-v36-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
cycy233-l3-e-v2-c1-v36-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/cycy233-l3-e-v2-c1-v36
cycy233-l3-e-v2-c1-v36-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/cycy233-l3-e-v2-c1-v36/config.json
cycy233-l3-e-v2-c1-v36-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/cycy233-l3-e-v2-c1-v36/special_tokens_map.json
cycy233-l3-e-v2-c1-v36-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/cycy233-l3-e-v2-c1-v36/tokenizer_config.json
cycy233-l3-e-v2-c1-v36-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/cycy233-l3-e-v2-c1-v36/tokenizer.json
cycy233-l3-e-v2-c1-v36-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/291 [00:00<00:08, 33.09it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:05, 52.79it/s]
Loading 0:   7%|▋         | 19/291 [00:00<00:06, 44.16it/s]
Loading 0:   8%|▊         | 24/291 [00:00<00:06, 43.43it/s]
Loading 0:  11%|█         | 31/291 [00:00<00:05, 49.53it/s]
Loading 0:  13%|█▎        | 37/291 [00:00<00:05, 44.77it/s]
Loading 0:  14%|█▍        | 42/291 [00:00<00:05, 43.97it/s]
Loading 0:  17%|█▋        | 49/291 [00:01<00:04, 49.24it/s]
Loading 0:  19%|█▉        | 55/291 [00:01<00:05, 44.83it/s]
Loading 0:  21%|██        | 60/291 [00:01<00:05, 43.01it/s]
Loading 0:  23%|██▎       | 66/291 [00:01<00:04, 46.37it/s]
Loading 0:  24%|██▍       | 71/291 [00:01<00:04, 45.57it/s]
Loading 0:  26%|██▌       | 76/291 [00:01<00:04, 46.03it/s]
Loading 0:  28%|██▊       | 82/291 [00:01<00:04, 42.57it/s]
Loading 0:  30%|██▉       | 87/291 [00:02<00:07, 28.97it/s]
Loading 0:  32%|███▏      | 93/291 [00:02<00:05, 34.12it/s]
Loading 0:  34%|███▎      | 98/291 [00:02<00:05, 36.30it/s]
Loading 0:  35%|███▌      | 103/291 [00:02<00:04, 38.67it/s]
Loading 0:  37%|███▋      | 108/291 [00:02<00:04, 41.28it/s]
Loading 0:  39%|███▉      | 113/291 [00:02<00:05, 35.26it/s]
Loading 0:  41%|████      | 120/291 [00:02<00:04, 41.99it/s]
Loading 0:  43%|████▎     | 125/291 [00:02<00:03, 42.52it/s]
Loading 0:  45%|████▍     | 130/291 [00:03<00:03, 42.79it/s]
Loading 0:  46%|████▋     | 135/291 [00:03<00:03, 44.56it/s]
Loading 0:  48%|████▊     | 140/291 [00:03<00:04, 37.04it/s]
Loading 0:  51%|█████     | 148/291 [00:03<00:03, 45.30it/s]
Loading 0:  53%|█████▎    | 153/291 [00:03<00:02, 46.42it/s]
Loading 0:  54%|█████▍    | 158/291 [00:03<00:03, 37.82it/s]
Loading 0:  57%|█████▋    | 165/291 [00:03<00:02, 43.58it/s]
Loading 0:  58%|█████▊    | 170/291 [00:04<00:02, 43.00it/s]
Loading 0:  60%|██████    | 175/291 [00:04<00:02, 43.96it/s]
Loading 0:  62%|██████▏   | 180/291 [00:04<00:02, 44.30it/s]
Loading 0:  64%|██████▍   | 186/291 [00:04<00:02, 41.77it/s]
Loading 0:  66%|██████▌   | 191/291 [00:04<00:03, 29.58it/s]
Loading 0:  67%|██████▋   | 195/291 [00:04<00:03, 30.20it/s]
Loading 0:  69%|██████▉   | 201/291 [00:04<00:02, 35.98it/s]
Loading 0:  71%|███████   | 206/291 [00:05<00:02, 37.80it/s]
Loading 0:  73%|███████▎  | 211/291 [00:05<00:02, 39.14it/s]
Loading 0:  75%|███████▍  | 217/291 [00:05<00:01, 37.96it/s]
Loading 0:  76%|███████▋  | 222/291 [00:05<00:01, 38.59it/s]
Loading 0:  78%|███████▊  | 228/291 [00:05<00:01, 42.20it/s]
Loading 0:  80%|████████  | 233/291 [00:05<00:01, 42.88it/s]
Loading 0:  82%|████████▏ | 238/291 [00:05<00:01, 43.19it/s]
Loading 0:  84%|████████▎ | 243/291 [00:05<00:01, 44.88it/s]
Loading 0:  85%|████████▌ | 248/291 [00:06<00:01, 36.10it/s]
Loading 0:  88%|████████▊ | 255/291 [00:06<00:00, 42.62it/s]
Loading 0:  89%|████████▉ | 260/291 [00:06<00:00, 43.15it/s]
Loading 0:  91%|█████████ | 265/291 [00:06<00:00, 43.07it/s]
Loading 0:  93%|█████████▎| 270/291 [00:06<00:00, 43.51it/s]
Loading 0:  95%|█████████▍| 275/291 [00:06<00:00, 36.43it/s]
Loading 0:  97%|█████████▋| 281/291 [00:06<00:00, 41.16it/s]
Loading 0:  98%|█████████▊| 286/291 [00:07<00:00, 36.75it/s]
Loading 0: 100%|█████████▉| 290/291 [00:12<00:00,  2.89it/s]
                                                            
Job cycy233-l3-e-v2-c1-v36-mkmlizer completed after 74.3s with status: succeeded
Stopping job with name cycy233-l3-e-v2-c1-v36-mkmlizer
Pipeline stage MKMLizer completed in 75.20s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service cycy233-l3-e-v2-c1-v36
Waiting for inference service cycy233-l3-e-v2-c1-v36 to be ready
Inference service cycy233-l3-e-v2-c1-v36 ready after 251.53182888031006s
Pipeline stage ISVCDeployer completed in 252.49s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.123164653778076s
Received healthy response to inference request in 1.6983916759490967s
Received healthy response to inference request in 1.639951229095459s
Received healthy response to inference request in 2.6772756576538086s
Received healthy response to inference request in 1.5052943229675293s
5 requests
0 failed requests
5th percentile: 1.5322257041931153
10th percentile: 1.5591570854187011
20th percentile: 1.613019847869873
30th percentile: 1.6516393184661866
40th percentile: 1.6750154972076416
50th percentile: 1.6983916759490967
60th percentile: 1.8683008670806884
70th percentile: 2.03821005821228
80th percentile: 2.2339868545532227
90th percentile: 2.4556312561035156
95th percentile: 2.566453456878662
99th percentile: 2.655111217498779
mean time: 1.9288155078887939
Pipeline stage StressChecker completed in 10.40s
cycy233-l3-e-v2-c1_v36 status is now deployed due to DeploymentManager action
cycy233-l3-e-v2-c1_v36 status is now inactive due to auto deactivation removed underperforming models
cycy233-l3-e-v2-c1_v36 status is now torndown due to DeploymentManager action