developer_uid: shiroe40
submission_id: cycy233-l3-bp-v0-c1_v2
model_name: auto
model_group: cycy233/L3-bp-v0-c1
status: torndown
timestamp: 2024-08-23T06:26:11+00:00
num_battles: 10121
num_wins: 5207
celo_rating: 1248.96
family_friendly_score: 0.0
submission_type: basic
model_repo: cycy233/L3-bp-v0-c1
model_architecture: LlamaForCausalLM
model_num_parameters: 8030261248.0
best_of: 16
max_input_tokens: 512
max_output_tokens: 64
display_name: auto
is_internal_developer: False
language_model: cycy233/L3-bp-v0-c1
model_size: 8B
ranking_group: single
us_pacific_date: 2024-08-22
win_ratio: 0.5144748542634127
generation_params: {'temperature': 1.0, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|end_header_id|>', '<|eot_id|>', ':\\\\'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name cycy233-l3-bp-v0-c1-v2-mkmlizer
Waiting for job on cycy233-l3-bp-v0-c1-v2-mkmlizer to finish
cycy233-l3-bp-v0-c1-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║     _____            __           __                                ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║       /___/                                                         ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║                                                                     ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  Version: 0.10.1                                                    ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  https://mk1.ai                                                     ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║                                                                     ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  belonging to:                                                      ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║                                                                     ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  Chai Research Corp.                                                ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ║                                                                     ║
cycy233-l3-bp-v0-c1-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
cycy233-l3-bp-v0-c1-v2-mkmlizer: Downloaded to shared memory in 24.495s
cycy233-l3-bp-v0-c1-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpj8z3jwxq, device:0
cycy233-l3-bp-v0-c1-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
cycy233-l3-bp-v0-c1-v2-mkmlizer: quantized model in 25.713s
cycy233-l3-bp-v0-c1-v2-mkmlizer: Processed model cycy233/L3-bp-v0-c1 in 50.208s
cycy233-l3-bp-v0-c1-v2-mkmlizer: creating bucket guanaco-mkml-models
cycy233-l3-bp-v0-c1-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
cycy233-l3-bp-v0-c1-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/cycy233-l3-bp-v0-c1-v2
cycy233-l3-bp-v0-c1-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/cycy233-l3-bp-v0-c1-v2/config.json
cycy233-l3-bp-v0-c1-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/cycy233-l3-bp-v0-c1-v2/special_tokens_map.json
cycy233-l3-bp-v0-c1-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/cycy233-l3-bp-v0-c1-v2/tokenizer_config.json
cycy233-l3-bp-v0-c1-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/cycy233-l3-bp-v0-c1-v2/tokenizer.json
cycy233-l3-bp-v0-c1-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/cycy233-l3-bp-v0-c1-v2/flywheel_model.0.safetensors
cycy233-l3-bp-v0-c1-v2-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 4/291 [00:00<00:07, 37.30it/s]
Loading 0:   5%|▌         | 16/291 [00:00<00:03, 70.19it/s]
Loading 0:  11%|█         | 31/291 [00:00<00:02, 87.98it/s]
Loading 0:  15%|█▍        | 43/291 [00:00<00:02, 87.40it/s]
Loading 0:  20%|█▉        | 58/291 [00:00<00:02, 95.64it/s]
Loading 0:  24%|██▍       | 70/291 [00:00<00:02, 92.45it/s]
Loading 0:  29%|██▊       | 83/291 [00:01<00:07, 28.34it/s]
Loading 0:  31%|███       | 90/291 [00:01<00:06, 32.07it/s]
Loading 0:  35%|███▌      | 103/291 [00:02<00:04, 41.72it/s]
Loading 0:  40%|███▉      | 115/291 [00:02<00:03, 49.62it/s]
Loading 0:  45%|████▍     | 130/291 [00:02<00:02, 61.97it/s]
Loading 0:  49%|████▉     | 142/291 [00:02<00:02, 67.67it/s]
Loading 0:  54%|█████▍    | 157/291 [00:02<00:01, 77.03it/s]
Loading 0:  58%|█████▊    | 169/291 [00:02<00:01, 79.77it/s]
Loading 0:  63%|██████▎   | 184/291 [00:02<00:01, 87.54it/s]
Loading 0:  67%|██████▋   | 194/291 [00:04<00:03, 28.15it/s]
Loading 0:  70%|███████   | 205/291 [00:04<00:02, 34.17it/s]
Loading 0:  76%|███████▌  | 220/291 [00:04<00:01, 44.84it/s]
Loading 0:  80%|███████▉  | 232/291 [00:04<00:01, 52.01it/s]
Loading 0:  85%|████████▍ | 247/291 [00:04<00:00, 63.19it/s]
Loading 0:  89%|████████▉ | 259/291 [00:04<00:00, 67.62it/s]
Loading 0:  94%|█████████▍| 274/291 [00:04<00:00, 76.83it/s]
Loading 0:  98%|█████████▊| 286/291 [00:05<00:00, 79.74it/s]
                                                            

Job cycy233-l3-bp-v0-c1-v2-mkmlizer completed after 74.78s with status: succeeded
Stopping job with name cycy233-l3-bp-v0-c1-v2-mkmlizer
Pipeline stage MKMLizer completed in 75.97s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service cycy233-l3-bp-v0-c1-v2
Waiting for inference service cycy233-l3-bp-v0-c1-v2 to be ready
Failed to get response for submission blend_sehof_2024-08-22: ('http://zonemercy-gemini-edit-v1-1e5-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:47382->127.0.0.1:8080: read: connection reset by peer\n')
Inference service cycy233-l3-bp-v0-c1-v2 ready after 191.32180500030518s
Pipeline stage ISVCDeployer completed in 192.09s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.115388870239258s
Received healthy response to inference request in 2.2161173820495605s
Received healthy response to inference request in 1.5608761310577393s
Received healthy response to inference request in 2.221311569213867s
Received healthy response to inference request in 1.7763481140136719s
5 requests
0 failed requests
5th percentile: 1.6039705276489258
10th percentile: 1.6470649242401123
20th percentile: 1.7332537174224854
30th percentile: 1.844156265258789
40th percentile: 1.9797725677490234
50th percentile: 2.115388870239258
60th percentile: 2.155680274963379
70th percentile: 2.1959716796875
80th percentile: 2.2171562194824217
90th percentile: 2.2192338943481444
95th percentile: 2.220272731781006
99th percentile: 2.221103801727295
mean time: 1.9780084133148192
Pipeline stage StressChecker completed in 10.48s
cycy233-l3-bp-v0-c1_v2 status is now deployed due to DeploymentManager action
cycy233-l3-bp-v0-c1_v2 status is now inactive due to auto deactivation removed underperforming models
cycy233-l3-bp-v0-c1_v2 status is now torndown due to DeploymentManager action