pawankrd-cosmosrp-12b

developer_uid: PawanOsman
submission_id: pawankrd-cosmosrp-12b_v1
model_name: pawankrd-cosmosrp-12b_v1
model_group: PawanKrd/CosmosRP-12b
status: torndown
timestamp: 2024-09-01T12:54:38+00:00
num_battles: 12394
num_wins: 6255
celo_rating: 1239.1
family_friendly_score: 0.0
submission_type: basic
model_repo: PawanKrd/CosmosRP-12b
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 512
max_output_tokens: 64
display_name: pawankrd-cosmosrp-12b_v1
is_internal_developer: False
language_model: PawanKrd/CosmosRP-12b
model_size: 13B
ranking_group: single
us_pacific_date: 2024-09-01
win_ratio: 0.504679683717928
generation_params: {'temperature': 0.7, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 1.2, 'frequency_penalty': 1.2, 'stopping_words': ['<', '>'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "<|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name pawankrd-cosmosrp-12b-v1-mkmlizer
Waiting for job on pawankrd-cosmosrp-12b-v1-mkmlizer to finish
Stopping job with name pawankrd-cosmosrp-12b-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name pawankrd-cosmosrp-12b-v1-mkmlizer
Waiting for job on pawankrd-cosmosrp-12b-v1-mkmlizer to finish
pawankrd-cosmosrp-12b-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
pawankrd-cosmosrp-12b-v1-mkmlizer: ║     _____            __           __                                ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║       /___/                                                         ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║                                                                     ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  https://mk1.ai                                                     ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║                                                                     ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  belonging to:                                                      ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║                                                                     ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  Chai Research Corp.                                                ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ║                                                                     ║
pawankrd-cosmosrp-12b-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
admin requested tearing down of sanchuanhehe-end-try_v7
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLDeleter completed in 0.22s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Skipping deletion as no model was successfully uploaded
Pipeline stage MKMLModelDeleter completed in 0.20s
sanchuanhehe-end-try_v7 status is now torndown due to DeploymentManager action
Failed to get response for submission chaiml-llama-8b-pairwis_8189_v19: ('http://mistralai-mixtral-8x7b-3473-v131-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '{"error":"ValueError : [TypeError(\\"\'numpy.int64\' object is not iterable\\"), TypeError(\'vars() argument must have __dict__ attribute\')]"}')
pawankrd-cosmosrp-12b-v1-mkmlizer: Downloaded to shared memory in 54.232s
pawankrd-cosmosrp-12b-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp26e05jbp, device:0
pawankrd-cosmosrp-12b-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
pawankrd-cosmosrp-12b-v1-mkmlizer: quantized model in 35.714s
pawankrd-cosmosrp-12b-v1-mkmlizer: Processed model PawanKrd/CosmosRP-12b in 89.946s
pawankrd-cosmosrp-12b-v1-mkmlizer: creating bucket guanaco-mkml-models
pawankrd-cosmosrp-12b-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
pawankrd-cosmosrp-12b-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/pawankrd-cosmosrp-12b-v1
pawankrd-cosmosrp-12b-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/pawankrd-cosmosrp-12b-v1/config.json
pawankrd-cosmosrp-12b-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/pawankrd-cosmosrp-12b-v1/special_tokens_map.json
pawankrd-cosmosrp-12b-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/pawankrd-cosmosrp-12b-v1/tokenizer_config.json
pawankrd-cosmosrp-12b-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/pawankrd-cosmosrp-12b-v1/tokenizer.json
pawankrd-cosmosrp-12b-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/pawankrd-cosmosrp-12b-v1/flywheel_model.0.safetensors
pawankrd-cosmosrp-12b-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:10, 34.90it/s]
Loading 0:   4%|▎         | 13/363 [00:00<00:06, 55.28it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:07, 46.42it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:07, 43.61it/s]
Loading 0:   9%|▊         | 31/363 [00:00<00:06, 50.01it/s]
Loading 0:  10%|█         | 37/363 [00:00<00:07, 44.63it/s]
Loading 0:  12%|█▏        | 42/363 [00:00<00:07, 43.77it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:06, 47.46it/s]
Loading 0:  15%|█▍        | 53/363 [00:01<00:06, 47.24it/s]
Loading 0:  17%|█▋        | 60/363 [00:01<00:06, 46.64it/s]
Loading 0:  18%|█▊        | 65/363 [00:01<00:09, 33.09it/s]
Loading 0:  20%|█▉        | 71/363 [00:01<00:07, 38.37it/s]
Loading 0:  21%|██        | 76/363 [00:01<00:07, 39.85it/s]
Loading 0:  22%|██▏       | 81/363 [00:01<00:06, 41.51it/s]
Loading 0:  24%|██▎       | 86/363 [00:01<00:06, 43.35it/s]
Loading 0:  25%|██▌       | 91/363 [00:02<00:07, 37.11it/s]
Loading 0:  27%|██▋       | 98/363 [00:02<00:06, 43.53it/s]
Loading 0:  28%|██▊       | 103/363 [00:02<00:05, 44.20it/s]
Loading 0:  30%|███       | 110/363 [00:02<00:05, 44.45it/s]
Loading 0:  32%|███▏      | 115/363 [00:02<00:05, 43.95it/s]
Loading 0:  33%|███▎      | 120/363 [00:02<00:05, 42.59it/s]
Loading 0:  35%|███▍      | 126/363 [00:02<00:05, 44.93it/s]
Loading 0:  36%|███▌      | 131/363 [00:03<00:05, 45.66it/s]
Loading 0:  37%|███▋      | 136/363 [00:03<00:06, 36.80it/s]
Loading 0:  39%|███▉      | 142/363 [00:03<00:06, 32.87it/s]
Loading 0:  40%|████      | 146/363 [00:03<00:06, 33.82it/s]
Loading 0:  41%|████▏     | 150/363 [00:03<00:06, 33.29it/s]
Loading 0:  43%|████▎     | 156/363 [00:03<00:05, 37.67it/s]
Loading 0:  44%|████▍     | 160/363 [00:03<00:05, 37.39it/s]
Loading 0:  45%|████▌     | 165/363 [00:04<00:04, 40.37it/s]
Loading 0:  47%|████▋     | 170/363 [00:04<00:04, 41.03it/s]
Loading 0:  48%|████▊     | 175/363 [00:04<00:04, 41.26it/s]
Loading 0:  50%|████▉     | 181/363 [00:04<00:04, 40.16it/s]
Loading 0:  51%|█████     | 186/363 [00:04<00:04, 39.24it/s]
Loading 0:  53%|█████▎    | 192/363 [00:04<00:03, 43.70it/s]
Loading 0:  54%|█████▍    | 197/363 [00:04<00:03, 43.50it/s]
Loading 0:  56%|█████▌    | 202/363 [00:04<00:03, 43.35it/s]
Loading 0:  57%|█████▋    | 207/363 [00:04<00:03, 43.76it/s]
Loading 0:  58%|█████▊    | 212/363 [00:05<00:04, 36.25it/s]
Loading 0:  60%|██████    | 218/363 [00:05<00:03, 41.14it/s]
Loading 0:  61%|██████▏   | 223/363 [00:05<00:04, 32.61it/s]
Loading 0:  63%|██████▎   | 228/363 [00:05<00:03, 34.49it/s]
Loading 0:  64%|██████▍   | 232/363 [00:05<00:03, 34.07it/s]
Loading 0:  65%|██████▌   | 237/363 [00:05<00:03, 36.72it/s]
Loading 0:  66%|██████▋   | 241/363 [00:05<00:03, 37.22it/s]
Loading 0:  68%|██████▊   | 246/363 [00:06<00:02, 40.10it/s]
Loading 0:  69%|██████▉   | 251/363 [00:06<00:02, 41.32it/s]
Loading 0:  71%|███████   | 256/363 [00:06<00:02, 40.97it/s]
Loading 0:  72%|███████▏  | 262/363 [00:06<00:02, 39.62it/s]
Loading 0:  74%|███████▎  | 267/363 [00:06<00:02, 39.71it/s]
Loading 0:  75%|███████▌  | 273/363 [00:06<00:02, 44.06it/s]
Loading 0:  77%|███████▋  | 278/363 [00:06<00:01, 44.24it/s]
Loading 0:  78%|███████▊  | 283/363 [00:06<00:01, 45.00it/s]
Loading 0:  79%|███████▉  | 288/363 [00:07<00:01, 46.12it/s]
Loading 0:  81%|████████  | 293/363 [00:07<00:01, 37.64it/s]
Loading 0:  82%|████████▏ | 299/363 [00:07<00:01, 42.99it/s]
Loading 0:  84%|████████▎ | 304/363 [00:14<00:23,  2.50it/s]
Loading 0:  85%|████████▍ | 308/363 [00:14<00:16,  3.24it/s]
Loading 0:  86%|████████▌ | 312/363 [00:14<00:12,  4.24it/s]
Loading 0:  88%|████████▊ | 320/363 [00:14<00:06,  7.08it/s]
Loading 0:  90%|████████▉ | 325/363 [00:14<00:04,  9.27it/s]
Loading 0:  91%|█████████ | 330/363 [00:14<00:02, 11.46it/s]
Loading 0:  93%|█████████▎| 338/363 [00:14<00:01, 17.04it/s]
Loading 0:  95%|█████████▍| 344/363 [00:14<00:00, 20.40it/s]
Loading 0:  96%|█████████▌| 349/363 [00:15<00:00, 23.65it/s]
Loading 0:  98%|█████████▊| 356/363 [00:15<00:00, 30.29it/s]
Loading 0: 100%|█████████▉| 362/363 [00:15<00:00, 33.06it/s]
                                                            
Job pawankrd-cosmosrp-12b-v1-mkmlizer completed after 115.94s with status: succeeded
Stopping job with name pawankrd-cosmosrp-12b-v1-mkmlizer
Pipeline stage MKMLizer completed in 117.98s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.10s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service pawankrd-cosmosrp-12b-v1
Waiting for inference service pawankrd-cosmosrp-12b-v1 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Retrying (%r) after connection broken by '%r': %s
Inference service pawankrd-cosmosrp-12b-v1 ready after 190.7606201171875s
Pipeline stage MKMLDeployer completed in 191.25s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4778904914855957s
Received healthy response to inference request in 1.9498496055603027s
Received healthy response to inference request in 2.1477911472320557s
Received healthy response to inference request in 1.9624853134155273s
Received healthy response to inference request in 2.5863494873046875s
5 requests
0 failed requests
5th percentile: 1.9523767471313476
10th percentile: 1.9549038887023926
20th percentile: 1.9599581718444825
30th percentile: 1.999546480178833
40th percentile: 2.0736688137054444
50th percentile: 2.1477911472320557
60th percentile: 2.279830884933472
70th percentile: 2.4118706226348876
80th percentile: 2.499582290649414
90th percentile: 2.542965888977051
95th percentile: 2.564657688140869
99th percentile: 2.5820111274719237
mean time: 2.2248732089996337
Pipeline stage StressChecker completed in 11.97s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
starting trigger_guanaco_pipeline %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 5.78s
pawankrd-cosmosrp-12b_v1 status is now deployed due to DeploymentManager action
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service pawankrd-cosmosrp-12b-v1-profiler
Waiting for inference service pawankrd-cosmosrp-12b-v1-profiler to be ready
Inference service pawankrd-cosmosrp-12b-v1-profiler ready after 190.4993667602539s
Pipeline stage MKMLProfilerDeployer completed in 190.92s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
script pods %s
Pipeline stage MKMLProfilerRunner completed in 0.47s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service pawankrd-cosmosrp-12b-v1-profiler is running
Tearing down inference service pawankrd-cosmosrp-12b-v1-profiler
Service pawankrd-cosmosrp-12b-v1-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 2.01s
pawankrd-cosmosrp-12b_v1 status is now inactive due to auto deactivation removed underperforming models
pawankrd-cosmosrp-12b_v1 status is now torndown due to DeploymentManager action