riverise-my-first-model

submission_id: riverise-my-first-model_v6
developer_uid: Riverise
best_of: 16
celo_rating: 1230.66
display_name: riverise-my-first-model_v5
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.2, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: False
language_model: Riverise/my-first-model
max_input_tokens: 512
max_output_tokens: 64
model_architecture: LlamaForCausalLM
model_group: Riverise/my-first-model
model_name: riverise-my-first-model_v5
model_num_parameters: 8030261248.0
model_repo: Riverise/my-first-model
model_size: 8B
num_battles: 10251
num_wins: 5034
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-08-26T16:16:06+00:00
us_pacific_date: 2024-08-26
win_ratio: 0.4910740415569213
Resubmit model
Running pipeline stage MKMLizer
Running pipeline stage MKMLizer
Starting job with name riverise-my-first-model-v6-mkmlizer
Waiting for job on riverise-my-first-model-v6-mkmlizer to finish
riverise-my-first-model-v6-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
riverise-my-first-model-v6-mkmlizer: ║     _____            __           __                                ║
riverise-my-first-model-v6-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
riverise-my-first-model-v6-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
riverise-my-first-model-v6-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
riverise-my-first-model-v6-mkmlizer: ║       /___/                                                         ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ║  Version: 0.10.1                                                    ║
riverise-my-first-model-v6-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
riverise-my-first-model-v6-mkmlizer: ║  https://mk1.ai                                                     ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ║  The license key for the current software has been verified as      ║
riverise-my-first-model-v6-mkmlizer: ║  belonging to:                                                      ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ║  Chai Research Corp.                                                ║
riverise-my-first-model-v6-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
riverise-my-first-model-v6-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
riverise-my-first-model-v6-mkmlizer: Downloaded to shared memory in 29.621s
riverise-my-first-model-v6-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpdji1a5qx, device:0
riverise-my-first-model-v6-mkmlizer: Saving flywheel model at /dev/shm/model_cache
riverise-my-first-model-v6-mkmlizer: quantized model in 25.799s
riverise-my-first-model-v6-mkmlizer: Processed model Riverise/my-first-model in 55.420s
riverise-my-first-model-v6-mkmlizer: creating bucket guanaco-mkml-models
riverise-my-first-model-v6-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
riverise-my-first-model-v6-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/riverise-my-first-model-v6
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/riverise-my-first-model-v6/config.json
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/riverise-my-first-model-v6/special_tokens_map.json
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/riverise-my-first-model-v6/tokenizer_config.json
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/riverise-my-first-model-v6/tokenizer.json
Stopping job with name riverise-my-first-model-v6-mkmlizer
%s, retrying in %s seconds...
Stopping job with name riverise-my-first-model-v6-mkmlizer
%s, retrying in %s seconds...
Stopping job with name riverise-my-first-model-v6-mkmlizer
%s, retrying in %s seconds...
Starting job with name riverise-my-first-model-v6-mkmlizer
Waiting for job on riverise-my-first-model-v6-mkmlizer to finish
riverise-my-first-model-v6-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
riverise-my-first-model-v6-mkmlizer: ║     _____            __           __                                ║
riverise-my-first-model-v6-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
riverise-my-first-model-v6-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
riverise-my-first-model-v6-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
riverise-my-first-model-v6-mkmlizer: ║       /___/                                                         ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ║  Version: 0.10.1                                                    ║
riverise-my-first-model-v6-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
riverise-my-first-model-v6-mkmlizer: ║  https://mk1.ai                                                     ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ║  The license key for the current software has been verified as      ║
riverise-my-first-model-v6-mkmlizer: ║  belonging to:                                                      ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ║  Chai Research Corp.                                                ║
riverise-my-first-model-v6-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
riverise-my-first-model-v6-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
riverise-my-first-model-v6-mkmlizer: ║                                                                     ║
riverise-my-first-model-v6-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
riverise-my-first-model-v6-mkmlizer: Downloaded to shared memory in 21.130s
riverise-my-first-model-v6-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp9fs3x7nz, device:0
riverise-my-first-model-v6-mkmlizer: Saving flywheel model at /dev/shm/model_cache
riverise-my-first-model-v6-mkmlizer: quantized model in 25.915s
riverise-my-first-model-v6-mkmlizer: Processed model Riverise/my-first-model in 47.046s
riverise-my-first-model-v6-mkmlizer: creating bucket guanaco-mkml-models
riverise-my-first-model-v6-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
riverise-my-first-model-v6-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/riverise-my-first-model-v6
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/riverise-my-first-model-v6/special_tokens_map.json
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/riverise-my-first-model-v6/config.json
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/riverise-my-first-model-v6/tokenizer_config.json
riverise-my-first-model-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/riverise-my-first-model-v6/tokenizer.json
riverise-my-first-model-v6-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 4/291 [00:00<00:07, 38.87it/s]
Loading 0:   5%|▌         | 16/291 [00:00<00:04, 68.63it/s]
Loading 0:   9%|▊         | 25/291 [00:00<00:03, 71.17it/s]
Loading 0:  12%|█▏        | 35/291 [00:00<00:03, 80.97it/s]
Loading 0:  15%|█▌        | 44/291 [00:00<00:03, 77.06it/s]
Loading 0:  18%|█▊        | 52/291 [00:00<00:03, 74.28it/s]
Loading 0:  23%|██▎       | 67/291 [00:00<00:02, 82.07it/s]
Loading 0:  26%|██▌       | 76/291 [00:01<00:02, 76.29it/s]
Loading 0:  29%|██▉       | 84/291 [00:02<00:09, 22.78it/s]
Loading 0:  31%|███       | 90/291 [00:02<00:07, 26.20it/s]
Loading 0:  33%|███▎      | 97/291 [00:02<00:06, 31.05it/s]
Loading 0:  36%|███▋      | 106/291 [00:02<00:04, 38.65it/s]
Loading 0:  40%|███▉      | 115/291 [00:02<00:03, 45.32it/s]
Loading 0:  43%|████▎     | 124/291 [00:02<00:03, 53.31it/s]
Loading 0:  46%|████▌     | 133/291 [00:02<00:02, 60.60it/s]
Loading 0:  49%|████▉     | 142/291 [00:02<00:02, 64.50it/s]
Loading 0:  52%|█████▏    | 151/291 [00:02<00:02, 66.06it/s]
Loading 0:  55%|█████▍    | 160/291 [00:03<00:01, 71.66it/s]
Loading 0:  60%|██████    | 175/291 [00:03<00:01, 82.68it/s]
Loading 0:  63%|██████▎   | 184/291 [00:03<00:01, 82.39it/s]
Loading 0:  66%|██████▋   | 193/291 [00:04<00:04, 23.77it/s]
Loading 0:  70%|███████   | 205/291 [00:04<00:02, 31.44it/s]
Loading 0:  76%|███████▌  | 220/291 [00:04<00:01, 42.29it/s]
Loading 0:  79%|███████▊  | 229/291 [00:04<00:01, 47.23it/s]
Loading 0:  82%|████████▏ | 238/291 [00:04<00:01, 52.76it/s]
Loading 0:  85%|████████▍ | 247/291 [00:05<00:00, 57.42it/s]
Loading 0:  89%|████████▉ | 259/291 [00:05<00:00, 63.99it/s]
Loading 0:  92%|█████████▏| 268/291 [00:05<00:00, 65.98it/s]
Loading 0:  95%|█████████▌| 277/291 [00:05<00:00, 70.58it/s]
Loading 0:  99%|█████████▊| 287/291 [00:05<00:00, 43.50it/s]
                                                            
Job riverise-my-first-model-v6-mkmlizer completed after 73.97s with status: succeeded
Stopping job with name riverise-my-first-model-v6-mkmlizer
Pipeline stage MKMLizer completed in 158.80s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.08s
Running pipeline stage ISVCDeployer
Creating inference service riverise-my-first-model-v6
Ignoring service riverise-my-first-model-v6 already deployed
Waiting for inference service riverise-my-first-model-v6 to be ready
Inference service riverise-my-first-model-v6 ready after 80.80160307884216s
Pipeline stage ISVCDeployer completed in 81.39s
Running pipeline stage StressChecker
{"detail":"('http://riverise-my-first-model-v6-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '{\"error\":\"ValueError : [TypeError(\\\\\"\\'numpy.int64\\' object is not iterable\\\\\"), TypeError(\\'vars() argument must have __dict__ attribute\\')]\"}')"}
Received unhealthy response to inference request!
Received healthy response to inference request in 2.322495222091675s
Received healthy response to inference request in 2.017551898956299s
Received healthy response to inference request in 2.1526529788970947s
Received healthy response to inference request in 1.8639271259307861s
5 requests
1 failed requests
5th percentile: 1.5272497653961181
10th percentile: 1.611419105529785
20th percentile: 1.7797577857971192
30th percentile: 1.8946520805358886
40th percentile: 1.9561019897460938
50th percentile: 2.017551898956299
60th percentile: 2.071592330932617
70th percentile: 2.1256327629089355
80th percentile: 2.1866214275360107
90th percentile: 2.2545583248138428
95th percentile: 2.288526773452759
99th percentile: 2.3157015323638914
mean time: 1.959941530227661
%s, retrying in %s seconds...
Received healthy response to inference request in 1.9277064800262451s
Received healthy response to inference request in 2.036332130432129s
Received healthy response to inference request in 1.7023005485534668s
Received healthy response to inference request in 2.0953128337860107s
Received healthy response to inference request in 1.7572345733642578s
5 requests
0 failed requests
5th percentile: 1.713287353515625
10th percentile: 1.7242741584777832
20th percentile: 1.7462477684020996
30th percentile: 1.7913289546966553
40th percentile: 1.85951771736145
50th percentile: 1.9277064800262451
60th percentile: 1.9711567401885985
70th percentile: 2.014607000350952
80th percentile: 2.048128271102905
90th percentile: 2.071720552444458
95th percentile: 2.0835166931152345
99th percentile: 2.0929536056518554
mean time: 1.9037773132324218
Pipeline stage StressChecker completed in 23.93s
riverise-my-first-model_v6 status is now deployed due to DeploymentManager action
riverise-my-first-model_v6 status is now inactive due to auto deactivation removed underperforming models
riverise-my-first-model_v6 status is now torndown due to DeploymentManager action