zonemercy-acute-nemo-v1-_4488

developer_uid: zonemercy
submission_id: zonemercy-acute-nemo-v1-_4488_v6
model_name: 0815v1-1
model_group: zonemercy/Acute-Nemo-v1-
status: torndown
timestamp: 2024-08-16T00:51:06+00:00
num_battles: 9935
num_wins: 5449
celo_rating: 1269.9
family_friendly_score: 0.0
submission_type: basic
model_repo: zonemercy/Acute-Nemo-v1-1e5ep1
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 16
max_input_tokens: 512
max_output_tokens: 64
display_name: 0815v1-1
is_internal_developer: True
language_model: zonemercy/Acute-Nemo-v1-1e5ep1
model_size: 13B
ranking_group: single
us_pacific_date: 2024-08-15
win_ratio: 0.5484650226472069
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-acute-nemo-v1-4488-v6-mkmlizer
Waiting for job on zonemercy-acute-nemo-v1-4488-v6-mkmlizer to finish
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║     _____            __           __                                ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║       /___/                                                         ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  Version: 0.9.11                                                    ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  belonging to:                                                      ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: Downloaded to shared memory in 62.390s
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpg_06zwlx, device:0
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: quantized model in 40.604s
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: Processed model zonemercy/Acute-Nemo-v1-1e5ep1 in 102.995s
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v6
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v6/config.json
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v6/special_tokens_map.json
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v6/tokenizer_config.json
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v6/tokenizer.json
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v6/flywheel_model.0.safetensors
zonemercy-acute-nemo-v1-4488-v6-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:15, 23.48it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:12, 29.03it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:13, 25.65it/s]
Loading 0:   6%|▌         | 20/363 [00:00<00:09, 34.86it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:14, 24.14it/s]
Loading 0:   8%|▊         | 28/363 [00:01<00:13, 24.47it/s]
Loading 0:   9%|▉         | 32/363 [00:01<00:13, 23.77it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:10, 30.15it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:11, 29.03it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:09, 31.51it/s]
Loading 0:  14%|█▍        | 52/363 [00:01<00:10, 30.02it/s]
Loading 0:  15%|█▌        | 56/363 [00:01<00:10, 29.44it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:12, 25.03it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:13, 21.67it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:10, 28.25it/s]
Loading 0:  21%|██        | 75/363 [00:02<00:10, 27.93it/s]
Loading 0:  21%|██▏       | 78/363 [00:02<00:10, 26.41it/s]
Loading 0:  23%|██▎       | 84/363 [00:03<00:09, 30.97it/s]
Loading 0:  24%|██▍       | 88/363 [00:03<00:09, 29.86it/s]
Loading 0:  26%|██▌       | 93/363 [00:03<00:08, 32.04it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:08, 30.57it/s]
Loading 0:  28%|██▊       | 101/363 [00:03<00:10, 24.43it/s]
Loading 0:  29%|██▊       | 104/363 [00:03<00:11, 21.82it/s]
Loading 0:  31%|███       | 111/363 [00:04<00:08, 28.84it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:08, 28.57it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:07, 31.51it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:07, 30.83it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:07, 32.54it/s]
Loading 0:  37%|███▋      | 133/363 [00:04<00:07, 29.74it/s]
Loading 0:  38%|███▊      | 137/363 [00:04<00:07, 30.12it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:08, 25.92it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:08, 24.46it/s]
Loading 0:  41%|████      | 149/363 [00:05<00:09, 23.41it/s]
Loading 0:  43%|████▎     | 156/363 [00:05<00:06, 30.27it/s]
Loading 0:  44%|████▍     | 160/363 [00:05<00:06, 29.37it/s]
Loading 0:  45%|████▌     | 165/363 [00:05<00:06, 31.61it/s]
Loading 0:  47%|████▋     | 169/363 [00:06<00:06, 30.02it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:05, 31.80it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:06, 30.64it/s]
Loading 0:  50%|█████     | 182/363 [00:06<00:07, 24.48it/s]
Loading 0:  51%|█████     | 185/363 [00:06<00:08, 22.08it/s]
Loading 0:  53%|█████▎    | 192/363 [00:06<00:05, 28.88it/s]
Loading 0:  54%|█████▍    | 196/363 [00:07<00:05, 28.03it/s]
Loading 0:  55%|█████▌    | 201/363 [00:07<00:05, 30.71it/s]
Loading 0:  56%|█████▋    | 205/363 [00:07<00:05, 29.35it/s]
Loading 0:  58%|█████▊    | 210/363 [00:07<00:04, 31.48it/s]
Loading 0:  59%|█████▉    | 214/363 [00:07<00:04, 30.45it/s]
Loading 0:  60%|██████    | 218/363 [00:07<00:04, 30.47it/s]
Loading 0:  61%|██████▏   | 223/363 [00:07<00:05, 25.92it/s]
Loading 0:  62%|██████▏   | 226/363 [00:08<00:05, 24.63it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:05, 23.46it/s]
Loading 0:  65%|██████▌   | 237/363 [00:08<00:04, 30.53it/s]
Loading 0:  66%|██████▋   | 241/363 [00:08<00:04, 29.60it/s]
Loading 0:  67%|██████▋   | 245/363 [00:08<00:03, 31.51it/s]
Loading 0:  69%|██████▊   | 249/363 [00:08<00:04, 28.37it/s]
Loading 0:  70%|███████   | 255/363 [00:08<00:03, 32.73it/s]
Loading 0:  71%|███████▏  | 259/363 [00:09<00:03, 30.19it/s]
Loading 0:  72%|███████▏  | 263/363 [00:09<00:04, 24.94it/s]
Loading 0:  73%|███████▎  | 266/363 [00:09<00:04, 22.12it/s]
Loading 0:  75%|███████▌  | 273/363 [00:09<00:03, 28.98it/s]
Loading 0:  76%|███████▋  | 277/363 [00:09<00:03, 28.40it/s]
Loading 0:  78%|███████▊  | 282/363 [00:10<00:02, 30.57it/s]
Loading 0:  79%|███████▉  | 286/363 [00:10<00:02, 29.66it/s]
Loading 0:  80%|████████  | 291/363 [00:10<00:02, 32.28it/s]
Loading 0:  81%|████████▏ | 295/363 [00:10<00:02, 30.96it/s]
Loading 0:  82%|████████▏ | 299/363 [00:10<00:02, 30.79it/s]
Loading 0:  84%|████████▎ | 304/363 [00:10<00:02, 26.09it/s]
Loading 0:  85%|████████▍ | 307/363 [00:10<00:02, 24.86it/s]
Loading 0:  86%|████████▌ | 311/363 [00:11<00:02, 23.64it/s]
Loading 0:  87%|████████▋ | 316/363 [00:11<00:01, 28.84it/s]
Loading 0:  88%|████████▊ | 320/363 [00:11<00:01, 25.99it/s]
Loading 0:  90%|█████████ | 327/363 [00:11<00:01, 32.55it/s]
Loading 0:  91%|█████████ | 331/363 [00:11<00:01, 31.06it/s]
Loading 0:  93%|█████████▎| 336/363 [00:11<00:00, 32.76it/s]
Loading 0:  94%|█████████▎| 340/363 [00:11<00:00, 31.01it/s]
Loading 0:  95%|█████████▍| 344/363 [00:18<00:09,  2.02it/s]
Loading 0:  96%|█████████▌| 348/363 [00:19<00:05,  2.71it/s]
Loading 0:  97%|█████████▋| 353/363 [00:19<00:02,  3.92it/s]
Loading 0:  98%|█████████▊| 357/363 [00:19<00:01,  5.08it/s]
                                                            
Job zonemercy-acute-nemo-v1-4488-v6-mkmlizer completed after 126.31s with status: succeeded
Stopping job with name zonemercy-acute-nemo-v1-4488-v6-mkmlizer
Pipeline stage MKMLizer completed in 127.24s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.10s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-acute-nemo-v1-4488-v6
Waiting for inference service zonemercy-acute-nemo-v1-4488-v6 to be ready
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission zonemercy-cogent-nemo-v2-5e6_v13: ('http://zonemercy-cogent-nemo-v2-5e6-v13-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission zonemercy-cogent-nemo-v2-5e6_v14: ('http://zonemercy-cogent-nemo-v2-5e6-v14-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission zonemercy-cogent-nemo-v2-5e6_v13: ('http://zonemercy-cogent-nemo-v2-5e6-v13-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission chaiml-elo-alignment-run-3_v34: ('http://chaiml-elo-alignment-run-3-v34-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission zonemercy-cogent-nemo-v2-5e6_v13: ('http://zonemercy-cogent-nemo-v2-5e6-v13-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Failed to get response for submission chaiml-elo-alignment-run-3_v34: ('http://chaiml-elo-alignment-run-3-v34-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'request timeout')
Inference service zonemercy-acute-nemo-v1-4488-v6 ready after 251.62341022491455s
Pipeline stage ISVCDeployer completed in 253.51s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5608322620391846s
Received healthy response to inference request in 2.6095640659332275s
Received healthy response to inference request in 2.8562285900115967s
Received healthy response to inference request in 1.8785309791564941s
Received healthy response to inference request in 2.3416588306427s
5 requests
0 failed requests
5th percentile: 1.9711565494537353
10th percentile: 2.0637821197509765
20th percentile: 2.249033260345459
30th percentile: 2.385493516921997
40th percentile: 2.473162889480591
50th percentile: 2.5608322620391846
60th percentile: 2.580324983596802
70th percentile: 2.599817705154419
80th percentile: 2.658896970748901
90th percentile: 2.757562780380249
95th percentile: 2.806895685195923
99th percentile: 2.846362009048462
mean time: 2.449362945556641
Pipeline stage StressChecker completed in 13.00s
zonemercy-acute-nemo-v1-_4488_v6 status is now deployed due to DeploymentManager action
zonemercy-acute-nemo-v1-_4488_v6 status is now inactive due to auto deactivation removed underperforming models
zonemercy-acute-nemo-v1-_4488_v6 status is now torndown due to DeploymentManager action