zonemercy-acute-nemo-v1-_4488

developer_uid: zonemercy
submission_id: zonemercy-acute-nemo-v1-_4488_v8
model_name: 0815v3-0
model_group: zonemercy/Acute-Nemo-v1-
status: torndown
timestamp: 2024-08-17T00:20:04+00:00
num_battles: 7306
num_wins: 4286
celo_rating: 1281.9
family_friendly_score: 0.0
submission_type: basic
model_repo: zonemercy/Acute-Nemo-v1-1e5ep1
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 32
max_input_tokens: 512
max_output_tokens: 64
display_name: 0815v3-0
is_internal_developer: True
language_model: zonemercy/Acute-Nemo-v1-1e5ep1
model_size: 13B
ranking_group: single
us_pacific_date: 2024-08-16
win_ratio: 0.5866411168902272
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 512, 'best_of': 32, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-acute-nemo-v1-4488-v8-mkmlizer
Waiting for job on zonemercy-acute-nemo-v1-4488-v8-mkmlizer to finish
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║     _____            __           __                                ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║       /___/                                                         ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  Version: 0.9.11                                                    ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  belonging to:                                                      ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ║                                                                     ║
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
Retrying (%r) after connection broken by '%r': %s
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: Downloaded to shared memory in 60.879s
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpja1cpsgr, device:0
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: quantized model in 42.401s
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: Processed model zonemercy/Acute-Nemo-v1-1e5ep1 in 103.280s
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v8
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v8/config.json
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v8/special_tokens_map.json
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v8/tokenizer_config.json
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v8/tokenizer.json
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-acute-nemo-v1-4488-v8/flywheel_model.0.safetensors
zonemercy-acute-nemo-v1-4488-v8-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:15, 22.48it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:12, 28.00it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:14, 23.66it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:11, 29.93it/s]
Loading 0:   6%|▋         | 23/363 [00:00<00:15, 21.46it/s]
Loading 0:   7%|▋         | 26/363 [00:01<00:17, 19.20it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:13, 24.45it/s]
Loading 0:   9%|▉         | 34/363 [00:01<00:13, 24.71it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:11, 28.03it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:11, 26.94it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:10, 29.09it/s]
Loading 0:  14%|█▍        | 52/363 [00:02<00:11, 26.90it/s]
Loading 0:  15%|█▌        | 56/363 [00:02<00:11, 26.96it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:12, 23.59it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:14, 20.73it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:10, 27.46it/s]
Loading 0:  20%|██        | 74/363 [00:02<00:10, 27.71it/s]
Loading 0:  21%|██        | 77/363 [00:03<00:12, 22.99it/s]
Loading 0:  23%|██▎       | 82/363 [00:03<00:09, 28.23it/s]
Loading 0:  24%|██▎       | 86/363 [00:03<00:12, 22.44it/s]
Loading 0:  26%|██▌       | 93/363 [00:03<00:09, 28.88it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:09, 27.86it/s]
Loading 0:  28%|██▊       | 101/363 [00:04<00:11, 22.76it/s]
Loading 0:  29%|██▊       | 104/363 [00:04<00:12, 20.46it/s]
Loading 0:  30%|███       | 109/363 [00:04<00:10, 24.84it/s]
Loading 0:  31%|███       | 112/363 [00:04<00:09, 25.72it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:09, 25.42it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:08, 27.30it/s]
Loading 0:  34%|███▍      | 123/363 [00:04<00:09, 24.61it/s]
Loading 0:  35%|███▍      | 127/363 [00:05<00:08, 27.95it/s]
Loading 0:  36%|███▌      | 130/363 [00:05<00:08, 28.26it/s]
Loading 0:  37%|███▋      | 133/363 [00:05<00:08, 26.96it/s]
Loading 0:  38%|███▊      | 137/363 [00:05<00:08, 27.75it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:09, 23.46it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:09, 22.28it/s]
Loading 0:  41%|████      | 149/363 [00:06<00:09, 21.46it/s]
Loading 0:  43%|████▎     | 156/363 [00:06<00:07, 28.07it/s]
Loading 0:  44%|████▍     | 159/363 [00:06<00:07, 25.99it/s]
Loading 0:  45%|████▌     | 165/363 [00:06<00:06, 30.57it/s]
Loading 0:  47%|████▋     | 169/363 [00:06<00:06, 29.16it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:06, 30.98it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:06, 29.59it/s]
Loading 0:  50%|█████     | 182/363 [00:07<00:07, 24.83it/s]
Loading 0:  51%|█████     | 185/363 [00:07<00:08, 21.68it/s]
Loading 0:  53%|█████▎    | 192/363 [00:07<00:06, 28.43it/s]
Loading 0:  54%|█████▍    | 196/363 [00:07<00:06, 27.79it/s]
Loading 0:  55%|█████▌    | 201/363 [00:07<00:05, 30.23it/s]
Loading 0:  56%|█████▋    | 205/363 [00:07<00:05, 28.76it/s]
Loading 0:  58%|█████▊    | 210/363 [00:08<00:04, 31.19it/s]
Loading 0:  59%|█████▉    | 214/363 [00:08<00:05, 29.37it/s]
Loading 0:  60%|██████    | 218/363 [00:08<00:04, 29.46it/s]
Loading 0:  61%|██████▏   | 223/363 [00:08<00:05, 25.44it/s]
Loading 0:  62%|██████▏   | 226/363 [00:08<00:05, 23.11it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:06, 21.76it/s]
Loading 0:  65%|██████▍   | 235/363 [00:09<00:04, 27.04it/s]
Loading 0:  66%|██████▌   | 239/363 [00:09<00:05, 24.44it/s]
Loading 0:  67%|██████▋   | 244/363 [00:09<00:04, 29.39it/s]
Loading 0:  68%|██████▊   | 248/363 [00:09<00:04, 26.01it/s]
Loading 0:  70%|███████   | 255/363 [00:09<00:03, 31.98it/s]
Loading 0:  71%|███████▏  | 259/363 [00:09<00:03, 29.89it/s]
Loading 0:  72%|███████▏  | 263/363 [00:10<00:04, 24.29it/s]
Loading 0:  73%|███████▎  | 266/363 [00:10<00:04, 21.29it/s]
Loading 0:  75%|███████▌  | 273/363 [00:10<00:03, 27.69it/s]
Loading 0:  76%|███████▋  | 277/363 [00:10<00:03, 27.38it/s]
Loading 0:  78%|███████▊  | 282/363 [00:10<00:02, 29.89it/s]
Loading 0:  79%|███████▉  | 286/363 [00:10<00:02, 28.67it/s]
Loading 0:  80%|████████  | 291/363 [00:11<00:02, 31.01it/s]
Loading 0:  81%|████████▏ | 295/363 [00:11<00:02, 29.25it/s]
Loading 0:  82%|████████▏ | 299/363 [00:11<00:02, 29.12it/s]
Loading 0:  83%|████████▎ | 303/363 [00:11<00:01, 31.53it/s]
Loading 0:  85%|████████▍ | 307/363 [00:11<00:02, 22.23it/s]
Loading 0:  86%|████████▌ | 311/363 [00:11<00:02, 21.58it/s]
Loading 0:  88%|████████▊ | 318/363 [00:12<00:01, 28.10it/s]
Loading 0:  89%|████████▊ | 322/363 [00:12<00:01, 27.01it/s]
Loading 0:  90%|█████████ | 327/363 [00:12<00:01, 28.78it/s]
Loading 0:  91%|█████████ | 331/363 [00:12<00:01, 27.80it/s]
Loading 0:  93%|█████████▎| 336/363 [00:12<00:00, 30.01it/s]
Loading 0:  94%|█████████▎| 340/363 [00:12<00:00, 28.35it/s]
Loading 0:  95%|█████████▍| 344/363 [00:19<00:09,  1.96it/s]
Loading 0:  96%|█████████▌| 348/363 [00:20<00:05,  2.64it/s]
Loading 0:  97%|█████████▋| 353/363 [00:20<00:02,  3.83it/s]
Loading 0:  98%|█████████▊| 357/363 [00:20<00:01,  4.95it/s]
                                                            
Job zonemercy-acute-nemo-v1-4488-v8-mkmlizer completed after 125.99s with status: succeeded
Stopping job with name zonemercy-acute-nemo-v1-4488-v8-mkmlizer
Pipeline stage MKMLizer completed in 126.98s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-acute-nemo-v1-4488-v8
Waiting for inference service zonemercy-acute-nemo-v1-4488-v8 to be ready
Tearing down inference service zonemercy-acute-nemo-v1-4488-v8
%s, retrying in %s seconds...
Creating inference service zonemercy-acute-nemo-v1-4488-v8
Ignoring service zonemercy-acute-nemo-v1-4488-v8 already deployed
Waiting for inference service zonemercy-acute-nemo-v1-4488-v8 to be ready
Tearing down inference service zonemercy-acute-nemo-v1-4488-v8
%s, retrying in %s seconds...
Creating inference service zonemercy-acute-nemo-v1-4488-v8
Waiting for inference service zonemercy-acute-nemo-v1-4488-v8 to be ready
Inference service zonemercy-acute-nemo-v1-4488-v8 ready after 130.8448131084442s
Pipeline stage ISVCDeployer completed in 747.66s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.960602045059204s
Received healthy response to inference request in 2.6786561012268066s
Received healthy response to inference request in 2.470548391342163s
Received healthy response to inference request in 2.3268704414367676s
Received healthy response to inference request in 2.8939895629882812s
5 requests
0 failed requests
5th percentile: 2.355606031417847
10th percentile: 2.3843416213989257
20th percentile: 2.441812801361084
30th percentile: 2.512169933319092
40th percentile: 2.595413017272949
50th percentile: 2.6786561012268066
60th percentile: 2.7647894859313964
70th percentile: 2.850922870635986
80th percentile: 2.9073120594024657
90th percentile: 2.933957052230835
95th percentile: 2.9472795486450196
99th percentile: 2.957937545776367
mean time: 2.6661333084106444
Pipeline stage StressChecker completed in 14.09s
zonemercy-acute-nemo-v1-_4488_v8 status is now deployed due to DeploymentManager action
Running pipeline stage MKMLDeleter
admin requested tearing down of zonemercy-acute-nemo-v1-_4488_v8
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
admin requested tearing down of zonemercy-lexical-nemo-_1518_v22
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLDeleter
run pipeline %s
%s, retrying in %s seconds...
run pipeline stage %s
%s, retrying in %s seconds...
Running pipeline stage MKMLDeleter
clean up pipeline due to error=%s
%s, retrying in %s seconds...
Shutdown handler de-registered
%s, retrying in %s seconds...
zonemercy-acute-nemo-v1-_4488_v8 status is now torndown due to DeploymentManager action