developer_uid: zonemercy
submission_id: zonemercy-graft-virgo-v1_3528_v1
model_name: zonemercy-graft-virgo-v1_3528_v1
model_group: zonemercy/Graft-Virgo-v1
status: torndown
timestamp: 2024-08-22T01:27:58+00:00
num_battles: 10233
num_wins: 5577
celo_rating: 1269.72
family_friendly_score: 0.0
submission_type: basic
model_repo: zonemercy/Graft-Virgo-v1-Acute-v1
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: zonemercy-graft-virgo-v1_3528_v1
is_internal_developer: True
language_model: zonemercy/Graft-Virgo-v1-Acute-v1
model_size: 13B
ranking_group: single
us_pacific_date: 2024-08-21
win_ratio: 0.545001465845793
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-graft-virgo-v1-3528-v1-mkmlizer
Waiting for job on zonemercy-graft-virgo-v1-3528-v1-mkmlizer to finish
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║     _____            __           __                                ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║       /___/                                                         ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║                                                                     ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║                                                                     ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  belonging to:                                                      ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║                                                                     ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ║                                                                     ║
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: Downloaded to shared memory in 103.453s
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp9_8cm6_k, device:0
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: quantized model in 40.732s
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: Processed model zonemercy/Graft-Virgo-v1-Acute-v1 in 144.185s
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-graft-virgo-v1-3528-v1
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-graft-virgo-v1-3528-v1/config.json
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-graft-virgo-v1-3528-v1/special_tokens_map.json
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-graft-virgo-v1-3528-v1/tokenizer_config.json
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-graft-virgo-v1-3528-v1/tokenizer.json
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-graft-virgo-v1-3528-v1/flywheel_model.0.safetensors
zonemercy-graft-virgo-v1-3528-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:16, 22.19it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:12, 28.45it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:13, 25.12it/s]
Loading 0:   6%|▌         | 20/363 [00:00<00:10, 34.24it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:15, 21.76it/s]
Loading 0:   7%|▋         | 27/363 [00:01<00:15, 21.51it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:13, 25.20it/s]
Loading 0:  10%|▉         | 35/363 [00:01<00:12, 27.22it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:11, 29.04it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:11, 28.54it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:10, 31.09it/s]
Loading 0:  14%|█▍        | 52/363 [00:01<00:10, 29.69it/s]
Loading 0:  15%|█▌        | 56/363 [00:02<00:10, 29.79it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:12, 24.57it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:13, 21.70it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:10, 28.68it/s]
Loading 0:  21%|██        | 75/363 [00:02<00:10, 28.49it/s]
Loading 0:  22%|██▏       | 79/363 [00:02<00:10, 28.07it/s]
Loading 0:  23%|██▎       | 84/363 [00:03<00:09, 30.64it/s]
Loading 0:  24%|██▍       | 88/363 [00:03<00:09, 29.37it/s]
Loading 0:  26%|██▌       | 93/363 [00:03<00:08, 31.53it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:08, 30.11it/s]
Loading 0:  28%|██▊       | 101/363 [00:03<00:11, 23.79it/s]
Loading 0:  29%|██▊       | 104/363 [00:03<00:12, 21.40it/s]
Loading 0:  31%|███       | 111/363 [00:04<00:08, 28.36it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:08, 27.89it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:07, 30.54it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:08, 29.51it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:07, 31.86it/s]
Loading 0:  37%|███▋      | 133/363 [00:04<00:07, 30.36it/s]
Loading 0:  38%|███▊      | 137/363 [00:04<00:07, 30.58it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:08, 25.63it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:08, 24.54it/s]
Loading 0:  41%|████      | 149/363 [00:05<00:09, 23.34it/s]
Loading 0:  43%|████▎     | 156/363 [00:05<00:06, 30.27it/s]
Loading 0:  44%|████▍     | 160/363 [00:05<00:06, 29.58it/s]
Loading 0:  45%|████▌     | 165/363 [00:05<00:06, 32.07it/s]
Loading 0:  47%|████▋     | 169/363 [00:06<00:06, 30.91it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:05, 33.07it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:05, 31.37it/s]
Loading 0:  50%|█████     | 182/363 [00:06<00:07, 24.75it/s]
Loading 0:  51%|█████     | 185/363 [00:06<00:08, 21.96it/s]
Loading 0:  53%|█████▎    | 192/363 [00:06<00:05, 29.19it/s]
Loading 0:  54%|█████▍    | 196/363 [00:07<00:05, 28.82it/s]
Loading 0:  55%|█████▌    | 201/363 [00:07<00:05, 31.61it/s]
Loading 0:  56%|█████▋    | 205/363 [00:07<00:05, 30.50it/s]
Loading 0:  58%|█████▊    | 210/363 [00:07<00:04, 32.88it/s]
Loading 0:  59%|█████▉    | 214/363 [00:07<00:04, 30.55it/s]
Loading 0:  60%|██████    | 218/363 [00:07<00:04, 30.58it/s]
Loading 0:  61%|██████▏   | 223/363 [00:07<00:05, 25.98it/s]
Loading 0:  62%|██████▏   | 226/363 [00:08<00:05, 24.92it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:05, 24.03it/s]
Loading 0:  65%|██████▌   | 237/363 [00:08<00:04, 30.68it/s]
Loading 0:  66%|██████▋   | 241/363 [00:08<00:04, 29.98it/s]
Loading 0:  68%|██████▊   | 246/363 [00:08<00:03, 32.52it/s]
Loading 0:  69%|██████▉   | 250/363 [00:08<00:03, 31.16it/s]
Loading 0:  70%|███████   | 255/363 [00:08<00:03, 33.19it/s]
Loading 0:  71%|███████▏  | 259/363 [00:09<00:03, 31.62it/s]
Loading 0:  72%|███████▏  | 263/363 [00:09<00:04, 24.58it/s]
Loading 0:  73%|███████▎  | 266/363 [00:09<00:04, 21.95it/s]
Loading 0:  75%|███████▌  | 273/363 [00:09<00:03, 29.21it/s]
Loading 0:  76%|███████▋  | 277/363 [00:09<00:03, 27.95it/s]
Loading 0:  78%|███████▊  | 282/363 [00:10<00:02, 30.78it/s]
Loading 0:  79%|███████▉  | 286/363 [00:10<00:02, 29.55it/s]
Loading 0:  80%|████████  | 291/363 [00:10<00:02, 31.33it/s]
Loading 0:  81%|████████▏ | 295/363 [00:10<00:02, 30.20it/s]
Loading 0:  82%|████████▏ | 299/363 [00:10<00:02, 30.31it/s]
Loading 0:  84%|████████▎ | 304/363 [00:10<00:02, 25.51it/s]
Loading 0:  85%|████████▍ | 307/363 [00:10<00:02, 24.31it/s]
Loading 0:  86%|████████▌ | 311/363 [00:11<00:02, 23.05it/s]
Loading 0:  88%|████████▊ | 318/363 [00:11<00:01, 29.64it/s]
Loading 0:  89%|████████▊ | 322/363 [00:11<00:01, 28.67it/s]
Loading 0:  90%|█████████ | 327/363 [00:11<00:01, 30.66it/s]
Loading 0:  91%|█████████ | 331/363 [00:11<00:01, 29.33it/s]
Loading 0:  93%|█████████▎| 336/363 [00:11<00:00, 31.80it/s]
Loading 0:  94%|█████████▎| 340/363 [00:12<00:00, 30.14it/s]
Loading 0:  95%|█████████▍| 344/363 [00:18<00:09,  1.99it/s]
Loading 0:  96%|█████████▌| 348/363 [00:19<00:05,  2.68it/s]
Loading 0:  97%|█████████▋| 353/363 [00:19<00:02,  3.89it/s]
Loading 0:  98%|█████████▊| 357/363 [00:19<00:01,  5.05it/s]
                                                            

Job zonemercy-graft-virgo-v1-3528-v1-mkmlizer completed after 170.7s with status: succeeded
Stopping job with name zonemercy-graft-virgo-v1-3528-v1-mkmlizer
Pipeline stage MKMLizer completed in 171.96s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-graft-virgo-v1-3528-v1
Waiting for inference service zonemercy-graft-virgo-v1-3528-v1 to be ready
Failed to get response for submission blend_dajen_2024-08-22: ('http://zonemercy-lexical-nemov8-5966-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:47562->127.0.0.1:8080: read: connection reset by peer\n')
Inference service zonemercy-graft-virgo-v1-3528-v1 ready after 262.85451221466064s
Pipeline stage ISVCDeployer completed in 263.81s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.968141555786133s
Received healthy response to inference request in 1.8194324970245361s
Received healthy response to inference request in 1.969564437866211s
Received healthy response to inference request in 1.506058692932129s
Received healthy response to inference request in 1.5251622200012207s
5 requests
0 failed requests
5th percentile: 1.5098793983459473
10th percentile: 1.5137001037597657
20th percentile: 1.5213415145874023
30th percentile: 1.5840162754058837
40th percentile: 1.70172438621521
50th percentile: 1.8194324970245361
60th percentile: 1.879485273361206
70th percentile: 1.939538049697876
80th percentile: 2.1692798614501956
90th percentile: 2.568710708618164
95th percentile: 2.768426132202148
99th percentile: 2.928198471069336
mean time: 1.957671880722046
Pipeline stage StressChecker completed in 10.48s
zonemercy-graft-virgo-v1_3528_v1 status is now deployed due to DeploymentManager action
zonemercy-graft-virgo-v1_3528_v1 status is now inactive due to auto deactivation removed underperforming models
zonemercy-graft-virgo-v1_3528_v1 status is now torndown due to DeploymentManager action