developer_uid: zonemercy
submission_id: zonemercy-virgo-edit-v2-_2834_v3
model_name: 0821v1-0
model_group: zonemercy/Virgo-Edit-v2-
status: torndown
timestamp: 2024-08-21T22:06:37+00:00
num_battles: 11160
num_wins: 5728
celo_rating: 1247.26
family_friendly_score: 0.0
submission_type: basic
model_repo: zonemercy/Virgo-Edit-v2-1e5ep1
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: 0821v1-0
is_internal_developer: True
language_model: zonemercy/Virgo-Edit-v2-1e5ep1
model_size: 13B
ranking_group: single
us_pacific_date: 2024-08-21
win_ratio: 0.5132616487455197
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': 'Bot Name: {bot_name}\n####\n', 'prompt_template': '', 'bot_template': 'Bot: {message}\n', 'user_template': 'User: {message}\n', 'response_template': 'Bot:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-virgo-edit-v2-2834-v3-mkmlizer
Waiting for job on zonemercy-virgo-edit-v2-2834-v3-mkmlizer to finish
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║     _____            __           __                                ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║       /___/                                                         ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  belonging to:                                                      ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: Downloaded to shared memory in 58.522s
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmprawggzgu, device:0
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: quantized model in 42.334s
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: Processed model zonemercy/Virgo-Edit-v2-1e5ep1 in 100.856s
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-virgo-edit-v2-2834-v3
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v2-2834-v3/config.json
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v2-2834-v3/special_tokens_map.json
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v2-2834-v3/tokenizer_config.json
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v2-2834-v3/tokenizer.json
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-virgo-edit-v2-2834-v3/flywheel_model.0.safetensors
zonemercy-virgo-edit-v2-2834-v3-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 4/363 [00:00<00:10, 32.65it/s]
Loading 0:   2%|▏         | 8/363 [00:00<00:16, 22.13it/s]
Loading 0:   3%|▎         | 12/363 [00:00<00:14, 24.61it/s]
Loading 0:   4%|▍         | 15/363 [00:00<00:15, 22.15it/s]
Loading 0:   5%|▌         | 19/363 [00:00<00:13, 26.12it/s]
Loading 0:   6%|▌         | 22/363 [00:00<00:12, 26.97it/s]
Loading 0:   7%|▋         | 25/363 [00:01<00:19, 17.45it/s]
Loading 0:   8%|▊         | 28/363 [00:01<00:18, 18.29it/s]
Loading 0:   9%|▉         | 32/363 [00:01<00:17, 18.61it/s]
Loading 0:  10%|█         | 37/363 [00:01<00:13, 24.19it/s]
Loading 0:  11%|█         | 40/363 [00:01<00:12, 25.38it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:12, 24.66it/s]
Loading 0:  13%|█▎        | 46/363 [00:01<00:12, 25.53it/s]
Loading 0:  13%|█▎        | 49/363 [00:02<00:12, 24.71it/s]
Loading 0:  14%|█▍        | 52/363 [00:02<00:12, 24.45it/s]
Loading 0:  15%|█▌        | 55/363 [00:02<00:12, 25.49it/s]
Loading 0:  17%|█▋        | 60/363 [00:02<00:11, 26.77it/s]
Loading 0:  17%|█▋        | 63/363 [00:02<00:16, 17.84it/s]
Loading 0:  18%|█▊        | 66/363 [00:02<00:15, 19.40it/s]
Loading 0:  20%|█▉        | 71/363 [00:03<00:12, 23.71it/s]
Loading 0:  20%|██        | 74/363 [00:03<00:11, 24.44it/s]
Loading 0:  21%|██        | 77/363 [00:03<00:14, 20.00it/s]
Loading 0:  23%|██▎       | 82/363 [00:03<00:11, 25.34it/s]
Loading 0:  23%|██▎       | 85/363 [00:03<00:10, 25.65it/s]
Loading 0:  24%|██▍       | 88/363 [00:03<00:10, 25.32it/s]
Loading 0:  25%|██▌       | 91/363 [00:03<00:10, 26.13it/s]
Loading 0:  26%|██▌       | 95/363 [00:04<00:11, 23.55it/s]
Loading 0:  28%|██▊       | 100/363 [00:04<00:08, 29.40it/s]
Loading 0:  29%|██▊       | 104/363 [00:04<00:13, 18.70it/s]
Loading 0:  31%|███       | 111/363 [00:04<00:09, 25.42it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:09, 25.03it/s]
Loading 0:  33%|███▎      | 120/363 [00:05<00:08, 28.13it/s]
Loading 0:  34%|███▍      | 124/363 [00:05<00:08, 27.44it/s]
Loading 0:  36%|███▌      | 129/363 [00:05<00:07, 30.06it/s]
Loading 0:  37%|███▋      | 133/363 [00:05<00:08, 28.73it/s]
Loading 0:  38%|███▊      | 137/363 [00:05<00:07, 28.91it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:08, 24.78it/s]
Loading 0:  40%|███▉      | 145/363 [00:06<00:09, 23.30it/s]
Loading 0:  41%|████      | 149/363 [00:06<00:09, 22.22it/s]
Loading 0:  43%|████▎     | 156/363 [00:06<00:07, 28.40it/s]
Loading 0:  44%|████▍     | 159/363 [00:06<00:07, 25.79it/s]
Loading 0:  45%|████▌     | 165/363 [00:06<00:06, 30.14it/s]
Loading 0:  47%|████▋     | 169/363 [00:06<00:06, 28.78it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:06, 30.93it/s]
Loading 0:  49%|████▉     | 178/363 [00:07<00:06, 29.27it/s]
Loading 0:  50%|█████     | 182/363 [00:07<00:07, 23.57it/s]
Loading 0:  51%|█████     | 185/363 [00:07<00:08, 20.88it/s]
Loading 0:  53%|█████▎    | 192/363 [00:07<00:06, 27.52it/s]
Loading 0:  54%|█████▎    | 195/363 [00:07<00:06, 25.71it/s]
Loading 0:  55%|█████▌    | 201/363 [00:08<00:05, 30.16it/s]
Loading 0:  56%|█████▋    | 205/363 [00:08<00:05, 28.05it/s]
Loading 0:  58%|█████▊    | 210/363 [00:08<00:05, 29.54it/s]
Loading 0:  59%|█████▉    | 214/363 [00:08<00:05, 27.16it/s]
Loading 0:  60%|█████▉    | 217/363 [00:08<00:05, 27.19it/s]
Loading 0:  61%|██████    | 222/363 [00:08<00:04, 28.82it/s]
Loading 0:  62%|██████▏   | 225/363 [00:09<00:07, 18.79it/s]
Loading 0:  63%|██████▎   | 230/363 [00:09<00:06, 20.34it/s]
Loading 0:  65%|██████▍   | 235/363 [00:09<00:05, 25.08it/s]
Loading 0:  66%|██████▌   | 239/363 [00:09<00:05, 23.21it/s]
Loading 0:  67%|██████▋   | 244/363 [00:09<00:04, 28.07it/s]
Loading 0:  68%|██████▊   | 248/363 [00:09<00:04, 24.93it/s]
Loading 0:  70%|███████   | 255/363 [00:10<00:03, 30.76it/s]
Loading 0:  71%|███████▏  | 259/363 [00:10<00:03, 28.69it/s]
Loading 0:  72%|███████▏  | 263/363 [00:10<00:04, 22.82it/s]
Loading 0:  73%|███████▎  | 266/363 [00:10<00:04, 19.96it/s]
Loading 0:  75%|███████▍  | 271/363 [00:10<00:03, 24.89it/s]
Loading 0:  76%|███████▌  | 275/363 [00:11<00:03, 23.00it/s]
Loading 0:  78%|███████▊  | 282/363 [00:11<00:02, 28.86it/s]
Loading 0:  79%|███████▉  | 286/363 [00:11<00:02, 27.54it/s]
Loading 0:  80%|████████  | 291/363 [00:11<00:02, 29.26it/s]
Loading 0:  81%|████████▏ | 295/363 [00:11<00:02, 27.65it/s]
Loading 0:  82%|████████▏ | 299/363 [00:11<00:02, 27.52it/s]
Loading 0:  83%|████████▎ | 303/363 [00:11<00:02, 29.92it/s]
Loading 0:  85%|████████▍ | 307/363 [00:12<00:02, 20.77it/s]
Loading 0:  86%|████████▌ | 311/363 [00:12<00:02, 20.09it/s]
Loading 0:  87%|████████▋ | 316/363 [00:12<00:01, 25.18it/s]
Loading 0:  88%|████████▊ | 320/363 [00:12<00:01, 23.36it/s]
Loading 0:  90%|████████▉ | 325/363 [00:12<00:01, 28.19it/s]
Loading 0:  91%|█████████ | 329/363 [00:13<00:01, 25.09it/s]
Loading 0:  92%|█████████▏| 334/363 [00:13<00:00, 30.01it/s]
Loading 0:  93%|█████████▎| 338/363 [00:13<00:00, 26.09it/s]
Loading 0:  94%|█████████▍| 343/363 [00:13<00:00, 30.89it/s]
Loading 0:  96%|█████████▌| 347/363 [00:20<00:08,  1.99it/s]
Loading 0:  96%|█████████▋| 350/363 [00:20<00:05,  2.51it/s]
Loading 0:  97%|█████████▋| 353/363 [00:20<00:03,  3.21it/s]
Loading 0:  98%|█████████▊| 357/363 [00:21<00:01,  4.37it/s]
                                                            

Job zonemercy-virgo-edit-v2-2834-v3-mkmlizer completed after 136.56s with status: succeeded
Stopping job with name zonemercy-virgo-edit-v2-2834-v3-mkmlizer
Pipeline stage MKMLizer completed in 138.16s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.15s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-virgo-edit-v2-2834-v3
Waiting for inference service zonemercy-virgo-edit-v2-2834-v3 to be ready
Inference service zonemercy-virgo-edit-v2-2834-v3 ready after 262.5262842178345s
Pipeline stage ISVCDeployer completed in 263.19s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.199314594268799s
Received healthy response to inference request in 1.8865857124328613s
Received healthy response to inference request in 1.817706823348999s
Received healthy response to inference request in 2.013633966445923s
Received healthy response to inference request in 2.0956246852874756s
5 requests
0 failed requests
5th percentile: 1.8314826011657714
10th percentile: 1.8452583789825439
20th percentile: 1.872809934616089
30th percentile: 1.9119953632354736
40th percentile: 1.9628146648406983
50th percentile: 2.013633966445923
60th percentile: 2.046430253982544
70th percentile: 2.079226541519165
80th percentile: 2.1163626670837403
90th percentile: 2.1578386306762694
95th percentile: 2.178576612472534
99th percentile: 2.195166997909546
mean time: 2.0025731563568114
Pipeline stage StressChecker completed in 10.81s
zonemercy-virgo-edit-v2-_2834_v3 status is now deployed due to DeploymentManager action
zonemercy-virgo-edit-v2-_2834_v3 status is now inactive due to auto deactivation removed underperforming models
zonemercy-virgo-edit-v2-_2834_v3 status is now torndown due to DeploymentManager action