zonemercy-virgo-edit-v1-_9278

developer_uid: zonemercy
submission_id: zonemercy-virgo-edit-v1-_9278_v1
model_name: 0821v1-1
model_group: zonemercy/Virgo-Edit-v1-
status: torndown
timestamp: 2024-08-21T20:45:49+00:00
num_battles: 9860
num_wins: 5013
celo_rating: 1247.15
family_friendly_score: 0.0
submission_type: basic
model_repo: zonemercy/Virgo-Edit-v1-1e5ep1
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: 0821v1-1
is_internal_developer: True
language_model: zonemercy/Virgo-Edit-v1-1e5ep1
model_size: 13B
ranking_group: single
us_pacific_date: 2024-08-21
win_ratio: 0.5084178498985801
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name zonemercy-virgo-edit-v1-9278-v1-mkmlizer
Waiting for job on zonemercy-virgo-edit-v1-9278-v1-mkmlizer to finish
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║     _____            __           __                                ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║       /___/                                                         ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  belonging to:                                                      ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: Downloaded to shared memory in 110.204s
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpq1dv94md, device:0
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: quantized model in 39.835s
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: Processed model zonemercy/Virgo-Edit-v1-1e5ep1 in 150.039s
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-9278-v1
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-9278-v1/special_tokens_map.json
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-9278-v1/config.json
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-9278-v1/tokenizer_config.json
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-9278-v1/tokenizer.json
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-9278-v1/flywheel_model.0.safetensors
zonemercy-virgo-edit-v1-9278-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:15, 23.64it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:12, 28.96it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:13, 25.67it/s]
Loading 0:   6%|▌         | 21/363 [00:00<00:09, 37.02it/s]
Loading 0:   7%|▋         | 26/363 [00:01<00:15, 21.64it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:12, 26.42it/s]
Loading 0:  10%|▉         | 35/363 [00:01<00:11, 27.76it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:10, 29.60it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:11, 29.09it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:09, 32.21it/s]
Loading 0:  14%|█▍        | 52/363 [00:01<00:09, 31.11it/s]
Loading 0:  15%|█▌        | 56/363 [00:01<00:09, 31.21it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:11, 26.48it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:12, 23.05it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:09, 30.45it/s]
Loading 0:  21%|██        | 75/363 [00:02<00:09, 29.34it/s]
Loading 0:  22%|██▏       | 79/363 [00:02<00:10, 28.19it/s]
Loading 0:  23%|██▎       | 84/363 [00:02<00:09, 30.68it/s]
Loading 0:  24%|██▍       | 88/363 [00:03<00:09, 29.57it/s]
Loading 0:  26%|██▌       | 93/363 [00:03<00:08, 32.03it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:08, 30.30it/s]
Loading 0:  28%|██▊       | 101/363 [00:03<00:10, 24.66it/s]
Loading 0:  29%|██▊       | 104/363 [00:03<00:11, 21.96it/s]
Loading 0:  31%|███       | 111/363 [00:03<00:08, 29.28it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:08, 28.75it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:07, 31.97it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:07, 30.56it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:07, 32.81it/s]
Loading 0:  37%|███▋      | 133/363 [00:04<00:07, 31.33it/s]
Loading 0:  38%|███▊      | 137/363 [00:04<00:07, 31.70it/s]
Loading 0:  39%|███▉      | 142/363 [00:04<00:08, 26.32it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:08, 24.60it/s]
Loading 0:  41%|████      | 149/363 [00:05<00:09, 23.53it/s]
Loading 0:  43%|████▎     | 156/363 [00:05<00:06, 30.71it/s]
Loading 0:  44%|████▍     | 160/363 [00:05<00:06, 29.76it/s]
Loading 0:  45%|████▌     | 165/363 [00:05<00:06, 32.36it/s]
Loading 0:  47%|████▋     | 169/363 [00:05<00:06, 31.04it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:05, 33.69it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:05, 31.74it/s]
Loading 0:  50%|█████     | 182/363 [00:06<00:07, 25.41it/s]
Loading 0:  51%|█████     | 185/363 [00:06<00:07, 22.50it/s]
Loading 0:  53%|█████▎    | 192/363 [00:06<00:05, 29.77it/s]
Loading 0:  54%|█████▍    | 196/363 [00:06<00:05, 29.13it/s]
Loading 0:  55%|█████▌    | 201/363 [00:06<00:05, 32.08it/s]
Loading 0:  56%|█████▋    | 205/363 [00:07<00:05, 30.45it/s]
Loading 0:  58%|█████▊    | 210/363 [00:07<00:04, 32.26it/s]
Loading 0:  59%|█████▉    | 214/363 [00:07<00:04, 30.36it/s]
Loading 0:  60%|██████    | 218/363 [00:07<00:04, 30.97it/s]
Loading 0:  61%|██████▏   | 223/363 [00:07<00:05, 26.78it/s]
Loading 0:  62%|██████▏   | 226/363 [00:07<00:05, 24.87it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:05, 23.66it/s]
Loading 0:  65%|██████▌   | 237/363 [00:08<00:04, 30.89it/s]
Loading 0:  66%|██████▋   | 241/363 [00:08<00:04, 29.23it/s]
Loading 0:  68%|██████▊   | 246/363 [00:08<00:03, 31.65it/s]
Loading 0:  69%|██████▉   | 250/363 [00:08<00:03, 30.13it/s]
Loading 0:  70%|███████   | 255/363 [00:08<00:03, 32.92it/s]
Loading 0:  71%|███████▏  | 259/363 [00:08<00:03, 30.64it/s]
Loading 0:  72%|███████▏  | 263/363 [00:09<00:03, 25.14it/s]
Loading 0:  73%|███████▎  | 266/363 [00:09<00:04, 22.34it/s]
Loading 0:  75%|███████▌  | 273/363 [00:09<00:03, 29.71it/s]
Loading 0:  76%|███████▋  | 277/363 [00:09<00:02, 28.78it/s]
Loading 0:  78%|███████▊  | 282/363 [00:09<00:02, 31.55it/s]
Loading 0:  79%|███████▉  | 286/363 [00:09<00:02, 30.21it/s]
Loading 0:  80%|████████  | 291/363 [00:10<00:02, 32.80it/s]
Loading 0:  81%|████████▏ | 295/363 [00:10<00:02, 31.59it/s]
Loading 0:  82%|████████▏ | 299/363 [00:10<00:02, 31.98it/s]
Loading 0:  84%|████████▎ | 304/363 [00:10<00:02, 27.27it/s]
Loading 0:  85%|████████▍ | 307/363 [00:10<00:02, 25.52it/s]
Loading 0:  86%|████████▌ | 311/363 [00:10<00:02, 24.22it/s]
Loading 0:  88%|████████▊ | 318/363 [00:11<00:01, 31.60it/s]
Loading 0:  89%|████████▊ | 322/363 [00:11<00:01, 30.75it/s]
Loading 0:  90%|█████████ | 327/363 [00:11<00:01, 33.68it/s]
Loading 0:  91%|█████████ | 331/363 [00:11<00:01, 31.54it/s]
Loading 0:  93%|█████████▎| 336/363 [00:11<00:00, 34.19it/s]
Loading 0:  94%|█████████▎| 340/363 [00:11<00:00, 31.50it/s]
Loading 0:  95%|█████████▍| 344/363 [00:18<00:09,  2.00it/s]
Loading 0:  96%|█████████▌| 348/363 [00:18<00:05,  2.69it/s]
Loading 0:  97%|█████████▋| 353/363 [00:18<00:02,  3.91it/s]
Loading 0:  98%|█████████▊| 357/363 [00:19<00:01,  5.08it/s]
                                                            
Job zonemercy-virgo-edit-v1-9278-v1-mkmlizer completed after 274.46s with status: succeeded
Stopping job with name zonemercy-virgo-edit-v1-9278-v1-mkmlizer
Pipeline stage MKMLizer completed in 275.71s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.11s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-virgo-edit-v1-9278-v1
Waiting for inference service zonemercy-virgo-edit-v1-9278-v1 to be ready
Inference service zonemercy-virgo-edit-v1-9278-v1 ready after 415.43967747688293s
Pipeline stage ISVCDeployer completed in 416.41s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1560678482055664s
Received healthy response to inference request in 1.848395586013794s
Received healthy response to inference request in 1.5976002216339111s
Received healthy response to inference request in 1.5845024585723877s
Received healthy response to inference request in 1.465261459350586s
5 requests
0 failed requests
5th percentile: 1.4891096591949462
10th percentile: 1.5129578590393067
20th percentile: 1.5606542587280274
30th percentile: 1.5871220111846924
40th percentile: 1.5923611164093017
50th percentile: 1.5976002216339111
60th percentile: 1.6979183673858642
70th percentile: 1.7982365131378173
80th percentile: 1.9099300384521485
90th percentile: 2.0329989433288573
95th percentile: 2.0945333957672116
99th percentile: 2.1437609577178955
mean time: 1.730365514755249
Pipeline stage StressChecker completed in 9.43s
zonemercy-virgo-edit-v1-_9278_v1 status is now deployed due to DeploymentManager action
zonemercy-virgo-edit-v1-_9278_v1 status is now inactive due to auto deactivation removed underperforming models
zonemercy-virgo-edit-v1-_9278_v1 status is now torndown due to DeploymentManager action