zonemercy-virgo-edit-v1-1e5

submission_id: zonemercy-virgo-edit-v1-1e5_v12
developer_uid: chai_backend_admin
best_of: 8
celo_rating: 1246.46
display_name: zonemercy-virgo-edit-v1-1e5_v12
family_friendly_score: 0.0
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
language_model: zonemercy/Virgo-Edit-v1-1e5
max_input_tokens: 1024
max_output_tokens: 64
model_architecture: MistralForCausalLM
model_group: zonemercy/Virgo-Edit-v1-
model_name: zonemercy-virgo-edit-v1-1e5_v12
model_num_parameters: 12772070400.0
model_repo: zonemercy/Virgo-Edit-v1-1e5
model_size: 13B
num_battles: 356107
num_wins: 178980
ranking_group: single
status: torndown
submission_type: basic
timestamp: 2024-09-11T17:50:48+00:00
us_pacific_date: 2024-09-11
win_ratio: 0.5026017461044012
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-virgo-edit-v1-1e5-v12-mkmlizer
Waiting for job on zonemercy-virgo-edit-v1-1e5-v12-mkmlizer to finish
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║     _____            __           __                                ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║       /___/                                                         ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  Version: 0.10.1                                                    ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  belonging to:                                                      ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ║                                                                     ║
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: Downloaded to shared memory in 56.475s
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp7kdope_j, device:0
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: quantized model in 38.944s
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: Processed model zonemercy/Virgo-Edit-v1-1e5 in 95.419s
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-1e5-v12
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-1e5-v12/config.json
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-1e5-v12/special_tokens_map.json
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-1e5-v12/tokenizer_config.json
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-1e5-v12/tokenizer.json
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-virgo-edit-v1-1e5-v12/flywheel_model.0.safetensors
zonemercy-virgo-edit-v1-1e5-v12-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:14, 24.73it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:11, 31.90it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:12, 28.23it/s]
Loading 0:   6%|▌         | 22/363 [00:00<00:08, 38.62it/s]
Loading 0:   7%|▋         | 27/363 [00:00<00:13, 25.65it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:11, 28.17it/s]
Loading 0:  10%|▉         | 35/363 [00:01<00:10, 30.31it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:10, 32.34it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:10, 31.88it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:09, 34.47it/s]
Loading 0:  14%|█▍        | 52/363 [00:01<00:09, 32.95it/s]
Loading 0:  15%|█▌        | 56/363 [00:01<00:09, 33.26it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:10, 28.42it/s]
Loading 0:  18%|█▊        | 65/363 [00:02<00:11, 25.68it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:09, 31.20it/s]
Loading 0:  21%|██        | 75/363 [00:02<00:09, 31.25it/s]
Loading 0:  22%|██▏       | 79/363 [00:02<00:09, 30.51it/s]
Loading 0:  23%|██▎       | 84/363 [00:02<00:08, 33.25it/s]
Loading 0:  24%|██▍       | 88/363 [00:02<00:08, 32.58it/s]
Loading 0:  26%|██▌       | 93/363 [00:02<00:07, 35.52it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:07, 33.89it/s]
Loading 0:  28%|██▊       | 101/363 [00:03<00:09, 27.23it/s]
Loading 0:  29%|██▊       | 104/363 [00:03<00:10, 23.85it/s]
Loading 0:  31%|███       | 111/363 [00:03<00:08, 31.33it/s]
Loading 0:  32%|███▏      | 115/363 [00:03<00:08, 30.79it/s]
Loading 0:  33%|███▎      | 120/363 [00:03<00:07, 33.98it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:07, 33.01it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:06, 35.54it/s]
Loading 0:  37%|███▋      | 133/363 [00:04<00:06, 33.73it/s]
Loading 0:  38%|███▊      | 137/363 [00:04<00:06, 33.69it/s]
Loading 0:  39%|███▉      | 142/363 [00:04<00:07, 29.00it/s]
Loading 0:  40%|████      | 146/363 [00:04<00:07, 29.10it/s]
Loading 0:  41%|████▏     | 150/363 [00:04<00:07, 27.09it/s]
Loading 0:  43%|████▎     | 156/363 [00:05<00:06, 32.48it/s]
Loading 0:  44%|████▍     | 160/363 [00:05<00:06, 32.01it/s]
Loading 0:  45%|████▌     | 165/363 [00:05<00:05, 34.43it/s]
Loading 0:  47%|████▋     | 169/363 [00:05<00:05, 33.01it/s]
Loading 0:  48%|████▊     | 174/363 [00:05<00:05, 35.94it/s]
Loading 0:  49%|████▉     | 178/363 [00:05<00:05, 34.59it/s]
Loading 0:  50%|█████     | 182/363 [00:05<00:06, 28.14it/s]
Loading 0:  51%|█████     | 186/363 [00:06<00:06, 25.83it/s]
Loading 0:  53%|█████▎    | 192/363 [00:06<00:05, 31.39it/s]
Loading 0:  54%|█████▍    | 196/363 [00:06<00:05, 31.07it/s]
Loading 0:  55%|█████▌    | 201/363 [00:06<00:04, 33.64it/s]
Loading 0:  56%|█████▋    | 205/363 [00:06<00:04, 32.59it/s]
Loading 0:  58%|█████▊    | 210/363 [00:06<00:04, 35.57it/s]
Loading 0:  59%|█████▉    | 214/363 [00:06<00:04, 33.59it/s]
Loading 0:  60%|██████    | 218/363 [00:06<00:04, 33.48it/s]
Loading 0:  61%|██████▏   | 223/363 [00:07<00:04, 29.19it/s]
Loading 0:  63%|██████▎   | 227/363 [00:07<00:04, 29.36it/s]
Loading 0:  64%|██████▎   | 231/363 [00:07<00:04, 27.37it/s]
Loading 0:  65%|██████▌   | 237/363 [00:07<00:03, 32.51it/s]
Loading 0:  66%|██████▋   | 241/363 [00:07<00:03, 32.04it/s]
Loading 0:  68%|██████▊   | 246/363 [00:07<00:03, 35.10it/s]
Loading 0:  69%|██████▉   | 250/363 [00:07<00:03, 33.46it/s]
Loading 0:  70%|███████   | 255/363 [00:08<00:03, 35.53it/s]
Loading 0:  71%|███████▏  | 259/363 [00:08<00:03, 33.97it/s]
Loading 0:  72%|███████▏  | 263/363 [00:08<00:03, 27.60it/s]
Loading 0:  73%|███████▎  | 266/363 [00:08<00:04, 23.76it/s]
Loading 0:  75%|███████▌  | 273/363 [00:08<00:02, 31.72it/s]
Loading 0:  76%|███████▋  | 277/363 [00:08<00:02, 31.07it/s]
Loading 0:  78%|███████▊  | 282/363 [00:09<00:02, 33.86it/s]
Loading 0:  79%|███████▉  | 286/363 [00:09<00:02, 32.83it/s]
Loading 0:  80%|████████  | 291/363 [00:09<00:02, 35.61it/s]
Loading 0:  81%|████████▏ | 295/363 [00:09<00:01, 34.12it/s]
Loading 0:  82%|████████▏ | 299/363 [00:09<00:01, 34.42it/s]
Loading 0:  84%|████████▎ | 304/363 [00:09<00:02, 29.20it/s]
Loading 0:  85%|████████▍ | 308/363 [00:09<00:01, 29.26it/s]
Loading 0:  86%|████████▌ | 312/363 [00:10<00:01, 27.63it/s]
Loading 0:  88%|████████▊ | 318/363 [00:10<00:01, 32.31it/s]
Loading 0:  89%|████████▊ | 322/363 [00:10<00:01, 30.45it/s]
Loading 0:  90%|█████████ | 327/363 [00:10<00:01, 33.67it/s]
Loading 0:  91%|█████████ | 331/363 [00:10<00:00, 32.74it/s]
Loading 0:  93%|█████████▎| 336/363 [00:10<00:00, 34.93it/s]
Loading 0:  94%|█████████▎| 340/363 [00:10<00:00, 32.30it/s]
Loading 0:  95%|█████████▍| 344/363 [00:17<00:09,  2.00it/s]
Loading 0:  96%|█████████▌| 348/363 [00:17<00:05,  2.70it/s]
Loading 0:  97%|█████████▋| 353/363 [00:17<00:02,  3.93it/s]
Loading 0:  98%|█████████▊| 357/363 [00:18<00:01,  5.12it/s]
                                                            
Job zonemercy-virgo-edit-v1-1e5-v12-mkmlizer completed after 120.58s with status: succeeded
Stopping job with name zonemercy-virgo-edit-v1-1e5-v12-mkmlizer
Pipeline stage MKMLizer completed in 123.79s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.42s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-virgo-edit-v1-1e5-v12
Waiting for inference service zonemercy-virgo-edit-v1-1e5-v12 to be ready
Inference service zonemercy-virgo-edit-v1-1e5-v12 ready after 30.503348112106323s
Pipeline stage MKMLDeployer completed in 31.99s
run pipeline stage %s
Running pipeline stage StressChecker
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.14924693107605s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.3415722846984863s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.3026010990142822s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.2101569175720215s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.3096799850463867s
5 requests
0 failed requests
5th percentile: 2.228645753860474
10th percentile: 2.2471345901489257
20th percentile: 2.28411226272583
30th percentile: 2.304016876220703
40th percentile: 2.306848430633545
50th percentile: 2.3096799850463867
60th percentile: 2.3224369049072267
70th percentile: 2.3351938247680666
80th percentile: 2.5031072139739994
90th percentile: 2.8261770725250246
95th percentile: 2.9877120018005368
99th percentile: 3.116939945220947
mean time: 2.4626514434814455
Pipeline stage StressChecker completed in 15.89s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 3.90s
Shutdown handler de-registered
zonemercy-virgo-edit-v1-1e5_v12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.12s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.11s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-virgo-edit-v1-1e5-v12-profiler
Waiting for inference service zonemercy-virgo-edit-v1-1e5-v12-profiler to be ready
Tearing down inference service zonemercy-virgo-edit-v1-1e5-v12-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-virgo-edit-v1-1e5-v12-profiler
Waiting for inference service zonemercy-virgo-edit-v1-1e5-v12-profiler to be ready
Tearing down inference service zonemercy-virgo-edit-v1-1e5-v12-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-virgo-edit-v1-1e5-v12-profiler
Waiting for inference service zonemercy-virgo-edit-v1-1e5-v12-profiler to be ready
Tearing down inference service zonemercy-virgo-edit-v1-1e5-v12-profiler
clean up pipeline due to error=%s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.12s
Shutdown handler de-registered
zonemercy-virgo-edit-v1-1e5_v12 status is now inactive due to auto deactivation removed underperforming models
zonemercy-virgo-edit-v1-1e5_v12 status is now torndown due to DeploymentManager action