valentin87-enzo

developer_uid: valentin87
submission_id: valentin87-enzo_v5
model_name: enzo
model_group: valentin87/Enzo
status: torndown
timestamp: 2024-09-04T02:35:30+00:00
num_battles: 11017
num_wins: 5292
celo_rating: 1227.55
family_friendly_score: 0.0
submission_type: basic
model_repo: valentin87/Enzo
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 512
max_output_tokens: 64
display_name: enzo
is_internal_developer: True
language_model: valentin87/Enzo
model_size: 13B
ranking_group: single
us_pacific_date: 2024-09-03
win_ratio: 0.4803485522374512
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name valentin87-enzo-v5-mkmlizer
Waiting for job on valentin87-enzo-v5-mkmlizer to finish
valentin87-enzo-v5-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
valentin87-enzo-v5-mkmlizer: ║     _____            __           __                                ║
valentin87-enzo-v5-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
valentin87-enzo-v5-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
valentin87-enzo-v5-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
valentin87-enzo-v5-mkmlizer: ║       /___/                                                         ║
valentin87-enzo-v5-mkmlizer: ║                                                                     ║
valentin87-enzo-v5-mkmlizer: ║  Version: 0.10.1                                                    ║
valentin87-enzo-v5-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
valentin87-enzo-v5-mkmlizer: ║  https://mk1.ai                                                     ║
valentin87-enzo-v5-mkmlizer: ║                                                                     ║
valentin87-enzo-v5-mkmlizer: ║  The license key for the current software has been verified as      ║
valentin87-enzo-v5-mkmlizer: ║  belonging to:                                                      ║
valentin87-enzo-v5-mkmlizer: ║                                                                     ║
valentin87-enzo-v5-mkmlizer: ║  Chai Research Corp.                                                ║
valentin87-enzo-v5-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
valentin87-enzo-v5-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
valentin87-enzo-v5-mkmlizer: ║                                                                     ║
valentin87-enzo-v5-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
valentin87-enzo-v5-mkmlizer: Downloaded to shared memory in 75.800s
valentin87-enzo-v5-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp5xvv0tgv, device:0
valentin87-enzo-v5-mkmlizer: Saving flywheel model at /dev/shm/model_cache
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
valentin87-enzo-v5-mkmlizer: quantized model in 40.591s
valentin87-enzo-v5-mkmlizer: Processed model valentin87/Enzo in 116.392s
valentin87-enzo-v5-mkmlizer: creating bucket guanaco-mkml-models
valentin87-enzo-v5-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
valentin87-enzo-v5-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/valentin87-enzo-v5
valentin87-enzo-v5-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/valentin87-enzo-v5/config.json
valentin87-enzo-v5-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/valentin87-enzo-v5/special_tokens_map.json
valentin87-enzo-v5-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/valentin87-enzo-v5/tokenizer_config.json
valentin87-enzo-v5-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/valentin87-enzo-v5/flywheel_model.0.safetensors
valentin87-enzo-v5-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|▏         | 5/363 [00:00<00:16, 22.15it/s]
Loading 0:   3%|▎         | 10/363 [00:00<00:12, 28.61it/s]
Loading 0:   4%|▍         | 14/363 [00:00<00:13, 25.27it/s]
Loading 0:   6%|▌         | 20/363 [00:00<00:10, 34.07it/s]
Loading 0:   7%|▋         | 24/363 [00:00<00:14, 23.28it/s]
Loading 0:   7%|▋         | 27/363 [00:01<00:15, 22.36it/s]
Loading 0:   9%|▊         | 31/363 [00:01<00:12, 25.83it/s]
Loading 0:  10%|▉         | 35/363 [00:01<00:12, 26.94it/s]
Loading 0:  11%|█         | 39/363 [00:01<00:11, 28.54it/s]
Loading 0:  12%|█▏        | 43/363 [00:01<00:11, 28.05it/s]
Loading 0:  13%|█▎        | 48/363 [00:01<00:10, 30.49it/s]
Loading 0:  14%|█▍        | 52/363 [00:01<00:10, 29.26it/s]
Loading 0:  15%|█▌        | 56/363 [00:02<00:10, 29.99it/s]
Loading 0:  17%|█▋        | 61/363 [00:02<00:11, 25.37it/s]
Loading 0:  18%|█▊        | 64/363 [00:02<00:13, 21.95it/s]
Loading 0:  20%|█▉        | 71/363 [00:02<00:10, 28.79it/s]
Loading 0:  21%|██        | 75/363 [00:02<00:10, 28.67it/s]
Loading 0:  22%|██▏       | 79/363 [00:02<00:10, 27.61it/s]
Loading 0:  23%|██▎       | 84/363 [00:03<00:09, 29.64it/s]
Loading 0:  24%|██▍       | 88/363 [00:03<00:09, 28.16it/s]
Loading 0:  26%|██▌       | 93/363 [00:03<00:08, 30.24it/s]
Loading 0:  27%|██▋       | 97/363 [00:03<00:09, 29.02it/s]
Loading 0:  28%|██▊       | 101/363 [00:03<00:11, 23.24it/s]
Loading 0:  29%|██▊       | 104/363 [00:03<00:12, 20.95it/s]
Loading 0:  31%|███       | 111/363 [00:04<00:09, 27.90it/s]
Loading 0:  32%|███▏      | 115/363 [00:04<00:09, 27.44it/s]
Loading 0:  33%|███▎      | 120/363 [00:04<00:08, 30.05it/s]
Loading 0:  34%|███▍      | 124/363 [00:04<00:08, 28.98it/s]
Loading 0:  36%|███▌      | 129/363 [00:04<00:07, 31.48it/s]
Loading 0:  37%|███▋      | 133/363 [00:04<00:07, 29.71it/s]
Loading 0:  38%|███▊      | 137/363 [00:04<00:07, 29.99it/s]
Loading 0:  39%|███▉      | 142/363 [00:05<00:08, 25.32it/s]
Loading 0:  40%|███▉      | 145/363 [00:05<00:09, 24.16it/s]
Loading 0:  41%|████      | 149/363 [00:05<00:09, 23.21it/s]
Loading 0:  43%|████▎     | 156/363 [00:05<00:06, 30.06it/s]
Loading 0:  44%|████▍     | 160/363 [00:05<00:07, 28.68it/s]
Loading 0:  45%|████▌     | 165/363 [00:05<00:06, 30.50it/s]
Loading 0:  47%|████▋     | 169/363 [00:06<00:06, 29.26it/s]
Loading 0:  48%|████▊     | 174/363 [00:06<00:05, 31.64it/s]
Loading 0:  49%|████▉     | 178/363 [00:06<00:06, 29.48it/s]
Loading 0:  50%|█████     | 182/363 [00:06<00:07, 23.94it/s]
Loading 0:  51%|█████     | 185/363 [00:06<00:08, 21.50it/s]
Loading 0:  53%|█████▎    | 192/363 [00:07<00:05, 28.81it/s]
Loading 0:  54%|█████▍    | 196/363 [00:07<00:06, 27.46it/s]
Loading 0:  55%|█████▌    | 201/363 [00:07<00:05, 29.70it/s]
Loading 0:  56%|█████▋    | 205/363 [00:07<00:05, 28.60it/s]
Loading 0:  58%|█████▊    | 210/363 [00:07<00:04, 30.99it/s]
Loading 0:  59%|█████▉    | 214/363 [00:07<00:05, 28.59it/s]
Loading 0:  60%|██████    | 218/363 [00:07<00:05, 28.96it/s]
Loading 0:  61%|██████▏   | 223/363 [00:08<00:05, 25.62it/s]
Loading 0:  62%|██████▏   | 226/363 [00:08<00:05, 24.33it/s]
Loading 0:  63%|██████▎   | 230/363 [00:08<00:05, 22.67it/s]
Loading 0:  65%|██████▍   | 235/363 [00:08<00:04, 27.40it/s]
Loading 0:  66%|██████▌   | 239/363 [00:08<00:04, 25.15it/s]
Loading 0:  68%|██████▊   | 246/363 [00:08<00:03, 31.28it/s]
Loading 0:  69%|██████▉   | 250/363 [00:09<00:03, 29.77it/s]
Loading 0:  70%|███████   | 255/363 [00:09<00:03, 31.87it/s]
Loading 0:  71%|███████▏  | 259/363 [00:09<00:03, 30.16it/s]
Loading 0:  72%|███████▏  | 263/363 [00:09<00:04, 24.03it/s]
Loading 0:  73%|███████▎  | 266/363 [00:09<00:04, 21.44it/s]
Loading 0:  75%|███████▌  | 273/363 [00:09<00:03, 28.35it/s]
Loading 0:  76%|███████▋  | 277/363 [00:10<00:03, 27.50it/s]
Loading 0:  78%|███████▊  | 282/363 [00:10<00:02, 29.35it/s]
Loading 0:  79%|███████▉  | 286/363 [00:10<00:02, 28.57it/s]
Loading 0:  80%|████████  | 291/363 [00:10<00:02, 31.11it/s]
Loading 0:  81%|████████▏ | 295/363 [00:10<00:02, 29.44it/s]
Loading 0:  82%|████████▏ | 299/363 [00:10<00:02, 29.50it/s]
Loading 0:  83%|████████▎ | 303/363 [00:10<00:01, 31.32it/s]
Loading 0:  85%|████████▍ | 307/363 [00:11<00:02, 22.68it/s]
Loading 0:  86%|████████▌ | 311/363 [00:11<00:02, 21.63it/s]
Loading 0:  88%|████████▊ | 318/363 [00:11<00:01, 28.00it/s]
Loading 0:  89%|████████▊ | 322/363 [00:11<00:01, 27.73it/s]
Loading 0:  90%|█████████ | 327/363 [00:11<00:01, 30.40it/s]
Loading 0:  91%|█████████ | 331/363 [00:12<00:01, 28.80it/s]
Loading 0:  93%|█████████▎| 336/363 [00:12<00:00, 31.55it/s]
Loading 0:  94%|█████████▎| 340/363 [00:12<00:00, 29.72it/s]
Loading 0:  95%|█████████▍| 344/363 [00:19<00:09,  1.97it/s]
Loading 0:  96%|█████████▌| 348/363 [00:19<00:05,  2.64it/s]
Loading 0:  97%|█████████▋| 353/363 [00:19<00:02,  3.82it/s]
Loading 0:  98%|█████████▊| 357/363 [00:19<00:01,  4.92it/s]
Loading 0: 100%|█████████▉| 362/363 [00:19<00:00,  7.02it/s]
                                                            
Job valentin87-enzo-v5-mkmlizer completed after 136.33s with status: succeeded
Stopping job with name valentin87-enzo-v5-mkmlizer
Pipeline stage MKMLizer completed in 137.14s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service valentin87-enzo-v5
Waiting for inference service valentin87-enzo-v5 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service valentin87-enzo-v5 ready after 150.6190323829651s
Pipeline stage MKMLDeployer completed in 150.95s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.000505208969116s
Received healthy response to inference request in 1.898216962814331s
Received healthy response to inference request in 1.5980443954467773s
Received healthy response to inference request in 1.8139111995697021s
Received healthy response to inference request in 2.1843771934509277s
5 requests
0 failed requests
5th percentile: 1.6412177562713623
10th percentile: 1.6843911170959474
20th percentile: 1.7707378387451171
30th percentile: 1.8307723522186279
40th percentile: 1.8644946575164796
50th percentile: 1.898216962814331
60th percentile: 1.9391322612762452
70th percentile: 1.9800475597381593
80th percentile: 2.0372796058654785
90th percentile: 2.110828399658203
95th percentile: 2.1476027965545654
99th percentile: 2.1770223140716554
mean time: 1.899010992050171
Pipeline stage StressChecker completed in 10.11s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
starting trigger_guanaco_pipeline %s
Pipeline stage TriggerMKMLProfilingPipeline completed in 5.18s
valentin87-enzo_v5 status is now deployed due to DeploymentManager action
valentin87-enzo_v5 status is now inactive due to auto deactivation removed underperforming models
valentin87-enzo_v5 status is now torndown due to DeploymentManager action