zonemercy-edit-ss-v8-22b0-1e5

developer_uid: zonemercy
submission_id: zonemercy-edit-ss-v8-22b0-1e5_v1
model_name: zonemercy-edit-ss-v8-22b0-1e5_v1
model_group: zonemercy/Edit-ss-v8-22b
status: torndown
timestamp: 2024-10-25T16:27:56+00:00
num_battles: 18458
num_wins: 8553
celo_rating: 1205.5
family_friendly_score: 0.573
family_friendly_standard_error: 0.006995298421082549
submission_type: basic
model_repo: zonemercy/Edit-ss-v8-22b0-1e5
model_architecture: MistralForCausalLM
model_num_parameters: 22247282688.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: zonemercy-edit-ss-v8-22b0-1e5_v1
is_internal_developer: True
language_model: zonemercy/Edit-ss-v8-22b0-1e5
model_size: 22B
ranking_group: single
us_pacific_date: 2024-10-25
win_ratio: 0.4633763137934771
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '####', 'Bot:', 'User:', 'You:', '<|im_end|>', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer
Waiting for job on zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer to finish
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║     _____            __           __                                ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║       /___/                                                         ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  belonging to:                                                      ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║  Expiration: 2025-01-15 23:59:59                                    ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ║                                                                     ║
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: Downloaded to shared memory in 91.026s
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpoj6xz84l, device:0
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: quantized model in 43.637s
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: Processed model zonemercy/Edit-ss-v8-22b0-1e5 in 134.663s
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-edit-ss-v8-22b0-1e5-v1
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-edit-ss-v8-22b0-1e5-v1/config.json
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-edit-ss-v8-22b0-1e5-v1/special_tokens_map.json
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-edit-ss-v8-22b0-1e5-v1/tokenizer_config.json
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-edit-ss-v8-22b0-1e5-v1/tokenizer.json
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/zonemercy-edit-ss-v8-22b0-1e5-v1/flywheel_model.1.safetensors
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-edit-ss-v8-22b0-1e5-v1/flywheel_model.0.safetensors
zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer: 
Loading 0:   0%|          | 0/507 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/507 [00:00<00:19, 25.75it/s]
Loading 0:   2%|▏         | 12/507 [00:00<00:12, 39.40it/s]
Loading 0:   3%|▎         | 17/507 [00:00<00:12, 38.35it/s]
Loading 0:   4%|▍         | 22/507 [00:00<00:12, 38.84it/s]
Loading 0:   5%|▌         | 26/507 [00:00<00:13, 36.66it/s]
Loading 0:   6%|▌         | 31/507 [00:00<00:12, 37.60it/s]
Loading 0:   7%|▋         | 35/507 [00:00<00:12, 36.99it/s]
Loading 0:   8%|▊         | 39/507 [00:01<00:12, 37.80it/s]
Loading 0:   8%|▊         | 43/507 [00:01<00:12, 36.75it/s]
Loading 0:   9%|▉         | 47/507 [00:01<00:12, 36.90it/s]
Loading 0:  10%|█         | 51/507 [00:01<00:12, 35.87it/s]
Loading 0:  11%|█         | 55/507 [00:01<00:19, 23.72it/s]
Loading 0:  12%|█▏        | 59/507 [00:01<00:16, 26.45it/s]
Loading 0:  12%|█▏        | 63/507 [00:01<00:15, 28.89it/s]
Loading 0:  13%|█▎        | 67/507 [00:02<00:14, 29.90it/s]
Loading 0:  14%|█▍        | 72/507 [00:02<00:12, 34.16it/s]
Loading 0:  15%|█▌        | 78/507 [00:02<00:10, 39.13it/s]
Loading 0:  16%|█▋        | 83/507 [00:02<00:11, 38.50it/s]
Loading 0:  17%|█▋        | 88/507 [00:02<00:10, 38.41it/s]
Loading 0:  18%|█▊        | 92/507 [00:02<00:10, 38.36it/s]
Loading 0:  19%|█▉        | 96/507 [00:02<00:10, 37.98it/s]
Loading 0:  20%|█▉        | 100/507 [00:02<00:11, 36.59it/s]
Loading 0:  21%|██        | 105/507 [00:02<00:10, 38.89it/s]
Loading 0:  21%|██▏       | 109/507 [00:03<00:10, 37.41it/s]
Loading 0:  22%|██▏       | 113/507 [00:03<00:14, 27.42it/s]
Loading 0:  23%|██▎       | 117/507 [00:03<00:14, 27.39it/s]
Loading 0:  24%|██▍       | 122/507 [00:03<00:13, 28.47it/s]
Loading 0:  25%|██▌       | 129/507 [00:03<00:10, 35.43it/s]
Loading 0:  26%|██▌       | 133/507 [00:03<00:11, 33.74it/s]
Loading 0:  27%|██▋       | 138/507 [00:04<00:10, 36.35it/s]
Loading 0:  28%|██▊       | 142/507 [00:04<00:10, 35.77it/s]
Loading 0:  29%|██▉       | 147/507 [00:04<00:09, 38.48it/s]
Loading 0:  30%|██▉       | 151/507 [00:04<00:09, 37.21it/s]
Loading 0:  31%|███       | 156/507 [00:04<00:08, 39.59it/s]
Loading 0:  32%|███▏      | 161/507 [00:04<00:08, 39.68it/s]
Loading 0:  33%|███▎      | 166/507 [00:04<00:09, 37.72it/s]
Loading 0:  34%|███▎      | 170/507 [00:05<00:12, 27.32it/s]
Loading 0:  34%|███▍      | 174/507 [00:05<00:11, 28.88it/s]
Loading 0:  35%|███▌      | 178/507 [00:05<00:11, 29.89it/s]
Loading 0:  36%|███▌      | 183/507 [00:05<00:09, 33.85it/s]
Loading 0:  37%|███▋      | 187/507 [00:05<00:09, 33.89it/s]
Loading 0:  38%|███▊      | 192/507 [00:05<00:08, 37.16it/s]
Loading 0:  39%|███▊      | 196/507 [00:05<00:08, 36.11it/s]
Loading 0:  40%|███▉      | 201/507 [00:05<00:07, 39.04it/s]
Loading 0:  41%|████      | 206/507 [00:05<00:07, 39.59it/s]
Loading 0:  42%|████▏     | 211/507 [00:06<00:07, 39.73it/s]
Loading 0:  43%|████▎     | 216/507 [00:06<00:06, 41.71it/s]
Loading 0:  44%|████▎     | 221/507 [00:06<00:08, 34.35it/s]
Loading 0:  44%|████▍     | 225/507 [00:06<00:10, 25.97it/s]
Loading 0:  45%|████▌     | 230/507 [00:06<00:09, 28.02it/s]
Loading 0:  47%|████▋     | 237/507 [00:06<00:07, 34.57it/s]
Loading 0:  48%|████▊     | 241/507 [00:07<00:07, 33.49it/s]
Loading 0:  49%|████▊     | 246/507 [00:07<00:07, 35.35it/s]
Loading 0:  49%|████▉     | 250/507 [00:07<00:07, 34.34it/s]
Loading 0:  50%|█████     | 255/507 [00:07<00:06, 36.07it/s]
Loading 0:  51%|█████     | 259/507 [00:07<00:07, 34.63it/s]
Loading 0:  52%|█████▏    | 264/507 [00:07<00:06, 36.55it/s]
Loading 0:  53%|█████▎    | 268/507 [00:07<00:06, 35.34it/s]
Loading 0:  54%|█████▍    | 273/507 [00:07<00:06, 37.15it/s]
Loading 0:  55%|█████▍    | 277/507 [00:08<00:06, 35.32it/s]
Loading 0:  56%|█████▌    | 283/507 [00:08<00:06, 36.59it/s]
Loading 0:  57%|█████▋    | 287/507 [00:08<00:08, 24.72it/s]
Loading 0:  58%|█████▊    | 293/507 [00:08<00:07, 27.66it/s]
Loading 0:  59%|█████▉    | 299/507 [00:23<00:07, 27.66it/s]
Loading 0:  59%|█████▉    | 300/507 [00:23<02:44,  1.26it/s]
Loading 0:  60%|█████▉    | 302/507 [00:23<02:22,  1.44it/s]
Loading 0:  61%|██████    | 307/507 [00:23<01:36,  2.07it/s]
Loading 0:  61%|██████    | 310/507 [00:23<01:16,  2.56it/s]
Loading 0:  62%|██████▏   | 313/507 [00:23<00:59,  3.26it/s]
Loading 0:  63%|██████▎   | 318/507 [00:23<00:38,  4.89it/s]
Loading 0:  64%|██████▎   | 322/507 [00:23<00:28,  6.50it/s]
Loading 0:  64%|██████▍   | 327/507 [00:23<00:19,  9.20it/s]
Loading 0:  65%|██████▌   | 331/507 [00:24<00:15, 11.54it/s]
Loading 0:  66%|██████▌   | 335/507 [00:24<00:12, 14.31it/s]
Loading 0:  67%|██████▋   | 340/507 [00:24<00:10, 15.74it/s]
Loading 0:  68%|██████▊   | 344/507 [00:24<00:08, 18.46it/s]
Loading 0:  69%|██████▊   | 348/507 [00:24<00:07, 20.02it/s]
Loading 0:  70%|██████▉   | 354/507 [00:24<00:05, 25.87it/s]
Loading 0:  71%|███████   | 358/507 [00:25<00:06, 24.79it/s]
Loading 0:  72%|███████▏  | 363/507 [00:25<00:05, 28.76it/s]
Loading 0:  72%|███████▏  | 367/507 [00:25<00:04, 29.62it/s]
Loading 0:  73%|███████▎  | 372/507 [00:25<00:04, 33.53it/s]
Loading 0:  74%|███████▍  | 376/507 [00:25<00:03, 34.01it/s]
Loading 0:  75%|███████▌  | 381/507 [00:25<00:03, 37.31it/s]
Loading 0:  76%|███████▌  | 385/507 [00:25<00:03, 36.35it/s]
Loading 0:  77%|███████▋  | 389/507 [00:25<00:03, 33.33it/s]
Loading 0:  78%|███████▊  | 393/507 [00:26<00:03, 33.63it/s]
Loading 0:  78%|███████▊  | 397/507 [00:26<00:04, 25.76it/s]
Loading 0:  79%|███████▉  | 401/507 [00:26<00:04, 25.92it/s]
Loading 0:  80%|████████  | 406/507 [00:26<00:03, 30.30it/s]
Loading 0:  81%|████████  | 410/507 [00:26<00:03, 28.40it/s]
Loading 0:  82%|████████▏ | 417/507 [00:26<00:02, 35.28it/s]
Loading 0:  83%|████████▎ | 421/507 [00:26<00:02, 34.03it/s]
Loading 0:  84%|████████▍ | 426/507 [00:27<00:02, 36.57it/s]
Loading 0:  85%|████████▍ | 430/507 [00:27<00:02, 35.50it/s]
Loading 0:  86%|████████▌ | 435/507 [00:27<00:01, 37.25it/s]
Loading 0:  87%|████████▋ | 439/507 [00:27<00:01, 36.18it/s]
Loading 0:  88%|████████▊ | 444/507 [00:27<00:01, 38.16it/s]
Loading 0:  88%|████████▊ | 448/507 [00:27<00:01, 36.40it/s]
Loading 0:  89%|████████▉ | 453/507 [00:27<00:01, 39.67it/s]
Loading 0:  90%|█████████ | 458/507 [00:30<00:08,  6.11it/s]
Loading 0:  91%|█████████ | 461/507 [00:30<00:06,  7.32it/s]
Loading 0:  92%|█████████▏| 465/507 [00:30<00:04,  9.31it/s]
Loading 0:  93%|█████████▎| 472/507 [00:30<00:02, 14.31it/s]
Loading 0:  94%|█████████▍| 476/507 [00:30<00:01, 16.69it/s]
Loading 0:  95%|█████████▍| 481/507 [00:30<00:01, 20.59it/s]
Loading 0:  96%|█████████▌| 485/507 [00:30<00:00, 22.73it/s]
Loading 0:  97%|█████████▋| 490/507 [00:30<00:00, 26.60it/s]
Loading 0:  97%|█████████▋| 494/507 [00:31<00:00, 27.99it/s]
Loading 0:  98%|█████████▊| 499/507 [00:31<00:00, 30.89it/s]
Loading 0:  99%|█████████▉| 503/507 [00:31<00:00, 31.54it/s]
                                                            
Job zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer completed after 165.68s with status: succeeded
Stopping job with name zonemercy-edit-ss-v8-22b0-1e5-v1-mkmlizer
Pipeline stage MKMLizer completed in 166.26s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.21s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zonemercy-edit-ss-v8-22b0-1e5-v1
Waiting for inference service zonemercy-edit-ss-v8-22b0-1e5-v1 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Failed to get response for submission zonemercy-virgo-edit-v1-1e5_v13: ('http://chaiml-llama-8b-pairwis-8189-v27-predictor.tenant-chaiml-guanaco.k2.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', 'read tcp 127.0.0.1:32820->127.0.0.1:8080: read: connection reset by peer\n')
Inference service zonemercy-edit-ss-v8-22b0-1e5-v1 ready after 130.47379088401794s
Pipeline stage MKMLDeployer completed in 131.06s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.960233211517334s
Received healthy response to inference request in 2.4733617305755615s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.372325897216797s
Received healthy response to inference request in 2.559699773788452s
Received healthy response to inference request in 2.4495491981506348s
5 requests
0 failed requests
5th percentile: 2.3877705574035644
10th percentile: 2.403215217590332
20th percentile: 2.4341045379638673
30th percentile: 2.45431170463562
40th percentile: 2.4638367176055906
50th percentile: 2.4733617305755615
60th percentile: 2.5078969478607176
70th percentile: 2.542432165145874
80th percentile: 2.6398064613342287
90th percentile: 2.8000198364257813
95th percentile: 2.8801265239715574
99th percentile: 2.944211874008179
mean time: 2.5630339622497558
Pipeline stage StressChecker completed in 14.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.47s
Shutdown handler de-registered
zonemercy-edit-ss-v8-22b0-1e5_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3093.92s
Shutdown handler de-registered
zonemercy-edit-ss-v8-22b0-1e5_v1 status is now inactive due to auto deactivation removed underperforming models
zonemercy-edit-ss-v8-22b0-1e5_v1 status is now torndown due to DeploymentManager action