developer_uid: chace9580
submission_id: jic062-dpo-v1-3_v3
model_name: jic062-dpo-v1-3_v3
model_group: jic062/dpo-v1.3
status: torndown
timestamp: 2024-08-30T17:05:29+00:00
num_battles: 12277
num_wins: 6511
celo_rating: 1258.22
family_friendly_score: 0.0
submission_type: basic
model_repo: jic062/dpo-v1.3
model_architecture: LlamaForCausalLM
model_num_parameters: 8030261248.0
best_of: 16
max_input_tokens: 512
max_output_tokens: 64
display_name: jic062-dpo-v1-3_v3
is_internal_developer: False
language_model: jic062/dpo-v1.3
model_size: 8B
ranking_group: single
us_pacific_date: 2024-08-30
win_ratio: 0.5303412885884173
generation_params: {'temperature': 1.0, 'top_p': 0.9, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '|eot_id|'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name jic062-dpo-v1-3-v3-mkmlizer
Waiting for job on jic062-dpo-v1-3-v3-mkmlizer to finish
Stopping job with name jic062-dpo-v1-3-v3-mkmlizer
%s, retrying in %s seconds...
Starting job with name jic062-dpo-v1-3-v3-mkmlizer
Waiting for job on jic062-dpo-v1-3-v3-mkmlizer to finish
jic062-dpo-v1-3-v3-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
jic062-dpo-v1-3-v3-mkmlizer: ║     _____            __           __                                ║
jic062-dpo-v1-3-v3-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
jic062-dpo-v1-3-v3-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
jic062-dpo-v1-3-v3-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
jic062-dpo-v1-3-v3-mkmlizer: ║       /___/                                                         ║
jic062-dpo-v1-3-v3-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v3-mkmlizer: ║  Version: 0.10.1                                                    ║
jic062-dpo-v1-3-v3-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
jic062-dpo-v1-3-v3-mkmlizer: ║  https://mk1.ai                                                     ║
jic062-dpo-v1-3-v3-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v3-mkmlizer: ║  The license key for the current software has been verified as      ║
jic062-dpo-v1-3-v3-mkmlizer: ║  belonging to:                                                      ║
jic062-dpo-v1-3-v3-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v3-mkmlizer: ║  Chai Research Corp.                                                ║
jic062-dpo-v1-3-v3-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
jic062-dpo-v1-3-v3-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
jic062-dpo-v1-3-v3-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v3-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
jic062-dpo-v1-3-v3-mkmlizer: Downloaded to shared memory in 24.615s
jic062-dpo-v1-3-v3-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmps4qrvezi, device:0
jic062-dpo-v1-3-v3-mkmlizer: Saving flywheel model at /dev/shm/model_cache
jic062-dpo-v1-3-v3-mkmlizer: quantized model in 26.885s
jic062-dpo-v1-3-v3-mkmlizer: Processed model jic062/dpo-v1.3 in 51.500s
jic062-dpo-v1-3-v3-mkmlizer: creating bucket guanaco-mkml-models
jic062-dpo-v1-3-v3-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
jic062-dpo-v1-3-v3-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/jic062-dpo-v1-3-v3
jic062-dpo-v1-3-v3-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v3/config.json
jic062-dpo-v1-3-v3-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v3/special_tokens_map.json
jic062-dpo-v1-3-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v3/tokenizer_config.json
jic062-dpo-v1-3-v3-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v3/tokenizer.json
jic062-dpo-v1-3-v3-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/jic062-dpo-v1-3-v3/flywheel_model.0.safetensors
jic062-dpo-v1-3-v3-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/291 [00:00<00:08, 35.33it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:05, 54.31it/s]
Loading 0:   7%|▋         | 19/291 [00:00<00:05, 49.44it/s]
Loading 0:   9%|▊         | 25/291 [00:00<00:05, 51.10it/s]
Loading 0:  11%|█         | 32/291 [00:00<00:05, 46.73it/s]
Loading 0:  14%|█▎        | 40/291 [00:00<00:04, 55.41it/s]
Loading 0:  16%|█▌        | 46/291 [00:00<00:04, 51.35it/s]
Loading 0:  18%|█▊        | 52/291 [00:01<00:04, 53.28it/s]
Loading 0:  20%|██        | 59/291 [00:01<00:04, 49.78it/s]
Loading 0:  23%|██▎       | 67/291 [00:01<00:03, 56.39it/s]
Loading 0:  25%|██▌       | 73/291 [00:01<00:04, 50.27it/s]
Loading 0:  27%|██▋       | 79/291 [00:01<00:04, 49.33it/s]
Loading 0:  29%|██▉       | 85/291 [00:01<00:05, 37.68it/s]
Loading 0:  31%|███▏      | 91/291 [00:01<00:05, 38.84it/s]
Loading 0:  33%|███▎      | 96/291 [00:02<00:04, 39.22it/s]
Loading 0:  35%|███▌      | 103/291 [00:02<00:04, 44.80it/s]
Loading 0:  37%|███▋      | 109/291 [00:02<00:04, 44.67it/s]
Loading 0:  39%|███▉      | 114/291 [00:02<00:03, 44.93it/s]
Loading 0:  42%|████▏     | 121/291 [00:02<00:03, 50.15it/s]
Loading 0:  44%|████▎     | 127/291 [00:02<00:03, 43.93it/s]
Loading 0:  45%|████▌     | 132/291 [00:02<00:03, 43.79it/s]
Loading 0:  48%|████▊     | 139/291 [00:02<00:03, 49.85it/s]
Loading 0:  50%|████▉     | 145/291 [00:03<00:03, 47.84it/s]
Loading 0:  52%|█████▏    | 150/291 [00:03<00:03, 45.73it/s]
Loading 0:  54%|█████▍    | 157/291 [00:03<00:02, 50.15it/s]
Loading 0:  56%|█████▌    | 163/291 [00:03<00:02, 47.92it/s]
Loading 0:  58%|█████▊    | 168/291 [00:03<00:02, 46.74it/s]
Loading 0:  60%|██████    | 176/291 [00:03<00:02, 54.88it/s]
Loading 0:  63%|██████▎   | 182/291 [00:03<00:02, 48.08it/s]
Loading 0:  65%|██████▍   | 188/291 [00:04<00:02, 36.10it/s]
Loading 0:  66%|██████▋   | 193/291 [00:04<00:02, 37.00it/s]
Loading 0:  68%|██████▊   | 199/291 [00:04<00:02, 38.81it/s]
Loading 0:  70%|███████   | 204/291 [00:04<00:02, 39.44it/s]
Loading 0:  73%|███████▎  | 211/291 [00:04<00:01, 45.23it/s]
Loading 0:  75%|███████▍  | 217/291 [00:04<00:01, 44.42it/s]
Loading 0:  76%|███████▋  | 222/291 [00:04<00:01, 44.61it/s]
Loading 0:  79%|███████▊  | 229/291 [00:04<00:01, 49.92it/s]
Loading 0:  81%|████████  | 235/291 [00:05<00:01, 45.09it/s]
Loading 0:  82%|████████▏ | 240/291 [00:05<00:01, 45.07it/s]
Loading 0:  84%|████████▍ | 245/291 [00:05<00:01, 45.90it/s]
Loading 0:  86%|████████▌ | 250/291 [00:05<00:01, 37.97it/s]
Loading 0:  88%|████████▊ | 255/291 [00:05<00:00, 36.67it/s]
Loading 0:  89%|████████▉ | 259/291 [00:05<00:00, 33.55it/s]
Loading 0:  90%|█████████ | 263/291 [00:05<00:00, 34.10it/s]
Loading 0:  92%|█████████▏| 267/291 [00:06<00:00, 30.83it/s]
Loading 0:  93%|█████████▎| 271/291 [00:06<00:00, 31.39it/s]
Loading 0:  95%|█████████▍| 275/291 [00:06<00:00, 28.27it/s]
Loading 0:  96%|█████████▌| 280/291 [00:06<00:00, 32.12it/s]
Loading 0:  98%|█████████▊| 284/291 [00:06<00:00, 29.97it/s]
Loading 0:  99%|█████████▉| 288/291 [00:12<00:01,  2.30it/s]
                                                            

Job jic062-dpo-v1-3-v3-mkmlizer completed after 75.48s with status: succeeded
Stopping job with name jic062-dpo-v1-3-v3-mkmlizer
Pipeline stage MKMLizer completed in 77.28s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.17s
Running pipeline stage ISVCDeployer
Creating inference service jic062-dpo-v1-3-v3
Waiting for inference service jic062-dpo-v1-3-v3 to be ready
Failed to get response for submission blend_katim_2024-08-22: ('http://zonemercy-lexical-nemov8-5966-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '{"error":"ValueError : [TypeError(\\"\'numpy.int64\' object is not iterable\\"), TypeError(\'vars() argument must have __dict__ attribute\')]"}')
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service jic062-dpo-v1-3-v3 ready after 181.0745780467987s
Pipeline stage ISVCDeployer completed in 181.51s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.382113456726074s
Received healthy response to inference request in 2.037576913833618s
Received healthy response to inference request in 1.7823302745819092s
Received healthy response to inference request in 1.9536364078521729s
Received healthy response to inference request in 1.8089790344238281s
5 requests
0 failed requests
5th percentile: 1.7876600265502929
10th percentile: 1.7929897785186768
20th percentile: 1.8036492824554444
30th percentile: 1.8379105091094972
40th percentile: 1.895773458480835
50th percentile: 1.9536364078521729
60th percentile: 1.987212610244751
70th percentile: 2.020788812637329
80th percentile: 2.1064842224121096
90th percentile: 2.2442988395690917
95th percentile: 2.3132061481475827
99th percentile: 2.368331995010376
mean time: 1.9929272174835204
Pipeline stage StressChecker completed in 11.57s
jic062-dpo-v1-3_v3 status is now deployed due to DeploymentManager action
jic062-dpo-v1-3_v3 status is now inactive due to auto deactivation removed underperforming models
jic062-dpo-v1-3_v3 status is now torndown due to DeploymentManager action