developer_uid: chace9580
submission_id: jic062-dpo-v1-3-c500_v1
model_name: jic062-dpo-v1-3-c500_v1
model_group: jic062/dpo-v1.3-c500
status: torndown
timestamp: 2024-08-30T02:21:22+00:00
num_battles: 10187
num_wins: 5463
celo_rating: 1258.34
family_friendly_score: 0.0
submission_type: basic
model_repo: jic062/dpo-v1.3-c500
model_architecture: LlamaForCausalLM
model_num_parameters: 8030261248.0
best_of: 16
max_input_tokens: 512
max_output_tokens: 64
display_name: jic062-dpo-v1-3-c500_v1
is_internal_developer: False
language_model: jic062/dpo-v1.3-c500
model_size: 8B
ranking_group: single
us_pacific_date: 2024-08-29
win_ratio: 0.5362717188573672
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '|eot_id|', '<|end_of_text|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage MKMLizer
Starting job with name jic062-dpo-v1-3-c500-v1-mkmlizer
Waiting for job on jic062-dpo-v1-3-c500-v1-mkmlizer to finish
Stopping job with name jic062-dpo-v1-3-c500-v1-mkmlizer
%s, retrying in %s seconds...
Starting job with name jic062-dpo-v1-3-c500-v1-mkmlizer
Waiting for job on jic062-dpo-v1-3-c500-v1-mkmlizer to finish
jic062-dpo-v1-3-c500-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
jic062-dpo-v1-3-c500-v1-mkmlizer: ║     _____            __           __                                ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║       /___/                                                         ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  Version: 0.10.1                                                    ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  https://mk1.ai                                                     ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  belonging to:                                                      ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  Chai Research Corp.                                                ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-c500-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
jic062-dpo-v1-3-c500-v1-mkmlizer: Downloaded to shared memory in 35.987s
jic062-dpo-v1-3-c500-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp5c043acq, device:0
jic062-dpo-v1-3-c500-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
jic062-dpo-v1-3-c500-v1-mkmlizer: quantized model in 26.198s
jic062-dpo-v1-3-c500-v1-mkmlizer: Processed model jic062/dpo-v1.3-c500 in 62.185s
jic062-dpo-v1-3-c500-v1-mkmlizer: creating bucket guanaco-mkml-models
jic062-dpo-v1-3-c500-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
jic062-dpo-v1-3-c500-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/jic062-dpo-v1-3-c500-v1
jic062-dpo-v1-3-c500-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/jic062-dpo-v1-3-c500-v1/config.json
jic062-dpo-v1-3-c500-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/jic062-dpo-v1-3-c500-v1/special_tokens_map.json
jic062-dpo-v1-3-c500-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/jic062-dpo-v1-3-c500-v1/tokenizer_config.json
jic062-dpo-v1-3-c500-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/jic062-dpo-v1-3-c500-v1/tokenizer.json
jic062-dpo-v1-3-c500-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/jic062-dpo-v1-3-c500-v1/flywheel_model.0.safetensors
jic062-dpo-v1-3-c500-v1-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/291 [00:00<00:07, 36.70it/s]
Loading 0:   4%|▍         | 13/291 [00:00<00:04, 57.25it/s]
Loading 0:   7%|▋         | 19/291 [00:00<00:05, 49.00it/s]
Loading 0:   9%|▊         | 25/291 [00:00<00:05, 51.03it/s]
Loading 0:  11%|█         | 31/291 [00:00<00:04, 53.07it/s]
Loading 0:  13%|█▎        | 37/291 [00:00<00:05, 48.25it/s]
Loading 0:  14%|█▍        | 42/291 [00:00<00:05, 47.81it/s]
Loading 0:  17%|█▋        | 49/291 [00:00<00:04, 53.60it/s]
Loading 0:  19%|█▉        | 55/291 [00:01<00:04, 49.62it/s]
Loading 0:  21%|██        | 61/291 [00:01<00:04, 50.98it/s]
Loading 0:  23%|██▎       | 68/291 [00:01<00:04, 47.69it/s]
Loading 0:  26%|██▌       | 75/291 [00:01<00:04, 52.69it/s]
Loading 0:  28%|██▊       | 81/291 [00:01<00:04, 51.66it/s]
Loading 0:  30%|██▉       | 87/291 [00:01<00:06, 33.28it/s]
Loading 0:  32%|███▏      | 94/291 [00:02<00:05, 39.34it/s]
Loading 0:  34%|███▍      | 100/291 [00:02<00:04, 40.22it/s]
Loading 0:  36%|███▌      | 105/291 [00:02<00:04, 40.81it/s]
Loading 0:  38%|███▊      | 112/291 [00:02<00:03, 46.90it/s]
Loading 0:  41%|████      | 118/291 [00:02<00:03, 45.23it/s]
Loading 0:  42%|████▏     | 123/291 [00:02<00:03, 44.75it/s]
Loading 0:  45%|████▍     | 130/291 [00:02<00:03, 49.93it/s]
Loading 0:  47%|████▋     | 136/291 [00:02<00:03, 48.59it/s]
Loading 0:  49%|████▉     | 142/291 [00:03<00:02, 50.39it/s]
Loading 0:  51%|█████     | 149/291 [00:03<00:02, 47.94it/s]
Loading 0:  54%|█████▍    | 158/291 [00:03<00:02, 50.00it/s]
Loading 0:  57%|█████▋    | 166/291 [00:03<00:02, 56.25it/s]
Loading 0:  59%|█████▉    | 172/291 [00:03<00:02, 51.70it/s]
Loading 0:  62%|██████▏   | 179/291 [00:03<00:02, 53.43it/s]
Loading 0:  64%|██████▎   | 185/291 [00:03<00:01, 53.63it/s]
Loading 0:  66%|██████▌   | 191/291 [00:04<00:02, 34.00it/s]
Loading 0:  67%|██████▋   | 196/291 [00:04<00:02, 34.34it/s]
Loading 0:  69%|██████▉   | 202/291 [00:04<00:02, 38.96it/s]
Loading 0:  71%|███████▏  | 208/291 [00:04<00:02, 38.92it/s]
Loading 0:  73%|███████▎  | 213/291 [00:04<00:01, 39.29it/s]
Loading 0:  75%|███████▌  | 219/291 [00:04<00:01, 42.87it/s]
Loading 0:  77%|███████▋  | 224/291 [00:04<00:01, 43.93it/s]
Loading 0:  79%|███████▊  | 229/291 [00:05<00:01, 45.13it/s]
Loading 0:  81%|████████  | 235/291 [00:05<00:01, 43.41it/s]
Loading 0:  82%|████████▏ | 240/291 [00:05<00:01, 43.81it/s]
Loading 0:  85%|████████▍ | 247/291 [00:05<00:00, 49.23it/s]
Loading 0:  87%|████████▋ | 253/291 [00:05<00:00, 46.59it/s]
Loading 0:  89%|████████▊ | 258/291 [00:05<00:00, 45.49it/s]
Loading 0:  91%|█████████ | 265/291 [00:05<00:00, 49.46it/s]
Loading 0:  93%|█████████▎| 271/291 [00:05<00:00, 46.25it/s]
Loading 0:  95%|█████████▍| 276/291 [00:06<00:00, 44.99it/s]
Loading 0:  97%|█████████▋| 281/291 [00:06<00:00, 45.41it/s]
Loading 0:  98%|█████████▊| 286/291 [00:06<00:00, 39.55it/s]
Loading 0: 100%|██████████| 291/291 [00:11<00:00,  3.03it/s]
                                                            

Job jic062-dpo-v1-3-c500-v1-mkmlizer completed after 83.87s with status: succeeded
Stopping job with name jic062-dpo-v1-3-c500-v1-mkmlizer
Pipeline stage MKMLizer completed in 85.00s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.08s
Running pipeline stage ISVCDeployer
Creating inference service jic062-dpo-v1-3-c500-v1
Waiting for inference service jic062-dpo-v1-3-c500-v1 to be ready
Inference service jic062-dpo-v1-3-c500-v1 ready after 180.69870853424072s
Pipeline stage ISVCDeployer completed in 181.04s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.187284231185913s
Received healthy response to inference request in 2.489800453186035s
Received healthy response to inference request in 1.571079969406128s
Received healthy response to inference request in 1.5896375179290771s
Received healthy response to inference request in 1.912306308746338s
5 requests
0 failed requests
5th percentile: 1.5747914791107178
10th percentile: 1.5785029888153077
20th percentile: 1.5859260082244873
30th percentile: 1.6541712760925293
40th percentile: 1.7832387924194335
50th percentile: 1.912306308746338
60th percentile: 2.022297477722168
70th percentile: 2.132288646697998
80th percentile: 2.2477874755859375
90th percentile: 2.3687939643859863
95th percentile: 2.4292972087860107
99th percentile: 2.47769980430603
mean time: 1.9500216960906982
Pipeline stage StressChecker completed in 10.86s
jic062-dpo-v1-3-c500_v1 status is now deployed due to DeploymentManager action
jic062-dpo-v1-3-c500_v1 status is now inactive due to auto deactivation removed underperforming models
jic062-dpo-v1-3-c500_v1 status is now torndown due to DeploymentManager action