jic062-dpo-v1-3

submission_id: jic062-dpo-v1-3_v2

developer_uid: chace9580

best_of: 16

celo_rating: 1255.2

display_name: jic062-dpo-v1-3_v2

family_friendly_score: 0.0

formatter: {'memory_template': "<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n{bot_name}'s Persona: {memory}\n\n", 'prompt_template': '{prompt}<|eot_id|>', 'bot_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}: {message}<|eot_id|>', 'user_template': '<|start_header_id|>user<|end_header_id|>\n\n{user_name}: {message}<|eot_id|>', 'response_template': '<|start_header_id|>assistant<|end_header_id|>\n\n{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.6, 'top_p': 0.9, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '|eot_id|'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}

is_internal_developer: False

language_model: jic062/dpo-v1.3

max_input_tokens: 512

max_output_tokens: 64

model_architecture: LlamaForCausalLM

model_group: jic062/dpo-v1.3

model_name: jic062-dpo-v1-3_v2

model_num_parameters: 8030261248.0

model_repo: jic062/dpo-v1.3

model_size: 8B

num_battles: 11026

num_wins: 5803

ranking_group: single

status: torndown

submission_type: basic

timestamp: 2024-08-30T15:44:52+00:00

us_pacific_date: 2024-08-30

win_ratio: 0.5263014692544894

Resubmit model

Running pipeline stage MKMLizer
Starting job with name jic062-dpo-v1-3-v2-mkmlizer
Waiting for job on jic062-dpo-v1-3-v2-mkmlizer to finish
Stopping job with name jic062-dpo-v1-3-v2-mkmlizer
%s, retrying in %s seconds...
Starting job with name jic062-dpo-v1-3-v2-mkmlizer
Waiting for job on jic062-dpo-v1-3-v2-mkmlizer to finish
jic062-dpo-v1-3-v2-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
jic062-dpo-v1-3-v2-mkmlizer: ║     _____            __           __                                ║
jic062-dpo-v1-3-v2-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
jic062-dpo-v1-3-v2-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
jic062-dpo-v1-3-v2-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
jic062-dpo-v1-3-v2-mkmlizer: ║       /___/                                                         ║
jic062-dpo-v1-3-v2-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v2-mkmlizer: ║  Version: 0.10.1                                                    ║
jic062-dpo-v1-3-v2-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
jic062-dpo-v1-3-v2-mkmlizer: ║  https://mk1.ai                                                     ║
jic062-dpo-v1-3-v2-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v2-mkmlizer: ║  The license key for the current software has been verified as      ║
jic062-dpo-v1-3-v2-mkmlizer: ║  belonging to:                                                      ║
jic062-dpo-v1-3-v2-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v2-mkmlizer: ║  Chai Research Corp.                                                ║
jic062-dpo-v1-3-v2-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
jic062-dpo-v1-3-v2-mkmlizer: ║  Expiration: 2024-10-15 23:59:59                                    ║
jic062-dpo-v1-3-v2-mkmlizer: ║                                                                     ║
jic062-dpo-v1-3-v2-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
jic062-dpo-v1-3-v2-mkmlizer: Downloaded to shared memory in 22.049s
jic062-dpo-v1-3-v2-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp2q6vo0cx, device:0
jic062-dpo-v1-3-v2-mkmlizer: Saving flywheel model at /dev/shm/model_cache
jic062-dpo-v1-3-v2-mkmlizer: quantized model in 26.758s
jic062-dpo-v1-3-v2-mkmlizer: Processed model jic062/dpo-v1.3 in 48.807s
jic062-dpo-v1-3-v2-mkmlizer: creating bucket guanaco-mkml-models
jic062-dpo-v1-3-v2-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
jic062-dpo-v1-3-v2-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/jic062-dpo-v1-3-v2
jic062-dpo-v1-3-v2-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v2/config.json
jic062-dpo-v1-3-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v2/tokenizer_config.json
jic062-dpo-v1-3-v2-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v2/special_tokens_map.json
jic062-dpo-v1-3-v2-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/jic062-dpo-v1-3-v2/tokenizer.json
jic062-dpo-v1-3-v2-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/jic062-dpo-v1-3-v2/flywheel_model.0.safetensors
jic062-dpo-v1-3-v2-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/291 [00:00<00:08, 35.71it/s]
Loading 0:   5%|▍         | 14/291 [00:00<00:06, 44.90it/s]
Loading 0:   8%|▊         | 22/291 [00:00<00:04, 54.64it/s]
Loading 0:  10%|▉         | 28/291 [00:00<00:05, 51.18it/s]
Loading 0:  12%|█▏        | 34/291 [00:00<00:04, 52.72it/s]
Loading 0:  14%|█▍        | 41/291 [00:00<00:05, 49.06it/s]
Loading 0:  17%|█▋        | 50/291 [00:01<00:04, 49.18it/s]
Loading 0:  20%|█▉        | 57/291 [00:01<00:04, 53.80it/s]
Loading 0:  22%|██▏       | 63/291 [00:01<00:04, 53.74it/s]
Loading 0:  24%|██▎       | 69/291 [00:01<00:04, 44.94it/s]
Loading 0:  26%|██▌       | 75/291 [00:01<00:04, 48.10it/s]
Loading 0:  28%|██▊       | 81/291 [00:01<00:04, 49.87it/s]
Loading 0:  30%|██▉       | 87/291 [00:02<00:06, 30.87it/s]
Loading 0:  32%|███▏      | 93/291 [00:02<00:05, 35.42it/s]
Loading 0:  34%|███▎      | 98/291 [00:02<00:05, 37.47it/s]
Loading 0:  36%|███▌      | 104/291 [00:02<00:05, 36.31it/s]
Loading 0:  38%|███▊      | 112/291 [00:02<00:04, 43.86it/s]
Loading 0:  40%|████      | 117/291 [00:02<00:03, 44.55it/s]
Loading 0:  42%|████▏     | 122/291 [00:02<00:04, 38.57it/s]
Loading 0:  45%|████▍     | 130/291 [00:02<00:03, 47.14it/s]
Loading 0:  47%|████▋     | 136/291 [00:03<00:03, 45.10it/s]
Loading 0:  48%|████▊     | 141/291 [00:03<00:03, 42.80it/s]
Loading 0:  51%|█████     | 147/291 [00:03<00:03, 45.70it/s]
Loading 0:  52%|█████▏    | 152/291 [00:03<00:03, 45.00it/s]
Loading 0:  54%|█████▍    | 157/291 [00:03<00:03, 43.97it/s]
Loading 0:  56%|█████▌    | 162/291 [00:03<00:02, 45.37it/s]
Loading 0:  57%|█████▋    | 167/291 [00:03<00:03, 36.41it/s]
Loading 0:  59%|█████▉    | 173/291 [00:03<00:02, 41.03it/s]
Loading 0:  62%|██████▏   | 179/291 [00:04<00:02, 45.56it/s]
Loading 0:  63%|██████▎   | 184/291 [00:04<00:02, 45.04it/s]
Loading 0:  65%|██████▍   | 189/291 [00:04<00:03, 27.62it/s]
Loading 0:  67%|██████▋   | 194/291 [00:04<00:03, 30.78it/s]
Loading 0:  69%|██████▉   | 202/291 [00:04<00:02, 39.86it/s]
Loading 0:  71%|███████   | 207/291 [00:04<00:02, 41.36it/s]
Loading 0:  73%|███████▎  | 212/291 [00:05<00:02, 36.57it/s]
Loading 0:  75%|███████▌  | 219/291 [00:05<00:01, 42.65it/s]
Loading 0:  77%|███████▋  | 224/291 [00:05<00:01, 42.75it/s]
Loading 0:  79%|███████▊  | 229/291 [00:05<00:01, 43.36it/s]
Loading 0:  81%|████████  | 235/291 [00:05<00:01, 40.68it/s]
Loading 0:  82%|████████▏ | 240/291 [00:05<00:01, 40.79it/s]
Loading 0:  85%|████████▍ | 247/291 [00:05<00:00, 46.55it/s]
Loading 0:  87%|████████▋ | 252/291 [00:05<00:00, 46.71it/s]
Loading 0:  88%|████████▊ | 257/291 [00:06<00:00, 38.04it/s]
Loading 0:  91%|█████████ | 264/291 [00:06<00:00, 44.11it/s]
Loading 0:  92%|█████████▏| 269/291 [00:06<00:00, 44.54it/s]
Loading 0:  94%|█████████▍| 274/291 [00:06<00:00, 44.38it/s]
Loading 0:  96%|█████████▌| 279/291 [00:06<00:00, 44.93it/s]
Loading 0:  98%|█████████▊| 284/291 [00:06<00:00, 36.55it/s]
Loading 0:  99%|█████████▉| 288/291 [00:12<00:01,  2.82it/s]
                                                            
Job jic062-dpo-v1-3-v2-mkmlizer completed after 75.98s with status: succeeded
Stopping job with name jic062-dpo-v1-3-v2-mkmlizer
Pipeline stage MKMLizer completed in 77.80s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.11s
Running pipeline stage ISVCDeployer
Creating inference service jic062-dpo-v1-3-v2
Waiting for inference service jic062-dpo-v1-3-v2 to be ready
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Inference service jic062-dpo-v1-3-v2 ready after 492.4824733734131s
Pipeline stage ISVCDeployer completed in 493.25s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3654305934906006s
Received healthy response to inference request in 2.7250125408172607s
Received healthy response to inference request in 1.6971094608306885s
Received healthy response to inference request in 1.9278478622436523s
Received healthy response to inference request in 1.6586127281188965s
5 requests
0 failed requests
5th percentile: 1.666312074661255
10th percentile: 1.6740114212036132
20th percentile: 1.68941011428833
30th percentile: 1.7432571411132813
40th percentile: 1.8355525016784668
50th percentile: 1.9278478622436523
60th percentile: 2.1028809547424316
70th percentile: 2.277914047241211
80th percentile: 2.437346982955933
90th percentile: 2.5811797618865966
95th percentile: 2.6530961513519284
99th percentile: 2.7106292629241944
mean time: 2.0748026371002197
Pipeline stage StressChecker completed in 12.44s
jic062-dpo-v1-3_v2 status is now deployed due to DeploymentManager action
jic062-dpo-v1-3_v2 status is now inactive due to auto deactivation removed underperforming models
jic062-dpo-v1-3_v2 status is now torndown due to DeploymentManager action